[2025-09-23T17:00:01.617145] [INFO ] [MAIN ] Using last completed trading day: 2025-09-23 [2025-09-23T17:00:01.617885] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-23T17:00:01.618051] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-23T17:00:01.618128] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-23T17:00:03.164767] [DEBUG] [SYMBOL ] Found 2424 valid NYSE symbols. [2025-09-23T17:00:03.164943] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-23T17:00:03.165148] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-23T17:00:03.165953] [INFO ] [LOCAL ] Symbols cache updated with 2372 symbols. [2025-09-23T17:00:03.166010] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-23T17:00:03.166041] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-23T17:00:03.166099] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-23T17:00:03.166193] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-23T17:00:03.166586] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-23T17:00:03.166638] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-23T17:00:03.166858] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-23T17:00:03.166913] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2372 valid symbols. [2025-09-23T17:00:03.166945] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-23T17:00:03.166975] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-23T17:00:03.192085] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/BRFS.csv (symbol BRFS no longer active). [2025-09-23T17:00:03.194536] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-23T17:00:03.218512] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/BRFS.csv (symbol BRFS no longer active). [2025-09-23T17:00:03.220970] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-09-23T17:00:03.221025] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-23T17:00:03.221056] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-23T17:00:03.221083] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-23T17:00:03.221360] [WARN ] [STATE ] State set to: RUNNING [2025-09-23T17:00:03.221483] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-23T17:00:03.221890] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-23T17:00:03.221941] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-23T17:00:03.221972] [INFO ] [MAIN ] Starting incremental update for 2372 symbols. [2025-09-23T17:00:03.222000] [INFO ] [MAIN ] Running in parallel mode [2025-09-23T17:00:03.222178] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2372 symbols [2025-09-23T17:00:03.852613] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:03.890727] [DEBUG] [LOCAL ] AACT: No existing data file found in primary storage. [2025-09-23T17:00:03.933955] [WARN ] [MAIN ] AACT: No existing data found, performing full refresh instead. [2025-09-23T17:00:04.036201] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:04.043386] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:04.072402] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-23T17:00:04.114515] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-23T17:00:04.115845] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-23T17:00:04.116743] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-23T17:00:04.114430] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:04.136065] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-23T17:00:04.167446] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-23T17:00:04.180992] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-23T17:00:04.205867] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-23T17:00:04.211716] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-23T17:00:04.211829] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-23T17:00:04.682265] [DEBUG] [LOCAL ] A: Loaded 50829 existing records from primary storage. [2025-09-23T17:00:04.710624] [INFO ] [MAIN ] A: Loaded 50829 existing records. [2025-09-23T17:00:04.744236] [DEBUG] [LOCAL ] AA: Loaded 53614 existing records from primary storage. [2025-09-23T17:00:04.880601] [INFO ] [MAIN ] AA: Loaded 53614 existing records. [2025-09-23T17:00:04.917617] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:05.002056] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-23T17:00:05.408852] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:05.392516] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:05.430139] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-23T17:00:05.430292] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:05.430428] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-23T17:00:05.430748] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-23T17:00:05.424302] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-23T17:00:05.430856] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-23T17:00:05.432203] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-23T17:00:05.432268] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-23T17:00:05.443677] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-23T17:00:05.454106] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-23T17:00:06.146063] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:06.172590] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-23T17:00:06.172303] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:06.173049] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-23T17:00:06.972953] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T17:00:06.974129] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-23T17:00:07.666790] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-23T17:00:07.667834] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-23T17:00:08.207857] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T17:00:08.209072] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-23T17:00:08.230112] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:00:08.231297] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-23T17:00:08.557921] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T17:00:08.559836] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-23T17:00:08.597878] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T17:00:08.599260] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-23T17:00:09.074787] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T17:00:09.075998] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-23T17:00:09.102639] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:00:09.105146] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-23T17:00:09.316383] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (3.14 seconds). [2025-09-23T17:00:09.327857] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-23T17:00:09.364210] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-23T17:00:09.374410] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-23T17:00:09.382454] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-23T17:00:09.383449] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-23T17:00:09.638081] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-23T17:00:09.639082] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-23T17:00:09.682049] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T17:00:09.684675] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-23T17:00:09.888108] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-23T17:00:09.889015] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-23T17:00:10.142694] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-23T17:00:10.143845] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-23T17:00:10.196949] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T17:00:10.199478] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-23T17:00:10.456012] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T17:00:10.457131] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-23T17:00:10.881834] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T17:00:10.882672] [INFO ] [REMOTE ] AAM: Full fetch complete (961 records). [2025-09-23T17:00:10.882759] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-23T17:00:10.883296] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:00:10.883395] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:10.883463] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:10.883534] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-23T17:00:10.883624] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-23T17:00:10.883713] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-23T17:00:10.883774] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-23T17:00:10.883844] [INFO ] [MAIN ] Update Progress: 1/2372 symbols completed. AAM took 7.6s. Estimated remaining: 5h 2m 46s. Rate: 7.8 symbols/min [2025-09-23T17:00:11.066209] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:11.066532] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-23T17:00:11.066933] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-23T17:00:11.067622] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-23T17:00:11.067888] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-23T17:00:11.068003] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-23T17:00:11.068065] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-23T17:00:11.306008] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-23T17:00:11.405978] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-23T17:00:11.434993] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-23T17:00:11.500932] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:00:11.499868] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-23T17:00:11.561109] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:11.561529] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-23T17:00:11.562603] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-23T17:00:11.765949] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:11.766358] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-23T17:00:11.766983] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-23T17:00:12.067662] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T17:00:12.070668] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-23T17:00:12.833499] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T17:00:12.837550] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-23T17:00:12.900006] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T17:00:12.902998] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-23T17:00:13.144469] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T17:00:13.154311] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-23T17:00:13.214611] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T17:00:13.224978] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-23T17:00:13.611992] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T17:00:13.615919] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-23T17:00:14.645026] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T17:00:14.656978] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-23T17:00:14.750136] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:00:14.762349] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-23T17:00:15.058597] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T17:00:15.063667] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-23T17:00:15.763779] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-23T17:00:15.767200] [INFO ] [REMOTE ] AACT: Full fetch complete (11003 records). [2025-09-23T17:00:15.767275] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-23T17:00:15.957958] [WARN ] [VALIDATOR ] AACT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T17:00:15.958313] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:15.958434] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:15.958596] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-23T17:00:15.958764] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-23T17:00:15.958854] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-23T17:00:15.958918] [DEBUG] [LOCAL ] AACT: No derivative data file found to delete. [2025-09-23T17:00:15.958982] [INFO ] [MAIN ] Update Progress: 2/2372 symbols completed. AACT took 12.7s. Estimated remaining: 4h 11m 33s. Rate: 9.4 symbols/min [2025-09-23T17:00:16.135137] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:16.204470] [DEBUG] [LOCAL ] AAP: Loaded 52149 existing records from primary storage. [2025-09-23T17:00:16.204606] [INFO ] [MAIN ] AAP: Loaded 52149 existing records. [2025-09-23T17:00:16.383549] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T17:00:16.423992] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-23T17:00:16.424106] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:16.425211] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-23T17:00:16.425261] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-23T17:00:16.426686] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-23T17:00:16.426748] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-23T17:00:16.791077] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:16.791931] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-23T17:00:16.941424] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T17:00:16.947881] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-23T17:00:17.131170] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-23T17:00:17.143041] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-23T17:00:17.931208] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T17:00:17.937435] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-23T17:00:18.025388] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T17:00:18.036222] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-23T17:00:18.257794] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:00:18.268027] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-23T17:00:19.421540] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T17:00:19.426626] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-23T17:00:19.879803] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T17:00:19.890439] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-23T17:00:19.978053] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T17:00:19.989264] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-23T17:00:20.179446] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T17:00:20.185724] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-23T17:00:20.572454] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (3.43 seconds). [2025-09-23T17:00:20.584699] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-23T17:00:21.318787] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:00:21.329000] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-23T17:00:21.448235] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T17:00:21.461061] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-23T17:00:21.795084] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T17:00:21.801903] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-23T17:00:22.145994] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T17:00:22.160118] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-23T17:00:22.790628] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:00:22.803176] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-23T17:00:22.944121] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:00:22.960951] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-23T17:00:23.215019] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T17:00:23.221013] [INFO ] [REMOTE ] AAMI: Full fetch complete (30270 records). [2025-09-23T17:00:23.221112] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-23T17:00:23.428215] [WARN ] [VALIDATOR ] AAMI: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T17:00:23.428775] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:23.428869] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:23.428957] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-23T17:00:23.429071] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-23T17:00:23.429129] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-23T17:00:23.429174] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-23T17:00:23.429289] [INFO ] [MAIN ] Update Progress: 3/2372 symbols completed. AAMI took 12.5s. Estimated remaining: 4h 25m 57s. Rate: 8.9 symbols/min [2025-09-23T17:00:23.628018] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:23.668255] [DEBUG] [LOCAL ] AAT: Loaded 30600 existing records from primary storage. [2025-09-23T17:00:23.668428] [INFO ] [MAIN ] AAT: Loaded 30600 existing records. [2025-09-23T17:00:23.854200] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:23.854504] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-23T17:00:23.854566] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-23T17:00:23.855868] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-23T17:00:23.855967] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-23T17:00:24.208627] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T17:00:24.304343] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:24.300958] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-23T17:00:24.307393] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-23T17:00:24.408811] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:00:24.413780] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T17:00:24.431968] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-23T17:00:24.447033] [INFO ] [REMOTE ] A: Full fetch complete (72727 records). [2025-09-23T17:00:24.447295] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-23T17:00:24.449862] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:00:24.450103] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:24.450212] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:24.450309] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-23T17:00:24.450426] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-23T17:00:24.450496] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-09-23T17:00:24.451131] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-09-23T17:00:24.451930] [INFO ] [MAIN ] Update Progress: 4/2372 symbols completed. A took 21.2s. Estimated remaining: 3h 29m 28s. Rate: 11.3 symbols/min [2025-09-23T17:00:24.630518] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:24.630855] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-23T17:00:24.630916] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-23T17:00:24.631084] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-23T17:00:24.631186] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-23T17:00:24.631239] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-23T17:00:24.631275] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-23T17:00:25.018664] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:25.019111] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-23T17:00:25.225257] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:25.225771] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-23T17:00:25.226353] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-23T17:00:25.411917] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:00:25.419152] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-23T17:00:25.460036] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:25.460548] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-23T17:00:25.461209] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-23T17:00:25.676247] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:25.676608] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-23T17:00:25.677086] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-23T17:00:25.901477] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:25.901834] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-23T17:00:25.902296] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-23T17:00:25.943563] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T17:00:25.955075] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-23T17:00:26.048529] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T17:00:26.059604] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-23T17:00:26.129460] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:26.129773] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-23T17:00:26.130208] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-23T17:00:26.306197] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T17:00:26.311860] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-23T17:00:26.515207] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:26.515536] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-23T17:00:26.516140] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-23T17:00:27.301019] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T17:00:27.303314] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-23T17:00:27.322887] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:00:27.330149] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-23T17:00:27.404182] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T17:00:27.418048] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-23T17:00:27.621287] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T17:00:27.635523] [INFO ] [REMOTE ] AA: Full fetch complete (77520 records). [2025-09-23T17:00:27.635756] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-23T17:00:27.966968] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T17:00:27.976400] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-23T17:00:28.076314] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-23T17:00:28.076402] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-23T17:00:28.077798] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-23T17:00:28.077913] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-23T17:00:28.081540] [DEBUG] [LOCAL ] AA: Trimmed 77520 records to 53614 (keeping 200 days of data) [2025-09-23T17:00:28.448999] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T17:00:28.458118] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-23T17:00:28.457779] [DEBUG] [LOCAL ] AA: Primary data saved (53614 records). [2025-09-23T17:00:28.459044] [INFO ] [MAIN ] AA: Full history saved. [2025-09-23T17:00:28.459600] [INFO ] [MAIN ] Update Progress: 5/2372 symbols completed. AA took 25.2s. Estimated remaining: 3h 19m 7s. Rate: 11.9 symbols/min [2025-09-23T17:00:28.640620] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:28.651746] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T17:00:28.662036] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-23T17:00:28.696635] [DEBUG] [LOCAL ] AB: Loaded 28542 existing records from primary storage. [2025-09-23T17:00:28.696806] [INFO ] [MAIN ] AB: Loaded 28542 existing records. [2025-09-23T17:00:28.879447] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:28.879803] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-23T17:00:28.879969] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-23T17:00:28.881092] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-23T17:00:28.881241] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-23T17:00:29.267095] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T17:00:29.272194] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:29.283058] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-23T17:00:29.287045] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-23T17:00:29.421538] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T17:00:29.425182] [INFO ] [REMOTE ] AAUC: Full fetch complete (7322 records). [2025-09-23T17:00:29.425256] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-23T17:00:29.607523] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-23T17:00:29.607834] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:29.607947] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:29.608073] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-23T17:00:29.608325] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-23T17:00:29.608465] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-23T17:00:29.608629] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-23T17:00:29.608811] [INFO ] [MAIN ] Update Progress: 6/2372 symbols completed. AAUC took 5.2s. Estimated remaining: 2h 53m 25s. Rate: 13.6 symbols/min [2025-09-23T17:00:29.782375] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:29.807050] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:00:29.816296] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-23T17:00:29.896972] [DEBUG] [LOCAL ] ABBV: Loaded 53687 existing records from primary storage. [2025-09-23T17:00:29.897365] [INFO ] [MAIN ] ABBV: Loaded 53687 existing records. [2025-09-23T17:00:30.074547] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:30.074931] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-23T17:00:30.074987] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-23T17:00:30.076519] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-23T17:00:30.076582] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-23T17:00:30.427495] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:30.427849] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-23T17:00:31.209172] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T17:00:31.216208] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-23T17:00:31.598617] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-23T17:00:31.609478] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-23T17:00:31.681979] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T17:00:31.688460] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-23T17:00:32.498493] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:00:32.505971] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-23T17:00:32.727895] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T17:00:32.734396] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-23T17:00:33.062036] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-23T17:00:33.073274] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-23T17:00:33.482013] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T17:00:33.489964] [INFO ] [REMOTE ] AAP: Full fetch complete (74822 records). [2025-09-23T17:00:33.490104] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-23T17:00:33.490852] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:00:33.490955] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:33.491034] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:33.491129] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-23T17:00:33.491211] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-23T17:00:33.491250] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-09-23T17:00:33.491797] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-09-23T17:00:33.492190] [INFO ] [MAIN ] Update Progress: 7/2372 symbols completed. AAP took 17.5s. Estimated remaining: 2h 50m 27s. Rate: 13.9 symbols/min [2025-09-23T17:00:33.682601] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:33.725342] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T17:00:33.739668] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T17:00:33.738469] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-23T17:00:33.750735] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-23T17:00:33.783033] [DEBUG] [LOCAL ] ABCB: Loaded 30792 existing records from primary storage. [2025-09-23T17:00:33.783195] [INFO ] [MAIN ] ABCB: Loaded 30792 existing records. [2025-09-23T17:00:33.968540] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:33.968856] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-23T17:00:33.968914] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-23T17:00:33.969989] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-23T17:00:33.970051] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-23T17:00:34.325988] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:34.326346] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-23T17:00:34.689334] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T17:00:34.695999] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-23T17:00:35.093909] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:00:35.103790] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-23T17:00:35.224573] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-23T17:00:35.235637] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-23T17:00:35.736627] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T17:00:35.743248] [INFO ] [REMOTE ] AAT: Full fetch complete (42765 records). [2025-09-23T17:00:35.743387] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-23T17:00:35.869092] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:00:35.891736] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-23T17:00:36.150906] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-23T17:00:36.151001] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-23T17:00:36.151427] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-23T17:00:36.151473] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-23T17:00:36.152527] [DEBUG] [LOCAL ] AAT: Trimmed 42765 records to 30651 (keeping 200 days of data) [2025-09-23T17:00:36.364452] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T17:00:36.374571] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-23T17:00:36.397018] [DEBUG] [LOCAL ] AAT: Primary data saved (30651 records). [2025-09-23T17:00:36.397395] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-23T17:00:36.397500] [INFO ] [MAIN ] Update Progress: 8/2372 symbols completed. AAT took 13.0s. Estimated remaining: 2h 43m 23s. Rate: 14.5 symbols/min [2025-09-23T17:00:36.567306] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:36.625515] [DEBUG] [LOCAL ] ABEV: Loaded 53275 existing records from primary storage. [2025-09-23T17:00:36.625758] [INFO ] [MAIN ] ABEV: Loaded 53275 existing records. [2025-09-23T17:00:36.815560] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:36.816115] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-23T17:00:36.816290] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-23T17:00:36.818122] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-23T17:00:36.818302] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-23T17:00:36.970340] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:00:37.005174] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-23T17:00:37.196152] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-23T17:00:37.256444] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-23T17:00:37.309211] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:37.309702] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-23T17:00:37.327871] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:00:37.334525] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-23T17:00:37.991047] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:00:37.997729] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-23T17:00:38.393608] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T17:00:38.399291] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-23T17:00:38.843443] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T17:00:38.854382] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-23T17:00:39.076708] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T17:00:39.084424] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-23T17:00:39.250342] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T17:00:39.260197] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-23T17:00:39.300543] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-23T17:00:39.312947] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-23T17:00:40.044585] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T17:00:40.051109] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-23T17:00:40.231505] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T17:00:40.239628] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-23T17:00:40.268214] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T17:00:40.278899] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-23T17:00:41.144005] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:00:41.151289] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-23T17:00:41.224696] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:00:41.229330] [INFO ] [REMOTE ] AB: Full fetch complete (46023 records). [2025-09-23T17:00:41.229425] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-23T17:00:41.649778] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-23T17:00:41.652862] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-23T17:00:41.653489] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-23T17:00:41.653805] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-23T17:00:41.655708] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-23T17:00:41.668119] [DEBUG] [LOCAL ] AB: Trimmed 46023 records to 28399 (keeping 200 days of data) [2025-09-23T17:00:41.668009] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-23T17:00:41.874425] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T17:00:41.886811] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-23T17:00:41.891483] [DEBUG] [LOCAL ] AB: Primary data saved (28399 records). [2025-09-23T17:00:41.891569] [INFO ] [MAIN ] AB: Full history saved. [2025-09-23T17:00:41.893306] [INFO ] [MAIN ] Update Progress: 9/2372 symbols completed. AB took 13.4s. Estimated remaining: 2h 49m 13s. Rate: 14.0 symbols/min [2025-09-23T17:00:42.073424] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:42.090536] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:00:42.096825] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-23T17:00:42.114942] [DEBUG] [LOCAL ] ABG: Loaded 18829 existing records from primary storage. [2025-09-23T17:00:42.115092] [INFO ] [MAIN ] ABG: Loaded 18829 existing records. [2025-09-23T17:00:42.305236] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:42.305507] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-23T17:00:42.305556] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-23T17:00:42.306215] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-23T17:00:42.306277] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-23T17:00:42.662795] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:42.663127] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-23T17:00:43.094829] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T17:00:43.102195] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-23T17:00:44.205526] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:00:44.209003] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-23T17:00:44.702541] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-23T17:00:44.715160] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-23T17:00:44.788609] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-23T17:00:44.801400] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-23T17:00:45.194728] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-23T17:00:45.201833] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-23T17:00:45.709994] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T17:00:45.714350] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-23T17:00:46.463706] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T17:00:46.475029] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-23T17:00:46.489543] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:00:46.496566] [INFO ] [REMOTE ] ABCB: Full fetch complete (44327 records). [2025-09-23T17:00:46.496770] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-23T17:00:46.562874] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T17:00:46.653572] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-23T17:00:46.794634] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-23T17:00:46.896098] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-23T17:00:46.996981] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-23T17:00:46.997079] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-23T17:00:46.997543] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-23T17:00:46.997590] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-23T17:00:46.998901] [DEBUG] [LOCAL ] ABCB: Trimmed 44327 records to 30812 (keeping 200 days of data) [2025-09-23T17:00:47.181132] [DEBUG] [LOCAL ] ABCB: Primary data saved (30812 records). [2025-09-23T17:00:47.181321] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-23T17:00:47.181416] [INFO ] [MAIN ] Update Progress: 10/2372 symbols completed. ABCB took 13.7s. Estimated remaining: 2h 53m 3s. Rate: 13.6 symbols/min [2025-09-23T17:00:47.352713] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:47.369241] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T17:00:47.374417] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-23T17:00:47.402254] [DEBUG] [LOCAL ] ABM: Loaded 32357 existing records from primary storage. [2025-09-23T17:00:47.402428] [INFO ] [MAIN ] ABM: Loaded 32357 existing records. [2025-09-23T17:00:47.578514] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:47.578781] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-23T17:00:47.578833] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-23T17:00:47.579738] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-23T17:00:47.579799] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-23T17:00:47.932474] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:47.932842] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-23T17:00:48.080305] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:00:48.091708] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-23T17:00:48.402611] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T17:00:48.408829] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-23T17:00:48.630348] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T17:00:48.642140] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-23T17:00:48.946773] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T17:00:48.952610] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-23T17:00:48.975594] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T17:00:48.979059] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-23T17:00:49.638803] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T17:00:49.649716] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-23T17:00:49.713717] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:00:49.718123] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-23T17:00:49.837476] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T17:00:49.843370] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-23T17:00:50.448792] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T17:00:50.465543] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-23T17:00:50.473275] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T17:00:50.478152] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-23T17:00:50.882907] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T17:00:50.888069] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-23T17:00:51.015090] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T17:00:51.026584] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-23T17:00:51.235240] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T17:00:51.402335] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-23T17:00:51.912818] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:00:52.069992] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T17:00:52.078349] [INFO ] [REMOTE ] ABG: Full fetch complete (26356 records). [2025-09-23T17:00:52.078620] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-23T17:00:52.207452] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-23T17:00:52.317612] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T17:00:52.364102] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-09-23T17:00:52.369864] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-23T17:00:52.916423] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-23T17:00:52.925805] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-23T17:00:52.958940] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-23T17:00:52.985595] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-23T17:00:53.097576] [DEBUG] [LOCAL ] ABG: Trimmed 26356 records to 18794 (keeping 200 days of data) [2025-09-23T17:00:53.122112] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-23T17:00:53.122672] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-23T17:00:53.123431] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-23T17:00:53.123841] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-23T17:00:53.239985] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T17:00:53.249533] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 53686 (keeping 200 days of data) [2025-09-23T17:00:53.257751] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-23T17:00:53.397588] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:00:53.437820] [DEBUG] [LOCAL ] ABG: Primary data saved (18794 records). [2025-09-23T17:00:53.438400] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-23T17:00:53.438797] [INFO ] [MAIN ] Update Progress: 11/2372 symbols completed. ABG took 11.5s. Estimated remaining: 2h 59m 38s. Rate: 13.1 symbols/min [2025-09-23T17:00:53.621748] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:53.807482] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-23T17:00:53.871665] [DEBUG] [LOCAL ] ABBV: Primary data saved (53686 records). [2025-09-23T17:00:53.872081] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-23T17:00:53.874029] [INFO ] [MAIN ] Update Progress: 12/2372 symbols completed. ABBV took 24.3s. Estimated remaining: 2h 46m 2s. Rate: 14.2 symbols/min [2025-09-23T17:00:53.875191] [DEBUG] [LOCAL ] ABR: Loaded 52125 existing records from primary storage. [2025-09-23T17:00:53.920601] [INFO ] [MAIN ] ABR: Loaded 52125 existing records. [2025-09-23T17:00:54.286271] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:54.346971] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:54.347256] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-23T17:00:54.347332] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-23T17:00:54.349518] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-23T17:00:54.349609] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-23T17:00:54.707960] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-09-23T17:00:54.708401] [INFO ] [MAIN ] ABT: Loaded 53620 existing records. [2025-09-23T17:00:54.900559] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:54.917215] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-23T17:00:55.001347] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:55.003907] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T17:00:55.009519] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-23T17:00:55.010198] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-23T17:00:55.034020] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-23T17:00:55.034217] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-23T17:00:55.109009] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T17:00:55.153490] [INFO ] [REMOTE ] ABEV: Full fetch complete (77199 records). [2025-09-23T17:00:55.153702] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-23T17:00:55.413841] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-23T17:00:55.818418] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:55.862949] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-23T17:00:55.863039] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-23T17:00:55.863761] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-23T17:00:55.863827] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-23T17:00:55.865454] [DEBUG] [LOCAL ] ABEV: Trimmed 77199 records to 53274 (keeping 200 days of data) [2025-09-23T17:00:56.177358] [DEBUG] [LOCAL ] ABEV: Primary data saved (53274 records). [2025-09-23T17:00:56.177499] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-23T17:00:56.179087] [INFO ] [MAIN ] Update Progress: 13/2372 symbols completed. ABEV took 19.8s. Estimated remaining: 2h 40m 10s. Rate: 14.7 symbols/min [2025-09-23T17:00:56.214262] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-23T17:00:56.356336] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:56.383821] [DEBUG] [LOCAL ] ACA: Loaded 23948 existing records from primary storage. [2025-09-23T17:00:56.383974] [INFO ] [MAIN ] ACA: Loaded 23948 existing records. [2025-09-23T17:00:56.569269] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:56.569544] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-23T17:00:56.569593] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-23T17:00:56.570517] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-23T17:00:56.570593] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-23T17:00:56.935424] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:56.983184] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T17:00:57.008928] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-23T17:00:57.022878] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T17:00:57.752705] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:00:57.802201] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-23T17:00:58.404034] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:00:58.602262] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-23T17:00:59.397897] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T17:00:59.407520] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-23T17:01:00.202182] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-23T17:01:00.479109] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T17:01:00.512308] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-23T17:01:01.002247] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-23T17:01:01.718959] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:01:01.802253] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-23T17:01:02.076404] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T17:01:02.602233] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-23T17:01:03.295978] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T17:01:03.402215] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-23T17:01:03.722604] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T17:01:03.729318] [INFO ] [REMOTE ] ABM: Full fetch complete (44481 records). [2025-09-23T17:01:03.729449] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-23T17:01:04.125149] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-23T17:01:04.125269] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-23T17:01:04.125769] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-23T17:01:04.125832] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-23T17:01:04.126967] [DEBUG] [LOCAL ] ABM: Trimmed 44481 records to 32493 (keeping 200 days of data) [2025-09-23T17:01:04.214309] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-23T17:01:04.327271] [DEBUG] [LOCAL ] ABM: Primary data saved (32493 records). [2025-09-23T17:01:04.327429] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-23T17:01:04.327522] [INFO ] [MAIN ] Update Progress: 14/2372 symbols completed. ABM took 17.1s. Estimated remaining: 2h 51m 32s. Rate: 13.7 symbols/min [2025-09-23T17:01:04.502585] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:04.502787] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-09-23T17:01:04.502851] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-09-23T17:01:04.503033] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-23T17:01:04.503076] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-23T17:01:04.503119] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-23T17:01:04.503158] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-23T17:01:04.883692] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:04.987975] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:01:05.002184] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-23T17:01:05.131335] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T17:01:05.802201] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-23T17:01:06.500246] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:01:06.602200] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-23T17:01:07.407539] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-23T17:01:07.413003] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T17:01:08.186795] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T17:01:08.202215] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-23T17:01:08.309605] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T17:01:09.002288] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-23T17:01:09.083614] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T17:01:09.802263] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-23T17:01:10.404997] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:01:10.602191] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-23T17:01:11.402169] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-23T17:01:11.952318] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T17:01:12.202189] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-23T17:01:12.240282] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T17:01:12.432320] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T17:01:13.002216] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-23T17:01:13.168314] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T17:01:13.802211] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-23T17:01:14.602229] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-23T17:01:14.729443] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T17:01:14.876623] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T17:01:15.402198] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-23T17:01:16.012549] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T17:01:16.202191] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-23T17:01:17.002209] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-23T17:01:17.164779] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:01:17.480417] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-23T17:01:17.802203] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-23T17:01:18.602232] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-23T17:01:18.809914] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T17:01:18.818395] [INFO ] [REMOTE ] ABR: Full fetch complete (75169 records). [2025-09-23T17:01:18.818539] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-23T17:01:19.206048] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:01:19.273877] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-23T17:01:19.274501] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-23T17:01:19.275410] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-23T17:01:19.275499] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-23T17:01:19.277378] [DEBUG] [LOCAL ] ABR: Trimmed 75169 records to 52103 (keeping 200 days of data) [2025-09-23T17:01:19.474873] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T17:01:19.407310] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-23T17:01:19.613101] [DEBUG] [LOCAL ] ABR: Primary data saved (52103 records). [2025-09-23T17:01:19.613273] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-23T17:01:19.614394] [INFO ] [MAIN ] Update Progress: 15/2372 symbols completed. ABR took 26.2s. Estimated remaining: 3h 20m 4s. Rate: 11.8 symbols/min [2025-09-23T17:01:19.788842] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:19.817688] [DEBUG] [LOCAL ] ACEL: Loaded 27250 existing records from primary storage. [2025-09-23T17:01:19.817828] [INFO ] [MAIN ] ACEL: Loaded 27250 existing records. [2025-09-23T17:01:19.996766] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:01:19.997039] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-23T17:01:19.997086] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-23T17:01:19.998071] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-23T17:01:19.998134] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-23T17:01:20.207337] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-23T17:01:20.352127] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:21.002203] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:01:21.002417] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-23T17:01:21.802200] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-23T17:01:21.870491] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T17:01:21.994705] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T17:01:22.602205] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-23T17:01:22.717847] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T17:01:23.402196] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-23T17:01:23.457093] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T17:01:24.202194] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-23T17:01:24.522497] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T17:01:25.002222] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-23T17:01:25.534369] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:01:25.802203] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-23T17:01:26.153200] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T17:01:26.602198] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-23T17:01:27.301040] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T17:01:27.402199] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-23T17:01:28.202154] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-23T17:01:28.246044] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:01:28.302914] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T17:01:29.002203] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-23T17:01:29.742827] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T17:01:29.751407] [INFO ] [REMOTE ] ABT: Full fetch complete (77194 records). [2025-09-23T17:01:29.751572] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-23T17:01:29.752514] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:01:29.752620] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:01:29.752709] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:01:29.752773] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-23T17:01:29.752836] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-23T17:01:29.752873] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-09-23T17:01:29.753333] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-09-23T17:01:29.753441] [INFO ] [MAIN ] Update Progress: 16/2372 symbols completed. ABT took 35.9s. Estimated remaining: 3h 32m 22s. Rate: 11.1 symbols/min [2025-09-23T17:01:29.810755] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-23T17:01:29.951813] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:29.952208] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-09-23T17:01:29.952284] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-09-23T17:01:29.952546] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-23T17:01:29.952680] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-23T17:01:29.952816] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-23T17:01:29.952872] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-23T17:01:30.280533] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:01:30.326307] [INFO ] [REMOTE ] ACA: Full fetch complete (34272 records). [2025-09-23T17:01:30.337954] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-23T17:01:30.359332] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:30.608103] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-23T17:01:30.746507] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-23T17:01:30.746752] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-23T17:01:30.747305] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-23T17:01:30.747437] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-23T17:01:30.748370] [DEBUG] [LOCAL ] ACA: Trimmed 34272 records to 23871 (keeping 200 days of data) [2025-09-23T17:01:30.857355] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T17:01:30.919874] [DEBUG] [LOCAL ] ACA: Primary data saved (23871 records). [2025-09-23T17:01:30.920017] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-23T17:01:30.920119] [INFO ] [MAIN ] Update Progress: 17/2372 symbols completed. ACA took 34.7s. Estimated remaining: 3h 22m 29s. Rate: 11.6 symbols/min [2025-09-23T17:01:31.091243] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:31.146574] [DEBUG] [LOCAL ] ACI: Loaded 53272 existing records from primary storage. [2025-09-23T17:01:31.146764] [INFO ] [MAIN ] ACI: Loaded 53272 existing records. [2025-09-23T17:01:31.340839] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:01:31.341116] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-23T17:01:31.341166] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-23T17:01:31.342599] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-23T17:01:31.342691] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-23T17:01:31.409064] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-23T17:01:31.732420] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:31.926033] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T17:01:32.202187] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-23T17:01:32.941037] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:01:33.002142] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-23T17:01:33.207483] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:01:33.802198] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-23T17:01:33.977273] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T17:01:34.602201] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-23T17:01:35.402175] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-23T17:01:35.662152] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T17:01:36.202173] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-23T17:01:36.293432] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-23T17:01:36.390838] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:01:36.400474] [INFO ] [REMOTE ] ACCO: Full fetch complete (54177 records). [2025-09-23T17:01:36.400676] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-23T17:01:36.797218] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-23T17:01:36.797337] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-23T17:01:36.797886] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-23T17:01:36.797956] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-23T17:01:36.799219] [DEBUG] [LOCAL ] ACCO: Trimmed 54177 records to 37773 (keeping 200 days of data) [2025-09-23T17:01:37.006490] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-23T17:01:37.015689] [DEBUG] [LOCAL ] ACCO: Primary data saved (37773 records). [2025-09-23T17:01:37.015905] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-23T17:01:37.016061] [INFO ] [MAIN ] Update Progress: 18/2372 symbols completed. ACCO took 32.7s. Estimated remaining: 3h 24m 26s. Rate: 11.5 symbols/min [2025-09-23T17:01:37.195136] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:37.245010] [DEBUG] [LOCAL ] ACM: Loaded 43137 existing records from primary storage. [2025-09-23T17:01:37.245209] [INFO ] [MAIN ] ACM: Loaded 43137 existing records. [2025-09-23T17:01:37.427160] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:01:37.427496] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-23T17:01:37.427553] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-23T17:01:37.428723] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-23T17:01:37.428787] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-23T17:01:37.815233] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-23T17:01:37.815144] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:37.853989] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T17:01:38.602237] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-23T17:01:38.678373] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T17:01:39.402175] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-23T17:01:39.847945] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T17:01:39.973358] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.97 seconds). [2025-09-23T17:01:40.202192] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-23T17:01:41.002277] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-23T17:01:41.143290] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T17:01:41.489040] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:01:41.784753] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T17:01:41.802152] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-23T17:01:42.602449] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-23T17:01:43.021600] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T17:01:43.025926] [INFO ] [REMOTE ] ACEL: Full fetch complete (38792 records). [2025-09-23T17:01:43.026034] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-23T17:01:43.026880] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:01:43.026965] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:01:43.027010] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:01:43.027094] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-23T17:01:43.027197] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-23T17:01:43.027269] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-09-23T17:01:43.028001] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-09-23T17:01:43.028114] [INFO ] [MAIN ] Update Progress: 19/2372 symbols completed. ACEL took 23.4s. Estimated remaining: 3h 26m 0s. Rate: 11.4 symbols/min [2025-09-23T17:01:43.200205] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:43.200454] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-09-23T17:01:43.200509] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-09-23T17:01:43.200699] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-23T17:01:43.200753] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-23T17:01:43.200841] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-23T17:01:43.200896] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-23T17:01:43.410034] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-23T17:01:43.560608] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:43.840207] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T17:01:44.202204] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-23T17:01:45.002270] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-23T17:01:45.145968] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T17:01:45.802251] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-23T17:01:45.864265] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T17:01:46.602235] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-23T17:01:47.183804] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-23T17:01:47.229388] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:01:47.402219] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-23T17:01:48.202202] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-23T17:01:48.238625] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T17:01:49.002245] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-23T17:01:49.488555] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T17:01:49.733255] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-23T17:01:49.802238] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-23T17:01:50.516122] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T17:01:50.602197] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-23T17:01:51.402282] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-23T17:01:52.194390] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:01:52.205781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-23T17:01:52.294187] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-23T17:01:53.019946] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-23T17:01:53.041919] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T17:01:53.704204] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:01:53.802207] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-23T17:01:54.602222] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-23T17:01:55.408507] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-23T17:01:55.432887] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T17:01:55.650420] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-23T17:01:56.202190] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-23T17:01:56.702928] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:01:56.731765] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-23T17:01:57.002222] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-23T17:01:57.802176] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-23T17:01:57.925102] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T17:01:58.213201] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:01:58.602224] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-23T17:01:59.014075] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:01:59.402198] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-23T17:02:00.202234] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-23T17:02:00.980271] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-23T17:02:01.002188] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-23T17:02:01.083272] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T17:02:01.802224] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-23T17:02:02.171587] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T17:02:02.218936] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T17:02:02.602217] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-23T17:02:03.402232] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-23T17:02:03.615203] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T17:02:03.945611] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:02:04.202203] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-23T17:02:05.002216] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-23T17:02:05.807354] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-23T17:02:05.827450] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-23T17:02:06.042337] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T17:02:06.351935] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:02:06.360929] [INFO ] [REMOTE ] ACM: Full fetch complete (62584 records). [2025-09-23T17:02:06.361113] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-23T17:02:06.610755] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-23T17:02:06.753666] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-23T17:02:06.753764] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-23T17:02:06.754357] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-23T17:02:06.754403] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-23T17:02:06.755870] [DEBUG] [LOCAL ] ACM: Trimmed 62584 records to 43154 (keeping 200 days of data) [2025-09-23T17:02:07.055990] [DEBUG] [LOCAL ] ACM: Primary data saved (43154 records). [2025-09-23T17:02:07.056261] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-23T17:02:07.056503] [INFO ] [MAIN ] Update Progress: 20/2372 symbols completed. ACM took 30.0s. Estimated remaining: 4h 2m 43s. Rate: 9.7 symbols/min [2025-09-23T17:02:07.235001] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:07.267958] [DEBUG] [LOCAL ] ACP: Loaded 31322 existing records from primary storage. [2025-09-23T17:02:07.268093] [INFO ] [MAIN ] ACP: Loaded 31322 existing records. [2025-09-23T17:02:07.407361] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-23T17:02:07.454087] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:07.454618] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-23T17:02:07.454739] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-23T17:02:07.455723] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-23T17:02:07.455794] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-23T17:02:07.836764] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:07.870383] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-23T17:02:08.182129] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:02:08.194911] [INFO ] [REMOTE ] ACI: Full fetch complete (77029 records). [2025-09-23T17:02:08.195050] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-23T17:02:08.211477] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-23T17:02:08.676620] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-23T17:02:08.676769] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-23T17:02:08.678154] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-23T17:02:08.678260] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-23T17:02:08.680210] [DEBUG] [LOCAL ] ACI: Trimmed 77029 records to 53272 (keeping 200 days of data) [2025-09-23T17:02:09.013718] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-23T17:02:09.039364] [DEBUG] [LOCAL ] ACI: Primary data saved (53272 records). [2025-09-23T17:02:09.039516] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-23T17:02:09.042412] [INFO ] [MAIN ] Update Progress: 21/2372 symbols completed. ACI took 38.1s. Estimated remaining: 3h 54m 46s. Rate: 10.0 symbols/min [2025-09-23T17:02:09.235698] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:09.247435] [DEBUG] [LOCAL ] ACR: Loaded 6375 existing records from primary storage. [2025-09-23T17:02:09.247606] [INFO ] [MAIN ] ACR: Loaded 6375 existing records. [2025-09-23T17:02:09.456259] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:09.456751] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-23T17:02:09.457272] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-23T17:02:09.457928] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-23T17:02:09.458088] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-23T17:02:09.720108] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T17:02:09.807340] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-23T17:02:09.882487] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:10.138225] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-23T17:02:10.602216] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-23T17:02:10.814467] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T17:02:10.826961] [INFO ] [REMOTE ] ACN: Full fetch complete (77100 records). [2025-09-23T17:02:10.827218] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-23T17:02:11.318397] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-23T17:02:11.331203] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-23T17:02:11.332144] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-23T17:02:11.332267] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-23T17:02:11.336364] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T17:02:11.351473] [DEBUG] [LOCAL ] ACN: Trimmed 77100 records to 53424 (keeping 200 days of data) [2025-09-23T17:02:11.435739] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-23T17:02:11.727057] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T17:02:11.756513] [DEBUG] [LOCAL ] ACN: Primary data saved (53424 records). [2025-09-23T17:02:11.756717] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-23T17:02:11.756854] [INFO ] [MAIN ] Update Progress: 22/2372 symbols completed. ACN took 28.7s. Estimated remaining: 3h 48m 50s. Rate: 10.3 symbols/min [2025-09-23T17:02:11.957925] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:11.958124] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-09-23T17:02:11.958247] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-09-23T17:02:11.958570] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-23T17:02:11.958684] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-23T17:02:11.958773] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-23T17:02:11.958816] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-23T17:02:12.213262] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-23T17:02:12.329916] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:13.002202] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-23T17:02:13.610279] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:02:13.802207] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-23T17:02:13.830022] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-23T17:02:13.843318] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-09-23T17:02:13.843527] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-23T17:02:13.844573] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:02:13.844722] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:02:13.844810] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:02:13.844925] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-23T17:02:13.844996] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-23T17:02:13.845048] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-09-23T17:02:13.845117] [DEBUG] [LOCAL ] ACHR: No derivative data file found to delete. [2025-09-23T17:02:13.845197] [INFO ] [MAIN ] Update Progress: 23/2372 symbols completed. ACHR took 44.1s. Estimated remaining: 3h 42m 21s. Rate: 10.6 symbols/min [2025-09-23T17:02:14.032994] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:14.042721] [DEBUG] [LOCAL ] ACV: Loaded 6905 existing records from primary storage. [2025-09-23T17:02:14.042890] [INFO ] [MAIN ] ACV: Loaded 6905 existing records. [2025-09-23T17:02:14.242263] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:14.242738] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-23T17:02:14.242795] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-23T17:02:14.243332] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-23T17:02:14.243394] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-23T17:02:14.607567] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-23T17:02:14.635959] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:14.641833] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T17:02:14.728912] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T17:02:15.402200] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-23T17:02:15.564586] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T17:02:15.898677] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T17:02:16.202192] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-23T17:02:16.613394] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T17:02:17.002218] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-23T17:02:17.412697] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T17:02:17.802216] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-23T17:02:18.602401] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-23T17:02:18.841169] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T17:02:19.163318] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T17:02:19.402200] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-23T17:02:20.180061] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T17:02:20.202152] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-23T17:02:20.605988] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T17:02:21.002199] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-23T17:02:21.802240] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-23T17:02:22.363964] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T17:02:22.602181] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-23T17:02:22.642013] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T17:02:23.035124] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:02:23.402197] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-23T17:02:24.202201] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-23T17:02:24.537281] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:02:24.855059] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T17:02:25.002211] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-23T17:02:25.802257] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-23T17:02:26.097265] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T17:02:26.371536] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T17:02:26.602250] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-23T17:02:27.402217] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-23T17:02:28.202260] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-23T17:02:28.271958] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T17:02:28.644077] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T17:02:28.928164] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:02:29.002169] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-23T17:02:29.466546] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T17:02:29.467922] [INFO ] [REMOTE ] ACR: Full fetch complete (8564 records). [2025-09-23T17:02:29.468001] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-23T17:02:29.803949] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-23T17:02:29.888874] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-23T17:02:29.888971] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-23T17:02:29.889199] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-23T17:02:29.889241] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-23T17:02:29.889744] [DEBUG] [LOCAL ] ACR: Trimmed 8564 records to 6346 (keeping 200 days of data) [2025-09-23T17:02:29.930636] [DEBUG] [LOCAL ] ACR: Primary data saved (6346 records). [2025-09-23T17:02:29.930819] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-23T17:02:29.930909] [INFO ] [MAIN ] Update Progress: 24/2372 symbols completed. ACR took 20.9s. Estimated remaining: 3h 59m 13s. Rate: 9.8 symbols/min [2025-09-23T17:02:30.098947] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:30.160609] [DEBUG] [LOCAL ] ACVA: Loaded 49361 existing records from primary storage. [2025-09-23T17:02:30.160860] [INFO ] [MAIN ] ACVA: Loaded 49361 existing records. [2025-09-23T17:02:30.342465] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:30.342877] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-23T17:02:30.342942] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-23T17:02:30.344239] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-23T17:02:30.344304] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-23T17:02:30.607385] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-23T17:02:30.712053] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:31.062553] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:02:31.402205] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-23T17:02:31.526734] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T17:02:32.202201] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-23T17:02:32.334507] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:02:33.002231] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-23T17:02:33.716739] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T17:02:33.802224] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-23T17:02:34.033462] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T17:02:34.602238] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-23T17:02:34.938093] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T17:02:35.082449] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T17:02:35.402231] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-23T17:02:36.202196] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-23T17:02:36.528594] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T17:02:37.002260] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-23T17:02:37.038242] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T17:02:37.802220] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-23T17:02:38.382573] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T17:02:38.602255] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-23T17:02:38.793826] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T17:02:39.227299] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:02:39.402230] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-23T17:02:40.202233] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-23T17:02:40.409770] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T17:02:40.414807] [INFO ] [REMOTE ] ACP: Full fetch complete (47616 records). [2025-09-23T17:02:40.414992] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-23T17:02:40.415753] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:02:40.415873] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:02:40.415919] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:02:40.415960] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-23T17:02:40.416034] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-23T17:02:40.416090] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-09-23T17:02:40.416789] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-09-23T17:02:40.416888] [INFO ] [MAIN ] Update Progress: 25/2372 symbols completed. ACP took 33.4s. Estimated remaining: 4h 5m 57s. Rate: 9.5 symbols/min [2025-09-23T17:02:40.628231] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:40.628418] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-23T17:02:40.628457] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-23T17:02:40.628608] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-23T17:02:40.628679] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-23T17:02:40.628744] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-23T17:02:40.628780] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-23T17:02:40.922821] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T17:02:41.003819] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:41.003946] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-23T17:02:41.802236] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-23T17:02:42.020112] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:42.028343] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-23T17:02:42.031842] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T17:02:42.602238] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-23T17:02:42.818026] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:42.818317] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-23T17:02:43.402237] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-23T17:02:43.611979] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:43.612289] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-23T17:02:44.202224] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-23T17:02:44.403866] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:44.404221] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-23T17:02:45.002245] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-23T17:02:45.230808] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:45.231141] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-23T17:02:45.802222] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-23T17:02:46.005028] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:46.005360] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-23T17:02:46.602214] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-23T17:02:47.402274] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-23T17:02:47.914377] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:02:47.917277] [INFO ] [REMOTE ] ACV: Full fetch complete (9672 records). [2025-09-23T17:02:47.917475] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-23T17:02:48.212733] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-23T17:02:48.384066] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-23T17:02:48.384633] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-23T17:02:48.386441] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-23T17:02:48.386531] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-23T17:02:48.386075] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T17:02:48.387284] [DEBUG] [LOCAL ] ACV: Trimmed 9672 records to 6930 (keeping 200 days of data) [2025-09-23T17:02:48.442351] [DEBUG] [LOCAL ] ACV: Primary data saved (6930 records). [2025-09-23T17:02:48.442497] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-23T17:02:48.442592] [INFO ] [MAIN ] Update Progress: 26/2372 symbols completed. ACV took 34.6s. Estimated remaining: 4h 8m 28s. Rate: 9.4 symbols/min [2025-09-23T17:02:48.616803] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:48.617020] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-09-23T17:02:48.617058] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-09-23T17:02:48.617206] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-23T17:02:48.617248] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-23T17:02:48.617289] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-23T17:02:48.617320] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-23T17:02:48.661581] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:48.696384] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-23T17:02:49.004713] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-23T17:02:49.008729] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:49.802201] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-23T17:02:49.999038] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:49.999362] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-23T17:02:50.560909] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T17:02:50.602194] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-23T17:02:51.402231] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-23T17:02:51.813507] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:02:51.821528] [INFO ] [REMOTE ] ACRE: Full fetch complete (50413 records). [2025-09-23T17:02:51.821770] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-23T17:02:52.203010] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-23T17:02:52.253827] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-23T17:02:52.253922] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-23T17:02:52.254438] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-23T17:02:52.254482] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-23T17:02:52.255768] [DEBUG] [LOCAL ] ACRE: Trimmed 50413 records to 33501 (keeping 200 days of data) [2025-09-23T17:02:52.470187] [DEBUG] [LOCAL ] ACRE: Primary data saved (33501 records). [2025-09-23T17:02:52.470375] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-23T17:02:52.470475] [INFO ] [MAIN ] Update Progress: 27/2372 symbols completed. ACRE took 40.7s. Estimated remaining: 4h 4m 60s. Rate: 9.6 symbols/min [2025-09-23T17:02:52.707123] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:52.747472] [DEBUG] [LOCAL ] ADCT: Loaded 33810 existing records from primary storage. [2025-09-23T17:02:52.747676] [INFO ] [MAIN ] ADCT: Loaded 33810 existing records. [2025-09-23T17:02:52.952797] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:52.967046] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-23T17:02:52.967308] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-23T17:02:52.968550] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:02:52.968622] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-23T17:02:52.977577] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-23T17:02:53.009700] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-23T17:02:53.326845] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:02:53.402236] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:53.802273] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-23T17:02:54.206109] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T17:02:54.602245] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-23T17:02:55.171130] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:02:55.402243] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-23T17:02:55.847494] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T17:02:55.852194] [INFO ] [REMOTE ] AD: Full fetch complete (5930 records). [2025-09-23T17:02:55.852337] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-23T17:02:56.112307] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 30 unique days, need 200 days [2025-09-23T17:02:56.112557] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:02:56.112628] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:02:56.112713] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-23T17:02:56.112780] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-23T17:02:56.112817] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-23T17:02:56.112857] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-23T17:02:56.112913] [INFO ] [MAIN ] Update Progress: 28/2372 symbols completed. AD took 15.7s. Estimated remaining: 4h 1m 13s. Rate: 9.7 symbols/min [2025-09-23T17:02:56.208297] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-23T17:02:56.295940] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:56.357180] [DEBUG] [LOCAL ] ADM: Loaded 53397 existing records from primary storage. [2025-09-23T17:02:56.357351] [INFO ] [MAIN ] ADM: Loaded 53397 existing records. [2025-09-23T17:02:56.571019] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:56.571512] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-23T17:02:56.571627] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-23T17:02:56.581536] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-23T17:02:56.599308] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-23T17:02:56.608181] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:02:57.007505] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-23T17:02:57.169551] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:57.395127] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:02:57.802260] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-23T17:02:58.338993] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:02:58.602320] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-23T17:02:59.250733] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:02:59.402201] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-23T17:02:59.550136] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T17:03:00.202197] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-23T17:03:01.002253] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-23T17:03:01.508937] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-23T17:03:01.802217] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-23T17:03:02.548607] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-23T17:03:02.602144] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-23T17:03:03.402278] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-23T17:03:03.481282] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-23T17:03:04.202260] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-23T17:03:05.018331] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-23T17:03:05.030951] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-23T17:03:05.054398] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T17:03:05.538357] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (3.74 seconds). [2025-09-23T17:03:05.744698] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T17:03:05.802208] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-23T17:03:06.217380] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T17:03:06.602223] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-23T17:03:06.869027] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T17:03:07.402202] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-23T17:03:08.202199] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-23T17:03:08.507029] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T17:03:08.872467] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:03:09.002200] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-23T17:03:09.810994] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-23T17:03:09.829269] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T17:03:10.361037] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T17:03:10.602206] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-23T17:03:11.402214] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-23T17:03:11.570605] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T17:03:12.202195] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-23T17:03:12.287898] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:03:13.002204] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-23T17:03:13.296405] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T17:03:13.755664] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T17:03:13.802207] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-23T17:03:14.268515] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T17:03:14.602218] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-23T17:03:15.402222] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-23T17:03:16.202264] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-23T17:03:16.559992] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T17:03:16.568930] [INFO ] [REMOTE ] ACVA: Full fetch complete (70185 records). [2025-09-23T17:03:16.569079] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-23T17:03:16.848941] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (3.05 seconds). [2025-09-23T17:03:17.051057] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-23T17:03:17.052345] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-23T17:03:17.052273] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T17:03:17.058955] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-23T17:03:17.019452] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-23T17:03:17.060730] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-23T17:03:17.061029] [INFO ] [REMOTE ] ADCT: Full fetch complete (51593 records). [2025-09-23T17:03:17.061114] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-23T17:03:17.153688] [DEBUG] [LOCAL ] ACVA: Trimmed 70185 records to 49359 (keeping 200 days of data) [2025-09-23T17:03:17.567256] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-23T17:03:17.567581] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-23T17:03:17.568736] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-23T17:03:17.569208] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-23T17:03:17.578037] [DEBUG] [LOCAL ] ADCT: Trimmed 51593 records to 33951 (keeping 200 days of data) [2025-09-23T17:03:17.882592] [DEBUG] [LOCAL ] ADCT: Primary data saved (33951 records). [2025-09-23T17:03:17.883626] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-23T17:03:17.885712] [INFO ] [MAIN ] Update Progress: 29/2372 symbols completed. ADCT took 25.4s. Estimated remaining: 4h 22m 7s. Rate: 8.9 symbols/min [2025-09-23T17:03:18.144134] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:18.148163] [DEBUG] [LOCAL ] ACVA: Primary data saved (49359 records). [2025-09-23T17:03:18.148275] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-23T17:03:18.149478] [INFO ] [MAIN ] Update Progress: 30/2372 symbols completed. ACVA took 48.2s. Estimated remaining: 4h 13m 37s. Rate: 9.2 symbols/min [2025-09-23T17:03:18.367828] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:18.380918] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-23T17:03:18.392680] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-23T17:03:18.411158] [DEBUG] [LOCAL ] ADNT: Loaded 47567 existing records from primary storage. [2025-09-23T17:03:18.411299] [INFO ] [MAIN ] ADNT: Loaded 47567 existing records. [2025-09-23T17:03:18.625306] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:18.626170] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-23T17:03:18.640561] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-23T17:03:18.641697] [DEBUG] [LOCAL ] ADT: Loaded 53479 existing records from primary storage. [2025-09-23T17:03:18.641954] [INFO ] [MAIN ] ADT: Loaded 53479 existing records. [2025-09-23T17:03:18.664060] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-23T17:03:18.675243] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-23T17:03:18.977591] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:19.013995] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T17:03:19.067496] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-23T17:03:19.113547] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-23T17:03:19.138530] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-23T17:03:19.157893] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-23T17:03:19.163481] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-23T17:03:19.430875] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:19.449816] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-23T17:03:19.652989] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:19.992451] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T17:03:20.202198] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-23T17:03:20.517155] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T17:03:21.002198] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-23T17:03:21.144733] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T17:03:21.802266] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-23T17:03:21.837379] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T17:03:22.348457] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:03:22.355827] [INFO ] [REMOTE ] ADC: Full fetch complete (65918 records). [2025-09-23T17:03:22.355948] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-23T17:03:22.607393] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-23T17:03:22.771260] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-23T17:03:22.771344] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-23T17:03:22.772073] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-23T17:03:22.772140] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-23T17:03:22.773540] [DEBUG] [LOCAL ] ADC: Trimmed 65918 records to 46374 (keeping 200 days of data) [2025-09-23T17:03:23.120237] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:03:23.137099] [DEBUG] [LOCAL ] ADC: Primary data saved (46374 records). [2025-09-23T17:03:23.137266] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-23T17:03:23.137355] [INFO ] [MAIN ] Update Progress: 31/2372 symbols completed. ADC took 34.7s. Estimated remaining: 4h 11m 37s. Rate: 9.3 symbols/min [2025-09-23T17:03:23.306936] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:23.342824] [DEBUG] [LOCAL ] ADX: Loaded 27927 existing records from primary storage. [2025-09-23T17:03:23.342956] [INFO ] [MAIN ] ADX: Loaded 27927 existing records. [2025-09-23T17:03:23.407398] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-23T17:03:23.523408] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:23.523729] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-23T17:03:23.523785] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-23T17:03:23.524604] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-23T17:03:23.524700] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-23T17:03:23.888083] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:24.202231] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-23T17:03:24.275940] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T17:03:24.285014] [INFO ] [REMOTE ] ADM: Full fetch complete (77218 records). [2025-09-23T17:03:24.285165] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-23T17:03:24.679363] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-23T17:03:24.679444] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-23T17:03:24.680219] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-23T17:03:24.680285] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-23T17:03:24.681876] [DEBUG] [LOCAL ] ADM: Trimmed 77218 records to 53397 (keeping 200 days of data) [2025-09-23T17:03:25.002179] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-23T17:03:25.016327] [DEBUG] [LOCAL ] ADM: Primary data saved (53397 records). [2025-09-23T17:03:25.016478] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-23T17:03:25.016595] [INFO ] [MAIN ] Update Progress: 32/2372 symbols completed. ADM took 28.9s. Estimated remaining: 4h 5m 56s. Rate: 9.5 symbols/min [2025-09-23T17:03:25.188220] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T17:03:25.245946] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:25.272983] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T17:03:25.324212] [DEBUG] [LOCAL ] AEE: Loaded 50205 existing records from primary storage. [2025-09-23T17:03:25.324356] [INFO ] [MAIN ] AEE: Loaded 50205 existing records. [2025-09-23T17:03:25.506022] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:25.506313] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-23T17:03:25.506363] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-23T17:03:25.507544] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-23T17:03:25.507605] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-23T17:03:25.807358] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-23T17:03:25.866797] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:26.173847] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T17:03:26.602201] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-23T17:03:27.128235] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:03:27.402181] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-23T17:03:28.108373] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:03:28.202164] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-23T17:03:29.002226] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-23T17:03:29.212216] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:03:29.446882] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T17:03:29.802234] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-23T17:03:30.481139] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T17:03:30.602210] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-23T17:03:31.058915] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:03:31.402206] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-23T17:03:31.543883] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T17:03:32.202208] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-23T17:03:32.799499] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T17:03:33.002233] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-23T17:03:33.116113] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T17:03:33.802211] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-23T17:03:34.295291] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:03:34.602243] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-23T17:03:35.402295] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-23T17:03:35.567087] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T17:03:35.813531] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:03:36.202195] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-23T17:03:36.754882] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T17:03:37.002207] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-23T17:03:37.078196] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T17:03:37.802205] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-23T17:03:38.602237] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-23T17:03:38.752284] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T17:03:39.236289] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:03:39.402203] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-23T17:03:39.500714] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T17:03:40.202197] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-23T17:03:41.002207] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-23T17:03:41.241943] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T17:03:41.265483] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T17:03:41.802207] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-23T17:03:42.207221] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:03:42.602233] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-23T17:03:42.734195] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T17:03:43.402233] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-23T17:03:43.955696] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T17:03:44.202202] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-23T17:03:44.718872] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T17:03:44.725949] [INFO ] [REMOTE ] ADNT: Full fetch complete (67782 records). [2025-09-23T17:03:44.726056] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-23T17:03:44.726890] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:03:44.726985] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:03:44.727028] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:03:44.727065] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-23T17:03:44.727146] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-23T17:03:44.727201] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-09-23T17:03:44.727675] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-09-23T17:03:44.728324] [INFO ] [MAIN ] Update Progress: 33/2372 symbols completed. ADNT took 26.8s. Estimated remaining: 4h 21m 40s. Rate: 8.9 symbols/min [2025-09-23T17:03:44.897060] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:44.907974] [DEBUG] [LOCAL ] AEFC: Loaded 8633 existing records from primary storage. [2025-09-23T17:03:44.908095] [INFO ] [MAIN ] AEFC: Loaded 8633 existing records. [2025-09-23T17:03:45.007906] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-23T17:03:45.086795] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:45.087014] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-23T17:03:45.087060] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-23T17:03:45.087454] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-23T17:03:45.087514] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-23T17:03:45.394163] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T17:03:45.441119] [INFO ] [REMOTE ] ADX: Full fetch complete (42179 records). [2025-09-23T17:03:45.462387] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-23T17:03:45.487341] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:45.814991] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-23T17:03:45.868714] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-23T17:03:45.868811] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-23T17:03:45.869316] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-23T17:03:45.869380] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-23T17:03:45.870357] [DEBUG] [LOCAL ] ADX: Trimmed 42179 records to 27857 (keeping 200 days of data) [2025-09-23T17:03:46.045590] [DEBUG] [LOCAL ] ADX: Primary data saved (27857 records). [2025-09-23T17:03:46.045756] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-23T17:03:46.047170] [INFO ] [MAIN ] Update Progress: 34/2372 symbols completed. ADX took 22.9s. Estimated remaining: 4h 15m 23s. Rate: 9.2 symbols/min [2025-09-23T17:03:46.227202] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:46.280423] [DEBUG] [LOCAL ] AEG: Loaded 49596 existing records from primary storage. [2025-09-23T17:03:46.280568] [INFO ] [MAIN ] AEG: Loaded 49596 existing records. [2025-09-23T17:03:46.471200] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:46.471493] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-23T17:03:46.471550] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-23T17:03:46.472708] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-23T17:03:46.472779] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-23T17:03:46.607336] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-23T17:03:46.860549] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:46.869510] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T17:03:46.903270] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T17:03:47.402227] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-23T17:03:48.202148] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-23T17:03:48.280091] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T17:03:48.627003] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T17:03:49.002255] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-23T17:03:49.227381] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T17:03:49.802328] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-23T17:03:50.225447] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T17:03:50.602200] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-23T17:03:51.073081] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T17:03:51.092032] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T17:03:51.402215] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-23T17:03:51.872846] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T17:03:52.202217] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-23T17:03:53.002283] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-23T17:03:53.539932] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T17:03:53.802165] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-23T17:03:54.136247] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T17:03:54.602250] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-23T17:03:55.062978] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:03:55.402217] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-23T17:03:56.011249] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:03:56.202198] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-23T17:03:57.007308] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-23T17:03:57.023075] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T17:03:57.597885] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:03:57.638680] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T17:03:57.802215] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-23T17:03:58.602228] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-23T17:03:59.402233] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-23T17:03:59.490390] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T17:04:00.157572] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T17:04:00.202143] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-23T17:04:01.002222] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-23T17:04:01.082326] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T17:04:01.516559] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T17:04:01.602311] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:04:01.612355] [INFO ] [REMOTE ] ADT: Full fetch complete (76816 records). [2025-09-23T17:04:01.612555] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-23T17:04:01.613395] [FATAL] [VALIDATOR ] ADT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:04:01.613490] [FATAL] [MAIN ] ADT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:04:01.613534] [WARN ] [MAIN ] ADT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:04:01.613574] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-23T17:04:01.613634] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-09-23T17:04:01.613728] [INFO ] [LOCAL ] ADT: Starting deletion of derivative data. [2025-09-23T17:04:01.614394] [DEBUG] [LOCAL ] ADT: Deleted derivative data file. [2025-09-23T17:04:01.618440] [INFO ] [MAIN ] Update Progress: 35/2372 symbols completed. ADT took 43.5s. Estimated remaining: 4h 25m 18s. Rate: 8.8 symbols/min [2025-09-23T17:04:01.800900] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:01.802294] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-23T17:04:01.867127] [DEBUG] [LOCAL ] AEM: Loaded 53465 existing records from primary storage. [2025-09-23T17:04:01.867277] [INFO ] [MAIN ] AEM: Loaded 53465 existing records. [2025-09-23T17:04:02.063532] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:02.063873] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-23T17:04:02.063932] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-23T17:04:02.065436] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-23T17:04:02.065500] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-23T17:04:02.398753] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T17:04:02.477921] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:02.602248] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-23T17:04:03.402239] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-23T17:04:03.680273] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T17:04:04.202199] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-23T17:04:05.002216] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-23T17:04:05.802258] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-23T17:04:06.016589] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T17:04:06.018160] [INFO ] [REMOTE ] AEFC: Full fetch complete (12401 records). [2025-09-23T17:04:06.018229] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-23T17:04:06.382397] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-23T17:04:06.382492] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-23T17:04:06.382737] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-23T17:04:06.382798] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-23T17:04:06.383329] [DEBUG] [LOCAL ] AEFC: Trimmed 12401 records to 8595 (keeping 200 days of data) [2025-09-23T17:04:06.440812] [DEBUG] [LOCAL ] AEFC: Primary data saved (8595 records). [2025-09-23T17:04:06.440953] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-23T17:04:06.441038] [INFO ] [MAIN ] Update Progress: 36/2372 symbols completed. AEFC took 21.7s. Estimated remaining: 4h 23m 2s. Rate: 8.9 symbols/min [2025-09-23T17:04:06.613007] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:06.674390] [DEBUG] [LOCAL ] AEO: Loaded 53558 existing records from primary storage. [2025-09-23T17:04:06.674562] [INFO ] [MAIN ] AEO: Loaded 53558 existing records. [2025-09-23T17:04:06.857313] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:06.857749] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-23T17:04:06.857874] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-23T17:04:06.859099] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-23T17:04:06.859162] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-23T17:04:07.286011] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:07.286802] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-23T17:04:07.290750] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (3.89 seconds). [2025-09-23T17:04:07.356692] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-23T17:04:07.402162] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-23T17:04:07.465310] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T17:04:07.476531] [INFO ] [REMOTE ] AEE: Full fetch complete (72172 records). [2025-09-23T17:04:07.476709] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-23T17:04:07.478883] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:04:07.478976] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:04:07.479020] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:04:07.479090] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-23T17:04:07.479171] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-23T17:04:07.479228] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-09-23T17:04:07.479786] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-09-23T17:04:07.479888] [INFO ] [MAIN ] Update Progress: 37/2372 symbols completed. AEE took 42.5s. Estimated remaining: 4h 16m 55s. Rate: 9.1 symbols/min [2025-09-23T17:04:08.202287] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-23T17:04:08.815049] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T17:04:08.844591] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T17:04:09.002170] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-23T17:04:09.593290] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:04:09.802194] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-23T17:04:10.602232] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-23T17:04:10.860688] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T17:04:11.402171] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-23T17:04:11.452612] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:04:12.207261] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-23T17:04:12.221676] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T17:04:12.636359] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T17:04:13.002215] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-23T17:04:13.802203] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-23T17:04:13.841019] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T17:04:14.602189] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-23T17:04:14.694942] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:04:15.402214] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-23T17:04:15.436015] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T17:04:16.202249] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-23T17:04:16.808066] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T17:04:16.848095] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-23T17:04:17.002188] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-23T17:04:17.631999] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T17:04:17.802182] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-23T17:04:18.602218] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-23T17:04:19.652104] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-23T17:04:19.664139] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-23T17:04:19.851530] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-23T17:04:20.202232] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-23T17:04:21.151926] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-23T17:04:21.162940] [INFO ] [REMOTE ] AEG: Full fetch complete (69830 records). [2025-09-23T17:04:21.163105] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-23T17:04:21.164019] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:04:21.164113] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:04:21.164156] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:04:21.164220] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-23T17:04:21.164284] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-09-23T17:04:21.164318] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-09-23T17:04:21.164635] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-09-23T17:04:21.167788] [INFO ] [MAIN ] Update Progress: 38/2372 symbols completed. AEG took 35.1s. Estimated remaining: 4h 24m 3s. Rate: 8.8 symbols/min [2025-09-23T17:04:21.256404] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T17:04:21.267498] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-23T17:04:21.997149] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T17:04:22.008376] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-23T17:04:22.958553] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:04:22.970569] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-23T17:04:23.747160] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T17:04:23.759129] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-23T17:04:24.500460] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:04:24.512143] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-23T17:04:25.543156] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T17:04:25.555946] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-23T17:04:26.258771] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T17:04:26.267610] [INFO ] [REMOTE ] AEM: Full fetch complete (77123 records). [2025-09-23T17:04:26.267782] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-23T17:04:26.669389] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-23T17:04:26.669487] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-23T17:04:26.670277] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-23T17:04:26.670364] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-23T17:04:26.672090] [DEBUG] [LOCAL ] AEM: Trimmed 77123 records to 53465 (keeping 200 days of data) [2025-09-23T17:04:27.018047] [DEBUG] [LOCAL ] AEM: Primary data saved (53465 records). [2025-09-23T17:04:27.018464] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-23T17:04:27.019746] [INFO ] [MAIN ] Update Progress: 39/2372 symbols completed. AEM took 25.4s. Estimated remaining: 4h 23m 1s. Rate: 8.9 symbols/min [2025-09-23T17:04:27.971607] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-23T17:04:27.981672] [INFO ] [REMOTE ] AEO: Full fetch complete (77445 records). [2025-09-23T17:04:27.981905] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-23T17:04:28.412077] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-23T17:04:28.412157] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-23T17:04:28.412914] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-23T17:04:28.412979] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-23T17:04:28.414624] [DEBUG] [LOCAL ] AEO: Trimmed 77445 records to 53557 (keeping 200 days of data) [2025-09-23T17:04:28.770675] [DEBUG] [LOCAL ] AEO: Primary data saved (53557 records). [2025-09-23T17:04:28.770962] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-23T17:04:28.773482] [INFO ] [MAIN ] Update Progress: 40/2372 symbols completed. AEO took 22.3s. Estimated remaining: 4h 18m 2s. Rate: 9.0 symbols/min [2025-09-23T17:04:29.450234] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:29.500886] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:29.496760] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:29.502201] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:29.502841] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-09-23T17:04:29.503097] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-09-23T17:04:29.503813] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-23T17:04:29.504378] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-23T17:04:29.504547] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-23T17:04:29.504620] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-23T17:04:29.638092] [DEBUG] [LOCAL ] AFB: Loaded 11445 existing records from primary storage. [2025-09-23T17:04:29.638837] [INFO ] [MAIN ] AFB: Loaded 11445 existing records. [2025-09-23T17:04:30.027531] [DEBUG] [LOCAL ] AES: Loaded 53672 existing records from primary storage. [2025-09-23T17:04:30.067309] [INFO ] [MAIN ] AES: Loaded 53672 existing records. [2025-09-23T17:04:30.078490] [DEBUG] [LOCAL ] AESI: Loaded 49488 existing records from primary storage. [2025-09-23T17:04:30.151838] [INFO ] [MAIN ] AESI: Loaded 49488 existing records. [2025-09-23T17:04:30.141606] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:30.293206] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:30.349722] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-23T17:04:30.376029] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-23T17:04:30.355273] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-23T17:04:30.414423] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-23T17:04:30.440561] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-23T17:04:30.617205] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:30.656284] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-23T17:04:30.656206] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:30.661531] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-23T17:04:30.678850] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-23T17:04:30.678906] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-23T17:04:30.685160] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-23T17:04:30.690373] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-23T17:04:30.690481] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-23T17:04:30.695703] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-23T17:04:31.522603] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:31.540103] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-23T17:04:31.719430] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:31.736764] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-23T17:04:31.742509] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:31.743919] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-23T17:04:32.073942] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T17:04:32.082839] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-23T17:04:32.259682] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T17:04:32.262579] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-23T17:04:32.834345] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:04:32.837742] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-23T17:04:32.968516] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:04:32.977980] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-23T17:04:33.298270] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:04:33.301183] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-23T17:04:33.411324] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:04:33.420781] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-23T17:04:33.779951] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T17:04:33.802143] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-23T17:04:33.894806] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:04:34.188529] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:04:34.602237] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-23T17:04:35.177343] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T17:04:35.196116] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T17:04:35.402172] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-23T17:04:35.443385] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T17:04:36.202235] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-23T17:04:36.911789] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T17:04:37.002269] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-23T17:04:37.769002] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T17:04:37.802192] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-23T17:04:38.602182] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-23T17:04:38.863303] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T17:04:39.402166] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-23T17:04:39.664157] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T17:04:39.920208] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:04:40.202212] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-23T17:04:40.854740] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T17:04:41.002196] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-23T17:04:41.609402] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:04:41.637557] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T17:04:41.802271] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-23T17:04:42.602262] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-23T17:04:43.234152] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T17:04:43.266415] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T17:04:43.402206] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-23T17:04:44.202190] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-23T17:04:45.002253] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-23T17:04:45.484062] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T17:04:45.802209] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-23T17:04:45.942741] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-23T17:04:46.602211] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-23T17:04:46.769209] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T17:04:47.213906] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T17:04:47.232356] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:04:47.402258] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-23T17:04:48.202215] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-23T17:04:48.661109] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T17:04:48.950374] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T17:04:49.002173] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-23T17:04:49.802209] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-23T17:04:50.309223] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T17:04:50.321777] [INFO ] [REMOTE ] AER: Full fetch complete (69498 records). [2025-09-23T17:04:50.321926] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-23T17:04:50.603061] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-23T17:04:50.581254] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T17:04:50.635838] [INFO ] [REMOTE ] AFB: Full fetch complete (16525 records). [2025-09-23T17:04:50.647446] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-23T17:04:50.875853] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-23T17:04:50.881077] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-23T17:04:50.886968] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-23T17:04:50.887050] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-23T17:04:50.942738] [DEBUG] [LOCAL ] AER: Trimmed 69498 records to 48687 (keeping 200 days of data) [2025-09-23T17:04:51.272602] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-23T17:04:51.272733] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-23T17:04:51.273017] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-23T17:04:51.273091] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-23T17:04:51.273741] [DEBUG] [LOCAL ] AFB: Trimmed 16525 records to 11406 (keeping 200 days of data) [2025-09-23T17:04:51.415472] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-23T17:04:51.530455] [DEBUG] [LOCAL ] AER: Primary data saved (48687 records). [2025-09-23T17:04:51.531955] [DEBUG] [LOCAL ] AFB: Primary data saved (11406 records). [2025-09-23T17:04:51.532190] [INFO ] [MAIN ] AER: Full history saved. [2025-09-23T17:04:51.532330] [INFO ] [MAIN ] Update Progress: 41/2372 symbols completed. AER took 22.8s. Estimated remaining: 4h 33m 11s. Rate: 8.5 symbols/min [2025-09-23T17:04:51.532442] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-23T17:04:51.532986] [INFO ] [MAIN ] Update Progress: 42/2372 symbols completed. AFB took 22.8s. Estimated remaining: 4h 26m 34s. Rate: 8.7 symbols/min [2025-09-23T17:04:51.872121] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:51.888862] [DEBUG] [LOCAL ] AFG: No existing data file found in primary storage. [2025-09-23T17:04:51.890056] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:51.890123] [WARN ] [MAIN ] AFG: No existing data found, performing full refresh instead. [2025-09-23T17:04:51.890962] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-23T17:04:51.891040] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-23T17:04:51.891107] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-09-23T17:04:51.891144] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-23T17:04:51.986788] [DEBUG] [LOCAL ] AFGB: Loaded 2450 existing records from primary storage. [2025-09-23T17:04:52.002256] [INFO ] [MAIN ] AFGB: Loaded 2450 existing records. [2025-09-23T17:04:52.320558] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:52.377879] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-23T17:04:52.416512] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-23T17:04:52.427119] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-23T17:04:52.442903] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-23T17:04:52.552113] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:52.613308] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-23T17:04:52.909907] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T17:04:52.958920] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:52.995789] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T17:04:53.007293] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-23T17:04:53.434818] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T17:04:53.676739] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T17:04:53.802206] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-23T17:04:54.602204] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-23T17:04:54.966608] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-23T17:04:55.133601] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:04:55.402240] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-23T17:04:56.202190] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-23T17:04:56.741944] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:04:57.002203] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-23T17:04:57.802182] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-23T17:04:57.907771] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T17:04:58.602180] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-23T17:04:58.806009] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T17:04:58.814951] [INFO ] [REMOTE ] AESI: Full fetch complete (70216 records). [2025-09-23T17:04:58.815096] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-23T17:04:59.030819] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T17:04:59.277039] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-23T17:04:59.277132] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-23T17:04:59.277848] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-23T17:04:59.277914] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-23T17:04:59.281812] [DEBUG] [LOCAL ] AESI: Trimmed 70216 records to 49508 (keeping 200 days of data) [2025-09-23T17:04:59.402255] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-23T17:04:59.591317] [DEBUG] [LOCAL ] AESI: Primary data saved (49508 records). [2025-09-23T17:04:59.591475] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-23T17:04:59.593238] [INFO ] [MAIN ] Update Progress: 43/2372 symbols completed. AESI took 30.8s. Estimated remaining: 4h 27m 32s. Rate: 8.7 symbols/min [2025-09-23T17:04:59.772173] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:59.775307] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T17:04:59.781094] [DEBUG] [LOCAL ] AFGC: Loaded 2558 existing records from primary storage. [2025-09-23T17:04:59.781228] [INFO ] [MAIN ] AFGC: Loaded 2558 existing records. [2025-09-23T17:05:00.020131] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:00.020371] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-23T17:05:00.020419] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-23T17:05:00.020638] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-23T17:05:00.020725] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-23T17:05:00.207452] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-23T17:05:00.379800] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:00.430852] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T17:05:01.002245] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-23T17:05:01.541445] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:05:01.760043] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:05:01.802144] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-23T17:05:02.602203] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-23T17:05:03.402250] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-23T17:05:03.749089] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T17:05:03.798356] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T17:05:04.202207] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-23T17:05:04.675833] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:05:05.002212] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-23T17:05:05.356239] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T17:05:05.532026] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T17:05:05.802213] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-23T17:05:06.174316] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-23T17:05:06.602246] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-23T17:05:07.371541] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T17:05:07.402229] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-23T17:05:07.787605] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T17:05:08.202195] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-23T17:05:09.002205] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-23T17:05:09.344631] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T17:05:09.378082] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T17:05:09.802339] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-23T17:05:10.602449] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-23T17:05:11.402224] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-23T17:05:11.632933] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T17:05:11.643113] [INFO ] [REMOTE ] AES: Full fetch complete (77724 records). [2025-09-23T17:05:11.643290] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-23T17:05:11.755414] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T17:05:11.861401] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:05:12.119911] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-23T17:05:12.120004] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-23T17:05:12.120736] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-23T17:05:12.120803] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-23T17:05:12.122763] [DEBUG] [LOCAL ] AES: Trimmed 77724 records to 53672 (keeping 200 days of data) [2025-09-23T17:05:12.214184] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-23T17:05:12.452238] [DEBUG] [LOCAL ] AES: Primary data saved (53672 records). [2025-09-23T17:05:12.452397] [INFO ] [MAIN ] AES: Full history saved. [2025-09-23T17:05:12.452499] [INFO ] [MAIN ] Update Progress: 44/2372 symbols completed. AES took 43.7s. Estimated remaining: 4h 32m 41s. Rate: 8.5 symbols/min [2025-09-23T17:05:12.637779] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:12.641927] [DEBUG] [LOCAL ] AFGD: Loaded 1879 existing records from primary storage. [2025-09-23T17:05:12.642014] [INFO ] [MAIN ] AFGD: Loaded 1879 existing records. [2025-09-23T17:05:12.817763] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:12.818023] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-23T17:05:12.818105] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-23T17:05:12.818345] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-23T17:05:12.818408] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-23T17:05:13.008424] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-23T17:05:13.183974] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:13.439292] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T17:05:13.488190] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T17:05:13.489306] [INFO ] [REMOTE ] AFGB: Full fetch complete (3641 records). [2025-09-23T17:05:13.489379] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-23T17:05:13.814600] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-23T17:05:13.856392] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-23T17:05:13.856467] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-23T17:05:13.856586] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-23T17:05:13.856623] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-23T17:05:13.857013] [DEBUG] [LOCAL ] AFGB: Trimmed 3641 records to 2417 (keeping 200 days of data) [2025-09-23T17:05:13.872370] [DEBUG] [LOCAL ] AFGB: Primary data saved (2417 records). [2025-09-23T17:05:13.872443] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-23T17:05:13.872514] [INFO ] [MAIN ] Update Progress: 45/2372 symbols completed. AFGB took 22.3s. Estimated remaining: 4h 27m 44s. Rate: 8.7 symbols/min [2025-09-23T17:05:14.038432] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:14.042428] [DEBUG] [LOCAL ] AFGE: Loaded 2534 existing records from primary storage. [2025-09-23T17:05:14.042499] [INFO ] [MAIN ] AFGE: Loaded 2534 existing records. [2025-09-23T17:05:14.225550] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:14.225870] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-23T17:05:14.225923] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-23T17:05:14.226173] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-23T17:05:14.226246] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-23T17:05:14.431925] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T17:05:14.607303] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-23T17:05:14.653974] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:14.972369] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-23T17:05:15.402205] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-23T17:05:16.202202] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-23T17:05:16.465055] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T17:05:16.621055] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T17:05:17.002216] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-23T17:05:17.437207] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T17:05:17.802200] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-23T17:05:18.102888] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-23T17:05:18.602242] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-23T17:05:19.402208] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-23T17:05:19.700705] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-23T17:05:19.767498] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:05:20.202201] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-23T17:05:20.521392] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T17:05:21.002212] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-23T17:05:21.332955] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T17:05:21.802194] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-23T17:05:22.173043] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-23T17:05:22.602192] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-23T17:05:22.895184] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-23T17:05:23.402261] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-23T17:05:23.851982] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T17:05:24.202276] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-23T17:05:24.505229] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-23T17:05:25.002214] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-23T17:05:25.802203] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-23T17:05:26.297789] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T17:05:26.303569] [INFO ] [REMOTE ] AFG: Full fetch complete (45744 records). [2025-09-23T17:05:26.303706] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-23T17:05:26.412033] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:05:26.607301] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-23T17:05:26.720913] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-23T17:05:26.721008] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-23T17:05:26.721509] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-23T17:05:26.721570] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-23T17:05:26.722608] [DEBUG] [LOCAL ] AFG: Trimmed 45744 records to 32602 (keeping 200 days of data) [2025-09-23T17:05:26.925861] [DEBUG] [LOCAL ] AFG: Primary data saved (32602 records). [2025-09-23T17:05:26.926002] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-23T17:05:26.926080] [INFO ] [MAIN ] Update Progress: 46/2372 symbols completed. AFG took 35.4s. Estimated remaining: 4h 32m 48s. Rate: 8.5 symbols/min [2025-09-23T17:05:27.104524] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:27.164383] [DEBUG] [LOCAL ] AFL: Loaded 53151 existing records from primary storage. [2025-09-23T17:05:27.168215] [INFO ] [MAIN ] AFL: Loaded 53151 existing records. [2025-09-23T17:05:27.168131] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T17:05:27.351723] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:27.351981] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-23T17:05:27.352030] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-23T17:05:27.353486] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-23T17:05:27.353716] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-23T17:05:27.409938] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-23T17:05:27.722273] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:28.202234] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-23T17:05:29.002238] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-23T17:05:29.452933] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T17:05:29.802248] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-23T17:05:30.120362] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T17:05:30.236554] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T17:05:30.602200] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-23T17:05:31.006975] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (3.60 seconds). [2025-09-23T17:05:31.402261] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-23T17:05:31.810886] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T17:05:32.202173] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-23T17:05:32.274898] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T17:05:32.539350] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-23T17:05:33.002198] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-23T17:05:33.649604] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T17:05:33.802259] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-23T17:05:34.204339] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T17:05:34.205981] [INFO ] [REMOTE ] AFGD: Full fetch complete (3219 records). [2025-09-23T17:05:34.206078] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-23T17:05:34.206675] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:05:34.206784] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:05:34.206880] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:05:34.206973] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-23T17:05:34.207065] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-09-23T17:05:34.207262] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-09-23T17:05:34.207802] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-09-23T17:05:34.207930] [INFO ] [MAIN ] Update Progress: 47/2372 symbols completed. AFGD took 21.8s. Estimated remaining: 4h 32m 53s. Rate: 8.5 symbols/min [2025-09-23T17:05:34.457290] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:34.537099] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-09-23T17:05:34.537297] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-09-23T17:05:34.611559] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-23T17:05:34.824366] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:34.824781] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-23T17:05:34.824888] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-23T17:05:34.826711] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-23T17:05:34.826796] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-23T17:05:35.187392] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T17:05:35.295337] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:35.402190] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-23T17:05:36.202198] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-23T17:05:36.620268] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T17:05:36.621396] [INFO ] [REMOTE ] AFGC: Full fetch complete (3705 records). [2025-09-23T17:05:36.621465] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-23T17:05:36.990972] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-23T17:05:36.991182] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-23T17:05:36.991394] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-23T17:05:36.991468] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-23T17:05:36.992022] [DEBUG] [LOCAL ] AFGC: Trimmed 3705 records to 2566 (keeping 200 days of data) [2025-09-23T17:05:37.004370] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-23T17:05:37.011429] [DEBUG] [LOCAL ] AFGC: Primary data saved (2566 records). [2025-09-23T17:05:37.011677] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-23T17:05:37.011869] [INFO ] [MAIN ] Update Progress: 48/2372 symbols completed. AFGC took 37.4s. Estimated remaining: 4h 29m 21s. Rate: 8.6 symbols/min [2025-09-23T17:05:37.153733] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T17:05:37.234879] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:37.301524] [DEBUG] [LOCAL ] AGCO: Loaded 42600 existing records from primary storage. [2025-09-23T17:05:37.301725] [INFO ] [MAIN ] AGCO: Loaded 42600 existing records. [2025-09-23T17:05:37.482326] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:37.482599] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-23T17:05:37.482672] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-23T17:05:37.484055] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-23T17:05:37.484118] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-23T17:05:37.810343] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-23T17:05:37.841853] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:38.602206] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-23T17:05:38.796734] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T17:05:38.889389] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-23T17:05:39.383603] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T17:05:39.402151] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-23T17:05:40.202191] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-23T17:05:41.002214] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-23T17:05:41.376784] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-23T17:05:41.592770] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:05:41.802223] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-23T17:05:42.552271] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T17:05:42.602147] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-23T17:05:43.402172] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-23T17:05:43.822794] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T17:05:44.161713] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:05:44.202152] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-23T17:05:44.618356] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T17:05:45.002196] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-23T17:05:45.670810] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T17:05:45.802196] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-23T17:05:46.112386] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T17:05:46.602207] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-23T17:05:47.279026] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T17:05:47.402218] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-23T17:05:47.925459] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:05:48.202287] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-23T17:05:48.636862] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:05:48.885412] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T17:05:49.002182] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-23T17:05:49.802201] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-23T17:05:50.172082] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T17:05:50.387123] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T17:05:50.602237] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-23T17:05:51.402241] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-23T17:05:51.959205] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T17:05:51.968531] [INFO ] [REMOTE ] AFL: Full fetch complete (76927 records). [2025-09-23T17:05:51.968752] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-23T17:05:52.207325] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-23T17:05:52.428916] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-23T17:05:52.429002] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-23T17:05:52.429721] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-23T17:05:52.429805] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-23T17:05:52.431464] [DEBUG] [LOCAL ] AFL: Trimmed 76927 records to 53146 (keeping 200 days of data) [2025-09-23T17:05:52.761422] [DEBUG] [LOCAL ] AFL: Primary data saved (53146 records). [2025-09-23T17:05:52.761564] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-23T17:05:52.761675] [INFO ] [MAIN ] Update Progress: 49/2372 symbols completed. AFL took 25.8s. Estimated remaining: 4h 36m 11s. Rate: 8.4 symbols/min [2025-09-23T17:05:52.935306] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:52.935520] [DEBUG] [LOCAL ] AGD: No existing data file found in primary storage. [2025-09-23T17:05:52.935573] [WARN ] [MAIN ] AGD: No existing data found, performing full refresh instead. [2025-09-23T17:05:52.935759] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-23T17:05:52.935807] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-23T17:05:52.935849] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-09-23T17:05:52.935882] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-23T17:05:53.009801] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-23T17:05:53.332873] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:53.406030] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T17:05:53.448274] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T17:05:53.449415] [INFO ] [REMOTE ] AFGE: Full fetch complete (3490 records). [2025-09-23T17:05:53.449487] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-23T17:05:53.802385] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-23T17:05:53.878117] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-23T17:05:53.878263] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-23T17:05:53.878412] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-23T17:05:53.878492] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-23T17:05:53.879257] [DEBUG] [LOCAL ] AFGE: Trimmed 3490 records to 2518 (keeping 200 days of data) [2025-09-23T17:05:53.895401] [DEBUG] [LOCAL ] AFGE: Primary data saved (2518 records). [2025-09-23T17:05:53.895550] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-23T17:05:53.895723] [INFO ] [MAIN ] Update Progress: 50/2372 symbols completed. AFGE took 40.0s. Estimated remaining: 4h 31m 25s. Rate: 8.6 symbols/min [2025-09-23T17:05:54.089196] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:54.120748] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T17:05:54.195363] [DEBUG] [LOCAL ] AGI: Loaded 53418 existing records from primary storage. [2025-09-23T17:05:54.195517] [INFO ] [MAIN ] AGI: Loaded 53418 existing records. [2025-09-23T17:05:54.402163] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:54.402400] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-23T17:05:54.402450] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-23T17:05:54.403839] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-23T17:05:54.403902] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-23T17:05:54.612257] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-23T17:05:54.743835] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:05:54.776599] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:55.402204] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-23T17:05:55.800105] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T17:05:56.054592] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T17:05:56.202207] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-23T17:05:56.721221] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T17:05:57.002191] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-23T17:05:57.802157] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-23T17:05:57.954291] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T17:05:58.602223] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-23T17:05:59.129226] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T17:05:59.402200] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-23T17:05:59.635182] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T17:06:00.202243] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-23T17:06:00.962622] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T17:06:01.002190] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-23T17:06:01.596779] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:06:01.802208] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-23T17:06:02.001812] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T17:06:02.602232] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-23T17:06:03.402233] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-23T17:06:04.202191] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-23T17:06:04.367632] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-23T17:06:05.002193] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-23T17:06:05.354141] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-23T17:06:05.444363] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T17:06:05.511130] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T17:06:05.802210] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-23T17:06:06.378905] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T17:06:06.602228] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-23T17:06:07.402251] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-23T17:06:07.915756] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T17:06:07.923181] [INFO ] [REMOTE ] AGCO: Full fetch complete (62016 records). [2025-09-23T17:06:07.923351] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-23T17:06:08.207184] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-23T17:06:08.215231] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-23T17:06:08.412997] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-23T17:06:08.413086] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-23T17:06:08.413702] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-23T17:06:08.413766] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-23T17:06:08.415278] [DEBUG] [LOCAL ] AGCO: Trimmed 62016 records to 42493 (keeping 200 days of data) [2025-09-23T17:06:08.678445] [DEBUG] [LOCAL ] AGCO: Primary data saved (42493 records). [2025-09-23T17:06:08.678602] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-23T17:06:08.679497] [INFO ] [MAIN ] Update Progress: 51/2372 symbols completed. AGCO took 31.7s. Estimated remaining: 4h 37m 12s. Rate: 8.4 symbols/min [2025-09-23T17:06:08.850664] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:08.914080] [DEBUG] [LOCAL ] AGL: Loaded 52417 existing records from primary storage. [2025-09-23T17:06:08.914265] [INFO ] [MAIN ] AGL: Loaded 52417 existing records. [2025-09-23T17:06:09.011299] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-23T17:06:09.112330] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:09.112810] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-23T17:06:09.112983] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-23T17:06:09.114334] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-23T17:06:09.114399] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-23T17:06:09.421639] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T17:06:09.467248] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:06:09.545723] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:09.802272] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-23T17:06:10.602238] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-23T17:06:10.811556] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T17:06:11.046241] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T17:06:11.402235] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-23T17:06:12.202188] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-23T17:06:12.733331] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:06:12.854046] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T17:06:13.002193] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-23T17:06:13.802166] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-23T17:06:13.873569] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:06:14.117522] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T17:06:14.602168] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-23T17:06:14.759291] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T17:06:15.402180] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-23T17:06:15.761150] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:06:16.199957] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T17:06:16.204011] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-23T17:06:17.002213] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-23T17:06:17.649017] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T17:06:17.802207] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-23T17:06:18.602157] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-23T17:06:18.749591] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:06:18.754106] [INFO ] [REMOTE ] AGD: Full fetch complete (25307 records). [2025-09-23T17:06:18.754188] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-23T17:06:19.090862] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-23T17:06:19.158512] [INFO ] [REMOTE ] AG: Full fetch complete (77182 records). [2025-09-23T17:06:19.221126] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-23T17:06:19.220908] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-23T17:06:19.221333] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-23T17:06:19.221790] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-23T17:06:19.222158] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-23T17:06:19.223411] [FATAL] [VALIDATOR ] AG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:06:19.223973] [FATAL] [MAIN ] AG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:06:19.223855] [DEBUG] [LOCAL ] AGD: Trimmed 25307 records to 17730 (keeping 200 days of data) [2025-09-23T17:06:19.224195] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:06:19.224637] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-23T17:06:19.224771] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-23T17:06:19.224817] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-09-23T17:06:19.225700] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-09-23T17:06:19.225827] [INFO ] [MAIN ] Update Progress: 52/2372 symbols completed. AG took 45.0s. Estimated remaining: 4h 39m 36s. Rate: 8.3 symbols/min [2025-09-23T17:06:19.403768] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-23T17:06:19.517035] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:19.531930] [DEBUG] [LOCAL ] AGM: Loaded 9877 existing records from primary storage. [2025-09-23T17:06:19.532551] [INFO ] [MAIN ] AGM: Loaded 9877 existing records. [2025-09-23T17:06:19.732296] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:19.734122] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-23T17:06:19.734412] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-23T17:06:19.735541] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-23T17:06:19.736104] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-23T17:06:19.856533] [DEBUG] [LOCAL ] AGD: Primary data saved (17730 records). [2025-09-23T17:06:19.866945] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-23T17:06:19.886131] [INFO ] [MAIN ] Update Progress: 53/2372 symbols completed. AGD took 27.1s. Estimated remaining: 4h 34m 41s. Rate: 8.4 symbols/min [2025-09-23T17:06:20.268357] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:20.304283] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:20.304907] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-23T17:06:20.334471] [DEBUG] [LOCAL ] AGO: Loaded 28128 existing records from primary storage. [2025-09-23T17:06:20.334609] [INFO ] [MAIN ] AGO: Loaded 28128 existing records. [2025-09-23T17:06:20.556705] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:20.558803] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T17:06:20.558880] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-23T17:06:20.569361] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-23T17:06:20.571376] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-23T17:06:20.571487] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-23T17:06:20.948369] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:20.971298] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T17:06:21.002193] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-23T17:06:21.238396] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T17:06:21.745516] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:06:21.802160] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-23T17:06:22.602219] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-23T17:06:22.723076] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T17:06:23.173565] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:06:23.402220] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-23T17:06:24.202232] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-23T17:06:24.291819] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T17:06:25.002247] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-23T17:06:25.802232] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-23T17:06:26.602259] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-23T17:06:26.789782] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T17:06:26.949594] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-23T17:06:27.402165] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-23T17:06:27.673791] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T17:06:28.202201] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-23T17:06:28.255211] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T17:06:28.651129] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:06:28.688485] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-23T17:06:29.002213] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-23T17:06:29.802205] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-23T17:06:30.299032] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T17:06:30.602186] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-23T17:06:30.718250] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T17:06:31.402248] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-23T17:06:31.733854] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T17:06:32.202230] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-23T17:06:32.893139] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T17:06:33.002197] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-23T17:06:33.802220] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-23T17:06:34.258511] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T17:06:34.273838] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:06:34.276743] [INFO ] [REMOTE ] AGI: Full fetch complete (76697 records). [2025-09-23T17:06:34.276873] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-23T17:06:34.607944] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-23T17:06:34.692208] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-23T17:06:34.692319] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-23T17:06:34.693190] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-23T17:06:34.693286] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-23T17:06:34.718216] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T17:06:34.727220] [DEBUG] [LOCAL ] AGI: Trimmed 76697 records to 53418 (keeping 200 days of data) [2025-09-23T17:06:34.728517] [INFO ] [REMOTE ] AGL: Full fetch complete (75410 records). [2025-09-23T17:06:34.728680] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-23T17:06:35.273734] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-23T17:06:35.274737] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-23T17:06:35.277004] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-23T17:06:35.277468] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-23T17:06:35.283118] [DEBUG] [LOCAL ] AGL: Trimmed 75410 records to 52423 (keeping 200 days of data) [2025-09-23T17:06:35.405889] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-23T17:06:35.787533] [DEBUG] [LOCAL ] AGL: Primary data saved (52423 records). [2025-09-23T17:06:35.788256] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-23T17:06:35.792553] [INFO ] [MAIN ] Update Progress: 54/2372 symbols completed. AGL took 27.1s. Estimated remaining: 4h 40m 51s. Rate: 8.3 symbols/min [2025-09-23T17:06:35.995188] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:36.008479] [DEBUG] [LOCAL ] AGI: Primary data saved (53418 records). [2025-09-23T17:06:36.008745] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-23T17:06:36.010813] [INFO ] [MAIN ] Update Progress: 55/2372 symbols completed. AGI took 42.1s. Estimated remaining: 4h 35m 47s. Rate: 8.4 symbols/min [2025-09-23T17:06:36.188863] [DEBUG] [LOCAL ] AGRO: Loaded 33821 existing records from primary storage. [2025-09-23T17:06:36.214189] [INFO ] [MAIN ] AGRO: Loaded 33821 existing records. [2025-09-23T17:06:36.218186] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:36.218671] [DEBUG] [LOCAL ] AGX: No existing data file found in primary storage. [2025-09-23T17:06:36.224018] [WARN ] [MAIN ] AGX: No existing data found, performing full refresh instead. [2025-09-23T17:06:36.255924] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-23T17:06:36.261274] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-23T17:06:36.298762] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-09-23T17:06:36.334384] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-23T17:06:36.341703] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T17:06:36.348545] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-23T17:06:36.521416] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:36.545966] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-23T17:06:36.551697] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-23T17:06:36.587794] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-23T17:06:36.587989] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-23T17:06:36.863467] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T17:06:37.011859] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-23T17:06:37.105164] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:37.265780] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:37.759400] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:06:37.802140] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-23T17:06:38.182037] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T17:06:38.602197] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-23T17:06:39.369372] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T17:06:39.402275] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-23T17:06:39.588111] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T17:06:39.982570] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T17:06:39.986138] [INFO ] [REMOTE ] AGM: Full fetch complete (12522 records). [2025-09-23T17:06:39.986260] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-23T17:06:40.207529] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-23T17:06:40.402152] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-23T17:06:40.402241] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-23T17:06:40.402503] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-23T17:06:40.402576] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-23T17:06:40.403569] [DEBUG] [LOCAL ] AGM: Trimmed 12522 records to 9921 (keeping 200 days of data) [2025-09-23T17:06:40.477824] [DEBUG] [LOCAL ] AGM: Primary data saved (9921 records). [2025-09-23T17:06:40.478183] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-23T17:06:40.478621] [INFO ] [MAIN ] Update Progress: 56/2372 symbols completed. AGM took 21.3s. Estimated remaining: 4h 33m 49s. Rate: 8.5 symbols/min [2025-09-23T17:06:40.662061] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:40.714808] [DEBUG] [LOCAL ] AHH: Loaded 41463 existing records from primary storage. [2025-09-23T17:06:40.715021] [INFO ] [MAIN ] AHH: Loaded 41463 existing records. [2025-09-23T17:06:40.893459] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:40.893791] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-23T17:06:40.893868] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-23T17:06:40.894967] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-23T17:06:40.895030] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-23T17:06:41.004844] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-23T17:06:41.309784] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:41.513807] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:06:41.802214] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-23T17:06:42.431341] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:06:42.602212] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-23T17:06:43.021203] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T17:06:43.402199] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-23T17:06:43.588061] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T17:06:44.202275] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-23T17:06:44.619681] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T17:06:45.002280] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-23T17:06:45.757988] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T17:06:45.802232] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-23T17:06:46.602217] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-23T17:06:46.892591] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T17:06:46.925960] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T17:06:47.402207] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-23T17:06:47.598365] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T17:06:48.202199] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-23T17:06:48.346487] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T17:06:48.353597] [INFO ] [REMOTE ] AGO: Full fetch complete (39291 records). [2025-09-23T17:06:48.353810] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-23T17:06:48.739210] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-23T17:06:48.739287] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-23T17:06:48.739728] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-23T17:06:48.739820] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-23T17:06:48.740758] [DEBUG] [LOCAL ] AGO: Trimmed 39291 records to 28103 (keeping 200 days of data) [2025-09-23T17:06:48.940879] [DEBUG] [LOCAL ] AGO: Primary data saved (28103 records). [2025-09-23T17:06:48.941086] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-23T17:06:48.941295] [INFO ] [MAIN ] Update Progress: 57/2372 symbols completed. AGO took 29.0s. Estimated remaining: 4h 34m 38s. Rate: 8.4 symbols/min [2025-09-23T17:06:49.008009] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-23T17:06:49.134566] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:49.134902] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-23T17:06:49.135043] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-23T17:06:49.135325] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-23T17:06:49.135473] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-23T17:06:49.135597] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-23T17:06:49.135707] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-23T17:06:49.486412] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:06:49.539799] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:49.802225] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-23T17:06:50.352203] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:06:50.602166] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-23T17:06:51.413802] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-23T17:06:51.416417] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T17:06:51.583094] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T17:06:51.622910] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:06:51.623216] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-23T17:06:52.202264] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-23T17:06:53.002236] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-23T17:06:53.261699] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T17:06:53.802210] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-23T17:06:54.036510] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:06:54.036905] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-23T17:06:54.337626] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T17:06:54.602207] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-23T17:06:55.402226] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-23T17:06:56.111372] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T17:06:56.202198] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-23T17:06:56.393271] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T17:06:57.002228] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-23T17:06:57.568900] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T17:06:57.802193] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-23T17:06:58.309361] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T17:06:58.602196] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-23T17:06:58.818711] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:06:58.820217] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T17:06:58.828275] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-23T17:06:59.402203] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-23T17:07:00.211920] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-23T17:07:00.214396] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T17:07:01.002212] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-23T17:07:01.229293] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:01.229613] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-23T17:07:01.313514] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T17:07:01.802195] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-23T17:07:02.602237] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-23T17:07:03.141419] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:03.141837] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-23T17:07:03.173175] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T17:07:03.178980] [INFO ] [REMOTE ] AGX: Full fetch complete (49004 records). [2025-09-23T17:07:03.179088] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-23T17:07:03.407767] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-23T17:07:03.578428] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-23T17:07:03.578571] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-23T17:07:03.579128] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-23T17:07:03.579191] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-23T17:07:03.583531] [DEBUG] [LOCAL ] AGX: Trimmed 49004 records to 33512 (keeping 200 days of data) [2025-09-23T17:07:03.808594] [DEBUG] [LOCAL ] AGX: Primary data saved (33512 records). [2025-09-23T17:07:03.808787] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-23T17:07:03.808941] [INFO ] [MAIN ] Update Progress: 58/2372 symbols completed. AGX took 27.8s. Estimated remaining: 4h 39m 40s. Rate: 8.3 symbols/min [2025-09-23T17:07:03.982001] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:04.038173] [DEBUG] [LOCAL ] AHR: Loaded 49322 existing records from primary storage. [2025-09-23T17:07:04.038342] [INFO ] [MAIN ] AHR: Loaded 49322 existing records. [2025-09-23T17:07:04.211763] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-23T17:07:04.216735] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:04.218034] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-23T17:07:04.218091] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-23T17:07:04.219451] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-23T17:07:04.219516] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-23T17:07:04.585841] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:04.931704] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T17:07:05.002200] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-23T17:07:05.025931] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T17:07:05.802239] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-23T17:07:06.093802] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:07:06.474497] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T17:07:06.602198] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-23T17:07:07.182348] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T17:07:07.402194] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-23T17:07:08.202206] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-23T17:07:08.272956] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T17:07:09.002201] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-23T17:07:09.587828] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:07:09.802199] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-23T17:07:10.468404] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:07:10.602174] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-23T17:07:10.914257] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T17:07:10.920495] [INFO ] [REMOTE ] AHL: Full fetch complete (17265 records). [2025-09-23T17:07:10.920573] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-23T17:07:11.107709] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 95 unique days, need 200 days [2025-09-23T17:07:11.108068] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:07:11.108152] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:07:11.108227] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-23T17:07:11.108295] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-23T17:07:11.108344] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-23T17:07:11.108424] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-23T17:07:11.108507] [INFO ] [MAIN ] Update Progress: 59/2372 symbols completed. AHL took 22.2s. Estimated remaining: 4h 39m 35s. Rate: 8.3 symbols/min [2025-09-23T17:07:11.274522] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:11.274733] [DEBUG] [LOCAL ] AHT: No existing data file found in primary storage. [2025-09-23T17:07:11.274787] [WARN ] [MAIN ] AHT: No existing data found, performing full refresh instead. [2025-09-23T17:07:11.274960] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-23T17:07:11.275020] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-23T17:07:11.275064] [DEBUG] [LOCAL ] AHT: No primary data file found to delete. [2025-09-23T17:07:11.275096] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-23T17:07:11.416631] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-23T17:07:11.639551] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:11.734380] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T17:07:12.202197] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-23T17:07:12.690679] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:07:13.002209] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-23T17:07:13.488831] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:07:13.494503] [INFO ] [REMOTE ] AGRO: Full fetch complete (49918 records). [2025-09-23T17:07:13.494628] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-23T17:07:13.804315] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-23T17:07:13.896735] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-23T17:07:13.896829] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-23T17:07:13.897428] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-23T17:07:13.897513] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-23T17:07:13.899747] [DEBUG] [LOCAL ] AGRO: Trimmed 49918 records to 33795 (keeping 200 days of data) [2025-09-23T17:07:14.118846] [DEBUG] [LOCAL ] AGRO: Primary data saved (33795 records). [2025-09-23T17:07:14.118996] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-23T17:07:14.119122] [INFO ] [MAIN ] Update Progress: 60/2372 symbols completed. AGRO took 38.3s. Estimated remaining: 4h 36m 44s. Rate: 8.4 symbols/min [2025-09-23T17:07:14.332569] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:07:14.336327] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:14.408433] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-23T17:07:14.408659] [INFO ] [MAIN ] AI: Loaded 53749 existing records. [2025-09-23T17:07:14.561480] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T17:07:14.612356] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-23T17:07:14.619363] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:14.620221] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-23T17:07:14.620275] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-23T17:07:14.621778] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-23T17:07:14.621841] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-23T17:07:14.970631] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:15.111893] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T17:07:15.402209] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-23T17:07:16.095520] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T17:07:16.202244] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-23T17:07:17.002215] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-23T17:07:17.372195] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T17:07:17.804797] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-23T17:07:17.814740] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T17:07:18.463989] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T17:07:18.602216] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-23T17:07:19.402218] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-23T17:07:20.166714] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:07:20.192634] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T17:07:20.202116] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-23T17:07:21.002259] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-23T17:07:21.276888] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T17:07:21.802219] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-23T17:07:22.602178] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-23T17:07:22.863541] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T17:07:23.402290] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-23T17:07:23.746287] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T17:07:23.752910] [INFO ] [REMOTE ] AHH: Full fetch complete (60367 records). [2025-09-23T17:07:23.753070] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-23T17:07:23.930012] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T17:07:24.159192] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-23T17:07:24.159341] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-23T17:07:24.160260] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-23T17:07:24.160350] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-23T17:07:24.162721] [DEBUG] [LOCAL ] AHH: Trimmed 60367 records to 41438 (keeping 200 days of data) [2025-09-23T17:07:24.222459] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-23T17:07:24.300171] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-23T17:07:24.461080] [DEBUG] [LOCAL ] AHH: Primary data saved (41438 records). [2025-09-23T17:07:24.461218] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-23T17:07:24.461302] [INFO ] [MAIN ] Update Progress: 61/2372 symbols completed. AHH took 44.0s. Estimated remaining: 4h 38m 36s. Rate: 8.3 symbols/min [2025-09-23T17:07:24.630181] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:24.682589] [DEBUG] [LOCAL ] AIG: Loaded 53478 existing records from primary storage. [2025-09-23T17:07:24.682772] [INFO ] [MAIN ] AIG: Loaded 53478 existing records. [2025-09-23T17:07:24.864569] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:24.864916] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-23T17:07:24.864975] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-23T17:07:24.866520] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-23T17:07:24.866583] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-23T17:07:25.007353] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-23T17:07:25.233749] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:25.494794] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T17:07:25.802269] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-23T17:07:26.602194] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-23T17:07:27.107227] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:07:27.190588] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:07:27.402179] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-23T17:07:27.479849] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-23T17:07:27.956006] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T17:07:28.202228] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-23T17:07:29.002200] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-23T17:07:29.395085] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T17:07:29.802196] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-23T17:07:30.602221] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-23T17:07:31.177471] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-23T17:07:31.316881] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T17:07:31.402157] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-23T17:07:31.921302] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T17:07:32.202206] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-23T17:07:32.747805] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T17:07:33.002259] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-23T17:07:33.546740] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T17:07:33.548893] [INFO ] [REMOTE ] AHT: Full fetch complete (9501 records). [2025-09-23T17:07:33.549000] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-23T17:07:33.810033] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-23T17:07:33.955237] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-23T17:07:33.955441] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-23T17:07:33.955781] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-23T17:07:33.955922] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-23T17:07:33.987765] [DEBUG] [LOCAL ] AHT: Trimmed 9501 records to 6041 (keeping 200 days of data) [2025-09-23T17:07:34.004989] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T17:07:34.039807] [DEBUG] [LOCAL ] AHT: Primary data saved (6041 records). [2025-09-23T17:07:34.039997] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-23T17:07:34.040094] [INFO ] [MAIN ] Update Progress: 62/2372 symbols completed. AHT took 22.9s. Estimated remaining: 4h 39m 57s. Rate: 8.3 symbols/min [2025-09-23T17:07:34.220437] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:34.220739] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-23T17:07:34.220789] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-23T17:07:34.220951] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-23T17:07:34.220993] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-23T17:07:34.221035] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-23T17:07:34.221125] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-23T17:07:34.587942] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:34.602145] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-23T17:07:34.790532] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:34.790950] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-23T17:07:35.316634] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:07:35.402254] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-23T17:07:36.202224] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-23T17:07:36.446812] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:36.447085] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-23T17:07:36.936996] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:07:37.002233] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-23T17:07:37.802240] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-23T17:07:38.602278] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-23T17:07:38.830061] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:38.830742] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-23T17:07:39.017089] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:07:39.028144] [INFO ] [REMOTE ] AHR: Full fetch complete (71039 records). [2025-09-23T17:07:39.028538] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-23T17:07:39.376249] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-23T17:07:39.405464] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-23T17:07:39.581117] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-23T17:07:39.581256] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-23T17:07:39.582129] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-23T17:07:39.582196] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-23T17:07:39.584169] [DEBUG] [LOCAL ] AHR: Trimmed 71039 records to 49330 (keeping 200 days of data) [2025-09-23T17:07:39.711714] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:39.714707] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-23T17:07:39.900131] [DEBUG] [LOCAL ] AHR: Primary data saved (49330 records). [2025-09-23T17:07:39.900349] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-23T17:07:39.901221] [INFO ] [MAIN ] Update Progress: 63/2372 symbols completed. AHR took 36.1s. Estimated remaining: 4h 38m 58s. Rate: 8.3 symbols/min [2025-09-23T17:07:40.082393] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:40.112584] [DEBUG] [LOCAL ] AIN: Loaded 24581 existing records from primary storage. [2025-09-23T17:07:40.112845] [INFO ] [MAIN ] AIN: Loaded 24581 existing records. [2025-09-23T17:07:40.207421] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-23T17:07:40.310976] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:40.311435] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-23T17:07:40.311492] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-23T17:07:40.312516] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-23T17:07:40.312583] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-23T17:07:40.685355] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:41.002214] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-23T17:07:41.206160] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:41.206525] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-23T17:07:41.802242] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-23T17:07:42.412507] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T17:07:42.569100] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-23T17:07:42.602189] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-23T17:07:43.402211] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-23T17:07:44.202219] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-23T17:07:44.291033] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T17:07:44.616698] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T17:07:44.869122] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T17:07:45.002201] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-23T17:07:45.484824] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T17:07:45.802195] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-23T17:07:46.322540] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T17:07:46.602241] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-23T17:07:47.402207] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-23T17:07:48.083111] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T17:07:48.202207] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-23T17:07:48.554158] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T17:07:48.824023] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T17:07:49.002183] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-23T17:07:49.802243] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-23T17:07:49.856355] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T17:07:50.602195] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-23T17:07:51.402204] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-23T17:07:51.771781] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T17:07:52.072390] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T17:07:52.202222] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-23T17:07:53.002212] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-23T17:07:53.055237] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T17:07:53.101319] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:07:53.802246] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-23T17:07:54.602208] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-23T17:07:55.056876] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:07:55.269223] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T17:07:55.402209] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-23T17:07:55.476608] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T17:07:55.480055] [INFO ] [REMOTE ] AII: Full fetch complete (10403 records). [2025-09-23T17:07:55.480128] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-23T17:07:55.660825] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 95 unique days, need 200 days [2025-09-23T17:07:55.661082] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:07:55.661149] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:07:55.661220] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-23T17:07:55.661284] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-23T17:07:55.661319] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-23T17:07:55.661358] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-23T17:07:55.661415] [INFO ] [MAIN ] Update Progress: 64/2372 symbols completed. AII took 21.6s. Estimated remaining: 4h 43m 57s. Rate: 8.1 symbols/min [2025-09-23T17:07:55.838742] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:55.859195] [DEBUG] [LOCAL ] AIO: Loaded 13283 existing records from primary storage. [2025-09-23T17:07:55.859344] [INFO ] [MAIN ] AIO: Loaded 13283 existing records. [2025-09-23T17:07:56.052168] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:56.052427] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-23T17:07:56.052474] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-23T17:07:56.052962] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-23T17:07:56.053022] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-23T17:07:56.212329] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-23T17:07:56.430639] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:57.002216] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-23T17:07:57.115800] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T17:07:57.739501] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:07:57.802180] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-23T17:07:57.870272] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-23T17:07:57.879371] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-23T17:07:57.879530] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-23T17:07:58.279970] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-23T17:07:58.280048] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-23T17:07:58.280777] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-23T17:07:58.280840] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-23T17:07:58.282366] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53749 (keeping 200 days of data) [2025-09-23T17:07:58.413944] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T17:07:58.602737] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-23T17:07:58.625037] [DEBUG] [LOCAL ] AI: Primary data saved (53749 records). [2025-09-23T17:07:58.625220] [INFO ] [MAIN ] AI: Full history saved. [2025-09-23T17:07:58.625322] [INFO ] [MAIN ] Update Progress: 65/2372 symbols completed. AI took 44.5s. Estimated remaining: 4h 41m 13s. Rate: 8.2 symbols/min [2025-09-23T17:07:58.794222] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:58.821918] [DEBUG] [LOCAL ] AIR: Loaded 27260 existing records from primary storage. [2025-09-23T17:07:58.822080] [INFO ] [MAIN ] AIR: Loaded 27260 existing records. [2025-09-23T17:07:58.996477] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:58.996788] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-23T17:07:58.996841] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-23T17:07:58.997620] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-23T17:07:58.997727] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-23T17:07:59.355454] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:59.402158] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-23T17:08:00.202184] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-23T17:08:00.371454] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T17:08:00.500530] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:08:01.002203] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-23T17:08:01.105800] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T17:08:01.560587] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:08:01.802242] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-23T17:08:02.396378] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:08:02.602193] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-23T17:08:03.210235] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T17:08:03.402229] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-23T17:08:03.899713] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T17:08:04.202199] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-23T17:08:05.002248] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-23T17:08:05.075350] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T17:08:05.079514] [INFO ] [REMOTE ] AIN: Full fetch complete (33249 records). [2025-09-23T17:08:05.079605] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-23T17:08:05.469309] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-23T17:08:05.469433] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-23T17:08:05.469875] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-23T17:08:05.469937] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-23T17:08:05.470786] [DEBUG] [LOCAL ] AIN: Trimmed 33249 records to 24626 (keeping 200 days of data) [2025-09-23T17:08:05.626443] [DEBUG] [LOCAL ] AIN: Primary data saved (24626 records). [2025-09-23T17:08:05.626576] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-23T17:08:05.626677] [INFO ] [MAIN ] Update Progress: 66/2372 symbols completed. AIN took 25.7s. Estimated remaining: 4h 40m 55s. Rate: 8.2 symbols/min [2025-09-23T17:08:05.800036] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:05.800234] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-09-23T17:08:05.800272] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-09-23T17:08:05.800464] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-23T17:08:05.800513] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-23T17:08:05.800556] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-23T17:08:05.800591] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-23T17:08:05.811930] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-23T17:08:06.162126] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:06.449565] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T17:08:06.602155] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-23T17:08:06.694483] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:08:07.402191] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-23T17:08:07.608364] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T17:08:08.016039] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:08:08.202202] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-23T17:08:09.002224] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-23T17:08:09.033297] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T17:08:09.802199] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-23T17:08:09.978146] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T17:08:10.602200] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-23T17:08:10.717885] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T17:08:11.082714] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T17:08:11.402205] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-23T17:08:12.202203] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-23T17:08:12.559507] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T17:08:12.809314] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T17:08:12.811900] [INFO ] [REMOTE ] AIO: Full fetch complete (20060 records). [2025-09-23T17:08:12.811979] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-23T17:08:13.021501] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-23T17:08:13.231284] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-23T17:08:13.231367] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-23T17:08:13.231636] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-23T17:08:13.231716] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-23T17:08:13.232315] [DEBUG] [LOCAL ] AIO: Trimmed 20060 records to 13260 (keeping 200 days of data) [2025-09-23T17:08:13.314455] [DEBUG] [LOCAL ] AIO: Primary data saved (13260 records). [2025-09-23T17:08:13.314611] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-23T17:08:13.314730] [INFO ] [MAIN ] Update Progress: 67/2372 symbols completed. AIO took 17.7s. Estimated remaining: 4h 41m 1s. Rate: 8.2 symbols/min [2025-09-23T17:08:13.483204] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:13.525485] [DEBUG] [LOCAL ] AIV: Loaded 40199 existing records from primary storage. [2025-09-23T17:08:13.525669] [INFO ] [MAIN ] AIV: Loaded 40199 existing records. [2025-09-23T17:08:13.703523] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:13.703896] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-23T17:08:13.703956] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-23T17:08:13.705026] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-23T17:08:13.705088] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-23T17:08:13.805946] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-23T17:08:14.079980] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:14.098883] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T17:08:14.602234] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-23T17:08:15.287513] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:08:15.402190] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-23T17:08:15.490976] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T17:08:16.202239] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-23T17:08:16.899096] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T17:08:16.908124] [INFO ] [REMOTE ] AIG: Full fetch complete (77372 records). [2025-09-23T17:08:16.908288] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-23T17:08:17.012462] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-23T17:08:17.226523] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T17:08:17.331897] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-23T17:08:17.331994] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-23T17:08:17.332741] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-23T17:08:17.332808] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-23T17:08:17.334419] [DEBUG] [LOCAL ] AIG: Trimmed 77372 records to 53475 (keeping 200 days of data) [2025-09-23T17:08:17.677699] [DEBUG] [LOCAL ] AIG: Primary data saved (53475 records). [2025-09-23T17:08:17.677953] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-23T17:08:17.678056] [INFO ] [MAIN ] Update Progress: 68/2372 symbols completed. AIG took 53.2s. Estimated remaining: 4h 39m 13s. Rate: 8.3 symbols/min [2025-09-23T17:08:17.817532] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-23T17:08:17.852129] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:17.884596] [DEBUG] [LOCAL ] AIZ: Loaded 30228 existing records from primary storage. [2025-09-23T17:08:17.884755] [INFO ] [MAIN ] AIZ: Loaded 30228 existing records. [2025-09-23T17:08:18.063017] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:18.063344] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-23T17:08:18.063402] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-23T17:08:18.064337] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-23T17:08:18.064400] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-23T17:08:18.437211] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:18.451948] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T17:08:18.546175] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:08:18.602142] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-23T17:08:19.402215] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-23T17:08:19.871501] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T17:08:20.202220] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-23T17:08:20.563262] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T17:08:21.002230] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-23T17:08:21.357385] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:08:21.802190] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-23T17:08:22.148535] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T17:08:22.602206] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-23T17:08:22.734567] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T17:08:23.402231] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-23T17:08:23.889496] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:08:23.894838] [INFO ] [REMOTE ] AIR: Full fetch complete (37686 records). [2025-09-23T17:08:23.895012] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-23T17:08:24.207305] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-23T17:08:24.274118] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-23T17:08:24.274206] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-23T17:08:24.274631] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-23T17:08:24.274708] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-23T17:08:24.275768] [DEBUG] [LOCAL ] AIR: Trimmed 37686 records to 27416 (keeping 200 days of data) [2025-09-23T17:08:24.443665] [DEBUG] [LOCAL ] AIR: Primary data saved (27416 records). [2025-09-23T17:08:24.443816] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-23T17:08:24.443905] [INFO ] [MAIN ] Update Progress: 69/2372 symbols completed. AIR took 25.8s. Estimated remaining: 4h 38m 49s. Rate: 8.3 symbols/min [2025-09-23T17:08:24.609015] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:08:24.642615] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:24.649540] [DEBUG] [LOCAL ] AIZN: Loaded 3925 existing records from primary storage. [2025-09-23T17:08:24.649673] [INFO ] [MAIN ] AIZN: Loaded 3925 existing records. [2025-09-23T17:08:24.836121] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:24.836423] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-23T17:08:24.836476] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-23T17:08:24.836842] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-23T17:08:24.836905] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-23T17:08:25.009345] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-23T17:08:25.193609] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:25.666310] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T17:08:25.802242] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-23T17:08:26.184136] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T17:08:26.602238] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-23T17:08:26.889603] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:08:27.402214] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-23T17:08:28.001241] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:08:28.202194] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-23T17:08:28.513158] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T17:08:28.699573] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T17:08:29.002204] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-23T17:08:29.483834] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:08:29.802196] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-23T17:08:30.167438] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T17:08:30.602261] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-23T17:08:31.216446] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T17:08:31.402359] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-23T17:08:32.202201] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-23T17:08:32.978507] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T17:08:33.002160] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-23T17:08:33.283738] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T17:08:33.802209] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-23T17:08:33.883357] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T17:08:34.602269] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-23T17:08:35.402206] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-23T17:08:35.552989] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T17:08:35.643052] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T17:08:36.202202] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-23T17:08:36.481377] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T17:08:37.002172] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-23T17:08:37.105277] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T17:08:37.802242] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-23T17:08:38.326438] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T17:08:38.602200] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-23T17:08:39.077260] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-23T17:08:39.326972] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T17:08:39.402244] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-23T17:08:40.202193] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-23T17:08:40.618325] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T17:08:41.002228] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-23T17:08:41.235984] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T17:08:41.802442] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-23T17:08:42.214175] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:08:42.221811] [INFO ] [REMOTE ] AIV: Full fetch complete (59118 records). [2025-09-23T17:08:42.221948] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-23T17:08:42.605186] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-23T17:08:42.604902] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-23T17:08:42.606221] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-23T17:08:42.606855] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-23T17:08:42.606920] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-23T17:08:42.608276] [DEBUG] [LOCAL ] AIV: Trimmed 59118 records to 40198 (keeping 200 days of data) [2025-09-23T17:08:42.851850] [DEBUG] [LOCAL ] AIV: Primary data saved (40198 records). [2025-09-23T17:08:42.851990] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-23T17:08:42.852078] [INFO ] [MAIN ] Update Progress: 70/2372 symbols completed. AIV took 29.5s. Estimated remaining: 4h 44m 48s. Rate: 8.1 symbols/min [2025-09-23T17:08:43.038762] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:43.090163] [DEBUG] [LOCAL ] AJG: Loaded 47141 existing records from primary storage. [2025-09-23T17:08:43.090337] [INFO ] [MAIN ] AJG: Loaded 47141 existing records. [2025-09-23T17:08:43.289234] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:43.289688] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-23T17:08:43.289861] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-23T17:08:43.299352] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-23T17:08:43.307821] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-23T17:08:43.308381] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T17:08:43.407309] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-23T17:08:43.705762] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:43.721575] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:08:43.831028] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T17:08:44.202215] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-23T17:08:44.755049] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-23T17:08:45.002203] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-23T17:08:45.802235] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-23T17:08:45.961680] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T17:08:45.965363] [INFO ] [REMOTE ] AIT: Full fetch complete (39522 records). [2025-09-23T17:08:45.965474] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-23T17:08:46.350226] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-23T17:08:46.350330] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-23T17:08:46.350797] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-23T17:08:46.350862] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-23T17:08:46.351807] [DEBUG] [LOCAL ] AIT: Trimmed 39522 records to 28113 (keeping 200 days of data) [2025-09-23T17:08:46.523664] [DEBUG] [LOCAL ] AIT: Primary data saved (28113 records). [2025-09-23T17:08:46.523806] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-23T17:08:46.523884] [INFO ] [MAIN ] Update Progress: 71/2372 symbols completed. AIT took 40.9s. Estimated remaining: 4h 42m 39s. Rate: 8.1 symbols/min [2025-09-23T17:08:46.607325] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-23T17:08:46.700166] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:46.700329] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-23T17:08:46.700368] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-23T17:08:46.700516] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-23T17:08:46.700561] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-23T17:08:46.700606] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-23T17:08:46.700700] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-23T17:08:47.025688] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-23T17:08:47.095577] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:47.351522] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T17:08:47.402247] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-23T17:08:48.202192] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-23T17:08:48.406562] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T17:08:48.411258] [INFO ] [REMOTE ] AIZ: Full fetch complete (42985 records). [2025-09-23T17:08:48.411340] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-23T17:08:48.703800] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:08:48.797554] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-23T17:08:48.797674] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-23T17:08:48.798216] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-23T17:08:48.798261] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-23T17:08:48.799207] [DEBUG] [LOCAL ] AIZ: Trimmed 42985 records to 30174 (keeping 200 days of data) [2025-09-23T17:08:49.002934] [DEBUG] [LOCAL ] AIZ: Primary data saved (30174 records). [2025-09-23T17:08:49.002377] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-23T17:08:49.004903] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-23T17:08:49.005103] [INFO ] [MAIN ] Update Progress: 72/2372 symbols completed. AIZ took 31.3s. Estimated remaining: 4h 39m 56s. Rate: 8.2 symbols/min [2025-09-23T17:08:49.179727] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:49.227119] [DEBUG] [LOCAL ] AKR: Loaded 45691 existing records from primary storage. [2025-09-23T17:08:49.227265] [INFO ] [MAIN ] AKR: Loaded 45691 existing records. [2025-09-23T17:08:49.406041] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:49.406325] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-23T17:08:49.406385] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-23T17:08:49.407669] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-23T17:08:49.407731] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-23T17:08:49.615625] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T17:08:49.665432] [INFO ] [REMOTE ] AIZN: Full fetch complete (5723 records). [2025-09-23T17:08:49.691607] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-23T17:08:49.805005] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-23T17:08:49.997534] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:50.200703] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-23T17:08:50.200789] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-23T17:08:50.200964] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-23T17:08:50.201043] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-23T17:08:50.201467] [DEBUG] [LOCAL ] AIZN: Trimmed 5723 records to 3919 (keeping 200 days of data) [2025-09-23T17:08:50.225017] [DEBUG] [LOCAL ] AIZN: Primary data saved (3919 records). [2025-09-23T17:08:50.225102] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-23T17:08:50.225245] [INFO ] [MAIN ] Update Progress: 73/2372 symbols completed. AIZN took 25.8s. Estimated remaining: 4h 36m 37s. Rate: 8.3 symbols/min [2025-09-23T17:08:50.393626] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:50.444163] [DEBUG] [LOCAL ] AL: Loaded 44012 existing records from primary storage. [2025-09-23T17:08:50.444308] [INFO ] [MAIN ] AL: Loaded 44012 existing records. [2025-09-23T17:08:50.613370] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-23T17:08:50.640077] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:50.640451] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-23T17:08:50.640548] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-23T17:08:50.643183] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-23T17:08:50.643267] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-23T17:08:51.002120] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:51.402235] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-23T17:08:51.792116] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-23T17:08:51.889977] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T17:08:51.925367] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:08:52.202215] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-23T17:08:53.002253] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-23T17:08:53.802193] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-23T17:08:53.916848] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T17:08:54.135887] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T17:08:54.180041] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T17:08:54.602215] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-23T17:08:55.402210] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-23T17:08:56.032903] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:08:56.202212] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-23T17:08:56.890326] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T17:08:57.002196] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-23T17:08:57.686764] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T17:08:57.802213] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-23T17:08:58.602172] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-23T17:08:58.772153] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T17:08:58.997971] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T17:08:59.266802] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T17:08:59.402185] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-23T17:09:00.202219] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-23T17:09:01.001198] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T17:09:01.010036] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-23T17:09:01.521366] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:09:01.802198] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-23T17:09:02.602250] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-23T17:09:03.195913] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-23T17:09:03.402230] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-23T17:09:04.202181] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-23T17:09:04.680470] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-23T17:09:04.730984] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T17:09:05.002246] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-23T17:09:05.566142] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T17:09:05.660012] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T17:09:05.704412] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (3.90 seconds). [2025-09-23T17:09:05.802240] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-23T17:09:06.602193] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-23T17:09:06.949596] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T17:09:07.402187] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-23T17:09:07.605559] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:09:08.202189] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-23T17:09:08.454981] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T17:09:09.002203] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-23T17:09:09.115893] [DEBUG] [REMOTE ] AKR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-23T17:09:09.116191] [WARN ] [REMOTE ] AKR: No data returned for month 2025-06 [2025-09-23T17:09:09.480555] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T17:09:09.802199] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-23T17:09:10.602205] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-23T17:09:10.942159] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T17:09:11.402196] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-23T17:09:12.202226] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-23T17:09:12.327152] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T17:09:13.002215] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-23T17:09:13.245241] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T17:09:13.802238] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-23T17:09:14.167288] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T17:09:14.288864] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:09:14.602195] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-23T17:09:15.081018] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T17:09:15.402188] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-23T17:09:15.982275] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T17:09:16.202241] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-23T17:09:17.002165] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-23T17:09:17.076310] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T17:09:17.084253] [INFO ] [REMOTE ] AJG: Full fetch complete (69439 records). [2025-09-23T17:09:17.084434] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-23T17:09:17.085835] [FATAL] [VALIDATOR ] AJG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:09:17.085964] [FATAL] [MAIN ] AJG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:17.086051] [WARN ] [MAIN ] AJG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:17.086148] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-23T17:09:17.086234] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-23T17:09:17.086287] [INFO ] [LOCAL ] AJG: Starting deletion of derivative data. [2025-09-23T17:09:17.086806] [DEBUG] [LOCAL ] AJG: Deleted derivative data file. [2025-09-23T17:09:17.088335] [INFO ] [MAIN ] Update Progress: 74/2372 symbols completed. AJG took 34.2s. Estimated remaining: 4h 46m 40s. Rate: 8.0 symbols/min [2025-09-23T17:09:17.262101] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:17.339235] [DEBUG] [LOCAL ] ALB: Loaded 53228 existing records from primary storage. [2025-09-23T17:09:17.339425] [INFO ] [MAIN ] ALB: Loaded 53228 existing records. [2025-09-23T17:09:17.582992] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:17.583406] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-23T17:09:17.583550] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-23T17:09:17.584940] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-23T17:09:17.585006] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-23T17:09:17.767103] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T17:09:17.816828] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-23T17:09:18.012041] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:18.602273] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-23T17:09:18.845609] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T17:09:18.853632] [INFO ] [REMOTE ] AKR: Full fetch complete (58598 records). [2025-09-23T17:09:18.853802] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-23T17:09:19.058376] [WARN ] [VALIDATOR ] AKR: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T17:09:19.059364] [FATAL] [MAIN ] AKR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:19.059497] [WARN ] [MAIN ] AKR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:19.059690] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-23T17:09:19.059807] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-23T17:09:19.059879] [INFO ] [LOCAL ] AKR: Starting deletion of derivative data. [2025-09-23T17:09:19.060506] [DEBUG] [LOCAL ] AKR: Deleted derivative data file. [2025-09-23T17:09:19.060626] [INFO ] [MAIN ] Update Progress: 75/2372 symbols completed. AKR took 30.1s. Estimated remaining: 4h 43m 43s. Rate: 8.1 symbols/min [2025-09-23T17:09:19.278488] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:19.282926] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T17:09:19.351487] [DEBUG] [LOCAL ] ALC: Loaded 50771 existing records from primary storage. [2025-09-23T17:09:19.351672] [INFO ] [MAIN ] ALC: Loaded 50771 existing records. [2025-09-23T17:09:19.407453] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-23T17:09:19.550886] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:19.551167] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-23T17:09:19.551256] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-23T17:09:19.552780] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-23T17:09:19.552844] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-23T17:09:19.824029] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-23T17:09:19.922383] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:20.204512] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-23T17:09:20.207891] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T17:09:21.002254] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-23T17:09:21.503261] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:09:21.802196] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-23T17:09:22.602204] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-23T17:09:22.788978] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T17:09:22.908768] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T17:09:23.402285] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-23T17:09:23.470744] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T17:09:24.202289] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-23T17:09:25.002203] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-23T17:09:25.380971] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-23T17:09:25.494682] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T17:09:25.495499] [INFO ] [REMOTE ] AKA: Full fetch complete (2426 records). [2025-09-23T17:09:25.495572] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-23T17:09:25.687456] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T17:09:25.687854] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:25.687926] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:25.687996] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-23T17:09:25.688079] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-23T17:09:25.688135] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-23T17:09:25.688181] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-23T17:09:25.688238] [INFO ] [MAIN ] Update Progress: 76/2372 symbols completed. AKA took 39.2s. Estimated remaining: 4h 43m 12s. Rate: 8.1 symbols/min [2025-09-23T17:09:25.807279] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-23T17:09:25.860379] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:25.926198] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T17:09:25.944166] [INFO ] [REMOTE ] AL: Full fetch complete (62092 records). [2025-09-23T17:09:25.944808] [DEBUG] [LOCAL ] ALE: Loaded 30184 existing records from primary storage. [2025-09-23T17:09:25.944332] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-23T17:09:25.945054] [INFO ] [MAIN ] ALE: Loaded 30184 existing records. [2025-09-23T17:09:26.323577] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:26.408077] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-23T17:09:26.438609] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-23T17:09:26.447253] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-23T17:09:26.467791] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-23T17:09:26.607672] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-23T17:09:26.654261] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-23T17:09:26.654425] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-23T17:09:26.655100] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-23T17:09:26.655496] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-23T17:09:26.814963] [DEBUG] [LOCAL ] AL: Trimmed 62092 records to 44068 (keeping 200 days of data) [2025-09-23T17:09:27.014231] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:27.182677] [DEBUG] [LOCAL ] AL: Primary data saved (44068 records). [2025-09-23T17:09:27.182812] [INFO ] [MAIN ] AL: Full history saved. [2025-09-23T17:09:27.185366] [INFO ] [MAIN ] Update Progress: 77/2372 symbols completed. AL took 37.0s. Estimated remaining: 4h 40m 9s. Rate: 8.2 symbols/min [2025-09-23T17:09:27.337048] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T17:09:27.402155] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-23T17:09:28.202176] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-23T17:09:28.304040] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T17:09:29.002298] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-23T17:09:29.211008] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T17:09:29.640354] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T17:09:29.802214] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-23T17:09:30.602216] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-23T17:09:31.200747] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T17:09:31.301493] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:09:31.402264] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-23T17:09:31.802494] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T17:09:32.202205] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-23T17:09:33.002219] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-23T17:09:34.036007] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T17:09:34.041349] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-23T17:09:34.253770] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-23T17:09:34.602210] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-23T17:09:35.026484] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T17:09:35.402252] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-23T17:09:35.502266] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-23T17:09:36.202220] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-23T17:09:36.433815] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T17:09:36.465359] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T17:09:37.002261] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-23T17:09:37.515443] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T17:09:37.802250] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-23T17:09:37.943683] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T17:09:38.602241] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-23T17:09:39.251758] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T17:09:39.402214] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-23T17:09:39.438222] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T17:09:40.202209] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-23T17:09:40.935731] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:09:41.002165] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-23T17:09:41.802297] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-23T17:09:42.511314] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T17:09:42.519729] [INFO ] [REMOTE ] ALC: Full fetch complete (72170 records). [2025-09-23T17:09:42.519899] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-23T17:09:42.520826] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:09:42.520926] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:42.520968] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:42.521006] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-23T17:09:42.521065] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-09-23T17:09:42.521100] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-09-23T17:09:42.521796] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-09-23T17:09:42.521901] [INFO ] [MAIN ] Update Progress: 78/2372 symbols completed. ALC took 23.5s. Estimated remaining: 4h 43m 57s. Rate: 8.1 symbols/min [2025-09-23T17:09:42.650387] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-23T17:09:42.662334] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-23T17:09:42.823025] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T17:09:43.402203] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-23T17:09:44.473879] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T17:09:44.507475] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T17:09:44.506486] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-23T17:09:45.002195] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-23T17:09:46.417889] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T17:09:46.423468] [INFO ] [REMOTE ] ALE: Full fetch complete (41972 records). [2025-09-23T17:09:46.423557] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-23T17:09:46.424100] [FATAL] [VALIDATOR ] ALE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:09:46.424183] [FATAL] [MAIN ] ALE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:46.424226] [WARN ] [MAIN ] ALE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:46.424290] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-23T17:09:46.424354] [DEBUG] [LOCAL ] ALE: No primary data file found to delete. [2025-09-23T17:09:46.424390] [INFO ] [LOCAL ] ALE: Starting deletion of derivative data. [2025-09-23T17:09:46.424780] [DEBUG] [LOCAL ] ALE: Deleted derivative data file. [2025-09-23T17:09:46.426090] [INFO ] [MAIN ] Update Progress: 79/2372 symbols completed. ALE took 20.7s. Estimated remaining: 4h 42m 8s. Rate: 8.1 symbols/min [2025-09-23T17:09:46.670126] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-23T17:09:46.678868] [INFO ] [REMOTE ] ALB: Full fetch complete (76760 records). [2025-09-23T17:09:46.678998] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-23T17:09:47.084132] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-23T17:09:47.084228] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-23T17:09:47.085184] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-23T17:09:47.085271] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-23T17:09:47.086841] [DEBUG] [LOCAL ] ALB: Trimmed 76760 records to 53222 (keeping 200 days of data) [2025-09-23T17:09:47.412796] [DEBUG] [LOCAL ] ALB: Primary data saved (53222 records). [2025-09-23T17:09:47.412946] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-23T17:09:47.413046] [INFO ] [MAIN ] Update Progress: 80/2372 symbols completed. ALB took 30.3s. Estimated remaining: 4h 38m 57s. Rate: 8.2 symbols/min [2025-09-23T17:09:47.966568] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:48.126820] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:48.170908] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:48.166861] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:48.204689] [DEBUG] [LOCAL ] ALG: Loaded 10523 existing records from primary storage. [2025-09-23T17:09:48.204845] [INFO ] [MAIN ] ALG: Loaded 10523 existing records. [2025-09-23T17:09:48.311017] [DEBUG] [LOCAL ] ALEX: Loaded 31417 existing records from primary storage. [2025-09-23T17:09:48.343318] [INFO ] [MAIN ] ALEX: Loaded 31417 existing records. [2025-09-23T17:09:48.511714] [DEBUG] [LOCAL ] ALK: Loaded 53078 existing records from primary storage. [2025-09-23T17:09:48.586397] [INFO ] [MAIN ] ALK: Loaded 53078 existing records. [2025-09-23T17:09:48.589731] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:48.591271] [DEBUG] [LOCAL ] ALIT: Loaded 52759 existing records from primary storage. [2025-09-23T17:09:48.591970] [INFO ] [MAIN ] ALIT: Loaded 52759 existing records. [2025-09-23T17:09:48.591855] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-23T17:09:48.613199] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-23T17:09:48.744574] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-23T17:09:48.836246] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-23T17:09:48.851880] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:48.932439] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-23T17:09:48.951794] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-23T17:09:49.109253] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-23T17:09:49.168883] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-23T17:09:49.172933] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:49.168769] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:49.233366] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-23T17:09:49.257268] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-23T17:09:49.295114] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-23T17:09:49.322951] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-23T17:09:49.418712] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-23T17:09:49.410241] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-23T17:09:49.428086] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-23T17:09:49.418872] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-23T17:09:50.035069] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:50.083416] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-23T17:09:50.223064] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:50.313997] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-23T17:09:50.539487] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:50.563489] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-23T17:09:50.604581] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:50.604915] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-23T17:09:51.021812] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:09:51.024618] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-23T17:09:51.586224] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:09:51.589225] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-23T17:09:51.948108] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:09:51.959385] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-23T17:09:52.054602] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T17:09:52.065521] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-23T17:09:52.113853] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T17:09:52.145473] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:09:52.202164] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-23T17:09:52.878119] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T17:09:53.002189] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-23T17:09:53.439700] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T17:09:53.733364] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T17:09:53.802207] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-23T17:09:53.940702] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:09:54.602264] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-23T17:09:55.353916] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:09:55.402379] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-23T17:09:55.483058] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T17:09:56.202218] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-23T17:09:57.002230] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-23T17:09:57.511391] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T17:09:57.791350] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T17:09:57.802152] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-23T17:09:58.212319] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T17:09:58.602206] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-23T17:09:59.122770] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:09:59.230775] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T17:09:59.402208] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-23T17:10:00.202226] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-23T17:10:01.002189] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-23T17:10:01.278021] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T17:10:01.802188] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-23T17:10:01.857759] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T17:10:02.004101] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T17:10:02.602406] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-23T17:10:03.150387] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T17:10:03.407337] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-23T17:10:03.422463] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T17:10:04.202212] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-23T17:10:04.748121] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T17:10:04.972758] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T17:10:05.002164] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-23T17:10:05.802205] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-23T17:10:06.396430] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:10:06.398508] [INFO ] [REMOTE ] ALG: Full fetch complete (15857 records). [2025-09-23T17:10:06.398675] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-23T17:10:06.607367] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-23T17:10:06.773503] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-23T17:10:06.773693] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-23T17:10:06.773995] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-23T17:10:06.774076] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-23T17:10:06.774834] [DEBUG] [LOCAL ] ALG: Trimmed 15857 records to 10456 (keeping 200 days of data) [2025-09-23T17:10:06.843093] [DEBUG] [LOCAL ] ALG: Primary data saved (10456 records). [2025-09-23T17:10:06.843244] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-23T17:10:06.843331] [INFO ] [MAIN ] Update Progress: 81/2372 symbols completed. ALG took 19.4s. Estimated remaining: 4h 44m 33s. Rate: 8.1 symbols/min [2025-09-23T17:10:07.046207] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T17:10:07.050612] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:07.117072] [DEBUG] [LOCAL ] ALL: Loaded 50217 existing records from primary storage. [2025-09-23T17:10:07.117202] [INFO ] [MAIN ] ALL: Loaded 50217 existing records. [2025-09-23T17:10:07.302965] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:07.303376] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-23T17:10:07.303433] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-23T17:10:07.305813] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-23T17:10:07.305875] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-23T17:10:07.406876] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-23T17:10:07.697878] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:08.202187] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-23T17:10:08.266933] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T17:10:08.825059] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T17:10:09.002451] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-23T17:10:09.725638] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T17:10:09.802220] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-23T17:10:10.602271] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-23T17:10:11.059591] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-23T17:10:11.402304] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-23T17:10:11.643816] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T17:10:11.704074] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T17:10:12.202233] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-23T17:10:12.862804] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T17:10:13.002198] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-23T17:10:13.086248] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T17:10:13.802204] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-23T17:10:14.602163] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-23T17:10:14.718822] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T17:10:15.402236] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-23T17:10:15.706842] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T17:10:16.202233] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-23T17:10:16.629071] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T17:10:16.637469] [INFO ] [REMOTE ] ALK: Full fetch complete (76432 records). [2025-09-23T17:10:16.637621] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-23T17:10:16.638537] [FATAL] [VALIDATOR ] ALK: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:10:16.638689] [FATAL] [MAIN ] ALK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:10:16.638743] [WARN ] [MAIN ] ALK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:10:16.638785] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-23T17:10:16.638844] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-23T17:10:16.638879] [INFO ] [LOCAL ] ALK: Starting deletion of derivative data. [2025-09-23T17:10:16.639318] [DEBUG] [LOCAL ] ALK: Deleted derivative data file. [2025-09-23T17:10:16.639421] [INFO ] [MAIN ] Update Progress: 82/2372 symbols completed. ALK took 29.2s. Estimated remaining: 4h 45m 31s. Rate: 8.0 symbols/min [2025-09-23T17:10:16.823772] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:16.873174] [DEBUG] [LOCAL ] ALLE: Loaded 45317 existing records from primary storage. [2025-09-23T17:10:16.873351] [INFO ] [MAIN ] ALLE: Loaded 45317 existing records. [2025-09-23T17:10:17.006588] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-23T17:10:17.029800] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T17:10:17.106890] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:17.107276] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-23T17:10:17.107380] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-23T17:10:17.108944] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-23T17:10:17.109006] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-23T17:10:17.467637] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:17.623259] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T17:10:17.632140] [INFO ] [REMOTE ] ALIT: Full fetch complete (76416 records). [2025-09-23T17:10:17.632264] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-23T17:10:17.808222] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-23T17:10:18.034180] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-23T17:10:18.034437] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-23T17:10:18.035545] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-23T17:10:18.035860] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-23T17:10:18.038123] [DEBUG] [LOCAL ] ALIT: Trimmed 76416 records to 52761 (keeping 200 days of data) [2025-09-23T17:10:18.149572] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T17:10:18.390201] [DEBUG] [LOCAL ] ALIT: Primary data saved (52761 records). [2025-09-23T17:10:18.390337] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-23T17:10:18.391008] [INFO ] [MAIN ] Update Progress: 83/2372 symbols completed. ALIT took 31.0s. Estimated remaining: 4h 42m 45s. Rate: 8.1 symbols/min [2025-09-23T17:10:18.570305] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:18.603458] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-23T17:10:18.625186] [DEBUG] [LOCAL ] ALLY: Loaded 53218 existing records from primary storage. [2025-09-23T17:10:18.625333] [INFO ] [MAIN ] ALLY: Loaded 53218 existing records. [2025-09-23T17:10:18.813604] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:18.813891] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-23T17:10:18.813940] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-23T17:10:18.815696] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-23T17:10:18.815761] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-23T17:10:19.179055] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:19.402150] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-23T17:10:19.657731] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T17:10:20.108532] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T17:10:20.202235] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-23T17:10:20.958175] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:10:21.002143] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-23T17:10:21.449743] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T17:10:21.802271] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-23T17:10:22.477571] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T17:10:22.602152] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-23T17:10:23.102814] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T17:10:23.402212] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-23T17:10:24.031113] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:10:24.202188] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-23T17:10:25.002201] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-23T17:10:25.070604] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T17:10:25.790768] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T17:10:25.802143] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-23T17:10:25.858280] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T17:10:26.602231] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-23T17:10:26.805371] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T17:10:26.814030] [INFO ] [REMOTE ] ALEX: Full fetch complete (44567 records). [2025-09-23T17:10:26.814198] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-23T17:10:27.197019] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-23T17:10:27.197131] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-23T17:10:27.197671] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-23T17:10:27.197736] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-23T17:10:27.199303] [DEBUG] [LOCAL ] ALEX: Trimmed 44567 records to 31336 (keeping 200 days of data) [2025-09-23T17:10:27.395038] [DEBUG] [LOCAL ] ALEX: Primary data saved (31336 records). [2025-09-23T17:10:27.395172] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-23T17:10:27.395257] [INFO ] [MAIN ] Update Progress: 84/2372 symbols completed. ALEX took 40.0s. Estimated remaining: 4h 43m 21s. Rate: 8.1 symbols/min [2025-09-23T17:10:27.407268] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-23T17:10:27.578364] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:27.621778] [DEBUG] [LOCAL ] ALSN: Loaded 43348 existing records from primary storage. [2025-09-23T17:10:27.621924] [INFO ] [MAIN ] ALSN: Loaded 43348 existing records. [2025-09-23T17:10:27.810883] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:27.811147] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-23T17:10:27.811196] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-23T17:10:27.812793] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-23T17:10:27.812859] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-23T17:10:28.195877] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:28.202139] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-23T17:10:28.416724] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T17:10:29.002214] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-23T17:10:29.048976] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T17:10:29.567517] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:10:29.802203] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-23T17:10:30.602211] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-23T17:10:30.896580] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T17:10:31.275212] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T17:10:31.402192] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-23T17:10:32.202179] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-23T17:10:32.300070] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T17:10:33.007350] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-23T17:10:33.024505] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T17:10:33.802165] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-23T17:10:33.985044] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T17:10:34.334282] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T17:10:34.602259] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-23T17:10:35.402193] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-23T17:10:35.496886] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:10:36.013530] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:10:36.202193] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-23T17:10:36.554315] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T17:10:37.002208] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-23T17:10:37.593610] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T17:10:37.802202] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-23T17:10:38.602224] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-23T17:10:38.738333] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T17:10:39.321889] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T17:10:39.330665] [INFO ] [REMOTE ] ALLY: Full fetch complete (76880 records). [2025-09-23T17:10:39.330792] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-23T17:10:39.407921] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-23T17:10:39.737171] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-23T17:10:39.737290] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-23T17:10:39.738122] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-23T17:10:39.738201] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-23T17:10:39.739964] [DEBUG] [LOCAL ] ALLY: Trimmed 76880 records to 53218 (keeping 200 days of data) [2025-09-23T17:10:39.898695] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:10:40.106023] [DEBUG] [LOCAL ] ALLY: Primary data saved (53218 records). [2025-09-23T17:10:40.106166] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-23T17:10:40.106249] [INFO ] [MAIN ] Update Progress: 85/2372 symbols completed. ALLY took 21.7s. Estimated remaining: 4h 45m 36s. Rate: 8.0 symbols/min [2025-09-23T17:10:40.207353] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-23T17:10:40.292364] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:40.314904] [DEBUG] [LOCAL ] ALTG: Loaded 24033 existing records from primary storage. [2025-09-23T17:10:40.315074] [INFO ] [MAIN ] ALTG: Loaded 24033 existing records. [2025-09-23T17:10:40.495585] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:40.495878] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-23T17:10:40.495927] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-23T17:10:40.496597] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-23T17:10:40.496717] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-23T17:10:40.868334] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:40.938285] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:10:41.002244] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-23T17:10:41.755631] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T17:10:41.802188] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-23T17:10:42.052710] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T17:10:42.602215] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-23T17:10:42.983372] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:10:43.402282] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-23T17:10:44.202232] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-23T17:10:44.743170] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T17:10:44.832769] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T17:10:45.002202] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-23T17:10:45.488107] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:10:45.495437] [INFO ] [REMOTE ] ALLE: Full fetch complete (65031 records). [2025-09-23T17:10:45.495554] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-23T17:10:45.808086] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-23T17:10:45.905079] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T17:10:45.929050] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-23T17:10:45.929121] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-23T17:10:45.929854] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-23T17:10:45.929918] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-23T17:10:45.931299] [DEBUG] [LOCAL ] ALLE: Trimmed 65031 records to 45201 (keeping 200 days of data) [2025-09-23T17:10:46.227735] [DEBUG] [LOCAL ] ALLE: Primary data saved (45201 records). [2025-09-23T17:10:46.227876] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-23T17:10:46.228610] [INFO ] [MAIN ] Update Progress: 86/2372 symbols completed. ALLE took 29.6s. Estimated remaining: 4h 44m 52s. Rate: 8.0 symbols/min [2025-09-23T17:10:46.396757] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:46.410328] [DEBUG] [LOCAL ] ALUR: Loaded 10934 existing records from primary storage. [2025-09-23T17:10:46.410456] [INFO ] [MAIN ] ALUR: Loaded 10934 existing records. [2025-09-23T17:10:46.607391] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-23T17:10:46.613513] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:46.615094] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-23T17:10:46.615163] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-23T17:10:46.615745] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-23T17:10:46.615815] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-23T17:10:46.981540] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:47.402170] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-23T17:10:47.473985] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:10:47.766625] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T17:10:48.202193] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-23T17:10:48.529975] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:10:49.002207] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-23T17:10:49.513093] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T17:10:49.802203] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-23T17:10:50.330344] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T17:10:50.339686] [INFO ] [REMOTE ] ALL: Full fetch complete (72560 records). [2025-09-23T17:10:50.339809] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-23T17:10:50.608898] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-23T17:10:50.734402] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-23T17:10:50.735158] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-23T17:10:50.736072] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-23T17:10:50.736158] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-23T17:10:50.739258] [DEBUG] [LOCAL ] ALL: Trimmed 72560 records to 50241 (keeping 200 days of data) [2025-09-23T17:10:50.884282] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:10:51.084203] [DEBUG] [LOCAL ] ALL: Primary data saved (50241 records). [2025-09-23T17:10:51.084343] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-23T17:10:51.084425] [INFO ] [MAIN ] Update Progress: 87/2372 symbols completed. ALL took 44.2s. Estimated remaining: 4h 43m 36s. Rate: 8.1 symbols/min [2025-09-23T17:10:51.251501] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:51.294198] [DEBUG] [LOCAL ] ALV: Loaded 42725 existing records from primary storage. [2025-09-23T17:10:51.294342] [INFO ] [MAIN ] ALV: Loaded 42725 existing records. [2025-09-23T17:10:51.405576] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-23T17:10:51.481783] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:51.482438] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-23T17:10:51.482526] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-23T17:10:51.495220] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T17:10:51.499384] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-23T17:10:51.500004] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-23T17:10:51.853724] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:52.202195] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-23T17:10:52.399454] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:10:53.002245] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-23T17:10:53.502925] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:10:53.802215] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-23T17:10:54.227631] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T17:10:54.602252] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-23T17:10:54.683060] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T17:10:55.402200] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-23T17:10:55.944243] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:10:56.202221] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-23T17:10:56.227634] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:10:57.002233] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-23T17:10:57.360548] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T17:10:57.802199] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-23T17:10:58.164983] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:10:58.602218] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-23T17:10:59.046020] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T17:10:59.402210] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-23T17:10:59.797475] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T17:10:59.805365] [INFO ] [REMOTE ] ALSN: Full fetch complete (62018 records). [2025-09-23T17:10:59.805538] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-23T17:11:00.173233] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T17:11:00.203840] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-23T17:11:00.227111] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-23T17:11:00.227203] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-23T17:11:00.227916] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-23T17:11:00.228075] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-23T17:11:00.229442] [DEBUG] [LOCAL ] ALSN: Trimmed 62018 records to 43307 (keeping 200 days of data) [2025-09-23T17:11:00.508596] [DEBUG] [LOCAL ] ALSN: Primary data saved (43307 records). [2025-09-23T17:11:00.508794] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-23T17:11:00.512397] [INFO ] [MAIN ] Update Progress: 88/2372 symbols completed. ALSN took 33.1s. Estimated remaining: 4h 44m 20s. Rate: 8.0 symbols/min [2025-09-23T17:11:00.684277] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:00.693701] [DEBUG] [LOCAL ] ALX: Loaded 5896 existing records from primary storage. [2025-09-23T17:11:00.693840] [INFO ] [MAIN ] ALX: Loaded 5896 existing records. [2025-09-23T17:11:00.870512] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:00.870868] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-23T17:11:00.870927] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-23T17:11:00.871352] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-23T17:11:00.871413] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-23T17:11:01.011695] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-23T17:11:01.268155] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:01.393406] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:11:01.802215] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-23T17:11:01.930016] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T17:11:02.602214] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-23T17:11:03.173199] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:11:03.402189] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-23T17:11:03.455954] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T17:11:03.887616] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T17:11:04.202252] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-23T17:11:04.842206] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T17:11:05.002201] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-23T17:11:05.802170] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-23T17:11:05.919031] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T17:11:06.275809] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-23T17:11:06.602225] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-23T17:11:07.390590] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T17:11:07.392133] [INFO ] [REMOTE ] ALUR: Full fetch complete (21065 records). [2025-09-23T17:11:07.392229] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-23T17:11:07.407348] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-23T17:11:07.803279] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-23T17:11:07.803381] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-23T17:11:07.803744] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-23T17:11:07.803807] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-23T17:11:07.804886] [DEBUG] [LOCAL ] ALUR: Trimmed 21065 records to 10889 (keeping 200 days of data) [2025-09-23T17:11:07.871444] [DEBUG] [LOCAL ] ALUR: Primary data saved (10889 records). [2025-09-23T17:11:07.871592] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-23T17:11:07.871742] [INFO ] [MAIN ] Update Progress: 89/2372 symbols completed. ALUR took 21.6s. Estimated remaining: 4h 44m 9s. Rate: 8.0 symbols/min [2025-09-23T17:11:07.992686] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:11:08.054204] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:08.113360] [DEBUG] [LOCAL ] AM: Loaded 52159 existing records from primary storage. [2025-09-23T17:11:08.113526] [INFO ] [MAIN ] AM: Loaded 52159 existing records. [2025-09-23T17:11:08.207365] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-23T17:11:08.295410] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:08.295698] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-23T17:11:08.295754] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-23T17:11:08.297314] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-23T17:11:08.297376] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-23T17:11:08.675873] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:08.680609] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T17:11:09.002197] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-23T17:11:09.802229] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-23T17:11:09.946165] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T17:11:10.183511] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T17:11:10.602246] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-23T17:11:11.402208] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-23T17:11:12.129743] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:11:12.202156] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-23T17:11:13.002166] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-23T17:11:13.362996] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T17:11:13.368373] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T17:11:13.433563] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:11:13.437976] [INFO ] [REMOTE ] ALTG: Full fetch complete (33623 records). [2025-09-23T17:11:13.438060] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-23T17:11:13.805031] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-23T17:11:13.830508] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-23T17:11:13.830607] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-23T17:11:13.831300] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-23T17:11:13.831398] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-23T17:11:13.832277] [DEBUG] [LOCAL ] ALTG: Trimmed 33623 records to 23978 (keeping 200 days of data) [2025-09-23T17:11:13.972983] [DEBUG] [LOCAL ] ALTG: Primary data saved (23978 records). [2025-09-23T17:11:13.973120] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-23T17:11:13.973246] [INFO ] [MAIN ] Update Progress: 90/2372 symbols completed. ALTG took 33.9s. Estimated remaining: 4h 43m 27s. Rate: 8.1 symbols/min [2025-09-23T17:11:14.144844] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:14.188201] [DEBUG] [LOCAL ] AMBC: Loaded 37269 existing records from primary storage. [2025-09-23T17:11:14.188339] [INFO ] [MAIN ] AMBC: Loaded 37269 existing records. [2025-09-23T17:11:14.367170] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:14.367483] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-23T17:11:14.367543] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-23T17:11:14.368591] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-23T17:11:14.368686] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-23T17:11:14.611098] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-23T17:11:14.803740] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:15.402194] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-23T17:11:15.462807] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T17:11:15.803582] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T17:11:16.202206] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-23T17:11:16.642886] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T17:11:16.897551] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:11:17.002206] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-23T17:11:17.627580] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T17:11:17.802253] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-23T17:11:18.581391] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T17:11:18.602146] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-23T17:11:19.402239] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-23T17:11:19.552357] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:11:20.202258] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-23T17:11:20.656796] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:11:21.002209] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-23T17:11:21.708760] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:11:21.802191] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-23T17:11:22.281954] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:11:22.602216] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-23T17:11:23.045636] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T17:11:23.402223] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-23T17:11:23.937818] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:11:24.202200] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-23T17:11:24.462894] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T17:11:25.002214] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-23T17:11:25.802219] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-23T17:11:25.892954] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T17:11:26.043025] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T17:11:26.602266] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-23T17:11:27.312142] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T17:11:27.402280] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-23T17:11:27.970547] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T17:11:28.008822] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T17:11:28.202206] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-23T17:11:28.734972] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T17:11:29.002195] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-23T17:11:29.574412] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T17:11:29.576611] [INFO ] [REMOTE ] ALX: Full fetch complete (6824 records). [2025-09-23T17:11:29.576790] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-23T17:11:29.807775] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-23T17:11:30.035209] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-23T17:11:30.035290] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-23T17:11:30.035549] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-23T17:11:30.035611] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-23T17:11:30.036895] [DEBUG] [LOCAL ] ALX: Trimmed 6824 records to 5959 (keeping 200 days of data) [2025-09-23T17:11:30.078780] [DEBUG] [LOCAL ] ALX: Primary data saved (5959 records). [2025-09-23T17:11:30.078883] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-23T17:11:30.078996] [INFO ] [MAIN ] Update Progress: 91/2372 symbols completed. ALX took 29.6s. Estimated remaining: 4h 46m 57s. Rate: 7.9 symbols/min [2025-09-23T17:11:30.251704] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:30.317337] [DEBUG] [LOCAL ] AMBP: Loaded 45371 existing records from primary storage. [2025-09-23T17:11:30.317481] [INFO ] [MAIN ] AMBP: Loaded 45371 existing records. [2025-09-23T17:11:30.505508] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:30.505850] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-23T17:11:30.505916] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-23T17:11:30.507146] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-23T17:11:30.507220] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-23T17:11:30.607284] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-23T17:11:30.891866] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:31.402178] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-23T17:11:31.759686] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T17:11:31.868303] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:11:31.876809] [INFO ] [REMOTE ] ALV: Full fetch complete (61871 records). [2025-09-23T17:11:31.876942] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-23T17:11:32.207303] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-23T17:11:32.283056] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-23T17:11:32.283146] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-23T17:11:32.283793] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-23T17:11:32.283858] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-23T17:11:32.287581] [DEBUG] [LOCAL ] ALV: Trimmed 61871 records to 42654 (keeping 200 days of data) [2025-09-23T17:11:32.571248] [DEBUG] [LOCAL ] ALV: Primary data saved (42654 records). [2025-09-23T17:11:32.571388] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-23T17:11:32.571492] [INFO ] [MAIN ] Update Progress: 92/2372 symbols completed. ALV took 41.5s. Estimated remaining: 4h 44m 44s. Rate: 8.0 symbols/min [2025-09-23T17:11:32.758279] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T17:11:32.790164] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:32.791096] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-23T17:11:32.791348] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-23T17:11:32.791698] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-23T17:11:32.791765] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-23T17:11:32.791821] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-23T17:11:32.791857] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-23T17:11:33.007353] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-23T17:11:33.162558] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:33.679393] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:11:33.802191] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-23T17:11:34.467472] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T17:11:34.602251] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-23T17:11:34.803588] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:34.803994] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-23T17:11:35.096445] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:11:35.402232] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-23T17:11:36.202187] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-23T17:11:36.612124] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:11:37.002201] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-23T17:11:37.704997] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T17:11:37.802201] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-23T17:11:38.114005] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T17:11:38.602218] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-23T17:11:38.799073] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:38.799408] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-23T17:11:39.127937] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:11:39.402225] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-23T17:11:40.202236] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-23T17:11:41.002181] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-23T17:11:41.042333] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T17:11:41.365766] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:11:41.802224] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-23T17:11:41.949858] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:11:41.956370] [INFO ] [REMOTE ] AMBC: Full fetch complete (51037 records). [2025-09-23T17:11:41.956483] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-23T17:11:42.361492] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-23T17:11:42.361672] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-23T17:11:42.362276] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-23T17:11:42.362321] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-23T17:11:42.363505] [DEBUG] [LOCAL ] AMBC: Trimmed 51037 records to 37181 (keeping 200 days of data) [2025-09-23T17:11:42.575060] [DEBUG] [LOCAL ] AMBC: Primary data saved (37181 records). [2025-09-23T17:11:42.575217] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-23T17:11:42.575341] [INFO ] [MAIN ] Update Progress: 93/2372 symbols completed. AMBC took 28.6s. Estimated remaining: 4h 45m 38s. Rate: 8.0 symbols/min [2025-09-23T17:11:42.607435] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-23T17:11:42.757007] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:42.814365] [DEBUG] [LOCAL ] AMC: Loaded 53758 existing records from primary storage. [2025-09-23T17:11:42.814514] [INFO ] [MAIN ] AMC: Loaded 53758 existing records. [2025-09-23T17:11:43.011545] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:43.012199] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-23T17:11:43.012344] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-23T17:11:43.014082] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-23T17:11:43.014149] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-23T17:11:43.416191] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T17:11:43.414637] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-23T17:11:43.422162] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:43.634188] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:43.634501] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-23T17:11:44.052111] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T17:11:44.060900] [INFO ] [REMOTE ] AM: Full fetch complete (75613 records). [2025-09-23T17:11:44.061068] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-23T17:11:44.207343] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-23T17:11:44.478337] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-23T17:11:44.478434] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-23T17:11:44.479176] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-23T17:11:44.479244] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-23T17:11:44.480863] [DEBUG] [LOCAL ] AM: Trimmed 75613 records to 52154 (keeping 200 days of data) [2025-09-23T17:11:44.546739] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:44.581523] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-23T17:11:44.812263] [DEBUG] [LOCAL ] AM: Primary data saved (52154 records). [2025-09-23T17:11:44.812417] [INFO ] [MAIN ] AM: Full history saved. [2025-09-23T17:11:44.812508] [INFO ] [MAIN ] Update Progress: 94/2372 symbols completed. AM took 36.9s. Estimated remaining: 4h 43m 22s. Rate: 8.0 symbols/min [2025-09-23T17:11:45.015347] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:45.011293] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-23T17:11:45.077788] [DEBUG] [LOCAL ] AMCR: Loaded 53668 existing records from primary storage. [2025-09-23T17:11:45.077955] [INFO ] [MAIN ] AMCR: Loaded 53668 existing records. [2025-09-23T17:11:45.261849] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:45.262128] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-23T17:11:45.262178] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-23T17:11:45.263705] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-23T17:11:45.263768] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-23T17:11:45.632217] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:45.802200] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-23T17:11:46.004506] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:46.004835] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-23T17:11:46.602219] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-23T17:11:46.707420] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T17:11:47.402213] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-23T17:11:48.202244] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-23T17:11:48.414894] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:48.415246] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-23T17:11:48.957347] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T17:11:49.002166] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-23T17:11:49.471682] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-09-23T17:11:49.802200] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-23T17:11:49.992109] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:49.992432] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-23T17:11:50.357722] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T17:11:50.602197] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-23T17:11:51.402253] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-23T17:11:52.202222] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-23T17:11:52.410007] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:11:52.788929] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:11:53.002205] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-23T17:11:53.336757] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T17:11:53.802202] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-23T17:11:54.203311] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T17:11:54.602208] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-23T17:11:55.121198] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:11:55.402187] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-23T17:11:55.807137] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T17:11:56.202249] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-23T17:11:56.369840] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:11:56.374205] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7753 records). [2025-09-23T17:11:56.374293] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-23T17:11:56.558200] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 39 unique days, need 200 days [2025-09-23T17:11:56.558459] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:11:56.558531] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:11:56.558605] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-23T17:11:56.558707] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-23T17:11:56.558761] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-23T17:11:56.558805] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-23T17:11:56.558865] [INFO ] [MAIN ] Update Progress: 95/2372 symbols completed. AMBQ took 24.0s. Estimated remaining: 4h 44m 58s. Rate: 8.0 symbols/min [2025-09-23T17:11:56.730788] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:56.783770] [DEBUG] [LOCAL ] AME: Loaded 48548 existing records from primary storage. [2025-09-23T17:11:56.783956] [INFO ] [MAIN ] AME: Loaded 48548 existing records. [2025-09-23T17:11:56.964784] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:56.965083] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-23T17:11:56.965137] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-23T17:11:56.966877] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-23T17:11:56.966940] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-23T17:11:57.008826] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-23T17:11:57.334985] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:57.807296] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-23T17:11:57.828088] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T17:11:58.270684] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:11:58.281559] [INFO ] [REMOTE ] AMBP: Full fetch complete (66042 records). [2025-09-23T17:11:58.281768] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-23T17:11:58.607311] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-23T17:11:58.690228] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-23T17:11:58.690324] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-23T17:11:58.691041] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-23T17:11:58.691107] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-23T17:11:58.692676] [DEBUG] [LOCAL ] AMBP: Trimmed 66042 records to 45331 (keeping 200 days of data) [2025-09-23T17:11:58.957985] [DEBUG] [LOCAL ] AMBP: Primary data saved (45331 records). [2025-09-23T17:11:58.958124] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-23T17:11:58.959260] [INFO ] [MAIN ] Update Progress: 96/2372 symbols completed. AMBP took 28.9s. Estimated remaining: 4h 42m 49s. Rate: 8.0 symbols/min [2025-09-23T17:11:59.177354] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:59.202878] [DEBUG] [LOCAL ] AMG: Loaded 20789 existing records from primary storage. [2025-09-23T17:11:59.203061] [INFO ] [MAIN ] AMG: Loaded 20789 existing records. [2025-09-23T17:11:59.395119] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:59.395390] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-23T17:11:59.395439] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-23T17:11:59.396300] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-23T17:11:59.396362] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-23T17:11:59.428379] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-23T17:11:59.758916] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:00.041829] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-23T17:12:00.202209] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-23T17:12:00.614800] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-23T17:12:01.002184] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-23T17:12:01.081473] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T17:12:01.802213] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-23T17:12:02.602174] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-23T17:12:02.828841] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-23T17:12:02.897683] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T17:12:03.402237] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-23T17:12:04.202237] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-23T17:12:04.556393] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-23T17:12:05.002200] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-23T17:12:05.450293] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-23T17:12:05.545568] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:12:05.802165] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-23T17:12:05.906252] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-23T17:12:06.031808] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T17:12:06.602229] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-23T17:12:07.263912] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:12:07.402200] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-23T17:12:07.841093] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T17:12:08.202145] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-23T17:12:08.820457] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T17:12:09.002183] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-23T17:12:09.063816] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T17:12:09.802194] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-23T17:12:10.432661] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:12:10.602227] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-23T17:12:11.332690] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T17:12:11.402168] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-23T17:12:11.455383] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T17:12:12.202251] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-23T17:12:13.002168] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-23T17:12:13.171722] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:12:13.239999] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T17:12:13.802249] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-23T17:12:14.602244] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-23T17:12:15.402305] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-23T17:12:15.573342] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-23T17:12:16.181300] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T17:12:16.202149] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-23T17:12:16.402580] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-23T17:12:17.002282] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-23T17:12:17.344406] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:12:17.674621] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T17:12:17.802240] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-23T17:12:18.501148] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T17:12:18.602190] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-23T17:12:19.031916] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T17:12:19.406045] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-23T17:12:19.411232] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:12:19.419438] [INFO ] [REMOTE ] AMG: Full fetch complete (29795 records). [2025-09-23T17:12:19.419581] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-23T17:12:19.970089] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-23T17:12:19.970206] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-23T17:12:19.970802] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-23T17:12:19.970931] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-23T17:12:19.972254] [DEBUG] [LOCAL ] AMG: Trimmed 29795 records to 20774 (keeping 200 days of data) [2025-09-23T17:12:20.152754] [DEBUG] [LOCAL ] AMG: Primary data saved (20774 records). [2025-09-23T17:12:20.152947] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-23T17:12:20.153081] [INFO ] [MAIN ] Update Progress: 97/2372 symbols completed. AMG took 21.2s. Estimated remaining: 4h 48m 4s. Rate: 7.9 symbols/min [2025-09-23T17:12:20.209599] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-23T17:12:20.426452] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:20.500757] [DEBUG] [LOCAL ] AMH: Loaded 51691 existing records from primary storage. [2025-09-23T17:12:20.500970] [INFO ] [MAIN ] AMH: Loaded 51691 existing records. [2025-09-23T17:12:20.712127] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:20.712435] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-23T17:12:20.712485] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-23T17:12:20.714434] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-23T17:12:20.714500] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-23T17:12:21.006793] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-23T17:12:21.154796] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:21.184974] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T17:12:21.802201] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-23T17:12:22.323938] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-23T17:12:22.602199] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-23T17:12:22.677692] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T17:12:23.402214] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-23T17:12:23.599689] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T17:12:23.608398] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-23T17:12:23.608524] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-23T17:12:24.002669] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-23T17:12:24.002759] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-23T17:12:24.003549] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-23T17:12:24.003614] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-23T17:12:24.005112] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53668 (keeping 200 days of data) [2025-09-23T17:12:24.210316] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-23T17:12:24.335517] [DEBUG] [LOCAL ] AMCR: Primary data saved (53668 records). [2025-09-23T17:12:24.335705] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-23T17:12:24.335809] [INFO ] [MAIN ] Update Progress: 98/2372 symbols completed. AMCR took 39.5s. Estimated remaining: 4h 46m 37s. Rate: 7.9 symbols/min [2025-09-23T17:12:24.514240] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:24.557099] [DEBUG] [LOCAL ] AMN: Loaded 42032 existing records from primary storage. [2025-09-23T17:12:24.557394] [INFO ] [MAIN ] AMN: Loaded 42032 existing records. [2025-09-23T17:12:24.777955] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T17:12:24.784391] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:24.795620] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-23T17:12:24.795902] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-23T17:12:24.798042] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-23T17:12:24.798112] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-23T17:12:25.007790] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-23T17:12:25.188861] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:25.217680] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T17:12:25.561411] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T17:12:25.802203] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-23T17:12:26.602252] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-23T17:12:27.123322] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-23T17:12:27.133312] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-23T17:12:27.133517] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-23T17:12:27.407326] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-23T17:12:27.555146] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-23T17:12:27.555279] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-23T17:12:27.556275] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-23T17:12:27.556367] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-23T17:12:27.558333] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53758 (keeping 200 days of data) [2025-09-23T17:12:27.670060] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T17:12:27.693701] [INFO ] [REMOTE ] AME: Full fetch complete (69704 records). [2025-09-23T17:12:27.697162] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-23T17:12:28.234380] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-23T17:12:28.235236] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-23T17:12:28.236172] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-23T17:12:28.237406] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-23T17:12:28.246288] [DEBUG] [LOCAL ] AME: Trimmed 69704 records to 48543 (keeping 200 days of data) [2025-09-23T17:12:28.391790] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T17:12:28.408574] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-23T17:12:28.534775] [DEBUG] [LOCAL ] AMC: Primary data saved (53758 records). [2025-09-23T17:12:28.536471] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-23T17:12:28.536851] [INFO ] [MAIN ] Update Progress: 99/2372 symbols completed. AMC took 46.0s. Estimated remaining: 4h 45m 12s. Rate: 8.0 symbols/min [2025-09-23T17:12:28.727354] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:28.922924] [DEBUG] [LOCAL ] AMP: Loaded 32634 existing records from primary storage. [2025-09-23T17:12:28.923747] [INFO ] [MAIN ] AMP: Loaded 32634 existing records. [2025-09-23T17:12:29.113596] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:29.128887] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-23T17:12:29.137802] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-23T17:12:29.141559] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T17:12:29.141970] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-23T17:12:29.151406] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-23T17:12:29.152195] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-23T17:12:29.187868] [DEBUG] [LOCAL ] AME: Primary data saved (48543 records). [2025-09-23T17:12:29.204985] [INFO ] [MAIN ] AME: Full history saved. [2025-09-23T17:12:29.222730] [INFO ] [MAIN ] Update Progress: 100/2372 symbols completed. AME took 32.7s. Estimated remaining: 4h 42m 29s. Rate: 8.0 symbols/min [2025-09-23T17:12:29.609663] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:29.750978] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:29.790314] [DEBUG] [LOCAL ] AMPX: Loaded 52158 existing records from primary storage. [2025-09-23T17:12:29.790553] [INFO ] [MAIN ] AMPX: Loaded 52158 existing records. [2025-09-23T17:12:29.811203] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-23T17:12:29.978699] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:29.978940] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-23T17:12:29.978988] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-23T17:12:29.980731] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-23T17:12:29.980794] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-23T17:12:30.354689] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T17:12:30.397951] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:30.426162] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:12:30.602216] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-23T17:12:31.171185] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T17:12:31.402221] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-23T17:12:32.202221] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-23T17:12:32.279699] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T17:12:32.743095] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:12:33.002222] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-23T17:12:33.300220] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T17:12:33.802219] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-23T17:12:34.302083] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T17:12:34.602243] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-23T17:12:35.018251] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T17:12:35.402256] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-23T17:12:36.002396] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T17:12:36.202271] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-23T17:12:37.002233] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-23T17:12:37.142277] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T17:12:37.338119] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T17:12:37.802244] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-23T17:12:38.339735] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T17:12:38.602195] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-23T17:12:39.402202] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-23T17:12:39.532508] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T17:12:39.888594] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:12:40.202221] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-23T17:12:40.872396] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:12:41.002229] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-23T17:12:41.802160] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-23T17:12:41.919437] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T17:12:42.602201] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-23T17:12:43.060840] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:12:43.168072] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T17:12:43.402183] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-23T17:12:44.202199] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-23T17:12:44.329693] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:12:44.338400] [INFO ] [REMOTE ] AMH: Full fetch complete (74698 records). [2025-09-23T17:12:44.338529] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-23T17:12:44.758553] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-23T17:12:44.762138] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-23T17:12:44.762960] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-23T17:12:44.763093] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-23T17:12:44.765317] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T17:12:44.774116] [DEBUG] [LOCAL ] AMH: Trimmed 74698 records to 51695 (keeping 200 days of data) [2025-09-23T17:12:45.002858] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-23T17:12:45.094415] [DEBUG] [LOCAL ] AMH: Primary data saved (51695 records). [2025-09-23T17:12:45.094627] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-23T17:12:45.094750] [INFO ] [MAIN ] Update Progress: 101/2372 symbols completed. AMH took 24.9s. Estimated remaining: 4h 45m 31s. Rate: 8.0 symbols/min [2025-09-23T17:12:45.267051] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:45.303083] [DEBUG] [LOCAL ] AMPY: Loaded 37411 existing records from primary storage. [2025-09-23T17:12:45.303389] [INFO ] [MAIN ] AMPY: Loaded 37411 existing records. [2025-09-23T17:12:45.420310] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:12:45.505375] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:45.505628] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-23T17:12:45.505708] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-23T17:12:45.506757] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-23T17:12:45.506818] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-23T17:12:45.807374] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-23T17:12:45.863549] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:46.407978] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:12:46.602215] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-23T17:12:47.052033] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T17:12:47.402221] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-23T17:12:47.466717] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:12:48.202231] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-23T17:12:49.002221] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-23T17:12:49.239017] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T17:12:49.469560] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-23T17:12:49.802187] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-23T17:12:50.227218] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:12:50.602213] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-23T17:12:50.981812] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T17:12:51.402231] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-23T17:12:52.202219] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-23T17:12:52.293833] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T17:12:52.517189] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:12:53.002228] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-23T17:12:53.547497] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:12:53.802249] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-23T17:12:54.510088] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T17:12:54.602177] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-23T17:12:54.942225] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T17:12:55.402196] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-23T17:12:56.202206] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-23T17:12:56.526329] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T17:12:56.620490] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T17:12:57.002196] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-23T17:12:57.703154] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T17:12:57.712086] [INFO ] [REMOTE ] AMN: Full fetch complete (60531 records). [2025-09-23T17:12:57.712268] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-23T17:12:57.809020] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-23T17:12:58.144908] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-23T17:12:58.145175] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-23T17:12:58.145923] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-23T17:12:58.145992] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-23T17:12:58.154106] [DEBUG] [LOCAL ] AMN: Trimmed 60531 records to 42049 (keeping 200 days of data) [2025-09-23T17:12:58.166320] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T17:12:58.429131] [DEBUG] [LOCAL ] AMN: Primary data saved (42049 records). [2025-09-23T17:12:58.429290] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-23T17:12:58.429389] [INFO ] [MAIN ] Update Progress: 102/2372 symbols completed. AMN took 34.1s. Estimated remaining: 4h 47m 32s. Rate: 7.9 symbols/min [2025-09-23T17:12:58.614220] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-23T17:12:58.619188] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:58.653893] [DEBUG] [LOCAL ] AMR: Loaded 29089 existing records from primary storage. [2025-09-23T17:12:58.654091] [INFO ] [MAIN ] AMR: Loaded 29089 existing records. [2025-09-23T17:12:58.833812] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:58.834058] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-23T17:12:58.834107] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-23T17:12:58.835244] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-23T17:12:58.835310] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-23T17:12:59.194239] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:59.242875] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:12:59.402172] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-23T17:12:59.689530] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T17:13:00.202208] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-23T17:13:00.812585] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:13:01.002238] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-23T17:13:01.066490] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:13:01.802225] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-23T17:13:01.921740] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T17:13:02.443855] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T17:13:02.602212] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-23T17:13:03.402179] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-23T17:13:03.798127] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T17:13:04.202251] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-23T17:13:04.475775] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T17:13:05.002207] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-23T17:13:05.661139] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T17:13:05.666575] [INFO ] [REMOTE ] AMP: Full fetch complete (47589 records). [2025-09-23T17:13:05.666690] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-23T17:13:05.807357] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-23T17:13:06.053520] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-23T17:13:06.053669] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-23T17:13:06.054677] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-23T17:13:06.054763] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-23T17:13:06.056126] [DEBUG] [LOCAL ] AMP: Trimmed 47589 records to 32522 (keeping 200 days of data) [2025-09-23T17:13:06.168013] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T17:13:06.282588] [DEBUG] [LOCAL ] AMP: Primary data saved (32522 records). [2025-09-23T17:13:06.282743] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-23T17:13:06.282830] [INFO ] [MAIN ] Update Progress: 103/2372 symbols completed. AMP took 37.7s. Estimated remaining: 4h 47m 30s. Rate: 7.9 symbols/min [2025-09-23T17:13:06.451479] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:06.488400] [DEBUG] [LOCAL ] AMRC: Loaded 38463 existing records from primary storage. [2025-09-23T17:13:06.488537] [INFO ] [MAIN ] AMRC: Loaded 38463 existing records. [2025-09-23T17:13:06.607325] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-23T17:13:06.670229] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:06.670480] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-23T17:13:06.670529] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-23T17:13:06.671822] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-23T17:13:06.671885] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-23T17:13:07.037164] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:07.402200] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-23T17:13:07.939381] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T17:13:08.202265] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-23T17:13:08.267462] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-23T17:13:08.456683] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T17:13:09.002254] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-23T17:13:09.347633] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T17:13:09.802204] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-23T17:13:10.602189] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-23T17:13:10.799061] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T17:13:10.804732] [INFO ] [REMOTE ] AMPY: Full fetch complete (50241 records). [2025-09-23T17:13:10.804884] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-23T17:13:11.220702] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-23T17:13:11.220945] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-23T17:13:11.221567] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-23T17:13:11.221677] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-23T17:13:11.249620] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-23T17:13:11.249834] [DEBUG] [LOCAL ] AMPY: Trimmed 50241 records to 37407 (keeping 200 days of data) [2025-09-23T17:13:11.260763] [INFO ] [REMOTE ] AMPX: Full fetch complete (74524 records). [2025-09-23T17:13:11.260962] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-23T17:13:11.427590] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-23T17:13:11.906293] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-23T17:13:11.906589] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-23T17:13:11.887906] [DEBUG] [LOCAL ] AMPY: Primary data saved (37407 records). [2025-09-23T17:13:11.907798] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-23T17:13:11.907928] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-23T17:13:11.906930] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-23T17:13:11.908951] [INFO ] [MAIN ] Update Progress: 104/2372 symbols completed. AMPY took 26.8s. Estimated remaining: 4h 46m 39s. Rate: 7.9 symbols/min [2025-09-23T17:13:11.956529] [DEBUG] [LOCAL ] AMPX: Trimmed 74524 records to 52164 (keeping 200 days of data) [2025-09-23T17:13:12.120399] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T17:13:12.238124] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-23T17:13:12.303254] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:12.309787] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-23T17:13:12.310578] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-23T17:13:12.321996] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-23T17:13:12.326317] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-23T17:13:12.328288] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-23T17:13:12.330525] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-23T17:13:12.778510] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T17:13:13.007687] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-23T17:13:13.235794] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:13.242419] [DEBUG] [LOCAL ] AMPX: Primary data saved (52164 records). [2025-09-23T17:13:13.242919] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-23T17:13:13.243138] [INFO ] [MAIN ] Update Progress: 105/2372 symbols completed. AMPX took 44.0s. Estimated remaining: 4h 44m 17s. Rate: 8.0 symbols/min [2025-09-23T17:13:13.465974] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:13.486494] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T17:13:13.547807] [DEBUG] [LOCAL ] AMT: Loaded 52455 existing records from primary storage. [2025-09-23T17:13:13.547971] [INFO ] [MAIN ] AMT: Loaded 52455 existing records. [2025-09-23T17:13:13.727752] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:13.728037] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-23T17:13:13.728088] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-23T17:13:13.729485] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-23T17:13:13.729546] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-23T17:13:13.807342] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-23T17:13:14.091382] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:14.243845] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T17:13:14.602222] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-23T17:13:15.130606] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:13:15.402248] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-23T17:13:15.721878] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T17:13:16.202217] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-23T17:13:16.431310] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:16.431675] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-23T17:13:16.832810] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:13:17.002214] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-23T17:13:17.802198] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-23T17:13:18.607371] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-23T17:13:18.624752] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T17:13:19.006546] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T17:13:19.402289] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-23T17:13:19.614799] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:13:20.202201] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-23T17:13:20.409543] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T17:13:21.002212] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-23T17:13:21.204232] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:21.204545] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-23T17:13:21.557085] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:13:21.564748] [INFO ] [REMOTE ] AMR: Full fetch complete (39605 records). [2025-09-23T17:13:21.564913] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-23T17:13:21.807445] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-23T17:13:21.993562] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-23T17:13:21.993755] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-23T17:13:21.994532] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-23T17:13:21.994630] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-23T17:13:21.996448] [DEBUG] [LOCAL ] AMR: Trimmed 39605 records to 29107 (keeping 200 days of data) [2025-09-23T17:13:22.202958] [DEBUG] [LOCAL ] AMR: Primary data saved (29107 records). [2025-09-23T17:13:22.203181] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-23T17:13:22.203321] [INFO ] [MAIN ] Update Progress: 106/2372 symbols completed. AMR took 23.8s. Estimated remaining: 4h 44m 40s. Rate: 8.0 symbols/min [2025-09-23T17:13:22.414753] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:22.439807] [DEBUG] [LOCAL ] AMTB: Loaded 20461 existing records from primary storage. [2025-09-23T17:13:22.439981] [INFO ] [MAIN ] AMTB: Loaded 20461 existing records. [2025-09-23T17:13:22.618024] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-23T17:13:22.624418] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:22.626455] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-23T17:13:22.626549] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-23T17:13:22.627491] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-23T17:13:22.627588] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-23T17:13:22.880472] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:22.906666] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-23T17:13:22.962352] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:13:23.057932] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:23.402255] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-23T17:13:24.202214] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-23T17:13:24.433021] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:24.433306] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-23T17:13:24.692916] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:13:25.002223] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-23T17:13:25.218124] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:25.218516] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-23T17:13:25.802211] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-23T17:13:26.602199] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-23T17:13:26.832439] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:26.832779] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-23T17:13:26.931043] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T17:13:27.402236] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-23T17:13:28.202195] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-23T17:13:28.562376] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T17:13:29.002205] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-23T17:13:29.577574] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T17:13:29.660525] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-23T17:13:29.802260] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-23T17:13:30.602254] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-23T17:13:31.071170] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T17:13:31.402199] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-23T17:13:32.029251] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T17:13:32.164154] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T17:13:32.172449] [INFO ] [REMOTE ] AMRC: Full fetch complete (52378 records). [2025-09-23T17:13:32.172727] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-23T17:13:32.207337] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-23T17:13:32.582758] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-23T17:13:32.582864] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-23T17:13:32.583535] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-23T17:13:32.583600] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-23T17:13:32.585185] [DEBUG] [LOCAL ] AMRC: Trimmed 52378 records to 38438 (keeping 200 days of data) [2025-09-23T17:13:32.834241] [DEBUG] [LOCAL ] AMRC: Primary data saved (38438 records). [2025-09-23T17:13:32.834637] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-23T17:13:32.834848] [INFO ] [MAIN ] Update Progress: 107/2372 symbols completed. AMRC took 26.6s. Estimated remaining: 4h 45m 38s. Rate: 7.9 symbols/min [2025-09-23T17:13:33.018319] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-23T17:13:33.022019] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:33.030422] [DEBUG] [LOCAL ] AMTD: Loaded 3554 existing records from primary storage. [2025-09-23T17:13:33.030528] [INFO ] [MAIN ] AMTD: Loaded 3554 existing records. [2025-09-23T17:13:33.212036] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:33.212356] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-23T17:13:33.212419] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-23T17:13:33.212914] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-23T17:13:33.212975] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-23T17:13:33.584197] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:33.735164] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:13:33.802215] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-23T17:13:34.067251] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T17:13:34.602212] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-23T17:13:35.402216] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-23T17:13:35.474789] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T17:13:35.926619] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-23T17:13:36.202200] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-23T17:13:36.332972] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T17:13:36.964492] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:13:37.002201] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-23T17:13:37.802200] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-23T17:13:38.585324] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T17:13:38.602169] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-23T17:13:39.095867] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:13:39.402198] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-23T17:13:40.202217] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-23T17:13:40.299944] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T17:13:40.630936] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:13:40.639514] [INFO ] [REMOTE ] AMRZ: Full fetch complete (24577 records). [2025-09-23T17:13:40.639604] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-23T17:13:40.835513] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 65 unique days, need 200 days [2025-09-23T17:13:40.835984] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:13:40.836090] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:13:40.836186] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-23T17:13:40.836276] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-23T17:13:40.836325] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-23T17:13:40.836405] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-23T17:13:40.836489] [INFO ] [MAIN ] Update Progress: 108/2372 symbols completed. AMRZ took 28.9s. Estimated remaining: 4h 45m 40s. Rate: 7.9 symbols/min [2025-09-23T17:13:41.006220] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:41.006307] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-23T17:13:41.079451] [DEBUG] [LOCAL ] AMTM: Loaded 50777 existing records from primary storage. [2025-09-23T17:13:41.079686] [INFO ] [MAIN ] AMTM: Loaded 50777 existing records. [2025-09-23T17:13:41.283104] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:41.284262] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-23T17:13:41.284321] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-23T17:13:41.286192] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-23T17:13:41.286371] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-23T17:13:41.428625] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T17:13:41.598072] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:13:41.678539] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:41.802203] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-23T17:13:42.602198] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-23T17:13:42.978204] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T17:13:43.301698] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:13:43.402153] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-23T17:13:44.202218] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-23T17:13:44.722422] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T17:13:45.002184] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-23T17:13:45.129526] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T17:13:45.338797] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T17:13:45.802255] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-23T17:13:46.216848] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T17:13:46.602196] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-23T17:13:47.163722] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T17:13:47.402193] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-23T17:13:47.900850] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T17:13:48.202279] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-23T17:13:48.693485] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T17:13:49.002275] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-23T17:13:49.802251] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-23T17:13:50.366803] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T17:13:50.368398] [INFO ] [REMOTE ] AMTD: Full fetch complete (5616 records). [2025-09-23T17:13:50.368469] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-23T17:13:50.609014] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-23T17:13:50.740437] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-23T17:13:50.740637] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-23T17:13:50.740876] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-23T17:13:50.741014] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-23T17:13:50.741579] [DEBUG] [LOCAL ] AMTD: Trimmed 5616 records to 3564 (keeping 200 days of data) [2025-09-23T17:13:50.787948] [DEBUG] [LOCAL ] AMTD: Primary data saved (3564 records). [2025-09-23T17:13:50.789433] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T17:13:50.788431] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-23T17:13:50.798737] [INFO ] [MAIN ] Update Progress: 109/2372 symbols completed. AMTD took 18.0s. Estimated remaining: 4h 46m 22s. Rate: 7.9 symbols/min [2025-09-23T17:13:50.970855] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:50.983263] [DEBUG] [LOCAL ] AMWL: Loaded 8612 existing records from primary storage. [2025-09-23T17:13:50.983367] [INFO ] [MAIN ] AMWL: Loaded 8612 existing records. [2025-09-23T17:13:51.158487] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:51.158797] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-23T17:13:51.158850] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-23T17:13:51.159241] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-23T17:13:51.159302] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-23T17:13:51.407363] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-23T17:13:51.526285] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:52.202229] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-23T17:13:52.232318] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T17:13:52.874869] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T17:13:53.002196] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-23T17:13:53.186384] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T17:13:53.802193] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-23T17:13:54.454872] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T17:13:54.515986] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T17:13:54.602204] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-23T17:13:55.241435] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T17:13:55.402193] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-23T17:13:56.098038] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T17:13:56.101378] [INFO ] [REMOTE ] AMTB: Full fetch complete (30307 records). [2025-09-23T17:13:56.101473] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-23T17:13:56.208478] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-23T17:13:56.493732] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-23T17:13:56.493827] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-23T17:13:56.494233] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-23T17:13:56.494297] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-23T17:13:56.495241] [DEBUG] [LOCAL ] AMTB: Trimmed 30307 records to 20436 (keeping 200 days of data) [2025-09-23T17:13:56.618308] [DEBUG] [LOCAL ] AMTB: Primary data saved (20436 records). [2025-09-23T17:13:56.618444] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-23T17:13:56.618528] [INFO ] [MAIN ] Update Progress: 110/2372 symbols completed. AMTB took 34.4s. Estimated remaining: 4h 45m 38s. Rate: 7.9 symbols/min [2025-09-23T17:13:56.796151] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:56.806022] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T17:13:56.858220] [DEBUG] [LOCAL ] AMX: Loaded 49133 existing records from primary storage. [2025-09-23T17:13:56.858362] [INFO ] [MAIN ] AMX: Loaded 49133 existing records. [2025-09-23T17:13:57.004901] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-23T17:13:57.042369] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:57.042627] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-23T17:13:57.042712] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-23T17:13:57.043838] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-23T17:13:57.043900] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-23T17:13:57.401760] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:57.802219] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-23T17:13:58.348771] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:13:58.381744] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T17:13:58.602235] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-23T17:13:59.402193] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-23T17:14:00.056635] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:14:00.202204] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-23T17:14:00.665849] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T17:14:00.853890] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:14:00.863261] [INFO ] [REMOTE ] AMT: Full fetch complete (76004 records). [2025-09-23T17:14:00.863394] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-23T17:14:01.016485] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-23T17:14:01.298351] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-23T17:14:01.298445] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-23T17:14:01.299314] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-23T17:14:01.299384] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-23T17:14:01.301413] [DEBUG] [LOCAL ] AMT: Trimmed 76004 records to 52450 (keeping 200 days of data) [2025-09-23T17:14:01.661769] [DEBUG] [LOCAL ] AMT: Primary data saved (52450 records). [2025-09-23T17:14:01.661928] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-23T17:14:01.662041] [INFO ] [MAIN ] Update Progress: 111/2372 symbols completed. AMT took 48.4s. Estimated remaining: 4h 44m 38s. Rate: 7.9 symbols/min [2025-09-23T17:14:01.807428] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-23T17:14:01.857934] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:01.896156] [DEBUG] [LOCAL ] AN: Loaded 32596 existing records from primary storage. [2025-09-23T17:14:01.896322] [INFO ] [MAIN ] AN: Loaded 32596 existing records. [2025-09-23T17:14:02.075172] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:02.075412] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-23T17:14:02.075460] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-23T17:14:02.076156] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-23T17:14:02.076217] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-23T17:14:02.433542] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:02.471982] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T17:14:02.602182] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-23T17:14:03.217749] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:14:03.402216] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-23T17:14:04.077037] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:14:04.090858] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T17:14:04.202225] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-23T17:14:05.001689] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T17:14:05.005182] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-23T17:14:05.802217] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-23T17:14:06.541792] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T17:14:06.602204] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-23T17:14:07.154861] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T17:14:07.402258] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-23T17:14:07.920162] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:14:08.202238] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-23T17:14:09.002270] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-23T17:14:09.230907] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T17:14:09.520950] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:14:09.802229] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-23T17:14:09.986506] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T17:14:10.602201] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-23T17:14:11.402208] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-23T17:14:11.621583] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T17:14:11.939235] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:14:12.202220] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-23T17:14:12.390826] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:14:12.743299] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T17:14:13.002214] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-23T17:14:13.802263] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-23T17:14:14.445263] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:14:14.602225] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-23T17:14:14.894982] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:14:15.164127] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T17:14:15.402254] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-23T17:14:16.202212] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-23T17:14:16.754175] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:14:16.762383] [INFO ] [REMOTE ] AMTM: Full fetch complete (73596 records). [2025-09-23T17:14:16.762513] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-23T17:14:16.763299] [FATAL] [VALIDATOR ] AMTM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:14:16.763391] [FATAL] [MAIN ] AMTM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:14:16.763434] [WARN ] [MAIN ] AMTM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:14:16.763473] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-23T17:14:16.763534] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-09-23T17:14:16.763569] [INFO ] [LOCAL ] AMTM: Starting deletion of derivative data. [2025-09-23T17:14:16.764045] [DEBUG] [LOCAL ] AMTM: Deleted derivative data file. [2025-09-23T17:14:16.764141] [INFO ] [MAIN ] Update Progress: 112/2372 symbols completed. AMTM took 35.9s. Estimated remaining: 4h 47m 3s. Rate: 7.9 symbols/min [2025-09-23T17:14:16.941198] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:16.998538] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-23T17:14:16.998804] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-09-23T17:14:17.010631] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-23T17:14:17.192380] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:17.192628] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-23T17:14:17.192713] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-23T17:14:17.193968] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-23T17:14:17.194031] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-23T17:14:17.625204] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:17.633094] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T17:14:17.688911] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T17:14:17.802214] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-23T17:14:18.602243] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-23T17:14:19.019860] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T17:14:19.258280] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T17:14:19.260879] [INFO ] [REMOTE ] AMWL: Full fetch complete (13976 records). [2025-09-23T17:14:19.260982] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-23T17:14:19.410945] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-23T17:14:19.642904] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-23T17:14:19.643012] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-23T17:14:19.643286] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-23T17:14:19.643329] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-23T17:14:19.644135] [DEBUG] [LOCAL ] AMWL: Trimmed 13976 records to 8642 (keeping 200 days of data) [2025-09-23T17:14:19.698074] [DEBUG] [LOCAL ] AMWL: Primary data saved (8642 records). [2025-09-23T17:14:19.698247] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-23T17:14:19.698354] [INFO ] [MAIN ] Update Progress: 113/2372 symbols completed. AMWL took 28.9s. Estimated remaining: 4h 45m 22s. Rate: 7.9 symbols/min [2025-09-23T17:14:19.871518] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:19.931109] [DEBUG] [LOCAL ] ANF: Loaded 52264 existing records from primary storage. [2025-09-23T17:14:19.931262] [INFO ] [MAIN ] ANF: Loaded 52264 existing records. [2025-09-23T17:14:20.112112] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:20.112409] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-23T17:14:20.112463] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-23T17:14:20.114744] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-23T17:14:20.114806] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-23T17:14:20.211152] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-23T17:14:20.478707] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:20.786271] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T17:14:20.794525] [INFO ] [REMOTE ] AMX: Full fetch complete (70783 records). [2025-09-23T17:14:20.794727] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-23T17:14:21.007462] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-23T17:14:21.196324] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-23T17:14:21.196402] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-23T17:14:21.197126] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-23T17:14:21.197189] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-23T17:14:21.198678] [DEBUG] [LOCAL ] AMX: Trimmed 70783 records to 49162 (keeping 200 days of data) [2025-09-23T17:14:21.497252] [DEBUG] [LOCAL ] AMX: Primary data saved (49162 records). [2025-09-23T17:14:21.497384] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-23T17:14:21.497469] [INFO ] [MAIN ] Update Progress: 114/2372 symbols completed. AMX took 24.9s. Estimated remaining: 4h 43m 20s. Rate: 8.0 symbols/min [2025-09-23T17:14:21.663513] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:21.663716] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-23T17:14:21.663772] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-23T17:14:21.663923] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-23T17:14:21.663965] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-23T17:14:21.664010] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-23T17:14:21.664042] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-23T17:14:21.813156] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-23T17:14:22.042762] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:22.450825] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-23T17:14:22.602247] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-23T17:14:22.804503] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T17:14:22.817338] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:22.818835] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-23T17:14:23.201306] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:14:23.402225] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-23T17:14:23.651271] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:23.651840] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-23T17:14:24.202200] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-23T17:14:24.393896] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:24.394173] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-23T17:14:25.002225] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-23T17:14:25.802194] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-23T17:14:26.290774] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T17:14:26.602190] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-23T17:14:27.402210] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-23T17:14:27.592324] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:27.592719] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-23T17:14:27.813041] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-23T17:14:28.054509] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T17:14:28.202189] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-23T17:14:29.002279] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-23T17:14:29.207154] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:29.207449] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-23T17:14:29.802201] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-23T17:14:30.011433] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:30.011770] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-23T17:14:30.607668] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-23T17:14:30.610750] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-23T17:14:31.402217] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-23T17:14:31.575954] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:14:31.635740] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:31.636094] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-23T17:14:32.202206] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-23T17:14:33.002268] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-23T17:14:33.802197] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-23T17:14:34.233094] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T17:14:34.602229] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-23T17:14:34.746976] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:14:34.798298] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:34.798608] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-23T17:14:34.974523] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-23T17:14:35.402213] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-23T17:14:35.758770] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:35.759128] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-23T17:14:36.202191] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-23T17:14:37.002217] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-23T17:14:37.570520] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T17:14:37.575173] [INFO ] [REMOTE ] ANGX: Full fetch complete (3160 records). [2025-09-23T17:14:37.575245] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-23T17:14:37.762721] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 9 unique days, need 200 days [2025-09-23T17:14:37.762953] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:14:37.763024] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:14:37.763134] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-23T17:14:37.763213] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-23T17:14:37.763252] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-23T17:14:37.763310] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-23T17:14:37.763393] [INFO ] [MAIN ] Update Progress: 115/2372 symbols completed. ANGX took 16.3s. Estimated remaining: 4h 46m 4s. Rate: 7.9 symbols/min [2025-09-23T17:14:37.808966] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-23T17:14:37.950683] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:37.972374] [DEBUG] [LOCAL ] ANRO: Loaded 19673 existing records from primary storage. [2025-09-23T17:14:37.972535] [INFO ] [MAIN ] ANRO: Loaded 19673 existing records. [2025-09-23T17:14:38.172586] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:38.172870] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-23T17:14:38.172932] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-23T17:14:38.173527] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-23T17:14:38.173590] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-23T17:14:38.592092] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:38.602165] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-23T17:14:38.977577] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T17:14:39.402159] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-23T17:14:39.470962] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T17:14:39.544140] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:14:40.202201] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-23T17:14:41.002195] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-23T17:14:41.529311] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-23T17:14:41.765394] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:14:41.802152] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-23T17:14:42.156867] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T17:14:42.602218] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-23T17:14:42.844768] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T17:14:43.402194] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-23T17:14:43.968792] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:14:44.202167] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-23T17:14:44.449678] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T17:14:45.002198] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-23T17:14:45.688321] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T17:14:45.802199] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-23T17:14:45.985020] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T17:14:46.602206] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-23T17:14:47.409597] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-23T17:14:47.415691] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T17:14:48.202215] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-23T17:14:48.532238] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T17:14:48.637994] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T17:14:49.002251] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-23T17:14:49.182926] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T17:14:49.191332] [INFO ] [REMOTE ] AN: Full fetch complete (47692 records). [2025-09-23T17:14:49.191512] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-23T17:14:49.582253] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-23T17:14:49.582352] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-23T17:14:49.582884] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-23T17:14:49.582948] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-23T17:14:49.584507] [DEBUG] [LOCAL ] AN: Trimmed 47692 records to 32517 (keeping 200 days of data) [2025-09-23T17:14:49.779528] [DEBUG] [LOCAL ] AN: Primary data saved (32517 records). [2025-09-23T17:14:49.779704] [INFO ] [MAIN ] AN: Full history saved. [2025-09-23T17:14:49.779804] [INFO ] [MAIN ] Update Progress: 116/2372 symbols completed. AN took 48.1s. Estimated remaining: 4h 47m 22s. Rate: 7.9 symbols/min [2025-09-23T17:14:49.810889] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-23T17:14:49.953026] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:49.978225] [DEBUG] [LOCAL ] ANVS: Loaded 23209 existing records from primary storage. [2025-09-23T17:14:49.978384] [INFO ] [MAIN ] ANVS: Loaded 23209 existing records. [2025-09-23T17:14:50.160018] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:50.160320] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-23T17:14:50.160369] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-23T17:14:50.160998] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-23T17:14:50.161058] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-23T17:14:50.516579] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:50.602158] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-23T17:14:50.876985] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T17:14:51.402258] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-23T17:14:51.767089] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T17:14:51.833019] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:14:52.202206] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-23T17:14:52.288208] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T17:14:53.002257] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-23T17:14:53.505870] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T17:14:53.515789] [INFO ] [REMOTE ] ANF: Full fetch complete (75631 records). [2025-09-23T17:14:53.515934] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-23T17:14:53.809398] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-23T17:14:53.908927] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-23T17:14:53.909017] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-23T17:14:53.909755] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-23T17:14:53.909857] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-23T17:14:53.911422] [DEBUG] [LOCAL ] ANF: Trimmed 75631 records to 52244 (keeping 200 days of data) [2025-09-23T17:14:54.224434] [DEBUG] [LOCAL ] ANF: Primary data saved (52244 records). [2025-09-23T17:14:54.224567] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-23T17:14:54.224671] [INFO ] [MAIN ] Update Progress: 117/2372 symbols completed. ANF took 34.5s. Estimated remaining: 4h 46m 13s. Rate: 7.9 symbols/min [2025-09-23T17:14:54.602219] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-23T17:14:54.787853] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T17:14:54.887406] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:14:55.182478] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T17:14:55.402251] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-23T17:14:56.202214] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-23T17:14:56.225315] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T17:14:57.002220] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-23T17:14:57.421744] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:14:57.802168] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-23T17:14:58.123068] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T17:14:58.602241] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-23T17:14:59.198537] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T17:14:59.402184] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-23T17:14:59.997608] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-23T17:15:00.006802] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-23T17:15:00.006986] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-23T17:15:00.160921] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T17:15:00.199080] [INFO ] [REMOTE ] ANRO: Full fetch complete (30667 records). [2025-09-23T17:15:00.205960] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-23T17:15:00.219893] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-23T17:15:00.712969] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-23T17:15:00.718570] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-23T17:15:00.725214] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-23T17:15:00.725303] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-23T17:15:00.768619] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 53766 (keeping 200 days of data) [2025-09-23T17:15:00.896822] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-23T17:15:00.923553] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-23T17:15:00.924280] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-23T17:15:00.924929] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-23T17:15:00.927384] [DEBUG] [LOCAL ] ANRO: Trimmed 30667 records to 19470 (keeping 200 days of data) [2025-09-23T17:15:01.181321] [DEBUG] [LOCAL ] ANRO: Primary data saved (19470 records). [2025-09-23T17:15:01.182117] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-23T17:15:01.183039] [INFO ] [MAIN ] Update Progress: 118/2372 symbols completed. ANRO took 23.4s. Estimated remaining: 4h 45m 53s. Rate: 7.9 symbols/min [2025-09-23T17:15:01.203283] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:15:01.210025] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-23T17:15:01.297572] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-23T17:15:01.297796] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-23T17:15:01.297909] [INFO ] [MAIN ] Update Progress: 119/2372 symbols completed. ANET took 44.5s. Estimated remaining: 4h 43m 23s. Rate: 8.0 symbols/min [2025-09-23T17:15:02.565140] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T17:15:02.570670] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-23T17:15:05.945566] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-23T17:15:05.951752] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-23T17:15:07.314178] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T17:15:07.321166] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-23T17:15:08.207737] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-23T17:15:08.213930] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-23T17:15:08.884618] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T17:15:08.889509] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-23T17:15:09.913517] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T17:15:09.916886] [INFO ] [REMOTE ] ANVS: Full fetch complete (36800 records). [2025-09-23T17:15:09.917073] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-23T17:15:10.295017] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-23T17:15:10.295120] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-23T17:15:10.295597] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-23T17:15:10.295684] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-23T17:15:10.298279] [DEBUG] [LOCAL ] ANVS: Trimmed 36800 records to 23212 (keeping 200 days of data) [2025-09-23T17:15:10.426762] [DEBUG] [LOCAL ] ANVS: Primary data saved (23212 records). [2025-09-23T17:15:10.426891] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-23T17:15:10.426997] [INFO ] [MAIN ] Update Progress: 120/2372 symbols completed. ANVS took 20.6s. Estimated remaining: 4h 43m 45s. Rate: 7.9 symbols/min [2025-09-23T17:15:11.161918] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:11.170509] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:11.218240] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:11.214709] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:11.219292] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-23T17:15:11.219603] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-23T17:15:11.220062] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-23T17:15:11.220155] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-23T17:15:11.220262] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-23T17:15:11.220349] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-23T17:15:11.368948] [DEBUG] [LOCAL ] AOMR: Loaded 16786 existing records from primary storage. [2025-09-23T17:15:11.399933] [INFO ] [MAIN ] AOMR: Loaded 16786 existing records. [2025-09-23T17:15:11.599012] [DEBUG] [LOCAL ] AOD: Loaded 30300 existing records from primary storage. [2025-09-23T17:15:11.659429] [INFO ] [MAIN ] AOD: Loaded 30300 existing records. [2025-09-23T17:15:11.699769] [DEBUG] [LOCAL ] AON: Loaded 45635 existing records from primary storage. [2025-09-23T17:15:11.748501] [INFO ] [MAIN ] AON: Loaded 45635 existing records. [2025-09-23T17:15:11.973777] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:12.032477] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-23T17:15:12.032340] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:12.043420] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-23T17:15:12.056398] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-23T17:15:12.072726] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-23T17:15:12.090020] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-23T17:15:12.252790] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:12.332747] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:12.333189] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-23T17:15:12.339079] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-23T17:15:12.345114] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-23T17:15:12.339462] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-23T17:15:12.453304] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-23T17:15:12.431842] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:12.489908] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-23T17:15:12.535625] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-23T17:15:12.571479] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-23T17:15:12.653680] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:12.653444] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-23T17:15:12.676187] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-23T17:15:12.700570] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-23T17:15:12.722525] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-23T17:15:12.990719] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:13.032069] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-23T17:15:13.075547] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:13.096406] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-23T17:15:13.143338] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-23T17:15:13.358254] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:13.358561] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-23T17:15:13.441260] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:13.434842] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:13.441576] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-23T17:15:13.442443] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-23T17:15:13.443047] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-23T17:15:13.915884] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:13.916187] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-23T17:15:13.916625] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-23T17:15:13.994772] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:15:13.997673] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-23T17:15:15.521326] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T17:15:15.526217] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-23T17:15:15.625530] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T17:15:15.627497] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-23T17:15:15.641982] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-23T17:15:15.652110] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-23T17:15:15.748920] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-23T17:15:16.030095] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T17:15:16.202458] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T17:15:16.202582] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-23T17:15:16.523888] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T17:15:16.774483] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T17:15:17.002207] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-23T17:15:17.782388] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T17:15:17.802176] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-23T17:15:18.558763] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T17:15:18.602182] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-23T17:15:19.402239] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-23T17:15:19.960050] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T17:15:19.987947] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:15:20.202201] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-23T17:15:20.486246] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-23T17:15:21.002205] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-23T17:15:21.441314] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T17:15:21.442487] [INFO ] [REMOTE ] AOMD: Full fetch complete (1777 records). [2025-09-23T17:15:21.442561] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-23T17:15:21.650355] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 83 unique days, need 200 days [2025-09-23T17:15:21.650568] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:15:21.650615] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:15:21.650683] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-23T17:15:21.650757] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-23T17:15:21.650793] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-23T17:15:21.650859] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-23T17:15:21.650957] [INFO ] [MAIN ] Update Progress: 121/2372 symbols completed. AOMD took 11.2s. Estimated remaining: 4h 44m 46s. Rate: 7.9 symbols/min [2025-09-23T17:15:21.802291] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-23T17:15:21.823616] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:21.823816] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-09-23T17:15:21.823857] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-09-23T17:15:21.823999] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-23T17:15:21.824041] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-23T17:15:21.824081] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-09-23T17:15:21.824113] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-23T17:15:22.196228] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:22.484667] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T17:15:22.602225] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-23T17:15:23.402265] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-23T17:15:23.888229] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:15:24.202216] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-23T17:15:24.299112] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:15:25.002247] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-23T17:15:25.802185] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-23T17:15:26.104321] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T17:15:26.399544] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:15:26.602190] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-23T17:15:26.698151] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T17:15:27.402208] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-23T17:15:27.497178] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T17:15:28.202256] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-23T17:15:28.745859] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:15:28.907011] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T17:15:29.002209] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-23T17:15:29.802252] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-23T17:15:30.433379] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T17:15:30.602199] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-23T17:15:30.632996] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T17:15:31.402304] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-23T17:15:31.893453] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:15:32.189912] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:15:32.202151] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-23T17:15:33.002258] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-23T17:15:33.050943] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T17:15:33.802170] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-23T17:15:33.838499] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T17:15:34.602225] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-23T17:15:35.047068] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T17:15:35.402219] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-23T17:15:36.140234] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T17:15:36.202158] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-23T17:15:36.555668] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T17:15:37.002249] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-23T17:15:37.546018] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:15:37.802235] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-23T17:15:38.339691] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:15:38.602155] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-23T17:15:38.614585] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:15:38.617978] [INFO ] [REMOTE ] AOMR: Full fetch complete (23129 records). [2025-09-23T17:15:38.618065] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-23T17:15:39.000373] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-23T17:15:39.000509] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-23T17:15:39.000864] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-23T17:15:39.000945] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-23T17:15:39.001587] [DEBUG] [LOCAL ] AOMR: Trimmed 23129 records to 16714 (keeping 200 days of data) [2025-09-23T17:15:39.101984] [DEBUG] [LOCAL ] AOMR: Primary data saved (16714 records). [2025-09-23T17:15:39.102125] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-23T17:15:39.102258] [INFO ] [MAIN ] Update Progress: 122/2372 symbols completed. AOMR took 28.7s. Estimated remaining: 4h 47m 40s. Rate: 7.8 symbols/min [2025-09-23T17:15:39.272904] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:39.322561] [DEBUG] [LOCAL ] AOS: Loaded 49320 existing records from primary storage. [2025-09-23T17:15:39.322752] [INFO ] [MAIN ] AOS: Loaded 49320 existing records. [2025-09-23T17:15:39.411771] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-23T17:15:39.513391] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:39.514008] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-23T17:15:39.514094] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-23T17:15:39.516534] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-23T17:15:39.516595] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-23T17:15:39.874952] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:39.891365] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:15:39.898583] [INFO ] [REMOTE ] AOD: Full fetch complete (44059 records). [2025-09-23T17:15:39.898703] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-23T17:15:40.207367] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-23T17:15:40.286254] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-23T17:15:40.286394] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-23T17:15:40.287392] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-23T17:15:40.287509] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-23T17:15:40.293172] [DEBUG] [LOCAL ] AOD: Trimmed 44059 records to 30169 (keeping 200 days of data) [2025-09-23T17:15:40.491885] [DEBUG] [LOCAL ] AOD: Primary data saved (30169 records). [2025-09-23T17:15:40.492034] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-23T17:15:40.492235] [INFO ] [MAIN ] Update Progress: 123/2372 symbols completed. AOD took 30.1s. Estimated remaining: 4h 45m 38s. Rate: 7.9 symbols/min [2025-09-23T17:15:40.674875] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:40.687587] [DEBUG] [LOCAL ] AP: Loaded 6931 existing records from primary storage. [2025-09-23T17:15:40.687743] [INFO ] [MAIN ] AP: Loaded 6931 existing records. [2025-09-23T17:15:40.904018] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:40.904606] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-23T17:15:40.904723] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-23T17:15:40.906766] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-23T17:15:40.906716] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T17:15:40.906926] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-23T17:15:41.007540] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-23T17:15:41.288857] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:41.634267] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:15:41.802191] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-23T17:15:42.058215] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T17:15:42.479132] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-23T17:15:42.602215] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-23T17:15:43.402183] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-23T17:15:43.511730] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T17:15:44.202222] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-23T17:15:44.551964] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-23T17:15:44.878446] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T17:15:44.887039] [INFO ] [REMOTE ] AON: Full fetch complete (64934 records). [2025-09-23T17:15:44.887215] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-23T17:15:45.007402] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-23T17:15:45.316811] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-23T17:15:45.316931] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-23T17:15:45.317590] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-23T17:15:45.317637] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-23T17:15:45.321677] [DEBUG] [LOCAL ] AON: Trimmed 64934 records to 45655 (keeping 200 days of data) [2025-09-23T17:15:45.585691] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T17:15:45.639368] [DEBUG] [LOCAL ] AON: Primary data saved (45655 records). [2025-09-23T17:15:45.639533] [INFO ] [MAIN ] AON: Full history saved. [2025-09-23T17:15:45.639675] [INFO ] [MAIN ] Update Progress: 124/2372 symbols completed. AON took 35.2s. Estimated remaining: 4h 44m 45s. Rate: 7.9 symbols/min [2025-09-23T17:15:45.812174] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-23T17:15:45.841100] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:45.884710] [DEBUG] [LOCAL ] APAM: Loaded 36619 existing records from primary storage. [2025-09-23T17:15:45.884875] [INFO ] [MAIN ] APAM: Loaded 36619 existing records. [2025-09-23T17:15:46.068291] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:46.068613] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-23T17:15:46.068704] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-23T17:15:46.071158] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-23T17:15:46.071266] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-23T17:15:46.449237] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:46.602162] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-23T17:15:46.704459] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T17:15:47.402259] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-23T17:15:48.056782] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:15:48.057374] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T17:15:48.202193] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-23T17:15:49.002187] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-23T17:15:49.162892] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T17:15:49.802193] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-23T17:15:50.400887] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:15:50.602168] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-23T17:15:50.786000] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T17:15:50.995979] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-23T17:15:51.402186] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-23T17:15:51.962997] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T17:15:52.202302] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-23T17:15:53.002253] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-23T17:15:53.329780] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T17:15:53.802231] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-23T17:15:54.061255] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T17:15:54.602185] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-23T17:15:55.386123] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T17:15:55.402138] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-23T17:15:55.942029] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T17:15:55.947272] [INFO ] [REMOTE ] AORT: Full fetch complete (41646 records). [2025-09-23T17:15:55.947367] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-23T17:15:56.207470] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-23T17:15:56.322863] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-23T17:15:56.322953] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-23T17:15:56.323414] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-23T17:15:56.323457] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-23T17:15:56.326206] [DEBUG] [LOCAL ] AORT: Trimmed 41646 records to 29726 (keeping 200 days of data) [2025-09-23T17:15:56.502490] [DEBUG] [LOCAL ] AORT: Primary data saved (29726 records). [2025-09-23T17:15:56.502669] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-23T17:15:56.502764] [INFO ] [MAIN ] Update Progress: 125/2372 symbols completed. AORT took 34.9s. Estimated remaining: 4h 45m 36s. Rate: 7.9 symbols/min [2025-09-23T17:15:56.684841] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:56.739527] [DEBUG] [LOCAL ] APD: Loaded 45375 existing records from primary storage. [2025-09-23T17:15:56.739693] [INFO ] [MAIN ] APD: Loaded 45375 existing records. [2025-09-23T17:15:56.881467] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T17:15:56.958976] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:56.959222] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-23T17:15:56.959269] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-23T17:15:56.961635] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-23T17:15:56.961722] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-23T17:15:57.007274] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-23T17:15:57.320675] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:57.523303] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:15:57.802282] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-23T17:15:58.596578] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:15:58.606397] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-23T17:15:59.402170] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-23T17:15:59.495600] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T17:15:59.708154] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T17:16:00.003588] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T17:16:00.202195] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-23T17:16:01.002227] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-23T17:16:01.729474] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T17:16:01.802214] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-23T17:16:01.938314] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:16:02.602247] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-23T17:16:03.146329] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T17:16:03.402225] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-23T17:16:03.750615] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T17:16:04.122258] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T17:16:04.202201] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-23T17:16:04.630414] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T17:16:05.002241] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-23T17:16:05.802236] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-23T17:16:06.371671] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:16:06.602173] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-23T17:16:07.402179] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-23T17:16:07.689831] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T17:16:07.971166] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T17:16:07.974212] [INFO ] [REMOTE ] AP: Full fetch complete (8733 records). [2025-09-23T17:16:07.978003] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-23T17:16:08.116146] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:16:08.208798] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-23T17:16:08.692260] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-23T17:16:08.692350] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-23T17:16:08.692574] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-23T17:16:08.692617] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-23T17:16:08.693219] [DEBUG] [LOCAL ] AP: Trimmed 8733 records to 6975 (keeping 200 days of data) [2025-09-23T17:16:08.762528] [DEBUG] [LOCAL ] AP: Primary data saved (6975 records). [2025-09-23T17:16:08.762740] [INFO ] [MAIN ] AP: Full history saved. [2025-09-23T17:16:08.762859] [INFO ] [MAIN ] Update Progress: 126/2372 symbols completed. AP took 28.3s. Estimated remaining: 4h 46m 51s. Rate: 7.8 symbols/min [2025-09-23T17:16:08.947838] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:09.008462] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-23T17:16:09.012029] [DEBUG] [LOCAL ] APG: Loaded 50234 existing records from primary storage. [2025-09-23T17:16:09.012276] [INFO ] [MAIN ] APG: Loaded 50234 existing records. [2025-09-23T17:16:09.205851] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:09.206289] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-23T17:16:09.206382] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-23T17:16:09.209789] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-23T17:16:09.209859] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-23T17:16:09.406107] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T17:16:09.616030] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:09.802190] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-23T17:16:10.350527] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T17:16:10.602246] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-23T17:16:11.193892] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:16:11.402183] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-23T17:16:12.095497] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T17:16:12.202228] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-23T17:16:12.581180] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T17:16:13.002202] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-23T17:16:13.607248] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:16:13.802211] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-23T17:16:14.602198] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-23T17:16:14.780170] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T17:16:15.190374] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:16:15.402233] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-23T17:16:15.864177] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T17:16:16.202244] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-23T17:16:16.584373] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:16:17.002222] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-23T17:16:17.726094] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T17:16:17.802202] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-23T17:16:18.442017] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:16:18.602238] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-23T17:16:19.077578] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:16:19.084772] [INFO ] [REMOTE ] APD: Full fetch complete (66571 records). [2025-09-23T17:16:19.084946] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-23T17:16:19.407283] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-23T17:16:19.487774] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-23T17:16:19.487865] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-23T17:16:19.488511] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-23T17:16:19.488554] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-23T17:16:19.490009] [DEBUG] [LOCAL ] APD: Trimmed 66571 records to 45379 (keeping 200 days of data) [2025-09-23T17:16:19.791975] [DEBUG] [LOCAL ] APD: Primary data saved (45379 records). [2025-09-23T17:16:19.792134] [INFO ] [MAIN ] APD: Full history saved. [2025-09-23T17:16:19.794082] [INFO ] [MAIN ] Update Progress: 127/2372 symbols completed. APD took 23.3s. Estimated remaining: 4h 47m 43s. Rate: 7.8 symbols/min [2025-09-23T17:16:19.990939] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:20.018420] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T17:16:20.028183] [INFO ] [REMOTE ] AOS: Full fetch complete (70678 records). [2025-09-23T17:16:20.028364] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-23T17:16:20.226530] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-23T17:16:20.374692] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-23T17:16:20.374914] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-09-23T17:16:20.591360] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-23T17:16:20.602134] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-23T17:16:20.603005] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-23T17:16:20.608578] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-23T17:16:20.745536] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:20.745304] [DEBUG] [LOCAL ] AOS: Trimmed 70678 records to 49194 (keeping 200 days of data) [2025-09-23T17:16:20.760854] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-23T17:16:20.762967] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T17:16:20.762397] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-23T17:16:20.769614] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-23T17:16:20.769780] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-23T17:16:20.802737] [INFO ] [REMOTE ] APAM: Full fetch complete (51247 records). [2025-09-23T17:16:20.907763] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-23T17:16:20.963563] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:16:20.965922] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:16:21.008225] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:16:21.058727] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-23T17:16:21.088439] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-23T17:16:21.089716] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-09-23T17:16:21.133785] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-09-23T17:16:21.145790] [INFO ] [MAIN ] Update Progress: 128/2372 symbols completed. APAM took 35.5s. Estimated remaining: 4h 45m 44s. Rate: 7.9 symbols/min [2025-09-23T17:16:21.343298] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:21.359083] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-23T17:16:21.442782] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:21.602436] [DEBUG] [LOCAL ] APLE: Loaded 52036 existing records from primary storage. [2025-09-23T17:16:21.605688] [INFO ] [MAIN ] APLE: Loaded 52036 existing records. [2025-09-23T17:16:21.858394] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:21.859512] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-23T17:16:21.860956] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-23T17:16:21.864466] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-23T17:16:21.865176] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-23T17:16:22.048703] [DEBUG] [LOCAL ] AOS: Primary data saved (49194 records). [2025-09-23T17:16:22.094197] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-23T17:16:22.128213] [INFO ] [MAIN ] Update Progress: 129/2372 symbols completed. AOS took 43.0s. Estimated remaining: 4h 43m 41s. Rate: 7.9 symbols/min [2025-09-23T17:16:22.388494] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:22.394546] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-23T17:16:22.466204] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:22.498276] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-23T17:16:22.566523] [DEBUG] [LOCAL ] APO: Loaded 53386 existing records from primary storage. [2025-09-23T17:16:22.566747] [INFO ] [MAIN ] APO: Loaded 53386 existing records. [2025-09-23T17:16:22.612475] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-23T17:16:22.757677] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:22.757930] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-23T17:16:22.757981] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-23T17:16:22.760751] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-23T17:16:22.760816] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-23T17:16:23.139396] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:23.173793] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:16:23.402202] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-23T17:16:23.897711] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T17:16:23.937037] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:16:24.202279] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-23T17:16:25.003332] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T17:16:25.003426] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-23T17:16:25.768687] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T17:16:25.802204] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-23T17:16:26.379563] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T17:16:26.602206] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-23T17:16:27.402189] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-23T17:16:27.699490] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T17:16:28.047936] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-23T17:16:28.202199] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-23T17:16:28.720408] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:16:29.002230] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-23T17:16:29.620876] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T17:16:29.802208] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-23T17:16:30.487503] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T17:16:30.602231] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-23T17:16:31.193547] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:16:31.402217] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-23T17:16:32.202204] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-23T17:16:32.514751] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T17:16:32.804495] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:16:33.002200] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-23T17:16:33.668069] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:16:33.802217] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-23T17:16:34.602255] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-23T17:16:34.641541] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T17:16:35.407932] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-23T17:16:35.429497] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T17:16:36.202266] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-23T17:16:36.754427] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T17:16:36.971040] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T17:16:37.002160] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-23T17:16:37.298381] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T17:16:37.802226] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-23T17:16:38.602209] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-23T17:16:38.687088] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T17:16:39.135232] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:16:39.402187] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-23T17:16:40.159372] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T17:16:40.202161] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-23T17:16:41.002199] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-23T17:16:41.300523] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T17:16:41.691300] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T17:16:41.802306] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-23T17:16:42.399727] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:16:42.408399] [INFO ] [REMOTE ] APG: Full fetch complete (71634 records). [2025-09-23T17:16:42.408552] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-23T17:16:42.613601] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-23T17:16:42.820401] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-23T17:16:42.820481] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-23T17:16:42.821176] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-23T17:16:42.821239] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-23T17:16:42.822633] [DEBUG] [LOCAL ] APG: Trimmed 71634 records to 50228 (keeping 200 days of data) [2025-09-23T17:16:43.137365] [DEBUG] [LOCAL ] APG: Primary data saved (50228 records). [2025-09-23T17:16:43.137500] [INFO ] [MAIN ] APG: Full history saved. [2025-09-23T17:16:43.137587] [INFO ] [MAIN ] Update Progress: 130/2372 symbols completed. APG took 34.4s. Estimated remaining: 4h 47m 25s. Rate: 7.8 symbols/min [2025-09-23T17:16:43.306125] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:43.315480] [DEBUG] [LOCAL ] APOS: Loaded 7486 existing records from primary storage. [2025-09-23T17:16:43.315620] [INFO ] [MAIN ] APOS: Loaded 7486 existing records. [2025-09-23T17:16:43.406684] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-23T17:16:43.500279] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:43.500908] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-23T17:16:43.500989] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-23T17:16:43.501697] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-23T17:16:43.501837] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-23T17:16:43.783861] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T17:16:43.910343] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:44.158838] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T17:16:44.202200] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-23T17:16:44.791552] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T17:16:45.002212] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-23T17:16:45.312807] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T17:16:45.403888] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:16:45.802195] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-23T17:16:46.602188] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-23T17:16:47.402228] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-23T17:16:47.513693] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T17:16:47.817533] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T17:16:48.202174] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-23T17:16:48.250580] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T17:16:49.002238] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-23T17:16:49.802159] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-23T17:16:49.876476] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T17:16:49.884887] [INFO ] [REMOTE ] APH: Full fetch complete (77293 records). [2025-09-23T17:16:49.885170] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-23T17:16:49.886318] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:16:49.886427] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:16:49.886490] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:16:49.886565] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-23T17:16:49.886630] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-09-23T17:16:49.886712] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-09-23T17:16:49.887117] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-09-23T17:16:49.887224] [INFO ] [MAIN ] Update Progress: 131/2372 symbols completed. APH took 30.1s. Estimated remaining: 4h 47m 1s. Rate: 7.8 symbols/min [2025-09-23T17:16:50.055568] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:50.107163] [DEBUG] [LOCAL ] APTV: Loaded 52232 existing records from primary storage. [2025-09-23T17:16:50.107309] [INFO ] [MAIN ] APTV: Loaded 52232 existing records. [2025-09-23T17:16:50.283367] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:50.283664] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-23T17:16:50.283740] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-23T17:16:50.286170] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-23T17:16:50.286234] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-23T17:16:50.606097] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-23T17:16:50.654626] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:50.729632] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T17:16:51.164285] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T17:16:51.190035] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T17:16:51.199006] [INFO ] [REMOTE ] APLE: Full fetch complete (74254 records). [2025-09-23T17:16:51.199162] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-23T17:16:51.410098] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-23T17:16:51.601540] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-23T17:16:51.601628] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-23T17:16:51.602409] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-23T17:16:51.602462] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-23T17:16:51.604026] [DEBUG] [LOCAL ] APLE: Trimmed 74254 records to 52034 (keeping 200 days of data) [2025-09-23T17:16:51.923234] [DEBUG] [LOCAL ] APLE: Primary data saved (52034 records). [2025-09-23T17:16:51.923381] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-23T17:16:51.923479] [INFO ] [MAIN ] Update Progress: 132/2372 symbols completed. APLE took 30.8s. Estimated remaining: 4h 45m 17s. Rate: 7.9 symbols/min [2025-09-23T17:16:52.094411] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:52.144917] [DEBUG] [LOCAL ] AQN: Loaded 51958 existing records from primary storage. [2025-09-23T17:16:52.145136] [INFO ] [MAIN ] AQN: Loaded 51958 existing records. [2025-09-23T17:16:52.208118] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-23T17:16:52.344610] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:52.345117] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-23T17:16:52.345197] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-23T17:16:52.347312] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-23T17:16:52.347376] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-23T17:16:52.699460] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:52.742838] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T17:16:53.002220] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-23T17:16:53.108722] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T17:16:53.432807] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T17:16:53.802211] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-23T17:16:54.602237] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-23T17:16:55.402198] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-23T17:16:55.534489] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T17:16:55.968560] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T17:16:55.977470] [INFO ] [REMOTE ] APO: Full fetch complete (77292 records). [2025-09-23T17:16:55.977614] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-23T17:16:56.209800] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-23T17:16:56.382494] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-23T17:16:56.382573] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-23T17:16:56.383313] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-23T17:16:56.383377] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-23T17:16:56.384892] [DEBUG] [LOCAL ] APO: Trimmed 77292 records to 53386 (keeping 200 days of data) [2025-09-23T17:16:56.729067] [DEBUG] [LOCAL ] APO: Primary data saved (53386 records). [2025-09-23T17:16:56.729199] [INFO ] [MAIN ] APO: Full history saved. [2025-09-23T17:16:56.729281] [INFO ] [MAIN ] Update Progress: 133/2372 symbols completed. APO took 34.6s. Estimated remaining: 4h 44m 22s. Rate: 7.9 symbols/min [2025-09-23T17:16:56.916814] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:56.917120] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-09-23T17:16:56.917282] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-09-23T17:16:56.917632] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-23T17:16:56.917803] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-23T17:16:56.918098] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-09-23T17:16:56.918162] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-23T17:16:57.004402] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-23T17:16:57.242820] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T17:16:57.355621] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:57.424035] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:16:57.714406] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:16:57.802158] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-23T17:16:58.602201] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-23T17:16:59.070994] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T17:16:59.402188] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-23T17:17:00.036551] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T17:17:00.202203] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-23T17:17:00.757031] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T17:17:01.002227] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-23T17:17:01.067913] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T17:17:01.537331] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T17:17:01.802216] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-23T17:17:02.203813] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T17:17:02.602207] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-23T17:17:03.402225] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-23T17:17:03.758992] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T17:17:04.202214] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-23T17:17:05.002173] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-23T17:17:05.049387] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:17:05.319712] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-23T17:17:05.685733] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T17:17:05.802197] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-23T17:17:06.602204] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-23T17:17:06.965393] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T17:17:07.281726] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T17:17:07.402193] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-23T17:17:08.202210] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-23T17:17:08.669422] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T17:17:08.848799] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T17:17:08.850597] [INFO ] [REMOTE ] APOS: Full fetch complete (10450 records). [2025-09-23T17:17:08.850700] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-23T17:17:09.005425] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-23T17:17:09.225718] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-23T17:17:09.225812] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-23T17:17:09.226074] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-23T17:17:09.226114] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-23T17:17:09.226594] [DEBUG] [LOCAL ] APOS: Trimmed 10450 records to 7493 (keeping 200 days of data) [2025-09-23T17:17:09.273016] [DEBUG] [LOCAL ] APOS: Primary data saved (7493 records). [2025-09-23T17:17:09.273162] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-23T17:17:09.273253] [INFO ] [MAIN ] Update Progress: 134/2372 symbols completed. APOS took 26.1s. Estimated remaining: 4h 45m 37s. Rate: 7.8 symbols/min [2025-09-23T17:17:09.451290] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:09.504804] [DEBUG] [LOCAL ] AR: Loaded 53585 existing records from primary storage. [2025-09-23T17:17:09.504977] [INFO ] [MAIN ] AR: Loaded 53585 existing records. [2025-09-23T17:17:09.714326] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:09.714699] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-23T17:17:09.714778] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-23T17:17:09.717683] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-23T17:17:09.717802] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-23T17:17:09.807321] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-23T17:17:10.090495] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:10.602246] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-23T17:17:10.762398] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T17:17:10.987406] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T17:17:11.402166] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-23T17:17:11.558455] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T17:17:11.877145] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:17:12.202192] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-23T17:17:12.564016] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T17:17:13.002203] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-23T17:17:13.442696] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T17:17:13.802206] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-23T17:17:14.602199] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-23T17:17:15.402262] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-23T17:17:15.696704] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T17:17:15.730237] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-23T17:17:15.942591] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T17:17:16.202224] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-23T17:17:17.002215] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-23T17:17:17.598422] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:17:17.802240] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-23T17:17:18.602168] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-23T17:17:18.888633] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T17:17:18.897931] [INFO ] [REMOTE ] AQN: Full fetch complete (75267 records). [2025-09-23T17:17:18.898089] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-23T17:17:19.182803] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T17:17:19.351130] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-23T17:17:19.351239] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-23T17:17:19.352043] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-23T17:17:19.352107] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-23T17:17:19.353688] [DEBUG] [LOCAL ] AQN: Trimmed 75267 records to 51946 (keeping 200 days of data) [2025-09-23T17:17:19.403566] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-23T17:17:19.657196] [DEBUG] [LOCAL ] AQN: Primary data saved (51946 records). [2025-09-23T17:17:19.657369] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-23T17:17:19.657470] [INFO ] [MAIN ] Update Progress: 135/2372 symbols completed. AQN took 27.7s. Estimated remaining: 4h 46m 14s. Rate: 7.8 symbols/min [2025-09-23T17:17:19.820872] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:17:19.844004] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:19.894381] [DEBUG] [LOCAL ] ARCO: Loaded 44673 existing records from primary storage. [2025-09-23T17:17:19.894534] [INFO ] [MAIN ] ARCO: Loaded 44673 existing records. [2025-09-23T17:17:20.105474] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:20.106061] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-23T17:17:20.106142] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-23T17:17:20.108406] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-23T17:17:20.108487] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-23T17:17:20.207943] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-23T17:17:20.252777] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T17:17:20.524944] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:20.725966] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T17:17:20.727233] [INFO ] [REMOTE ] AQNB: Full fetch complete (5947 records). [2025-09-23T17:17:20.727311] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-23T17:17:21.007328] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-23T17:17:21.124330] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-23T17:17:21.124406] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-23T17:17:21.124564] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-23T17:17:21.124601] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-23T17:17:21.125050] [DEBUG] [LOCAL ] AQNB: Trimmed 5947 records to 4213 (keeping 200 days of data) [2025-09-23T17:17:21.153425] [DEBUG] [LOCAL ] AQNB: Primary data saved (4213 records). [2025-09-23T17:17:21.153544] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-23T17:17:21.153617] [INFO ] [MAIN ] Update Progress: 136/2372 symbols completed. AQNB took 24.4s. Estimated remaining: 4h 44m 25s. Rate: 7.9 symbols/min [2025-09-23T17:17:21.323512] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:21.340254] [DEBUG] [LOCAL ] ARDC: Loaded 14387 existing records from primary storage. [2025-09-23T17:17:21.340373] [INFO ] [MAIN ] ARDC: Loaded 14387 existing records. [2025-09-23T17:17:21.515790] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:21.516076] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-23T17:17:21.516133] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-23T17:17:21.517018] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-23T17:17:21.517080] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-23T17:17:21.807334] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-23T17:17:21.877762] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:22.348307] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:17:22.602213] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-23T17:17:23.233010] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:17:23.402187] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-23T17:17:24.036423] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T17:17:24.202260] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-23T17:17:24.877307] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T17:17:25.002228] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-23T17:17:25.483152] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:17:25.802227] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-23T17:17:26.487226] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T17:17:26.602211] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-23T17:17:27.039893] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T17:17:27.402205] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-23T17:17:28.043623] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:17:28.202204] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-23T17:17:28.833125] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T17:17:28.931206] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T17:17:29.002176] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-23T17:17:29.802219] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-23T17:17:30.602185] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-23T17:17:30.862820] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T17:17:30.910342] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:17:31.185024] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T17:17:31.402202] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-23T17:17:32.202191] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-23T17:17:33.002174] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-23T17:17:33.046077] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T17:17:33.769719] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:17:33.802168] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-23T17:17:34.588812] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T17:17:34.602159] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-23T17:17:35.402197] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-23T17:17:35.759524] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T17:17:35.770224] [INFO ] [REMOTE ] AR: Full fetch complete (77526 records). [2025-09-23T17:17:35.770377] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-23T17:17:36.107013] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:17:36.190332] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-23T17:17:36.190417] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-23T17:17:36.191148] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-23T17:17:36.191213] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-23T17:17:36.192638] [DEBUG] [LOCAL ] AR: Trimmed 77526 records to 53585 (keeping 200 days of data) [2025-09-23T17:17:36.240374] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-23T17:17:36.506945] [DEBUG] [LOCAL ] AR: Primary data saved (53585 records). [2025-09-23T17:17:36.507073] [INFO ] [MAIN ] AR: Full history saved. [2025-09-23T17:17:36.507154] [INFO ] [MAIN ] Update Progress: 137/2372 symbols completed. AR took 27.2s. Estimated remaining: 4h 46m 23s. Rate: 7.8 symbols/min [2025-09-23T17:17:36.720132] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:36.716408] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-23T17:17:36.730944] [INFO ] [REMOTE ] APTV: Full fetch complete (76059 records). [2025-09-23T17:17:36.731048] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-23T17:17:36.993840] [DEBUG] [LOCAL ] ARDT: Loaded 28318 existing records from primary storage. [2025-09-23T17:17:37.014236] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-23T17:17:37.031133] [INFO ] [MAIN ] ARDT: Loaded 28318 existing records. [2025-09-23T17:17:37.313001] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-23T17:17:37.313737] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-23T17:17:37.314836] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-23T17:17:37.315278] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-23T17:17:37.336782] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:37.337960] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-23T17:17:37.338029] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-23T17:17:37.338250] [DEBUG] [LOCAL ] APTV: Trimmed 76059 records to 52221 (keeping 200 days of data) [2025-09-23T17:17:37.339356] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-23T17:17:37.339420] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-23T17:17:37.776189] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T17:17:37.848841] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:37.850220] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-23T17:17:37.871132] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T17:17:38.090044] [DEBUG] [LOCAL ] APTV: Primary data saved (52221 records). [2025-09-23T17:17:38.090260] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-23T17:17:38.090499] [INFO ] [MAIN ] Update Progress: 138/2372 symbols completed. APTV took 48.2s. Estimated remaining: 4h 44m 37s. Rate: 7.8 symbols/min [2025-09-23T17:17:38.263946] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:38.264146] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-09-23T17:17:38.264202] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-09-23T17:17:38.264362] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-23T17:17:38.264405] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-23T17:17:38.264449] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-09-23T17:17:38.264493] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-23T17:17:38.608880] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-23T17:17:38.629577] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:39.164404] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:17:39.402178] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-23T17:17:39.782042] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:17:40.202737] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-23T17:17:40.203897] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T17:17:41.002262] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-23T17:17:41.203176] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T17:17:41.802223] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-23T17:17:42.602213] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-23T17:17:42.691537] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T17:17:42.990370] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:17:43.132115] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T17:17:43.402205] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-23T17:17:44.202201] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-23T17:17:44.987986] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T17:17:45.002143] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-23T17:17:45.526482] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:17:45.802212] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-23T17:17:46.266102] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:17:46.391360] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T17:17:46.602234] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-23T17:17:47.402229] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-23T17:17:47.667062] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T17:17:48.202204] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-23T17:17:48.848120] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T17:17:48.957071] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:17:49.002170] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-23T17:17:49.802239] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-23T17:17:50.321537] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:17:50.602201] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-23T17:17:50.873574] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T17:17:50.880878] [INFO ] [REMOTE ] ARCO: Full fetch complete (65641 records). [2025-09-23T17:17:50.881032] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-23T17:17:51.320016] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-23T17:17:51.320133] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-23T17:17:51.320949] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-23T17:17:51.321062] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-23T17:17:51.327932] [DEBUG] [LOCAL ] ARCO: Trimmed 65641 records to 44633 (keeping 200 days of data) [2025-09-23T17:17:51.427084] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-23T17:17:51.608822] [DEBUG] [LOCAL ] ARCO: Primary data saved (44633 records). [2025-09-23T17:17:51.608962] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-23T17:17:51.609092] [INFO ] [MAIN ] Update Progress: 139/2372 symbols completed. ARCO took 32.0s. Estimated remaining: 4h 46m 3s. Rate: 7.8 symbols/min [2025-09-23T17:17:51.811790] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:51.868796] [DEBUG] [LOCAL ] ARES: Loaded 49656 existing records from primary storage. [2025-09-23T17:17:51.868989] [INFO ] [MAIN ] ARES: Loaded 49656 existing records. [2025-09-23T17:17:52.054361] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:52.054658] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-23T17:17:52.054732] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-23T17:17:52.057320] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-23T17:17:52.057398] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-23T17:17:52.206169] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-23T17:17:52.419979] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:52.556690] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T17:17:52.577602] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T17:17:52.581107] [INFO ] [REMOTE ] ARDC: Full fetch complete (20225 records). [2025-09-23T17:17:52.581182] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-23T17:17:52.947459] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-23T17:17:52.947536] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-23T17:17:52.947859] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-23T17:17:52.947919] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-23T17:17:52.948478] [DEBUG] [LOCAL ] ARDC: Trimmed 20225 records to 14405 (keeping 200 days of data) [2025-09-23T17:17:53.002971] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-23T17:17:53.049043] [DEBUG] [LOCAL ] ARDC: Primary data saved (14405 records). [2025-09-23T17:17:53.049172] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-23T17:17:53.049297] [INFO ] [MAIN ] Update Progress: 140/2372 symbols completed. ARDC took 31.9s. Estimated remaining: 4h 44m 16s. Rate: 7.9 symbols/min [2025-09-23T17:17:53.227976] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:53.252982] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T17:17:53.306463] [DEBUG] [LOCAL ] ARI: Loaded 43335 existing records from primary storage. [2025-09-23T17:17:53.306607] [INFO ] [MAIN ] ARI: Loaded 43335 existing records. [2025-09-23T17:17:53.480491] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:53.480867] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-23T17:17:53.480923] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-23T17:17:53.483555] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-23T17:17:53.483618] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-23T17:17:53.807312] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-23T17:17:53.837202] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:54.602203] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-23T17:17:54.643609] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T17:17:55.351333] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:17:55.402159] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-23T17:17:55.942169] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:17:56.202198] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-23T17:17:56.787391] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:17:57.002167] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-23T17:17:57.041252] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T17:17:57.802233] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-23T17:17:58.416446] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:17:58.565150] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:17:58.602149] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-23T17:17:59.402224] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-23T17:17:59.751927] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:18:00.202228] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-23T17:18:00.980515] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T17:18:01.002158] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-23T17:18:01.802228] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-23T17:18:02.555708] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T17:18:02.602180] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-23T17:18:02.657736] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-23T17:18:03.402262] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-23T17:18:04.202195] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-23T17:18:05.020425] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T17:18:05.029069] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-23T17:18:05.423372] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (3.62 seconds). [2025-09-23T17:18:05.457967] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-23T17:18:05.802220] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-23T17:18:06.249055] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:18:06.424560] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-23T17:18:06.602210] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-23T17:18:07.402184] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-23T17:18:07.617274] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-23T17:18:07.689416] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:18:08.202246] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-23T17:18:08.941216] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T17:18:09.003740] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-23T17:18:09.005871] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T17:18:09.011586] [INFO ] [REMOTE ] ARDT: Full fetch complete (41173 records). [2025-09-23T17:18:09.011737] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-23T17:18:09.418686] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-23T17:18:09.419011] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-23T17:18:09.419511] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-23T17:18:09.419556] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-23T17:18:09.421377] [DEBUG] [LOCAL ] ARDT: Trimmed 41173 records to 28224 (keeping 200 days of data) [2025-09-23T17:18:09.599629] [DEBUG] [LOCAL ] ARDT: Primary data saved (28224 records). [2025-09-23T17:18:09.599792] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-23T17:18:09.599903] [INFO ] [MAIN ] Update Progress: 141/2372 symbols completed. ARDT took 33.1s. Estimated remaining: 4h 46m 29s. Rate: 7.8 symbols/min [2025-09-23T17:18:09.767546] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:09.802231] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-23T17:18:09.817624] [DEBUG] [LOCAL ] ARIS: Loaded 41970 existing records from primary storage. [2025-09-23T17:18:09.817805] [INFO ] [MAIN ] ARIS: Loaded 41970 existing records. [2025-09-23T17:18:10.018013] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:10.018339] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-23T17:18:10.018396] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-23T17:18:10.020561] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-23T17:18:10.020630] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-23T17:18:10.377912] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:10.602200] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-23T17:18:10.846318] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T17:18:10.854736] [INFO ] [REMOTE ] ARE: Full fetch complete (72662 records). [2025-09-23T17:18:10.854899] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-23T17:18:11.247591] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-23T17:18:11.247809] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-23T17:18:11.248575] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-23T17:18:11.248720] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-23T17:18:11.250353] [DEBUG] [LOCAL ] ARE: Trimmed 72662 records to 50634 (keeping 200 days of data) [2025-09-23T17:18:11.376707] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T17:18:11.402338] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-23T17:18:11.728188] [DEBUG] [LOCAL ] ARE: Primary data saved (50634 records). [2025-09-23T17:18:11.728457] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-23T17:18:11.728619] [INFO ] [MAIN ] Update Progress: 142/2372 symbols completed. ARE took 33.6s. Estimated remaining: 4h 44m 54s. Rate: 7.8 symbols/min [2025-09-23T17:18:11.887852] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T17:18:12.045163] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:12.109528] [DEBUG] [LOCAL ] ARLO: Loaded 43987 existing records from primary storage. [2025-09-23T17:18:12.109840] [INFO ] [MAIN ] ARLO: Loaded 43987 existing records. [2025-09-23T17:18:12.207634] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-23T17:18:12.412538] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:12.412843] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-23T17:18:12.412895] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-23T17:18:12.414847] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-23T17:18:12.414923] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-23T17:18:12.879866] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:12.968732] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T17:18:13.002158] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-23T17:18:13.575586] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:18:13.802238] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-23T17:18:14.602198] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-23T17:18:15.216622] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-23T17:18:15.402212] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-23T17:18:16.202177] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-23T17:18:16.327090] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T17:18:16.392209] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-23T17:18:17.002204] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-23T17:18:17.192070] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T17:18:17.491113] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:18:17.802251] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-23T17:18:18.028031] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T17:18:18.602198] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-23T17:18:18.773804] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T17:18:19.402205] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-23T17:18:19.793464] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:18:20.202216] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-23T17:18:20.520234] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T17:18:21.002285] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-23T17:18:21.646243] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:18:21.802253] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-23T17:18:22.157199] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T17:18:22.602205] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-23T17:18:23.402295] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-23T17:18:23.738073] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T17:18:23.746597] [INFO ] [REMOTE ] ARES: Full fetch complete (70585 records). [2025-09-23T17:18:23.746788] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-23T17:18:24.161099] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T17:18:24.212707] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-23T17:18:24.216744] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-23T17:18:24.218263] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-23T17:18:24.219276] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-23T17:18:24.219485] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-23T17:18:24.222022] [DEBUG] [LOCAL ] ARES: Trimmed 70585 records to 49614 (keeping 200 days of data) [2025-09-23T17:18:24.576363] [DEBUG] [LOCAL ] ARES: Primary data saved (49614 records). [2025-09-23T17:18:24.576594] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-23T17:18:24.576736] [INFO ] [MAIN ] Update Progress: 143/2372 symbols completed. ARES took 33.0s. Estimated remaining: 4h 46m 7s. Rate: 7.8 symbols/min [2025-09-23T17:18:24.765875] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:24.766161] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-09-23T17:18:24.766236] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-09-23T17:18:24.766534] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-23T17:18:24.766615] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-23T17:18:24.766734] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-23T17:18:24.766815] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-23T17:18:25.026490] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-23T17:18:25.153417] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:25.308476] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T17:18:25.502017] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:18:25.802218] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-23T17:18:26.229527] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T17:18:26.602204] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-23T17:18:27.113982] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T17:18:27.402191] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-23T17:18:28.010872] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T17:18:28.202215] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-23T17:18:28.559797] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T17:18:29.002229] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-23T17:18:29.340516] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T17:18:29.802212] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-23T17:18:30.602238] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-23T17:18:30.798437] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T17:18:30.901584] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T17:18:31.402199] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-23T17:18:31.942131] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T17:18:31.949613] [INFO ] [REMOTE ] ARI: Full fetch complete (62724 records). [2025-09-23T17:18:31.949818] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-23T17:18:32.208029] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-23T17:18:32.405577] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-23T17:18:32.405696] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-23T17:18:32.406378] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-23T17:18:32.406427] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-23T17:18:32.407830] [DEBUG] [LOCAL ] ARI: Trimmed 62724 records to 43411 (keeping 200 days of data) [2025-09-23T17:18:32.670131] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T17:18:32.723375] [DEBUG] [LOCAL ] ARI: Primary data saved (43411 records). [2025-09-23T17:18:32.723521] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-23T17:18:32.723608] [INFO ] [MAIN ] Update Progress: 144/2372 symbols completed. ARI took 39.7s. Estimated remaining: 4h 46m 6s. Rate: 7.8 symbols/min [2025-09-23T17:18:32.892562] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:32.938922] [DEBUG] [LOCAL ] AROC: Loaded 48989 existing records from primary storage. [2025-09-23T17:18:32.939103] [INFO ] [MAIN ] AROC: Loaded 48989 existing records. [2025-09-23T17:18:33.007286] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-23T17:18:33.116562] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:33.116817] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-23T17:18:33.116867] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-23T17:18:33.118932] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-23T17:18:33.118995] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-23T17:18:33.491910] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:33.549041] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:18:33.802225] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-23T17:18:34.221724] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:18:34.602200] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-23T17:18:35.402170] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-23T17:18:35.467368] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T17:18:35.998109] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T17:18:36.202200] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-23T17:18:37.002213] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-23T17:18:37.050359] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T17:18:37.058679] [INFO ] [REMOTE ] ARLO: Full fetch complete (62446 records). [2025-09-23T17:18:37.058851] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-23T17:18:37.459178] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-23T17:18:37.459373] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-23T17:18:37.460088] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-23T17:18:37.460229] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-23T17:18:37.461616] [DEBUG] [LOCAL ] ARLO: Trimmed 62446 records to 43939 (keeping 200 days of data) [2025-09-23T17:18:37.573972] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:18:37.750899] [DEBUG] [LOCAL ] ARLO: Primary data saved (43939 records). [2025-09-23T17:18:37.751037] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-23T17:18:37.751120] [INFO ] [MAIN ] Update Progress: 145/2372 symbols completed. ARLO took 26.0s. Estimated remaining: 4h 45m 18s. Rate: 7.8 symbols/min [2025-09-23T17:18:37.813407] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-23T17:18:37.919994] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:37.972257] [DEBUG] [LOCAL ] ARR: Loaded 52064 existing records from primary storage. [2025-09-23T17:18:37.972399] [INFO ] [MAIN ] ARR: Loaded 52064 existing records. [2025-09-23T17:18:38.150019] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:38.150268] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-23T17:18:38.150329] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-23T17:18:38.152418] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-23T17:18:38.152478] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-23T17:18:38.510516] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:38.568073] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:18:38.602143] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-23T17:18:39.379371] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T17:18:39.402143] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-23T17:18:39.829949] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:18:39.837222] [INFO ] [REMOTE ] ARIS: Full fetch complete (59853 records). [2025-09-23T17:18:39.837337] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-23T17:18:40.204890] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-23T17:18:40.241986] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-23T17:18:40.242070] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-23T17:18:40.242733] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-23T17:18:40.242800] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-23T17:18:40.244163] [DEBUG] [LOCAL ] ARIS: Trimmed 59853 records to 41981 (keeping 200 days of data) [2025-09-23T17:18:40.509611] [DEBUG] [LOCAL ] ARIS: Primary data saved (41981 records). [2025-09-23T17:18:40.509767] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-23T17:18:40.509855] [INFO ] [MAIN ] Update Progress: 146/2372 symbols completed. ARIS took 30.9s. Estimated remaining: 4h 43m 55s. Rate: 7.8 symbols/min [2025-09-23T17:18:40.678448] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:40.713575] [DEBUG] [LOCAL ] ARW: Loaded 33224 existing records from primary storage. [2025-09-23T17:18:40.713761] [INFO ] [MAIN ] ARW: Loaded 33224 existing records. [2025-09-23T17:18:40.894733] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:40.895129] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-23T17:18:40.895238] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-23T17:18:40.896208] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-23T17:18:40.896269] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-23T17:18:41.005671] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-23T17:18:41.107609] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T17:18:41.300630] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:41.517230] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:18:41.802201] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-23T17:18:42.602222] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-23T17:18:42.913828] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T17:18:43.133229] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T17:18:43.402222] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-23T17:18:43.939393] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:18:44.202223] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-23T17:18:44.713494] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T17:18:45.002199] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-23T17:18:45.802222] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-23T17:18:45.983488] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T17:18:46.304306] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:18:46.602225] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-23T17:18:46.706137] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T17:18:47.402188] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-23T17:18:48.035623] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:18:48.202163] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-23T17:18:48.680864] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:18:49.002208] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-23T17:18:49.801552] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T17:18:49.810742] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-23T17:18:50.602159] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-23T17:18:50.779590] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T17:18:51.402174] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-23T17:18:51.518781] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T17:18:51.978752] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:18:52.202290] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-23T17:18:52.516872] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:18:53.002197] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-23T17:18:53.802170] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-23T17:18:54.075995] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T17:18:54.187828] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:18:54.602249] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-23T17:18:54.973067] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:18:55.402200] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-23T17:18:55.517385] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T17:18:56.202249] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-23T17:18:57.002216] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-23T17:18:57.109813] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T17:18:57.203080] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T17:18:57.802275] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-23T17:18:58.602168] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-23T17:18:58.984957] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T17:18:58.993708] [INFO ] [REMOTE ] ARMK: Full fetch complete (72511 records). [2025-09-23T17:18:58.993861] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-23T17:18:59.406035] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-23T17:18:59.407229] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-23T17:18:59.407412] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-23T17:18:59.408232] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-23T17:18:59.408463] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-23T17:18:59.438795] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:18:59.438931] [DEBUG] [LOCAL ] ARMK: Trimmed 72511 records to 50336 (keeping 200 days of data) [2025-09-23T17:18:59.707637] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T17:18:59.785364] [DEBUG] [LOCAL ] ARMK: Primary data saved (50336 records). [2025-09-23T17:18:59.785501] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-23T17:18:59.785598] [INFO ] [MAIN ] Update Progress: 147/2372 symbols completed. ARMK took 35.2s. Estimated remaining: 4h 46m 43s. Rate: 7.8 symbols/min [2025-09-23T17:18:59.972262] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:59.972495] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-23T17:18:59.972551] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-23T17:18:59.972734] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-23T17:18:59.972785] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-23T17:18:59.972835] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-23T17:18:59.972869] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-23T17:19:00.209797] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-23T17:19:00.344458] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:00.750249] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:19:01.002217] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-23T17:19:01.219518] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:01.219900] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-23T17:19:01.802202] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-23T17:19:02.013396] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T17:19:02.602276] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-23T17:19:02.811677] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:19:03.402198] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-23T17:19:04.202330] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-23T17:19:04.822013] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-23T17:19:05.002246] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-23T17:19:05.203431] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T17:19:05.251329] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:05.251837] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-23T17:19:05.356974] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T17:19:05.364552] [INFO ] [REMOTE ] ARW: Full fetch complete (47894 records). [2025-09-23T17:19:05.364832] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-23T17:19:05.788964] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-23T17:19:05.789052] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-23T17:19:05.789670] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-23T17:19:05.789735] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-23T17:19:05.791995] [DEBUG] [LOCAL ] ARW: Trimmed 47894 records to 33212 (keeping 200 days of data) [2025-09-23T17:19:05.850570] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-23T17:19:06.024708] [DEBUG] [LOCAL ] ARW: Primary data saved (33212 records). [2025-09-23T17:19:06.024951] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-23T17:19:06.025102] [INFO ] [MAIN ] Update Progress: 148/2372 symbols completed. ARW took 25.5s. Estimated remaining: 4h 46m 13s. Rate: 7.8 symbols/min [2025-09-23T17:19:06.106851] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:06.146701] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-23T17:19:06.228216] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:06.228529] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-09-23T17:19:06.228574] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-09-23T17:19:06.228769] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-23T17:19:06.228820] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-23T17:19:06.228863] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-23T17:19:06.228896] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-23T17:19:06.607554] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-23T17:19:06.613271] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:06.821358] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:06.821821] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-23T17:19:07.402197] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-23T17:19:07.632386] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:07.632754] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-23T17:19:08.202244] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-23T17:19:09.002227] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-23T17:19:09.207520] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:09.207892] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-23T17:19:09.802238] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-23T17:19:09.834578] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:19:09.844202] [INFO ] [REMOTE ] ARR: Full fetch complete (75073 records). [2025-09-23T17:19:09.844390] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-23T17:19:10.242149] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-23T17:19:10.242253] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-23T17:19:10.243092] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-23T17:19:10.243162] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-23T17:19:10.244783] [DEBUG] [LOCAL ] ARR: Trimmed 75073 records to 52069 (keeping 200 days of data) [2025-09-23T17:19:10.575477] [DEBUG] [LOCAL ] ARR: Primary data saved (52069 records). [2025-09-23T17:19:10.575703] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-23T17:19:10.575803] [INFO ] [MAIN ] Update Progress: 149/2372 symbols completed. ARR took 32.8s. Estimated remaining: 4h 45m 18s. Rate: 7.8 symbols/min [2025-09-23T17:19:10.607881] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-23T17:19:10.754961] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:10.773336] [DEBUG] [LOCAL ] ASA: Loaded 13639 existing records from primary storage. [2025-09-23T17:19:10.773529] [INFO ] [MAIN ] ASA: Loaded 13639 existing records. [2025-09-23T17:19:10.957398] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:10.957804] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-23T17:19:10.957881] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-23T17:19:10.958454] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-23T17:19:10.958533] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-23T17:19:11.332533] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:11.407347] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-23T17:19:11.427722] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T17:19:11.954828] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:19:11.963775] [INFO ] [REMOTE ] AROC: Full fetch complete (70536 records). [2025-09-23T17:19:11.963924] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-23T17:19:12.208960] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-23T17:19:12.360908] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T17:19:12.403089] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-23T17:19:12.403203] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-23T17:19:12.404046] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-23T17:19:12.404115] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-23T17:19:12.405880] [DEBUG] [LOCAL ] AROC: Trimmed 70536 records to 48987 (keeping 200 days of data) [2025-09-23T17:19:12.652463] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:12.653554] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-23T17:19:12.711591] [DEBUG] [LOCAL ] AROC: Primary data saved (48987 records). [2025-09-23T17:19:12.711755] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-23T17:19:12.711843] [INFO ] [MAIN ] Update Progress: 150/2372 symbols completed. AROC took 40.0s. Estimated remaining: 4h 43m 48s. Rate: 7.8 symbols/min [2025-09-23T17:19:12.879337] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:12.933359] [DEBUG] [LOCAL ] ASAN: Loaded 52755 existing records from primary storage. [2025-09-23T17:19:12.933502] [INFO ] [MAIN ] ASAN: Loaded 52755 existing records. [2025-09-23T17:19:13.007333] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-23T17:19:13.122577] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:13.122852] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-23T17:19:13.122906] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-23T17:19:13.125334] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-23T17:19:13.125398] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-23T17:19:13.483054] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:13.802505] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-23T17:19:13.821545] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T17:19:14.333767] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T17:19:14.602214] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-23T17:19:15.402200] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-23T17:19:16.202235] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-23T17:19:16.323445] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T17:19:17.002216] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-23T17:19:17.164955] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T17:19:17.428696] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:19:17.526518] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T17:19:17.802206] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-23T17:19:18.317228] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T17:19:18.602242] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-23T17:19:19.402193] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-23T17:19:20.119613] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T17:19:20.202228] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-23T17:19:20.416093] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T17:19:20.423094] [INFO ] [REMOTE ] ARX: Full fetch complete (13435 records). [2025-09-23T17:19:20.423176] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-23T17:19:20.605147] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 43 unique days, need 200 days [2025-09-23T17:19:20.605475] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:19:20.605549] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:19:20.605622] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-23T17:19:20.605722] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-23T17:19:20.605769] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-23T17:19:20.605829] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-23T17:19:20.605910] [INFO ] [MAIN ] Update Progress: 151/2372 symbols completed. ARX took 20.8s. Estimated remaining: 4h 43m 44s. Rate: 7.8 symbols/min [2025-09-23T17:19:20.788439] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:20.839877] [DEBUG] [LOCAL ] ASB: Loaded 49584 existing records from primary storage. [2025-09-23T17:19:20.840018] [INFO ] [MAIN ] ASB: Loaded 49584 existing records. [2025-09-23T17:19:21.002987] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-23T17:19:21.025471] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:21.025777] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-23T17:19:21.025859] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-23T17:19:21.029130] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-23T17:19:21.029209] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-23T17:19:21.159831] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:19:21.418634] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:21.802192] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-23T17:19:22.435837] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T17:19:22.602176] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-23T17:19:22.672395] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T17:19:23.402219] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-23T17:19:23.932817] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T17:19:23.954732] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:19:24.202219] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-23T17:19:25.002234] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-23T17:19:25.802182] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-23T17:19:25.887766] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T17:19:26.072494] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T17:19:26.602239] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-23T17:19:27.242452] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T17:19:27.402190] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-23T17:19:27.690460] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:19:28.202192] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-23T17:19:29.002265] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-23T17:19:29.070883] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T17:19:29.628488] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:19:29.808095] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-23T17:19:29.811631] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:19:29.816107] [INFO ] [REMOTE ] ASA: Full fetch complete (18479 records). [2025-09-23T17:19:29.816203] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-23T17:19:30.187625] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-23T17:19:30.187735] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-23T17:19:30.188024] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-23T17:19:30.188062] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-23T17:19:30.188632] [DEBUG] [LOCAL ] ASA: Trimmed 18479 records to 13773 (keeping 200 days of data) [2025-09-23T17:19:30.272028] [DEBUG] [LOCAL ] ASA: Primary data saved (13773 records). [2025-09-23T17:19:30.272170] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-23T17:19:30.272264] [INFO ] [MAIN ] Update Progress: 152/2372 symbols completed. ASA took 19.7s. Estimated remaining: 4h 44m 5s. Rate: 7.8 symbols/min [2025-09-23T17:19:30.452595] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:30.459699] [DEBUG] [LOCAL ] ASBA: Loaded 3446 existing records from primary storage. [2025-09-23T17:19:30.459790] [INFO ] [MAIN ] ASBA: Loaded 3446 existing records. [2025-09-23T17:19:30.611407] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-23T17:19:30.643604] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:30.643920] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-23T17:19:30.643975] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-23T17:19:30.644268] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-23T17:19:30.644327] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-23T17:19:31.010011] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:31.248144] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T17:19:31.402165] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-23T17:19:32.047437] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T17:19:32.098220] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T17:19:32.202144] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-23T17:19:33.002186] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-23T17:19:33.611852] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:19:33.612502] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T17:19:33.802209] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-23T17:19:34.604984] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-23T17:19:34.605311] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T17:19:35.402199] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-23T17:19:35.763190] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-23T17:19:36.202179] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-23T17:19:36.442084] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T17:19:37.002217] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-23T17:19:37.559315] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-23T17:19:37.802163] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-23T17:19:37.894427] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T17:19:38.602215] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-23T17:19:39.276026] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:19:39.402193] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-23T17:19:39.724668] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-23T17:19:40.202165] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-23T17:19:40.521975] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T17:19:40.538333] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T17:19:41.002202] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-23T17:19:41.802256] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-23T17:19:42.303523] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:19:42.455601] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T17:19:42.602219] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-23T17:19:43.402235] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-23T17:19:44.202200] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-23T17:19:44.702235] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T17:19:44.807847] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T17:19:44.836451] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T17:19:45.002202] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-23T17:19:45.518149] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T17:19:45.519299] [INFO ] [REMOTE ] ASBA: Full fetch complete (5290 records). [2025-09-23T17:19:45.519374] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-23T17:19:45.807458] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-23T17:19:45.909030] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-23T17:19:45.909133] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-23T17:19:45.909325] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-23T17:19:45.909441] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-23T17:19:45.909960] [DEBUG] [LOCAL ] ASBA: Trimmed 5290 records to 3438 (keeping 200 days of data) [2025-09-23T17:19:45.933808] [DEBUG] [LOCAL ] ASBA: Primary data saved (3438 records). [2025-09-23T17:19:45.933887] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-23T17:19:45.934001] [INFO ] [MAIN ] Update Progress: 153/2372 symbols completed. ASBA took 15.7s. Estimated remaining: 4h 45m 53s. Rate: 7.8 symbols/min [2025-09-23T17:19:46.102494] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:46.151994] [DEBUG] [LOCAL ] ASC: Loaded 37878 existing records from primary storage. [2025-09-23T17:19:46.152167] [INFO ] [MAIN ] ASC: Loaded 37878 existing records. [2025-09-23T17:19:46.347875] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:46.348313] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-23T17:19:46.348408] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-23T17:19:46.349503] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-23T17:19:46.349595] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-23T17:19:46.607432] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-23T17:19:46.717698] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:47.092415] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T17:19:47.402199] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-23T17:19:48.202181] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-23T17:19:48.462449] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T17:19:48.633337] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T17:19:49.002187] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-23T17:19:49.768274] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T17:19:49.802151] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-23T17:19:50.226754] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T17:19:50.602230] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-23T17:19:51.387894] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T17:19:51.402156] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-23T17:19:52.202218] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-23T17:19:52.305587] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T17:19:52.983025] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T17:19:52.991789] [INFO ] [REMOTE ] ASAN: Full fetch complete (76560 records). [2025-09-23T17:19:52.991963] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-23T17:19:53.007443] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-23T17:19:53.402804] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-23T17:19:53.402894] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-23T17:19:53.403890] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-23T17:19:53.403957] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-23T17:19:53.408617] [DEBUG] [LOCAL ] ASAN: Trimmed 76560 records to 52755 (keeping 200 days of data) [2025-09-23T17:19:53.732006] [DEBUG] [LOCAL ] ASAN: Primary data saved (52755 records). [2025-09-23T17:19:53.732235] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-23T17:19:53.732391] [INFO ] [MAIN ] Update Progress: 154/2372 symbols completed. ASAN took 41.0s. Estimated remaining: 4h 45m 46s. Rate: 7.8 symbols/min [2025-09-23T17:19:53.802963] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-23T17:19:53.908466] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:53.940010] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T17:19:53.950589] [INFO ] [REMOTE ] AS: Full fetch complete (76523 records). [2025-09-23T17:19:53.950797] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-23T17:19:54.083969] [DEBUG] [LOCAL ] ASG: Loaded 20751 existing records from primary storage. [2025-09-23T17:19:54.094431] [INFO ] [MAIN ] ASG: Loaded 20751 existing records. [2025-09-23T17:19:54.472389] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:54.518009] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-23T17:19:54.518119] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-23T17:19:54.543549] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-23T17:19:54.549338] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-23T17:19:54.587969] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-23T17:19:54.610765] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-23T17:19:54.628524] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-23T17:19:54.672771] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-23T17:19:54.728329] [DEBUG] [LOCAL ] AS: Trimmed 76523 records to 53077 (keeping 200 days of data) [2025-09-23T17:19:55.126046] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:55.127580] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-23T17:19:55.158259] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-23T17:19:55.273434] [INFO ] [REMOTE ] ASB: Full fetch complete (71577 records). [2025-09-23T17:19:55.303628] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-23T17:19:55.463811] [DEBUG] [LOCAL ] AS: Primary data saved (53077 records). [2025-09-23T17:19:55.477154] [INFO ] [MAIN ] AS: Full history saved. [2025-09-23T17:19:55.477545] [INFO ] [MAIN ] Update Progress: 155/2372 symbols completed. AS took 49.5s. Estimated remaining: 4h 44m 13s. Rate: 7.8 symbols/min [2025-09-23T17:19:55.802952] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-23T17:19:55.885438] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-23T17:19:55.902253] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:56.050123] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-23T17:19:56.050229] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-23T17:19:56.050986] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-23T17:19:56.051112] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-23T17:19:56.052884] [DEBUG] [LOCAL ] ASB: Trimmed 71577 records to 49587 (keeping 200 days of data) [2025-09-23T17:19:56.060991] [DEBUG] [LOCAL ] ASGI: Loaded 22400 existing records from primary storage. [2025-09-23T17:19:56.061288] [INFO ] [MAIN ] ASGI: Loaded 22400 existing records. [2025-09-23T17:19:56.387336] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T17:19:56.412868] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:56.478595] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-23T17:19:56.516441] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-23T17:19:56.518008] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-23T17:19:56.520757] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-23T17:19:56.521844] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-23T17:19:57.025484] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:57.028132] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-23T17:19:57.041047] [DEBUG] [LOCAL ] ASB: Primary data saved (49587 records). [2025-09-23T17:19:57.041316] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-23T17:19:57.041457] [INFO ] [MAIN ] Update Progress: 156/2372 symbols completed. ASB took 36.4s. Estimated remaining: 4h 42m 38s. Rate: 7.8 symbols/min [2025-09-23T17:19:57.299478] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:57.325620] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T17:19:57.402539] [DEBUG] [LOCAL ] ASGN: Loaded 35998 existing records from primary storage. [2025-09-23T17:19:57.403216] [INFO ] [MAIN ] ASGN: Loaded 35998 existing records. [2025-09-23T17:19:57.537723] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:19:57.887937] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-23T17:19:57.900350] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:57.902881] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-23T17:19:57.903061] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-23T17:19:57.904986] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-23T17:19:57.905116] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-23T17:19:58.347237] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:58.366727] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:19:58.602260] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-23T17:19:58.952203] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:19:59.402253] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-23T17:19:59.799081] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T17:20:00.207290] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-23T17:20:00.221562] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T17:20:01.002275] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-23T17:20:01.516425] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:20:01.794169] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T17:20:01.802148] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-23T17:20:02.611002] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-23T17:20:02.618274] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T17:20:03.402201] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-23T17:20:03.852390] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T17:20:04.202228] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-23T17:20:04.520011] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T17:20:04.885253] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T17:20:05.002221] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-23T17:20:05.802209] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-23T17:20:06.095256] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T17:20:06.602276] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-23T17:20:06.979520] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T17:20:07.402244] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-23T17:20:07.979457] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T17:20:08.202219] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-23T17:20:08.573638] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T17:20:09.002189] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-23T17:20:09.754844] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T17:20:09.802153] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-23T17:20:10.014811] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:20:10.602242] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-23T17:20:11.032389] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T17:20:11.402213] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-23T17:20:11.723993] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T17:20:12.202196] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-23T17:20:12.560035] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T17:20:12.854737] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T17:20:13.002194] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-23T17:20:13.802227] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-23T17:20:14.211130] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T17:20:14.602224] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-23T17:20:15.345739] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T17:20:15.402155] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-23T17:20:15.412524] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T17:20:15.416300] [INFO ] [REMOTE ] ASG: Full fetch complete (31458 records). [2025-09-23T17:20:15.416381] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-23T17:20:15.801272] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-23T17:20:15.801369] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-23T17:20:15.801824] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-23T17:20:15.801889] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-23T17:20:15.803002] [DEBUG] [LOCAL ] ASG: Trimmed 31458 records to 20570 (keeping 200 days of data) [2025-09-23T17:20:15.922485] [DEBUG] [LOCAL ] ASG: Primary data saved (20570 records). [2025-09-23T17:20:15.922612] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-23T17:20:15.922720] [INFO ] [MAIN ] Update Progress: 157/2372 symbols completed. ASG took 22.2s. Estimated remaining: 4h 45m 9s. Rate: 7.8 symbols/min [2025-09-23T17:20:16.202283] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-23T17:20:16.424051] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T17:20:17.002272] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-23T17:20:17.710008] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T17:20:17.802153] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-23T17:20:17.900298] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T17:20:18.602249] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-23T17:20:18.895410] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T17:20:19.402199] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-23T17:20:19.712743] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T17:20:20.202193] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-23T17:20:20.415194] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:20:21.002236] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-23T17:20:21.346586] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T17:20:21.802231] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-23T17:20:22.080859] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T17:20:22.087038] [INFO ] [REMOTE ] ASC: Full fetch complete (57214 records). [2025-09-23T17:20:22.087152] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-23T17:20:22.511204] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-23T17:20:22.511293] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-23T17:20:22.511903] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-23T17:20:22.511967] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-23T17:20:22.513199] [DEBUG] [LOCAL ] ASC: Trimmed 57214 records to 37756 (keeping 200 days of data) [2025-09-23T17:20:22.614197] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-23T17:20:22.639841] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:20:22.780597] [DEBUG] [LOCAL ] ASC: Primary data saved (37756 records). [2025-09-23T17:20:22.780776] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-23T17:20:22.780871] [INFO ] [MAIN ] Update Progress: 158/2372 symbols completed. ASC took 36.8s. Estimated remaining: 4h 44m 49s. Rate: 7.8 symbols/min [2025-09-23T17:20:23.402206] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-23T17:20:24.133344] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T17:20:24.202178] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-23T17:20:24.354025] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T17:20:25.002266] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-23T17:20:25.268810] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T17:20:25.274752] [INFO ] [REMOTE ] ASGN: Full fetch complete (51316 records). [2025-09-23T17:20:25.274860] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-23T17:20:25.276494] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:20:25.276725] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:20:25.276798] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:20:25.276872] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-23T17:20:25.276945] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-23T17:20:25.276986] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-09-23T17:20:25.277582] [DEBUG] [LOCAL ] ASGN: Deleted derivative data file. [2025-09-23T17:20:25.277736] [INFO ] [MAIN ] Update Progress: 159/2372 symbols completed. ASGN took 28.2s. Estimated remaining: 4h 43m 29s. Rate: 7.8 symbols/min [2025-09-23T17:20:25.774261] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T17:20:25.778761] [INFO ] [REMOTE ] ASGI: Full fetch complete (33412 records). [2025-09-23T17:20:25.778890] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-23T17:20:26.164677] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-23T17:20:26.164772] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-23T17:20:26.165210] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-23T17:20:26.165272] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-23T17:20:26.166094] [DEBUG] [LOCAL ] ASGI: Trimmed 33412 records to 22412 (keeping 200 days of data) [2025-09-23T17:20:26.298404] [DEBUG] [LOCAL ] ASGI: Primary data saved (22412 records). [2025-09-23T17:20:26.298535] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-23T17:20:26.298620] [INFO ] [MAIN ] Update Progress: 160/2372 symbols completed. ASGI took 30.8s. Estimated remaining: 4h 41m 49s. Rate: 7.8 symbols/min [2025-09-23T17:20:26.989989] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:27.045451] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:27.045624] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-09-23T17:20:26.990919] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:27.048609] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:27.049441] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-09-23T17:20:27.049584] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-23T17:20:27.049625] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-23T17:20:27.049704] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-23T17:20:27.049747] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-23T17:20:27.260528] [DEBUG] [LOCAL ] ASIX: Loaded 22422 existing records from primary storage. [2025-09-23T17:20:27.317695] [INFO ] [MAIN ] ASIX: Loaded 22422 existing records. [2025-09-23T17:20:27.432333] [DEBUG] [LOCAL ] ASH: Loaded 37815 existing records from primary storage. [2025-09-23T17:20:27.498999] [INFO ] [MAIN ] ASH: Loaded 37815 existing records. [2025-09-23T17:20:27.629119] [DEBUG] [LOCAL ] ASPN: Loaded 49599 existing records from primary storage. [2025-09-23T17:20:27.726401] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:27.729902] [INFO ] [MAIN ] ASPN: Loaded 49599 existing records. [2025-09-23T17:20:27.756668] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-23T17:20:27.832241] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:27.933866] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-23T17:20:27.957223] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-23T17:20:27.982107] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:28.008591] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-23T17:20:28.008736] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-23T17:20:28.053065] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-23T17:20:28.053218] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-23T17:20:28.119495] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-23T17:20:28.105516] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:28.119775] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-23T17:20:28.166323] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-23T17:20:28.187438] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-23T17:20:28.247760] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-23T17:20:28.275521] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-23T17:20:28.718505] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:20:28.802452] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-23T17:20:29.049097] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:29.084401] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-23T17:20:29.113535] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:29.117431] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-23T17:20:29.201959] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:29.202291] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-23T17:20:29.520246] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T17:20:29.802196] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-23T17:20:29.844582] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T17:20:30.364635] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:20:30.406448] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T17:20:30.602203] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-23T17:20:30.863789] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T17:20:31.070064] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T17:20:31.402217] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-23T17:20:32.202204] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-23T17:20:32.478731] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:20:32.885393] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T17:20:33.002182] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-23T17:20:33.802199] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-23T17:20:33.923108] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T17:20:34.373428] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T17:20:34.602255] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-23T17:20:35.212486] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T17:20:35.402210] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-23T17:20:36.192166] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T17:20:36.202136] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-23T17:20:36.830564] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:20:37.002197] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-23T17:20:37.802189] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-23T17:20:38.261528] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:20:38.602214] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-23T17:20:38.758032] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T17:20:39.402255] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-23T17:20:39.841599] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T17:20:40.202224] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-23T17:20:40.902664] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T17:20:41.002165] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-23T17:20:41.048369] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:20:41.802216] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-23T17:20:42.392507] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:20:42.395213] [INFO ] [REMOTE ] ASR: Full fetch complete (12307 records). [2025-09-23T17:20:42.395293] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-23T17:20:42.602446] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-23T17:20:42.644572] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T17:20:42.832131] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-23T17:20:42.832212] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-23T17:20:42.832485] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-23T17:20:42.832524] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-23T17:20:42.833239] [DEBUG] [LOCAL ] ASR: Trimmed 12307 records to 9238 (keeping 200 days of data) [2025-09-23T17:20:42.892026] [DEBUG] [LOCAL ] ASR: Primary data saved (9238 records). [2025-09-23T17:20:42.892202] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-23T17:20:42.892284] [INFO ] [MAIN ] Update Progress: 161/2372 symbols completed. ASR took 16.6s. Estimated remaining: 4h 43m 44s. Rate: 7.8 symbols/min [2025-09-23T17:20:43.058852] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:43.114873] [DEBUG] [LOCAL ] ASX: Loaded 52907 existing records from primary storage. [2025-09-23T17:20:43.115048] [INFO ] [MAIN ] ASX: Loaded 52907 existing records. [2025-09-23T17:20:43.291227] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:43.291472] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-23T17:20:43.291520] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-23T17:20:43.294068] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-23T17:20:43.294133] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-23T17:20:43.407294] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-23T17:20:43.695093] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:43.697269] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:20:44.202249] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-23T17:20:44.870956] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:20:45.002253] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-23T17:20:45.802208] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-23T17:20:46.069080] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T17:20:46.373561] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T17:20:46.602159] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-23T17:20:46.773208] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T17:20:47.402208] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-23T17:20:48.078014] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T17:20:48.202178] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-23T17:20:49.002166] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-23T17:20:49.028966] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T17:20:49.568179] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T17:20:49.802187] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-23T17:20:50.567290] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:20:50.604163] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-23T17:20:50.607366] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T17:20:51.402181] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-23T17:20:51.557899] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T17:20:52.202196] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-23T17:20:52.923975] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:20:53.002277] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-23T17:20:53.390613] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T17:20:53.802193] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-23T17:20:54.602272] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-23T17:20:54.892272] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T17:20:54.992235] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T17:20:55.402218] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-23T17:20:56.148092] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T17:20:56.202159] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-23T17:20:56.453815] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T17:20:56.457897] [INFO ] [REMOTE ] ASIX: Full fetch complete (29711 records). [2025-09-23T17:20:56.458011] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-23T17:20:56.852574] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-23T17:20:56.852679] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-23T17:20:56.853102] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-23T17:20:56.853145] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-23T17:20:56.853972] [DEBUG] [LOCAL ] ASIX: Trimmed 29711 records to 22480 (keeping 200 days of data) [2025-09-23T17:20:57.001385] [DEBUG] [LOCAL ] ASIX: Primary data saved (22480 records). [2025-09-23T17:20:57.001555] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-23T17:20:57.001697] [INFO ] [MAIN ] Update Progress: 162/2372 symbols completed. ASIX took 30.7s. Estimated remaining: 4h 45m 4s. Rate: 7.8 symbols/min [2025-09-23T17:20:57.007260] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-23T17:20:57.197010] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:57.242495] [DEBUG] [LOCAL ] ATEN: Loaded 39993 existing records from primary storage. [2025-09-23T17:20:57.242689] [INFO ] [MAIN ] ATEN: Loaded 39993 existing records. [2025-09-23T17:20:57.453599] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:57.453896] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-23T17:20:57.453945] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-23T17:20:57.455846] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-23T17:20:57.455912] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-23T17:20:57.810174] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-23T17:20:57.842838] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:57.878143] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T17:20:58.602223] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-23T17:20:58.690146] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T17:20:59.064144] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:20:59.402215] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-23T17:20:59.788978] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T17:21:00.202225] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-23T17:21:01.002192] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-23T17:21:01.100323] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T17:21:01.108274] [INFO ] [REMOTE ] ASPN: Full fetch complete (72353 records). [2025-09-23T17:21:01.108410] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-23T17:21:01.549969] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-23T17:21:01.550600] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-23T17:21:01.551612] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T17:21:01.552477] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-23T17:21:01.560346] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-23T17:21:01.562550] [DEBUG] [LOCAL ] ASPN: Trimmed 72353 records to 49610 (keeping 200 days of data) [2025-09-23T17:21:01.817848] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-23T17:21:01.852457] [DEBUG] [LOCAL ] ASPN: Primary data saved (49610 records). [2025-09-23T17:21:01.852585] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-23T17:21:01.852690] [INFO ] [MAIN ] Update Progress: 163/2372 symbols completed. ASPN took 35.6s. Estimated remaining: 4h 44m 17s. Rate: 7.8 symbols/min [2025-09-23T17:21:02.031138] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:02.065468] [DEBUG] [LOCAL ] ATGE: Loaded 32042 existing records from primary storage. [2025-09-23T17:21:02.065632] [INFO ] [MAIN ] ATGE: Loaded 32042 existing records. [2025-09-23T17:21:02.266575] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:02.266957] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-23T17:21:02.267028] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-23T17:21:02.268977] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-23T17:21:02.269065] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-23T17:21:02.607323] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-23T17:21:02.660407] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:03.167138] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T17:21:03.402220] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-23T17:21:04.202273] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-23T17:21:05.326769] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (3.51 seconds). [2025-09-23T17:21:05.335578] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-23T17:21:05.600242] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-23T17:21:05.678374] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:21:05.802247] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-23T17:21:06.211223] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (3.60 seconds). [2025-09-23T17:21:06.526749] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T17:21:06.602200] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-23T17:21:06.708995] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T17:21:07.402252] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-23T17:21:07.740886] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T17:21:08.202195] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-23T17:21:08.563444] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:21:08.571418] [INFO ] [REMOTE ] ASH: Full fetch complete (54475 records). [2025-09-23T17:21:08.571580] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-23T17:21:09.014329] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-23T17:21:09.038584] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-23T17:21:09.038719] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-23T17:21:09.039359] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-23T17:21:09.039405] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-23T17:21:09.040980] [DEBUG] [LOCAL ] ASH: Trimmed 54475 records to 37789 (keeping 200 days of data) [2025-09-23T17:21:09.291666] [DEBUG] [LOCAL ] ASH: Primary data saved (37789 records). [2025-09-23T17:21:09.292019] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-23T17:21:09.292134] [INFO ] [MAIN ] Update Progress: 164/2372 symbols completed. ASH took 43.0s. Estimated remaining: 4h 44m 6s. Rate: 7.8 symbols/min [2025-09-23T17:21:09.481463] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:09.515788] [DEBUG] [LOCAL ] ATHM: Loaded 32743 existing records from primary storage. [2025-09-23T17:21:09.524042] [INFO ] [MAIN ] ATHM: Loaded 32743 existing records. [2025-09-23T17:21:09.588591] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:21:09.757352] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:09.757684] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-23T17:21:09.757744] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-23T17:21:09.759279] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-23T17:21:09.759344] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-23T17:21:09.807316] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-23T17:21:10.158276] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:10.303829] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T17:21:10.602214] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-23T17:21:10.808901] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:21:11.402205] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-23T17:21:12.078320] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T17:21:12.202211] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-23T17:21:13.002215] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-23T17:21:13.421614] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T17:21:13.802195] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-23T17:21:14.433024] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-23T17:21:14.602239] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-23T17:21:14.766626] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T17:21:14.969709] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T17:21:15.402196] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-23T17:21:15.926428] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T17:21:16.202353] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-23T17:21:16.612976] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:21:17.002204] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-23T17:21:17.309199] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T17:21:17.802233] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-23T17:21:18.489321] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T17:21:18.602169] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-23T17:21:18.642861] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:21:19.402219] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-23T17:21:20.075963] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:21:20.202258] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-23T17:21:20.610770] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T17:21:21.002269] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-23T17:21:21.426841] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T17:21:21.802451] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-23T17:21:22.308226] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T17:21:22.602174] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-23T17:21:22.909943] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T17:21:22.917168] [INFO ] [REMOTE ] ATEN: Full fetch complete (57524 records). [2025-09-23T17:21:22.917279] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-23T17:21:23.297501] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-23T17:21:23.297615] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-23T17:21:23.298255] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-23T17:21:23.298307] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-23T17:21:23.301147] [DEBUG] [LOCAL ] ATEN: Trimmed 57524 records to 39963 (keeping 200 days of data) [2025-09-23T17:21:23.404812] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-23T17:21:23.543142] [DEBUG] [LOCAL ] ATEN: Primary data saved (39963 records). [2025-09-23T17:21:23.543268] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-23T17:21:23.543345] [INFO ] [MAIN ] Update Progress: 165/2372 symbols completed. ATEN took 26.5s. Estimated remaining: 4h 45m 25s. Rate: 7.7 symbols/min [2025-09-23T17:21:23.714511] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:23.727886] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T17:21:23.734211] [INFO ] [REMOTE ] ATGE: Full fetch complete (46217 records). [2025-09-23T17:21:23.734358] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-23T17:21:23.835308] [DEBUG] [LOCAL ] ATHS: Loaded 7074 existing records from primary storage. [2025-09-23T17:21:23.846635] [INFO ] [MAIN ] ATHS: Loaded 7074 existing records. [2025-09-23T17:21:24.207113] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-23T17:21:24.206972] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:24.219196] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-23T17:21:24.219314] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-23T17:21:24.225329] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-23T17:21:24.225512] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-23T17:21:24.403120] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-23T17:21:24.413633] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-23T17:21:24.414191] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-23T17:21:24.414266] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-23T17:21:24.476480] [DEBUG] [LOCAL ] ATGE: Trimmed 46217 records to 32031 (keeping 200 days of data) [2025-09-23T17:21:24.772168] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:24.877126] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T17:21:24.903659] [DEBUG] [LOCAL ] ATGE: Primary data saved (32031 records). [2025-09-23T17:21:24.903771] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-23T17:21:24.903847] [INFO ] [MAIN ] Update Progress: 166/2372 symbols completed. ATGE took 23.1s. Estimated remaining: 4h 43m 52s. Rate: 7.8 symbols/min [2025-09-23T17:21:25.003529] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-23T17:21:25.074127] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:25.125468] [DEBUG] [LOCAL ] ATI: Loaded 51595 existing records from primary storage. [2025-09-23T17:21:25.125602] [INFO ] [MAIN ] ATI: Loaded 51595 existing records. [2025-09-23T17:21:25.301192] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:25.301436] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-23T17:21:25.301482] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-23T17:21:25.304093] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-23T17:21:25.304155] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-23T17:21:25.691798] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:25.697778] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T17:21:25.800009] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T17:21:25.808144] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-23T17:21:25.810167] [INFO ] [REMOTE ] ASX: Full fetch complete (76623 records). [2025-09-23T17:21:25.810257] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-23T17:21:26.208369] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-23T17:21:26.208449] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-23T17:21:26.209216] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-23T17:21:26.209280] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-23T17:21:26.210721] [DEBUG] [LOCAL ] ASX: Trimmed 76623 records to 52890 (keeping 200 days of data) [2025-09-23T17:21:26.536277] [DEBUG] [LOCAL ] ASX: Primary data saved (52890 records). [2025-09-23T17:21:26.536433] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-23T17:21:26.536524] [INFO ] [MAIN ] Update Progress: 167/2372 symbols completed. ASX took 43.6s. Estimated remaining: 4h 42m 24s. Rate: 7.8 symbols/min [2025-09-23T17:21:26.608731] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-23T17:21:26.744744] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:26.784298] [DEBUG] [LOCAL ] ATKR: Loaded 35746 existing records from primary storage. [2025-09-23T17:21:26.784454] [INFO ] [MAIN ] ATKR: Loaded 35746 existing records. [2025-09-23T17:21:26.970823] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:26.971060] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-23T17:21:26.971109] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-23T17:21:26.972584] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-23T17:21:26.972671] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-23T17:21:27.359809] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:27.407315] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-23T17:21:27.420720] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T17:21:27.952413] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T17:21:28.123980] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T17:21:28.202193] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-23T17:21:29.002195] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-23T17:21:29.315495] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T17:21:29.802405] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-23T17:21:30.315325] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:21:30.602198] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-23T17:21:31.087152] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:21:31.119940] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T17:21:31.402207] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-23T17:21:32.202211] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-23T17:21:32.781342] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T17:21:33.002200] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-23T17:21:33.406632] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T17:21:33.802189] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-23T17:21:34.017260] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T17:21:34.602217] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-23T17:21:35.024701] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:21:35.402175] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-23T17:21:35.437292] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:21:36.202192] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-23T17:21:36.688716] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T17:21:36.817700] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T17:21:37.002188] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-23T17:21:37.802293] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-23T17:21:38.544200] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T17:21:38.602175] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-23T17:21:38.807794] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T17:21:38.982934] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T17:21:39.402202] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-23T17:21:40.202265] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-23T17:21:40.772523] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T17:21:41.002172] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-23T17:21:41.270867] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T17:21:41.802279] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-23T17:21:42.375632] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T17:21:42.602222] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-23T17:21:43.239391] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T17:21:43.334837] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T17:21:43.402193] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-23T17:21:44.202207] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-23T17:21:44.870987] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:21:45.002227] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-23T17:21:45.626720] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T17:21:45.802211] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-23T17:21:45.934967] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:21:46.602254] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-23T17:21:47.134377] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:21:47.151269] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T17:21:47.402196] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-23T17:21:48.202206] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-23T17:21:48.245906] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T17:21:49.002255] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-23T17:21:49.359458] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:21:49.366143] [INFO ] [REMOTE ] ATHM: Full fetch complete (51972 records). [2025-09-23T17:21:49.366328] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-23T17:21:49.805043] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-23T17:21:49.807712] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-23T17:21:49.808078] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-23T17:21:49.813477] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-23T17:21:49.813714] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-23T17:21:49.814811] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:21:49.817071] [INFO ] [REMOTE ] ATHS: Full fetch complete (10062 records). [2025-09-23T17:21:49.817237] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-23T17:21:49.884373] [DEBUG] [LOCAL ] ATHM: Trimmed 51972 records to 32638 (keeping 200 days of data) [2025-09-23T17:21:50.381441] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-23T17:21:50.398461] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-23T17:21:50.399000] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-23T17:21:50.399336] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-23T17:21:50.407207] [DEBUG] [LOCAL ] ATHS: Trimmed 10062 records to 7107 (keeping 200 days of data) [2025-09-23T17:21:50.421575] [DEBUG] [LOCAL ] ATHM: Primary data saved (32638 records). [2025-09-23T17:21:50.421750] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-23T17:21:50.421907] [INFO ] [MAIN ] Update Progress: 168/2372 symbols completed. ATHM took 41.1s. Estimated remaining: 4h 45m 49s. Rate: 7.7 symbols/min [2025-09-23T17:21:50.577035] [DEBUG] [LOCAL ] ATHS: Primary data saved (7107 records). [2025-09-23T17:21:50.587912] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-23T17:21:50.603440] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-23T17:21:50.616729] [INFO ] [MAIN ] Update Progress: 169/2372 symbols completed. ATHS took 27.1s. Estimated remaining: 4h 44m 3s. Rate: 7.8 symbols/min [2025-09-23T17:21:50.693583] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:50.841192] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:50.872880] [DEBUG] [LOCAL ] ATMU: Loaded 39666 existing records from primary storage. [2025-09-23T17:21:50.873126] [INFO ] [MAIN ] ATMU: Loaded 39666 existing records. [2025-09-23T17:21:51.093153] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:21:51.098958] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:51.108291] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-23T17:21:51.121207] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-23T17:21:51.121957] [DEBUG] [LOCAL ] ATO: Loaded 42015 existing records from primary storage. [2025-09-23T17:21:51.122128] [INFO ] [MAIN ] ATO: Loaded 42015 existing records. [2025-09-23T17:21:51.134016] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-23T17:21:51.157509] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-23T17:21:51.409940] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-23T17:21:51.511277] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:51.586964] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-23T17:21:51.605931] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-23T17:21:51.627588] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-23T17:21:51.630634] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-23T17:21:51.829634] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:52.089349] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:52.200878] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T17:21:52.214107] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-23T17:21:52.578794] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:21:53.002222] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-23T17:21:53.802157] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-23T17:21:53.967011] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T17:21:54.278291] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:21:54.289190] [INFO ] [REMOTE ] ATI: Full fetch complete (73809 records). [2025-09-23T17:21:54.289389] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-23T17:21:54.607368] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-23T17:21:54.717685] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-23T17:21:54.717804] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-23T17:21:54.718762] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-23T17:21:54.718882] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-23T17:21:54.720572] [DEBUG] [LOCAL ] ATI: Trimmed 73809 records to 51578 (keeping 200 days of data) [2025-09-23T17:21:54.983608] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T17:21:54.992833] [INFO ] [REMOTE ] ATKR: Full fetch complete (53617 records). [2025-09-23T17:21:54.994604] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-23T17:21:55.402978] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-23T17:21:55.426103] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-23T17:21:55.426683] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-23T17:21:55.428078] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-23T17:21:55.428611] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-23T17:21:55.434446] [DEBUG] [LOCAL ] ATKR: Trimmed 53617 records to 35702 (keeping 200 days of data) [2025-09-23T17:21:55.734225] [DEBUG] [LOCAL ] ATKR: Primary data saved (35702 records). [2025-09-23T17:21:55.735466] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-23T17:21:55.735693] [INFO ] [MAIN ] Update Progress: 170/2372 symbols completed. ATKR took 29.2s. Estimated remaining: 4h 43m 21s. Rate: 7.8 symbols/min [2025-09-23T17:21:55.911542] [DEBUG] [LOCAL ] ATI: Primary data saved (51578 records). [2025-09-23T17:21:55.928811] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-23T17:21:55.933592] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:55.934289] [INFO ] [MAIN ] Update Progress: 171/2372 symbols completed. ATI took 31.0s. Estimated remaining: 4h 41m 36s. Rate: 7.8 symbols/min [2025-09-23T17:21:56.158951] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:56.171028] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:21:56.181202] [DEBUG] [LOCAL ] ATR: Loaded 30532 existing records from primary storage. [2025-09-23T17:21:56.181394] [INFO ] [MAIN ] ATR: Loaded 30532 existing records. [2025-09-23T17:21:56.206179] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-23T17:21:56.325317] [DEBUG] [LOCAL ] ATS: Loaded 18112 existing records from primary storage. [2025-09-23T17:21:56.336216] [INFO ] [MAIN ] ATS: Loaded 18112 existing records. [2025-09-23T17:21:56.640035] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:56.646433] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-23T17:21:56.646554] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-23T17:21:56.646093] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:56.646897] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-23T17:21:56.646955] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-23T17:21:56.647926] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-23T17:21:56.648012] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-23T17:21:56.653619] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-23T17:21:56.671947] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-23T17:21:57.409451] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:57.475761] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-23T17:21:57.484912] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:57.481467] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-23T17:21:57.551806] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T17:21:57.802227] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-23T17:21:58.497957] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T17:21:58.602255] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-23T17:21:58.777036] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T17:21:59.402231] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-23T17:21:59.615192] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:22:00.202242] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-23T17:22:00.827442] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:22:00.851407] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T17:22:01.002258] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-23T17:22:01.707193] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:22:01.802267] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-23T17:22:02.602236] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-23T17:22:03.342895] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T17:22:03.402155] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-23T17:22:04.202235] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-23T17:22:04.310492] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T17:22:04.536404] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T17:22:05.002221] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-23T17:22:05.160810] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:22:05.802266] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-23T17:22:06.607541] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-23T17:22:06.630125] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T17:22:06.746731] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T17:22:07.196887] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:22:07.402195] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-23T17:22:08.132781] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T17:22:08.202170] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-23T17:22:09.002238] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-23T17:22:09.298003] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T17:22:09.802211] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-23T17:22:10.017688] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T17:22:10.602287] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-23T17:22:10.950056] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:22:11.402225] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-23T17:22:11.992546] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:22:12.202267] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-23T17:22:12.678528] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:22:13.002225] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-23T17:22:13.573675] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:22:13.802195] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-23T17:22:13.940139] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:22:14.460353] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T17:22:14.602214] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-23T17:22:15.402227] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-23T17:22:15.836379] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:22:16.202217] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-23T17:22:17.002216] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-23T17:22:17.103666] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T17:22:17.175512] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T17:22:17.802199] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-23T17:22:18.107477] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T17:22:18.602229] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-23T17:22:18.930225] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T17:22:18.937615] [INFO ] [REMOTE ] ATMU: Full fetch complete (56814 records). [2025-09-23T17:22:18.937775] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-23T17:22:19.338832] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-23T17:22:19.338933] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-23T17:22:19.339771] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-23T17:22:19.339834] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-23T17:22:19.341630] [DEBUG] [LOCAL ] ATMU: Trimmed 56814 records to 39751 (keeping 200 days of data) [2025-09-23T17:22:19.409542] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-23T17:22:19.600512] [DEBUG] [LOCAL ] ATMU: Primary data saved (39751 records). [2025-09-23T17:22:19.600705] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-23T17:22:19.600810] [INFO ] [MAIN ] Update Progress: 172/2372 symbols completed. ATMU took 29.2s. Estimated remaining: 4h 44m 53s. Rate: 7.7 symbols/min [2025-09-23T17:22:19.809734] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:22:19.824608] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T17:22:19.878443] [DEBUG] [LOCAL ] ATUS: Loaded 49259 existing records from primary storage. [2025-09-23T17:22:19.878621] [INFO ] [MAIN ] ATUS: Loaded 49259 existing records. [2025-09-23T17:22:20.074380] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:22:20.074738] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-23T17:22:20.074795] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-23T17:22:20.076915] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-23T17:22:20.076988] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-23T17:22:20.207358] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-23T17:22:20.480145] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:22:20.853690] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:22:21.002233] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-23T17:22:21.245857] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T17:22:21.802232] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-23T17:22:22.134155] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:22:22.424022] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T17:22:22.602191] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-23T17:22:23.402197] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-23T17:22:24.042872] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T17:22:24.046225] [INFO ] [REMOTE ] ATS: Full fetch complete (25779 records). [2025-09-23T17:22:24.046329] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-23T17:22:24.207063] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-23T17:22:24.451408] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-23T17:22:24.451507] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-23T17:22:24.460456] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-23T17:22:24.476690] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-23T17:22:24.479039] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T17:22:24.490901] [DEBUG] [LOCAL ] ATS: Trimmed 25779 records to 18001 (keeping 200 days of data) [2025-09-23T17:22:24.601052] [DEBUG] [LOCAL ] ATS: Primary data saved (18001 records). [2025-09-23T17:22:24.601217] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-23T17:22:24.601307] [INFO ] [MAIN ] Update Progress: 173/2372 symbols completed. ATS took 28.7s. Estimated remaining: 4h 44m 10s. Rate: 7.7 symbols/min [2025-09-23T17:22:24.809298] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:22:24.871216] [DEBUG] [LOCAL ] AU: Loaded 52931 existing records from primary storage. [2025-09-23T17:22:24.871401] [INFO ] [MAIN ] AU: Loaded 52931 existing records. [2025-09-23T17:22:25.007357] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-23T17:22:25.071420] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:22:25.071721] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-23T17:22:25.071779] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-23T17:22:25.074422] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-23T17:22:25.074488] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-23T17:22:25.553012] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:22:25.585123] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T17:22:25.802194] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-23T17:22:26.203223] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T17:22:26.602206] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-23T17:22:27.402252] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-23T17:22:27.466318] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T17:22:27.831705] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:22:27.841565] [INFO ] [REMOTE ] ATO: Full fetch complete (60423 records). [2025-09-23T17:22:27.841736] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-23T17:22:28.208975] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-23T17:22:28.232639] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-23T17:22:28.232757] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-23T17:22:28.233395] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-23T17:22:28.233436] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-23T17:22:28.234746] [DEBUG] [LOCAL ] ATO: Trimmed 60423 records to 41969 (keeping 200 days of data) [2025-09-23T17:22:28.522704] [DEBUG] [LOCAL ] ATO: Primary data saved (41969 records). [2025-09-23T17:22:28.522856] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-23T17:22:28.523974] [INFO ] [MAIN ] Update Progress: 174/2372 symbols completed. ATO took 37.9s. Estimated remaining: 4h 43m 14s. Rate: 7.8 symbols/min [2025-09-23T17:22:28.702059] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:22:28.764956] [DEBUG] [LOCAL ] AUB: Loaded 46477 existing records from primary storage. [2025-09-23T17:22:28.765195] [INFO ] [MAIN ] AUB: Loaded 46477 existing records. [2025-09-23T17:22:28.977822] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:22:28.978257] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-23T17:22:28.978334] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-23T17:22:28.980953] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-23T17:22:28.981054] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-23T17:22:29.013212] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-23T17:22:29.322026] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T17:22:29.418458] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:22:29.492073] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T17:22:29.802204] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-23T17:22:30.100945] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T17:22:30.107273] [INFO ] [REMOTE ] ATR: Full fetch complete (43364 records). [2025-09-23T17:22:30.107454] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-23T17:22:30.516110] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-23T17:22:30.516227] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-23T17:22:30.516777] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-23T17:22:30.516841] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-23T17:22:30.518192] [DEBUG] [LOCAL ] ATR: Trimmed 43364 records to 30488 (keeping 200 days of data) [2025-09-23T17:22:30.613343] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-23T17:22:30.722174] [DEBUG] [LOCAL ] ATR: Primary data saved (30488 records). [2025-09-23T17:22:30.722320] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-23T17:22:30.722411] [INFO ] [MAIN ] Update Progress: 175/2372 symbols completed. ATR took 35.0s. Estimated remaining: 4h 41m 57s. Rate: 7.8 symbols/min [2025-09-23T17:22:30.895942] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:22:30.903015] [DEBUG] [LOCAL ] AUNA: Loaded 4683 existing records from primary storage. [2025-09-23T17:22:30.903132] [INFO ] [MAIN ] AUNA: Loaded 4683 existing records. [2025-09-23T17:22:31.084147] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:22:31.084432] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-23T17:22:31.084481] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-23T17:22:31.084816] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-23T17:22:31.084876] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-23T17:22:31.416223] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-23T17:22:31.462870] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:22:31.994370] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-23T17:22:32.136708] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T17:22:32.202208] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-23T17:22:32.836036] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T17:22:33.002233] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-23T17:22:33.802192] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-23T17:22:33.836371] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T17:22:34.110227] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T17:22:34.602243] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-23T17:22:35.062540] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:22:35.402210] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-23T17:22:35.859416] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-23T17:22:36.177758] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T17:22:36.202151] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-23T17:22:37.002251] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-23T17:22:37.802153] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-23T17:22:37.860958] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T17:22:38.186702] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:22:38.602246] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-23T17:22:38.978776] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T17:22:39.402213] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-23T17:22:40.011144] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T17:22:40.202236] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-23T17:22:40.993259] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:22:41.003540] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:22:41.003354] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-23T17:22:41.802212] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-23T17:22:42.602310] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-23T17:22:42.844674] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T17:22:43.038708] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T17:22:43.327368] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:22:43.402154] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-23T17:22:44.202233] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-23T17:22:44.590023] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T17:22:45.002154] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-23T17:22:45.042795] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:22:45.802215] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-23T17:22:46.171829] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T17:22:46.330409] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T17:22:46.602204] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-23T17:22:47.402200] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-23T17:22:47.865958] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:22:48.202214] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-23T17:22:49.002212] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-23T17:22:49.294926] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T17:22:49.459382] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:22:49.458257] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T17:22:49.802215] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-23T17:22:50.602209] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-23T17:22:51.140177] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:22:51.402220] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-23T17:22:52.202184] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-23T17:22:52.372218] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T17:22:53.002202] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-23T17:22:53.802268] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-23T17:23:05.161097] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (13.76 seconds). [2025-09-23T17:23:05.163588] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-23T17:23:05.367405] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (11.57 seconds). [2025-09-23T17:23:05.375235] [INFO ] [REMOTE ] AUB: Full fetch complete (65381 records). [2025-09-23T17:23:05.375400] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-23T17:23:05.802056] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-23T17:23:05.802492] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-23T17:23:05.807826] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-23T17:23:05.808938] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T17:23:05.809230] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-23T17:23:05.819729] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-23T17:23:05.837160] [DEBUG] [LOCAL ] AUB: Trimmed 65381 records to 46455 (keeping 200 days of data) [2025-09-23T17:23:05.836924] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (12.83 seconds). [2025-09-23T17:23:05.847484] [INFO ] [REMOTE ] ATUS: Full fetch complete (70607 records). [2025-09-23T17:23:05.934417] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-23T17:23:05.982107] [FATAL] [VALIDATOR ] ATUS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:23:05.986378] [FATAL] [MAIN ] ATUS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:23:05.986546] [WARN ] [MAIN ] ATUS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:23:05.985224] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (13.78 seconds). [2025-09-23T17:23:05.987590] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-23T17:23:06.001020] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-23T17:23:06.003806] [INFO ] [LOCAL ] ATUS: Starting deletion of derivative data. [2025-09-23T17:23:06.006537] [DEBUG] [LOCAL ] ATUS: Deleted derivative data file. [2025-09-23T17:23:06.006474] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-23T17:23:06.007127] [INFO ] [MAIN ] Update Progress: 176/2372 symbols completed. ATUS took 46.4s. Estimated remaining: 4h 47m 33s. Rate: 7.6 symbols/min [2025-09-23T17:23:06.222017] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:06.275202] [DEBUG] [LOCAL ] AVA: Loaded 39610 existing records from primary storage. [2025-09-23T17:23:06.278054] [INFO ] [MAIN ] AVA: Loaded 39610 existing records. [2025-09-23T17:23:06.612219] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:06.613716] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-23T17:23:06.614067] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-23T17:23:06.616009] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-23T17:23:06.616341] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-23T17:23:07.039059] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:07.040446] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-23T17:23:07.048082] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:23:07.051694] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-23T17:23:07.118352] [DEBUG] [LOCAL ] AUB: Primary data saved (46455 records). [2025-09-23T17:23:07.118525] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-23T17:23:07.118623] [INFO ] [MAIN ] Update Progress: 177/2372 symbols completed. AUB took 38.6s. Estimated remaining: 4h 46m 2s. Rate: 7.7 symbols/min [2025-09-23T17:23:07.301478] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:07.313310] [DEBUG] [LOCAL ] AVAL: Loaded 9095 existing records from primary storage. [2025-09-23T17:23:07.313448] [INFO ] [MAIN ] AVAL: Loaded 9095 existing records. [2025-09-23T17:23:07.502349] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:07.502611] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-23T17:23:07.502692] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-23T17:23:07.503240] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-23T17:23:07.503302] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-23T17:23:07.619082] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T17:23:07.641494] [INFO ] [REMOTE ] AUNA: Full fetch complete (7462 records). [2025-09-23T17:23:07.646733] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-23T17:23:08.208780] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:08.242570] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-23T17:23:08.337241] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-23T17:23:08.337553] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-23T17:23:08.338089] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-23T17:23:08.338309] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-23T17:23:08.389979] [DEBUG] [LOCAL ] AUNA: Trimmed 7462 records to 4746 (keeping 200 days of data) [2025-09-23T17:23:08.394466] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-23T17:23:08.407184] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:23:08.441716] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-23T17:23:08.443406] [DEBUG] [LOCAL ] AUNA: Primary data saved (4746 records). [2025-09-23T17:23:08.445049] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-23T17:23:08.445394] [INFO ] [MAIN ] Update Progress: 178/2372 symbols completed. AUNA took 37.7s. Estimated remaining: 4h 44m 34s. Rate: 7.7 symbols/min [2025-09-23T17:23:08.445811] [INFO ] [REMOTE ] AU: Full fetch complete (76262 records). [2025-09-23T17:23:08.458748] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-23T17:23:08.811280] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:09.000579] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T17:23:09.020785] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-23T17:23:09.093556] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-23T17:23:09.104588] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-23T17:23:09.106836] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-23T17:23:09.106962] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-23T17:23:09.107950] [DEBUG] [LOCAL ] AVB: Loaded 41705 existing records from primary storage. [2025-09-23T17:23:09.108441] [INFO ] [MAIN ] AVB: Loaded 41705 existing records. [2025-09-23T17:23:09.203700] [DEBUG] [LOCAL ] AU: Trimmed 76262 records to 52932 (keeping 200 days of data) [2025-09-23T17:23:09.390613] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:09.393010] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-23T17:23:09.393386] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-23T17:23:09.396889] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-23T17:23:09.397577] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-23T17:23:09.735347] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T17:23:09.794515] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-23T17:23:09.815536] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:23:09.847484] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:09.848632] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-23T17:23:09.848311] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-23T17:23:10.088395] [DEBUG] [LOCAL ] AU: Primary data saved (52932 records). [2025-09-23T17:23:10.088572] [INFO ] [MAIN ] AU: Full history saved. [2025-09-23T17:23:10.088723] [INFO ] [MAIN ] Update Progress: 179/2372 symbols completed. AU took 45.5s. Estimated remaining: 4h 43m 11s. Rate: 7.7 symbols/min [2025-09-23T17:23:10.281686] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:10.281931] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-23T17:23:10.281987] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-23T17:23:10.282142] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-23T17:23:10.282185] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-23T17:23:10.282230] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-23T17:23:10.282301] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-23T17:23:10.490405] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:23:10.533153] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-23T17:23:10.688521] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:10.688909] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-23T17:23:10.896489] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:10.897435] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T17:23:10.898087] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-23T17:23:10.906525] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-23T17:23:10.907030] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-23T17:23:11.152697] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:11.153226] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-23T17:23:11.153721] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-23T17:23:11.167304] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T17:23:11.171341] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-23T17:23:11.226722] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:23:11.235024] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-23T17:23:11.363352] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:11.363706] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-23T17:23:11.364157] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-23T17:23:11.751120] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:11.751470] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-23T17:23:11.751966] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-23T17:23:11.979912] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:11.980220] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-23T17:23:11.980696] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-23T17:23:12.014797] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T17:23:12.019702] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-23T17:23:12.211484] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:12.212383] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-23T17:23:12.213260] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-23T17:23:12.241803] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T17:23:12.484727] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:12.484212] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T17:23:12.492449] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-23T17:23:12.794455] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:23:13.002279] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-23T17:23:13.802347] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-23T17:23:14.008141] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:14.008455] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-23T17:23:14.163252] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T17:23:14.602202] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-23T17:23:15.402189] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-23T17:23:15.813182] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:23:16.202191] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-23T17:23:16.686054] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T17:23:17.002212] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-23T17:23:17.097407] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T17:23:17.099987] [INFO ] [REMOTE ] AVBC: Full fetch complete (4498 records). [2025-09-23T17:23:17.100058] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-23T17:23:17.281765] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 37 unique days, need 200 days [2025-09-23T17:23:17.281987] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:23:17.282056] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:23:17.282106] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-23T17:23:17.282163] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-23T17:23:17.282197] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-23T17:23:17.282264] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-23T17:23:17.282343] [INFO ] [MAIN ] Update Progress: 180/2372 symbols completed. AVBC took 7.2s. Estimated remaining: 4h 42m 57s. Rate: 7.7 symbols/min [2025-09-23T17:23:17.458798] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:17.466780] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T17:23:17.489304] [DEBUG] [LOCAL ] AVD: Loaded 23038 existing records from primary storage. [2025-09-23T17:23:17.489446] [INFO ] [MAIN ] AVD: Loaded 23038 existing records. [2025-09-23T17:23:17.666513] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:17.666802] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-23T17:23:17.666852] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-23T17:23:17.668194] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-23T17:23:17.668256] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-23T17:23:17.811605] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-23T17:23:18.032378] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:18.417441] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:23:18.602199] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-23T17:23:19.402207] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-23T17:23:19.546958] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:23:20.202196] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-23T17:23:20.612766] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T17:23:21.002196] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-23T17:23:21.182153] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T17:23:21.802222] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-23T17:23:22.190254] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T17:23:22.602220] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-23T17:23:23.218613] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T17:23:23.317555] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T17:23:23.402226] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-23T17:23:24.202227] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-23T17:23:24.979888] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:23:25.002189] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-23T17:23:25.078569] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T17:23:25.802205] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-23T17:23:26.169410] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:23:26.602181] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-23T17:23:26.619365] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T17:23:27.108443] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T17:23:27.402195] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-23T17:23:27.929902] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T17:23:27.931551] [INFO ] [REMOTE ] AVAL: Full fetch complete (14613 records). [2025-09-23T17:23:27.931628] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-23T17:23:28.207276] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-23T17:23:28.313616] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-23T17:23:28.313841] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-23T17:23:28.314166] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-23T17:23:28.314210] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-23T17:23:28.314971] [DEBUG] [LOCAL ] AVAL: Trimmed 14613 records to 8950 (keeping 200 days of data) [2025-09-23T17:23:28.371331] [DEBUG] [LOCAL ] AVAL: Primary data saved (8950 records). [2025-09-23T17:23:28.371484] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-23T17:23:28.371571] [INFO ] [MAIN ] Update Progress: 181/2372 symbols completed. AVAL took 21.3s. Estimated remaining: 4h 43m 29s. Rate: 7.7 symbols/min [2025-09-23T17:23:28.557796] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:28.577883] [DEBUG] [LOCAL ] AVK: Loaded 18073 existing records from primary storage. [2025-09-23T17:23:28.578043] [INFO ] [MAIN ] AVK: Loaded 18073 existing records. [2025-09-23T17:23:28.771279] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:28.771606] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-23T17:23:28.771714] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-23T17:23:28.772817] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-23T17:23:28.772880] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-23T17:23:29.007457] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-23T17:23:29.135905] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:29.226606] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T17:23:29.802231] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-23T17:23:30.337106] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:23:30.602205] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-23T17:23:31.192745] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:23:31.342000] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:23:31.402177] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-23T17:23:32.189447] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T17:23:32.202143] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-23T17:23:32.985330] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T17:23:33.002227] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-23T17:23:33.802253] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-23T17:23:34.399010] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T17:23:34.602250] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-23T17:23:34.902860] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T17:23:35.410775] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-23T17:23:35.413192] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T17:23:36.202190] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-23T17:23:36.224902] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T17:23:37.002204] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-23T17:23:37.639829] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:23:37.737614] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:23:37.741299] [INFO ] [REMOTE ] AVD: Full fetch complete (33899 records). [2025-09-23T17:23:37.741381] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-23T17:23:37.807316] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-23T17:23:38.127956] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-23T17:23:38.128048] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-23T17:23:38.128485] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-23T17:23:38.128526] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-23T17:23:38.129349] [DEBUG] [LOCAL ] AVD: Trimmed 33899 records to 22934 (keeping 200 days of data) [2025-09-23T17:23:38.258510] [DEBUG] [LOCAL ] AVD: Primary data saved (22934 records). [2025-09-23T17:23:38.258673] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-23T17:23:38.258782] [INFO ] [MAIN ] Update Progress: 182/2372 symbols completed. AVD took 21.0s. Estimated remaining: 4h 43m 47s. Rate: 7.7 symbols/min [2025-09-23T17:23:38.433996] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:38.469155] [DEBUG] [LOCAL ] AVNS: Loaded 33592 existing records from primary storage. [2025-09-23T17:23:38.469462] [INFO ] [MAIN ] AVNS: Loaded 33592 existing records. [2025-09-23T17:23:38.535812] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:23:38.607270] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-23T17:23:38.671903] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:38.672161] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-23T17:23:38.672213] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-23T17:23:38.674403] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-23T17:23:38.674491] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-23T17:23:39.056722] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:39.402180] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-23T17:23:39.622294] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:23:40.202274] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-23T17:23:40.446269] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T17:23:41.002229] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-23T17:23:41.648470] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:23:41.655785] [INFO ] [REMOTE ] AVB: Full fetch complete (58043 records). [2025-09-23T17:23:41.655890] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-23T17:23:41.807415] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-23T17:23:42.054711] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-23T17:23:42.055016] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-23T17:23:42.055937] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-23T17:23:42.056175] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-23T17:23:42.077245] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:23:42.084391] [DEBUG] [LOCAL ] AVB: Trimmed 58043 records to 41728 (keeping 200 days of data) [2025-09-23T17:23:42.345627] [DEBUG] [LOCAL ] AVB: Primary data saved (41728 records). [2025-09-23T17:23:42.345784] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-23T17:23:42.345869] [INFO ] [MAIN ] Update Progress: 183/2372 symbols completed. AVB took 33.9s. Estimated remaining: 4h 42m 55s. Rate: 7.7 symbols/min [2025-09-23T17:23:42.515524] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:42.554301] [DEBUG] [LOCAL ] AVNT: Loaded 39407 existing records from primary storage. [2025-09-23T17:23:42.554450] [INFO ] [MAIN ] AVNT: Loaded 39407 existing records. [2025-09-23T17:23:42.609098] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-23T17:23:42.737208] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:42.737475] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-23T17:23:42.737530] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-23T17:23:42.739424] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-23T17:23:42.739491] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-23T17:23:43.106312] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:43.118421] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T17:23:43.402235] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-23T17:23:43.507076] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T17:23:44.202239] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-23T17:23:44.754195] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:23:44.977271] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T17:23:45.002154] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-23T17:23:45.588944] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T17:23:45.802233] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-23T17:23:46.582844] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T17:23:46.602145] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-23T17:23:47.238929] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T17:23:47.402182] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-23T17:23:48.202210] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-23T17:23:48.625674] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T17:23:48.632208] [INFO ] [REMOTE ] AVA: Full fetch complete (55535 records). [2025-09-23T17:23:48.632313] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-23T17:23:49.004965] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-23T17:23:49.018808] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-23T17:23:49.019983] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-23T17:23:49.020591] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-23T17:23:49.020667] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-23T17:23:49.021975] [DEBUG] [LOCAL ] AVA: Trimmed 55535 records to 39654 (keeping 200 days of data) [2025-09-23T17:23:49.288755] [DEBUG] [LOCAL ] AVA: Primary data saved (39654 records). [2025-09-23T17:23:49.289468] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-23T17:23:49.291545] [INFO ] [MAIN ] Update Progress: 184/2372 symbols completed. AVA took 43.3s. Estimated remaining: 4h 42m 38s. Rate: 7.7 symbols/min [2025-09-23T17:23:49.290804] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:23:49.471681] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:49.532092] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-09-23T17:23:49.532267] [INFO ] [MAIN ] AVTR: Loaded 53567 existing records. [2025-09-23T17:23:49.706923] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:49.707186] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-23T17:23:49.707232] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-23T17:23:49.709837] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-23T17:23:49.709901] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-23T17:23:49.807498] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-23T17:23:50.065195] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:50.087280] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T17:23:50.602239] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-23T17:23:51.252464] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T17:23:51.402276] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-23T17:23:51.751991] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T17:23:52.202203] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-23T17:23:52.919217] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T17:23:53.002155] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-23T17:23:53.037342] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T17:23:53.041281] [INFO ] [REMOTE ] AVK: Full fetch complete (26639 records). [2025-09-23T17:23:53.041387] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-23T17:23:53.440372] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-23T17:23:53.440456] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-23T17:23:53.440831] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-23T17:23:53.440894] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-23T17:23:53.441587] [DEBUG] [LOCAL ] AVK: Trimmed 26639 records to 17983 (keeping 200 days of data) [2025-09-23T17:23:53.558295] [DEBUG] [LOCAL ] AVK: Primary data saved (17983 records). [2025-09-23T17:23:53.558445] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-23T17:23:53.558534] [INFO ] [MAIN ] Update Progress: 185/2372 symbols completed. AVK took 25.2s. Estimated remaining: 4h 41m 49s. Rate: 7.8 symbols/min [2025-09-23T17:23:53.742527] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:53.786492] [DEBUG] [LOCAL ] AVY: Loaded 37716 existing records from primary storage. [2025-09-23T17:23:53.786691] [INFO ] [MAIN ] AVY: Loaded 37716 existing records. [2025-09-23T17:23:53.809176] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-23T17:23:53.997761] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:53.998174] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-23T17:23:53.998285] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-23T17:23:54.001059] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-23T17:23:54.001127] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-23T17:23:54.399325] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:54.533711] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T17:23:54.602219] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-23T17:23:54.772180] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:23:55.402195] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-23T17:23:56.100025] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:23:56.127730] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:23:56.202195] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-23T17:23:57.002206] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-23T17:23:57.344323] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:23:57.802216] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-23T17:23:58.504590] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T17:23:58.602211] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-23T17:23:59.195561] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:23:59.402195] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-23T17:24:00.097822] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T17:24:00.202212] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-23T17:24:00.987739] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:24:01.002170] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-23T17:24:01.170210] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T17:24:01.802238] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-23T17:24:02.602230] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-23T17:24:03.280935] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-23T17:24:03.402194] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-23T17:24:04.202210] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-23T17:24:04.622839] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-23T17:24:04.664950] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-23T17:24:04.720631] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:24:05.002202] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-23T17:24:05.354180] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T17:24:05.360047] [INFO ] [REMOTE ] AVNS: Full fetch complete (47792 records). [2025-09-23T17:24:05.360160] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-23T17:24:05.745890] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-23T17:24:05.746018] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-23T17:24:05.746565] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-23T17:24:05.746636] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-23T17:24:05.747812] [DEBUG] [LOCAL ] AVNS: Trimmed 47792 records to 33579 (keeping 200 days of data) [2025-09-23T17:24:05.810338] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-23T17:24:05.952469] [DEBUG] [LOCAL ] AVNS: Primary data saved (33579 records). [2025-09-23T17:24:05.952615] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-23T17:24:05.952763] [INFO ] [MAIN ] Update Progress: 186/2372 symbols completed. AVNS took 27.7s. Estimated remaining: 4h 42m 36s. Rate: 7.7 symbols/min [2025-09-23T17:24:06.125269] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:06.150475] [DEBUG] [LOCAL ] AWF: Loaded 24294 existing records from primary storage. [2025-09-23T17:24:06.150606] [INFO ] [MAIN ] AWF: Loaded 24294 existing records. [2025-09-23T17:24:06.347989] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:06.348608] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-23T17:24:06.348709] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-23T17:24:06.350007] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-23T17:24:06.350071] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-23T17:24:06.607414] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-23T17:24:06.739096] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:06.765634] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T17:24:07.225780] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T17:24:07.402239] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-23T17:24:07.708470] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T17:24:08.202193] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-23T17:24:08.384739] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T17:24:09.002202] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-23T17:24:09.720708] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T17:24:09.802163] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-23T17:24:09.962173] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T17:24:10.602230] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-23T17:24:10.849431] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T17:24:11.297593] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:24:11.402188] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-23T17:24:12.202261] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-23T17:24:12.587875] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T17:24:13.002231] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-23T17:24:13.626182] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T17:24:13.802155] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-23T17:24:14.602189] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-23T17:24:15.402201] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-23T17:24:15.614582] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-23T17:24:15.780196] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-23T17:24:16.202194] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-23T17:24:16.765916] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T17:24:17.002220] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-23T17:24:17.638257] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T17:24:17.647742] [INFO ] [REMOTE ] AVTR: Full fetch complete (77440 records). [2025-09-23T17:24:17.647938] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-23T17:24:17.802703] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-23T17:24:17.818568] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-23T17:24:18.096724] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-23T17:24:18.096824] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-23T17:24:18.097590] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-23T17:24:18.097709] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-23T17:24:18.099226] [DEBUG] [LOCAL ] AVTR: Trimmed 77440 records to 53567 (keeping 200 days of data) [2025-09-23T17:24:18.224571] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T17:24:18.456290] [DEBUG] [LOCAL ] AVTR: Primary data saved (53567 records). [2025-09-23T17:24:18.456463] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-23T17:24:18.456625] [INFO ] [MAIN ] Update Progress: 187/2372 symbols completed. AVTR took 29.2s. Estimated remaining: 4h 43m 24s. Rate: 7.7 symbols/min [2025-09-23T17:24:18.626213] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:18.609186] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-23T17:24:18.659244] [DEBUG] [LOCAL ] AWI: Loaded 26066 existing records from primary storage. [2025-09-23T17:24:18.659386] [INFO ] [MAIN ] AWI: Loaded 26066 existing records. [2025-09-23T17:24:18.837893] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:18.838289] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-23T17:24:18.838357] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-23T17:24:18.839256] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-23T17:24:18.839338] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-23T17:24:19.217219] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:19.237052] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T17:24:19.402176] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-23T17:24:19.757238] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T17:24:20.202250] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-23T17:24:20.884563] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T17:24:21.002204] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-23T17:24:21.387134] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T17:24:21.393555] [INFO ] [REMOTE ] AVNT: Full fetch complete (55808 records). [2025-09-23T17:24:21.393716] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-23T17:24:21.394806] [FATAL] [VALIDATOR ] AVNT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:24:21.394942] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:24:21.394997] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:24:21.395062] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-23T17:24:21.395169] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-23T17:24:21.395241] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-09-23T17:24:21.395941] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-09-23T17:24:21.396072] [INFO ] [MAIN ] Update Progress: 188/2372 symbols completed. AVNT took 39.1s. Estimated remaining: 4h 42m 20s. Rate: 7.7 symbols/min [2025-09-23T17:24:21.564015] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:21.633078] [DEBUG] [LOCAL ] AWK: Loaded 48853 existing records from primary storage. [2025-09-23T17:24:21.633249] [INFO ] [MAIN ] AWK: Loaded 48853 existing records. [2025-09-23T17:24:21.810741] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-23T17:24:21.811104] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:21.812532] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-23T17:24:21.812723] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-23T17:24:21.819082] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-23T17:24:21.819303] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-23T17:24:21.873487] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T17:24:22.200594] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:22.602178] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-23T17:24:22.902916] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:24:23.388713] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T17:24:23.402143] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-23T17:24:24.200476] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T17:24:24.202237] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-23T17:24:25.002231] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-23T17:24:25.263633] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:24:25.773146] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T17:24:25.778068] [INFO ] [REMOTE ] AWF: Full fetch complete (35992 records). [2025-09-23T17:24:25.778220] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-23T17:24:25.809481] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-23T17:24:26.180318] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-23T17:24:26.180417] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-23T17:24:26.180951] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-23T17:24:26.181014] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-23T17:24:26.181907] [DEBUG] [LOCAL ] AWF: Trimmed 35992 records to 24324 (keeping 200 days of data) [2025-09-23T17:24:26.348092] [DEBUG] [LOCAL ] AWF: Primary data saved (24324 records). [2025-09-23T17:24:26.348231] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-23T17:24:26.348332] [INFO ] [MAIN ] Update Progress: 189/2372 symbols completed. AWF took 20.4s. Estimated remaining: 4h 41m 39s. Rate: 7.8 symbols/min [2025-09-23T17:24:26.598996] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:26.602169] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-23T17:24:26.624112] [DEBUG] [LOCAL ] AWP: Loaded 21999 existing records from primary storage. [2025-09-23T17:24:26.624267] [INFO ] [MAIN ] AWP: Loaded 21999 existing records. [2025-09-23T17:24:26.811052] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:26.811572] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-23T17:24:26.811670] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-23T17:24:26.818658] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-23T17:24:26.829445] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-23T17:24:26.830129] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:24:27.200535] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:27.402193] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-23T17:24:27.999254] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:24:28.202209] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-23T17:24:28.261984] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:24:29.002201] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-23T17:24:29.155914] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T17:24:29.802216] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-23T17:24:29.844055] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T17:24:30.602236] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-23T17:24:31.080495] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T17:24:31.402200] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-23T17:24:31.552170] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:24:32.202206] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-23T17:24:33.002198] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-23T17:24:33.228801] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T17:24:33.387846] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T17:24:33.802231] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-23T17:24:34.088475] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:24:34.602231] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-23T17:24:35.353313] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:24:35.402142] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-23T17:24:35.764448] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:24:35.770936] [INFO ] [REMOTE ] AVY: Full fetch complete (56074 records). [2025-09-23T17:24:35.771086] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-23T17:24:36.148852] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-23T17:24:36.148932] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-23T17:24:36.149507] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-23T17:24:36.149547] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-23T17:24:36.150630] [DEBUG] [LOCAL ] AVY: Trimmed 56074 records to 37657 (keeping 200 days of data) [2025-09-23T17:24:36.224477] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-23T17:24:36.404294] [DEBUG] [LOCAL ] AVY: Primary data saved (37657 records). [2025-09-23T17:24:36.404433] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-23T17:24:36.405568] [INFO ] [MAIN ] Update Progress: 190/2372 symbols completed. AVY took 42.8s. Estimated remaining: 4h 41m 58s. Rate: 7.7 symbols/min [2025-09-23T17:24:36.574907] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:36.604176] [DEBUG] [LOCAL ] AWR: Loaded 22541 existing records from primary storage. [2025-09-23T17:24:36.604328] [INFO ] [MAIN ] AWR: Loaded 22541 existing records. [2025-09-23T17:24:36.787071] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:36.787620] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-23T17:24:36.787757] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-23T17:24:36.788368] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-23T17:24:36.788463] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-23T17:24:37.006238] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-23T17:24:37.091442] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T17:24:37.193431] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T17:24:37.225038] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:37.802228] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-23T17:24:38.320478] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T17:24:38.602204] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-23T17:24:38.976451] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T17:24:39.402199] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-23T17:24:39.458846] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:24:40.202186] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-23T17:24:40.250964] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T17:24:40.945185] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T17:24:41.002215] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-23T17:24:41.802225] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-23T17:24:42.152773] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T17:24:42.504618] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:24:42.602265] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-23T17:24:43.302351] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T17:24:43.402261] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-23T17:24:44.202295] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-23T17:24:44.682725] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:24:44.688084] [INFO ] [REMOTE ] AWI: Full fetch complete (35461 records). [2025-09-23T17:24:44.688292] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-23T17:24:45.007951] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-23T17:24:45.103967] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-23T17:24:45.104338] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-23T17:24:45.105516] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-23T17:24:45.107210] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-23T17:24:45.107114] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T17:24:45.115613] [DEBUG] [LOCAL ] AWI: Trimmed 35461 records to 26007 (keeping 200 days of data) [2025-09-23T17:24:45.294156] [DEBUG] [LOCAL ] AWI: Primary data saved (26007 records). [2025-09-23T17:24:45.294310] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-23T17:24:45.294401] [INFO ] [MAIN ] Update Progress: 191/2372 symbols completed. AWI took 26.8s. Estimated remaining: 4h 42m 4s. Rate: 7.7 symbols/min [2025-09-23T17:24:45.474690] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:45.504349] [DEBUG] [LOCAL ] AX: Loaded 28679 existing records from primary storage. [2025-09-23T17:24:45.504490] [INFO ] [MAIN ] AX: Loaded 28679 existing records. [2025-09-23T17:24:45.698618] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:45.698908] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-23T17:24:45.698956] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-23T17:24:45.699670] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-23T17:24:45.699735] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-23T17:24:45.807453] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-23T17:24:46.112433] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:46.133085] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T17:24:46.573997] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T17:24:46.602175] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-23T17:24:47.402278] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-23T17:24:47.671433] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:24:48.161024] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T17:24:48.202152] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-23T17:24:48.854668] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T17:24:49.002186] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-23T17:24:49.802179] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-23T17:24:50.165077] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T17:24:50.580925] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T17:24:50.585285] [INFO ] [REMOTE ] AWP: Full fetch complete (32517 records). [2025-09-23T17:24:50.585462] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-23T17:24:50.608503] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-23T17:24:50.994156] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-23T17:24:50.994289] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-23T17:24:50.994806] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-23T17:24:50.994870] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-23T17:24:50.996127] [DEBUG] [LOCAL ] AWP: Trimmed 32517 records to 21785 (keeping 200 days of data) [2025-09-23T17:24:51.121547] [DEBUG] [LOCAL ] AWP: Primary data saved (21785 records). [2025-09-23T17:24:51.121705] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-23T17:24:51.121797] [INFO ] [MAIN ] Update Progress: 192/2372 symbols completed. AWP took 24.8s. Estimated remaining: 4h 41m 34s. Rate: 7.7 symbols/min [2025-09-23T17:24:51.300170] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:51.300356] [DEBUG] [LOCAL ] AXL: No existing data file found in primary storage. [2025-09-23T17:24:51.300393] [WARN ] [MAIN ] AXL: No existing data found, performing full refresh instead. [2025-09-23T17:24:51.300535] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-23T17:24:51.300576] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-23T17:24:51.300617] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-09-23T17:24:51.300675] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-23T17:24:51.407399] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-23T17:24:51.676448] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:51.736914] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:24:52.202199] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-23T17:24:52.670296] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:24:53.002259] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-23T17:24:53.098264] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T17:24:53.802239] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-23T17:24:54.353275] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:24:54.602214] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-23T17:24:55.113043] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:24:55.402187] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-23T17:24:55.422614] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T17:24:56.202215] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-23T17:24:57.002199] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-23T17:24:57.153898] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T17:24:57.227395] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T17:24:57.770884] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T17:24:57.802162] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-23T17:24:58.602208] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-23T17:24:58.701784] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T17:24:58.706777] [INFO ] [REMOTE ] AWR: Full fetch complete (31716 records). [2025-09-23T17:24:58.706955] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-23T17:24:59.081804] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-23T17:24:59.081887] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-23T17:24:59.082303] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-23T17:24:59.082380] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-23T17:24:59.083282] [DEBUG] [LOCAL ] AWR: Trimmed 31716 records to 22614 (keeping 200 days of data) [2025-09-23T17:24:59.226048] [DEBUG] [LOCAL ] AWR: Primary data saved (22614 records). [2025-09-23T17:24:59.226217] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-23T17:24:59.226335] [INFO ] [MAIN ] Update Progress: 193/2372 symbols completed. AWR took 22.8s. Estimated remaining: 4h 41m 30s. Rate: 7.7 symbols/min [2025-09-23T17:24:59.393961] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:59.402166] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-23T17:24:59.450081] [DEBUG] [LOCAL ] AXP: Loaded 53264 existing records from primary storage. [2025-09-23T17:24:59.450229] [INFO ] [MAIN ] AXP: Loaded 53264 existing records. [2025-09-23T17:24:59.618763] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T17:24:59.663944] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:59.664333] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-23T17:24:59.665202] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-23T17:24:59.666544] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-23T17:24:59.666612] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-23T17:25:00.037876] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:00.202201] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-23T17:25:00.937796] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T17:25:01.002207] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-23T17:25:01.802227] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-23T17:25:02.185234] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-23T17:25:02.246490] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T17:25:02.602205] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-23T17:25:02.735230] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:25:03.402249] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-23T17:25:03.831010] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T17:25:04.202253] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-23T17:25:05.002214] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-23T17:25:05.542979] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T17:25:05.802212] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-23T17:25:06.099747] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T17:25:06.448377] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T17:25:06.602221] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-23T17:25:07.402173] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-23T17:25:07.434891] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T17:25:07.658134] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T17:25:08.202192] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-23T17:25:08.955598] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:25:08.967255] [INFO ] [REMOTE ] AWK: Full fetch complete (70524 records). [2025-09-23T17:25:08.967419] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-23T17:25:09.007428] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-23T17:25:09.393950] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-23T17:25:09.394050] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-23T17:25:09.394784] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-23T17:25:09.394848] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-23T17:25:09.396276] [DEBUG] [LOCAL ] AWK: Trimmed 70524 records to 48832 (keeping 200 days of data) [2025-09-23T17:25:09.704689] [DEBUG] [LOCAL ] AWK: Primary data saved (48832 records). [2025-09-23T17:25:09.704824] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-23T17:25:09.704908] [INFO ] [MAIN ] Update Progress: 194/2372 symbols completed. AWK took 48.3s. Estimated remaining: 4h 41m 53s. Rate: 7.7 symbols/min [2025-09-23T17:25:09.804529] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-23T17:25:09.878841] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:09.884401] [DEBUG] [LOCAL ] AXR: Loaded 3148 existing records from primary storage. [2025-09-23T17:25:09.884493] [INFO ] [MAIN ] AXR: Loaded 3148 existing records. [2025-09-23T17:25:10.067225] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:25:10.067479] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-23T17:25:10.067527] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-23T17:25:10.067788] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-23T17:25:10.067847] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-23T17:25:10.382803] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T17:25:10.464308] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:10.500888] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-23T17:25:10.602155] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-23T17:25:11.313127] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:25:11.402200] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-23T17:25:12.202299] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-23T17:25:12.510420] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T17:25:13.002225] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-23T17:25:13.136465] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T17:25:13.374370] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T17:25:13.802216] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-23T17:25:14.602253] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-23T17:25:15.168229] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-23T17:25:15.224349] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:25:15.402175] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-23T17:25:15.549176] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:25:15.554468] [INFO ] [REMOTE ] AX: Full fetch complete (42762 records). [2025-09-23T17:25:15.554629] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-23T17:25:15.933349] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-23T17:25:15.933430] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-23T17:25:15.933937] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-23T17:25:15.934000] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-23T17:25:15.934972] [DEBUG] [LOCAL ] AX: Trimmed 42762 records to 28637 (keeping 200 days of data) [2025-09-23T17:25:16.037362] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T17:25:16.120949] [DEBUG] [LOCAL ] AX: Primary data saved (28637 records). [2025-09-23T17:25:16.121083] [INFO ] [MAIN ] AX: Full history saved. [2025-09-23T17:25:16.121165] [INFO ] [MAIN ] Update Progress: 195/2372 symbols completed. AX took 30.8s. Estimated remaining: 4h 41m 30s. Rate: 7.7 symbols/min [2025-09-23T17:25:16.207442] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-23T17:25:16.297720] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:16.345351] [DEBUG] [LOCAL ] AXS: Loaded 38244 existing records from primary storage. [2025-09-23T17:25:16.345511] [INFO ] [MAIN ] AXS: Loaded 38244 existing records. [2025-09-23T17:25:16.523289] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:25:16.523549] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-23T17:25:16.523597] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-23T17:25:16.524501] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-23T17:25:16.524564] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-23T17:25:16.874553] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:17.002149] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-23T17:25:17.802208] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-23T17:25:18.224937] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-23T17:25:18.305131] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:25:18.602204] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-23T17:25:19.284030] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T17:25:19.402192] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-23T17:25:19.758308] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T17:25:20.202193] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-23T17:25:20.650512] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T17:25:21.002196] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-23T17:25:21.802197] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-23T17:25:21.956186] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:25:22.062802] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T17:25:22.602196] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-23T17:25:23.402213] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-23T17:25:23.492870] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T17:25:23.770479] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-23T17:25:24.202158] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-23T17:25:24.391287] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T17:25:25.002188] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-23T17:25:25.378232] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T17:25:25.802202] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-23T17:25:26.264618] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:25:26.555485] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:25:26.564144] [INFO ] [REMOTE ] AXL: Full fetch complete (72396 records). [2025-09-23T17:25:26.564288] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-23T17:25:26.607258] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-23T17:25:26.962834] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-23T17:25:26.962917] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-23T17:25:26.963618] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-23T17:25:26.963694] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-23T17:25:26.965407] [DEBUG] [LOCAL ] AXL: Trimmed 72396 records to 50505 (keeping 200 days of data) [2025-09-23T17:25:27.248104] [DEBUG] [LOCAL ] AXL: Primary data saved (50505 records). [2025-09-23T17:25:27.248242] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-23T17:25:27.248319] [INFO ] [MAIN ] Update Progress: 196/2372 symbols completed. AXL took 36.1s. Estimated remaining: 4h 41m 60s. Rate: 7.7 symbols/min [2025-09-23T17:25:27.417183] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:27.414351] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-23T17:25:27.478000] [DEBUG] [LOCAL ] AXTA: Loaded 52052 existing records from primary storage. [2025-09-23T17:25:27.478163] [INFO ] [MAIN ] AXTA: Loaded 52052 existing records. [2025-09-23T17:25:27.655758] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:25:27.655991] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-23T17:25:27.656045] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-23T17:25:27.657098] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-23T17:25:27.657161] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-23T17:25:28.014165] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:28.202165] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-23T17:25:28.562512] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T17:25:28.571296] [INFO ] [REMOTE ] AXP: Full fetch complete (76541 records). [2025-09-23T17:25:28.571434] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-23T17:25:28.572191] [FATAL] [VALIDATOR ] AXP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:25:28.572282] [FATAL] [MAIN ] AXP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:25:28.572332] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:25:28.572422] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-23T17:25:28.572526] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-23T17:25:28.572579] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-09-23T17:25:28.573590] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-09-23T17:25:28.574098] [INFO ] [MAIN ] Update Progress: 197/2372 symbols completed. AXP took 29.3s. Estimated remaining: 4h 40m 41s. Rate: 7.7 symbols/min [2025-09-23T17:25:28.579362] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T17:25:29.002164] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-23T17:25:29.094775] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T17:25:29.376221] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-23T17:25:29.802217] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-23T17:25:30.195310] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-23T17:25:30.602231] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-23T17:25:31.219579] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T17:25:31.402197] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-23T17:25:32.202198] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-23T17:25:32.559316] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T17:25:33.007321] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-23T17:25:33.026140] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T17:25:33.489561] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T17:25:33.802214] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-23T17:25:34.602213] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-23T17:25:34.889559] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:25:35.047486] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T17:25:35.048751] [INFO ] [REMOTE ] AXR: Full fetch complete (4989 records). [2025-09-23T17:25:35.048821] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-23T17:25:35.049176] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:25:35.049270] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:25:35.049347] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:25:35.049436] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-23T17:25:35.049516] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-09-23T17:25:35.049553] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-09-23T17:25:35.049844] [DEBUG] [LOCAL ] AXR: Deleted derivative data file. [2025-09-23T17:25:35.049934] [INFO ] [MAIN ] Update Progress: 198/2372 symbols completed. AXR took 25.3s. Estimated remaining: 4h 40m 19s. Rate: 7.8 symbols/min [2025-09-23T17:25:35.402234] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-23T17:25:36.202210] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-23T17:25:36.465638] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:25:37.002249] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-23T17:25:37.575479] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:25:37.802277] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-23T17:25:38.232841] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T17:25:38.602220] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-23T17:25:39.292303] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T17:25:39.402225] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-23T17:25:40.327996] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T17:25:40.339273] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-23T17:25:41.023446] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T17:25:41.032559] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-23T17:25:41.691499] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T17:25:41.802298] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-23T17:25:42.085050] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T17:25:42.602251] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-23T17:25:43.024315] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:25:43.402210] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-23T17:25:44.187183] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T17:25:44.194116] [INFO ] [REMOTE ] AXS: Full fetch complete (55334 records). [2025-09-23T17:25:44.194290] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-23T17:25:44.594415] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-23T17:25:44.594548] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-23T17:25:44.595249] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-23T17:25:44.595314] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-23T17:25:44.596595] [DEBUG] [LOCAL ] AXS: Trimmed 55334 records to 38262 (keeping 200 days of data) [2025-09-23T17:25:44.755946] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T17:25:44.819581] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-23T17:25:44.873938] [DEBUG] [LOCAL ] AXS: Primary data saved (38262 records). [2025-09-23T17:25:44.874099] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-23T17:25:44.874188] [INFO ] [MAIN ] Update Progress: 199/2372 symbols completed. AXS took 28.8s. Estimated remaining: 4h 40m 34s. Rate: 7.7 symbols/min [2025-09-23T17:25:46.162107] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:25:46.173507] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-23T17:25:47.904238] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:25:47.912910] [INFO ] [REMOTE ] AXTA: Full fetch complete (74746 records). [2025-09-23T17:25:47.913035] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-23T17:25:48.304405] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-23T17:25:48.304573] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-23T17:25:48.305365] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-23T17:25:48.305433] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-23T17:25:48.307377] [DEBUG] [LOCAL ] AXTA: Trimmed 74746 records to 52056 (keeping 200 days of data) [2025-09-23T17:25:48.611431] [DEBUG] [LOCAL ] AXTA: Primary data saved (52056 records). [2025-09-23T17:25:48.611587] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-23T17:25:48.611699] [INFO ] [MAIN ] Update Progress: 200/2372 symbols completed. AXTA took 21.4s. Estimated remaining: 4h 39m 43s. Rate: 7.8 symbols/min [2025-09-23T17:25:49.305372] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:49.247582] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:49.331278] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:49.333731] [DEBUG] [LOCAL ] AYI: No existing data file found in primary storage. [2025-09-23T17:25:49.331501] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-23T17:25:49.338112] [WARN ] [MAIN ] AYI: No existing data found, performing full refresh instead. [2025-09-23T17:25:49.338285] [DEBUG] [LOCAL ] AZZ: No existing data file found in primary storage. [2025-09-23T17:25:49.338419] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-23T17:25:49.338720] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-23T17:25:49.388964] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-23T17:25:49.383481] [WARN ] [MAIN ] AZZ: No existing data found, performing full refresh instead. [2025-09-23T17:25:49.393892] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-09-23T17:25:49.394120] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-23T17:25:49.394438] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-23T17:25:49.394380] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-23T17:25:49.393274] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:49.394752] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-23T17:25:49.400008] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-23T17:25:49.426295] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-23T17:25:49.426229] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-23T17:25:49.426400] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-23T17:25:49.447946] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-23T17:25:49.886938] [DEBUG] [LOCAL ] AZO: Loaded 11466 existing records from primary storage. [2025-09-23T17:25:49.968849] [INFO ] [MAIN ] AZO: Loaded 11466 existing records. [2025-09-23T17:25:50.546505] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:50.607387] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-23T17:25:50.606976] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:25:50.668850] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-23T17:25:50.692928] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-23T17:25:50.731475] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:50.738758] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-23T17:25:50.738606] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:50.739181] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-23T17:25:50.739308] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-23T17:25:50.751678] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-23T17:25:51.096329] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:51.096755] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-23T17:25:51.838507] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:25:51.842002] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-23T17:25:51.899142] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T17:25:51.903746] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-23T17:25:51.992037] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:25:51.997609] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-23T17:25:52.060228] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T17:25:52.067735] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-23T17:25:52.646232] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:25:52.649082] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-23T17:25:52.898105] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T17:25:52.915621] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T17:25:52.969875] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T17:25:53.002182] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-23T17:25:53.260024] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T17:25:53.757120] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T17:25:53.802153] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-23T17:25:54.602255] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-23T17:25:55.219126] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T17:25:55.402280] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-23T17:25:55.833284] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T17:25:56.202237] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-23T17:25:56.402697] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:25:56.403016] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-23T17:25:56.915680] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:25:57.002191] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-23T17:25:57.761324] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:25:57.802203] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-23T17:25:58.602220] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-23T17:25:58.737701] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:25:59.317892] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:25:59.402192] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-23T17:26:00.202214] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-23T17:26:00.262532] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T17:26:01.002231] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-23T17:26:01.388037] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T17:26:01.802309] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-23T17:26:02.578064] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T17:26:02.602170] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-23T17:26:02.869489] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:26:03.295919] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T17:26:03.402195] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-23T17:26:03.622986] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:26:03.623293] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-23T17:26:04.202232] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-23T17:26:04.825225] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T17:26:05.002235] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-23T17:26:05.329947] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:26:05.330281] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-23T17:26:05.802205] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-23T17:26:06.602222] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-23T17:26:07.062699] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:26:07.402233] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-23T17:26:08.202153] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-23T17:26:08.469783] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T17:26:08.564957] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:26:08.568917] [INFO ] [REMOTE ] AYI: Full fetch complete (36772 records). [2025-09-23T17:26:08.569039] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-23T17:26:08.994021] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T17:26:08.996550] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-23T17:26:08.996694] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-23T17:26:09.000568] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-23T17:26:09.000857] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-23T17:26:09.002217] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-23T17:26:09.004453] [DEBUG] [LOCAL ] AYI: Trimmed 36772 records to 25239 (keeping 200 days of data) [2025-09-23T17:26:09.178924] [DEBUG] [LOCAL ] AYI: Primary data saved (25239 records). [2025-09-23T17:26:09.179072] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-23T17:26:09.179153] [INFO ] [MAIN ] Update Progress: 201/2372 symbols completed. AYI took 20.6s. Estimated remaining: 4h 41m 54s. Rate: 7.7 symbols/min [2025-09-23T17:26:09.389593] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:09.457992] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-23T17:26:09.458154] [INFO ] [MAIN ] BA: Loaded 53791 existing records. [2025-09-23T17:26:09.663104] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:09.671608] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-23T17:26:09.672464] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T17:26:09.672586] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-23T17:26:09.678393] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-23T17:26:09.678464] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-23T17:26:09.807338] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-23T17:26:10.078284] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:10.602156] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-23T17:26:10.616892] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:26:10.619290] [INFO ] [REMOTE ] AZO: Full fetch complete (16394 records). [2025-09-23T17:26:10.619363] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-23T17:26:10.977433] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-23T17:26:10.977513] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-23T17:26:10.977812] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-23T17:26:10.977886] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-23T17:26:10.978408] [DEBUG] [LOCAL ] AZO: Trimmed 16394 records to 11496 (keeping 200 days of data) [2025-09-23T17:26:11.054726] [DEBUG] [LOCAL ] AZO: Primary data saved (11496 records). [2025-09-23T17:26:11.054860] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-23T17:26:11.054965] [INFO ] [MAIN ] Update Progress: 202/2372 symbols completed. AZO took 22.4s. Estimated remaining: 4h 40m 43s. Rate: 7.7 symbols/min [2025-09-23T17:26:11.224210] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:11.289862] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-23T17:26:11.290031] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-09-23T17:26:11.407501] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-23T17:26:11.480409] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:11.480739] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-23T17:26:11.480795] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-23T17:26:11.483355] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-23T17:26:11.483418] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-23T17:26:11.835436] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:12.202227] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-23T17:26:12.411680] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:26:12.997295] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T17:26:13.002195] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-23T17:26:13.148459] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:26:13.802196] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-23T17:26:14.602182] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-23T17:26:15.279032] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-23T17:26:15.402207] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-23T17:26:16.202163] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-23T17:26:16.256171] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-23T17:26:16.443726] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T17:26:17.002176] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-23T17:26:17.130364] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T17:26:17.331726] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T17:26:17.802204] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-23T17:26:18.602283] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-23T17:26:19.004856] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T17:26:19.127042] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-23T17:26:19.402196] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-23T17:26:20.202210] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-23T17:26:20.381211] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T17:26:21.002200] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-23T17:26:21.535682] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-23T17:26:21.802219] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-23T17:26:22.232291] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T17:26:22.549207] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T17:26:22.602200] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-23T17:26:22.899065] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T17:26:22.908740] [INFO ] [REMOTE ] B: Full fetch complete (44970 records). [2025-09-23T17:26:22.908972] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-23T17:26:23.125733] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-23T17:26:23.126289] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:26:23.126375] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:26:23.126495] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-23T17:26:23.126588] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-23T17:26:23.126684] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-23T17:26:23.126776] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-23T17:26:23.126892] [INFO ] [MAIN ] Update Progress: 203/2372 symbols completed. B took 34.5s. Estimated remaining: 4h 41m 21s. Rate: 7.7 symbols/min [2025-09-23T17:26:23.299604] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:23.377287] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-23T17:26:23.377445] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-09-23T17:26:23.409390] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-23T17:26:23.566409] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:23.566672] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-23T17:26:23.566731] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-23T17:26:23.569288] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-23T17:26:23.569349] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-23T17:26:23.938876] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:24.202197] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-23T17:26:24.792614] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-23T17:26:25.002327] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-23T17:26:25.260000] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T17:26:25.263715] [INFO ] [REMOTE ] AZZ: Full fetch complete (30832 records). [2025-09-23T17:26:25.263823] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-23T17:26:25.659620] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-23T17:26:25.659739] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-23T17:26:25.660146] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-23T17:26:25.660198] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-23T17:26:25.661363] [DEBUG] [LOCAL ] AZZ: Trimmed 30832 records to 22139 (keeping 200 days of data) [2025-09-23T17:26:25.802626] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-23T17:26:25.830033] [DEBUG] [LOCAL ] AZZ: Primary data saved (22139 records). [2025-09-23T17:26:25.830180] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-23T17:26:25.830265] [INFO ] [MAIN ] Update Progress: 204/2372 symbols completed. AZZ took 37.2s. Estimated remaining: 4h 40m 19s. Rate: 7.7 symbols/min [2025-09-23T17:26:26.025067] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:26.100098] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-23T17:26:26.129004] [DEBUG] [LOCAL ] BAH: Loaded 51749 existing records from primary storage. [2025-09-23T17:26:26.129168] [INFO ] [MAIN ] BAH: Loaded 51749 existing records. [2025-09-23T17:26:26.309931] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:26.310241] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-23T17:26:26.310300] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-23T17:26:26.312706] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-23T17:26:26.312800] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-23T17:26:26.607445] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-23T17:26:26.679065] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:27.402243] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-23T17:26:27.473880] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-23T17:26:27.563507] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T17:26:28.202273] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-23T17:26:28.786735] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:26:28.935444] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-23T17:26:29.002155] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-23T17:26:29.802244] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-23T17:26:30.229872] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-23T17:26:30.602208] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-23T17:26:31.063176] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-23T17:26:31.137317] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:26:31.402198] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-23T17:26:32.202235] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-23T17:26:32.480863] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T17:26:33.002248] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-23T17:26:33.509486] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:26:33.802220] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-23T17:26:33.989619] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-23T17:26:34.602173] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-23T17:26:34.745306] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:26:35.402231] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-23T17:26:36.134474] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-23T17:26:36.202160] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-23T17:26:36.678957] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T17:26:36.913900] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:26:37.002190] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-23T17:26:37.802193] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-23T17:26:38.403790] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T17:26:38.602189] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-23T17:26:38.892391] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T17:26:39.402210] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-23T17:26:39.885094] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T17:26:40.202199] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-23T17:26:40.674407] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T17:26:40.815262] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:26:41.002193] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-23T17:26:41.802245] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-23T17:26:42.172153] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T17:26:42.602248] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-23T17:26:42.903872] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T17:26:43.130867] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:26:43.402265] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-23T17:26:44.202250] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-23T17:26:44.821223] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T17:26:44.856820] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-23T17:26:44.867736] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-23T17:26:44.867879] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-23T17:26:45.007409] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-23T17:26:45.269572] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-23T17:26:45.269693] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-23T17:26:45.270546] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-23T17:26:45.270611] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-23T17:26:45.272183] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 53791 (keeping 200 days of data) [2025-09-23T17:26:45.604234] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-23T17:26:45.604383] [INFO ] [MAIN ] BA: Full history saved. [2025-09-23T17:26:45.604468] [INFO ] [MAIN ] Update Progress: 205/2372 symbols completed. BA took 36.4s. Estimated remaining: 4h 42m 18s. Rate: 7.7 symbols/min [2025-09-23T17:26:45.827167] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-23T17:26:45.829814] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:45.872673] [DEBUG] [LOCAL ] BAK: Loaded 38789 existing records from primary storage. [2025-09-23T17:26:45.872845] [INFO ] [MAIN ] BAK: Loaded 38789 existing records. [2025-09-23T17:26:46.053079] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:46.053316] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-23T17:26:46.053378] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-23T17:26:46.055039] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-23T17:26:46.055113] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-23T17:26:46.429014] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:46.499867] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-23T17:26:46.540713] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:26:46.602160] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-23T17:26:47.402209] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-23T17:26:47.642086] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T17:26:48.025618] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T17:26:48.035034] [INFO ] [REMOTE ] BAH: Full fetch complete (74446 records). [2025-09-23T17:26:48.035269] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-23T17:26:48.036346] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:26:48.036476] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:26:48.036553] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:26:48.036678] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-23T17:26:48.036787] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-23T17:26:48.036860] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-09-23T17:26:48.037382] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-09-23T17:26:48.042449] [INFO ] [MAIN ] Update Progress: 206/2372 symbols completed. BAH took 22.2s. Estimated remaining: 4h 41m 14s. Rate: 7.7 symbols/min [2025-09-23T17:26:48.209507] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-23T17:26:48.332845] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:48.432012] [DEBUG] [LOCAL ] BALL: Loaded 51825 existing records from primary storage. [2025-09-23T17:26:48.432234] [INFO ] [MAIN ] BALL: Loaded 51825 existing records. [2025-09-23T17:26:48.724841] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:48.751176] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-23T17:26:48.751785] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-23T17:26:48.753398] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:26:48.763209] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-23T17:26:48.764338] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-23T17:26:49.007354] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-23T17:26:49.159678] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:49.802244] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-23T17:26:50.602304] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-23T17:26:50.940691] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-23T17:26:50.950977] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-23T17:26:50.951183] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-23T17:26:51.299857] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T17:26:51.406128] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-23T17:26:51.433451] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-23T17:26:51.433576] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-23T17:26:51.434577] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-23T17:26:51.434813] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-23T17:26:51.470761] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-23T17:26:51.468500] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-09-23T17:26:51.866009] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-23T17:26:51.866267] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-23T17:26:51.866551] [INFO ] [MAIN ] Update Progress: 207/2372 symbols completed. BABA took 40.8s. Estimated remaining: 4h 40m 25s. Rate: 7.7 symbols/min [2025-09-23T17:26:52.038377] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:52.038616] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-23T17:26:52.038798] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-23T17:26:52.039025] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-23T17:26:52.039095] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-23T17:26:52.039156] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-23T17:26:52.039193] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-23T17:26:52.207328] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-23T17:26:52.263325] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T17:26:52.444808] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:52.477074] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T17:26:53.002178] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-23T17:26:53.802242] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-23T17:26:53.997096] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T17:26:54.602180] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-23T17:26:54.635977] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-23T17:26:54.645373] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-23T17:26:54.645517] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-23T17:26:54.805677] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T17:26:55.068451] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-23T17:26:55.068559] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-23T17:26:55.069358] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-23T17:26:55.069426] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-23T17:26:55.071082] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-09-23T17:26:55.402713] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-23T17:26:55.417883] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-23T17:26:55.418022] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-23T17:26:55.418106] [INFO ] [MAIN ] Update Progress: 208/2372 symbols completed. BAC took 32.3s. Estimated remaining: 4h 39m 33s. Rate: 7.7 symbols/min [2025-09-23T17:26:55.600339] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:55.653201] [DEBUG] [LOCAL ] BAM: Loaded 52009 existing records from primary storage. [2025-09-23T17:26:55.653368] [INFO ] [MAIN ] BAM: Loaded 52009 existing records. [2025-09-23T17:26:55.844384] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:55.845064] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-23T17:26:55.845453] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-23T17:26:55.847899] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-23T17:26:55.848029] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-23T17:26:55.991697] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:26:56.212398] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-23T17:26:56.260141] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:56.276552] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T17:26:57.002196] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-23T17:26:57.385765] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T17:26:57.597504] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T17:26:57.802203] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-23T17:26:58.602207] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-23T17:26:59.192204] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T17:26:59.402247] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-23T17:27:00.013070] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:27:00.202205] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-23T17:27:00.864942] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T17:27:01.002199] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-23T17:27:01.802239] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-23T17:27:02.602220] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-23T17:27:02.690099] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-23T17:27:03.208393] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-23T17:27:03.402220] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-23T17:27:03.748615] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-23T17:27:04.202200] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-23T17:27:04.776534] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T17:27:04.884069] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-23T17:27:05.002151] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-23T17:27:05.709555] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:27:05.802143] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-23T17:27:06.254597] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T17:27:06.602182] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-23T17:27:07.153263] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T17:27:07.305782] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T17:27:07.402217] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-23T17:27:08.202186] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-23T17:27:08.618176] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:27:09.002194] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-23T17:27:09.373946] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:27:09.802193] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-23T17:27:10.447109] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:27:10.602223] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-23T17:27:10.975984] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:27:10.982551] [INFO ] [REMOTE ] BAK: Full fetch complete (57062 records). [2025-09-23T17:27:10.982751] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-23T17:27:11.365544] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-23T17:27:11.365635] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-23T17:27:11.366279] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-23T17:27:11.366325] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-23T17:27:11.367602] [DEBUG] [LOCAL ] BAK: Trimmed 57062 records to 38785 (keeping 200 days of data) [2025-09-23T17:27:11.411244] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-23T17:27:11.588077] [DEBUG] [LOCAL ] BAK: Primary data saved (38785 records). [2025-09-23T17:27:11.588232] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-23T17:27:11.588316] [INFO ] [MAIN ] Update Progress: 209/2372 symbols completed. BAK took 26.0s. Estimated remaining: 4h 40m 52s. Rate: 7.7 symbols/min [2025-09-23T17:27:11.756200] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:11.808492] [DEBUG] [LOCAL ] BANC: Loaded 51261 existing records from primary storage. [2025-09-23T17:27:11.808676] [INFO ] [MAIN ] BANC: Loaded 51261 existing records. [2025-09-23T17:27:11.984120] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:11.984376] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-23T17:27:11.984431] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-23T17:27:11.986488] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-23T17:27:11.986551] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-23T17:27:12.223467] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-23T17:27:12.352433] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:12.539959] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-23T17:27:12.890706] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:27:13.002157] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-23T17:27:13.146600] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T17:27:13.802261] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-23T17:27:14.323937] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T17:27:14.447463] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T17:27:14.602192] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-23T17:27:15.402245] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-23T17:27:16.202198] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-23T17:27:16.849415] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T17:27:16.905480] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T17:27:17.002209] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-23T17:27:17.540070] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T17:27:17.539766] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T17:27:17.552433] [INFO ] [REMOTE ] BALL: Full fetch complete (75356 records). [2025-09-23T17:27:17.552741] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-23T17:27:17.808680] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-23T17:27:17.974874] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-23T17:27:17.975006] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-23T17:27:17.976087] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-23T17:27:17.976211] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-23T17:27:17.979002] [DEBUG] [LOCAL ] BALL: Trimmed 75356 records to 51815 (keeping 200 days of data) [2025-09-23T17:27:18.326679] [DEBUG] [LOCAL ] BALL: Primary data saved (51815 records). [2025-09-23T17:27:18.326929] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-23T17:27:18.327049] [INFO ] [MAIN ] Update Progress: 210/2372 symbols completed. BALL took 30.3s. Estimated remaining: 4h 40m 34s. Rate: 7.7 symbols/min [2025-09-23T17:27:18.515932] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:18.547029] [DEBUG] [LOCAL ] BAP: Loaded 26391 existing records from primary storage. [2025-09-23T17:27:18.547251] [INFO ] [MAIN ] BAP: Loaded 26391 existing records. [2025-09-23T17:27:18.608048] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-23T17:27:18.746395] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:18.746900] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-23T17:27:18.746953] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-23T17:27:18.748263] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-23T17:27:18.748327] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-23T17:27:19.135194] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:19.229285] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T17:27:19.231463] [INFO ] [REMOTE ] BALY: Full fetch complete (17420 records). [2025-09-23T17:27:19.231537] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-23T17:27:19.410735] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-23T17:27:19.423936] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T17:27:19.425558] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:27:19.425714] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:27:19.425795] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-23T17:27:19.425976] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-23T17:27:19.426049] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-23T17:27:19.426220] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-23T17:27:19.426464] [INFO ] [MAIN ] Update Progress: 211/2372 symbols completed. BALY took 27.6s. Estimated remaining: 4h 39m 18s. Rate: 7.7 symbols/min [2025-09-23T17:27:19.617384] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:27:19.646288] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:19.689123] [DEBUG] [LOCAL ] BARK: Loaded 38462 existing records from primary storage. [2025-09-23T17:27:19.689310] [INFO ] [MAIN ] BARK: Loaded 38462 existing records. [2025-09-23T17:27:19.870702] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:19.870941] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-23T17:27:19.870988] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-23T17:27:19.872407] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-23T17:27:19.872489] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-23T17:27:20.208388] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-23T17:27:20.239016] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:20.408517] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T17:27:21.002188] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-23T17:27:21.409462] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T17:27:21.802253] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-23T17:27:22.270796] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T17:27:22.602227] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-23T17:27:23.141239] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:27:23.402244] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-23T17:27:23.460286] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T17:27:24.202203] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-23T17:27:24.779118] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T17:27:25.002164] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-23T17:27:25.041971] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T17:27:25.802210] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-23T17:27:26.602172] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-23T17:27:26.760685] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T17:27:27.295870] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T17:27:27.402250] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-23T17:27:27.869202] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:27:28.202258] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-23T17:27:28.865278] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T17:27:29.002197] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-23T17:27:29.802181] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-23T17:27:29.854550] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T17:27:30.032775] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T17:27:30.602230] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-23T17:27:31.047555] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T17:27:31.402207] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-23T17:27:31.922384] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T17:27:31.931070] [INFO ] [REMOTE ] BAM: Full fetch complete (74001 records). [2025-09-23T17:27:31.931200] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-23T17:27:32.207481] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-23T17:27:32.337556] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-23T17:27:32.338004] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-23T17:27:32.339188] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-23T17:27:32.339264] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-23T17:27:32.341309] [DEBUG] [LOCAL ] BAM: Trimmed 74001 records to 52005 (keeping 200 days of data) [2025-09-23T17:27:32.598587] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T17:27:32.702571] [DEBUG] [LOCAL ] BAM: Primary data saved (52005 records). [2025-09-23T17:27:32.702744] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-23T17:27:32.702842] [INFO ] [MAIN ] Update Progress: 212/2372 symbols completed. BAM took 37.3s. Estimated remaining: 4h 40m 6s. Rate: 7.7 symbols/min [2025-09-23T17:27:32.876339] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:32.933581] [DEBUG] [LOCAL ] BAX: Loaded 53491 existing records from primary storage. [2025-09-23T17:27:32.933769] [INFO ] [MAIN ] BAX: Loaded 53491 existing records. [2025-09-23T17:27:33.009246] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-23T17:27:33.127980] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:33.128233] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-23T17:27:33.128283] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-23T17:27:33.130803] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-23T17:27:33.130870] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-23T17:27:33.529784] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:33.588324] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:27:33.802209] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-23T17:27:33.989311] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T17:27:34.602246] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-23T17:27:35.344569] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:27:35.402161] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-23T17:27:35.909323] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T17:27:36.202191] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-23T17:27:36.723795] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:27:37.002183] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-23T17:27:37.296718] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:27:37.802271] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-23T17:27:38.387605] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:27:38.602195] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-23T17:27:39.092337] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:27:39.402215] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-23T17:27:40.042854] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T17:27:40.202235] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-23T17:27:40.801165] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:27:40.813276] [INFO ] [REMOTE ] BANC: Full fetch complete (74061 records). [2025-09-23T17:27:40.813509] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-23T17:27:41.007393] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-23T17:27:41.410381] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-23T17:27:41.410498] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-23T17:27:41.411297] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-23T17:27:41.411388] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-23T17:27:41.430562] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:27:41.436341] [DEBUG] [LOCAL ] BANC: Trimmed 74061 records to 51262 (keeping 200 days of data) [2025-09-23T17:27:41.767120] [DEBUG] [LOCAL ] BANC: Primary data saved (51262 records). [2025-09-23T17:27:41.767314] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-23T17:27:41.767421] [INFO ] [MAIN ] Update Progress: 213/2372 symbols completed. BANC took 30.2s. Estimated remaining: 4h 40m 11s. Rate: 7.7 symbols/min [2025-09-23T17:27:41.807357] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-23T17:27:41.950761] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:42.002976] [DEBUG] [LOCAL ] BB: Loaded 52923 existing records from primary storage. [2025-09-23T17:27:42.003128] [INFO ] [MAIN ] BB: Loaded 52923 existing records. [2025-09-23T17:27:42.187109] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:42.187424] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-23T17:27:42.187473] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-23T17:27:42.189426] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-23T17:27:42.189489] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-23T17:27:42.544374] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:42.602324] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-23T17:27:42.778571] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T17:27:42.818088] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T17:27:43.402205] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-23T17:27:43.652163] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T17:27:44.168394] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T17:27:44.202162] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-23T17:27:45.002254] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-23T17:27:45.366244] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T17:27:45.802234] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-23T17:27:46.602200] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-23T17:27:46.747969] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T17:27:47.354124] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T17:27:47.402182] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-23T17:27:47.543527] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T17:27:48.202212] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-23T17:27:49.002168] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-23T17:27:49.047865] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T17:27:49.805852] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-23T17:27:49.811200] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T17:27:49.902797] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T17:27:49.908492] [INFO ] [REMOTE ] BAP: Full fetch complete (38056 records). [2025-09-23T17:27:49.908683] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-23T17:27:50.292941] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-23T17:27:50.293036] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-23T17:27:50.293520] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-23T17:27:50.293565] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-23T17:27:50.294539] [DEBUG] [LOCAL ] BAP: Trimmed 38056 records to 26398 (keeping 200 days of data) [2025-09-23T17:27:50.463897] [DEBUG] [LOCAL ] BAP: Primary data saved (26398 records). [2025-09-23T17:27:50.464059] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-23T17:27:50.464158] [INFO ] [MAIN ] Update Progress: 214/2372 symbols completed. BAP took 32.1s. Estimated remaining: 4h 40m 13s. Rate: 7.7 symbols/min [2025-09-23T17:27:50.607858] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-23T17:27:50.642695] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:50.696443] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-23T17:27:50.696631] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-09-23T17:27:50.890414] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:50.890745] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-23T17:27:50.890803] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-23T17:27:50.893774] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-23T17:27:50.893842] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-23T17:27:51.265036] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:51.335873] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:27:51.402215] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-23T17:27:52.212718] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-23T17:27:52.218237] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T17:27:52.887097] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:27:53.002219] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-23T17:27:53.802298] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-23T17:27:54.607741] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-23T17:27:54.629104] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-23T17:27:54.908806] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T17:27:54.917787] [INFO ] [REMOTE ] BAX: Full fetch complete (77436 records). [2025-09-23T17:27:54.917910] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-23T17:27:55.340570] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-23T17:27:55.341057] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-23T17:27:55.342365] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-23T17:27:55.352565] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-23T17:27:55.370922] [DEBUG] [LOCAL ] BAX: Trimmed 77436 records to 53493 (keeping 200 days of data) [2025-09-23T17:27:55.371993] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T17:27:55.439316] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-23T17:27:55.713265] [DEBUG] [LOCAL ] BAX: Primary data saved (53493 records). [2025-09-23T17:27:55.713409] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-23T17:27:55.713511] [INFO ] [MAIN ] Update Progress: 215/2372 symbols completed. BAX took 23.0s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-23T17:27:55.882557] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:55.924328] [DEBUG] [LOCAL ] BBAR: Loaded 41183 existing records from primary storage. [2025-09-23T17:27:55.924481] [INFO ] [MAIN ] BBAR: Loaded 41183 existing records. [2025-09-23T17:27:56.109845] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:56.110357] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-23T17:27:56.110464] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-23T17:27:56.112877] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-23T17:27:56.112949] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-23T17:27:56.210121] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-23T17:27:56.482943] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:56.504051] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T17:27:56.612446] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-23T17:27:57.002203] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-23T17:27:57.802200] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-23T17:27:58.096811] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T17:27:58.602148] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-23T17:27:59.025083] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T17:27:59.052375] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T17:27:59.058472] [INFO ] [REMOTE ] BARK: Full fetch complete (57167 records). [2025-09-23T17:27:59.058584] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-23T17:27:59.407270] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-23T17:27:59.452916] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-23T17:27:59.452998] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-23T17:27:59.453633] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-23T17:27:59.453732] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-23T17:27:59.454988] [DEBUG] [LOCAL ] BARK: Trimmed 57167 records to 38517 (keeping 200 days of data) [2025-09-23T17:27:59.684835] [DEBUG] [LOCAL ] BARK: Primary data saved (38517 records). [2025-09-23T17:27:59.685209] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-23T17:27:59.685580] [INFO ] [MAIN ] Update Progress: 216/2372 symbols completed. BARK took 40.3s. Estimated remaining: 4h 38m 54s. Rate: 7.7 symbols/min [2025-09-23T17:27:59.858864] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:59.914142] [DEBUG] [LOCAL ] BBD: Loaded 53179 existing records from primary storage. [2025-09-23T17:27:59.914353] [INFO ] [MAIN ] BBD: Loaded 53179 existing records. [2025-09-23T17:28:00.104102] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:00.104385] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-23T17:28:00.104460] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-23T17:28:00.106820] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-23T17:28:00.106884] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-23T17:28:00.209175] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-23T17:28:00.505253] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:00.931453] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T17:28:01.002161] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-23T17:28:01.199821] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-23T17:28:01.344162] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:28:01.802216] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-23T17:28:02.602195] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-23T17:28:02.696551] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T17:28:02.993218] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T17:28:03.402234] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-23T17:28:04.202270] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-23T17:28:05.002179] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-23T17:28:05.076266] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-23T17:28:05.335821] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T17:28:05.665560] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T17:28:05.802193] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-23T17:28:06.146626] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:28:06.602207] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-23T17:28:07.328544] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T17:28:07.402159] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-23T17:28:07.919512] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:28:08.202187] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-23T17:28:09.002148] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-23T17:28:09.059942] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T17:28:09.802347] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-23T17:28:09.940485] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T17:28:10.222623] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:28:10.602249] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-23T17:28:11.411439] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-23T17:28:11.418063] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T17:28:11.898373] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T17:28:12.202198] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-23T17:28:13.002247] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-23T17:28:13.433892] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T17:28:13.667428] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:28:13.802228] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-23T17:28:14.282999] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T17:28:14.602191] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-23T17:28:15.119150] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T17:28:15.402205] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-23T17:28:15.776748] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:28:16.202227] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-23T17:28:16.736723] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T17:28:16.745342] [INFO ] [REMOTE ] BB: Full fetch complete (76589 records). [2025-09-23T17:28:16.745560] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-23T17:28:16.747250] [FATAL] [VALIDATOR ] BB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:28:16.747429] [FATAL] [MAIN ] BB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:28:16.747509] [WARN ] [MAIN ] BB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:28:16.747634] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-23T17:28:16.747753] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-09-23T17:28:16.747838] [INFO ] [LOCAL ] BB: Starting deletion of derivative data. [2025-09-23T17:28:16.748409] [DEBUG] [LOCAL ] BB: Deleted derivative data file. [2025-09-23T17:28:16.748599] [INFO ] [MAIN ] Update Progress: 217/2372 symbols completed. BB took 35.0s. Estimated remaining: 4h 40m 18s. Rate: 7.7 symbols/min [2025-09-23T17:28:16.936316] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:16.982914] [DEBUG] [LOCAL ] BBDC: Loaded 33253 existing records from primary storage. [2025-09-23T17:28:16.983094] [INFO ] [MAIN ] BBDC: Loaded 33253 existing records. [2025-09-23T17:28:17.007349] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-23T17:28:17.168200] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:17.168439] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-23T17:28:17.168486] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-23T17:28:17.170951] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-23T17:28:17.171013] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-23T17:28:17.547597] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:17.603524] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:28:17.802180] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-23T17:28:18.366465] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T17:28:18.602198] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-23T17:28:18.914396] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T17:28:19.402203] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-23T17:28:20.041343] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:28:20.202169] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-23T17:28:20.562837] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T17:28:21.002258] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-23T17:28:21.430353] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:28:21.802258] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-23T17:28:22.209731] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:28:22.217564] [INFO ] [REMOTE ] BBAR: Full fetch complete (60508 records). [2025-09-23T17:28:22.217730] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-23T17:28:22.622691] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-23T17:28:22.645498] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-23T17:28:22.645594] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-23T17:28:22.646309] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-23T17:28:22.646377] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-23T17:28:22.647589] [DEBUG] [LOCAL ] BBAR: Trimmed 60508 records to 41265 (keeping 200 days of data) [2025-09-23T17:28:22.917300] [DEBUG] [LOCAL ] BBAR: Primary data saved (41265 records). [2025-09-23T17:28:22.917438] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-23T17:28:22.917549] [INFO ] [MAIN ] Update Progress: 218/2372 symbols completed. BBAR took 27.2s. Estimated remaining: 4h 39m 54s. Rate: 7.7 symbols/min [2025-09-23T17:28:23.097664] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:23.105469] [DEBUG] [LOCAL ] BBDO: Loaded 5039 existing records from primary storage. [2025-09-23T17:28:23.105620] [INFO ] [MAIN ] BBDO: Loaded 5039 existing records. [2025-09-23T17:28:23.295257] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:23.295852] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-23T17:28:23.295944] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-23T17:28:23.296699] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-23T17:28:23.296771] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-23T17:28:23.408463] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T17:28:23.406867] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-23T17:28:23.460161] [INFO ] [REMOTE ] BBD: Full fetch complete (77120 records). [2025-09-23T17:28:23.470609] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-23T17:28:23.937176] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:24.136845] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-23T17:28:24.136954] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-23T17:28:24.137797] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-23T17:28:24.137868] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-23T17:28:24.139484] [DEBUG] [LOCAL ] BBD: Trimmed 77120 records to 53181 (keeping 200 days of data) [2025-09-23T17:28:24.208060] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-23T17:28:24.399407] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T17:28:24.509828] [DEBUG] [LOCAL ] BBD: Primary data saved (53181 records). [2025-09-23T17:28:24.509978] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-23T17:28:24.510066] [INFO ] [MAIN ] Update Progress: 219/2372 symbols completed. BBD took 24.8s. Estimated remaining: 4h 38m 45s. Rate: 7.7 symbols/min [2025-09-23T17:28:24.682236] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:24.704066] [DEBUG] [LOCAL ] BBN: Loaded 18017 existing records from primary storage. [2025-09-23T17:28:24.704207] [INFO ] [MAIN ] BBN: Loaded 18017 existing records. [2025-09-23T17:28:24.890998] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:24.891268] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-23T17:28:24.891319] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-23T17:28:24.892455] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-23T17:28:24.892526] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-23T17:28:25.005956] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-23T17:28:25.101252] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T17:28:25.308593] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:25.350708] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-23T17:28:25.802252] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-23T17:28:25.968187] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T17:28:26.602220] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-23T17:28:26.740490] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:28:27.402230] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-23T17:28:28.008703] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T17:28:28.202212] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-23T17:28:28.793762] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T17:28:29.002176] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-23T17:28:29.197666] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-23T17:28:29.627985] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T17:28:29.802200] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-23T17:28:30.602235] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-23T17:28:30.887494] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:28:31.218196] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:28:31.402207] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-23T17:28:32.202256] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-23T17:28:32.387495] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T17:28:33.002274] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-23T17:28:33.286445] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T17:28:33.695710] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T17:28:33.802280] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-23T17:28:34.602222] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-23T17:28:35.102594] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T17:28:35.141229] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T17:28:35.402219] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-23T17:28:36.053547] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T17:28:36.202271] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-23T17:28:36.670760] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T17:28:37.002267] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-23T17:28:37.802222] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-23T17:28:38.128294] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T17:28:38.520402] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T17:28:38.602208] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-23T17:28:39.403462] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-23T17:28:39.405590] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T17:28:39.909396] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-23T17:28:40.202198] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-23T17:28:40.612319] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T17:28:41.002258] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-23T17:28:41.407120] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T17:28:41.802261] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-23T17:28:42.403210] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T17:28:42.602263] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-23T17:28:43.402212] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-23T17:28:43.752259] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T17:28:44.202268] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-23T17:28:44.672734] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T17:28:44.904579] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T17:28:45.002214] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-23T17:28:45.802237] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-23T17:28:46.602276] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-23T17:28:47.101267] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T17:28:47.272845] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T17:28:47.344046] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:28:47.348108] [INFO ] [REMOTE ] BBN: Full fetch complete (26965 records). [2025-09-23T17:28:47.348193] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-23T17:28:47.407438] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-23T17:28:47.757945] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-23T17:28:47.758048] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-23T17:28:47.758468] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-23T17:28:47.758529] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-23T17:28:47.759268] [DEBUG] [LOCAL ] BBN: Trimmed 26965 records to 18034 (keeping 200 days of data) [2025-09-23T17:28:47.870813] [DEBUG] [LOCAL ] BBN: Primary data saved (18034 records). [2025-09-23T17:28:47.870974] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-23T17:28:47.871064] [INFO ] [MAIN ] Update Progress: 220/2372 symbols completed. BBN took 23.4s. Estimated remaining: 4h 41m 10s. Rate: 7.7 symbols/min [2025-09-23T17:28:48.041078] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:48.041311] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-23T17:28:48.041365] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-23T17:28:48.041600] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-23T17:28:48.041690] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-23T17:28:48.041760] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-23T17:28:48.041795] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-23T17:28:48.215535] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-23T17:28:48.406451] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:49.002192] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-23T17:28:49.211995] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:49.212318] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-23T17:28:49.308799] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T17:28:49.314471] [INFO ] [REMOTE ] BBDC: Full fetch complete (48688 records). [2025-09-23T17:28:49.314604] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-23T17:28:49.315306] [FATAL] [VALIDATOR ] BBDC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:28:49.315437] [FATAL] [MAIN ] BBDC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:28:49.315509] [WARN ] [MAIN ] BBDC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:28:49.315580] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-23T17:28:49.315666] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-09-23T17:28:49.315728] [INFO ] [LOCAL ] BBDC: Starting deletion of derivative data. [2025-09-23T17:28:49.316164] [DEBUG] [LOCAL ] BBDC: Deleted derivative data file. [2025-09-23T17:28:49.316266] [INFO ] [MAIN ] Update Progress: 221/2372 symbols completed. BBDC took 32.6s. Estimated remaining: 4h 40m 0s. Rate: 7.7 symbols/min [2025-09-23T17:28:49.488688] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:49.494796] [DEBUG] [LOCAL ] BBU: Loaded 4091 existing records from primary storage. [2025-09-23T17:28:49.494892] [INFO ] [MAIN ] BBU: Loaded 4091 existing records. [2025-09-23T17:28:49.674780] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:49.675428] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-23T17:28:49.675489] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-23T17:28:49.676075] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-23T17:28:49.676140] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-23T17:28:49.804836] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-23T17:28:50.121991] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-23T17:28:50.143711] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-23T17:28:50.157257] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:50.157395] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-23T17:28:50.540095] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:28:50.561089] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-23T17:28:50.560971] [INFO ] [REMOTE ] BBDO: Full fetch complete (7747 records). [2025-09-23T17:28:50.561219] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-23T17:28:50.561435] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-23T17:28:50.594487] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-23T17:28:50.594597] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-23T17:28:50.606757] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-23T17:28:50.663562] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-23T17:28:50.862674] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:50.893098] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-23T17:28:51.061490] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-23T17:28:51.062193] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-23T17:28:51.062825] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-23T17:28:51.062903] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-23T17:28:51.064634] [DEBUG] [LOCAL ] BBDO: Trimmed 7747 records to 5032 (keeping 200 days of data) [2025-09-23T17:28:51.102828] [DEBUG] [LOCAL ] BBDO: Primary data saved (5032 records). [2025-09-23T17:28:51.103823] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-23T17:28:51.104479] [INFO ] [MAIN ] Update Progress: 222/2372 symbols completed. BBDO took 28.2s. Estimated remaining: 4h 38m 54s. Rate: 7.7 symbols/min [2025-09-23T17:28:51.368266] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:51.394562] [DEBUG] [LOCAL ] BBUC: Loaded 13152 existing records from primary storage. [2025-09-23T17:28:51.402361] [INFO ] [MAIN ] BBUC: Loaded 13152 existing records. [2025-09-23T17:28:51.402245] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-23T17:28:51.666984] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:51.668186] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-23T17:28:51.668569] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-23T17:28:51.670590] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-23T17:28:51.671240] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-23T17:28:51.866811] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-23T17:28:51.878483] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-23T17:28:51.932708] [INFO ] [MAIN ] Update Progress: 223/2372 symbols completed. BBAI took 1m 1s. Estimated remaining: 4h 37m 39s. Rate: 7.7 symbols/min [2025-09-23T17:28:52.203919] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-23T17:28:52.203775] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T17:28:52.197606] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:52.271138] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:52.323551] [DEBUG] [LOCAL ] BBVA: Loaded 49550 existing records from primary storage. [2025-09-23T17:28:52.323733] [INFO ] [MAIN ] BBVA: Loaded 49550 existing records. [2025-09-23T17:28:52.440194] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:52.467873] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-23T17:28:52.504794] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:52.505046] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-23T17:28:52.505095] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-23T17:28:52.508299] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-23T17:28:52.508363] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-23T17:28:52.866464] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:53.002201] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-23T17:28:53.536502] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T17:28:53.802248] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-23T17:28:54.305505] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T17:28:54.602191] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-23T17:28:55.062855] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:28:55.402207] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-23T17:28:55.980365] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T17:28:56.202204] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-23T17:28:56.417557] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:56.417988] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-23T17:28:57.002242] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-23T17:28:57.198153] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:57.198470] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-23T17:28:57.802204] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-23T17:28:58.602202] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-23T17:28:58.821296] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:58.821799] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-23T17:28:58.836332] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T17:28:59.402298] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-23T17:28:59.603463] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:59.603844] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-23T17:29:00.202188] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-23T17:29:00.447431] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:29:00.447805] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-23T17:29:01.002212] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-23T17:29:01.802258] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-23T17:29:02.339462] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:29:02.463354] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T17:29:02.602229] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-23T17:29:03.402193] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-23T17:29:03.578690] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T17:29:04.202229] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-23T17:29:04.736611] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:29:04.876518] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:29:05.002243] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-23T17:29:05.351123] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-23T17:29:05.802216] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-23T17:29:06.174291] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-23T17:29:06.602221] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-23T17:29:07.125982] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T17:29:07.402205] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-23T17:29:08.202211] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-23T17:29:08.298670] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T17:29:08.417304] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:29:08.417897] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-23T17:29:09.002233] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-23T17:29:09.569599] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T17:29:09.802212] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-23T17:29:10.602240] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-23T17:29:11.200461] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:29:11.402234] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-23T17:29:11.606993] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T17:29:11.614312] [INFO ] [REMOTE ] BBT: Full fetch complete (4861 records). [2025-09-23T17:29:11.614391] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-23T17:29:11.802027] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 16 unique days, need 200 days [2025-09-23T17:29:11.802343] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:29:11.802417] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:29:11.802471] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-23T17:29:11.802540] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-23T17:29:11.802576] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-23T17:29:11.802615] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-23T17:29:11.802713] [INFO ] [MAIN ] Update Progress: 224/2372 symbols completed. BBT took 23.9s. Estimated remaining: 4h 39m 28s. Rate: 7.7 symbols/min [2025-09-23T17:29:11.982090] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:12.013247] [DEBUG] [LOCAL ] BBW: Loaded 26617 existing records from primary storage. [2025-09-23T17:29:12.013478] [INFO ] [MAIN ] BBW: Loaded 26617 existing records. [2025-09-23T17:29:12.208557] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-23T17:29:12.210312] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:12.211797] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-23T17:29:12.211860] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-23T17:29:12.214258] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-23T17:29:12.214353] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-23T17:29:12.573439] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:12.830218] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T17:29:12.832797] [INFO ] [REMOTE ] BBUC: Full fetch complete (17326 records). [2025-09-23T17:29:12.832869] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-23T17:29:13.009694] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-23T17:29:13.207866] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-23T17:29:13.208017] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-23T17:29:13.208397] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-23T17:29:13.208441] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-23T17:29:13.209057] [DEBUG] [LOCAL ] BBUC: Trimmed 17326 records to 13148 (keeping 200 days of data) [2025-09-23T17:29:13.309374] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T17:29:13.330385] [DEBUG] [LOCAL ] BBUC: Primary data saved (13148 records). [2025-09-23T17:29:13.330503] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-23T17:29:13.330582] [INFO ] [MAIN ] Update Progress: 225/2372 symbols completed. BBUC took 22.2s. Estimated remaining: 4h 38m 20s. Rate: 7.7 symbols/min [2025-09-23T17:29:13.503669] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:13.507908] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T17:29:13.561077] [DEBUG] [LOCAL ] BBWI: Loaded 53576 existing records from primary storage. [2025-09-23T17:29:13.561223] [INFO ] [MAIN ] BBWI: Loaded 53576 existing records. [2025-09-23T17:29:13.738596] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:13.738846] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-23T17:29:13.738902] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-23T17:29:13.742045] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-23T17:29:13.742111] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-23T17:29:13.807290] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-23T17:29:14.099872] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:14.602185] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-23T17:29:15.336573] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:29:15.402195] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-23T17:29:16.081293] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T17:29:16.202165] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-23T17:29:16.571730] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T17:29:17.002202] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-23T17:29:17.544488] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:29:17.802210] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-23T17:29:17.954309] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T17:29:18.602196] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-23T17:29:19.143500] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T17:29:19.393668] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T17:29:19.402132] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-23T17:29:20.202190] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-23T17:29:20.296088] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T17:29:20.639287] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T17:29:21.002205] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-23T17:29:21.802191] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-23T17:29:22.183659] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:29:22.602283] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-23T17:29:22.698227] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T17:29:23.402216] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-23T17:29:24.202170] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-23T17:29:24.369282] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T17:29:24.769562] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T17:29:25.007323] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-23T17:29:25.028498] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T17:29:25.408124] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T17:29:25.802250] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-23T17:29:26.602192] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-23T17:29:27.113610] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T17:29:27.402199] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-23T17:29:27.911879] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:29:27.913803] [INFO ] [REMOTE ] BBU: Full fetch complete (6104 records). [2025-09-23T17:29:27.914002] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-23T17:29:28.209128] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-23T17:29:28.304804] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-23T17:29:28.320840] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-23T17:29:28.333783] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-23T17:29:28.334056] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-23T17:29:28.335859] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T17:29:28.346832] [DEBUG] [LOCAL ] BBU: Trimmed 6104 records to 4116 (keeping 200 days of data) [2025-09-23T17:29:28.373111] [DEBUG] [LOCAL ] BBU: Primary data saved (4116 records). [2025-09-23T17:29:28.373212] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-23T17:29:28.373295] [INFO ] [MAIN ] Update Progress: 226/2372 symbols completed. BBU took 39.1s. Estimated remaining: 4h 39m 21s. Rate: 7.7 symbols/min [2025-09-23T17:29:28.542693] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:28.599610] [DEBUG] [LOCAL ] BBY: Loaded 53482 existing records from primary storage. [2025-09-23T17:29:28.599805] [INFO ] [MAIN ] BBY: Loaded 53482 existing records. [2025-09-23T17:29:28.777769] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:28.778053] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-23T17:29:28.778102] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-23T17:29:28.779609] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-23T17:29:28.779700] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-23T17:29:29.010448] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-23T17:29:29.142178] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:29.560197] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T17:29:29.802216] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-23T17:29:29.961430] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T17:29:30.602193] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-23T17:29:31.402208] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-23T17:29:31.454336] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T17:29:31.677471] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T17:29:32.202248] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-23T17:29:33.002179] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-23T17:29:33.078403] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T17:29:33.086797] [INFO ] [REMOTE ] BBVA: Full fetch complete (71591 records). [2025-09-23T17:29:33.086959] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-23T17:29:33.488259] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-23T17:29:33.488353] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-23T17:29:33.489088] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-23T17:29:33.489151] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-23T17:29:33.490664] [DEBUG] [LOCAL ] BBVA: Trimmed 71591 records to 49510 (keeping 200 days of data) [2025-09-23T17:29:33.746537] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T17:29:33.813636] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-23T17:29:33.832057] [DEBUG] [LOCAL ] BBVA: Primary data saved (49510 records). [2025-09-23T17:29:33.832195] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-23T17:29:33.832282] [INFO ] [MAIN ] Update Progress: 227/2372 symbols completed. BBVA took 41.9s. Estimated remaining: 4h 38m 51s. Rate: 7.7 symbols/min [2025-09-23T17:29:34.004884] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:34.020617] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T17:29:34.066059] [DEBUG] [LOCAL ] BC: Loaded 44536 existing records from primary storage. [2025-09-23T17:29:34.066198] [INFO ] [MAIN ] BC: Loaded 44536 existing records. [2025-09-23T17:29:34.242492] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:34.242785] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-23T17:29:34.242838] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-23T17:29:34.246161] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-23T17:29:34.246224] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-23T17:29:34.599067] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:34.602157] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-23T17:29:35.338084] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T17:29:35.402150] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-23T17:29:35.993573] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:29:36.202204] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-23T17:29:36.856227] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T17:29:37.002192] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-23T17:29:37.407444] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:29:37.413321] [INFO ] [REMOTE ] BBW: Full fetch complete (39274 records). [2025-09-23T17:29:37.413404] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-23T17:29:37.787989] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-23T17:29:37.788082] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-23T17:29:37.788585] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-23T17:29:37.788633] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-23T17:29:37.789606] [DEBUG] [LOCAL ] BBW: Trimmed 39274 records to 26671 (keeping 200 days of data) [2025-09-23T17:29:37.842428] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-23T17:29:37.957274] [DEBUG] [LOCAL ] BBW: Primary data saved (26671 records). [2025-09-23T17:29:37.957418] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-23T17:29:37.957503] [INFO ] [MAIN ] Update Progress: 228/2372 symbols completed. BBW took 26.2s. Estimated remaining: 4h 38m 9s. Rate: 7.7 symbols/min [2025-09-23T17:29:38.129502] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:38.166584] [DEBUG] [LOCAL ] BCAT: Loaded 34509 existing records from primary storage. [2025-09-23T17:29:38.166748] [INFO ] [MAIN ] BCAT: Loaded 34509 existing records. [2025-09-23T17:29:38.354798] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:38.355319] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-23T17:29:38.355487] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-23T17:29:38.357339] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-23T17:29:38.357403] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-23T17:29:38.609408] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-23T17:29:38.708049] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T17:29:38.781095] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:39.334698] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T17:29:39.402157] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-23T17:29:40.202188] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-23T17:29:40.282012] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T17:29:40.974531] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:29:40.983783] [INFO ] [REMOTE ] BBWI: Full fetch complete (77413 records). [2025-09-23T17:29:40.983913] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-23T17:29:41.007288] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-23T17:29:41.386997] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-23T17:29:41.387302] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-23T17:29:41.388230] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-23T17:29:41.388339] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-23T17:29:41.407940] [DEBUG] [LOCAL ] BBWI: Trimmed 77413 records to 53580 (keeping 200 days of data) [2025-09-23T17:29:41.408733] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T17:29:41.749505] [DEBUG] [LOCAL ] BBWI: Primary data saved (53580 records). [2025-09-23T17:29:41.749680] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-23T17:29:41.749790] [INFO ] [MAIN ] Update Progress: 229/2372 symbols completed. BBWI took 28.4s. Estimated remaining: 4h 37m 24s. Rate: 7.7 symbols/min [2025-09-23T17:29:41.814429] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-23T17:29:41.927902] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:41.959229] [DEBUG] [LOCAL ] BCC: Loaded 28411 existing records from primary storage. [2025-09-23T17:29:41.959400] [INFO ] [MAIN ] BCC: Loaded 28411 existing records. [2025-09-23T17:29:42.146248] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:42.146552] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-23T17:29:42.146602] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-23T17:29:42.147375] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-23T17:29:42.147439] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-23T17:29:42.528808] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:42.602194] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-23T17:29:42.762231] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T17:29:42.807809] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T17:29:43.402215] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-23T17:29:43.509678] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T17:29:44.202254] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-23T17:29:44.878495] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T17:29:45.002264] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-23T17:29:45.731198] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T17:29:45.802208] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-23T17:29:46.023243] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:29:46.602225] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-23T17:29:46.711131] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T17:29:47.402260] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-23T17:29:47.621693] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T17:29:48.202221] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-23T17:29:48.341614] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T17:29:49.002261] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-23T17:29:49.512346] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:29:49.802276] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-23T17:29:50.310318] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T17:29:50.602208] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-23T17:29:51.388753] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:29:51.402165] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-23T17:29:51.572396] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T17:29:52.202259] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-23T17:29:52.958393] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:29:53.002190] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-23T17:29:53.139504] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:29:53.802233] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-23T17:29:54.077249] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T17:29:54.602225] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-23T17:29:55.402281] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-23T17:29:55.469791] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T17:29:55.531834] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T17:29:56.202248] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-23T17:29:56.982307] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:29:57.002165] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-23T17:29:57.641822] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:29:57.802192] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-23T17:29:58.601503] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T17:29:58.611370] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-23T17:29:59.249082] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T17:29:59.402262] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-23T17:29:59.976479] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:30:00.202206] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-23T17:30:00.851874] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T17:30:01.002161] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-23T17:30:01.387719] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T17:30:01.393719] [INFO ] [REMOTE ] BCAT: Full fetch complete (49892 records). [2025-09-23T17:30:01.393834] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-23T17:30:01.784717] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-23T17:30:01.784849] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-23T17:30:01.785798] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-23T17:30:01.785897] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-23T17:30:01.787501] [DEBUG] [LOCAL ] BCAT: Trimmed 49892 records to 34488 (keeping 200 days of data) [2025-09-23T17:30:01.859139] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-23T17:30:02.030012] [DEBUG] [LOCAL ] BCAT: Primary data saved (34488 records). [2025-09-23T17:30:02.030178] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-23T17:30:02.030272] [INFO ] [MAIN ] Update Progress: 230/2372 symbols completed. BCAT took 24.1s. Estimated remaining: 4h 39m 12s. Rate: 7.7 symbols/min [2025-09-23T17:30:02.220098] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:02.275238] [DEBUG] [LOCAL ] BCE: Loaded 52370 existing records from primary storage. [2025-09-23T17:30:02.275401] [INFO ] [MAIN ] BCE: Loaded 52370 existing records. [2025-09-23T17:30:02.459304] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:02.459637] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-23T17:30:02.459937] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-23T17:30:02.461411] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-23T17:30:02.461482] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-23T17:30:02.615321] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-23T17:30:02.869975] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:03.315840] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-23T17:30:03.402204] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-23T17:30:04.202244] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-23T17:30:05.865245] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (4.01 seconds). [2025-09-23T17:30:05.881214] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-23T17:30:05.900101] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-09-23T17:30:05.906856] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-23T17:30:06.420602] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-23T17:30:06.602164] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-23T17:30:07.454021] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (3.25 seconds). [2025-09-23T17:30:07.466956] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-23T17:30:07.652541] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T17:30:07.700028] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T17:30:08.126291] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-23T17:30:08.202171] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-23T17:30:08.896567] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T17:30:09.002228] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-23T17:30:09.737624] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T17:30:09.746813] [INFO ] [REMOTE ] BBY: Full fetch complete (77251 records). [2025-09-23T17:30:09.746956] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-23T17:30:09.811348] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-23T17:30:10.154604] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-23T17:30:10.154717] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-23T17:30:10.155540] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-23T17:30:10.155614] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-23T17:30:10.157184] [DEBUG] [LOCAL ] BBY: Trimmed 77251 records to 53480 (keeping 200 days of data) [2025-09-23T17:30:10.279132] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:30:10.292551] [INFO ] [REMOTE ] BC: Full fetch complete (63746 records). [2025-09-23T17:30:10.300692] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-23T17:30:10.607152] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-23T17:30:10.824308] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-23T17:30:10.824676] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-23T17:30:10.826225] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-23T17:30:10.826588] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-23T17:30:10.834895] [DEBUG] [LOCAL ] BC: Trimmed 63746 records to 44506 (keeping 200 days of data) [2025-09-23T17:30:10.982121] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:30:11.245903] [DEBUG] [LOCAL ] BC: Primary data saved (44506 records). [2025-09-23T17:30:11.246586] [INFO ] [MAIN ] BC: Full history saved. [2025-09-23T17:30:11.246752] [INFO ] [MAIN ] Update Progress: 231/2372 symbols completed. BC took 37.4s. Estimated remaining: 4h 39m 17s. Rate: 7.7 symbols/min [2025-09-23T17:30:11.387941] [DEBUG] [LOCAL ] BBY: Primary data saved (53480 records). [2025-09-23T17:30:11.409056] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-23T17:30:11.409252] [INFO ] [MAIN ] Update Progress: 232/2372 symbols completed. BBY took 43.0s. Estimated remaining: 4h 37m 59s. Rate: 7.7 symbols/min [2025-09-23T17:30:11.403694] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-23T17:30:11.535911] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:11.653484] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:11.676124] [DEBUG] [LOCAL ] BCH: Loaded 29570 existing records from primary storage. [2025-09-23T17:30:11.676364] [INFO ] [MAIN ] BCH: Loaded 29570 existing records. [2025-09-23T17:30:11.860024] [DEBUG] [LOCAL ] BCO: Loaded 26483 existing records from primary storage. [2025-09-23T17:30:11.881759] [INFO ] [MAIN ] BCO: Loaded 26483 existing records. [2025-09-23T17:30:11.881589] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:11.963445] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-23T17:30:11.982600] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-23T17:30:11.990815] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-23T17:30:12.001102] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-23T17:30:12.158447] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:12.170852] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-23T17:30:12.192448] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-23T17:30:12.236708] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-23T17:30:12.251708] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-23T17:30:12.755249] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:12.798110] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-23T17:30:12.967043] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-23T17:30:12.964996] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:12.974480] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:30:12.987425] [INFO ] [REMOTE ] BCC: Full fetch complete (40251 records). [2025-09-23T17:30:12.988003] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-23T17:30:13.011212] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-23T17:30:13.388980] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-23T17:30:13.389090] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-23T17:30:13.389753] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-23T17:30:13.389845] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-23T17:30:13.391039] [DEBUG] [LOCAL ] BCC: Trimmed 40251 records to 28407 (keeping 200 days of data) [2025-09-23T17:30:13.588936] [DEBUG] [LOCAL ] BCC: Primary data saved (28407 records). [2025-09-23T17:30:13.589077] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-23T17:30:13.589180] [INFO ] [MAIN ] Update Progress: 233/2372 symbols completed. BCC took 31.8s. Estimated remaining: 4h 36m 60s. Rate: 7.7 symbols/min [2025-09-23T17:30:13.782109] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:13.801202] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T17:30:13.807350] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-23T17:30:13.867259] [DEBUG] [LOCAL ] BCS: Loaded 53472 existing records from primary storage. [2025-09-23T17:30:13.867459] [INFO ] [MAIN ] BCS: Loaded 53472 existing records. [2025-09-23T17:30:14.052576] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:14.052942] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-23T17:30:14.053000] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-23T17:30:14.054193] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-23T17:30:14.054253] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-23T17:30:14.419675] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:14.533102] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T17:30:14.604305] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-23T17:30:14.607951] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:30:15.402258] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-23T17:30:15.689819] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:30:16.127931] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:30:16.202164] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-23T17:30:17.002197] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-23T17:30:17.128196] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T17:30:17.802208] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-23T17:30:18.449688] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:30:18.602193] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-23T17:30:18.673718] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T17:30:19.402232] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-23T17:30:20.202264] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-23T17:30:21.002280] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-23T17:30:21.109230] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-23T17:30:21.535916] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-23T17:30:21.802249] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-23T17:30:21.887588] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T17:30:22.497623] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-23T17:30:22.602158] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-23T17:30:23.258370] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T17:30:23.402142] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-23T17:30:23.727384] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T17:30:24.202201] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-23T17:30:24.631367] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T17:30:25.002213] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-23T17:30:25.684392] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T17:30:25.802228] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-23T17:30:26.039781] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T17:30:26.602215] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-23T17:30:27.412866] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-23T17:30:27.439032] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T17:30:27.474463] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T17:30:28.202198] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-23T17:30:29.002339] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-23T17:30:29.007987] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T17:30:29.219211] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T17:30:29.802199] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-23T17:30:30.602184] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-23T17:30:31.173565] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T17:30:31.233459] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T17:30:31.402203] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-23T17:30:31.576227] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T17:30:32.202206] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-23T17:30:32.829558] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:30:33.002202] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-23T17:30:33.078897] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T17:30:33.802201] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-23T17:30:34.518027] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T17:30:34.602196] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-23T17:30:34.978367] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T17:30:35.402196] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-23T17:30:36.200396] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T17:30:36.210896] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-23T17:30:36.573986] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:30:36.587753] [INFO ] [REMOTE ] BCE: Full fetch complete (76152 records). [2025-09-23T17:30:36.588009] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-23T17:30:37.011322] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-23T17:30:37.263682] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-23T17:30:37.263826] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-23T17:30:37.265225] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-23T17:30:37.265434] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-23T17:30:37.275391] [DEBUG] [LOCAL ] BCE: Trimmed 76152 records to 52350 (keeping 200 days of data) [2025-09-23T17:30:37.613042] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:30:37.756111] [DEBUG] [LOCAL ] BCE: Primary data saved (52350 records). [2025-09-23T17:30:37.756276] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-23T17:30:37.756422] [INFO ] [MAIN ] Update Progress: 234/2372 symbols completed. BCE took 35.7s. Estimated remaining: 4h 39m 22s. Rate: 7.7 symbols/min [2025-09-23T17:30:37.807340] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-23T17:30:37.941789] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:37.976724] [DEBUG] [LOCAL ] BCSF: Loaded 27741 existing records from primary storage. [2025-09-23T17:30:37.976867] [INFO ] [MAIN ] BCSF: Loaded 27741 existing records. [2025-09-23T17:30:38.159634] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:38.160047] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-23T17:30:38.160131] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-23T17:30:38.167534] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-23T17:30:38.174212] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-23T17:30:38.253169] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T17:30:38.297146] [INFO ] [REMOTE ] BCH: Full fetch complete (40904 records). [2025-09-23T17:30:38.307520] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-23T17:30:38.602245] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-23T17:30:38.772467] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:38.944056] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-23T17:30:38.944138] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-23T17:30:38.944670] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-23T17:30:38.944744] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-23T17:30:38.946160] [DEBUG] [LOCAL ] BCH: Trimmed 40904 records to 29617 (keeping 200 days of data) [2025-09-23T17:30:39.069516] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:30:39.151345] [DEBUG] [LOCAL ] BCH: Primary data saved (29617 records). [2025-09-23T17:30:39.151483] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-23T17:30:39.151588] [INFO ] [MAIN ] Update Progress: 235/2372 symbols completed. BCH took 27.9s. Estimated remaining: 4h 38m 15s. Rate: 7.7 symbols/min [2025-09-23T17:30:39.321867] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:39.344324] [DEBUG] [LOCAL ] BCX: Loaded 21767 existing records from primary storage. [2025-09-23T17:30:39.344444] [INFO ] [MAIN ] BCX: Loaded 21767 existing records. [2025-09-23T17:30:39.407357] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-23T17:30:39.522725] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:39.523278] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-23T17:30:39.523341] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-23T17:30:39.524096] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-23T17:30:39.524155] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-23T17:30:39.882754] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:40.111240] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T17:30:40.202251] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-23T17:30:40.288631] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T17:30:41.002196] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-23T17:30:41.754304] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:30:41.762723] [INFO ] [REMOTE ] BCS: Full fetch complete (76876 records). [2025-09-23T17:30:41.762862] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-23T17:30:41.763746] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:30:41.763837] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:30:41.763915] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:30:41.763990] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-23T17:30:41.764056] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-23T17:30:41.764104] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-09-23T17:30:41.764543] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-09-23T17:30:41.764677] [INFO ] [MAIN ] Update Progress: 236/2372 symbols completed. BCS took 28.2s. Estimated remaining: 4h 37m 20s. Rate: 7.7 symbols/min [2025-09-23T17:30:41.807390] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-23T17:30:41.947686] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:41.970912] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T17:30:41.994891] [DEBUG] [LOCAL ] BDC: Loaded 24906 existing records from primary storage. [2025-09-23T17:30:41.995046] [INFO ] [MAIN ] BDC: Loaded 24906 existing records. [2025-09-23T17:30:42.172450] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:42.172864] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-23T17:30:42.172919] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-23T17:30:42.173729] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-23T17:30:42.173790] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-23T17:30:42.561502] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:42.602234] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-23T17:30:43.015287] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:30:43.019751] [INFO ] [REMOTE ] BCO: Full fetch complete (36630 records). [2025-09-23T17:30:43.019851] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-23T17:30:43.022011] [FATAL] [VALIDATOR ] BCO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:30:43.022101] [FATAL] [MAIN ] BCO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:30:43.022144] [WARN ] [MAIN ] BCO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:30:43.022183] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-23T17:30:43.022242] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-09-23T17:30:43.022280] [INFO ] [LOCAL ] BCO: Starting deletion of derivative data. [2025-09-23T17:30:43.022730] [DEBUG] [LOCAL ] BCO: Deleted derivative data file. [2025-09-23T17:30:43.022829] [INFO ] [MAIN ] Update Progress: 237/2372 symbols completed. BCO took 31.6s. Estimated remaining: 4h 36m 14s. Rate: 7.7 symbols/min [2025-09-23T17:30:43.408111] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-23T17:30:43.410329] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T17:30:44.202220] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-23T17:30:44.306526] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T17:30:45.002209] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-23T17:30:45.432181] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:30:45.744134] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T17:30:45.802198] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-23T17:30:46.579202] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T17:30:46.602168] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-23T17:30:47.402252] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-23T17:30:47.582381] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T17:30:48.202213] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-23T17:30:48.668874] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:30:49.002229] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-23T17:30:49.346286] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:30:49.702335] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:30:49.802227] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-23T17:30:50.602211] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-23T17:30:50.913239] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T17:30:51.449249] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-23T17:30:51.466135] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T17:30:52.202259] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-23T17:30:52.400269] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:30:53.002175] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-23T17:30:53.466590] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T17:30:53.802198] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-23T17:30:53.907577] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T17:30:54.562294] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:30:54.602143] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-23T17:30:55.402222] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-23T17:30:55.778008] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:30:56.202195] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-23T17:30:56.318887] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T17:30:57.002195] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-23T17:30:57.375867] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T17:30:57.802223] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-23T17:30:57.949616] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T17:30:58.602225] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-23T17:30:58.704480] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T17:30:59.402223] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-23T17:30:59.537302] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:31:00.202210] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-23T17:31:00.725824] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T17:31:00.731448] [INFO ] [REMOTE ] BCSF: Full fetch complete (37905 records). [2025-09-23T17:31:00.731561] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-23T17:31:01.007429] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-23T17:31:01.047812] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T17:31:01.128827] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-23T17:31:01.128917] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-23T17:31:01.129381] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-23T17:31:01.129485] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-23T17:31:01.130444] [DEBUG] [LOCAL ] BCSF: Trimmed 37905 records to 27779 (keeping 200 days of data) [2025-09-23T17:31:01.301575] [DEBUG] [LOCAL ] BCSF: Primary data saved (27779 records). [2025-09-23T17:31:01.301736] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-23T17:31:01.301859] [INFO ] [MAIN ] Update Progress: 238/2372 symbols completed. BCSF took 23.5s. Estimated remaining: 4h 37m 40s. Rate: 7.7 symbols/min [2025-09-23T17:31:01.781089] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:31:01.802148] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-23T17:31:02.602241] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-23T17:31:02.892297] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:31:03.402167] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-23T17:31:03.594775] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:31:03.598433] [INFO ] [REMOTE ] BCX: Full fetch complete (33928 records). [2025-09-23T17:31:03.598613] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-23T17:31:03.979296] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-23T17:31:03.979381] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-23T17:31:03.979863] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-23T17:31:03.979930] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-23T17:31:03.980899] [DEBUG] [LOCAL ] BCX: Trimmed 33928 records to 21721 (keeping 200 days of data) [2025-09-23T17:31:04.109142] [DEBUG] [LOCAL ] BCX: Primary data saved (21721 records). [2025-09-23T17:31:04.109275] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-23T17:31:04.109359] [INFO ] [MAIN ] Update Progress: 239/2372 symbols completed. BCX took 25.0s. Estimated remaining: 4h 36m 48s. Rate: 7.7 symbols/min [2025-09-23T17:31:04.374549] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T17:31:04.380864] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-23T17:31:05.570987] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T17:31:05.576987] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-23T17:31:06.595097] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T17:31:06.599396] [INFO ] [REMOTE ] BDC: Full fetch complete (35719 records). [2025-09-23T17:31:06.599490] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-23T17:31:06.996184] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-23T17:31:06.996279] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-23T17:31:06.996802] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-23T17:31:06.996869] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-23T17:31:06.998164] [DEBUG] [LOCAL ] BDC: Trimmed 35719 records to 24877 (keeping 200 days of data) [2025-09-23T17:31:07.171537] [DEBUG] [LOCAL ] BDC: Primary data saved (24877 records). [2025-09-23T17:31:07.171705] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-23T17:31:07.171801] [INFO ] [MAIN ] Update Progress: 240/2372 symbols completed. BDC took 25.4s. Estimated remaining: 4h 35m 58s. Rate: 7.7 symbols/min [2025-09-23T17:31:07.700005] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:07.831732] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:07.867356] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:07.932394] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:08.007270] [DEBUG] [LOCAL ] BDJ: Loaded 28984 existing records from primary storage. [2025-09-23T17:31:08.007694] [INFO ] [MAIN ] BDJ: Loaded 28984 existing records. [2025-09-23T17:31:08.064493] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-23T17:31:08.096688] [INFO ] [MAIN ] BE: Loaded 53653 existing records. [2025-09-23T17:31:08.186703] [DEBUG] [LOCAL ] BDN: Loaded 47620 existing records from primary storage. [2025-09-23T17:31:08.305859] [INFO ] [MAIN ] BDN: Loaded 47620 existing records. [2025-09-23T17:31:08.300567] [DEBUG] [LOCAL ] BDX: Loaded 52497 existing records from primary storage. [2025-09-23T17:31:08.322666] [INFO ] [MAIN ] BDX: Loaded 52497 existing records. [2025-09-23T17:31:08.563753] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:08.615048] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:08.633877] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-23T17:31:08.634566] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-23T17:31:08.634106] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-23T17:31:08.662188] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-23T17:31:08.662137] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-23T17:31:08.667470] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-23T17:31:08.711101] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-23T17:31:08.756301] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-23T17:31:08.990164] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:09.056266] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:09.066481] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-23T17:31:09.060762] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-23T17:31:09.082277] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-23T17:31:09.082381] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-23T17:31:09.121856] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-23T17:31:09.127186] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-23T17:31:09.127305] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-23T17:31:09.132679] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-23T17:31:09.969370] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:10.065423] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:10.075897] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-23T17:31:10.062283] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-23T17:31:10.390900] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:10.424670] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-23T17:31:10.464960] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:10.465387] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-23T17:31:10.938293] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:31:10.944717] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-23T17:31:11.813736] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T17:31:11.833577] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-23T17:31:11.836612] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T17:31:11.848149] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-23T17:31:12.060701] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T17:31:12.072388] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-23T17:31:12.311525] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-23T17:31:12.322445] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-23T17:31:12.710520] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T17:31:13.002220] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-23T17:31:13.076124] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T17:31:13.460515] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:31:13.802238] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-23T17:31:14.065303] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T17:31:14.481537] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T17:31:14.602208] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-23T17:31:15.169396] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T17:31:15.402210] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-23T17:31:16.202177] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-23T17:31:16.527305] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T17:31:16.826268] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T17:31:17.002201] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-23T17:31:17.484129] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T17:31:17.802232] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-23T17:31:18.075004] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:31:18.602240] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-23T17:31:19.262662] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:31:19.402224] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-23T17:31:20.017054] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:31:20.202198] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-23T17:31:20.901002] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:31:21.002228] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-23T17:31:21.436209] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:31:21.802213] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-23T17:31:22.602186] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-23T17:31:23.183602] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-23T17:31:23.402198] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-23T17:31:23.430567] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T17:31:23.521877] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T17:31:24.202238] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-23T17:31:24.585533] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:31:25.002208] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-23T17:31:25.093991] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T17:31:25.802242] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-23T17:31:26.469336] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:31:26.602295] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-23T17:31:27.407361] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-23T17:31:27.419792] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T17:31:27.631915] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T17:31:28.202291] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-23T17:31:29.002282] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-23T17:31:29.503584] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T17:31:29.780021] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T17:31:29.803695] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-23T17:31:29.803560] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T17:31:30.602310] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-23T17:31:30.829412] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T17:31:30.837470] [INFO ] [REMOTE ] BDJ: Full fetch complete (42685 records). [2025-09-23T17:31:30.837677] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-23T17:31:31.270422] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-23T17:31:31.270515] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-23T17:31:31.271114] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-23T17:31:31.271180] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-23T17:31:31.272339] [DEBUG] [LOCAL ] BDJ: Trimmed 42685 records to 28925 (keeping 200 days of data) [2025-09-23T17:31:31.403227] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-23T17:31:31.458458] [DEBUG] [LOCAL ] BDJ: Primary data saved (28925 records). [2025-09-23T17:31:31.458609] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-23T17:31:31.458727] [INFO ] [MAIN ] Update Progress: 241/2372 symbols completed. BDJ took 24.3s. Estimated remaining: 4h 38m 16s. Rate: 7.7 symbols/min [2025-09-23T17:31:31.673717] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:31.673991] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-23T17:31:31.674046] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-23T17:31:31.674190] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-23T17:31:31.674232] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-23T17:31:31.674272] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-23T17:31:31.674303] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-23T17:31:32.068525] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:32.195442] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T17:31:32.205811] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-23T17:31:32.645769] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T17:31:32.873723] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:31:33.002206] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-23T17:31:33.802242] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-23T17:31:34.459416] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T17:31:34.468251] [INFO ] [REMOTE ] BDX: Full fetch complete (75917 records). [2025-09-23T17:31:34.468464] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-23T17:31:34.620153] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-23T17:31:34.885577] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-23T17:31:34.885698] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-23T17:31:34.886541] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-23T17:31:34.886593] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-23T17:31:34.888270] [DEBUG] [LOCAL ] BDX: Trimmed 75917 records to 52492 (keeping 200 days of data) [2025-09-23T17:31:35.227306] [DEBUG] [LOCAL ] BDX: Primary data saved (52492 records). [2025-09-23T17:31:35.227461] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-23T17:31:35.227552] [INFO ] [MAIN ] Update Progress: 242/2372 symbols completed. BDX took 28.1s. Estimated remaining: 4h 37m 33s. Rate: 7.7 symbols/min [2025-09-23T17:31:35.404554] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-23T17:31:35.410428] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:35.467373] [DEBUG] [LOCAL ] BEKE: Loaded 53261 existing records from primary storage. [2025-09-23T17:31:35.467523] [INFO ] [MAIN ] BEKE: Loaded 53261 existing records. [2025-09-23T17:31:35.650763] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:35.651067] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-23T17:31:35.651122] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-23T17:31:35.652394] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-23T17:31:35.652455] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-23T17:31:35.747796] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T17:31:36.030949] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:36.062289] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-23T17:31:36.202197] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-23T17:31:36.341684] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T17:31:37.002230] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-23T17:31:37.264279] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-23T17:31:37.590779] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:31:37.802203] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-23T17:31:38.602205] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-23T17:31:38.896264] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-23T17:31:39.402187] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-23T17:31:39.460415] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T17:31:40.202221] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-23T17:31:40.834846] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T17:31:40.843063] [INFO ] [REMOTE ] BDN: Full fetch complete (69271 records). [2025-09-23T17:31:40.843207] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-23T17:31:41.007319] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-23T17:31:41.266397] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-23T17:31:41.266476] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-23T17:31:41.267196] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-23T17:31:41.267260] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-23T17:31:41.268589] [DEBUG] [LOCAL ] BDN: Trimmed 69271 records to 47615 (keeping 200 days of data) [2025-09-23T17:31:41.541920] [DEBUG] [LOCAL ] BDN: Primary data saved (47615 records). [2025-09-23T17:31:41.542059] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-23T17:31:41.542145] [INFO ] [MAIN ] Update Progress: 243/2372 symbols completed. BDN took 34.4s. Estimated remaining: 4h 37m 12s. Rate: 7.7 symbols/min [2025-09-23T17:31:41.712181] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:41.765961] [DEBUG] [LOCAL ] BEN: Loaded 53067 existing records from primary storage. [2025-09-23T17:31:41.766218] [INFO ] [MAIN ] BEN: Loaded 53067 existing records. [2025-09-23T17:31:41.822416] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-23T17:31:41.956521] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:41.957012] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-23T17:31:41.957111] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-23T17:31:41.959940] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-23T17:31:41.960019] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-23T17:31:42.294562] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:31:42.363558] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-23T17:31:42.437347] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:42.527385] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T17:31:42.602190] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-23T17:31:43.402281] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-23T17:31:43.872394] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T17:31:44.202236] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-23T17:31:44.636443] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T17:31:45.002200] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-23T17:31:45.266898] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T17:31:45.377988] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T17:31:45.390498] [INFO ] [REMOTE ] BE: Full fetch complete (77272 records). [2025-09-23T17:31:45.390719] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-23T17:31:45.391669] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:31:45.391775] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:31:45.391818] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:31:45.391860] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-23T17:31:45.391960] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-23T17:31:45.392018] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-09-23T17:31:45.392557] [DEBUG] [LOCAL ] BE: Deleted derivative data file. [2025-09-23T17:31:45.392745] [INFO ] [MAIN ] Update Progress: 244/2372 symbols completed. BE took 38.2s. Estimated remaining: 4h 36m 29s. Rate: 7.7 symbols/min [2025-09-23T17:31:45.569061] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:45.611118] [DEBUG] [LOCAL ] BEP: Loaded 38703 existing records from primary storage. [2025-09-23T17:31:45.611291] [INFO ] [MAIN ] BEP: Loaded 38703 existing records. [2025-09-23T17:31:45.805457] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-23T17:31:45.805758] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:45.807089] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-23T17:31:45.807164] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-23T17:31:45.808363] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-23T17:31:45.808434] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-23T17:31:46.182319] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:46.602208] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-23T17:31:47.402365] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-23T17:31:47.853358] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T17:31:47.899014] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-23T17:31:48.202190] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-23T17:31:48.450307] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-23T17:31:48.767306] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T17:31:49.002199] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-23T17:31:49.802460] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-23T17:31:50.591487] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:31:50.603887] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-23T17:31:50.988669] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-23T17:31:50.989454] [INFO ] [REMOTE ] BEDU: Full fetch complete (1400 records). [2025-09-23T17:31:50.989521] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-23T17:31:51.178025] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-23T17:31:51.178255] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:31:51.178343] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:31:51.178439] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-23T17:31:51.178523] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-23T17:31:51.178561] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-23T17:31:51.178602] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-23T17:31:51.178691] [INFO ] [MAIN ] Update Progress: 245/2372 symbols completed. BEDU took 19.7s. Estimated remaining: 4h 36m 4s. Rate: 7.7 symbols/min [2025-09-23T17:31:51.353390] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:51.353709] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-09-23T17:31:51.353831] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-09-23T17:31:51.354191] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-23T17:31:51.354297] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-23T17:31:51.354369] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-09-23T17:31:51.354420] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-23T17:31:51.409680] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-23T17:31:51.742598] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:51.775004] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T17:31:52.202193] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-23T17:31:52.639996] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:31:53.002166] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-23T17:31:53.802199] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-23T17:31:54.043713] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T17:31:54.299027] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T17:31:54.602214] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-23T17:31:55.158526] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T17:31:55.402233] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-23T17:31:55.744956] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:31:56.202189] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-23T17:31:57.002192] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-23T17:31:57.133436] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T17:31:57.802222] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-23T17:31:58.031905] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T17:31:58.260462] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T17:31:58.602179] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-23T17:31:59.402177] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-23T17:31:59.467188] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T17:31:59.949205] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:32:00.202197] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-23T17:32:00.576418] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T17:32:01.002192] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-23T17:32:01.482587] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T17:32:01.802213] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-23T17:32:02.032624] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T17:32:02.602245] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-23T17:32:03.358044] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:32:03.402241] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-23T17:32:03.696467] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:32:04.202192] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-23T17:32:04.675743] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:32:05.002201] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-23T17:32:05.461959] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:32:05.802202] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-23T17:32:06.602209] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-23T17:32:06.741471] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:32:06.960832] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T17:32:07.402191] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-23T17:32:07.724678] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:32:08.202189] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-23T17:32:09.002248] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-23T17:32:09.065736] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T17:32:09.489293] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T17:32:09.802200] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-23T17:32:10.127154] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T17:32:10.133378] [INFO ] [REMOTE ] BEP: Full fetch complete (58350 records). [2025-09-23T17:32:10.133507] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-23T17:32:10.518589] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-23T17:32:10.518730] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-23T17:32:10.519386] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-23T17:32:10.519431] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-23T17:32:10.520887] [DEBUG] [LOCAL ] BEP: Trimmed 58350 records to 38607 (keeping 200 days of data) [2025-09-23T17:32:10.611017] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-23T17:32:10.763613] [DEBUG] [LOCAL ] BEP: Primary data saved (38607 records). [2025-09-23T17:32:10.763782] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-23T17:32:10.763883] [INFO ] [MAIN ] Update Progress: 246/2372 symbols completed. BEP took 25.4s. Estimated remaining: 4h 37m 38s. Rate: 7.7 symbols/min [2025-09-23T17:32:10.932530] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:10.940192] [DEBUG] [LOCAL ] BEPH: Loaded 5153 existing records from primary storage. [2025-09-23T17:32:10.940294] [INFO ] [MAIN ] BEPH: Loaded 5153 existing records. [2025-09-23T17:32:11.119841] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:11.120108] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-23T17:32:11.120155] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-23T17:32:11.120498] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-23T17:32:11.120558] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-23T17:32:11.404699] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-23T17:32:11.499935] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:11.519626] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T17:32:11.820284] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T17:32:12.202209] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-23T17:32:13.002238] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-23T17:32:13.142850] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T17:32:13.654087] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:32:13.663041] [INFO ] [REMOTE ] BEN: Full fetch complete (76885 records). [2025-09-23T17:32:13.663208] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-23T17:32:13.784733] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T17:32:13.802288] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-23T17:32:14.079792] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-23T17:32:14.079875] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-23T17:32:14.080617] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-23T17:32:14.080692] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-23T17:32:14.082168] [DEBUG] [LOCAL ] BEN: Trimmed 76885 records to 53062 (keeping 200 days of data) [2025-09-23T17:32:14.406234] [DEBUG] [LOCAL ] BEN: Primary data saved (53062 records). [2025-09-23T17:32:14.406365] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-23T17:32:14.406449] [INFO ] [MAIN ] Update Progress: 247/2372 symbols completed. BEN took 32.9s. Estimated remaining: 4h 36m 54s. Rate: 7.7 symbols/min [2025-09-23T17:32:14.579618] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:14.585186] [DEBUG] [LOCAL ] BEPI: Loaded 3415 existing records from primary storage. [2025-09-23T17:32:14.585326] [INFO ] [MAIN ] BEPI: Loaded 3415 existing records. [2025-09-23T17:32:14.607331] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-23T17:32:14.776155] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:14.776484] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-23T17:32:14.776544] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-23T17:32:14.776853] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-23T17:32:14.776914] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-23T17:32:15.137765] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:15.201046] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T17:32:15.402243] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-23T17:32:16.202231] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-23T17:32:16.360635] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T17:32:16.369987] [INFO ] [REMOTE ] BEKE: Full fetch complete (77204 records). [2025-09-23T17:32:16.370134] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-23T17:32:16.715902] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-23T17:32:16.828290] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-23T17:32:16.828399] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-23T17:32:16.829252] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-23T17:32:16.829447] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-23T17:32:16.831103] [DEBUG] [LOCAL ] BEKE: Trimmed 77204 records to 53257 (keeping 200 days of data) [2025-09-23T17:32:16.966930] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T17:32:17.044245] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-23T17:32:17.200081] [DEBUG] [LOCAL ] BEKE: Primary data saved (53257 records). [2025-09-23T17:32:17.200251] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-23T17:32:17.200364] [INFO ] [MAIN ] Update Progress: 248/2372 symbols completed. BEKE took 42.0s. Estimated remaining: 4h 36m 4s. Rate: 7.7 symbols/min [2025-09-23T17:32:17.370831] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:17.375700] [DEBUG] [LOCAL ] BEPJ: Loaded 3285 existing records from primary storage. [2025-09-23T17:32:17.375780] [INFO ] [MAIN ] BEPJ: Loaded 3285 existing records. [2025-09-23T17:32:17.551498] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:17.551829] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-23T17:32:17.551878] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-23T17:32:17.552166] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-23T17:32:17.552224] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-23T17:32:17.807410] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-23T17:32:17.907369] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:18.209057] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T17:32:18.335338] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T17:32:18.602213] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-23T17:32:19.402222] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-23T17:32:19.968750] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T17:32:20.202241] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-23T17:32:20.334351] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T17:32:20.685957] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:32:21.002435] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-23T17:32:21.329399] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T17:32:21.802278] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-23T17:32:22.379409] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T17:32:22.602251] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-23T17:32:23.402235] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-23T17:32:23.612768] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T17:32:23.621256] [INFO ] [REMOTE ] BEPC: Full fetch complete (68403 records). [2025-09-23T17:32:23.621400] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-23T17:32:23.822981] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T17:32:24.076727] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-23T17:32:24.076845] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-23T17:32:24.077679] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-23T17:32:24.077749] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-23T17:32:24.079289] [DEBUG] [LOCAL ] BEPC: Trimmed 68403 records to 46516 (keeping 200 days of data) [2025-09-23T17:32:24.202785] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-23T17:32:24.395526] [DEBUG] [LOCAL ] BEPC: Primary data saved (46516 records). [2025-09-23T17:32:24.395702] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-23T17:32:24.395800] [INFO ] [MAIN ] Update Progress: 249/2372 symbols completed. BEPC took 33.2s. Estimated remaining: 4h 35m 51s. Rate: 7.7 symbols/min [2025-09-23T17:32:24.567264] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:24.606338] [DEBUG] [LOCAL ] BFAM: Loaded 33000 existing records from primary storage. [2025-09-23T17:32:24.606537] [INFO ] [MAIN ] BFAM: Loaded 33000 existing records. [2025-09-23T17:32:24.788686] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:24.793874] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:32:24.796395] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-23T17:32:24.796461] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-23T17:32:24.797602] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-23T17:32:24.797701] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-23T17:32:25.012416] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-23T17:32:25.176987] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:25.709435] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T17:32:25.802244] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-23T17:32:26.602194] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-23T17:32:26.986849] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-23T17:32:27.237842] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T17:32:27.402198] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-23T17:32:27.811978] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T17:32:28.202194] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-23T17:32:28.595099] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-23T17:32:29.002241] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-23T17:32:29.802214] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-23T17:32:29.922008] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T17:32:30.171989] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T17:32:30.602199] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-23T17:32:31.275939] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T17:32:31.402257] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-23T17:32:31.739604] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T17:32:32.202213] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-23T17:32:32.701060] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T17:32:33.002203] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-23T17:32:33.383434] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T17:32:33.802214] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-23T17:32:34.152148] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T17:32:34.602249] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-23T17:32:34.939074] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-23T17:32:35.402230] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-23T17:32:36.202238] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-23T17:32:36.327243] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T17:32:36.709303] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T17:32:37.002239] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-23T17:32:37.477215] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T17:32:37.478240] [INFO ] [REMOTE ] BEPI: Full fetch complete (4954 records). [2025-09-23T17:32:37.478315] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-23T17:32:37.478731] [FATAL] [VALIDATOR ] BEPI: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:32:37.478817] [FATAL] [MAIN ] BEPI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:32:37.478861] [WARN ] [MAIN ] BEPI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:32:37.478931] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-23T17:32:37.479030] [DEBUG] [LOCAL ] BEPI: No primary data file found to delete. [2025-09-23T17:32:37.479104] [INFO ] [LOCAL ] BEPI: Starting deletion of derivative data. [2025-09-23T17:32:37.479753] [DEBUG] [LOCAL ] BEPI: Deleted derivative data file. [2025-09-23T17:32:37.479854] [INFO ] [MAIN ] Update Progress: 250/2372 symbols completed. BEPI took 23.1s. Estimated remaining: 4h 36m 28s. Rate: 7.7 symbols/min [2025-09-23T17:32:37.652434] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:37.691448] [DEBUG] [LOCAL ] BFH: Loaded 41822 existing records from primary storage. [2025-09-23T17:32:37.691586] [INFO ] [MAIN ] BFH: Loaded 41822 existing records. [2025-09-23T17:32:37.807348] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-23T17:32:37.885358] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:37.885636] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-23T17:32:37.885717] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-23T17:32:37.887035] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-23T17:32:37.887106] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-23T17:32:38.264908] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:38.602224] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-23T17:32:38.847003] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T17:32:39.402227] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-23T17:32:39.720162] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T17:32:39.867558] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T17:32:40.202239] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-23T17:32:40.505458] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-23T17:32:41.002248] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-23T17:32:41.802232] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-23T17:32:42.537868] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T17:32:42.602153] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-23T17:32:42.920131] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T17:32:43.402213] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-23T17:32:43.611619] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:32:44.202397] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-23T17:32:44.715383] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:32:44.717919] [INFO ] [REMOTE ] BEPH: Full fetch complete (7500 records). [2025-09-23T17:32:44.718052] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-23T17:32:44.868044] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T17:32:45.007336] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-23T17:32:45.151409] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-23T17:32:45.151492] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-23T17:32:45.151705] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-23T17:32:45.151766] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-23T17:32:45.152164] [DEBUG] [LOCAL ] BEPH: Trimmed 7500 records to 5122 (keeping 200 days of data) [2025-09-23T17:32:45.186542] [DEBUG] [LOCAL ] BEPH: Primary data saved (5122 records). [2025-09-23T17:32:45.186622] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-23T17:32:45.186735] [INFO ] [MAIN ] Update Progress: 251/2372 symbols completed. BEPH took 34.4s. Estimated remaining: 4h 36m 19s. Rate: 7.7 symbols/min [2025-09-23T17:32:45.353267] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:45.368854] [DEBUG] [LOCAL ] BFK: Loaded 14045 existing records from primary storage. [2025-09-23T17:32:45.368978] [INFO ] [MAIN ] BFK: Loaded 14045 existing records. [2025-09-23T17:32:45.481927] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:32:45.562096] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:45.562372] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-23T17:32:45.562478] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-23T17:32:45.563052] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-23T17:32:45.563122] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-23T17:32:45.807435] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-23T17:32:45.914572] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:46.216242] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T17:32:46.602209] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-23T17:32:47.402223] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-23T17:32:47.499602] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T17:32:48.202202] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-23T17:32:48.721570] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:32:48.869049] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T17:32:49.002197] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-23T17:32:49.717756] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T17:32:49.802213] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-23T17:32:50.358963] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:32:50.602214] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-23T17:32:51.402227] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-23T17:32:51.504704] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T17:32:52.202220] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-23T17:32:52.836119] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T17:32:53.002210] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-23T17:32:53.324037] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T17:32:53.580781] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T17:32:53.802207] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-23T17:32:54.602261] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-23T17:32:54.623168] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T17:32:55.402196] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-23T17:32:55.842552] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T17:32:56.037216] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-23T17:32:56.202233] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-23T17:32:57.002212] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-23T17:32:57.814404] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-23T17:32:57.835618] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:32:57.836694] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T17:32:57.845353] [INFO ] [REMOTE ] BFAM: Full fetch complete (47055 records). [2025-09-23T17:32:57.845745] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-23T17:32:58.255386] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-23T17:32:58.255546] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-23T17:32:58.256436] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-23T17:32:58.256533] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-23T17:32:58.262399] [DEBUG] [LOCAL ] BFAM: Trimmed 47055 records to 33044 (keeping 200 days of data) [2025-09-23T17:32:58.329874] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T17:32:58.357763] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4516 records). [2025-09-23T17:32:58.358300] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-23T17:32:58.611320] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-23T17:32:58.750923] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-23T17:32:58.751806] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-23T17:32:58.752242] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-23T17:32:58.752315] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-23T17:32:58.754147] [DEBUG] [LOCAL ] BEPJ: Trimmed 4516 records to 3259 (keeping 200 days of data) [2025-09-23T17:32:58.778469] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3259 records). [2025-09-23T17:32:58.778830] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-23T17:32:58.778977] [INFO ] [MAIN ] Update Progress: 252/2372 symbols completed. BEPJ took 41.6s. Estimated remaining: 4h 36m 60s. Rate: 7.7 symbols/min [2025-09-23T17:32:58.967497] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:59.051199] [DEBUG] [LOCAL ] BFAM: Primary data saved (33044 records). [2025-09-23T17:32:59.051344] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-23T17:32:59.051457] [INFO ] [MAIN ] Update Progress: 253/2372 symbols completed. BFAM took 34.7s. Estimated remaining: 4h 35m 49s. Rate: 7.7 symbols/min [2025-09-23T17:32:59.211885] [DEBUG] [LOCAL ] BFLY: Loaded 51829 existing records from primary storage. [2025-09-23T17:32:59.237288] [INFO ] [MAIN ] BFLY: Loaded 51829 existing records. [2025-09-23T17:32:59.263225] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:59.415086] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-23T17:32:59.459247] [DEBUG] [LOCAL ] BFS: Loaded 8996 existing records from primary storage. [2025-09-23T17:32:59.463409] [INFO ] [MAIN ] BFS: Loaded 8996 existing records. [2025-09-23T17:32:59.463538] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:59.496434] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-23T17:32:59.496603] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-23T17:32:59.547251] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-23T17:32:59.547352] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-23T17:32:59.779578] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:59.813978] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-23T17:32:59.817550] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-23T17:32:59.839524] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-23T17:32:59.866329] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-23T17:33:00.211495] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:00.250941] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-23T17:33:00.407609] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T17:33:00.497570] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:00.543597] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T17:33:01.002189] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-23T17:33:01.802204] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-23T17:33:01.875224] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T17:33:02.488774] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-23T17:33:02.602150] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-23T17:33:03.402192] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-23T17:33:04.202200] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-23T17:33:04.858082] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-09-23T17:33:05.002188] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-23T17:33:05.522423] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-09-23T17:33:05.709725] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-23T17:33:05.802264] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-23T17:33:06.171794] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:33:06.602182] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-23T17:33:06.747388] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-23T17:33:07.360178] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T17:33:07.402159] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-23T17:33:07.471947] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T17:33:07.475332] [INFO ] [REMOTE ] BFK: Full fetch complete (19239 records). [2025-09-23T17:33:07.475427] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-23T17:33:07.476245] [FATAL] [VALIDATOR ] BFK: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:33:07.476330] [FATAL] [MAIN ] BFK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:33:07.476388] [WARN ] [MAIN ] BFK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:33:07.476461] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-23T17:33:07.476559] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-09-23T17:33:07.476611] [INFO ] [LOCAL ] BFK: Starting deletion of derivative data. [2025-09-23T17:33:07.477113] [DEBUG] [LOCAL ] BFK: Deleted derivative data file. [2025-09-23T17:33:07.477281] [INFO ] [MAIN ] Update Progress: 254/2372 symbols completed. BFK took 22.3s. Estimated remaining: 4h 35m 46s. Rate: 7.7 symbols/min [2025-09-23T17:33:07.650716] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:07.667152] [DEBUG] [LOCAL ] BFZ: Loaded 11524 existing records from primary storage. [2025-09-23T17:33:07.667271] [INFO ] [MAIN ] BFZ: Loaded 11524 existing records. [2025-09-23T17:33:07.843706] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:07.843972] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-23T17:33:07.844019] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-23T17:33:07.844449] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-23T17:33:07.844508] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-23T17:33:08.201730] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:08.202055] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-23T17:33:08.722538] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T17:33:08.928749] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T17:33:09.002202] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-23T17:33:09.802219] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-23T17:33:10.463304] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T17:33:10.602185] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-23T17:33:11.290878] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T17:33:11.298296] [INFO ] [REMOTE ] BFH: Full fetch complete (59586 records). [2025-09-23T17:33:11.298451] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-23T17:33:11.408434] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-23T17:33:11.703637] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-23T17:33:11.703762] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-23T17:33:11.704473] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-23T17:33:11.704517] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-23T17:33:11.708279] [DEBUG] [LOCAL ] BFH: Trimmed 59586 records to 41829 (keeping 200 days of data) [2025-09-23T17:33:11.982537] [DEBUG] [LOCAL ] BFH: Primary data saved (41829 records). [2025-09-23T17:33:11.982748] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-23T17:33:11.982871] [INFO ] [MAIN ] Update Progress: 255/2372 symbols completed. BFH took 34.5s. Estimated remaining: 4h 35m 11s. Rate: 7.7 symbols/min [2025-09-23T17:33:12.158083] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:12.200123] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:33:12.210378] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-23T17:33:12.257491] [DEBUG] [LOCAL ] BG: Loaded 50380 existing records from primary storage. [2025-09-23T17:33:12.257684] [INFO ] [MAIN ] BG: Loaded 50380 existing records. [2025-09-23T17:33:12.442269] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:12.443079] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-23T17:33:12.449734] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-23T17:33:12.452627] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T17:33:12.454543] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-23T17:33:12.454932] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-23T17:33:12.818008] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:12.826530] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:33:13.002228] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-23T17:33:13.543496] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:33:13.802201] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-23T17:33:14.602222] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-23T17:33:15.356364] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T17:33:15.402145] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-23T17:33:16.202164] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-23T17:33:16.305060] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T17:33:16.687543] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:33:17.002227] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-23T17:33:17.081195] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T17:33:17.802265] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-23T17:33:18.298798] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T17:33:18.426720] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:33:18.602184] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-23T17:33:19.402201] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-23T17:33:19.983409] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:33:20.202189] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-23T17:33:20.750471] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T17:33:21.002240] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-23T17:33:21.802189] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-23T17:33:21.863240] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T17:33:21.934946] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T17:33:22.521394] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T17:33:22.602167] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-23T17:33:23.131886] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T17:33:23.402209] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-23T17:33:23.891431] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T17:33:24.202242] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-23T17:33:25.002256] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-23T17:33:25.646313] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:33:25.700805] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T17:33:25.802206] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-23T17:33:26.602202] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-23T17:33:27.047870] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T17:33:27.213367] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T17:33:27.222893] [INFO ] [REMOTE ] BFLY: Full fetch complete (75222 records). [2025-09-23T17:33:27.223032] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-23T17:33:27.402344] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-23T17:33:27.638783] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-23T17:33:27.638879] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-23T17:33:27.639723] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-23T17:33:27.639789] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-23T17:33:27.641342] [DEBUG] [LOCAL ] BFLY: Trimmed 75222 records to 51830 (keeping 200 days of data) [2025-09-23T17:33:27.942141] [DEBUG] [LOCAL ] BFLY: Primary data saved (51830 records). [2025-09-23T17:33:27.942276] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-23T17:33:27.942385] [INFO ] [MAIN ] Update Progress: 256/2372 symbols completed. BFLY took 29.2s. Estimated remaining: 4h 36m 10s. Rate: 7.7 symbols/min [2025-09-23T17:33:28.115741] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:28.135720] [DEBUG] [LOCAL ] BGB: Loaded 17407 existing records from primary storage. [2025-09-23T17:33:28.135836] [INFO ] [MAIN ] BGB: Loaded 17407 existing records. [2025-09-23T17:33:28.208708] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-23T17:33:28.315633] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:28.315911] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-23T17:33:28.315960] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-23T17:33:28.316763] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-23T17:33:28.316825] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-23T17:33:28.672661] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:28.967220] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T17:33:29.002201] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-23T17:33:29.620332] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-23T17:33:29.621168] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T17:33:29.802211] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-23T17:33:30.301340] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:33:30.602177] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-23T17:33:31.377787] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T17:33:31.380067] [INFO ] [REMOTE ] BFS: Full fetch complete (12473 records). [2025-09-23T17:33:31.380146] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-23T17:33:31.409929] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-23T17:33:31.765552] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-23T17:33:31.765635] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-23T17:33:31.765967] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-23T17:33:31.766026] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-23T17:33:31.766697] [DEBUG] [LOCAL ] BFS: Trimmed 12473 records to 9015 (keeping 200 days of data) [2025-09-23T17:33:31.829734] [DEBUG] [LOCAL ] BFS: Primary data saved (9015 records). [2025-09-23T17:33:31.829884] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-23T17:33:31.829978] [INFO ] [MAIN ] Update Progress: 257/2372 symbols completed. BFS took 32.8s. Estimated remaining: 4h 35m 30s. Rate: 7.7 symbols/min [2025-09-23T17:33:32.017921] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:32.039061] [DEBUG] [LOCAL ] BGH: Loaded 16404 existing records from primary storage. [2025-09-23T17:33:32.039199] [INFO ] [MAIN ] BGH: Loaded 16404 existing records. [2025-09-23T17:33:32.208168] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-23T17:33:32.213264] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T17:33:32.237669] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:32.238180] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-23T17:33:32.238229] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-23T17:33:32.238991] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-23T17:33:32.239053] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-23T17:33:32.662603] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:32.937571] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T17:33:33.002279] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-23T17:33:33.802214] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-23T17:33:33.872872] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T17:33:34.602187] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-23T17:33:35.402263] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-23T17:33:36.198984] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:33:36.203279] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-23T17:33:36.359690] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T17:33:36.362826] [INFO ] [REMOTE ] BFZ: Full fetch complete (17968 records). [2025-09-23T17:33:36.362899] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-23T17:33:36.764184] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-23T17:33:36.775035] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-23T17:33:36.775553] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-23T17:33:36.777746] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-23T17:33:36.775826] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-23T17:33:36.795050] [DEBUG] [LOCAL ] BFZ: Trimmed 17968 records to 11731 (keeping 200 days of data) [2025-09-23T17:33:36.796976] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:33:36.869567] [DEBUG] [LOCAL ] BFZ: Primary data saved (11731 records). [2025-09-23T17:33:36.869717] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-23T17:33:36.869810] [INFO ] [MAIN ] Update Progress: 258/2372 symbols completed. BFZ took 29.4s. Estimated remaining: 4h 34m 59s. Rate: 7.7 symbols/min [2025-09-23T17:33:37.010099] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-23T17:33:37.042011] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:37.057411] [DEBUG] [LOCAL ] BGR: Loaded 13484 existing records from primary storage. [2025-09-23T17:33:37.057524] [INFO ] [MAIN ] BGR: Loaded 13484 existing records. [2025-09-23T17:33:37.237542] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:37.237817] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-23T17:33:37.237867] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-23T17:33:37.238433] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-23T17:33:37.238502] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-23T17:33:37.590531] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:37.802148] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-23T17:33:38.466254] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T17:33:38.522149] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T17:33:38.602215] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-23T17:33:39.329892] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:33:39.402157] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-23T17:33:39.926001] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T17:33:40.202181] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-23T17:33:40.778042] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T17:33:41.002218] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-23T17:33:41.802210] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-23T17:33:42.081135] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T17:33:42.602235] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-23T17:33:43.128265] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:33:43.304859] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:33:43.402144] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-23T17:33:43.943160] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T17:33:44.202226] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-23T17:33:44.759987] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:33:45.002231] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-23T17:33:45.722765] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T17:33:45.802213] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-23T17:33:46.602189] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-23T17:33:46.824015] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T17:33:47.402245] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-23T17:33:48.202248] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-23T17:33:48.615078] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T17:33:49.002210] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-23T17:33:49.343017] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-23T17:33:49.802230] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-23T17:33:49.912829] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T17:33:49.917235] [INFO ] [REMOTE ] BGH: Full fetch complete (21735 records). [2025-09-23T17:33:49.917353] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-23T17:33:50.301156] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-23T17:33:50.301241] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-23T17:33:50.301577] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-23T17:33:50.301617] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-23T17:33:50.302272] [DEBUG] [LOCAL ] BGH: Trimmed 21735 records to 16373 (keeping 200 days of data) [2025-09-23T17:33:50.407002] [DEBUG] [LOCAL ] BGH: Primary data saved (16373 records). [2025-09-23T17:33:50.407159] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-23T17:33:50.407248] [INFO ] [MAIN ] Update Progress: 259/2372 symbols completed. BGH took 18.6s. Estimated remaining: 4h 35m 38s. Rate: 7.7 symbols/min [2025-09-23T17:33:50.597790] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:50.602192] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-23T17:33:50.636275] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T17:33:50.673685] [DEBUG] [LOCAL ] BGS: Loaded 50448 existing records from primary storage. [2025-09-23T17:33:50.673843] [INFO ] [MAIN ] BGS: Loaded 50448 existing records. [2025-09-23T17:33:50.850938] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:50.851217] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-23T17:33:50.851267] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-23T17:33:50.852593] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-23T17:33:50.852682] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-23T17:33:51.232215] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:51.306552] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T17:33:51.327314] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:33:51.402190] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-23T17:33:52.202204] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-23T17:33:53.002175] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-23T17:33:53.085149] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T17:33:53.533358] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T17:33:53.804049] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-23T17:33:53.806809] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T17:33:53.815684] [INFO ] [REMOTE ] BG: Full fetch complete (72774 records). [2025-09-23T17:33:53.815842] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-23T17:33:54.226289] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-23T17:33:54.226385] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-23T17:33:54.227147] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-23T17:33:54.227217] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-23T17:33:54.228810] [DEBUG] [LOCAL ] BG: Trimmed 72774 records to 50394 (keeping 200 days of data) [2025-09-23T17:33:54.497985] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T17:33:54.565203] [DEBUG] [LOCAL ] BG: Primary data saved (50394 records). [2025-09-23T17:33:54.565332] [INFO ] [MAIN ] BG: Full history saved. [2025-09-23T17:33:54.565406] [INFO ] [MAIN ] Update Progress: 260/2372 symbols completed. BG took 42.6s. Estimated remaining: 4h 35m 1s. Rate: 7.7 symbols/min [2025-09-23T17:33:54.607367] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-23T17:33:54.740802] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:54.749296] [DEBUG] [LOCAL ] BGSF: Loaded 6537 existing records from primary storage. [2025-09-23T17:33:54.749415] [INFO ] [MAIN ] BGSF: Loaded 6537 existing records. [2025-09-23T17:33:54.943306] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:54.943565] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-23T17:33:54.943614] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-23T17:33:54.944008] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-23T17:33:54.944072] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-23T17:33:55.327469] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:55.393149] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T17:33:55.402133] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-23T17:33:55.969079] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T17:33:56.202191] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-23T17:33:56.563561] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-23T17:33:57.002235] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-23T17:33:57.802202] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-23T17:33:58.138095] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T17:33:58.207980] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:33:58.602187] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-23T17:33:59.402236] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-23T17:33:59.704848] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-23T17:33:59.856791] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T17:34:00.202233] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-23T17:34:00.918250] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T17:34:01.002181] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-23T17:34:01.802195] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-23T17:34:02.396889] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:34:02.459637] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:34:02.602191] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-23T17:34:03.402203] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-23T17:34:03.953499] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:34:04.059514] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T17:34:04.202240] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-23T17:34:04.875523] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T17:34:05.002219] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-23T17:34:05.504463] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T17:34:05.802258] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-23T17:34:06.602231] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-23T17:34:06.924825] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-23T17:34:07.402237] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-23T17:34:07.828591] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-23T17:34:07.994998] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T17:34:08.202225] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-23T17:34:09.002213] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-23T17:34:09.195402] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:34:09.198148] [INFO ] [REMOTE ] BGR: Full fetch complete (20319 records). [2025-09-23T17:34:09.198222] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-23T17:34:09.562841] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-23T17:34:09.562939] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-23T17:34:09.563256] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-23T17:34:09.563300] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-23T17:34:09.563905] [DEBUG] [LOCAL ] BGR: Trimmed 20319 records to 13481 (keeping 200 days of data) [2025-09-23T17:34:09.655579] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T17:34:09.662076] [DEBUG] [LOCAL ] BGR: Primary data saved (13481 records). [2025-09-23T17:34:09.662280] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-23T17:34:09.662693] [INFO ] [MAIN ] Update Progress: 261/2372 symbols completed. BGR took 32.8s. Estimated remaining: 4h 35m 52s. Rate: 7.7 symbols/min [2025-09-23T17:34:09.807285] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-23T17:34:09.832528] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:09.849835] [DEBUG] [LOCAL ] BGT: Loaded 16570 existing records from primary storage. [2025-09-23T17:34:09.849972] [INFO ] [MAIN ] BGT: Loaded 16570 existing records. [2025-09-23T17:34:10.031316] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:10.031547] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-23T17:34:10.031594] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-23T17:34:10.032289] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-23T17:34:10.032350] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-23T17:34:10.389123] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:10.548404] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:34:10.551444] [INFO ] [REMOTE ] BGB: Full fetch complete (26853 records). [2025-09-23T17:34:10.551524] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-23T17:34:10.607309] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-23T17:34:10.926385] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-23T17:34:10.926463] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-23T17:34:10.926871] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-23T17:34:10.926934] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-23T17:34:10.927588] [DEBUG] [LOCAL ] BGB: Trimmed 26853 records to 17392 (keeping 200 days of data) [2025-09-23T17:34:11.038312] [DEBUG] [LOCAL ] BGB: Primary data saved (17392 records). [2025-09-23T17:34:11.038455] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-23T17:34:11.038598] [INFO ] [MAIN ] Update Progress: 262/2372 symbols completed. BGB took 43.1s. Estimated remaining: 4h 34m 52s. Rate: 7.7 symbols/min [2025-09-23T17:34:11.207490] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:11.219722] [DEBUG] [LOCAL ] BGX: Loaded 10738 existing records from primary storage. [2025-09-23T17:34:11.219821] [INFO ] [MAIN ] BGX: Loaded 10738 existing records. [2025-09-23T17:34:11.401633] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:11.401899] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-23T17:34:11.401946] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-23T17:34:11.402166] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-23T17:34:11.402986] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-23T17:34:11.403049] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-23T17:34:11.763306] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:11.814805] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T17:34:11.966583] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T17:34:12.202165] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-23T17:34:12.867105] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T17:34:13.002176] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-23T17:34:13.750173] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T17:34:13.802193] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-23T17:34:14.382307] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T17:34:14.602218] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-23T17:34:15.215463] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T17:34:15.402191] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-23T17:34:16.178308] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T17:34:16.202175] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-23T17:34:17.002187] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-23T17:34:17.148709] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:34:17.602136] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T17:34:17.802229] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-23T17:34:18.536529] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:34:18.602152] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-23T17:34:19.279156] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T17:34:19.402243] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-23T17:34:20.054386] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T17:34:20.202230] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-23T17:34:21.002224] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-23T17:34:21.232108] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T17:34:21.802206] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-23T17:34:22.375143] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:34:22.602206] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-23T17:34:22.870786] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T17:34:23.056529] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T17:34:23.402235] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-23T17:34:24.202235] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-23T17:34:24.233270] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T17:34:24.236690] [INFO ] [REMOTE ] BGT: Full fetch complete (24371 records). [2025-09-23T17:34:24.236854] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-23T17:34:24.616786] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-23T17:34:24.620093] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-23T17:34:24.621154] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:34:24.621006] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-23T17:34:24.622701] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-23T17:34:24.623638] [DEBUG] [LOCAL ] BGT: Trimmed 24371 records to 16586 (keeping 200 days of data) [2025-09-23T17:34:24.725827] [DEBUG] [LOCAL ] BGT: Primary data saved (16586 records). [2025-09-23T17:34:24.725965] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-23T17:34:24.726052] [INFO ] [MAIN ] Update Progress: 263/2372 symbols completed. BGT took 15.1s. Estimated remaining: 4h 35m 31s. Rate: 7.7 symbols/min [2025-09-23T17:34:24.897123] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:24.919977] [DEBUG] [LOCAL ] BGY: Loaded 22663 existing records from primary storage. [2025-09-23T17:34:24.920119] [INFO ] [MAIN ] BGY: Loaded 22663 existing records. [2025-09-23T17:34:25.007295] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-23T17:34:25.120309] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:25.120552] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-23T17:34:25.120601] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-23T17:34:25.121668] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-23T17:34:25.121736] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-23T17:34:25.710549] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:34:25.752021] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:25.802275] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-23T17:34:26.602184] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-23T17:34:27.106439] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T17:34:27.144393] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:34:27.402200] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-23T17:34:27.912672] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-23T17:34:28.202216] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-23T17:34:28.737099] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T17:34:29.002257] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-23T17:34:29.490591] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T17:34:29.802209] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-23T17:34:30.602219] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-23T17:34:30.768104] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:34:30.771395] [INFO ] [REMOTE ] BGSF: Full fetch complete (8067 records). [2025-09-23T17:34:30.771466] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-23T17:34:31.136003] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-23T17:34:31.136086] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-23T17:34:31.136369] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-23T17:34:31.136432] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-23T17:34:31.136911] [DEBUG] [LOCAL ] BGSF: Trimmed 8067 records to 6707 (keeping 200 days of data) [2025-09-23T17:34:31.178326] [DEBUG] [LOCAL ] BGSF: Primary data saved (6707 records). [2025-09-23T17:34:31.178482] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-23T17:34:31.178585] [INFO ] [MAIN ] Update Progress: 264/2372 symbols completed. BGSF took 36.6s. Estimated remaining: 4h 35m 12s. Rate: 7.7 symbols/min [2025-09-23T17:34:31.362938] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:31.380495] [DEBUG] [LOCAL ] BH: Loaded 15425 existing records from primary storage. [2025-09-23T17:34:31.380675] [INFO ] [MAIN ] BH: Loaded 15425 existing records. [2025-09-23T17:34:31.414528] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-23T17:34:31.576171] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:31.576421] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-23T17:34:31.576473] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-23T17:34:31.577156] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-23T17:34:31.577222] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-23T17:34:31.946136] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:31.970673] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T17:34:31.979299] [INFO ] [REMOTE ] BGS: Full fetch complete (72497 records). [2025-09-23T17:34:31.979439] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-23T17:34:32.207510] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-23T17:34:32.398813] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-23T17:34:32.398943] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-23T17:34:32.400362] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-23T17:34:32.401094] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T17:34:32.405999] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-23T17:34:32.408463] [DEBUG] [LOCAL ] BGS: Trimmed 72497 records to 50467 (keeping 200 days of data) [2025-09-23T17:34:32.739412] [DEBUG] [LOCAL ] BGS: Primary data saved (50467 records). [2025-09-23T17:34:32.739599] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-23T17:34:32.739748] [INFO ] [MAIN ] Update Progress: 265/2372 symbols completed. BGS took 42.3s. Estimated remaining: 4h 34m 15s. Rate: 7.7 symbols/min [2025-09-23T17:34:32.939469] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:32.986562] [DEBUG] [LOCAL ] BHC: Loaded 46804 existing records from primary storage. [2025-09-23T17:34:32.986804] [INFO ] [MAIN ] BHC: Loaded 46804 existing records. [2025-09-23T17:34:33.012009] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-23T17:34:33.172243] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:34:33.222725] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:33.223028] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-23T17:34:33.223088] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-23T17:34:33.224705] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-23T17:34:33.224786] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-23T17:34:33.628243] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:33.799770] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:34:33.804579] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-23T17:34:34.373801] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T17:34:34.602214] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-23T17:34:35.402217] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-23T17:34:35.940711] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T17:34:36.202233] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-23T17:34:36.363984] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T17:34:36.806848] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T17:34:36.810573] [INFO ] [REMOTE ] BGX: Full fetch complete (15734 records). [2025-09-23T17:34:36.810697] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-23T17:34:37.007332] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-23T17:34:37.201127] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-23T17:34:37.201209] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-23T17:34:37.201553] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-23T17:34:37.201593] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-23T17:34:37.202249] [DEBUG] [LOCAL ] BGX: Trimmed 15734 records to 10682 (keeping 200 days of data) [2025-09-23T17:34:37.274458] [DEBUG] [LOCAL ] BGX: Primary data saved (10682 records). [2025-09-23T17:34:37.274680] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-23T17:34:37.274841] [INFO ] [MAIN ] Update Progress: 266/2372 symbols completed. BGX took 26.2s. Estimated remaining: 4h 33m 41s. Rate: 7.7 symbols/min [2025-09-23T17:34:37.459680] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:37.484015] [DEBUG] [LOCAL ] BHE: Loaded 25215 existing records from primary storage. [2025-09-23T17:34:37.484160] [INFO ] [MAIN ] BHE: Loaded 25215 existing records. [2025-09-23T17:34:37.668725] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:37.669004] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-23T17:34:37.669051] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-23T17:34:37.669864] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-23T17:34:37.669925] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-23T17:34:37.812801] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-23T17:34:38.030922] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:38.263034] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:34:38.360113] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T17:34:38.602249] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-23T17:34:39.402187] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-23T17:34:39.430972] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T17:34:40.094689] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T17:34:40.202244] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-23T17:34:40.661856] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:34:41.002225] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-23T17:34:41.802219] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-23T17:34:42.131602] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T17:34:42.602192] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-23T17:34:42.655412] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T17:34:43.402211] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-23T17:34:43.931040] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T17:34:44.202220] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-23T17:34:44.510583] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:34:45.002195] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-23T17:34:45.078407] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T17:34:45.802217] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-23T17:34:46.108989] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T17:34:46.507405] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T17:34:46.602182] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-23T17:34:47.402218] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-23T17:34:47.485246] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T17:34:48.065742] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T17:34:48.202156] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-23T17:34:48.999594] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T17:34:49.005036] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-23T17:34:49.802250] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-23T17:34:50.183231] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T17:34:50.602232] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-23T17:34:50.623576] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T17:34:51.402234] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-23T17:34:51.819666] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:34:52.202184] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-23T17:34:52.540325] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T17:34:53.002201] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-23T17:34:53.802191] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-23T17:34:54.290219] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:34:54.511895] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:34:54.602162] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-23T17:34:55.402223] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-23T17:34:55.441473] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:34:56.202226] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-23T17:34:56.342030] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T17:34:56.619284] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (4.42 seconds). [2025-09-23T17:34:56.954544] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T17:34:57.002208] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-23T17:34:57.802235] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-23T17:34:58.139934] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T17:34:58.144505] [INFO ] [REMOTE ] BHE: Full fetch complete (36559 records). [2025-09-23T17:34:58.144622] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-23T17:34:58.525530] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-23T17:34:58.525629] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-23T17:34:58.526169] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-23T17:34:58.526226] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-23T17:34:58.527290] [DEBUG] [LOCAL ] BHE: Trimmed 36559 records to 25147 (keeping 200 days of data) [2025-09-23T17:34:58.614462] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-23T17:34:58.681810] [DEBUG] [LOCAL ] BHE: Primary data saved (25147 records). [2025-09-23T17:34:58.681952] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-23T17:34:58.682041] [INFO ] [MAIN ] Update Progress: 267/2372 symbols completed. BHE took 21.4s. Estimated remaining: 4h 35m 20s. Rate: 7.6 symbols/min [2025-09-23T17:34:58.857016] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:58.879021] [DEBUG] [LOCAL ] BHK: Loaded 22486 existing records from primary storage. [2025-09-23T17:34:58.879147] [INFO ] [MAIN ] BHK: Loaded 22486 existing records. [2025-09-23T17:34:59.059516] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:59.059996] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-23T17:34:59.060080] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-23T17:34:59.061029] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-23T17:34:59.061095] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-23T17:34:59.242546] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T17:34:59.403685] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-23T17:34:59.463788] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:59.474564] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T17:35:00.202200] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-23T17:35:00.751053] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T17:35:00.935432] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:35:01.002191] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-23T17:35:01.786674] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T17:35:01.802191] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-23T17:35:02.602175] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-23T17:35:02.651268] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T17:35:02.655896] [INFO ] [REMOTE ] BGY: Full fetch complete (33366 records). [2025-09-23T17:35:02.656040] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-23T17:35:03.056345] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-23T17:35:03.056450] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-23T17:35:03.056935] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-23T17:35:03.056998] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-23T17:35:03.057986] [DEBUG] [LOCAL ] BGY: Trimmed 33366 records to 22573 (keeping 200 days of data) [2025-09-23T17:35:03.194039] [DEBUG] [LOCAL ] BGY: Primary data saved (22573 records). [2025-09-23T17:35:03.194178] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-23T17:35:03.194295] [INFO ] [MAIN ] Update Progress: 268/2372 symbols completed. BGY took 38.5s. Estimated remaining: 4h 34m 46s. Rate: 7.7 symbols/min [2025-09-23T17:35:03.375769] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:03.413892] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-23T17:35:03.438432] [DEBUG] [LOCAL ] BHP: Loaded 53385 existing records from primary storage. [2025-09-23T17:35:03.438675] [INFO ] [MAIN ] BHP: Loaded 53385 existing records. [2025-09-23T17:35:03.529106] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T17:35:03.663520] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:03.663886] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-23T17:35:03.663962] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-23T17:35:03.665497] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-23T17:35:03.665560] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-23T17:35:04.019056] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:04.202176] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-23T17:35:05.002217] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-23T17:35:05.084548] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:35:05.729325] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T17:35:05.802238] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-23T17:35:06.044147] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T17:35:06.602254] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-23T17:35:06.662147] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T17:35:07.402231] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-23T17:35:08.202195] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-23T17:35:08.281575] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T17:35:08.673335] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T17:35:08.681376] [INFO ] [REMOTE ] BHC: Full fetch complete (66675 records). [2025-09-23T17:35:08.681554] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-23T17:35:09.010095] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-23T17:35:09.125453] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-23T17:35:09.125601] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-23T17:35:09.126376] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-23T17:35:09.126498] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-23T17:35:09.142157] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T17:35:09.148264] [DEBUG] [LOCAL ] BHC: Trimmed 66675 records to 46783 (keeping 200 days of data) [2025-09-23T17:35:09.430816] [DEBUG] [LOCAL ] BHC: Primary data saved (46783 records). [2025-09-23T17:35:09.430959] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-23T17:35:09.431100] [INFO ] [MAIN ] Update Progress: 269/2372 symbols completed. BHC took 36.7s. Estimated remaining: 4h 34m 26s. Rate: 7.7 symbols/min [2025-09-23T17:35:09.602146] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:09.634960] [DEBUG] [LOCAL ] BHR: Loaded 21413 existing records from primary storage. [2025-09-23T17:35:09.635349] [INFO ] [MAIN ] BHR: Loaded 21413 existing records. [2025-09-23T17:35:09.807709] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-23T17:35:09.834356] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:09.834619] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-23T17:35:09.834703] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-23T17:35:09.835437] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-23T17:35:09.835503] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-23T17:35:10.201079] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:10.518128] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T17:35:10.551502] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T17:35:10.602159] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-23T17:35:11.402210] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-23T17:35:12.070889] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-23T17:35:12.207396] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-23T17:35:12.226789] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T17:35:13.002202] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-23T17:35:13.159556] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T17:35:13.802194] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-23T17:35:14.602172] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-23T17:35:14.679749] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T17:35:15.043112] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T17:35:15.402199] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-23T17:35:15.918252] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:35:16.202205] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-23T17:35:16.806177] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T17:35:16.869889] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T17:35:17.002209] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-23T17:35:17.809033] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-23T17:35:17.837805] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:35:18.602230] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-23T17:35:18.956487] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T17:35:19.345838] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T17:35:19.402195] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-23T17:35:20.202209] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-23T17:35:20.437156] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T17:35:20.441758] [INFO ] [REMOTE ] BHK: Full fetch complete (29619 records). [2025-09-23T17:35:20.441881] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-23T17:35:20.813802] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-23T17:35:20.813893] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-23T17:35:20.814487] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-23T17:35:20.814590] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-23T17:35:20.815439] [DEBUG] [LOCAL ] BHK: Trimmed 29619 records to 22454 (keeping 200 days of data) [2025-09-23T17:35:20.969408] [DEBUG] [LOCAL ] BHK: Primary data saved (22454 records). [2025-09-23T17:35:20.969591] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-23T17:35:20.969915] [INFO ] [MAIN ] Update Progress: 270/2372 symbols completed. BHK took 22.3s. Estimated remaining: 4h 34m 47s. Rate: 7.6 symbols/min [2025-09-23T17:35:21.007389] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-23T17:35:21.146005] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:21.146181] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-23T17:35:21.146218] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-23T17:35:21.146356] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-23T17:35:21.146398] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-23T17:35:21.146438] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-23T17:35:21.146487] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-23T17:35:21.499728] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:21.792396] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T17:35:21.807015] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-23T17:35:22.197094] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-23T17:35:22.242029] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T17:35:22.602206] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-23T17:35:23.402209] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-23T17:35:23.641270] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T17:35:23.650080] [INFO ] [REMOTE ] BH: Full fetch complete (19260 records). [2025-09-23T17:35:23.650482] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-23T17:35:23.783718] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T17:35:24.045489] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-23T17:35:24.045574] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-23T17:35:24.045983] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-23T17:35:24.046048] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-23T17:35:24.047543] [DEBUG] [LOCAL ] BH: Trimmed 19260 records to 15557 (keeping 200 days of data) [2025-09-23T17:35:24.155071] [DEBUG] [LOCAL ] BH: Primary data saved (15557 records). [2025-09-23T17:35:24.155247] [INFO ] [MAIN ] BH: Full history saved. [2025-09-23T17:35:24.155366] [INFO ] [MAIN ] Update Progress: 271/2372 symbols completed. BH took 53.0s. Estimated remaining: 4h 34m 3s. Rate: 7.7 symbols/min [2025-09-23T17:35:24.208462] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-23T17:35:24.327912] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:24.388140] [DEBUG] [LOCAL ] BHVN: Loaded 49586 existing records from primary storage. [2025-09-23T17:35:24.388291] [INFO ] [MAIN ] BHVN: Loaded 49586 existing records. [2025-09-23T17:35:24.565095] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:24.565464] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-23T17:35:24.565528] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-23T17:35:24.566879] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-23T17:35:24.566941] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-23T17:35:24.925943] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:25.002201] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-23T17:35:25.762144] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T17:35:25.802154] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-23T17:35:26.290556] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T17:35:26.602183] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-23T17:35:27.402958] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-23T17:35:27.409166] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T17:35:27.695961] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-23T17:35:27.802723] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T17:35:28.202215] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-23T17:35:28.996465] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T17:35:29.002139] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-23T17:35:29.720141] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T17:35:29.802191] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-23T17:35:30.394139] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:35:30.602201] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-23T17:35:31.402207] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-23T17:35:31.801378] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T17:35:32.202179] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-23T17:35:32.264245] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T17:35:32.645838] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-23T17:35:33.002196] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-23T17:35:33.302533] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-23T17:35:33.802215] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-23T17:35:34.076266] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-23T17:35:34.602179] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-23T17:35:35.402190] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-23T17:35:35.924521] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:35:36.202201] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-23T17:35:36.932142] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T17:35:36.942007] [INFO ] [REMOTE ] BHP: Full fetch complete (77237 records). [2025-09-23T17:35:36.942181] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-23T17:35:37.013118] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-23T17:35:37.372797] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-23T17:35:37.368874] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T17:35:37.373015] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-23T17:35:37.375395] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-23T17:35:37.375536] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-23T17:35:37.377636] [DEBUG] [LOCAL ] BHP: Trimmed 77237 records to 53376 (keeping 200 days of data) [2025-09-23T17:35:37.521863] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:35:37.764527] [DEBUG] [LOCAL ] BHP: Primary data saved (53376 records). [2025-09-23T17:35:37.764720] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-23T17:35:37.764856] [INFO ] [MAIN ] Update Progress: 272/2372 symbols completed. BHP took 34.6s. Estimated remaining: 4h 34m 40s. Rate: 7.6 symbols/min [2025-09-23T17:35:37.807322] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-23T17:35:37.964874] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:37.965052] [DEBUG] [LOCAL ] BILL: No existing data file found in primary storage. [2025-09-23T17:35:37.965128] [WARN ] [MAIN ] BILL: No existing data found, performing full refresh instead. [2025-09-23T17:35:37.965290] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-23T17:35:37.965334] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-23T17:35:37.965377] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-09-23T17:35:37.965410] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-23T17:35:38.258343] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T17:35:38.347389] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:38.602186] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-23T17:35:39.402192] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-23T17:35:39.806548] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T17:35:39.807524] [INFO ] [REMOTE ] BHV: Full fetch complete (1379 records). [2025-09-23T17:35:39.807593] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-23T17:35:39.995149] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-23T17:35:39.995398] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:35:39.995522] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:35:39.995585] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-23T17:35:39.995685] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-23T17:35:39.995753] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-23T17:35:39.995834] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-23T17:35:39.995927] [INFO ] [MAIN ] Update Progress: 273/2372 symbols completed. BHV took 19.0s. Estimated remaining: 4h 33m 49s. Rate: 7.7 symbols/min [2025-09-23T17:35:40.184538] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:40.208103] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-23T17:35:40.220133] [DEBUG] [LOCAL ] BIO: Loaded 25556 existing records from primary storage. [2025-09-23T17:35:40.220541] [INFO ] [MAIN ] BIO: Loaded 25556 existing records. [2025-09-23T17:35:40.409509] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:35:40.452238] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:40.453203] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-23T17:35:40.453255] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-23T17:35:40.454113] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-23T17:35:40.454175] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-23T17:35:40.820301] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:41.002192] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-23T17:35:41.614297] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:35:41.802199] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-23T17:35:41.852480] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T17:35:42.602342] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-23T17:35:43.149750] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T17:35:43.402197] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-23T17:35:43.469598] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T17:35:44.202197] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-23T17:35:44.351907] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:35:44.357488] [INFO ] [REMOTE ] BHR: Full fetch complete (30553 records). [2025-09-23T17:35:44.357603] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-23T17:35:44.743875] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-23T17:35:44.743951] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-23T17:35:44.744374] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-23T17:35:44.744442] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-23T17:35:44.746620] [DEBUG] [LOCAL ] BHR: Trimmed 30553 records to 21431 (keeping 200 days of data) [2025-09-23T17:35:44.880042] [DEBUG] [LOCAL ] BHR: Primary data saved (21431 records). [2025-09-23T17:35:44.880169] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-23T17:35:44.880249] [INFO ] [MAIN ] Update Progress: 274/2372 symbols completed. BHR took 35.4s. Estimated remaining: 4h 33m 19s. Rate: 7.7 symbols/min [2025-09-23T17:35:45.007321] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-23T17:35:45.079190] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:45.121426] [DEBUG] [LOCAL ] BIP: Loaded 39680 existing records from primary storage. [2025-09-23T17:35:45.121608] [INFO ] [MAIN ] BIP: Loaded 39680 existing records. [2025-09-23T17:35:45.324383] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:45.324985] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-23T17:35:45.325209] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-23T17:35:45.326451] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-23T17:35:45.326516] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-23T17:35:45.687625] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:45.726087] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T17:35:45.802156] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-23T17:35:46.376381] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:35:46.602191] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-23T17:35:46.906530] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:35:47.402214] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-23T17:35:48.202185] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-23T17:35:48.414589] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T17:35:48.959503] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T17:35:49.002165] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-23T17:35:49.272921] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T17:35:49.802197] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-23T17:35:50.309485] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T17:35:50.602221] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-23T17:35:51.327388] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:35:51.402158] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-23T17:35:51.464538] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T17:35:52.202201] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-23T17:35:52.757365] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T17:35:52.765708] [INFO ] [REMOTE ] BHVN: Full fetch complete (69345 records). [2025-09-23T17:35:52.765821] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-23T17:35:53.012176] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-23T17:35:53.211993] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-23T17:35:53.212091] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-23T17:35:53.212916] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-23T17:35:53.212980] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-23T17:35:53.214367] [DEBUG] [LOCAL ] BHVN: Trimmed 69345 records to 49614 (keeping 200 days of data) [2025-09-23T17:35:53.506173] [DEBUG] [LOCAL ] BHVN: Primary data saved (49614 records). [2025-09-23T17:35:53.506322] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-23T17:35:53.506411] [INFO ] [MAIN ] Update Progress: 275/2372 symbols completed. BHVN took 29.4s. Estimated remaining: 4h 33m 17s. Rate: 7.7 symbols/min [2025-09-23T17:35:53.675191] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:53.714076] [DEBUG] [LOCAL ] BIPC: Loaded 41711 existing records from primary storage. [2025-09-23T17:35:53.714225] [INFO ] [MAIN ] BIPC: Loaded 41711 existing records. [2025-09-23T17:35:53.804051] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-23T17:35:53.900479] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:53.900831] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-23T17:35:53.900885] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-23T17:35:53.901786] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-23T17:35:53.901846] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-23T17:35:54.231160] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T17:35:54.327867] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:54.377735] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:35:54.602206] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-23T17:35:54.799326] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T17:35:55.402224] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-23T17:35:55.695175] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:35:56.202204] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-23T17:35:56.824611] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:35:57.002189] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-23T17:35:57.479557] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:35:57.802195] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-23T17:35:57.959148] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T17:35:58.602198] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-23T17:35:58.865153] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:35:59.402189] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-23T17:35:59.718293] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T17:36:00.202196] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-23T17:36:01.002184] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-23T17:36:01.178364] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T17:36:01.802201] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-23T17:36:01.898982] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T17:36:02.602217] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-23T17:36:03.219760] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-23T17:36:03.402177] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-23T17:36:04.202218] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-23T17:36:04.883319] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-09-23T17:36:05.002189] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-23T17:36:05.095445] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T17:36:05.507903] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-23T17:36:05.684999] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T17:36:05.802197] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-23T17:36:06.437422] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:36:06.602161] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-23T17:36:07.357513] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T17:36:07.402203] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-23T17:36:08.110416] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T17:36:08.122940] [INFO ] [REMOTE ] BILL: Full fetch complete (75583 records). [2025-09-23T17:36:08.123144] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-23T17:36:08.207314] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-23T17:36:08.537560] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-23T17:36:08.537778] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-23T17:36:08.538583] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-23T17:36:08.538813] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-23T17:36:08.542753] [DEBUG] [LOCAL ] BILL: Trimmed 75583 records to 52325 (keeping 200 days of data) [2025-09-23T17:36:08.655054] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:36:08.891919] [DEBUG] [LOCAL ] BILL: Primary data saved (52325 records). [2025-09-23T17:36:08.892065] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-23T17:36:08.892149] [INFO ] [MAIN ] Update Progress: 276/2372 symbols completed. BILL took 31.1s. Estimated remaining: 4h 34m 7s. Rate: 7.6 symbols/min [2025-09-23T17:36:09.007341] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-23T17:36:09.075755] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:09.080743] [DEBUG] [LOCAL ] BIPH: Loaded 2646 existing records from primary storage. [2025-09-23T17:36:09.080866] [INFO ] [MAIN ] BIPH: Loaded 2646 existing records. [2025-09-23T17:36:09.268694] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:09.268959] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-23T17:36:09.269009] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-23T17:36:09.269327] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-23T17:36:09.269387] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-23T17:36:09.640113] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:09.660951] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T17:36:09.802150] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-23T17:36:09.931529] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T17:36:10.602283] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-23T17:36:10.884352] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T17:36:11.402273] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-23T17:36:11.761832] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T17:36:11.968792] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T17:36:12.202221] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-23T17:36:13.002265] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-23T17:36:13.404098] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T17:36:13.428571] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T17:36:13.802187] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-23T17:36:14.297941] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T17:36:14.602256] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-23T17:36:15.402242] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-23T17:36:16.202207] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-23T17:36:16.236814] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T17:36:16.417897] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T17:36:16.424514] [INFO ] [REMOTE ] BIPC: Full fetch complete (59473 records). [2025-09-23T17:36:16.424629] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-23T17:36:16.824098] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-23T17:36:16.824184] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-23T17:36:16.824860] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-23T17:36:16.824950] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-23T17:36:16.826321] [DEBUG] [LOCAL ] BIPC: Trimmed 59473 records to 41701 (keeping 200 days of data) [2025-09-23T17:36:17.014170] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-23T17:36:17.109754] [DEBUG] [LOCAL ] BIPC: Primary data saved (41701 records). [2025-09-23T17:36:17.109908] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-23T17:36:17.110032] [INFO ] [MAIN ] Update Progress: 277/2372 symbols completed. BIPC took 23.6s. Estimated remaining: 4h 34m 1s. Rate: 7.6 symbols/min [2025-09-23T17:36:17.390914] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T17:36:17.802207] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-23T17:36:18.261058] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T17:36:18.602218] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-23T17:36:18.711442] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T17:36:19.029855] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T17:36:19.402238] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-23T17:36:20.202221] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-23T17:36:20.686143] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T17:36:21.006000] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-23T17:36:21.007203] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T17:36:21.011772] [INFO ] [REMOTE ] BIO: Full fetch complete (34253 records). [2025-09-23T17:36:21.011873] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-23T17:36:21.396920] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-23T17:36:21.397006] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-23T17:36:21.397475] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-23T17:36:21.397516] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-23T17:36:21.398413] [DEBUG] [LOCAL ] BIO: Trimmed 34253 records to 25445 (keeping 200 days of data) [2025-09-23T17:36:21.543143] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T17:36:21.563964] [DEBUG] [LOCAL ] BIO: Primary data saved (25445 records). [2025-09-23T17:36:21.564126] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-23T17:36:21.564233] [INFO ] [MAIN ] Update Progress: 278/2372 symbols completed. BIO took 41.6s. Estimated remaining: 4h 33m 28s. Rate: 7.7 symbols/min [2025-09-23T17:36:21.802236] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-23T17:36:22.602206] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-23T17:36:23.027165] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:36:23.402256] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-23T17:36:23.707862] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T17:36:23.758175] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:36:23.765099] [INFO ] [REMOTE ] BIP: Full fetch complete (56365 records). [2025-09-23T17:36:23.765264] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-23T17:36:24.166325] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-23T17:36:24.166414] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-23T17:36:24.167053] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-23T17:36:24.167117] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-23T17:36:24.168367] [DEBUG] [LOCAL ] BIP: Trimmed 56365 records to 39590 (keeping 200 days of data) [2025-09-23T17:36:24.227949] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-23T17:36:24.417701] [DEBUG] [LOCAL ] BIP: Primary data saved (39590 records). [2025-09-23T17:36:24.417858] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-23T17:36:24.417976] [INFO ] [MAIN ] Update Progress: 279/2372 symbols completed. BIP took 39.5s. Estimated remaining: 4h 32m 43s. Rate: 7.7 symbols/min [2025-09-23T17:36:24.593529] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T17:36:25.002236] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-23T17:36:25.474984] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T17:36:25.476045] [INFO ] [REMOTE ] BIPH: Full fetch complete (4318 records). [2025-09-23T17:36:25.476133] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-23T17:36:25.839606] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-23T17:36:25.839708] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-23T17:36:25.839847] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-23T17:36:25.839885] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-23T17:36:25.840237] [DEBUG] [LOCAL ] BIPH: Trimmed 4318 records to 2635 (keeping 200 days of data) [2025-09-23T17:36:25.856289] [DEBUG] [LOCAL ] BIPH: Primary data saved (2635 records). [2025-09-23T17:36:25.856362] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-23T17:36:25.856444] [INFO ] [MAIN ] Update Progress: 280/2372 symbols completed. BIPH took 17.0s. Estimated remaining: 4h 31m 47s. Rate: 7.7 symbols/min [2025-09-23T17:36:26.421405] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:26.583516] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:26.523803] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:26.585105] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:26.592446] [DEBUG] [LOCAL ] BIPI: Loaded 3354 existing records from primary storage. [2025-09-23T17:36:26.592800] [INFO ] [MAIN ] BIPI: Loaded 3354 existing records. [2025-09-23T17:36:26.618360] [DEBUG] [LOCAL ] BIPJ: Loaded 2937 existing records from primary storage. [2025-09-23T17:36:26.650322] [INFO ] [MAIN ] BIPJ: Loaded 2937 existing records. [2025-09-23T17:36:26.794468] [DEBUG] [LOCAL ] BIT: Loaded 22270 existing records from primary storage. [2025-09-23T17:36:26.864033] [INFO ] [MAIN ] BIT: Loaded 22270 existing records. [2025-09-23T17:36:26.962791] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:27.117567] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:27.134169] [DEBUG] [LOCAL ] BIRK: Loaded 50882 existing records from primary storage. [2025-09-23T17:36:27.064258] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-23T17:36:27.154254] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-23T17:36:27.154012] [INFO ] [MAIN ] BIRK: Loaded 50882 existing records. [2025-09-23T17:36:27.154451] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-23T17:36:27.171880] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-23T17:36:27.223132] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-23T17:36:27.223062] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-23T17:36:27.262666] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-23T17:36:27.275585] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-23T17:36:27.417147] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:27.544141] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-23T17:36:27.572991] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-23T17:36:27.678540] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:27.689042] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-23T17:36:27.718868] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-23T17:36:27.760811] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-23T17:36:27.819348] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-23T17:36:27.919384] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-23T17:36:27.931688] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-23T17:36:28.544530] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:28.641288] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-23T17:36:28.714139] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:28.766752] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-23T17:36:28.932284] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:28.949696] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-23T17:36:28.974216] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:28.974499] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-23T17:36:29.278995] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-23T17:36:29.280486] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-23T17:36:29.582519] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:36:29.605507] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T17:36:29.784585] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T17:36:29.802176] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-23T17:36:30.194601] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T17:36:30.312342] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:36:30.602198] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-23T17:36:31.044663] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T17:36:31.402225] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-23T17:36:31.990622] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:36:32.202201] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-23T17:36:32.884552] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T17:36:33.002202] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-23T17:36:33.476188] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:36:33.802202] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-23T17:36:34.344462] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T17:36:34.602223] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-23T17:36:34.967980] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T17:36:35.402223] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-23T17:36:35.769431] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-23T17:36:36.202210] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-23T17:36:36.880450] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T17:36:37.002199] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-23T17:36:37.340059] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-23T17:36:37.802189] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-23T17:36:38.602229] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-23T17:36:39.043247] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T17:36:39.142265] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:36:39.402212] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-23T17:36:40.202253] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-23T17:36:40.527809] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T17:36:41.002177] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-23T17:36:41.312879] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T17:36:41.512837] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T17:36:41.802203] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-23T17:36:42.602231] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-23T17:36:43.026640] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T17:36:43.402158] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-23T17:36:43.551482] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:36:44.202282] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-23T17:36:44.579635] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T17:36:44.697980] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T17:36:45.002193] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-23T17:36:45.802219] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-23T17:36:46.286567] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T17:36:46.602192] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-23T17:36:46.850346] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T17:36:46.949341] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T17:36:47.402206] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-23T17:36:47.675508] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-23T17:36:48.202200] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-23T17:36:48.635868] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T17:36:49.002194] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-23T17:36:49.382427] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T17:36:49.802221] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-23T17:36:50.222551] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T17:36:50.223771] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4325 records). [2025-09-23T17:36:50.223839] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-23T17:36:50.603335] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-23T17:36:50.608740] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-23T17:36:50.609763] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-23T17:36:50.609932] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-23T17:36:50.609993] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-23T17:36:50.610408] [DEBUG] [LOCAL ] BIPJ: Trimmed 4325 records to 2951 (keeping 200 days of data) [2025-09-23T17:36:50.630630] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2951 records). [2025-09-23T17:36:50.630787] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-23T17:36:50.631065] [INFO ] [MAIN ] Update Progress: 281/2372 symbols completed. BIPJ took 24.8s. Estimated remaining: 4h 33m 46s. Rate: 7.6 symbols/min [2025-09-23T17:36:50.804437] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:50.863749] [DEBUG] [LOCAL ] BJ: Loaded 51426 existing records from primary storage. [2025-09-23T17:36:50.863916] [INFO ] [MAIN ] BJ: Loaded 51426 existing records. [2025-09-23T17:36:51.045626] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:51.045904] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-23T17:36:51.045960] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-23T17:36:51.047494] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-23T17:36:51.047556] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-23T17:36:51.405593] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-23T17:36:51.405490] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:51.952431] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T17:36:52.202193] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-23T17:36:52.624223] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:36:53.002172] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-23T17:36:53.131492] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T17:36:53.468374] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T17:36:53.469705] [INFO ] [REMOTE ] BIPI: Full fetch complete (5260 records). [2025-09-23T17:36:53.469776] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-23T17:36:53.803527] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-23T17:36:53.865800] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-23T17:36:53.865877] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-23T17:36:53.866076] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-23T17:36:53.866138] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-23T17:36:53.866534] [DEBUG] [LOCAL ] BIPI: Trimmed 5260 records to 3293 (keeping 200 days of data) [2025-09-23T17:36:53.887759] [DEBUG] [LOCAL ] BIPI: Primary data saved (3293 records). [2025-09-23T17:36:53.887845] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-23T17:36:53.887922] [INFO ] [MAIN ] Update Progress: 282/2372 symbols completed. BIPI took 28.0s. Estimated remaining: 4h 33m 4s. Rate: 7.7 symbols/min [2025-09-23T17:36:54.073706] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:54.129601] [DEBUG] [LOCAL ] BK: Loaded 53562 existing records from primary storage. [2025-09-23T17:36:54.129777] [INFO ] [MAIN ] BK: Loaded 53562 existing records. [2025-09-23T17:36:54.312294] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:54.312587] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-23T17:36:54.312677] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-23T17:36:54.315750] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-23T17:36:54.315817] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-23T17:36:54.607267] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-23T17:36:54.706796] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:54.800110] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T17:36:55.402206] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-23T17:36:55.979058] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:36:56.202196] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-23T17:36:56.926129] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T17:36:57.002203] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-23T17:36:57.162523] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T17:36:57.172016] [INFO ] [REMOTE ] BIT: Full fetch complete (31054 records). [2025-09-23T17:36:57.172168] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-23T17:36:57.540069] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-23T17:36:57.540150] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-23T17:36:57.540574] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-23T17:36:57.540613] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-23T17:36:57.541409] [DEBUG] [LOCAL ] BIT: Trimmed 31054 records to 22326 (keeping 200 days of data) [2025-09-23T17:36:57.676863] [DEBUG] [LOCAL ] BIT: Primary data saved (22326 records). [2025-09-23T17:36:57.676997] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-23T17:36:57.677081] [INFO ] [MAIN ] Update Progress: 283/2372 symbols completed. BIT took 31.8s. Estimated remaining: 4h 32m 26s. Rate: 7.7 symbols/min [2025-09-23T17:36:57.816756] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-23T17:36:57.850997] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:57.900967] [DEBUG] [LOCAL ] BKD: Loaded 50100 existing records from primary storage. [2025-09-23T17:36:57.901150] [INFO ] [MAIN ] BKD: Loaded 50100 existing records. [2025-09-23T17:36:58.092177] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:58.092560] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-23T17:36:58.092686] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-23T17:36:58.094187] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-23T17:36:58.094251] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-23T17:36:58.466995] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:58.531281] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:36:58.602154] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-23T17:36:59.402249] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-23T17:36:59.435255] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T17:36:59.865165] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:37:00.202203] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-23T17:37:00.697268] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:37:01.002195] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-23T17:37:01.802253] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-23T17:37:02.088812] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T17:37:02.602232] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-23T17:37:02.718381] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T17:37:02.726926] [INFO ] [REMOTE ] BIRK: Full fetch complete (72711 records). [2025-09-23T17:37:02.727067] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-23T17:37:03.129442] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-23T17:37:03.129637] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-23T17:37:03.130535] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-23T17:37:03.130677] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-23T17:37:03.157085] [DEBUG] [LOCAL ] BIRK: Trimmed 72711 records to 50900 (keeping 200 days of data) [2025-09-23T17:37:03.158338] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T17:37:03.402633] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-23T17:37:03.467752] [DEBUG] [LOCAL ] BIRK: Primary data saved (50900 records). [2025-09-23T17:37:03.467910] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-23T17:37:03.470783] [INFO ] [MAIN ] Update Progress: 284/2372 symbols completed. BIRK took 37.6s. Estimated remaining: 4h 32m 4s. Rate: 7.7 symbols/min [2025-09-23T17:37:03.641845] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:03.677625] [DEBUG] [LOCAL ] BKE: Loaded 34839 existing records from primary storage. [2025-09-23T17:37:03.677795] [INFO ] [MAIN ] BKE: Loaded 34839 existing records. [2025-09-23T17:37:03.854405] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:03.854778] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-23T17:37:03.854852] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-23T17:37:03.856113] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-23T17:37:03.856176] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-23T17:37:04.204911] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-23T17:37:04.227149] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:04.290789] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T17:37:04.792896] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:37:05.002221] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-23T17:37:05.547984] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:37:05.802224] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-23T17:37:06.215760] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T17:37:06.602215] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-23T17:37:07.097046] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T17:37:07.402205] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-23T17:37:08.202192] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-23T17:37:08.504158] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T17:37:08.931526] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:37:09.002153] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-23T17:37:09.302070] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T17:37:09.802190] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-23T17:37:10.607317] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-23T17:37:10.623424] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T17:37:10.759982] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T17:37:11.402246] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-23T17:37:12.073353] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:37:12.202210] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-23T17:37:12.531766] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T17:37:13.002197] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-23T17:37:13.779998] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:37:13.802144] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-23T17:37:14.097369] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T17:37:14.602257] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-23T17:37:15.080237] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T17:37:15.402232] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-23T17:37:16.145706] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T17:37:16.202176] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-23T17:37:16.580752] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T17:37:17.002210] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-23T17:37:17.376228] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T17:37:17.802210] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-23T17:37:18.458420] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T17:37:18.602159] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-23T17:37:18.652363] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T17:37:19.402213] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-23T17:37:20.202214] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-23T17:37:20.435798] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T17:37:20.554908] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:37:21.002196] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-23T17:37:21.145685] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T17:37:21.802228] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-23T17:37:22.239231] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T17:37:22.602358] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-23T17:37:23.311841] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T17:37:23.320669] [INFO ] [REMOTE ] BJ: Full fetch complete (73326 records). [2025-09-23T17:37:23.320842] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-23T17:37:23.321888] [FATAL] [VALIDATOR ] BJ: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:37:23.322001] [FATAL] [MAIN ] BJ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:37:23.322045] [WARN ] [MAIN ] BJ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:37:23.322110] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-23T17:37:23.322199] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-09-23T17:37:23.322256] [INFO ] [LOCAL ] BJ: Starting deletion of derivative data. [2025-09-23T17:37:23.322921] [DEBUG] [LOCAL ] BJ: Deleted derivative data file. [2025-09-23T17:37:23.323025] [INFO ] [MAIN ] Update Progress: 285/2372 symbols completed. BJ took 32.7s. Estimated remaining: 4h 33m 24s. Rate: 7.6 symbols/min [2025-09-23T17:37:23.407483] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-23T17:37:23.501502] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:23.540827] [DEBUG] [LOCAL ] BKH: Loaded 36644 existing records from primary storage. [2025-09-23T17:37:23.540978] [INFO ] [MAIN ] BKH: Loaded 36644 existing records. [2025-09-23T17:37:23.688375] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T17:37:23.756203] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:23.756472] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-23T17:37:23.756521] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-23T17:37:23.757784] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-23T17:37:23.757847] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-23T17:37:24.129688] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:24.202207] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-23T17:37:24.727705] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T17:37:25.002214] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-23T17:37:25.802256] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-23T17:37:25.837892] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T17:37:25.843666] [INFO ] [REMOTE ] BKE: Full fetch complete (50070 records). [2025-09-23T17:37:25.843853] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-23T17:37:25.844611] [FATAL] [VALIDATOR ] BKE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:37:25.844732] [FATAL] [MAIN ] BKE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:37:25.844802] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:37:25.844876] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-23T17:37:25.844942] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-09-23T17:37:25.845021] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-09-23T17:37:25.845461] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-09-23T17:37:25.845563] [INFO ] [MAIN ] Update Progress: 286/2372 symbols completed. BKE took 22.4s. Estimated remaining: 4h 32m 37s. Rate: 7.7 symbols/min [2025-09-23T17:37:26.014031] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:26.049678] [DEBUG] [LOCAL ] BKKT: Loaded 34157 existing records from primary storage. [2025-09-23T17:37:26.049819] [INFO ] [MAIN ] BKKT: Loaded 34157 existing records. [2025-09-23T17:37:26.224111] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:26.224358] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-23T17:37:26.224412] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-23T17:37:26.226046] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-23T17:37:26.226108] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-23T17:37:26.604924] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-23T17:37:26.604765] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:26.631573] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:37:26.640173] [INFO ] [REMOTE ] BKD: Full fetch complete (71057 records). [2025-09-23T17:37:26.640338] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-23T17:37:26.641160] [FATAL] [VALIDATOR ] BKD: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:37:26.641265] [FATAL] [MAIN ] BKD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:37:26.641308] [WARN ] [MAIN ] BKD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:37:26.641366] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-23T17:37:26.641472] [DEBUG] [LOCAL ] BKD: No primary data file found to delete. [2025-09-23T17:37:26.641530] [INFO ] [LOCAL ] BKD: Starting deletion of derivative data. [2025-09-23T17:37:26.642026] [DEBUG] [LOCAL ] BKD: Deleted derivative data file. [2025-09-23T17:37:26.642155] [INFO ] [MAIN ] Update Progress: 287/2372 symbols completed. BKD took 29.0s. Estimated remaining: 4h 31m 38s. Rate: 7.7 symbols/min [2025-09-23T17:37:26.826479] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:26.836992] [DEBUG] [LOCAL ] BKN: Loaded 7678 existing records from primary storage. [2025-09-23T17:37:26.837122] [INFO ] [MAIN ] BKN: Loaded 7678 existing records. [2025-09-23T17:37:27.013679] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:27.013964] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-23T17:37:27.014012] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-23T17:37:27.014438] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-23T17:37:27.014497] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-23T17:37:27.371323] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:27.402136] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-23T17:37:27.435149] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T17:37:27.722023] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T17:37:28.118545] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T17:37:28.202248] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-23T17:37:29.002198] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-23T17:37:29.371840] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T17:37:29.802200] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-23T17:37:30.602255] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-23T17:37:30.723412] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T17:37:31.102234] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:37:31.169600] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:37:31.402193] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-23T17:37:32.202203] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-23T17:37:32.535023] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T17:37:33.002231] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-23T17:37:33.381094] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T17:37:33.802184] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-23T17:37:34.152002] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T17:37:34.284584] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T17:37:34.602244] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-23T17:37:35.402222] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-23T17:37:35.561477] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T17:37:36.202201] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-23T17:37:36.707738] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:37:36.732994] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T17:37:37.002225] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-23T17:37:37.802188] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-23T17:37:38.233607] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T17:37:38.602193] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-23T17:37:39.318670] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T17:37:39.402166] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-23T17:37:39.427503] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:37:40.050426] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T17:37:40.202212] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-23T17:37:41.002206] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-23T17:37:41.780469] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T17:37:41.802166] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-23T17:37:41.999847] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T17:37:42.602264] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-23T17:37:43.253604] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:37:43.264939] [INFO ] [REMOTE ] BK: Full fetch complete (77484 records). [2025-09-23T17:37:43.265079] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-23T17:37:43.407416] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-23T17:37:43.671148] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-23T17:37:43.671325] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-23T17:37:43.672391] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-23T17:37:43.672464] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-23T17:37:43.676889] [DEBUG] [LOCAL ] BK: Trimmed 77484 records to 53555 (keeping 200 days of data) [2025-09-23T17:37:43.914551] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T17:37:43.937732] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T17:37:44.049558] [DEBUG] [LOCAL ] BK: Primary data saved (53555 records). [2025-09-23T17:37:44.049739] [INFO ] [MAIN ] BK: Full history saved. [2025-09-23T17:37:44.049854] [INFO ] [MAIN ] Update Progress: 288/2372 symbols completed. BK took 50.2s. Estimated remaining: 4h 32m 40s. Rate: 7.6 symbols/min [2025-09-23T17:37:44.209337] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-23T17:37:44.228862] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:44.279975] [DEBUG] [LOCAL ] BKSY: Loaded 48277 existing records from primary storage. [2025-09-23T17:37:44.280144] [INFO ] [MAIN ] BKSY: Loaded 48277 existing records. [2025-09-23T17:37:44.503222] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:44.503886] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-23T17:37:44.503961] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-23T17:37:44.505285] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-23T17:37:44.505348] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-23T17:37:44.838144] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:37:44.926117] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:45.002233] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-23T17:37:45.802214] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-23T17:37:45.994186] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T17:37:46.222134] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:37:46.602205] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-23T17:37:47.402209] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-23T17:37:47.933822] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T17:37:47.969523] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T17:37:47.971499] [INFO ] [REMOTE ] BKN: Full fetch complete (11995 records). [2025-09-23T17:37:47.971601] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-23T17:37:48.207334] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-23T17:37:48.339535] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-23T17:37:48.339613] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-23T17:37:48.339957] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-23T17:37:48.340063] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-23T17:37:48.340566] [DEBUG] [LOCAL ] BKN: Trimmed 11995 records to 7722 (keeping 200 days of data) [2025-09-23T17:37:48.391279] [DEBUG] [LOCAL ] BKN: Primary data saved (7722 records). [2025-09-23T17:37:48.391397] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-23T17:37:48.391545] [INFO ] [MAIN ] Update Progress: 289/2372 symbols completed. BKN took 21.7s. Estimated remaining: 4h 32m 6s. Rate: 7.7 symbols/min [2025-09-23T17:37:48.558663] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:48.575351] [DEBUG] [LOCAL ] BKT: Loaded 10780 existing records from primary storage. [2025-09-23T17:37:48.575474] [INFO ] [MAIN ] BKT: Loaded 10780 existing records. [2025-09-23T17:37:48.748855] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:48.749103] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-23T17:37:48.749150] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-23T17:37:48.749603] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-23T17:37:48.749716] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-23T17:37:49.007392] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-23T17:37:49.140804] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:49.420902] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:37:49.802205] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-23T17:37:50.602165] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-23T17:37:50.779569] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T17:37:50.958861] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T17:37:51.402196] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-23T17:37:51.977051] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:37:52.202196] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-23T17:37:53.002205] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-23T17:37:53.067377] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T17:37:53.798285] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T17:37:53.807781] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-23T17:37:54.119045] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T17:37:54.602195] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-23T17:37:55.402217] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-23T17:37:55.482078] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:37:56.115919] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T17:37:56.202164] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-23T17:37:56.368715] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T17:37:56.781227] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T17:37:57.002208] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-23T17:37:57.425220] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T17:37:57.802178] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-23T17:37:58.391275] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T17:37:58.602352] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-23T17:37:59.402213] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-23T17:37:59.922113] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T17:38:00.202234] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-23T17:38:00.382397] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T17:38:00.389989] [INFO ] [REMOTE ] BKKT: Full fetch complete (49604 records). [2025-09-23T17:38:00.390107] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-23T17:38:00.774179] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-23T17:38:00.774285] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-23T17:38:00.774910] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-23T17:38:00.774973] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-23T17:38:00.776052] [DEBUG] [LOCAL ] BKKT: Trimmed 49604 records to 34261 (keeping 200 days of data) [2025-09-23T17:38:00.895776] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-23T17:38:01.001194] [DEBUG] [LOCAL ] BKKT: Primary data saved (34261 records). [2025-09-23T17:38:01.001345] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-23T17:38:01.001451] [INFO ] [MAIN ] Update Progress: 290/2372 symbols completed. BKKT took 35.2s. Estimated remaining: 4h 32m 33s. Rate: 7.6 symbols/min [2025-09-23T17:38:01.007398] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-23T17:38:01.180421] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:01.223026] [DEBUG] [LOCAL ] BKU: Loaded 42017 existing records from primary storage. [2025-09-23T17:38:01.223165] [INFO ] [MAIN ] BKU: Loaded 42017 existing records. [2025-09-23T17:38:01.401724] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:01.402006] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-23T17:38:01.402067] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-23T17:38:01.403387] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-23T17:38:01.403450] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-23T17:38:01.802176] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-23T17:38:01.824527] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:02.362405] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T17:38:02.602175] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-23T17:38:02.649394] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T17:38:03.402233] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-23T17:38:03.696502] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:38:03.916465] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T17:38:04.202240] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-23T17:38:05.002205] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-23T17:38:05.709516] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:38:05.802211] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-23T17:38:06.099062] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T17:38:06.112293] [INFO ] [REMOTE ] BKH: Full fetch complete (52033 records). [2025-09-23T17:38:06.113151] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-23T17:38:06.500950] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-23T17:38:06.501059] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-23T17:38:06.501698] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-23T17:38:06.501764] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-23T17:38:06.503130] [DEBUG] [LOCAL ] BKH: Trimmed 52033 records to 36620 (keeping 200 days of data) [2025-09-23T17:38:06.604677] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-23T17:38:06.735946] [DEBUG] [LOCAL ] BKH: Primary data saved (36620 records). [2025-09-23T17:38:06.736114] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-23T17:38:06.736240] [INFO ] [MAIN ] Update Progress: 291/2372 symbols completed. BKH took 43.4s. Estimated remaining: 4h 32m 10s. Rate: 7.6 symbols/min [2025-09-23T17:38:06.910616] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:06.944000] [DEBUG] [LOCAL ] BKV: Loaded 29866 existing records from primary storage. [2025-09-23T17:38:06.944135] [INFO ] [MAIN ] BKV: Loaded 29866 existing records. [2025-09-23T17:38:07.121782] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:07.122049] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-23T17:38:07.122096] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-23T17:38:07.123096] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-23T17:38:07.123157] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-23T17:38:07.406957] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-23T17:38:07.492266] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:07.549572] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T17:38:07.771314] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T17:38:08.202233] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-23T17:38:08.578096] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:38:08.582391] [INFO ] [REMOTE ] BKT: Full fetch complete (14922 records). [2025-09-23T17:38:08.582489] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-23T17:38:08.961193] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-23T17:38:08.961537] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-23T17:38:08.961889] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-23T17:38:08.961963] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-23T17:38:08.962762] [DEBUG] [LOCAL ] BKT: Trimmed 14922 records to 10811 (keeping 200 days of data) [2025-09-23T17:38:09.013522] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-23T17:38:09.035101] [DEBUG] [LOCAL ] BKT: Primary data saved (10811 records). [2025-09-23T17:38:09.035305] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-23T17:38:09.035395] [INFO ] [MAIN ] Update Progress: 292/2372 symbols completed. BKT took 20.6s. Estimated remaining: 4h 31m 23s. Rate: 7.7 symbols/min [2025-09-23T17:38:09.216232] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:09.260265] [DEBUG] [LOCAL ] BLCO: Loaded 35903 existing records from primary storage. [2025-09-23T17:38:09.260451] [INFO ] [MAIN ] BLCO: Loaded 35903 existing records. [2025-09-23T17:38:09.441239] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:09.441550] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-23T17:38:09.441597] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-23T17:38:09.442856] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-23T17:38:09.442918] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-23T17:38:09.812160] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:09.807411] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-23T17:38:10.049316] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T17:38:10.169707] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T17:38:10.602201] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-23T17:38:10.933682] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:38:11.402241] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-23T17:38:12.202192] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-23T17:38:12.490485] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:38:12.839724] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-23T17:38:13.002204] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-23T17:38:13.282255] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:38:13.802252] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-23T17:38:14.359284] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T17:38:14.602275] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-23T17:38:15.402275] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-23T17:38:15.509101] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T17:38:15.806835] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T17:38:16.202210] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-23T17:38:16.629280] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T17:38:17.002241] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-23T17:38:17.802155] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-23T17:38:17.883248] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T17:38:17.891872] [INFO ] [REMOTE ] BKSY: Full fetch complete (69297 records). [2025-09-23T17:38:17.891999] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-23T17:38:18.337363] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:38:18.343691] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-23T17:38:18.344121] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-23T17:38:18.345332] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-23T17:38:18.345407] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-23T17:38:18.346969] [DEBUG] [LOCAL ] BKSY: Trimmed 69297 records to 48276 (keeping 200 days of data) [2025-09-23T17:38:18.619726] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-23T17:38:18.652242] [DEBUG] [LOCAL ] BKSY: Primary data saved (48276 records). [2025-09-23T17:38:18.652395] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-23T17:38:18.652485] [INFO ] [MAIN ] Update Progress: 293/2372 symbols completed. BKSY took 34.6s. Estimated remaining: 4h 31m 27s. Rate: 7.7 symbols/min [2025-09-23T17:38:18.825002] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:18.853176] [DEBUG] [LOCAL ] BLD: Loaded 28136 existing records from primary storage. [2025-09-23T17:38:18.853443] [INFO ] [MAIN ] BLD: Loaded 28136 existing records. [2025-09-23T17:38:19.036838] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:19.037270] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-23T17:38:19.037440] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-23T17:38:19.045049] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-23T17:38:19.057824] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-23T17:38:19.102260] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T17:38:19.413852] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-23T17:38:19.419336] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:19.721114] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T17:38:20.202230] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-23T17:38:20.600459] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:38:21.002195] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-23T17:38:21.231074] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T17:38:21.802228] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-23T17:38:22.084714] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T17:38:22.602202] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-23T17:38:22.926881] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T17:38:23.402254] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-23T17:38:23.585845] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T17:38:24.202228] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-23T17:38:25.002314] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-23T17:38:25.046905] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T17:38:25.616104] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:38:25.802222] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-23T17:38:25.958050] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:38:26.602258] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-23T17:38:26.941471] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:38:27.402202] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-23T17:38:27.534205] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T17:38:28.202214] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-23T17:38:28.465821] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T17:38:29.002210] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-23T17:38:29.336077] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T17:38:29.802190] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-23T17:38:30.590091] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T17:38:30.602147] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-23T17:38:30.884023] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T17:38:30.890730] [INFO ] [REMOTE ] BKU: Full fetch complete (59678 records). [2025-09-23T17:38:30.890923] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-23T17:38:31.282079] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-23T17:38:31.282192] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-23T17:38:31.282895] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-23T17:38:31.282960] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-23T17:38:31.284437] [DEBUG] [LOCAL ] BKU: Trimmed 59678 records to 41950 (keeping 200 days of data) [2025-09-23T17:38:31.405900] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-23T17:38:31.541731] [DEBUG] [LOCAL ] BKU: Primary data saved (41950 records). [2025-09-23T17:38:31.542049] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-23T17:38:31.542190] [INFO ] [MAIN ] Update Progress: 294/2372 symbols completed. BKU took 30.5s. Estimated remaining: 4h 31m 55s. Rate: 7.6 symbols/min [2025-09-23T17:38:31.641925] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T17:38:31.742249] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:31.796308] [DEBUG] [LOCAL ] BLDR: Loaded 51653 existing records from primary storage. [2025-09-23T17:38:31.796463] [INFO ] [MAIN ] BLDR: Loaded 51653 existing records. [2025-09-23T17:38:31.973874] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:31.974146] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-23T17:38:31.974194] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-23T17:38:31.975603] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-23T17:38:31.975697] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-23T17:38:32.209856] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-23T17:38:32.342039] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:33.003198] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T17:38:33.002630] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-23T17:38:33.189026] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T17:38:33.802249] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-23T17:38:34.473239] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:38:34.602195] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-23T17:38:34.850980] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T17:38:34.856049] [INFO ] [REMOTE ] BLCO: Full fetch complete (52599 records). [2025-09-23T17:38:34.856149] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-23T17:38:35.232404] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-23T17:38:35.232500] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-23T17:38:35.233105] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-23T17:38:35.233170] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-23T17:38:35.234352] [DEBUG] [LOCAL ] BLCO: Trimmed 52599 records to 35761 (keeping 200 days of data) [2025-09-23T17:38:35.403453] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-23T17:38:35.451232] [DEBUG] [LOCAL ] BLCO: Primary data saved (35761 records). [2025-09-23T17:38:35.451340] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-23T17:38:35.451445] [INFO ] [MAIN ] Update Progress: 295/2372 symbols completed. BLCO took 26.4s. Estimated remaining: 4h 31m 20s. Rate: 7.7 symbols/min [2025-09-23T17:38:35.623620] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:35.623792] [DEBUG] [LOCAL ] BLE: No existing data file found in primary storage. [2025-09-23T17:38:35.623834] [WARN ] [MAIN ] BLE: No existing data found, performing full refresh instead. [2025-09-23T17:38:35.623975] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-23T17:38:35.624018] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-23T17:38:35.624059] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-09-23T17:38:35.624091] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-23T17:38:35.978912] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:36.202161] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-23T17:38:36.314748] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T17:38:36.479111] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T17:38:36.971247] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T17:38:37.002207] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-23T17:38:37.802238] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-23T17:38:38.333506] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:38:38.593698] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:38:38.602146] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-23T17:38:39.132761] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T17:38:39.402210] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-23T17:38:40.202199] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-23T17:38:40.329781] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T17:38:40.925694] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T17:38:41.002266] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-23T17:38:41.804047] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-23T17:38:41.808491] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:38:41.815215] [INFO ] [REMOTE ] BKV: Full fetch complete (44890 records). [2025-09-23T17:38:41.815344] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-23T17:38:42.212763] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-23T17:38:42.212869] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-23T17:38:42.213670] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-23T17:38:42.213734] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-23T17:38:42.215333] [DEBUG] [LOCAL ] BKV: Trimmed 44890 records to 29765 (keeping 200 days of data) [2025-09-23T17:38:42.393171] [DEBUG] [LOCAL ] BKV: Primary data saved (29765 records). [2025-09-23T17:38:42.393333] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-23T17:38:42.393430] [INFO ] [MAIN ] Update Progress: 296/2372 symbols completed. BKV took 35.7s. Estimated remaining: 4h 31m 6s. Rate: 7.7 symbols/min [2025-09-23T17:38:42.585034] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:42.586989] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T17:38:42.602154] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-23T17:38:42.641806] [DEBUG] [LOCAL ] BLK: Loaded 35027 existing records from primary storage. [2025-09-23T17:38:42.641954] [INFO ] [MAIN ] BLK: Loaded 35027 existing records. [2025-09-23T17:38:42.827236] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:42.827480] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-23T17:38:42.827529] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-23T17:38:42.828541] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-23T17:38:42.828606] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-23T17:38:43.212862] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:43.334928] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T17:38:43.402192] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-23T17:38:44.202192] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-23T17:38:44.976207] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:38:45.002146] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-23T17:38:45.802219] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-23T17:38:46.160459] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-23T17:38:46.555218] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T17:38:46.602163] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-23T17:38:46.810795] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T17:38:47.402204] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-23T17:38:48.202231] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-23T17:38:48.322356] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T17:38:48.436559] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T17:38:48.878721] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T17:38:49.002158] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-23T17:38:49.802253] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-23T17:38:50.025482] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T17:38:50.602216] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-23T17:38:51.402203] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-23T17:38:51.823424] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T17:38:51.985345] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T17:38:52.111160] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:38:52.202168] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-23T17:38:53.002204] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-23T17:38:53.645424] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T17:38:53.802203] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-23T17:38:53.886729] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T17:38:54.602235] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-23T17:38:55.064961] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:38:55.402201] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-23T17:38:55.525463] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T17:38:56.202189] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-23T17:38:56.698486] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:38:56.724970] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T17:38:57.002205] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-23T17:38:57.802203] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-23T17:38:58.129824] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T17:38:58.427213] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T17:38:58.429950] [INFO ] [REMOTE ] BLE: Full fetch complete (20600 records). [2025-09-23T17:38:58.430060] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-23T17:38:58.605032] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-23T17:38:58.837310] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-23T17:38:58.837395] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-23T17:38:58.837884] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-23T17:38:58.837951] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-23T17:38:58.838583] [DEBUG] [LOCAL ] BLE: Trimmed 20600 records to 14633 (keeping 200 days of data) [2025-09-23T17:38:58.928125] [DEBUG] [LOCAL ] BLE: Primary data saved (14633 records). [2025-09-23T17:38:58.928267] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-23T17:38:58.928347] [INFO ] [MAIN ] Update Progress: 297/2372 symbols completed. BLE took 23.5s. Estimated remaining: 4h 31m 58s. Rate: 7.6 symbols/min [2025-09-23T17:38:59.107376] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:59.153412] [DEBUG] [LOCAL ] BLND: Loaded 49488 existing records from primary storage. [2025-09-23T17:38:59.153564] [INFO ] [MAIN ] BLND: Loaded 49488 existing records. [2025-09-23T17:38:59.350798] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:59.351057] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-23T17:38:59.351106] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-23T17:38:59.352387] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-23T17:38:59.352451] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-23T17:38:59.414361] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-23T17:38:59.712144] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:00.212845] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-23T17:39:00.215791] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T17:39:00.872049] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T17:39:00.877175] [INFO ] [REMOTE ] BLD: Full fetch complete (40555 records). [2025-09-23T17:39:00.877277] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-23T17:39:01.017733] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-23T17:39:01.259098] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-23T17:39:01.259196] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-23T17:39:01.259816] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-23T17:39:01.259883] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-23T17:39:01.261207] [DEBUG] [LOCAL ] BLD: Trimmed 40555 records to 28198 (keeping 200 days of data) [2025-09-23T17:39:01.436192] [DEBUG] [LOCAL ] BLD: Primary data saved (28198 records). [2025-09-23T17:39:01.436346] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-23T17:39:01.436437] [INFO ] [MAIN ] Update Progress: 298/2372 symbols completed. BLD took 42.8s. Estimated remaining: 4h 31m 13s. Rate: 7.6 symbols/min [2025-09-23T17:39:01.608404] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:01.608612] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-23T17:39:01.608679] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-23T17:39:01.608838] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-23T17:39:01.608881] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-23T17:39:01.608922] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-23T17:39:01.608955] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-23T17:39:01.814676] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-23T17:39:02.019969] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:02.158740] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T17:39:02.602218] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-23T17:39:03.325308] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T17:39:03.402188] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-23T17:39:03.753188] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:03.753514] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-23T17:39:04.202243] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-23T17:39:04.472352] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-23T17:39:04.511355] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:04.511714] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-23T17:39:05.002206] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-23T17:39:05.210381] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:05.210732] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-23T17:39:05.420128] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-23T17:39:05.802236] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-23T17:39:06.602206] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-23T17:39:07.033250] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:39:07.040720] [INFO ] [REMOTE ] BLK: Full fetch complete (52998 records). [2025-09-23T17:39:07.040893] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-23T17:39:07.410403] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-23T17:39:07.645746] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-23T17:39:07.645891] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-23T17:39:07.647074] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-23T17:39:07.647168] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-23T17:39:07.649233] [DEBUG] [LOCAL ] BLK: Trimmed 52998 records to 34927 (keeping 200 days of data) [2025-09-23T17:39:08.011398] [DEBUG] [LOCAL ] BLK: Primary data saved (34927 records). [2025-09-23T17:39:08.011628] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-23T17:39:08.011799] [INFO ] [MAIN ] Update Progress: 299/2372 symbols completed. BLK took 25.6s. Estimated remaining: 4h 30m 57s. Rate: 7.7 symbols/min [2025-09-23T17:39:08.203796] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-23T17:39:08.240376] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:08.257854] [DEBUG] [LOCAL ] BLW: Loaded 12732 existing records from primary storage. [2025-09-23T17:39:08.258002] [INFO ] [MAIN ] BLW: Loaded 12732 existing records. [2025-09-23T17:39:08.464120] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:08.464629] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-23T17:39:08.464797] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-23T17:39:08.476821] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-23T17:39:08.493039] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:08.496359] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-23T17:39:08.518442] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-23T17:39:08.585542] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T17:39:08.886857] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:08.955300] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T17:39:09.002173] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-23T17:39:09.677480] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-23T17:39:09.802236] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-23T17:39:10.602216] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-23T17:39:10.813781] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:10.814058] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-23T17:39:11.305375] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T17:39:11.402150] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-23T17:39:12.202284] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-23T17:39:12.407050] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:12.407478] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-23T17:39:13.002215] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-23T17:39:13.269526] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T17:39:13.278749] [INFO ] [REMOTE ] BLDR: Full fetch complete (74302 records). [2025-09-23T17:39:13.278959] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-23T17:39:13.690606] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-23T17:39:13.690735] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-23T17:39:13.691599] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-23T17:39:13.691693] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-23T17:39:13.693247] [DEBUG] [LOCAL ] BLDR: Trimmed 74302 records to 51666 (keeping 200 days of data) [2025-09-23T17:39:13.803751] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-23T17:39:14.014035] [DEBUG] [LOCAL ] BLDR: Primary data saved (51666 records). [2025-09-23T17:39:14.014258] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-23T17:39:14.014365] [INFO ] [MAIN ] Update Progress: 300/2372 symbols completed. BLDR took 42.5s. Estimated remaining: 4h 30m 36s. Rate: 7.7 symbols/min [2025-09-23T17:39:14.182475] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:14.199702] [DEBUG] [LOCAL ] BLX: Loaded 15777 existing records from primary storage. [2025-09-23T17:39:14.199864] [INFO ] [MAIN ] BLX: Loaded 15777 existing records. [2025-09-23T17:39:14.399284] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:14.399520] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-23T17:39:14.399570] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-23T17:39:14.400128] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-23T17:39:14.400192] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-23T17:39:14.467360] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:14.497601] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-23T17:39:14.607446] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-23T17:39:14.773726] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:15.045854] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-23T17:39:15.402207] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-23T17:39:15.661841] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T17:39:16.202251] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-23T17:39:16.261437] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:39:16.766355] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:39:17.002224] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-23T17:39:17.810751] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-23T17:39:17.811781] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T17:39:18.602255] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-23T17:39:19.151888] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T17:39:19.191942] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T17:39:19.402174] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-23T17:39:20.202253] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-23T17:39:20.626328] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:39:21.002255] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-23T17:39:21.045602] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T17:39:21.619050] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T17:39:21.802197] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-23T17:39:22.602230] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-23T17:39:23.167755] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:39:23.210506] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T17:39:23.402191] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-23T17:39:24.047569] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T17:39:24.202207] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-23T17:39:24.899750] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T17:39:25.002255] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-23T17:39:25.213210] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:25.213631] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-23T17:39:25.802222] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-23T17:39:26.602206] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-23T17:39:27.346978] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T17:39:27.406022] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-23T17:39:27.408716] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T17:39:28.138617] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T17:39:28.202157] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-23T17:39:28.783673] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T17:39:29.002241] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-23T17:39:29.802253] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-23T17:39:30.426750] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T17:39:30.602280] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-23T17:39:31.402252] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-23T17:39:31.462665] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-23T17:39:31.471445] [INFO ] [REMOTE ] BLSH: Full fetch complete (11051 records). [2025-09-23T17:39:31.471548] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-23T17:39:31.678270] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 29 unique days, need 200 days [2025-09-23T17:39:31.678572] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:39:31.678688] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:39:31.678761] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-23T17:39:31.678844] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-23T17:39:31.678900] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-23T17:39:31.678957] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-23T17:39:31.679044] [INFO ] [MAIN ] Update Progress: 301/2372 symbols completed. BLSH took 30.2s. Estimated remaining: 4h 31m 36s. Rate: 7.6 symbols/min [2025-09-23T17:39:31.860374] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:31.911784] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T17:39:31.934996] [DEBUG] [LOCAL ] BMA: Loaded 34783 existing records from primary storage. [2025-09-23T17:39:31.935221] [INFO ] [MAIN ] BMA: Loaded 34783 existing records. [2025-09-23T17:39:32.126520] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:32.127163] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-23T17:39:32.127276] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-23T17:39:32.133483] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-23T17:39:32.139328] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-23T17:39:32.146566] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T17:39:32.202335] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-23T17:39:32.574907] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:33.002253] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-23T17:39:33.412013] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T17:39:33.721244] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T17:39:33.724370] [INFO ] [REMOTE ] BLX: Full fetch complete (22762 records). [2025-09-23T17:39:33.724445] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-23T17:39:33.807421] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-23T17:39:34.108398] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-23T17:39:34.108517] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-23T17:39:34.108988] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-23T17:39:34.109051] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-23T17:39:34.109706] [DEBUG] [LOCAL ] BLX: Trimmed 22762 records to 15743 (keeping 200 days of data) [2025-09-23T17:39:34.204126] [DEBUG] [LOCAL ] BLX: Primary data saved (15743 records). [2025-09-23T17:39:34.204267] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-23T17:39:34.204354] [INFO ] [MAIN ] Update Progress: 302/2372 symbols completed. BLX took 20.2s. Estimated remaining: 4h 30m 51s. Rate: 7.6 symbols/min [2025-09-23T17:39:34.373780] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:34.385531] [DEBUG] [LOCAL ] BME: Loaded 10829 existing records from primary storage. [2025-09-23T17:39:34.385659] [INFO ] [MAIN ] BME: Loaded 10829 existing records. [2025-09-23T17:39:34.563147] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:34.563372] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-23T17:39:34.563422] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-23T17:39:34.563995] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-23T17:39:34.564056] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-23T17:39:34.607326] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-23T17:39:34.926078] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:35.094930] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T17:39:35.388323] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T17:39:35.402146] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-23T17:39:36.202602] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-23T17:39:36.203211] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T17:39:36.989842] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T17:39:37.002148] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-23T17:39:37.600474] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T17:39:37.802198] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-23T17:39:38.602203] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-23T17:39:39.087041] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T17:39:39.402213] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-23T17:39:40.139182] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T17:39:40.202173] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-23T17:39:40.765499] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T17:39:40.774025] [INFO ] [REMOTE ] BLND: Full fetch complete (72321 records). [2025-09-23T17:39:40.774211] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-23T17:39:41.012421] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-23T17:39:41.171499] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-23T17:39:41.171622] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-23T17:39:41.180168] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-23T17:39:41.180322] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-23T17:39:41.181568] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T17:39:41.185227] [INFO ] [REMOTE ] BLW: Full fetch complete (18836 records). [2025-09-23T17:39:41.185539] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-23T17:39:41.185801] [DEBUG] [LOCAL ] BLND: Trimmed 72321 records to 49485 (keeping 200 days of data) [2025-09-23T17:39:41.682947] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-23T17:39:41.683380] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-23T17:39:41.685270] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-23T17:39:41.685350] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-23T17:39:41.690190] [DEBUG] [LOCAL ] BLW: Trimmed 18836 records to 12741 (keeping 200 days of data) [2025-09-23T17:39:41.817947] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-23T17:39:41.874203] [DEBUG] [LOCAL ] BLW: Primary data saved (12741 records). [2025-09-23T17:39:41.875448] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-23T17:39:41.875584] [INFO ] [MAIN ] Update Progress: 303/2372 symbols completed. BLW took 33.9s. Estimated remaining: 4h 30m 42s. Rate: 7.6 symbols/min [2025-09-23T17:39:42.064777] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:42.100007] [DEBUG] [LOCAL ] BMEZ: Loaded 26103 existing records from primary storage. [2025-09-23T17:39:42.102737] [INFO ] [MAIN ] BMEZ: Loaded 26103 existing records. [2025-09-23T17:39:42.331270] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:42.332475] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-23T17:39:42.334205] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-23T17:39:42.336206] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-23T17:39:42.336518] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-23T17:39:42.474204] [DEBUG] [LOCAL ] BLND: Primary data saved (49485 records). [2025-09-23T17:39:42.479850] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-23T17:39:42.498820] [INFO ] [MAIN ] Update Progress: 304/2372 symbols completed. BLND took 43.6s. Estimated remaining: 4h 29m 45s. Rate: 7.7 symbols/min [2025-09-23T17:39:42.659214] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:39:42.723370] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T17:39:42.770470] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-23T17:39:42.932537] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:42.950713] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:42.976032] [DEBUG] [LOCAL ] BMI: Loaded 24070 existing records from primary storage. [2025-09-23T17:39:42.976197] [INFO ] [MAIN ] BMI: Loaded 24070 existing records. [2025-09-23T17:39:43.151498] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:43.151755] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-23T17:39:43.151838] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-23T17:39:43.152736] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-23T17:39:43.152800] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-23T17:39:43.404012] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-23T17:39:43.510150] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:43.625529] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T17:39:44.202195] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-23T17:39:44.404861] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:39:45.002197] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-23T17:39:45.186722] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T17:39:45.802203] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-23T17:39:46.271818] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T17:39:46.599962] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T17:39:46.602498] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-23T17:39:47.402196] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-23T17:39:47.732473] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:39:48.202198] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-23T17:39:48.736568] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T17:39:49.002224] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-23T17:39:49.504550] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T17:39:49.673767] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:39:49.802225] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-23T17:39:50.262454] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T17:39:50.602186] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-23T17:39:51.183213] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T17:39:51.402196] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-23T17:39:52.202165] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-23T17:39:52.440673] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T17:39:53.002194] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-23T17:39:53.189286] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T17:39:53.802178] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-23T17:39:54.136386] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T17:39:54.540797] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T17:39:54.602190] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-23T17:39:55.195847] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T17:39:55.402249] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-23T17:39:56.202281] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-23T17:39:56.257065] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T17:39:57.002249] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-23T17:39:57.671083] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:39:57.802217] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-23T17:39:57.942544] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:39:58.602218] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-23T17:39:58.788544] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T17:39:59.402214] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-23T17:39:59.529525] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T17:40:00.202259] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-23T17:40:00.559110] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T17:40:01.002249] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-23T17:40:01.802245] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-23T17:40:01.908103] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T17:40:02.063553] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T17:40:02.071784] [INFO ] [REMOTE ] BMA: Full fetch complete (51060 records). [2025-09-23T17:40:02.071928] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-23T17:40:02.483927] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-23T17:40:02.484024] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-23T17:40:02.484612] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-23T17:40:02.484683] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-23T17:40:02.485952] [DEBUG] [LOCAL ] BMA: Trimmed 51060 records to 34895 (keeping 200 days of data) [2025-09-23T17:40:02.604271] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-23T17:40:02.712032] [DEBUG] [LOCAL ] BMA: Primary data saved (34895 records). [2025-09-23T17:40:02.712201] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-23T17:40:02.712319] [INFO ] [MAIN ] Update Progress: 305/2372 symbols completed. BMA took 31.0s. Estimated remaining: 4h 31m 1s. Rate: 7.6 symbols/min [2025-09-23T17:40:02.915776] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:02.921576] [DEBUG] [LOCAL ] BMN: Loaded 2561 existing records from primary storage. [2025-09-23T17:40:02.921762] [INFO ] [MAIN ] BMN: Loaded 2561 existing records. [2025-09-23T17:40:03.122753] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:40:03.167282] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:03.168373] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-23T17:40:03.168459] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-23T17:40:03.168754] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-23T17:40:03.168826] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-23T17:40:03.408324] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-23T17:40:03.585855] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:03.603567] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T17:40:04.202243] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-23T17:40:04.333313] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T17:40:04.336790] [INFO ] [REMOTE ] BME: Full fetch complete (16083 records). [2025-09-23T17:40:04.336885] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-23T17:40:04.699193] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-23T17:40:04.699273] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-23T17:40:04.699576] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-23T17:40:04.699628] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-23T17:40:04.700393] [DEBUG] [LOCAL ] BME: Trimmed 16083 records to 10811 (keeping 200 days of data) [2025-09-23T17:40:04.770764] [DEBUG] [LOCAL ] BME: Primary data saved (10811 records). [2025-09-23T17:40:04.770912] [INFO ] [MAIN ] BME: Full history saved. [2025-09-23T17:40:04.771016] [INFO ] [MAIN ] Update Progress: 306/2372 symbols completed. BME took 30.6s. Estimated remaining: 4h 30m 14s. Rate: 7.6 symbols/min [2025-09-23T17:40:04.951113] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:05.005894] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-23T17:40:05.072097] [DEBUG] [LOCAL ] BMO: Loaded 41319 existing records from primary storage. [2025-09-23T17:40:05.072552] [INFO ] [MAIN ] BMO: Loaded 41319 existing records. [2025-09-23T17:40:05.089512] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T17:40:05.267688] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:05.267952] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-23T17:40:05.268000] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-23T17:40:05.269197] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-23T17:40:05.269258] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-23T17:40:05.552213] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T17:40:05.627680] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:05.802175] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-23T17:40:06.602251] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-23T17:40:07.169558] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:40:07.402169] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-23T17:40:07.763035] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T17:40:08.108463] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:40:08.202165] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-23T17:40:09.002207] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-23T17:40:09.201072] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T17:40:09.802220] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-23T17:40:10.075163] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T17:40:10.602235] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-23T17:40:10.796967] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:40:10.801969] [INFO ] [REMOTE ] BMEZ: Full fetch complete (41054 records). [2025-09-23T17:40:10.802072] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-23T17:40:11.240756] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-23T17:40:11.240881] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-23T17:40:11.241438] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-23T17:40:11.241485] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-23T17:40:11.243304] [DEBUG] [LOCAL ] BMEZ: Trimmed 41054 records to 26034 (keeping 200 days of data) [2025-09-23T17:40:11.413362] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-23T17:40:11.439329] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26034 records). [2025-09-23T17:40:11.439512] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-23T17:40:11.439714] [INFO ] [MAIN ] Update Progress: 307/2372 symbols completed. BMEZ took 29.6s. Estimated remaining: 4h 29m 59s. Rate: 7.6 symbols/min [2025-09-23T17:40:11.648439] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:11.715261] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-23T17:40:11.715434] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-09-23T17:40:11.843509] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T17:40:11.929792] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:11.930089] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-23T17:40:11.930146] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-23T17:40:11.931406] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-23T17:40:11.931489] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-23T17:40:12.204185] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-23T17:40:12.352081] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T17:40:12.357798] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:12.653480] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T17:40:13.002216] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-23T17:40:13.802225] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-23T17:40:14.602184] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-23T17:40:14.645367] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T17:40:14.706128] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T17:40:15.217716] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T17:40:15.402236] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-23T17:40:16.202202] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-23T17:40:17.002191] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-23T17:40:17.091493] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T17:40:17.802249] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-23T17:40:18.261211] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T17:40:18.582287] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T17:40:18.602183] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-23T17:40:19.402242] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-23T17:40:19.836857] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (3.63 seconds). [2025-09-23T17:40:19.842071] [INFO ] [REMOTE ] BMI: Full fetch complete (32775 records). [2025-09-23T17:40:19.842248] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-23T17:40:20.220271] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-23T17:40:20.263778] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-23T17:40:20.264015] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-23T17:40:20.264485] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-23T17:40:20.264562] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-23T17:40:20.267293] [DEBUG] [LOCAL ] BMI: Trimmed 32775 records to 24187 (keeping 200 days of data) [2025-09-23T17:40:20.417312] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T17:40:20.480245] [DEBUG] [LOCAL ] BMI: Primary data saved (24187 records). [2025-09-23T17:40:20.480389] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-23T17:40:20.480502] [INFO ] [MAIN ] Update Progress: 308/2372 symbols completed. BMI took 38.0s. Estimated remaining: 4h 29m 59s. Rate: 7.6 symbols/min [2025-09-23T17:40:20.666661] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:20.670418] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T17:40:20.731106] [DEBUG] [LOCAL ] BN: Loaded 52995 existing records from primary storage. [2025-09-23T17:40:20.731309] [INFO ] [MAIN ] BN: Loaded 52995 existing records. [2025-09-23T17:40:20.965541] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:40:20.971164] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:20.981206] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-23T17:40:20.981280] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-23T17:40:20.982537] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-23T17:40:20.982598] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-23T17:40:21.011313] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-23T17:40:21.355993] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:21.802234] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-23T17:40:22.284895] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T17:40:22.602237] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-23T17:40:22.895929] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-23T17:40:23.385374] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T17:40:23.402161] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-23T17:40:24.202191] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-23T17:40:25.002244] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-23T17:40:25.242362] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T17:40:25.802199] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-23T17:40:26.078774] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T17:40:26.512367] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T17:40:26.602195] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-23T17:40:27.414089] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-23T17:40:27.421721] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T17:40:27.835343] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T17:40:28.202198] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-23T17:40:28.752017] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:40:29.002250] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-23T17:40:29.802266] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-23T17:40:29.927445] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T17:40:30.390553] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:40:30.602221] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-23T17:40:31.077773] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T17:40:31.402235] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-23T17:40:31.968155] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T17:40:32.027206] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T17:40:32.202179] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-23T17:40:32.565879] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T17:40:33.002191] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-23T17:40:33.802199] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-23T17:40:34.602161] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-23T17:40:34.737139] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T17:40:35.402244] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-23T17:40:35.710922] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T17:40:35.811054] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:40:35.818456] [INFO ] [REMOTE ] BMO: Full fetch complete (59910 records). [2025-09-23T17:40:35.818597] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-23T17:40:36.216437] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-23T17:40:36.237914] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-23T17:40:36.238032] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-23T17:40:36.238801] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-23T17:40:36.238868] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-23T17:40:36.240489] [DEBUG] [LOCAL ] BMO: Trimmed 59910 records to 41304 (keeping 200 days of data) [2025-09-23T17:40:36.501778] [DEBUG] [LOCAL ] BMO: Primary data saved (41304 records). [2025-09-23T17:40:36.501916] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-23T17:40:36.502002] [INFO ] [MAIN ] Update Progress: 309/2372 symbols completed. BMO took 31.7s. Estimated remaining: 4h 30m 45s. Rate: 7.6 symbols/min [2025-09-23T17:40:36.671816] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:36.701855] [DEBUG] [LOCAL ] BNED: Loaded 30016 existing records from primary storage. [2025-09-23T17:40:36.701990] [INFO ] [MAIN ] BNED: Loaded 30016 existing records. [2025-09-23T17:40:36.806491] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:40:36.813563] [INFO ] [REMOTE ] BMN: Full fetch complete (3709 records). [2025-09-23T17:40:36.818719] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-23T17:40:37.007139] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:37.002534] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-23T17:40:37.009174] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-23T17:40:37.020019] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-23T17:40:37.035763] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-23T17:40:37.041215] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-23T17:40:37.492425] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-23T17:40:37.492566] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-23T17:40:37.531720] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-23T17:40:37.543564] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-23T17:40:37.596778] [DEBUG] [LOCAL ] BMN: Trimmed 3709 records to 2537 (keeping 200 days of data) [2025-09-23T17:40:37.655535] [DEBUG] [LOCAL ] BMN: Primary data saved (2537 records). [2025-09-23T17:40:37.698349] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:37.692807] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-23T17:40:37.699032] [INFO ] [MAIN ] Update Progress: 310/2372 symbols completed. BMN took 35.0s. Estimated remaining: 4h 29m 53s. Rate: 7.6 symbols/min [2025-09-23T17:40:37.807553] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-23T17:40:37.837435] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-23T17:40:37.921358] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:37.934481] [DEBUG] [LOCAL ] BNH: Loaded 4822 existing records from primary storage. [2025-09-23T17:40:37.934606] [INFO ] [MAIN ] BNH: Loaded 4822 existing records. [2025-09-23T17:40:38.115807] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:38.116084] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-23T17:40:38.116134] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-23T17:40:38.116470] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-23T17:40:38.116542] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-23T17:40:38.477418] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:38.602186] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-23T17:40:38.653324] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T17:40:39.079945] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T17:40:39.093397] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T17:40:39.402196] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-23T17:40:39.737966] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T17:40:40.202234] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-23T17:40:41.002243] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-23T17:40:41.570985] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T17:40:41.655765] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T17:40:41.664980] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-23T17:40:41.665183] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-23T17:40:41.807688] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-23T17:40:42.072692] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-23T17:40:42.072796] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-23T17:40:42.073732] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-23T17:40:42.073800] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-23T17:40:42.078011] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-09-23T17:40:42.402067] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-23T17:40:42.402212] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-23T17:40:42.402298] [INFO ] [MAIN ] Update Progress: 311/2372 symbols completed. BMY took 31.0s. Estimated remaining: 4h 29m 24s. Rate: 7.7 symbols/min [2025-09-23T17:40:42.568374] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:42.572454] [DEBUG] [LOCAL ] BNJ: Loaded 2577 existing records from primary storage. [2025-09-23T17:40:42.572525] [INFO ] [MAIN ] BNJ: Loaded 2577 existing records. [2025-09-23T17:40:42.607498] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-23T17:40:42.754283] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:42.754530] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-23T17:40:42.754584] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-23T17:40:42.754851] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-23T17:40:42.754911] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-23T17:40:43.118633] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:43.137488] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:40:43.402213] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-23T17:40:43.897984] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T17:40:44.128179] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T17:40:44.202161] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-23T17:40:45.002214] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-23T17:40:45.754013] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T17:40:45.811285] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-23T17:40:45.831899] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T17:40:46.602199] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-23T17:40:46.917123] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-23T17:40:47.157343] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T17:40:47.402195] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-23T17:40:48.202245] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-23T17:40:48.288050] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T17:40:48.517215] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T17:40:49.002192] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-23T17:40:49.802202] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-23T17:40:49.997592] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T17:40:50.110335] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T17:40:50.602197] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-23T17:40:51.136520] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T17:40:51.402205] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-23T17:40:51.868636] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:40:52.202225] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-23T17:40:53.002178] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-23T17:40:53.374454] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:40:53.802229] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-23T17:40:54.442574] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T17:40:54.451369] [INFO ] [REMOTE ] BN: Full fetch complete (76623 records). [2025-09-23T17:40:54.451538] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-23T17:40:54.627406] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-23T17:40:54.859823] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-23T17:40:54.859953] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-23T17:40:54.860877] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-23T17:40:54.861118] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-23T17:40:54.882993] [DEBUG] [LOCAL ] BN: Trimmed 76623 records to 52994 (keeping 200 days of data) [2025-09-23T17:40:54.884226] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T17:40:55.207443] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T17:40:55.228860] [DEBUG] [LOCAL ] BN: Primary data saved (52994 records). [2025-09-23T17:40:55.228953] [INFO ] [MAIN ] BN: Full history saved. [2025-09-23T17:40:55.229028] [INFO ] [MAIN ] Update Progress: 312/2372 symbols completed. BN took 34.7s. Estimated remaining: 4h 29m 50s. Rate: 7.6 symbols/min [2025-09-23T17:40:55.398702] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:55.402196] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-23T17:40:55.447213] [DEBUG] [LOCAL ] BNL: Loaded 46906 existing records from primary storage. [2025-09-23T17:40:55.447350] [INFO ] [MAIN ] BNL: Loaded 46906 existing records. [2025-09-23T17:40:55.627693] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:55.627965] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-23T17:40:55.628030] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-23T17:40:55.629018] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-23T17:40:55.629080] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-23T17:40:55.984696] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:56.202261] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-23T17:40:56.354319] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T17:40:57.002195] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-23T17:40:57.401984] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T17:40:57.785818] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T17:40:57.802157] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-23T17:40:58.602250] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-23T17:40:58.921334] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-23T17:40:58.975437] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T17:40:59.402291] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-23T17:40:59.749083] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T17:41:00.202234] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-23T17:41:00.531623] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T17:41:01.002212] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-23T17:41:01.523148] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T17:41:01.802254] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-23T17:41:02.133895] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-23T17:41:02.602220] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-23T17:41:02.918898] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T17:41:03.402227] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-23T17:41:03.729725] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-23T17:41:04.202214] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-23T17:41:04.649204] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T17:41:04.650400] [INFO ] [REMOTE ] BNJ: Full fetch complete (4435 records). [2025-09-23T17:41:04.650468] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-23T17:41:05.009010] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-23T17:41:05.043561] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-23T17:41:05.043661] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-23T17:41:05.043830] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-23T17:41:05.043871] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-23T17:41:05.044253] [DEBUG] [LOCAL ] BNJ: Trimmed 4435 records to 2584 (keeping 200 days of data) [2025-09-23T17:41:05.060179] [DEBUG] [LOCAL ] BNJ: Primary data saved (2584 records). [2025-09-23T17:41:05.060338] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-23T17:41:05.060442] [INFO ] [MAIN ] Update Progress: 313/2372 symbols completed. BNJ took 22.7s. Estimated remaining: 4h 29m 55s. Rate: 7.6 symbols/min [2025-09-23T17:41:05.237123] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:05.289607] [DEBUG] [LOCAL ] BNS: Loaded 51466 existing records from primary storage. [2025-09-23T17:41:05.289779] [INFO ] [MAIN ] BNS: Loaded 51466 existing records. [2025-09-23T17:41:05.473806] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:05.474133] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-23T17:41:05.474186] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-23T17:41:05.475907] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-23T17:41:05.475970] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-23T17:41:05.605500] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T17:41:05.807384] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-23T17:41:05.845981] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:06.398548] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:41:06.399888] [INFO ] [REMOTE ] BNH: Full fetch complete (6811 records). [2025-09-23T17:41:06.399967] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-23T17:41:06.607349] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-23T17:41:06.766060] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-23T17:41:06.766186] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-23T17:41:06.766386] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-23T17:41:06.766428] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-23T17:41:06.766877] [DEBUG] [LOCAL ] BNH: Trimmed 6811 records to 4838 (keeping 200 days of data) [2025-09-23T17:41:06.799467] [DEBUG] [LOCAL ] BNH: Primary data saved (4838 records). [2025-09-23T17:41:06.799602] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-23T17:41:06.799712] [INFO ] [MAIN ] Update Progress: 314/2372 symbols completed. BNH took 29.1s. Estimated remaining: 4h 29m 7s. Rate: 7.6 symbols/min [2025-09-23T17:41:06.970514] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:06.976022] [DEBUG] [LOCAL ] BNT: Loaded 3407 existing records from primary storage. [2025-09-23T17:41:06.976153] [INFO ] [MAIN ] BNT: Loaded 3407 existing records. [2025-09-23T17:41:07.157786] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:07.158127] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-23T17:41:07.158186] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-23T17:41:07.158473] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-23T17:41:07.158535] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-23T17:41:07.410249] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-23T17:41:07.562775] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:07.777938] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:41:07.783383] [INFO ] [REMOTE ] BNED: Full fetch complete (44350 records). [2025-09-23T17:41:07.783521] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-23T17:41:08.200637] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-23T17:41:08.200921] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-23T17:41:08.201519] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-23T17:41:08.201569] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-23T17:41:08.202322] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-23T17:41:08.204008] [DEBUG] [LOCAL ] BNED: Trimmed 44350 records to 29989 (keeping 200 days of data) [2025-09-23T17:41:08.386575] [DEBUG] [LOCAL ] BNED: Primary data saved (29989 records). [2025-09-23T17:41:08.386757] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-23T17:41:08.386880] [INFO ] [MAIN ] Update Progress: 315/2372 symbols completed. BNED took 31.9s. Estimated remaining: 4h 28m 18s. Rate: 7.7 symbols/min [2025-09-23T17:41:08.575346] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:08.585005] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-23T17:41:08.585148] [INFO ] [MAIN ] BNY: Loaded 7446 existing records. [2025-09-23T17:41:08.763538] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:08.763902] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-23T17:41:08.763958] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-23T17:41:08.764303] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-23T17:41:08.764362] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-23T17:41:09.035453] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-23T17:41:09.052961] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T17:41:09.192942] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:09.595230] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-23T17:41:09.597322] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T17:41:09.802261] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-23T17:41:10.602169] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-23T17:41:10.653093] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T17:41:11.016851] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T17:41:11.402250] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-23T17:41:11.817576] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T17:41:12.202194] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-23T17:41:12.684012] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T17:41:13.002281] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-23T17:41:13.405000] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T17:41:13.802202] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-23T17:41:14.602218] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-23T17:41:15.299873] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T17:41:15.337326] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-23T17:41:15.402196] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-23T17:41:16.202239] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-23T17:41:16.608909] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-23T17:41:16.997500] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T17:41:17.007256] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-23T17:41:17.802192] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-23T17:41:18.292557] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:41:18.602200] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-23T17:41:19.015176] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T17:41:19.402237] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-23T17:41:19.538008] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T17:41:20.202290] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-23T17:41:20.684287] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:41:21.002216] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-23T17:41:21.605717] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T17:41:21.802172] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-23T17:41:21.856358] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T17:41:22.233154] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T17:41:22.602212] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-23T17:41:23.067547] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T17:41:23.402211] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-23T17:41:24.202199] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-23T17:41:25.002190] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-23T17:41:25.141483] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T17:41:25.402024] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T17:41:25.463609] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:41:25.802201] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-23T17:41:26.316739] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-23T17:41:26.602197] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-23T17:41:27.402209] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-23T17:41:28.174817] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:41:28.202147] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-23T17:41:28.829832] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T17:41:29.002193] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-23T17:41:29.531552] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T17:41:29.531373] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T17:41:29.540993] [INFO ] [REMOTE ] BNY: Full fetch complete (10504 records). [2025-09-23T17:41:29.541069] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-23T17:41:29.605613] [INFO ] [REMOTE ] BNL: Full fetch complete (66591 records). [2025-09-23T17:41:29.617080] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-23T17:41:29.818160] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-23T17:41:30.381443] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-23T17:41:30.413409] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-23T17:41:30.413589] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-23T17:41:30.414124] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-23T17:41:30.417550] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-23T17:41:30.419251] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T17:41:30.418971] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-23T17:41:30.421313] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-23T17:41:30.421422] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-23T17:41:30.422506] [DEBUG] [LOCAL ] BNY: Trimmed 10504 records to 7423 (keeping 200 days of data) [2025-09-23T17:41:30.441385] [DEBUG] [LOCAL ] BNL: Trimmed 66591 records to 46871 (keeping 200 days of data) [2025-09-23T17:41:30.556928] [DEBUG] [LOCAL ] BNY: Primary data saved (7423 records). [2025-09-23T17:41:30.559702] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-23T17:41:30.560060] [INFO ] [MAIN ] Update Progress: 316/2372 symbols completed. BNY took 22.2s. Estimated remaining: 4h 29m 43s. Rate: 7.6 symbols/min [2025-09-23T17:41:30.604084] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-23T17:41:30.835439] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:30.898511] [DEBUG] [LOCAL ] BOC: Loaded 18367 existing records from primary storage. [2025-09-23T17:41:30.900233] [INFO ] [MAIN ] BOC: Loaded 18367 existing records. [2025-09-23T17:41:31.100188] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:31.103506] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-23T17:41:31.103569] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-23T17:41:31.104094] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-23T17:41:31.104156] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-23T17:41:31.406073] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-23T17:41:31.406005] [DEBUG] [LOCAL ] BNL: Primary data saved (46871 records). [2025-09-23T17:41:31.412791] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-23T17:41:31.419158] [INFO ] [MAIN ] Update Progress: 317/2372 symbols completed. BNL took 36.2s. Estimated remaining: 4h 28m 50s. Rate: 7.6 symbols/min [2025-09-23T17:41:31.523436] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:31.749619] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T17:41:32.010776] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:41:32.202181] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-23T17:41:32.573180] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-23T17:41:33.002224] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-23T17:41:33.780185] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T17:41:33.802145] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-23T17:41:34.392327] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:41:34.602236] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-23T17:41:35.233688] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T17:41:35.402259] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-23T17:41:36.202197] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-23T17:41:36.739681] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T17:41:36.804392] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T17:41:37.002263] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-23T17:41:37.440283] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T17:41:37.802214] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-23T17:41:38.521437] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T17:41:38.602190] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-23T17:41:39.402173] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-23T17:41:39.568624] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:41:39.855525] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T17:41:39.857069] [INFO ] [REMOTE ] BNT: Full fetch complete (4444 records). [2025-09-23T17:41:39.857139] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-23T17:41:40.209098] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-23T17:41:40.209390] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-23T17:41:40.209490] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-23T17:41:40.210530] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-23T17:41:40.210611] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-23T17:41:40.211257] [DEBUG] [LOCAL ] BNT: Trimmed 4444 records to 3417 (keeping 200 days of data) [2025-09-23T17:41:40.232014] [DEBUG] [LOCAL ] BNT: Primary data saved (3417 records). [2025-09-23T17:41:40.232082] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-23T17:41:40.232156] [INFO ] [MAIN ] Update Progress: 318/2372 symbols completed. BNT took 33.4s. Estimated remaining: 4h 28m 48s. Rate: 7.6 symbols/min [2025-09-23T17:41:40.918605] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:41:41.002141] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-23T17:41:41.685455] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T17:41:41.802231] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-23T17:41:42.495861] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T17:41:42.602239] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-23T17:41:43.321307] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T17:41:43.325226] [INFO ] [REMOTE ] BOC: Full fetch complete (25819 records). [2025-09-23T17:41:43.325342] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-23T17:41:43.411440] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-23T17:41:43.700878] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-23T17:41:43.700955] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-23T17:41:43.701330] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-23T17:41:43.701368] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-23T17:41:43.702057] [DEBUG] [LOCAL ] BOC: Trimmed 25819 records to 18394 (keeping 200 days of data) [2025-09-23T17:41:43.804604] [DEBUG] [LOCAL ] BOC: Primary data saved (18394 records). [2025-09-23T17:41:43.804763] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-23T17:41:43.804852] [INFO ] [MAIN ] Update Progress: 319/2372 symbols completed. BOC took 13.2s. Estimated remaining: 4h 28m 13s. Rate: 7.7 symbols/min [2025-09-23T17:41:45.085956] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T17:41:45.098130] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-23T17:41:46.333872] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T17:41:46.344633] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-23T17:41:48.035513] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T17:41:48.044849] [INFO ] [REMOTE ] BNS: Full fetch complete (74200 records). [2025-09-23T17:41:48.045004] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-23T17:41:48.459007] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-23T17:41:48.459116] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-23T17:41:48.460001] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-23T17:41:48.460086] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-23T17:41:48.461851] [DEBUG] [LOCAL ] BNS: Trimmed 74200 records to 51460 (keeping 200 days of data) [2025-09-23T17:41:48.788850] [DEBUG] [LOCAL ] BNS: Primary data saved (51460 records). [2025-09-23T17:41:48.789002] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-23T17:41:48.789094] [INFO ] [MAIN ] Update Progress: 320/2372 symbols completed. BNS took 43.7s. Estimated remaining: 4h 27m 47s. Rate: 7.7 symbols/min [2025-09-23T17:41:49.451955] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:49.466742] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:49.495971] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:49.517220] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:49.539241] [DEBUG] [LOCAL ] BOE: Loaded 17665 existing records from primary storage. [2025-09-23T17:41:49.539424] [INFO ] [MAIN ] BOE: Loaded 17665 existing records. [2025-09-23T17:41:49.749249] [DEBUG] [LOCAL ] BOH: Loaded 31418 existing records from primary storage. [2025-09-23T17:41:49.782065] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:49.794589] [INFO ] [MAIN ] BOH: Loaded 31418 existing records. [2025-09-23T17:41:49.825885] [DEBUG] [LOCAL ] BOOT: Loaded 41054 existing records from primary storage. [2025-09-23T17:41:49.825273] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-23T17:41:49.851430] [INFO ] [MAIN ] BOOT: Loaded 41054 existing records. [2025-09-23T17:41:49.836760] [DEBUG] [LOCAL ] BOND: Loaded 32096 existing records from primary storage. [2025-09-23T17:41:49.865766] [INFO ] [MAIN ] BOND: Loaded 32096 existing records. [2025-09-23T17:41:49.860419] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-23T17:41:49.939676] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-23T17:41:49.953738] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-23T17:41:50.249708] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:50.472340] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:50.453639] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-23T17:41:50.525376] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-23T17:41:50.539736] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-23T17:41:50.558732] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:50.558872] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-23T17:41:50.600458] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-23T17:41:50.621824] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-23T17:41:50.622022] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-23T17:41:50.621742] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-23T17:41:50.627465] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-23T17:41:50.643361] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-23T17:41:50.658688] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-23T17:41:50.696558] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-23T17:41:51.230739] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:51.383174] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-23T17:41:51.738122] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:51.798735] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-23T17:41:51.845233] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:51.895999] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-23T17:41:51.901153] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:51.901602] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-23T17:41:52.244014] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:41:52.248948] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-23T17:41:52.880466] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T17:41:52.900502] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-23T17:41:52.902272] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:41:52.908133] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-23T17:41:52.977986] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T17:41:52.982456] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-23T17:41:53.124394] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T17:41:53.132518] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-23T17:41:53.729174] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T17:41:53.733324] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-23T17:41:53.976826] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T17:41:53.985798] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-23T17:41:54.175679] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:41:54.444792] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T17:41:54.602200] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-23T17:41:54.666871] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T17:41:54.863476] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T17:41:55.402194] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-23T17:41:55.445489] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T17:41:56.202243] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-23T17:41:56.514413] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:41:57.002174] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-23T17:41:57.030270] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:41:57.802198] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-23T17:41:58.096310] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T17:41:58.602184] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-23T17:41:58.989873] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:41:59.236130] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T17:41:59.402225] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-23T17:42:00.202191] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-23T17:42:00.801686] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T17:42:01.002214] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-23T17:42:01.796923] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:42:01.806770] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-23T17:42:02.200549] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T17:42:02.602258] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-23T17:42:03.402217] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-23T17:42:04.194165] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T17:42:04.202145] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-23T17:42:04.335431] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T17:42:04.904714] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T17:42:04.980123] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T17:42:05.002240] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-23T17:42:05.802264] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-23T17:42:06.407770] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T17:42:06.602219] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-23T17:42:06.799114] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T17:42:07.402244] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-23T17:42:07.473158] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T17:42:07.477106] [INFO ] [REMOTE ] BOE: Full fetch complete (26674 records). [2025-09-23T17:42:07.477197] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-23T17:42:07.898276] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-23T17:42:07.898371] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-23T17:42:07.898776] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-23T17:42:07.898839] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-23T17:42:07.899538] [DEBUG] [LOCAL ] BOE: Trimmed 26674 records to 17606 (keeping 200 days of data) [2025-09-23T17:42:08.011395] [DEBUG] [LOCAL ] BOE: Primary data saved (17606 records). [2025-09-23T17:42:08.011548] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-23T17:42:08.011667] [INFO ] [MAIN ] Update Progress: 321/2372 symbols completed. BOE took 19.2s. Estimated remaining: 4h 28m 52s. Rate: 7.6 symbols/min [2025-09-23T17:42:08.200248] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:08.202270] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-23T17:42:08.266559] [DEBUG] [LOCAL ] BORR: Loaded 51168 existing records from primary storage. [2025-09-23T17:42:08.266739] [INFO ] [MAIN ] BORR: Loaded 51168 existing records. [2025-09-23T17:42:08.453002] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:08.453325] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-23T17:42:08.453403] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-23T17:42:08.454800] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-23T17:42:08.454864] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-23T17:42:08.838996] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:08.865758] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T17:42:09.002239] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-23T17:42:09.131336] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:42:09.802205] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-23T17:42:10.159681] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T17:42:10.602212] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-23T17:42:11.375268] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T17:42:11.402156] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-23T17:42:11.862814] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:42:12.202210] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-23T17:42:12.329197] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T17:42:13.002204] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-23T17:42:13.297037] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T17:42:13.802227] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-23T17:42:14.478008] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:42:14.602189] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-23T17:42:15.402199] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-23T17:42:15.848690] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T17:42:16.204286] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-23T17:42:16.206044] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T17:42:16.218898] [INFO ] [REMOTE ] BOND: Full fetch complete (46291 records). [2025-09-23T17:42:16.219107] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-23T17:42:16.614317] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-23T17:42:16.614417] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-23T17:42:16.615041] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-23T17:42:16.615181] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-23T17:42:16.616314] [DEBUG] [LOCAL ] BOND: Trimmed 46291 records to 32076 (keeping 200 days of data) [2025-09-23T17:42:16.832777] [DEBUG] [LOCAL ] BOND: Primary data saved (32076 records). [2025-09-23T17:42:16.833063] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-23T17:42:16.833356] [INFO ] [MAIN ] Update Progress: 322/2372 symbols completed. BOND took 28.0s. Estimated remaining: 4h 28m 50s. Rate: 7.6 symbols/min [2025-09-23T17:42:16.970732] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:42:17.005245] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-23T17:42:17.060358] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:17.094121] [DEBUG] [LOCAL ] BOW: Loaded 23622 existing records from primary storage. [2025-09-23T17:42:17.094385] [INFO ] [MAIN ] BOW: Loaded 23622 existing records. [2025-09-23T17:42:17.299727] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:17.300457] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-23T17:42:17.300676] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-23T17:42:17.301586] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-23T17:42:17.301749] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-23T17:42:17.435177] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:42:17.701775] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:17.802195] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-23T17:42:18.497895] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T17:42:18.560154] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T17:42:18.602170] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-23T17:42:19.402189] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-23T17:42:19.917624] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:42:20.202193] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-23T17:42:20.474167] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T17:42:20.480544] [INFO ] [REMOTE ] BOH: Full fetch complete (44846 records). [2025-09-23T17:42:20.480669] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-23T17:42:20.852686] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-23T17:42:20.852774] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-23T17:42:20.853279] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-23T17:42:20.853319] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-23T17:42:20.854300] [DEBUG] [LOCAL ] BOH: Trimmed 44846 records to 31414 (keeping 200 days of data) [2025-09-23T17:42:21.028368] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-23T17:42:21.068914] [DEBUG] [LOCAL ] BOH: Primary data saved (31414 records). [2025-09-23T17:42:21.069052] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-23T17:42:21.069174] [INFO ] [MAIN ] Update Progress: 323/2372 symbols completed. BOH took 32.3s. Estimated remaining: 4h 28m 19s. Rate: 7.6 symbols/min [2025-09-23T17:42:21.248175] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:21.300350] [DEBUG] [LOCAL ] BOX: Loaded 50341 existing records from primary storage. [2025-09-23T17:42:21.300491] [INFO ] [MAIN ] BOX: Loaded 50341 existing records. [2025-09-23T17:42:21.484267] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:21.484599] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-23T17:42:21.484705] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-23T17:42:21.486618] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-23T17:42:21.486721] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-23T17:42:21.816220] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-23T17:42:21.830792] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:42:21.880836] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:21.884693] [INFO ] [REMOTE ] BOOT: Full fetch complete (60345 records). [2025-09-23T17:42:21.884827] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-23T17:42:22.282160] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-23T17:42:22.282329] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-23T17:42:22.283002] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-23T17:42:22.283812] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-23T17:42:22.285371] [DEBUG] [LOCAL ] BOOT: Trimmed 60345 records to 40931 (keeping 200 days of data) [2025-09-23T17:42:22.431600] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T17:42:22.563265] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T17:42:22.604681] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-23T17:42:22.607373] [DEBUG] [LOCAL ] BOOT: Primary data saved (40931 records). [2025-09-23T17:42:22.607488] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-23T17:42:22.607614] [INFO ] [MAIN ] Update Progress: 324/2372 symbols completed. BOOT took 33.8s. Estimated remaining: 4h 27m 31s. Rate: 7.7 symbols/min [2025-09-23T17:42:22.778119] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:22.835137] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-23T17:42:22.835311] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-09-23T17:42:23.082888] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:23.083150] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-23T17:42:23.083198] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-23T17:42:23.084860] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-23T17:42:23.084923] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-23T17:42:23.407393] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-23T17:42:23.472365] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:24.018991] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T17:42:24.202205] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-23T17:42:24.379704] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T17:42:25.002210] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-23T17:42:25.168824] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T17:42:25.802269] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-23T17:42:26.602272] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-23T17:42:26.770850] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T17:42:27.187915] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T17:42:27.402203] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-23T17:42:28.003999] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:42:28.202203] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-23T17:42:29.002215] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-23T17:42:29.178540] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T17:42:29.340045] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:42:29.802213] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-23T17:42:30.502047] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T17:42:30.602219] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-23T17:42:30.789482] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T17:42:31.402226] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-23T17:42:32.197427] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:42:32.207694] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-23T17:42:32.226245] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T17:42:33.002205] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-23T17:42:33.714882] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:42:33.802161] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-23T17:42:33.914246] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T17:42:34.429776] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:42:34.602213] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-23T17:42:35.402204] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-23T17:42:36.146155] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T17:42:36.202190] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-23T17:42:37.002202] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-23T17:42:37.213395] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T17:42:37.802208] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-23T17:42:37.860097] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T17:42:38.003496] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T17:42:38.602196] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-23T17:42:39.314227] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T17:42:39.391058] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T17:42:39.395176] [INFO ] [REMOTE ] BOW: Full fetch complete (31126 records). [2025-09-23T17:42:39.395262] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-23T17:42:39.407292] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-23T17:42:39.766385] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-23T17:42:39.766463] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-23T17:42:39.766901] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-23T17:42:39.766964] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-23T17:42:39.767743] [DEBUG] [LOCAL ] BOW: Trimmed 31126 records to 23640 (keeping 200 days of data) [2025-09-23T17:42:39.903140] [DEBUG] [LOCAL ] BOW: Primary data saved (23640 records). [2025-09-23T17:42:39.903268] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-23T17:42:39.903353] [INFO ] [MAIN ] Update Progress: 325/2372 symbols completed. BOW took 23.1s. Estimated remaining: 4h 28m 23s. Rate: 7.6 symbols/min [2025-09-23T17:42:40.070106] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:40.115007] [DEBUG] [LOCAL ] BR: Loaded 34832 existing records from primary storage. [2025-09-23T17:42:40.115165] [INFO ] [MAIN ] BR: Loaded 34832 existing records. [2025-09-23T17:42:40.210395] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-23T17:42:40.291182] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:40.291457] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-23T17:42:40.291505] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-23T17:42:40.292671] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-23T17:42:40.292734] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-23T17:42:40.644587] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:41.002187] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-23T17:42:41.349696] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T17:42:41.664905] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:42:41.673605] [INFO ] [REMOTE ] BORR: Full fetch complete (74772 records). [2025-09-23T17:42:41.673805] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-23T17:42:41.807319] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-23T17:42:42.105439] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-23T17:42:42.105595] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-23T17:42:42.106836] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-23T17:42:42.106989] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-23T17:42:42.108909] [DEBUG] [LOCAL ] BORR: Trimmed 74772 records to 51182 (keeping 200 days of data) [2025-09-23T17:42:42.221294] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T17:42:42.435197] [DEBUG] [LOCAL ] BORR: Primary data saved (51182 records). [2025-09-23T17:42:42.435362] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-23T17:42:42.435459] [INFO ] [MAIN ] Update Progress: 326/2372 symbols completed. BORR took 34.4s. Estimated remaining: 4h 27m 42s. Rate: 7.6 symbols/min [2025-09-23T17:42:42.605267] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:42.605398] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-23T17:42:42.657450] [DEBUG] [LOCAL ] BRBR: Loaded 51236 existing records from primary storage. [2025-09-23T17:42:42.657605] [INFO ] [MAIN ] BRBR: Loaded 51236 existing records. [2025-09-23T17:42:42.839478] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:42.839796] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-23T17:42:42.839849] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-23T17:42:42.841434] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-23T17:42:42.841498] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-23T17:42:43.193531] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:43.294269] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T17:42:43.402166] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-23T17:42:44.202255] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-23T17:42:44.502735] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T17:42:45.002209] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-23T17:42:45.063234] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T17:42:45.537033] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T17:42:45.802203] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-23T17:42:46.123554] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T17:42:46.602194] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-23T17:42:47.055160] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T17:42:47.402204] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-23T17:42:47.526800] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T17:42:48.202199] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-23T17:42:48.640310] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T17:42:49.002242] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-23T17:42:49.800583] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:42:49.809402] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-23T17:42:50.408881] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:42:50.602237] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-23T17:42:51.132764] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T17:42:51.402208] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-23T17:42:52.202160] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-23T17:42:52.204873] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:42:52.720045] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:42:53.002207] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-23T17:42:53.802237] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-23T17:42:54.212556] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-23T17:42:54.346848] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:42:54.602152] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-23T17:42:55.059377] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T17:42:55.402214] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-23T17:42:56.004900] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:42:56.013582] [INFO ] [REMOTE ] BOX: Full fetch complete (72163 records). [2025-09-23T17:42:56.013742] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-23T17:42:56.204716] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-23T17:42:56.427532] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-23T17:42:56.427618] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-23T17:42:56.428440] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-23T17:42:56.428506] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-23T17:42:56.429963] [DEBUG] [LOCAL ] BOX: Trimmed 72163 records to 50321 (keeping 200 days of data) [2025-09-23T17:42:56.666882] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:42:56.759380] [DEBUG] [LOCAL ] BOX: Primary data saved (50321 records). [2025-09-23T17:42:56.759520] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-23T17:42:56.759604] [INFO ] [MAIN ] Update Progress: 327/2372 symbols completed. BOX took 35.7s. Estimated remaining: 4h 28m 14s. Rate: 7.6 symbols/min [2025-09-23T17:42:56.936941] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:56.956331] [DEBUG] [LOCAL ] BRC: Loaded 19492 existing records from primary storage. [2025-09-23T17:42:56.956457] [INFO ] [MAIN ] BRC: Loaded 19492 existing records. [2025-09-23T17:42:57.009950] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-23T17:42:57.136921] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:57.137141] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-23T17:42:57.137189] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-23T17:42:57.137847] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-23T17:42:57.137909] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-23T17:42:57.545814] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:57.775633] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T17:42:57.802246] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-23T17:42:58.602314] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-23T17:42:58.945991] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T17:42:59.065081] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:42:59.402236] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-23T17:42:59.906378] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:43:00.202199] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-23T17:43:01.002274] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T17:43:01.002439] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-23T17:43:01.591409] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:43:01.802196] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-23T17:43:02.379868] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T17:43:02.602209] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-23T17:43:03.242326] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:43:03.402158] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-23T17:43:04.202252] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-23T17:43:04.939326] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-23T17:43:04.976806] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:43:04.985814] [INFO ] [REMOTE ] BRBR: Full fetch complete (71740 records). [2025-09-23T17:43:04.985981] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-23T17:43:05.007564] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-23T17:43:05.403828] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-23T17:43:05.403951] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-23T17:43:05.404802] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-23T17:43:05.404885] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-23T17:43:05.406434] [DEBUG] [LOCAL ] BRBR: Trimmed 71740 records to 51231 (keeping 200 days of data) [2025-09-23T17:43:05.522193] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T17:43:05.731369] [DEBUG] [LOCAL ] BRBR: Primary data saved (51231 records). [2025-09-23T17:43:05.731524] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-23T17:43:05.731610] [INFO ] [MAIN ] Update Progress: 328/2372 symbols completed. BRBR took 23.3s. Estimated remaining: 4h 28m 13s. Rate: 7.6 symbols/min [2025-09-23T17:43:05.807319] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-23T17:43:05.923975] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:05.964736] [DEBUG] [LOCAL ] BRCC: Loaded 40430 existing records from primary storage. [2025-09-23T17:43:05.964901] [INFO ] [MAIN ] BRCC: Loaded 40430 existing records. [2025-09-23T17:43:06.166496] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:06.166836] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-23T17:43:06.166891] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-23T17:43:06.167936] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-23T17:43:06.167999] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-23T17:43:06.312196] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T17:43:06.550706] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:06.602155] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-23T17:43:07.028968] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T17:43:07.035412] [INFO ] [REMOTE ] BR: Full fetch complete (48985 records). [2025-09-23T17:43:07.035543] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-23T17:43:07.414296] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-23T17:43:07.467761] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-23T17:43:07.467845] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-23T17:43:07.468469] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-23T17:43:07.468532] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-23T17:43:07.469599] [DEBUG] [LOCAL ] BR: Trimmed 48985 records to 34778 (keeping 200 days of data) [2025-09-23T17:43:07.700343] [DEBUG] [LOCAL ] BR: Primary data saved (34778 records). [2025-09-23T17:43:07.700498] [INFO ] [MAIN ] BR: Full history saved. [2025-09-23T17:43:07.701843] [INFO ] [MAIN ] Update Progress: 329/2372 symbols completed. BR took 27.8s. Estimated remaining: 4h 27m 29s. Rate: 7.6 symbols/min [2025-09-23T17:43:07.889359] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:07.962371] [DEBUG] [LOCAL ] BRO: Loaded 51919 existing records from primary storage. [2025-09-23T17:43:07.962733] [INFO ] [MAIN ] BRO: Loaded 51919 existing records. [2025-09-23T17:43:08.146187] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:43:08.185950] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:08.186573] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-23T17:43:08.186623] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-23T17:43:08.188064] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-23T17:43:08.188125] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-23T17:43:08.208772] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-23T17:43:08.552241] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:09.002229] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-23T17:43:09.231045] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T17:43:09.240270] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-23T17:43:09.240415] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-23T17:43:09.658278] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T17:43:09.689948] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-23T17:43:09.690315] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-23T17:43:09.691157] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-23T17:43:09.691228] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-23T17:43:09.693348] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 53711 (keeping 200 days of data) [2025-09-23T17:43:09.802359] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-23T17:43:09.822418] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T17:43:10.050105] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-23T17:43:10.050313] [INFO ] [MAIN ] BP: Full history saved. [2025-09-23T17:43:10.050415] [INFO ] [MAIN ] Update Progress: 330/2372 symbols completed. BP took 47.4s. Estimated remaining: 4h 26m 47s. Rate: 7.7 symbols/min [2025-09-23T17:43:10.234152] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:10.287582] [DEBUG] [LOCAL ] BROS: Loaded 53287 existing records from primary storage. [2025-09-23T17:43:10.287783] [INFO ] [MAIN ] BROS: Loaded 53287 existing records. [2025-09-23T17:43:10.480391] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:10.480709] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-23T17:43:10.480765] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-23T17:43:10.481842] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-23T17:43:10.481902] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-23T17:43:10.607369] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-23T17:43:10.853632] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:10.873853] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T17:43:11.402301] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-23T17:43:11.733789] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T17:43:12.202200] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-23T17:43:13.002207] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-23T17:43:13.079248] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T17:43:13.176932] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T17:43:13.802210] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-23T17:43:14.184148] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T17:43:14.602230] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-23T17:43:15.203568] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:43:15.402214] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-23T17:43:15.639709] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T17:43:16.202254] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-23T17:43:16.957949] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:43:17.002211] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-23T17:43:17.370815] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T17:43:17.802224] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-23T17:43:18.512877] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T17:43:18.602263] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-23T17:43:18.975609] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:43:19.402272] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-23T17:43:19.827131] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:43:20.202217] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-23T17:43:20.914396] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T17:43:21.002224] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-23T17:43:21.714065] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:43:21.802237] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-23T17:43:22.248458] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T17:43:22.602201] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-23T17:43:23.402188] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-23T17:43:23.472251] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T17:43:24.041159] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T17:43:24.202763] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-23T17:43:24.348900] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T17:43:24.834470] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:43:25.002213] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-23T17:43:25.802201] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-23T17:43:26.427383] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:43:26.602232] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-23T17:43:26.945901] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:43:27.216788] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T17:43:27.402203] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-23T17:43:28.202229] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-23T17:43:29.002193] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-23T17:43:29.059489] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T17:43:29.475483] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T17:43:29.802352] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-23T17:43:29.824057] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T17:43:29.827783] [INFO ] [REMOTE ] BRC: Full fetch complete (29147 records). [2025-09-23T17:43:29.827887] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-23T17:43:30.215431] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-23T17:43:30.215534] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-23T17:43:30.216125] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-23T17:43:30.216191] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-23T17:43:30.217282] [DEBUG] [LOCAL ] BRC: Trimmed 29147 records to 19365 (keeping 200 days of data) [2025-09-23T17:43:30.345224] [DEBUG] [LOCAL ] BRC: Primary data saved (19365 records). [2025-09-23T17:43:30.345460] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-23T17:43:30.345585] [INFO ] [MAIN ] Update Progress: 331/2372 symbols completed. BRC took 33.6s. Estimated remaining: 4h 27m 56s. Rate: 7.6 symbols/min [2025-09-23T17:43:30.520926] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:30.521214] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-23T17:43:30.521252] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-23T17:43:30.521441] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-23T17:43:30.521486] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-23T17:43:30.521530] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-23T17:43:30.521629] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-23T17:43:30.607397] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-23T17:43:30.928108] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:31.187470] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T17:43:31.402239] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-23T17:43:32.202253] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-23T17:43:32.809557] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-23T17:43:33.002205] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-23T17:43:33.028425] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:43:33.036263] [INFO ] [REMOTE ] BRCC: Full fetch complete (58038 records). [2025-09-23T17:43:33.036436] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-23T17:43:33.441139] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-23T17:43:33.441219] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-23T17:43:33.441864] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-23T17:43:33.441928] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-23T17:43:33.443142] [DEBUG] [LOCAL ] BRCC: Trimmed 58038 records to 40441 (keeping 200 days of data) [2025-09-23T17:43:33.669618] [DEBUG] [LOCAL ] BRCC: Primary data saved (40441 records). [2025-09-23T17:43:33.669808] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-23T17:43:33.669902] [INFO ] [MAIN ] Update Progress: 332/2372 symbols completed. BRCC took 27.9s. Estimated remaining: 4h 27m 20s. Rate: 7.6 symbols/min [2025-09-23T17:43:33.816012] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-23T17:43:33.841418] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:33.879425] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T17:43:33.920491] [DEBUG] [LOCAL ] BRSP: Loaded 36916 existing records from primary storage. [2025-09-23T17:43:33.920670] [INFO ] [MAIN ] BRSP: Loaded 36916 existing records. [2025-09-23T17:43:34.063737] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:34.106189] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-23T17:43:34.106400] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:34.107514] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-23T17:43:34.107581] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-23T17:43:34.108694] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-23T17:43:34.108757] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-23T17:43:34.490765] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:34.602150] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-23T17:43:34.658782] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T17:43:35.402205] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-23T17:43:35.608242] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:35.608574] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-23T17:43:35.705295] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:43:36.202233] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-23T17:43:37.002180] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-23T17:43:37.164932] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T17:43:37.802247] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-23T17:43:38.602182] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-23T17:43:38.769419] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T17:43:38.855694] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T17:43:39.402191] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-23T17:43:40.202206] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-23T17:43:40.460190] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T17:43:40.552192] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T17:43:41.002189] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-23T17:43:41.630962] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T17:43:41.639767] [INFO ] [REMOTE ] BRO: Full fetch complete (74146 records). [2025-09-23T17:43:41.639913] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-23T17:43:41.810486] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-23T17:43:42.071102] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-23T17:43:42.071195] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-23T17:43:42.071992] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-23T17:43:42.072065] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-23T17:43:42.073771] [DEBUG] [LOCAL ] BRO: Trimmed 74146 records to 51916 (keeping 200 days of data) [2025-09-23T17:43:42.130453] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:42.166429] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-23T17:43:42.411916] [DEBUG] [LOCAL ] BRO: Primary data saved (51916 records). [2025-09-23T17:43:42.412054] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-23T17:43:42.412592] [INFO ] [MAIN ] Update Progress: 333/2372 symbols completed. BRO took 34.7s. Estimated remaining: 4h 27m 18s. Rate: 7.6 symbols/min [2025-09-23T17:43:42.583961] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:42.606187] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-23T17:43:42.613147] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T17:43:42.626008] [DEBUG] [LOCAL ] BRT: Loaded 4876 existing records from primary storage. [2025-09-23T17:43:42.626426] [INFO ] [MAIN ] BRT: Loaded 4876 existing records. [2025-09-23T17:43:42.811400] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:42.811727] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-23T17:43:42.811784] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-23T17:43:42.812125] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-23T17:43:42.812187] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-23T17:43:42.880851] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:42.903047] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-23T17:43:43.192598] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:43.402208] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-23T17:43:43.963420] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-23T17:43:44.202218] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-23T17:43:45.002203] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-23T17:43:45.106529] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:43:45.406990] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:43:45.802230] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-23T17:43:46.602226] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-23T17:43:46.822587] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T17:43:47.402243] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-23T17:43:48.205835] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-23T17:43:48.211607] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T17:43:48.426863] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T17:43:48.545786] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T17:43:49.002217] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-23T17:43:49.206242] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:49.206546] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-23T17:43:49.802248] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-23T17:43:50.602235] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-23T17:43:50.800778] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:50.801276] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-23T17:43:50.968634] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:43:51.402218] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-23T17:43:52.202281] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-23T17:43:53.002218] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-23T17:43:53.163294] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T17:43:53.169282] [INFO ] [REMOTE ] BRSP: Full fetch complete (53642 records). [2025-09-23T17:43:53.169411] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-23T17:43:53.170156] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:43:53.170245] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:43:53.170303] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:43:53.170394] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-23T17:43:53.170474] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-23T17:43:53.170537] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-09-23T17:43:53.171174] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-09-23T17:43:53.171288] [INFO ] [MAIN ] Update Progress: 334/2372 symbols completed. BRSP took 19.5s. Estimated remaining: 4h 27m 27s. Rate: 7.6 symbols/min [2025-09-23T17:43:53.354174] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:53.374677] [DEBUG] [LOCAL ] BRW: Loaded 19139 existing records from primary storage. [2025-09-23T17:43:53.374820] [INFO ] [MAIN ] BRW: Loaded 19139 existing records. [2025-09-23T17:43:53.491892] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-23T17:43:53.580888] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:53.581505] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-23T17:43:53.581639] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-23T17:43:53.591666] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-23T17:43:53.606727] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-23T17:43:53.682095] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-23T17:43:53.733734] [INFO ] [REMOTE ] BROS: Full fetch complete (76572 records). [2025-09-23T17:43:53.749404] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-23T17:43:53.777899] [FATAL] [VALIDATOR ] BROS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:43:53.793896] [FATAL] [MAIN ] BROS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:43:53.795960] [WARN ] [MAIN ] BROS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:43:53.810862] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-23T17:43:53.820988] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-23T17:43:53.862900] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-23T17:43:53.875764] [INFO ] [LOCAL ] BROS: Starting deletion of derivative data. [2025-09-23T17:43:53.902819] [DEBUG] [LOCAL ] BROS: Deleted derivative data file. [2025-09-23T17:43:53.924726] [INFO ] [MAIN ] Update Progress: 335/2372 symbols completed. BROS took 43.9s. Estimated remaining: 4h 26m 36s. Rate: 7.6 symbols/min [2025-09-23T17:43:54.128523] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:54.145942] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:54.186673] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-23T17:43:54.190331] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:54.240832] [DEBUG] [LOCAL ] BRX: Loaded 51826 existing records from primary storage. [2025-09-23T17:43:54.241048] [INFO ] [MAIN ] BRX: Loaded 51826 existing records. [2025-09-23T17:43:54.430350] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:54.430630] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-23T17:43:54.430715] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-23T17:43:54.432215] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-23T17:43:54.432281] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-23T17:43:54.612749] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-23T17:43:54.808297] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:55.402207] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-23T17:43:56.054863] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:43:56.202202] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-23T17:43:56.789803] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:43:57.002208] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-23T17:43:57.395785] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T17:43:57.802268] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-23T17:43:58.602265] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-23T17:43:58.654829] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:43:59.061113] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:43:59.069001] [INFO ] [REMOTE ] BRSL: Full fetch complete (21252 records). [2025-09-23T17:43:59.069076] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-23T17:43:59.249396] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 58 unique days, need 200 days [2025-09-23T17:43:59.249752] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:43:59.249823] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:43:59.249893] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-23T17:43:59.250018] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-23T17:43:59.250073] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-23T17:43:59.250117] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-23T17:43:59.250174] [INFO ] [MAIN ] Update Progress: 336/2372 symbols completed. BRSL took 28.9s. Estimated remaining: 4h 26m 13s. Rate: 7.6 symbols/min [2025-09-23T17:43:59.417111] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:59.417324] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-09-23T17:43:59.417453] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-09-23T17:43:59.413124] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-23T17:43:59.418802] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-23T17:43:59.418964] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-23T17:43:59.419087] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-09-23T17:43:59.419190] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-23T17:43:59.585231] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T17:43:59.790746] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:00.014593] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T17:44:00.202225] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-23T17:44:00.627945] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T17:44:01.002248] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-23T17:44:01.580291] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T17:44:01.802347] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-23T17:44:02.597324] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T17:44:02.602138] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-23T17:44:03.398952] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:44:03.403827] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-23T17:44:04.202162] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-23T17:44:04.606456] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T17:44:04.969277] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T17:44:05.002142] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-23T17:44:05.802303] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-23T17:44:06.602168] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-23T17:44:06.649607] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:44:07.128101] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T17:44:07.402159] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-23T17:44:07.797120] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:44:08.202235] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-23T17:44:08.810515] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:44:08.869391] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T17:44:09.002233] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-23T17:44:09.802175] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-23T17:44:10.024871] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:44:10.299927] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:44:10.602194] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-23T17:44:11.402227] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-23T17:44:11.905716] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T17:44:11.907610] [INFO ] [REMOTE ] BRT: Full fetch complete (6816 records). [2025-09-23T17:44:11.907761] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-23T17:44:12.207343] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-23T17:44:12.317686] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-23T17:44:12.317953] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-23T17:44:12.318338] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-23T17:44:12.318423] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-23T17:44:12.319380] [DEBUG] [LOCAL ] BRT: Trimmed 6816 records to 4949 (keeping 200 days of data) [2025-09-23T17:44:12.396313] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T17:44:12.418364] [DEBUG] [LOCAL ] BRT: Primary data saved (4949 records). [2025-09-23T17:44:12.418676] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-23T17:44:12.418875] [INFO ] [MAIN ] Update Progress: 337/2372 symbols completed. BRT took 30.0s. Estimated remaining: 4h 26m 37s. Rate: 7.6 symbols/min [2025-09-23T17:44:12.619428] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:12.619770] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-09-23T17:44:12.619831] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-09-23T17:44:12.620006] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-23T17:44:12.620066] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-23T17:44:12.620137] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-09-23T17:44:12.620176] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-23T17:44:13.007421] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:13.002464] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-23T17:44:13.135033] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T17:44:13.802277] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-23T17:44:14.194018] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:44:14.602206] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-23T17:44:14.758626] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:44:15.402200] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-23T17:44:15.558894] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:44:16.202212] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-23T17:44:16.389355] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T17:44:17.002200] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-23T17:44:17.117016] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T17:44:17.802195] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-23T17:44:18.607316] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-23T17:44:18.617584] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T17:44:18.872890] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T17:44:19.219836] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T17:44:19.402193] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-23T17:44:20.202199] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-23T17:44:20.730441] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:44:21.002197] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-23T17:44:21.489725] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:44:21.802205] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-23T17:44:21.841837] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T17:44:22.602233] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-23T17:44:23.168702] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T17:44:23.342965] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T17:44:23.402155] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-23T17:44:24.186261] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T17:44:24.190538] [INFO ] [REMOTE ] BRW: Full fetch complete (29316 records). [2025-09-23T17:44:24.190636] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-23T17:44:24.207344] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-23T17:44:24.581996] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-23T17:44:24.582094] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-23T17:44:24.582613] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-23T17:44:24.582754] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-23T17:44:24.583597] [DEBUG] [LOCAL ] BRW: Trimmed 29316 records to 18999 (keeping 200 days of data) [2025-09-23T17:44:24.708795] [DEBUG] [LOCAL ] BRW: Primary data saved (18999 records). [2025-09-23T17:44:24.708945] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-23T17:44:24.709107] [INFO ] [MAIN ] Update Progress: 338/2372 symbols completed. BRW took 31.5s. Estimated remaining: 4h 26m 56s. Rate: 7.6 symbols/min [2025-09-23T17:44:24.883760] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:24.897571] [DEBUG] [LOCAL ] BSL: Loaded 7898 existing records from primary storage. [2025-09-23T17:44:24.897743] [INFO ] [MAIN ] BSL: Loaded 7898 existing records. [2025-09-23T17:44:25.007445] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-23T17:44:25.086156] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:25.086417] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-23T17:44:25.086470] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-23T17:44:25.086959] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-23T17:44:25.087054] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-23T17:44:25.476430] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:25.501636] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T17:44:25.802210] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-23T17:44:26.095693] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:44:26.602214] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-23T17:44:27.133861] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T17:44:27.402209] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-23T17:44:27.865422] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:44:28.034048] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T17:44:28.202248] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-23T17:44:29.002227] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-23T17:44:29.163411] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T17:44:29.802238] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-23T17:44:30.293154] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:44:30.304110] [INFO ] [REMOTE ] BRX: Full fetch complete (74950 records). [2025-09-23T17:44:30.304305] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-23T17:44:30.605520] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-23T17:44:30.741585] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-23T17:44:30.743874] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-23T17:44:30.744973] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-23T17:44:30.745539] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-23T17:44:30.746626] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T17:44:30.754904] [DEBUG] [LOCAL ] BRX: Trimmed 74950 records to 51807 (keeping 200 days of data) [2025-09-23T17:44:31.091356] [DEBUG] [LOCAL ] BRX: Primary data saved (51807 records). [2025-09-23T17:44:31.091630] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-23T17:44:31.091803] [INFO ] [MAIN ] Update Progress: 339/2372 symbols completed. BRX took 37.2s. Estimated remaining: 4h 26m 39s. Rate: 7.6 symbols/min [2025-09-23T17:44:31.279578] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:31.314842] [DEBUG] [LOCAL ] BSM: Loaded 32330 existing records from primary storage. [2025-09-23T17:44:31.314992] [INFO ] [MAIN ] BSM: Loaded 32330 existing records. [2025-09-23T17:44:31.410793] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-23T17:44:31.495398] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:31.495868] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-23T17:44:31.496056] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-23T17:44:31.497534] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-23T17:44:31.497599] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-23T17:44:31.759119] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:44:31.911725] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:31.945269] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T17:44:32.202206] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-23T17:44:32.739601] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T17:44:33.002218] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-23T17:44:33.802206] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-23T17:44:34.131293] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:44:34.602213] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-23T17:44:34.888870] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T17:44:35.402207] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-23T17:44:35.466849] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T17:44:36.202215] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-23T17:44:36.694032] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:44:36.700487] [INFO ] [REMOTE ] BSAC: Full fetch complete (43532 records). [2025-09-23T17:44:36.700584] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-23T17:44:37.003801] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-23T17:44:37.097787] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-23T17:44:37.097882] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-23T17:44:37.098425] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-23T17:44:37.098466] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-23T17:44:37.101352] [DEBUG] [LOCAL ] BSAC: Trimmed 43532 records to 32985 (keeping 200 days of data) [2025-09-23T17:44:37.309557] [DEBUG] [LOCAL ] BSAC: Primary data saved (32985 records). [2025-09-23T17:44:37.309860] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-23T17:44:37.310227] [INFO ] [MAIN ] Update Progress: 340/2372 symbols completed. BSAC took 38.1s. Estimated remaining: 4h 26m 22s. Rate: 7.6 symbols/min [2025-09-23T17:44:37.491160] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:44:37.527628] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:37.553577] [DEBUG] [LOCAL ] BST: Loaded 19306 existing records from primary storage. [2025-09-23T17:44:37.553772] [INFO ] [MAIN ] BST: Loaded 19306 existing records. [2025-09-23T17:44:37.716442] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T17:44:37.757549] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:37.757875] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-23T17:44:37.757936] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-23T17:44:37.758872] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-23T17:44:37.758940] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-23T17:44:37.807399] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-23T17:44:38.126488] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:38.535376] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T17:44:38.602195] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-23T17:44:39.402212] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-23T17:44:39.554856] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:44:40.202204] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-23T17:44:40.622548] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T17:44:40.902537] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T17:44:40.909148] [INFO ] [REMOTE ] BSBR: Full fetch complete (50517 records). [2025-09-23T17:44:40.909244] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-23T17:44:41.007313] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-23T17:44:41.295711] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-23T17:44:41.295801] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-23T17:44:41.296388] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-23T17:44:41.296431] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-23T17:44:41.297467] [DEBUG] [LOCAL ] BSBR: Trimmed 50517 records to 35113 (keeping 200 days of data) [2025-09-23T17:44:41.503838] [DEBUG] [LOCAL ] BSBR: Primary data saved (35113 records). [2025-09-23T17:44:41.503983] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-23T17:44:41.504061] [INFO ] [MAIN ] Update Progress: 341/2372 symbols completed. BSBR took 29.1s. Estimated remaining: 4h 25m 52s. Rate: 7.6 symbols/min [2025-09-23T17:44:41.676284] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:41.701395] [DEBUG] [LOCAL ] BSTZ: Loaded 24927 existing records from primary storage. [2025-09-23T17:44:41.701575] [INFO ] [MAIN ] BSTZ: Loaded 24927 existing records. [2025-09-23T17:44:41.807349] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-23T17:44:41.912820] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:41.913076] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-23T17:44:41.913127] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-23T17:44:41.914228] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-23T17:44:41.914291] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-23T17:44:42.222114] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T17:44:42.366957] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:42.372989] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T17:44:42.602194] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-23T17:44:43.402206] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-23T17:44:43.493867] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T17:44:44.202220] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-23T17:44:44.420137] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T17:44:45.002198] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-23T17:44:45.160006] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:44:45.763837] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T17:44:45.802167] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-23T17:44:46.346115] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T17:44:46.602194] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-23T17:44:47.402166] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-23T17:44:47.483277] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T17:44:47.485357] [INFO ] [REMOTE ] BSL: Full fetch complete (12525 records). [2025-09-23T17:44:47.485435] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-23T17:44:47.854881] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-23T17:44:47.855030] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-23T17:44:47.855358] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-23T17:44:47.855433] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-23T17:44:47.856206] [DEBUG] [LOCAL ] BSL: Trimmed 12525 records to 7936 (keeping 200 days of data) [2025-09-23T17:44:47.910674] [DEBUG] [LOCAL ] BSL: Primary data saved (7936 records). [2025-09-23T17:44:47.910791] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-23T17:44:47.910882] [INFO ] [MAIN ] Update Progress: 342/2372 symbols completed. BSL took 23.2s. Estimated remaining: 4h 25m 35s. Rate: 7.6 symbols/min [2025-09-23T17:44:48.085026] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:48.145385] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-23T17:44:48.145525] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-09-23T17:44:48.207782] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-23T17:44:48.342801] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:48.343158] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-23T17:44:48.343296] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-23T17:44:48.351219] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-23T17:44:48.363423] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-23T17:44:48.423169] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T17:44:48.731778] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:49.002277] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-23T17:44:49.430069] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:44:49.808544] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-23T17:44:49.815744] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T17:44:50.602196] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-23T17:44:50.737540] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:44:51.402232] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-23T17:44:52.127002] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T17:44:52.161637] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T17:44:52.202225] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-23T17:44:53.002275] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-23T17:44:53.717576] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T17:44:53.802265] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-23T17:44:54.383466] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:44:54.602237] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-23T17:44:54.720561] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T17:44:55.402303] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-23T17:44:55.608058] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T17:44:56.202197] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-23T17:44:56.849410] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T17:44:57.005750] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-23T17:44:57.010201] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T17:44:57.802220] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-23T17:44:57.825667] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T17:44:58.602229] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-23T17:44:59.242478] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:44:59.402284] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-23T17:45:00.092953] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T17:45:00.135554] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:45:00.202226] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-23T17:45:01.002331] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-23T17:45:01.407901] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T17:45:01.802361] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-23T17:45:02.602305] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-23T17:45:02.904063] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T17:45:03.402270] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-23T17:45:04.202311] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-23T17:45:04.916167] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-23T17:45:05.002296] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-23T17:45:05.812676] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (3.21 seconds). [2025-09-23T17:45:05.817312] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-23T17:45:06.684355] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T17:45:06.689119] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-23T17:45:07.129349] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-23T17:45:07.402446] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-23T17:45:07.430303] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T17:45:07.464866] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (3.26 seconds). [2025-09-23T17:45:07.473024] [INFO ] [REMOTE ] BSM: Full fetch complete (47649 records). [2025-09-23T17:45:07.473510] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-23T17:45:07.940392] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-23T17:45:07.940718] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-23T17:45:07.941982] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-23T17:45:07.942095] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-23T17:45:07.944762] [DEBUG] [LOCAL ] BSM: Trimmed 47649 records to 32342 (keeping 200 days of data) [2025-09-23T17:45:08.088330] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (4.69 seconds). [2025-09-23T17:45:08.202220] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-23T17:45:08.223547] [DEBUG] [LOCAL ] BSM: Primary data saved (32342 records). [2025-09-23T17:45:08.223816] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-23T17:45:08.223952] [INFO ] [MAIN ] Update Progress: 343/2372 symbols completed. BSM took 37.1s. Estimated remaining: 4h 26m 41s. Rate: 7.6 symbols/min [2025-09-23T17:45:08.437135] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:08.446322] [DEBUG] [LOCAL ] BTA: Loaded 5290 existing records from primary storage. [2025-09-23T17:45:08.446507] [INFO ] [MAIN ] BTA: Loaded 5290 existing records. [2025-09-23T17:45:08.675679] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:08.676431] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-23T17:45:08.676500] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-23T17:45:08.676907] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-23T17:45:08.676970] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-23T17:45:08.941507] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T17:45:09.007517] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-23T17:45:09.180615] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:09.195412] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:45:09.199901] [INFO ] [REMOTE ] BST: Full fetch complete (28774 records). [2025-09-23T17:45:09.200028] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-23T17:45:09.675728] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-23T17:45:09.675856] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-23T17:45:09.676390] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-23T17:45:09.676435] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-23T17:45:09.677372] [DEBUG] [LOCAL ] BST: Trimmed 28774 records to 19205 (keeping 200 days of data) [2025-09-23T17:45:09.804197] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-23T17:45:09.804045] [DEBUG] [LOCAL ] BST: Primary data saved (19205 records). [2025-09-23T17:45:09.804687] [INFO ] [MAIN ] BST: Full history saved. [2025-09-23T17:45:09.806120] [INFO ] [MAIN ] Update Progress: 344/2372 symbols completed. BST took 32.5s. Estimated remaining: 4h 25m 56s. Rate: 7.6 symbols/min [2025-09-23T17:45:10.003611] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:10.023117] [DEBUG] [LOCAL ] BTCM: Loaded 14601 existing records from primary storage. [2025-09-23T17:45:10.023317] [INFO ] [MAIN ] BTCM: Loaded 14601 existing records. [2025-09-23T17:45:10.226968] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:10.227337] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-23T17:45:10.227390] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-23T17:45:10.228177] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-23T17:45:10.228254] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-23T17:45:10.604297] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-23T17:45:10.705573] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:10.722401] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T17:45:10.727004] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36679 records). [2025-09-23T17:45:10.727094] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-23T17:45:11.117988] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T17:45:11.176236] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-23T17:45:11.176314] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-23T17:45:11.176851] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-23T17:45:11.176942] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-23T17:45:11.177778] [DEBUG] [LOCAL ] BSTZ: Trimmed 36679 records to 24871 (keeping 200 days of data) [2025-09-23T17:45:11.333045] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24871 records). [2025-09-23T17:45:11.333190] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-23T17:45:11.333287] [INFO ] [MAIN ] Update Progress: 345/2372 symbols completed. BSTZ took 29.8s. Estimated remaining: 4h 25m 11s. Rate: 7.6 symbols/min [2025-09-23T17:45:11.411004] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-23T17:45:11.524289] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:11.523068] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T17:45:11.591561] [DEBUG] [LOCAL ] BTE: Loaded 52748 existing records from primary storage. [2025-09-23T17:45:11.591732] [INFO ] [MAIN ] BTE: Loaded 52748 existing records. [2025-09-23T17:45:11.767064] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:11.767338] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-23T17:45:11.767385] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-23T17:45:11.768955] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-23T17:45:11.769017] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-23T17:45:12.120423] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:12.202168] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-23T17:45:12.333925] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T17:45:13.002250] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-23T17:45:13.524258] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T17:45:13.770079] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:45:13.802143] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-23T17:45:14.310737] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T17:45:14.602185] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-23T17:45:15.119517] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T17:45:15.402202] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-23T17:45:16.202189] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-23T17:45:17.002191] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-23T17:45:17.802194] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-23T17:45:17.957441] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T17:45:18.092091] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-23T17:45:18.296757] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T17:45:18.365885] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-23T17:45:18.602225] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-23T17:45:19.402196] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-23T17:45:20.172047] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T17:45:20.206606] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-23T17:45:20.212175] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T17:45:21.002196] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-23T17:45:21.452686] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T17:45:21.802174] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-23T17:45:21.868518] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T17:45:22.370838] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T17:45:22.602199] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-23T17:45:23.402267] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-23T17:45:23.890912] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T17:45:24.003301] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T17:45:24.202193] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-23T17:45:24.655577] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T17:45:25.002221] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-23T17:45:25.395786] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T17:45:25.802199] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-23T17:45:26.602230] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-23T17:45:27.337305] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T17:45:27.402195] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-23T17:45:27.674871] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T17:45:28.202190] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-23T17:45:29.002256] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-23T17:45:29.198682] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T17:45:29.466322] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T17:45:29.802243] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-23T17:45:29.935182] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:45:29.945991] [INFO ] [REMOTE ] BSX: Full fetch complete (77684 records). [2025-09-23T17:45:29.946130] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-23T17:45:30.302103] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:45:30.393579] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-23T17:45:30.393700] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-23T17:45:30.394616] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-23T17:45:30.394708] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-23T17:45:30.396361] [DEBUG] [LOCAL ] BSX: Trimmed 77684 records to 53688 (keeping 200 days of data) [2025-09-23T17:45:30.619325] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-23T17:45:30.743144] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-23T17:45:30.743272] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-23T17:45:30.743351] [INFO ] [MAIN ] Update Progress: 346/2372 symbols completed. BSX took 42.8s. Estimated remaining: 4h 26m 11s. Rate: 7.6 symbols/min [2025-09-23T17:45:30.926999] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:30.927178] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-09-23T17:45:30.927217] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-09-23T17:45:30.927366] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-23T17:45:30.927411] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-23T17:45:30.927453] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-09-23T17:45:30.927487] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-23T17:45:31.219975] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T17:45:31.232948] [INFO ] [REMOTE ] BTA: Full fetch complete (9494 records). [2025-09-23T17:45:31.243332] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-23T17:45:31.407313] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-23T17:45:31.411364] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:31.698157] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-23T17:45:31.698235] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-23T17:45:31.698472] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-23T17:45:31.698510] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-23T17:45:31.698951] [DEBUG] [LOCAL ] BTA: Trimmed 9494 records to 5282 (keeping 200 days of data) [2025-09-23T17:45:31.729991] [DEBUG] [LOCAL ] BTA: Primary data saved (5282 records). [2025-09-23T17:45:31.730091] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-23T17:45:31.730199] [INFO ] [MAIN ] Update Progress: 347/2372 symbols completed. BTA took 23.5s. Estimated remaining: 4h 25m 23s. Rate: 7.6 symbols/min [2025-09-23T17:45:31.895744] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:31.906075] [DEBUG] [LOCAL ] BTO: Loaded 8965 existing records from primary storage. [2025-09-23T17:45:31.906180] [INFO ] [MAIN ] BTO: Loaded 8965 existing records. [2025-09-23T17:45:32.079245] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:32.079496] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-23T17:45:32.079551] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-23T17:45:32.079933] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-23T17:45:32.080007] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-23T17:45:32.219063] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-23T17:45:32.432863] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:32.801191] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:45:33.002199] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-23T17:45:33.802150] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-23T17:45:34.352436] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-23T17:45:34.385212] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T17:45:34.602237] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-23T17:45:35.239457] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T17:45:35.402179] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-23T17:45:36.202175] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-23T17:45:36.248820] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:45:36.755728] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T17:45:37.002199] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-23T17:45:37.257259] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T17:45:37.262466] [INFO ] [REMOTE ] BTCM: Full fetch complete (19663 records). [2025-09-23T17:45:37.262713] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-23T17:45:37.660967] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-23T17:45:37.661046] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-23T17:45:37.661427] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-23T17:45:37.661467] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-23T17:45:37.662058] [DEBUG] [LOCAL ] BTCM: Trimmed 19663 records to 14757 (keeping 200 days of data) [2025-09-23T17:45:37.749261] [DEBUG] [LOCAL ] BTCM: Primary data saved (14757 records). [2025-09-23T17:45:37.749391] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-23T17:45:37.749473] [INFO ] [MAIN ] Update Progress: 348/2372 symbols completed. BTCM took 27.9s. Estimated remaining: 4h 25m 4s. Rate: 7.6 symbols/min [2025-09-23T17:45:37.812152] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-23T17:45:37.921168] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:37.941000] [DEBUG] [LOCAL ] BTT: Loaded 16021 existing records from primary storage. [2025-09-23T17:45:37.941130] [INFO ] [MAIN ] BTT: Loaded 16021 existing records. [2025-09-23T17:45:38.118334] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:38.118603] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-23T17:45:38.118680] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-23T17:45:38.119336] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-23T17:45:38.119397] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-23T17:45:38.470912] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:38.533014] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T17:45:38.586920] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T17:45:38.602175] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-23T17:45:39.402190] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-23T17:45:40.197748] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:45:40.208249] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-23T17:45:40.804153] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:45:41.002166] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-23T17:45:41.123697] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T17:45:41.802214] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-23T17:45:42.286048] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:45:42.602211] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-23T17:45:42.768460] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T17:45:43.221091] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:45:43.402196] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-23T17:45:44.202218] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-23T17:45:44.797571] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:45:44.806314] [INFO ] [REMOTE ] BTE: Full fetch complete (75992 records). [2025-09-23T17:45:44.806444] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-23T17:45:45.007359] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-23T17:45:45.205495] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-23T17:45:45.205599] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-23T17:45:45.206406] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-23T17:45:45.206468] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-23T17:45:45.208409] [DEBUG] [LOCAL ] BTE: Trimmed 75992 records to 52748 (keeping 200 days of data) [2025-09-23T17:45:45.532488] [DEBUG] [LOCAL ] BTE: Primary data saved (52748 records). [2025-09-23T17:45:45.532637] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-23T17:45:45.532812] [INFO ] [MAIN ] Update Progress: 349/2372 symbols completed. BTE took 34.2s. Estimated remaining: 4h 24m 56s. Rate: 7.6 symbols/min [2025-09-23T17:45:45.740444] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:45.751535] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T17:45:45.805414] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-23T17:45:45.808749] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-23T17:45:45.808906] [INFO ] [MAIN ] BTU: Loaded 53303 existing records. [2025-09-23T17:45:45.992356] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:45.992882] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-23T17:45:45.993087] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-23T17:45:45.994698] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-23T17:45:45.994767] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-23T17:45:46.370570] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:46.393139] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-23T17:45:46.561088] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T17:45:46.602146] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-23T17:45:47.370881] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T17:45:47.402194] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-23T17:45:47.879999] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T17:45:48.202193] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-23T17:45:49.002196] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-23T17:45:49.802171] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-23T17:45:49.905677] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T17:45:50.420898] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T17:45:50.453575] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:45:50.602196] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-23T17:45:51.402244] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-23T17:45:51.904469] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T17:45:52.144554] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T17:45:52.202206] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-23T17:45:53.002232] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-23T17:45:53.031089] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T17:45:53.802233] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-23T17:45:54.287551] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T17:45:54.602247] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-23T17:45:54.781118] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T17:45:55.402194] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-23T17:45:56.069103] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T17:45:56.137458] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T17:45:56.202276] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-23T17:45:57.002242] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-23T17:45:57.519364] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T17:45:57.802169] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-23T17:45:57.939447] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T17:45:58.336104] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T17:45:58.602192] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-23T17:45:59.402209] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-23T17:46:00.202190] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-23T17:46:00.295950] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T17:46:00.308243] [INFO ] [REMOTE ] BTI: Full fetch complete (77426 records). [2025-09-23T17:46:00.308432] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-23T17:46:00.440274] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T17:46:00.472966] [INFO ] [REMOTE ] BTO: Full fetch complete (13360 records). [2025-09-23T17:46:00.484177] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-23T17:46:01.020278] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-23T17:46:01.043032] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-23T17:46:01.047376] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-23T17:46:01.048462] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-23T17:46:01.059359] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-23T17:46:01.133859] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-23T17:46:01.134054] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-23T17:46:01.134407] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-23T17:46:01.134854] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-23T17:46:01.135700] [DEBUG] [LOCAL ] BTI: Trimmed 77426 records to 53557 (keeping 200 days of data) [2025-09-23T17:46:01.136038] [DEBUG] [LOCAL ] BTO: Trimmed 13360 records to 8939 (keeping 200 days of data) [2025-09-23T17:46:01.301497] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T17:46:01.326953] [DEBUG] [LOCAL ] BTO: Primary data saved (8939 records). [2025-09-23T17:46:01.327579] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-23T17:46:01.327721] [INFO ] [MAIN ] Update Progress: 350/2372 symbols completed. BTO took 29.6s. Estimated remaining: 4h 25m 34s. Rate: 7.6 symbols/min [2025-09-23T17:46:01.513101] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:01.513801] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-23T17:46:01.514549] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-23T17:46:01.516586] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-23T17:46:01.517425] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-23T17:46:01.518022] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-23T17:46:01.518562] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-23T17:46:01.805215] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-23T17:46:02.011239] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:02.130099] [DEBUG] [LOCAL ] BTI: Primary data saved (53557 records). [2025-09-23T17:46:02.130243] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-23T17:46:02.130320] [INFO ] [MAIN ] Update Progress: 351/2372 symbols completed. BTI took 31.4s. Estimated remaining: 4h 24m 45s. Rate: 7.6 symbols/min [2025-09-23T17:46:02.306780] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:02.338041] [DEBUG] [LOCAL ] BTZ: Loaded 22906 existing records from primary storage. [2025-09-23T17:46:02.338218] [INFO ] [MAIN ] BTZ: Loaded 22906 existing records. [2025-09-23T17:46:02.536189] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:02.537338] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-23T17:46:02.537541] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-23T17:46:02.543176] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-23T17:46:02.549335] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-23T17:46:02.584530] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T17:46:02.610103] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-23T17:46:02.893268] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:46:02.894963] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T17:46:02.895261] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-23T17:46:02.984235] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:03.402189] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-23T17:46:04.202196] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-23T17:46:04.422271] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:46:04.422584] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-23T17:46:04.964537] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T17:46:05.002206] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-23T17:46:05.580546] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T17:46:05.802210] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-23T17:46:06.602235] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-23T17:46:07.402251] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-23T17:46:07.831459] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T17:46:07.850384] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T17:46:07.854383] [INFO ] [REMOTE ] BTT: Full fetch complete (24320 records). [2025-09-23T17:46:07.854487] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-23T17:46:07.855170] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:46:07.855271] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:46:07.855330] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:46:07.855408] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-23T17:46:07.855509] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-23T17:46:07.855565] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-09-23T17:46:07.856141] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-09-23T17:46:07.856317] [INFO ] [MAIN ] Update Progress: 352/2372 symbols completed. BTT took 30.1s. Estimated remaining: 4h 24m 25s. Rate: 7.6 symbols/min [2025-09-23T17:46:08.026921] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:08.096220] [DEBUG] [LOCAL ] BUD: Loaded 52752 existing records from primary storage. [2025-09-23T17:46:08.096548] [INFO ] [MAIN ] BUD: Loaded 52752 existing records. [2025-09-23T17:46:08.207448] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-23T17:46:08.284494] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:08.285275] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-23T17:46:08.285421] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-23T17:46:08.286839] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-23T17:46:08.286908] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-23T17:46:08.407218] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T17:46:08.667390] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:09.002201] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-23T17:46:09.793836] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T17:46:09.804848] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-23T17:46:09.820663] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T17:46:10.602205] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-23T17:46:11.402277] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-23T17:46:11.435249] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T17:46:11.980878] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T17:46:12.202199] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-23T17:46:12.897949] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T17:46:12.956223] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T17:46:13.002227] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-23T17:46:13.802223] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-23T17:46:14.602178] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-23T17:46:14.744112] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T17:46:14.745081] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:46:15.202548] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T17:46:15.402204] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-23T17:46:16.202153] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-23T17:46:16.219122] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T17:46:17.002207] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-23T17:46:17.664803] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:46:17.802205] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-23T17:46:18.583700] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T17:46:18.602159] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-23T17:46:18.726483] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T17:46:19.402210] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-23T17:46:20.123024] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:46:20.202152] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-23T17:46:20.883481] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:46:21.002191] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-23T17:46:21.812550] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-23T17:46:21.839059] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T17:46:22.602198] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-23T17:46:22.761050] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:46:22.823084] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T17:46:22.832365] [INFO ] [REMOTE ] BTU: Full fetch complete (76826 records). [2025-09-23T17:46:22.832512] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-23T17:46:23.256138] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-23T17:46:23.256267] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-23T17:46:23.257637] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-23T17:46:23.257782] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-23T17:46:23.259464] [DEBUG] [LOCAL ] BTU: Trimmed 76826 records to 53303 (keeping 200 days of data) [2025-09-23T17:46:23.451335] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-23T17:46:23.608673] [DEBUG] [LOCAL ] BTU: Primary data saved (53303 records). [2025-09-23T17:46:23.608850] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-23T17:46:23.608983] [INFO ] [MAIN ] Update Progress: 353/2372 symbols completed. BTU took 38.1s. Estimated remaining: 4h 25m 3s. Rate: 7.6 symbols/min [2025-09-23T17:46:23.782196] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:23.796005] [DEBUG] [LOCAL ] BUI: Loaded 11478 existing records from primary storage. [2025-09-23T17:46:23.796150] [INFO ] [MAIN ] BUI: Loaded 11478 existing records. [2025-09-23T17:46:23.986530] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:23.986934] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-23T17:46:23.987018] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-23T17:46:23.987452] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-23T17:46:23.987531] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-23T17:46:24.203543] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-23T17:46:24.369726] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:24.460354] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T17:46:24.852315] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:46:25.002237] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-23T17:46:25.426196] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:46:25.802201] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-23T17:46:26.436056] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T17:46:26.578358] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:46:26.602185] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-23T17:46:27.402217] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-23T17:46:27.637719] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T17:46:28.202215] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-23T17:46:28.711585] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T17:46:29.002210] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-23T17:46:29.409220] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:46:29.802189] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-23T17:46:30.333341] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:46:30.602210] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-23T17:46:30.680461] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T17:46:31.402159] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-23T17:46:31.490099] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T17:46:32.202190] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-23T17:46:32.504103] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T17:46:32.509274] [INFO ] [REMOTE ] BTX: Full fetch complete (35518 records). [2025-09-23T17:46:32.509370] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-23T17:46:32.710493] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-23T17:46:32.710936] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:46:32.711017] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:46:32.711092] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-23T17:46:32.711157] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-23T17:46:32.711206] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-23T17:46:32.711274] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-23T17:46:32.711368] [INFO ] [MAIN ] Update Progress: 354/2372 symbols completed. BTX took 31.4s. Estimated remaining: 4h 25m 2s. Rate: 7.6 symbols/min [2025-09-23T17:46:32.888636] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:32.957307] [DEBUG] [LOCAL ] BUR: Loaded 45095 existing records from primary storage. [2025-09-23T17:46:32.957483] [INFO ] [MAIN ] BUR: Loaded 45095 existing records. [2025-09-23T17:46:33.011281] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-23T17:46:33.143173] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:33.143558] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-23T17:46:33.143682] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-23T17:46:33.152409] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-23T17:46:33.154020] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-23T17:46:33.212597] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T17:46:33.254021] [INFO ] [REMOTE ] BTZ: Full fetch complete (33843 records). [2025-09-23T17:46:33.264358] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-23T17:46:33.825891] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-23T17:46:33.834027] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:33.923231] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-23T17:46:33.923306] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-23T17:46:33.923771] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-23T17:46:33.923835] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-23T17:46:33.924754] [DEBUG] [LOCAL ] BTZ: Trimmed 33843 records to 22844 (keeping 200 days of data) [2025-09-23T17:46:34.076076] [DEBUG] [LOCAL ] BTZ: Primary data saved (22844 records). [2025-09-23T17:46:34.076240] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-23T17:46:34.076351] [INFO ] [MAIN ] Update Progress: 355/2372 symbols completed. BTZ took 31.9s. Estimated remaining: 4h 24m 17s. Rate: 7.6 symbols/min [2025-09-23T17:46:34.245769] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:34.298057] [DEBUG] [LOCAL ] BURL: Loaded 46416 existing records from primary storage. [2025-09-23T17:46:34.298221] [INFO ] [MAIN ] BURL: Loaded 46416 existing records. [2025-09-23T17:46:34.478824] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:34.479104] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-23T17:46:34.479152] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-23T17:46:34.480230] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-23T17:46:34.480292] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-23T17:46:34.607036] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-23T17:46:34.752414] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T17:46:34.864527] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:34.925978] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T17:46:35.402192] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-23T17:46:35.738488] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:46:36.202208] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-23T17:46:36.799358] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T17:46:37.002208] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-23T17:46:37.256893] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T17:46:37.802169] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-23T17:46:37.867866] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T17:46:38.602187] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-23T17:46:39.285015] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T17:46:39.402226] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-23T17:46:40.151033] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:46:40.160821] [INFO ] [REMOTE ] BUD: Full fetch complete (76487 records). [2025-09-23T17:46:40.160962] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-23T17:46:40.207474] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-23T17:46:40.358470] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T17:46:40.596971] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-23T17:46:40.597101] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-23T17:46:40.597990] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-23T17:46:40.598063] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-23T17:46:40.602597] [DEBUG] [LOCAL ] BUD: Trimmed 76487 records to 52743 (keeping 200 days of data) [2025-09-23T17:46:40.941916] [DEBUG] [LOCAL ] BUD: Primary data saved (52743 records). [2025-09-23T17:46:40.942070] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-23T17:46:40.942226] [INFO ] [MAIN ] Update Progress: 356/2372 symbols completed. BUD took 33.1s. Estimated remaining: 4h 24m 3s. Rate: 7.6 symbols/min [2025-09-23T17:46:41.011685] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-23T17:46:41.128064] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:41.147846] [DEBUG] [LOCAL ] BUXX: Loaded 15166 existing records from primary storage. [2025-09-23T17:46:41.148007] [INFO ] [MAIN ] BUXX: Loaded 15166 existing records. [2025-09-23T17:46:41.359275] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:41.359575] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-23T17:46:41.359626] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-23T17:46:41.360332] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-23T17:46:41.360398] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-23T17:46:41.718787] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T17:46:41.810237] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:41.803407] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-23T17:46:41.838039] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T17:46:42.385354] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T17:46:42.602182] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-23T17:46:43.402210] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-23T17:46:44.183503] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T17:46:44.202151] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-23T17:46:44.219868] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T17:46:45.002218] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-23T17:46:45.432518] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T17:46:45.802214] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-23T17:46:45.986215] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T17:46:46.602269] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-23T17:46:47.159153] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-23T17:46:47.396268] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T17:46:47.405141] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-23T17:46:48.202262] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-23T17:46:48.576954] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:46:48.579673] [INFO ] [REMOTE ] BUI: Full fetch complete (16139 records). [2025-09-23T17:46:48.579761] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-23T17:46:48.947859] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-23T17:46:48.947938] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-23T17:46:48.948252] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-23T17:46:48.948293] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-23T17:46:48.948883] [DEBUG] [LOCAL ] BUI: Trimmed 16139 records to 11464 (keeping 200 days of data) [2025-09-23T17:46:49.003292] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-23T17:46:49.020926] [DEBUG] [LOCAL ] BUI: Primary data saved (11464 records). [2025-09-23T17:46:49.021047] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-23T17:46:49.021131] [INFO ] [MAIN ] Update Progress: 357/2372 symbols completed. BUI took 25.4s. Estimated remaining: 4h 23m 57s. Rate: 7.6 symbols/min [2025-09-23T17:46:49.385027] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:46:49.484750] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:46:49.802207] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-23T17:46:50.602212] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-23T17:46:51.078723] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T17:46:51.403109] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T17:46:51.403215] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-23T17:46:52.013217] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T17:46:52.202214] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-23T17:46:53.002209] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-23T17:46:53.547201] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:46:53.656434] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T17:46:53.802238] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-23T17:46:54.602288] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-23T17:46:54.926699] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:46:55.402221] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-23T17:46:55.613833] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T17:46:56.202221] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-23T17:46:56.906701] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T17:46:56.914419] [INFO ] [REMOTE ] BUR: Full fetch complete (62927 records). [2025-09-23T17:46:56.925217] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-23T17:46:56.926563] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T17:46:56.927228] [FATAL] [VALIDATOR ] BUR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:46:56.927496] [FATAL] [MAIN ] BUR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:46:56.931771] [WARN ] [MAIN ] BUR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:46:56.931857] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-23T17:46:56.931931] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-23T17:46:56.931992] [INFO ] [LOCAL ] BUR: Starting deletion of derivative data. [2025-09-23T17:46:56.932596] [DEBUG] [LOCAL ] BUR: Deleted derivative data file. [2025-09-23T17:46:56.932743] [INFO ] [MAIN ] Update Progress: 358/2372 symbols completed. BUR took 24.2s. Estimated remaining: 4h 23m 49s. Rate: 7.6 symbols/min [2025-09-23T17:46:57.002161] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-23T17:46:57.710302] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T17:46:57.802254] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-23T17:46:58.316843] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T17:46:58.602258] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-23T17:46:59.295611] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T17:46:59.298550] [INFO ] [REMOTE ] BUXX: Full fetch complete (20255 records). [2025-09-23T17:46:59.298704] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-23T17:46:59.407074] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-23T17:46:59.681130] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-23T17:46:59.681250] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-23T17:46:59.681786] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-23T17:46:59.681853] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-23T17:46:59.682594] [DEBUG] [LOCAL ] BUXX: Trimmed 20255 records to 15142 (keeping 200 days of data) [2025-09-23T17:46:59.776867] [DEBUG] [LOCAL ] BUXX: Primary data saved (15142 records). [2025-09-23T17:46:59.777024] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-23T17:46:59.777113] [INFO ] [MAIN ] Update Progress: 359/2372 symbols completed. BUXX took 18.8s. Estimated remaining: 4h 23m 13s. Rate: 7.6 symbols/min [2025-09-23T17:47:00.819361] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:47:00.828334] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-23T17:47:02.291554] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:47:02.302272] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-23T17:47:03.801420] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:47:03.812904] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-23T17:47:05.593229] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T17:47:05.603375] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-23T17:47:06.815300] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:47:06.824758] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-23T17:47:08.519434] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:47:08.529447] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-23T17:47:09.818798] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:47:09.829037] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-23T17:47:11.854926] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T17:47:11.864171] [INFO ] [REMOTE ] BURL: Full fetch complete (65664 records). [2025-09-23T17:47:11.864449] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-23T17:47:12.258166] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-23T17:47:12.258254] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-23T17:47:12.258976] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-23T17:47:12.259043] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-23T17:47:12.260396] [DEBUG] [LOCAL ] BURL: Trimmed 65664 records to 46328 (keeping 200 days of data) [2025-09-23T17:47:12.544445] [DEBUG] [LOCAL ] BURL: Primary data saved (46328 records). [2025-09-23T17:47:12.544605] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-23T17:47:12.544758] [INFO ] [MAIN ] Update Progress: 360/2372 symbols completed. BURL took 38.5s. Estimated remaining: 4h 23m 33s. Rate: 7.6 symbols/min [2025-09-23T17:47:13.163355] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:13.267148] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:13.298561] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:13.322406] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:13.384049] [DEBUG] [LOCAL ] BW: Loaded 39509 existing records from primary storage. [2025-09-23T17:47:13.384336] [INFO ] [MAIN ] BW: Loaded 39509 existing records. [2025-09-23T17:47:13.553178] [DEBUG] [LOCAL ] BV: Loaded 38631 existing records from primary storage. [2025-09-23T17:47:13.575731] [INFO ] [MAIN ] BV: Loaded 38631 existing records. [2025-09-23T17:47:13.654910] [DEBUG] [LOCAL ] BVN: Loaded 43798 existing records from primary storage. [2025-09-23T17:47:13.743446] [INFO ] [MAIN ] BVN: Loaded 43798 existing records. [2025-09-23T17:47:13.744315] [DEBUG] [LOCAL ] BWA: Loaded 52257 existing records from primary storage. [2025-09-23T17:47:13.755008] [INFO ] [MAIN ] BWA: Loaded 52257 existing records. [2025-09-23T17:47:13.743255] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:13.946215] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-23T17:47:14.010782] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-23T17:47:14.129743] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:14.203800] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-23T17:47:14.230267] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-23T17:47:14.230187] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-23T17:47:14.243478] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:14.243595] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-23T17:47:14.302755] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:14.320964] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-23T17:47:14.347337] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-23T17:47:14.347487] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-23T17:47:14.331571] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-23T17:47:14.362123] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-23T17:47:14.362325] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-23T17:47:14.398461] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-23T17:47:14.389584] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-23T17:47:14.424594] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-23T17:47:14.424477] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-23T17:47:15.443936] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:15.517020] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-23T17:47:15.641923] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:15.643149] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-23T17:47:15.769142] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:15.814097] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-23T17:47:15.820500] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:15.821595] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-23T17:47:17.019484] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:47:17.028789] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-23T17:47:17.178462] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T17:47:17.199672] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-23T17:47:17.202221] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:47:17.209892] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-23T17:47:17.299725] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T17:47:17.310519] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-23T17:47:18.075428] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T17:47:18.081523] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-23T17:47:18.185230] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T17:47:18.194319] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-23T17:47:18.351052] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T17:47:18.359361] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-23T17:47:18.640968] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:47:18.651608] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-23T17:47:19.034175] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:47:19.042050] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-23T17:47:19.141242] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:47:19.149606] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-23T17:47:19.474252] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T17:47:19.482887] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-23T17:47:19.983094] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:47:19.993353] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-23T17:47:20.075997] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T17:47:20.084377] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-23T17:47:20.255157] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:47:20.264296] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-23T17:47:20.718207] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T17:47:20.727482] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-23T17:47:21.140268] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T17:47:21.148602] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-23T17:47:21.332150] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:47:21.501465] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T17:47:21.802202] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-23T17:47:22.233538] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:47:22.271332] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T17:47:22.602201] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-23T17:47:23.312856] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T17:47:23.402184] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-23T17:47:24.105937] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T17:47:24.202200] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-23T17:47:24.800581] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T17:47:25.002212] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-23T17:47:25.454611] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:47:25.802187] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-23T17:47:26.093885] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:47:26.602214] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-23T17:47:27.061183] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:47:27.402256] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-23T17:47:28.131378] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:47:28.202164] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-23T17:47:28.981690] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:47:29.002208] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-23T17:47:29.383989] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:47:29.802250] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-23T17:47:30.398577] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T17:47:30.602212] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-23T17:47:31.104174] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:47:31.402224] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-23T17:47:31.979032] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T17:47:31.987393] [INFO ] [REMOTE ] BW: Full fetch complete (58711 records). [2025-09-23T17:47:31.987564] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-23T17:47:32.207291] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-23T17:47:32.382008] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-23T17:47:32.382097] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-23T17:47:32.382754] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-23T17:47:32.382818] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-23T17:47:32.384078] [DEBUG] [LOCAL ] BW: Trimmed 58711 records to 39536 (keeping 200 days of data) [2025-09-23T17:47:32.610472] [DEBUG] [LOCAL ] BW: Primary data saved (39536 records). [2025-09-23T17:47:32.610660] [INFO ] [MAIN ] BW: Full history saved. [2025-09-23T17:47:32.610768] [INFO ] [MAIN ] Update Progress: 361/2372 symbols completed. BW took 20.1s. Estimated remaining: 4h 24m 33s. Rate: 7.6 symbols/min [2025-09-23T17:47:32.794604] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:32.811345] [DEBUG] [LOCAL ] BWG: Loaded 12327 existing records from primary storage. [2025-09-23T17:47:32.811494] [INFO ] [MAIN ] BWG: Loaded 12327 existing records. [2025-09-23T17:47:33.003522] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-23T17:47:33.009726] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:33.011273] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-23T17:47:33.011528] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-23T17:47:33.012170] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-23T17:47:33.012234] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-23T17:47:33.344395] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T17:47:33.432930] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:33.483005] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:47:33.490212] [INFO ] [REMOTE ] BV: Full fetch complete (53803 records). [2025-09-23T17:47:33.490391] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-23T17:47:33.807329] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-23T17:47:33.881848] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-23T17:47:33.881968] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-23T17:47:33.882799] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-23T17:47:33.882878] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-23T17:47:33.884156] [DEBUG] [LOCAL ] BV: Trimmed 53803 records to 38602 (keeping 200 days of data) [2025-09-23T17:47:34.104529] [DEBUG] [LOCAL ] BV: Primary data saved (38602 records). [2025-09-23T17:47:34.104713] [INFO ] [MAIN ] BV: Full history saved. [2025-09-23T17:47:34.104814] [INFO ] [MAIN ] Update Progress: 362/2372 symbols completed. BV took 21.6s. Estimated remaining: 4h 23m 49s. Rate: 7.6 symbols/min [2025-09-23T17:47:34.299505] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:34.337461] [DEBUG] [LOCAL ] BWLP: Loaded 32842 existing records from primary storage. [2025-09-23T17:47:34.337824] [INFO ] [MAIN ] BWLP: Loaded 32842 existing records. [2025-09-23T17:47:34.530954] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:34.531552] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-23T17:47:34.531620] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-23T17:47:34.532915] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-23T17:47:34.532979] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-23T17:47:34.604308] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-23T17:47:34.758911] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T17:47:34.881565] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T17:47:34.978126] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:35.402195] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-23T17:47:35.746225] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:47:36.202204] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-23T17:47:36.819301] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:47:36.884508] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:47:37.002216] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-23T17:47:37.802199] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-23T17:47:38.557556] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:47:38.602249] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-23T17:47:39.348255] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:47:39.364664] [INFO ] [REMOTE ] BWA: Full fetch complete (75763 records). [2025-09-23T17:47:39.364908] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-23T17:47:39.402306] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-23T17:47:39.890872] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-23T17:47:39.891053] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-23T17:47:39.892096] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-23T17:47:39.892257] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-23T17:47:39.894360] [DEBUG] [LOCAL ] BWA: Trimmed 75763 records to 52250 (keeping 200 days of data) [2025-09-23T17:47:40.203271] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-23T17:47:40.252435] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:47:40.287291] [DEBUG] [LOCAL ] BWA: Primary data saved (52250 records). [2025-09-23T17:47:40.287474] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-23T17:47:40.287606] [INFO ] [MAIN ] Update Progress: 363/2372 symbols completed. BWA took 27.7s. Estimated remaining: 4h 23m 32s. Rate: 7.6 symbols/min [2025-09-23T17:47:40.480537] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:40.490843] [DEBUG] [LOCAL ] BWMX: Loaded 7613 existing records from primary storage. [2025-09-23T17:47:40.490982] [INFO ] [MAIN ] BWMX: Loaded 7613 existing records. [2025-09-23T17:47:40.693602] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:40.693957] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-23T17:47:40.694105] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-23T17:47:40.694628] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-23T17:47:40.694725] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-23T17:47:40.865944] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T17:47:40.872730] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T17:47:41.010298] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-23T17:47:41.132227] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:41.509498] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T17:47:41.802190] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-23T17:47:42.602214] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-23T17:47:43.191431] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T17:47:43.199925] [INFO ] [REMOTE ] BVN: Full fetch complete (62621 records). [2025-09-23T17:47:43.200098] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-23T17:47:43.402293] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-23T17:47:43.447887] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T17:47:43.612766] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-23T17:47:43.612915] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-23T17:47:43.613720] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-23T17:47:43.613787] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-23T17:47:43.615820] [DEBUG] [LOCAL ] BVN: Trimmed 62621 records to 43805 (keeping 200 days of data) [2025-09-23T17:47:43.880271] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T17:47:43.893943] [DEBUG] [LOCAL ] BVN: Primary data saved (43805 records). [2025-09-23T17:47:43.894089] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-23T17:47:43.894179] [INFO ] [MAIN ] Update Progress: 364/2372 symbols completed. BVN took 31.3s. Estimated remaining: 4h 23m 1s. Rate: 7.6 symbols/min [2025-09-23T17:47:44.061192] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:44.067633] [DEBUG] [LOCAL ] BWNB: Loaded 4485 existing records from primary storage. [2025-09-23T17:47:44.067764] [INFO ] [MAIN ] BWNB: Loaded 4485 existing records. [2025-09-23T17:47:44.209090] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-23T17:47:44.251604] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:44.251884] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-23T17:47:44.251965] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-23T17:47:44.252265] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-23T17:47:44.252338] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-23T17:47:44.607586] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:45.002203] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-23T17:47:45.261137] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T17:47:45.426797] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T17:47:45.802281] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-23T17:47:46.495975] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T17:47:46.602245] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-23T17:47:47.402212] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-23T17:47:47.758505] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:47:48.078690] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T17:47:48.202203] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-23T17:47:49.002229] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-23T17:47:49.256284] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T17:47:49.454873] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T17:47:49.802229] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-23T17:47:50.241871] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T17:47:50.602222] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-23T17:47:51.132844] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T17:47:51.402214] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-23T17:47:51.842957] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T17:47:52.202195] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-23T17:47:52.921308] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:47:53.002196] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-23T17:47:53.553071] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T17:47:53.802222] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-23T17:47:54.244534] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-23T17:47:54.602237] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-23T17:47:55.402207] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-23T17:47:55.767062] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T17:47:55.861040] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T17:47:56.202210] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-23T17:47:57.002235] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-23T17:47:57.154428] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T17:47:57.458170] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T17:47:57.802230] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-23T17:47:58.255217] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-23T17:47:58.602240] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-23T17:47:59.074226] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:47:59.402242] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-23T17:47:59.814561] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T17:48:00.202198] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-23T17:48:01.002195] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-23T17:48:01.534980] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T17:48:01.703095] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T17:48:01.802256] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-23T17:48:02.602200] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-23T17:48:03.402199] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-23T17:48:03.549452] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T17:48:03.832669] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T17:48:03.949423] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T17:48:04.202205] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-23T17:48:05.002177] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-23T17:48:05.241304] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T17:48:05.511372] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:48:05.512763] [INFO ] [REMOTE ] BWNB: Full fetch complete (5734 records). [2025-09-23T17:48:05.512836] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-23T17:48:05.513255] [FATAL] [VALIDATOR ] BWNB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:48:05.513366] [FATAL] [MAIN ] BWNB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:48:05.513450] [WARN ] [MAIN ] BWNB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:48:05.513541] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-23T17:48:05.513637] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-23T17:48:05.513731] [INFO ] [LOCAL ] BWNB: Starting deletion of derivative data. [2025-09-23T17:48:05.514330] [DEBUG] [LOCAL ] BWNB: Deleted derivative data file. [2025-09-23T17:48:05.514431] [INFO ] [MAIN ] Update Progress: 365/2372 symbols completed. BWNB took 21.6s. Estimated remaining: 4h 24m 9s. Rate: 7.6 symbols/min [2025-09-23T17:48:05.689753] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:05.690063] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-09-23T17:48:05.690118] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-09-23T17:48:05.690360] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-23T17:48:05.690416] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-23T17:48:05.690460] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-23T17:48:05.690493] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-23T17:48:05.807258] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-23T17:48:06.072248] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:06.602154] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-23T17:48:06.737705] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T17:48:06.740825] [INFO ] [REMOTE ] BWG: Full fetch complete (17689 records). [2025-09-23T17:48:06.741092] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-23T17:48:07.136864] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-23T17:48:07.136995] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-23T17:48:07.137442] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-23T17:48:07.137517] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-23T17:48:07.138310] [DEBUG] [LOCAL ] BWG: Trimmed 17689 records to 12317 (keeping 200 days of data) [2025-09-23T17:48:07.226689] [DEBUG] [LOCAL ] BWG: Primary data saved (12317 records). [2025-09-23T17:48:07.226854] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-23T17:48:07.226976] [INFO ] [MAIN ] Update Progress: 366/2372 symbols completed. BWG took 34.6s. Estimated remaining: 4h 23m 27s. Rate: 7.6 symbols/min [2025-09-23T17:48:07.400683] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:07.401023] [DEBUG] [LOCAL ] BWXT: No existing data file found in primary storage. [2025-09-23T17:48:07.401079] [WARN ] [MAIN ] BWXT: No existing data found, performing full refresh instead. [2025-09-23T17:48:07.401253] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-23T17:48:07.401306] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-23T17:48:07.401352] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-09-23T17:48:07.401386] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-23T17:48:07.412491] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-23T17:48:07.764664] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:08.067583] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T17:48:08.073089] [INFO ] [REMOTE ] BWLP: Full fetch complete (48651 records). [2025-09-23T17:48:08.073190] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-23T17:48:08.156927] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:48:08.217552] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-23T17:48:08.456052] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-23T17:48:08.456142] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-23T17:48:08.456754] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-23T17:48:08.456819] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-23T17:48:08.457978] [DEBUG] [LOCAL ] BWLP: Trimmed 48651 records to 32847 (keeping 200 days of data) [2025-09-23T17:48:08.665077] [DEBUG] [LOCAL ] BWLP: Primary data saved (32847 records). [2025-09-23T17:48:08.665257] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-23T17:48:08.665351] [INFO ] [MAIN ] Update Progress: 367/2372 symbols completed. BWLP took 34.6s. Estimated remaining: 4h 22m 44s. Rate: 7.6 symbols/min [2025-09-23T17:48:08.832762] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:08.889231] [DEBUG] [LOCAL ] BX: Loaded 53501 existing records from primary storage. [2025-09-23T17:48:08.889378] [INFO ] [MAIN ] BX: Loaded 53501 existing records. [2025-09-23T17:48:09.004861] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-23T17:48:09.054044] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:48:09.091143] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:09.091392] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-23T17:48:09.091458] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-23T17:48:09.093158] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-23T17:48:09.093222] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-23T17:48:09.448840] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:09.481449] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:48:09.802276] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-23T17:48:10.577891] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T17:48:10.602168] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-23T17:48:11.402209] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-23T17:48:11.711960] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T17:48:12.202217] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-23T17:48:12.367151] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T17:48:12.734849] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T17:48:12.737434] [INFO ] [REMOTE ] BWMX: Full fetch complete (10057 records). [2025-09-23T17:48:12.737542] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-23T17:48:13.007386] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-23T17:48:13.103400] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-23T17:48:13.103478] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-23T17:48:13.103731] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-23T17:48:13.103791] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-23T17:48:13.104223] [DEBUG] [LOCAL ] BWMX: Trimmed 10057 records to 7621 (keeping 200 days of data) [2025-09-23T17:48:13.155340] [DEBUG] [LOCAL ] BWMX: Primary data saved (7621 records). [2025-09-23T17:48:13.155483] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-23T17:48:13.155568] [INFO ] [MAIN ] Update Progress: 368/2372 symbols completed. BWMX took 32.9s. Estimated remaining: 4h 22m 18s. Rate: 7.6 symbols/min [2025-09-23T17:48:13.324609] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:13.324891] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-09-23T17:48:13.324934] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-09-23T17:48:13.325041] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-23T17:48:13.325079] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-23T17:48:13.325152] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-09-23T17:48:13.325213] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-23T17:48:13.459110] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-23T17:48:13.693923] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:13.802195] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-23T17:48:14.263948] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T17:48:14.602199] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-23T17:48:15.193226] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T17:48:15.402219] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-23T17:48:16.202224] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-23T17:48:17.002220] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-23T17:48:17.353818] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T17:48:17.802238] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-23T17:48:18.048718] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T17:48:18.602223] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-23T17:48:18.905337] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-09-23T17:48:18.922809] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T17:48:19.187822] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T17:48:19.402198] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-23T17:48:20.202199] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-23T17:48:20.830254] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T17:48:21.003261] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-23T17:48:21.003142] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T17:48:21.460759] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T17:48:21.802254] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-23T17:48:22.602224] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-23T17:48:22.927896] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-23T17:48:23.323820] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:48:23.402233] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-23T17:48:24.202215] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-23T17:48:25.002198] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-23T17:48:25.422482] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T17:48:25.547380] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T17:48:25.625964] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T17:48:25.802210] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-23T17:48:26.591809] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T17:48:26.602136] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-23T17:48:27.237981] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T17:48:27.402188] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-23T17:48:28.202271] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-23T17:48:28.295428] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T17:48:29.002195] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-23T17:48:29.633123] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:48:29.802178] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-23T17:48:30.602197] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-23T17:48:30.862852] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T17:48:31.280672] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T17:48:31.402188] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-23T17:48:31.582576] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T17:48:32.000767] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T17:48:32.202220] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-23T17:48:33.002209] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-23T17:48:33.802217] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-23T17:48:33.923660] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T17:48:34.355601] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T17:48:34.356927] [INFO ] [REMOTE ] BWSN: Full fetch complete (6143 records). [2025-09-23T17:48:34.357032] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-23T17:48:34.607310] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-23T17:48:34.753128] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-23T17:48:34.753208] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-23T17:48:34.753380] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-23T17:48:34.753453] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-23T17:48:34.753966] [DEBUG] [LOCAL ] BWSN: Trimmed 6143 records to 5091 (keeping 200 days of data) [2025-09-23T17:48:34.815821] [DEBUG] [LOCAL ] BWSN: Primary data saved (5091 records). [2025-09-23T17:48:34.817244] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T17:48:34.817342] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-23T17:48:34.826588] [INFO ] [MAIN ] Update Progress: 369/2372 symbols completed. BWSN took 29.3s. Estimated remaining: 4h 23m 25s. Rate: 7.6 symbols/min [2025-09-23T17:48:34.996877] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:35.054800] [DEBUG] [LOCAL ] BXMT: Loaded 47231 existing records from primary storage. [2025-09-23T17:48:35.054970] [INFO ] [MAIN ] BXMT: Loaded 47231 existing records. [2025-09-23T17:48:35.232241] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:35.232537] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-23T17:48:35.232601] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-23T17:48:35.234070] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-23T17:48:35.234136] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-23T17:48:35.417976] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-23T17:48:35.539115] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T17:48:35.581476] [INFO ] [REMOTE ] BXC: Full fetch complete (17723 records). [2025-09-23T17:48:35.592418] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-23T17:48:35.622988] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:35.983223] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-23T17:48:35.983297] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-23T17:48:35.983616] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-23T17:48:35.983731] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-23T17:48:35.985063] [DEBUG] [LOCAL ] BXC: Trimmed 17723 records to 13767 (keeping 200 days of data) [2025-09-23T17:48:36.073842] [DEBUG] [LOCAL ] BXC: Primary data saved (13767 records). [2025-09-23T17:48:36.073977] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-23T17:48:36.074070] [INFO ] [MAIN ] Update Progress: 370/2372 symbols completed. BXC took 22.9s. Estimated remaining: 4h 22m 41s. Rate: 7.6 symbols/min [2025-09-23T17:48:36.212815] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-23T17:48:36.245705] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:36.245870] [DEBUG] [LOCAL ] BXMX: No existing data file found in primary storage. [2025-09-23T17:48:36.245914] [WARN ] [MAIN ] BXMX: No existing data found, performing full refresh instead. [2025-09-23T17:48:36.246059] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-23T17:48:36.246101] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-23T17:48:36.246142] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-09-23T17:48:36.246173] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-23T17:48:36.600219] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:37.002166] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-23T17:48:37.441377] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-23T17:48:37.594111] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:48:37.804216] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-23T17:48:37.806817] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T17:48:38.602221] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-23T17:48:39.338195] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T17:48:39.402213] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-23T17:48:39.750222] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T17:48:40.052026] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T17:48:40.202181] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-23T17:48:41.002206] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-23T17:48:41.478818] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:48:41.802207] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-23T17:48:42.602317] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-23T17:48:42.891777] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T17:48:43.324216] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:48:43.402152] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-23T17:48:43.958710] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T17:48:44.202167] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-23T17:48:44.226265] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T17:48:45.002195] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-23T17:48:45.525955] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:48:45.802179] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-23T17:48:46.602210] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-23T17:48:46.669250] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:48:47.214448] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T17:48:47.369586] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:48:47.402145] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-23T17:48:48.202222] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-23T17:48:48.524352] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T17:48:49.002298] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-23T17:48:49.771536] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:48:49.802250] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-23T17:48:50.037575] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T17:48:50.602222] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-23T17:48:51.341427] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T17:48:51.350503] [INFO ] [REMOTE ] BX: Full fetch complete (77399 records). [2025-09-23T17:48:51.350716] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-23T17:48:51.408765] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-23T17:48:51.799019] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-23T17:48:51.799108] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-23T17:48:51.799947] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-23T17:48:51.800021] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-23T17:48:51.801529] [DEBUG] [LOCAL ] BX: Trimmed 77399 records to 53497 (keeping 200 days of data) [2025-09-23T17:48:52.142163] [DEBUG] [LOCAL ] BX: Primary data saved (53497 records). [2025-09-23T17:48:52.142301] [INFO ] [MAIN ] BX: Full history saved. [2025-09-23T17:48:52.144100] [INFO ] [MAIN ] Update Progress: 371/2372 symbols completed. BX took 43.5s. Estimated remaining: 4h 23m 17s. Rate: 7.6 symbols/min [2025-09-23T17:48:52.236116] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-23T17:48:52.344293] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T17:48:52.342607] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:52.399900] [DEBUG] [LOCAL ] BXP: Loaded 49824 existing records from primary storage. [2025-09-23T17:48:52.400157] [INFO ] [MAIN ] BXP: Loaded 49824 existing records. [2025-09-23T17:48:52.589898] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:52.590332] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-23T17:48:52.590402] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-23T17:48:52.597959] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-23T17:48:52.611554] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-23T17:48:52.618693] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-23T17:48:52.724596] [INFO ] [REMOTE ] BWXT: Full fetch complete (67272 records). [2025-09-23T17:48:52.727734] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-23T17:48:53.003758] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-23T17:48:53.357278] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:53.432604] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-23T17:48:53.432726] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-23T17:48:53.433566] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-23T17:48:53.433685] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-23T17:48:53.441288] [DEBUG] [LOCAL ] BWXT: Trimmed 67272 records to 46764 (keeping 200 days of data) [2025-09-23T17:48:53.754071] [DEBUG] [LOCAL ] BWXT: Primary data saved (46764 records). [2025-09-23T17:48:53.754213] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-23T17:48:53.754312] [INFO ] [MAIN ] Update Progress: 372/2372 symbols completed. BWXT took 46.5s. Estimated remaining: 4h 22m 36s. Rate: 7.6 symbols/min [2025-09-23T17:48:53.823524] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-23T17:48:53.931988] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:53.943293] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T17:48:53.979140] [INFO ] [REMOTE ] BXMX: Full fetch complete (28719 records). [2025-09-23T17:48:53.980092] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-23T17:48:53.981250] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T17:48:54.265790] [DEBUG] [LOCAL ] BXSL: Loaded 47462 existing records from primary storage. [2025-09-23T17:48:54.315449] [INFO ] [MAIN ] BXSL: Loaded 47462 existing records. [2025-09-23T17:48:54.606523] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-23T17:48:54.629272] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-23T17:48:54.631076] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-23T17:48:54.631676] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-23T17:48:54.631749] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-23T17:48:54.631002] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:54.632424] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-23T17:48:54.632819] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-23T17:48:54.633610] [DEBUG] [LOCAL ] BXMX: Trimmed 28719 records to 19572 (keeping 200 days of data) [2025-09-23T17:48:54.634488] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-23T17:48:54.634575] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-23T17:48:55.070942] [DEBUG] [LOCAL ] BXMX: Primary data saved (19572 records). [2025-09-23T17:48:55.104633] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-23T17:48:55.135333] [INFO ] [MAIN ] Update Progress: 373/2372 symbols completed. BXMX took 19.1s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-23T17:48:55.135210] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:55.326325] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:55.359855] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:48:55.384686] [DEBUG] [LOCAL ] BY: Loaded 21511 existing records from primary storage. [2025-09-23T17:48:55.384849] [INFO ] [MAIN ] BY: Loaded 21511 existing records. [2025-09-23T17:48:55.407281] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-23T17:48:55.571616] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:55.571914] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-23T17:48:55.572005] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-23T17:48:55.572852] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-23T17:48:55.572914] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-23T17:48:55.933890] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:55.990817] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T17:48:56.202232] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-23T17:48:56.959004] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T17:48:57.002177] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-23T17:48:57.296690] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:48:57.802232] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-23T17:48:58.223295] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T17:48:58.471859] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T17:48:58.602260] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-23T17:48:59.402197] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-23T17:48:59.877148] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T17:49:00.202210] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-23T17:49:00.996045] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T17:49:01.005700] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-23T17:49:01.465520] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T17:49:01.802166] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-23T17:49:01.839046] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T17:49:02.602253] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-23T17:49:03.090792] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T17:49:03.325918] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:49:03.402146] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-23T17:49:04.202259] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-23T17:49:04.624543] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:49:05.002244] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-23T17:49:05.542433] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:49:05.802204] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-23T17:49:06.444476] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T17:49:06.602156] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-23T17:49:06.808192] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T17:49:07.402200] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-23T17:49:08.202206] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-23T17:49:09.002221] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-23T17:49:10.033066] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (3.43 seconds). [2025-09-23T17:49:10.044997] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-23T17:49:10.441759] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-23T17:49:10.481696] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T17:49:10.602200] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-23T17:49:10.925776] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-23T17:49:11.402272] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-23T17:49:11.471845] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:49:11.915088] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T17:49:12.148833] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T17:49:12.202184] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-23T17:49:13.002244] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-23T17:49:13.189357] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T17:49:13.802240] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-23T17:49:14.295393] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T17:49:14.602293] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-23T17:49:14.979381] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T17:49:14.983715] [INFO ] [REMOTE ] BY: Full fetch complete (29077 records). [2025-09-23T17:49:14.983838] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-23T17:49:15.372960] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-23T17:49:15.373078] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-23T17:49:15.373805] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-23T17:49:15.373871] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-23T17:49:15.374973] [DEBUG] [LOCAL ] BY: Trimmed 29077 records to 21542 (keeping 200 days of data) [2025-09-23T17:49:15.431634] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-23T17:49:15.522940] [DEBUG] [LOCAL ] BY: Primary data saved (21542 records). [2025-09-23T17:49:15.523153] [INFO ] [MAIN ] BY: Full history saved. [2025-09-23T17:49:15.523294] [INFO ] [MAIN ] Update Progress: 374/2372 symbols completed. BY took 20.4s. Estimated remaining: 4h 22m 52s. Rate: 7.6 symbols/min [2025-09-23T17:49:15.702322] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:15.760075] [DEBUG] [LOCAL ] BYD: Loaded 45355 existing records from primary storage. [2025-09-23T17:49:15.760298] [INFO ] [MAIN ] BYD: Loaded 45355 existing records. [2025-09-23T17:49:15.949125] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:15.949796] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-23T17:49:15.949880] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-23T17:49:15.951808] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-23T17:49:15.951889] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-23T17:49:16.095945] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T17:49:16.150028] [INFO ] [REMOTE ] BXMT: Full fetch complete (69367 records). [2025-09-23T17:49:16.161878] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-23T17:49:16.222021] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-23T17:49:16.620573] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:16.825413] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-23T17:49:16.825570] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-23T17:49:16.826305] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-23T17:49:16.826534] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-23T17:49:16.828444] [DEBUG] [LOCAL ] BXMT: Trimmed 69367 records to 47250 (keeping 200 days of data) [2025-09-23T17:49:16.957418] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:49:17.002403] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-23T17:49:17.168742] [DEBUG] [LOCAL ] BXMT: Primary data saved (47250 records). [2025-09-23T17:49:17.168882] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-23T17:49:17.168968] [INFO ] [MAIN ] Update Progress: 375/2372 symbols completed. BXMT took 42.3s. Estimated remaining: 4h 22m 11s. Rate: 7.6 symbols/min [2025-09-23T17:49:17.342556] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:17.358150] [DEBUG] [LOCAL ] BYM: Loaded 12167 existing records from primary storage. [2025-09-23T17:49:17.358302] [INFO ] [MAIN ] BYM: Loaded 12167 existing records. [2025-09-23T17:49:17.540038] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:17.540295] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-23T17:49:17.540344] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-23T17:49:17.541068] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-23T17:49:17.541131] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-23T17:49:17.804794] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-23T17:49:17.914304] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:18.058475] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T17:49:18.328960] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T17:49:18.602190] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-23T17:49:19.156268] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:49:19.402180] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-23T17:49:19.942210] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T17:49:19.950720] [INFO ] [REMOTE ] BXP: Full fetch complete (71165 records). [2025-09-23T17:49:19.950894] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-23T17:49:20.213509] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-23T17:49:20.359940] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-23T17:49:20.360079] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-23T17:49:20.360887] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-23T17:49:20.360959] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-23T17:49:20.362561] [DEBUG] [LOCAL ] BXP: Trimmed 71165 records to 49802 (keeping 200 days of data) [2025-09-23T17:49:20.687143] [DEBUG] [LOCAL ] BXP: Primary data saved (49802 records). [2025-09-23T17:49:20.687293] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-23T17:49:20.687381] [INFO ] [MAIN ] Update Progress: 376/2372 symbols completed. BXP took 28.5s. Estimated remaining: 4h 21m 40s. Rate: 7.6 symbols/min [2025-09-23T17:49:20.866877] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:20.904567] [DEBUG] [LOCAL ] BZH: Loaded 32788 existing records from primary storage. [2025-09-23T17:49:20.904769] [INFO ] [MAIN ] BZH: Loaded 32788 existing records. [2025-09-23T17:49:21.009837] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-23T17:49:21.100402] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:21.101116] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-23T17:49:21.101424] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-23T17:49:21.111755] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T17:49:21.110736] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-23T17:49:21.115765] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-23T17:49:21.232271] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T17:49:21.531228] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:21.802181] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-23T17:49:22.340276] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:49:22.602179] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-23T17:49:23.078030] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T17:49:23.402196] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-23T17:49:23.938814] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:49:24.202207] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-23T17:49:24.301555] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T17:49:24.734952] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T17:49:25.002201] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-23T17:49:25.802231] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-23T17:49:26.203064] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T17:49:26.602417] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-23T17:49:27.106963] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T17:49:27.402191] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-23T17:49:27.677765] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T17:49:28.202247] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-23T17:49:29.002196] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-23T17:49:29.108753] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T17:49:29.117498] [INFO ] [REMOTE ] BXSL: Full fetch complete (69188 records). [2025-09-23T17:49:29.117706] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-23T17:49:29.537119] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-23T17:49:29.538094] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-23T17:49:29.538782] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T17:49:29.540748] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-23T17:49:29.540855] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-23T17:49:29.565950] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T17:49:29.575232] [DEBUG] [LOCAL ] BXSL: Trimmed 69188 records to 47457 (keeping 200 days of data) [2025-09-23T17:49:29.802265] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-23T17:49:29.878731] [DEBUG] [LOCAL ] BXSL: Primary data saved (47457 records). [2025-09-23T17:49:29.878869] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-23T17:49:29.878978] [INFO ] [MAIN ] Update Progress: 377/2372 symbols completed. BXSL took 36.1s. Estimated remaining: 4h 21m 39s. Rate: 7.6 symbols/min [2025-09-23T17:49:30.051313] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:30.103208] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-23T17:49:30.103354] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-09-23T17:49:30.282508] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:30.282802] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-23T17:49:30.282861] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-23T17:49:30.284394] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-23T17:49:30.284458] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-23T17:49:30.476203] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-23T17:49:30.607371] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-23T17:49:30.675690] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:31.402204] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-23T17:49:31.680495] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:49:32.202285] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-23T17:49:33.002213] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-23T17:49:33.181731] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T17:49:33.590438] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:49:33.802186] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-23T17:49:34.072608] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:49:34.602207] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-23T17:49:35.278122] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T17:49:35.402164] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-23T17:49:35.499145] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T17:49:36.202222] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-23T17:49:36.886329] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T17:49:37.002151] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-23T17:49:37.216775] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T17:49:37.802206] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-23T17:49:38.433633] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:49:38.602244] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-23T17:49:39.324566] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:49:39.402155] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-23T17:49:40.131979] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T17:49:40.202256] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-23T17:49:41.002258] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-23T17:49:41.166394] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T17:49:41.600506] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:49:41.802303] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-23T17:49:42.222277] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:49:42.602255] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-23T17:49:42.985598] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:49:43.187716] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T17:49:43.402225] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-23T17:49:44.202194] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-23T17:49:44.217976] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T17:49:45.002237] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-23T17:49:45.638277] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T17:49:45.719967] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T17:49:45.802204] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-23T17:49:46.602199] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-23T17:49:47.008614] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:49:47.402195] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-23T17:49:48.202202] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-23T17:49:48.634547] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T17:49:48.800204] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:49:48.807389] [INFO ] [REMOTE ] BYD: Full fetch complete (64921 records). [2025-09-23T17:49:48.807514] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-23T17:49:49.007332] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-23T17:49:49.199578] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-23T17:49:49.199690] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-23T17:49:49.200443] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-23T17:49:49.200554] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-23T17:49:49.201982] [DEBUG] [LOCAL ] BYD: Trimmed 64921 records to 45300 (keeping 200 days of data) [2025-09-23T17:49:49.483336] [DEBUG] [LOCAL ] BYD: Primary data saved (45300 records). [2025-09-23T17:49:49.483477] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-23T17:49:49.483562] [INFO ] [MAIN ] Update Progress: 378/2372 symbols completed. BYD took 34.0s. Estimated remaining: 4h 22m 33s. Rate: 7.6 symbols/min [2025-09-23T17:49:49.668355] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:49.670814] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T17:49:49.677145] [INFO ] [REMOTE ] BZH: Full fetch complete (47039 records). [2025-09-23T17:49:49.677369] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-23T17:49:49.748604] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:49:49.799063] [DEBUG] [LOCAL ] CAAP: Loaded 19303 existing records from primary storage. [2025-09-23T17:49:49.799265] [INFO ] [REMOTE ] BYM: Full fetch complete (17976 records). [2025-09-23T17:49:49.805729] [INFO ] [MAIN ] CAAP: Loaded 19303 existing records. [2025-09-23T17:49:49.813814] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-23T17:49:49.824013] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-23T17:49:50.388614] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:50.483269] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-23T17:49:50.483690] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-23T17:49:50.532425] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-23T17:49:50.542825] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-23T17:49:50.756750] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-23T17:49:50.762149] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-23T17:49:50.773472] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-23T17:49:50.797290] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-23T17:49:50.893672] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-23T17:49:50.941805] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-23T17:49:50.978772] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-23T17:49:50.980731] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-23T17:49:50.957958] [DEBUG] [LOCAL ] BZH: Trimmed 47039 records to 32727 (keeping 200 days of data) [2025-09-23T17:49:51.065866] [DEBUG] [LOCAL ] BYM: Trimmed 17976 records to 12057 (keeping 200 days of data) [2025-09-23T17:49:51.264442] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:51.282498] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-23T17:49:51.375502] [DEBUG] [LOCAL ] BYM: Primary data saved (12057 records). [2025-09-23T17:49:51.378730] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-23T17:49:51.379703] [INFO ] [MAIN ] Update Progress: 379/2372 symbols completed. BYM took 34.2s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-23T17:49:51.505666] [DEBUG] [LOCAL ] BZH: Primary data saved (32727 records). [2025-09-23T17:49:51.521126] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-23T17:49:51.526364] [INFO ] [MAIN ] Update Progress: 380/2372 symbols completed. BZH took 30.8s. Estimated remaining: 4h 21m 5s. Rate: 7.6 symbols/min [2025-09-23T17:49:51.639989] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:51.758877] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:51.759228] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-09-23T17:49:51.759302] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-09-23T17:49:51.759604] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-23T17:49:51.759777] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-23T17:49:51.759851] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-23T17:49:51.759915] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-23T17:49:51.820053] [DEBUG] [LOCAL ] CABO: Loaded 17506 existing records from primary storage. [2025-09-23T17:49:51.841736] [INFO ] [MAIN ] CABO: Loaded 17506 existing records. [2025-09-23T17:49:52.264743] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:52.275731] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-23T17:49:52.335277] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:52.301901] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-23T17:49:52.336018] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-23T17:49:52.337607] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-23T17:49:52.337780] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-23T17:49:52.448192] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-23T17:49:52.499812] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-23T17:49:52.708853] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:49:52.776887] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:53.002195] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-23T17:49:53.636881] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:49:53.739700] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T17:49:53.802172] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-23T17:49:54.182738] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T17:49:54.357205] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:49:54.602190] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-23T17:49:55.402209] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-23T17:49:55.651947] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T17:49:56.202222] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-23T17:49:57.002236] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-23T17:49:57.382466] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T17:49:57.478893] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T17:49:57.802224] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-23T17:49:57.973048] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T17:49:58.394287] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:49:58.602242] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-23T17:49:59.402256] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-23T17:49:59.962856] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T17:50:00.202195] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-23T17:50:00.932521] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:50:01.002193] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-23T17:50:01.498987] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T17:50:01.802252] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-23T17:50:02.339717] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:50:02.602250] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-23T17:50:02.722150] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T17:50:03.402211] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-23T17:50:04.102440] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:50:04.202233] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-23T17:50:04.499047] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T17:50:04.508504] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-09-23T17:50:04.508704] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-23T17:50:04.906070] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-23T17:50:04.906275] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-23T17:50:04.907147] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-23T17:50:04.907286] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-23T17:50:04.920048] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T17:50:04.924187] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53741 (keeping 200 days of data) [2025-09-23T17:50:05.016344] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-23T17:50:05.260581] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-23T17:50:05.260762] [INFO ] [MAIN ] C: Full history saved. [2025-09-23T17:50:05.260861] [INFO ] [MAIN ] Update Progress: 381/2372 symbols completed. C took 35.4s. Estimated remaining: 4h 21m 28s. Rate: 7.6 symbols/min [2025-09-23T17:50:05.430740] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:05.483013] [DEBUG] [LOCAL ] CADE: Loaded 48797 existing records from primary storage. [2025-09-23T17:50:05.483167] [INFO ] [MAIN ] CADE: Loaded 48797 existing records. [2025-09-23T17:50:05.664222] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:05.664527] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-23T17:50:05.664577] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-23T17:50:05.666086] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-23T17:50:05.666150] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-23T17:50:05.807387] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-23T17:50:06.022319] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:06.248536] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T17:50:06.602204] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-23T17:50:06.639896] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:50:07.402338] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-23T17:50:07.612914] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T17:50:08.202218] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-23T17:50:09.002198] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-23T17:50:09.219574] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T17:50:09.273015] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T17:50:09.802233] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-23T17:50:10.336273] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T17:50:10.602213] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-23T17:50:11.073318] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:50:11.341102] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T17:50:11.402217] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-23T17:50:12.202251] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-23T17:50:12.662050] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T17:50:13.002198] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-23T17:50:13.168295] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:50:13.172903] [INFO ] [REMOTE ] CAAP: Full fetch complete (27591 records). [2025-09-23T17:50:13.173030] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-23T17:50:13.552322] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-23T17:50:13.552408] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-23T17:50:13.552873] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-23T17:50:13.552938] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-23T17:50:13.553818] [DEBUG] [LOCAL ] CAAP: Trimmed 27591 records to 19410 (keeping 200 days of data) [2025-09-23T17:50:13.666486] [DEBUG] [LOCAL ] CAAP: Primary data saved (19410 records). [2025-09-23T17:50:13.666635] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-23T17:50:13.666764] [INFO ] [MAIN ] Update Progress: 382/2372 symbols completed. CAAP took 24.2s. Estimated remaining: 4h 21m 23s. Rate: 7.6 symbols/min [2025-09-23T17:50:13.817292] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-23T17:50:13.852799] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:13.891028] [DEBUG] [LOCAL ] CAE: Loaded 38913 existing records from primary storage. [2025-09-23T17:50:13.891287] [INFO ] [MAIN ] CAE: Loaded 38913 existing records. [2025-09-23T17:50:13.988958] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T17:50:14.106744] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:14.107009] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-23T17:50:14.107068] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-23T17:50:14.108243] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-23T17:50:14.108306] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-23T17:50:14.496272] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:14.602161] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-23T17:50:15.031691] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T17:50:15.402243] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-23T17:50:16.194220] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T17:50:16.202140] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-23T17:50:16.404166] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T17:50:17.002205] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-23T17:50:17.564020] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T17:50:17.802240] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-23T17:50:18.402249] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:50:18.550313] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T17:50:18.602191] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-23T17:50:19.336812] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T17:50:19.339346] [INFO ] [REMOTE ] CABO: Full fetch complete (22984 records). [2025-09-23T17:50:19.339424] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-23T17:50:19.407304] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-23T17:50:19.711705] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-23T17:50:19.711807] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-23T17:50:19.712209] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-23T17:50:19.712251] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-23T17:50:19.712926] [DEBUG] [LOCAL ] CABO: Trimmed 22984 records to 17449 (keeping 200 days of data) [2025-09-23T17:50:19.818745] [DEBUG] [LOCAL ] CABO: Primary data saved (17449 records). [2025-09-23T17:50:19.818892] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-23T17:50:19.818989] [INFO ] [MAIN ] Update Progress: 383/2372 symbols completed. CABO took 28.4s. Estimated remaining: 4h 21m 6s. Rate: 7.6 symbols/min [2025-09-23T17:50:19.986469] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:19.991720] [DEBUG] [LOCAL ] CAF: Loaded 3423 existing records from primary storage. [2025-09-23T17:50:19.991810] [INFO ] [MAIN ] CAF: Loaded 3423 existing records. [2025-09-23T17:50:20.170948] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:20.171168] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-23T17:50:20.171221] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-23T17:50:20.171465] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-23T17:50:20.171526] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-23T17:50:20.207371] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-23T17:50:20.532408] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:20.994936] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T17:50:21.002182] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-23T17:50:21.048111] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:50:21.802183] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-23T17:50:22.367454] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:50:22.602199] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-23T17:50:23.286507] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T17:50:23.402192] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-23T17:50:23.923616] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:50:24.202229] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-23T17:50:24.488283] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T17:50:25.002197] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-23T17:50:25.386800] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T17:50:25.504788] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T17:50:25.802195] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-23T17:50:26.198244] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:50:26.602214] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-23T17:50:27.402209] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-23T17:50:28.204053] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-23T17:50:28.206838] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T17:50:28.639524] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T17:50:29.002194] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-23T17:50:29.411920] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:50:29.802155] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-23T17:50:29.803283] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T17:50:29.808461] [INFO ] [REMOTE ] CACI: Full fetch complete (39150 records). [2025-09-23T17:50:29.808584] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-23T17:50:30.208069] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-23T17:50:30.208178] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-23T17:50:30.208792] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-23T17:50:30.208859] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-23T17:50:30.209822] [DEBUG] [LOCAL ] CACI: Trimmed 39150 records to 25266 (keeping 200 days of data) [2025-09-23T17:50:30.369460] [DEBUG] [LOCAL ] CACI: Primary data saved (25266 records). [2025-09-23T17:50:30.369614] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-23T17:50:30.369743] [INFO ] [MAIN ] Update Progress: 384/2372 symbols completed. CACI took 38.8s. Estimated remaining: 4h 21m 12s. Rate: 7.6 symbols/min [2025-09-23T17:50:30.557263] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:30.609074] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-23T17:50:30.612605] [DEBUG] [LOCAL ] CAG: Loaded 53659 existing records from primary storage. [2025-09-23T17:50:30.612867] [INFO ] [MAIN ] CAG: Loaded 53659 existing records. [2025-09-23T17:50:30.799332] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:30.799637] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-23T17:50:30.799723] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-23T17:50:30.801183] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-23T17:50:30.801248] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-23T17:50:30.924604] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T17:50:31.204016] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:31.402193] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-23T17:50:32.104120] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T17:50:32.202156] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-23T17:50:32.450735] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T17:50:33.002217] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-23T17:50:33.216865] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T17:50:33.802191] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-23T17:50:34.421846] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T17:50:34.602237] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-23T17:50:35.025031] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T17:50:35.402242] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-23T17:50:36.202271] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-23T17:50:36.328908] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:50:36.338302] [INFO ] [REMOTE ] CADE: Full fetch complete (69659 records). [2025-09-23T17:50:36.338482] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-23T17:50:36.783239] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-23T17:50:36.783446] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-23T17:50:36.784232] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-23T17:50:36.784369] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-23T17:50:36.785915] [DEBUG] [LOCAL ] CADE: Trimmed 69659 records to 48801 (keeping 200 days of data) [2025-09-23T17:50:36.899538] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T17:50:37.005212] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-23T17:50:37.125881] [DEBUG] [LOCAL ] CADE: Primary data saved (48801 records). [2025-09-23T17:50:37.126061] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-23T17:50:37.126160] [INFO ] [MAIN ] Update Progress: 385/2372 symbols completed. CADE took 31.9s. Estimated remaining: 4h 20m 58s. Rate: 7.6 symbols/min [2025-09-23T17:50:37.299724] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:37.354541] [DEBUG] [LOCAL ] CAH: Loaded 51466 existing records from primary storage. [2025-09-23T17:50:37.354772] [INFO ] [MAIN ] CAH: Loaded 51466 existing records. [2025-09-23T17:50:37.534192] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:37.534785] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-23T17:50:37.534883] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-23T17:50:37.536637] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-23T17:50:37.536724] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-23T17:50:37.807702] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-23T17:50:37.932540] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:37.928579] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T17:50:38.242328] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T17:50:38.248616] [INFO ] [REMOTE ] CAE: Full fetch complete (55695 records). [2025-09-23T17:50:38.248737] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-23T17:50:38.358235] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T17:50:38.606962] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-23T17:50:38.641370] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-23T17:50:38.641455] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-23T17:50:38.642176] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-23T17:50:38.642243] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-23T17:50:38.643710] [DEBUG] [LOCAL ] CAE: Trimmed 55695 records to 38961 (keeping 200 days of data) [2025-09-23T17:50:38.867438] [DEBUG] [LOCAL ] CAE: Primary data saved (38961 records). [2025-09-23T17:50:38.867621] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-23T17:50:38.867749] [INFO ] [MAIN ] Update Progress: 386/2372 symbols completed. CAE took 25.2s. Estimated remaining: 4h 20m 19s. Rate: 7.6 symbols/min [2025-09-23T17:50:39.036773] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:39.079478] [DEBUG] [LOCAL ] CAL: Loaded 43280 existing records from primary storage. [2025-09-23T17:50:39.079630] [INFO ] [MAIN ] CAL: Loaded 43280 existing records. [2025-09-23T17:50:39.298987] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:39.299296] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-23T17:50:39.299346] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-23T17:50:39.300413] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-23T17:50:39.300475] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-23T17:50:39.407254] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-23T17:50:39.660350] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:40.202176] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-23T17:50:40.644422] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T17:50:40.671560] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:50:40.993367] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T17:50:41.004564] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-23T17:50:41.335779] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T17:50:41.802185] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-23T17:50:42.602247] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-23T17:50:43.106614] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T17:50:43.402211] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-23T17:50:43.870303] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T17:50:43.936907] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:50:44.202225] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-23T17:50:45.002213] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-23T17:50:45.571178] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:50:45.802197] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-23T17:50:46.402064] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:50:46.602213] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-23T17:50:46.788288] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T17:50:47.402268] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-23T17:50:47.825276] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:50:48.001865] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T17:50:48.202248] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-23T17:50:49.002194] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-23T17:50:49.725405] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T17:50:49.802152] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-23T17:50:50.098770] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T17:50:50.602224] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-23T17:50:51.402192] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-23T17:50:51.903619] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T17:50:52.115482] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:50:52.202176] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-23T17:50:52.881068] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T17:50:53.002245] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-23T17:50:53.467430] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T17:50:53.802217] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-23T17:50:54.602236] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-23T17:50:54.810762] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T17:50:55.192738] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:50:55.194411] [INFO ] [REMOTE ] CAF: Full fetch complete (5823 records). [2025-09-23T17:50:55.194493] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-23T17:50:55.407845] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-23T17:50:55.544571] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T17:50:55.630111] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-23T17:50:55.630197] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-23T17:50:55.630351] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-23T17:50:55.630412] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-23T17:50:55.630975] [DEBUG] [LOCAL ] CAF: Trimmed 5823 records to 3440 (keeping 200 days of data) [2025-09-23T17:50:55.651742] [DEBUG] [LOCAL ] CAF: Primary data saved (3440 records). [2025-09-23T17:50:55.651812] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-23T17:50:55.651893] [INFO ] [MAIN ] Update Progress: 387/2372 symbols completed. CAF took 35.8s. Estimated remaining: 4h 20m 57s. Rate: 7.6 symbols/min [2025-09-23T17:50:55.859343] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:55.909283] [DEBUG] [LOCAL ] CALX: Loaded 38657 existing records from primary storage. [2025-09-23T17:50:55.909423] [INFO ] [MAIN ] CALX: Loaded 38657 existing records. [2025-09-23T17:50:56.093239] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:56.093600] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-23T17:50:56.093689] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-23T17:50:56.094638] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-23T17:50:56.094749] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-23T17:50:56.207351] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-23T17:50:56.457074] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:56.810898] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T17:50:57.002216] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-23T17:50:57.803692] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-23T17:50:57.820746] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T17:50:58.384481] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:50:58.602244] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-23T17:50:59.251673] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T17:50:59.402283] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-23T17:51:00.096349] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T17:51:00.202152] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-23T17:51:01.007249] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-23T17:51:01.024784] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T17:51:01.229279] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T17:51:01.802249] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-23T17:51:02.602191] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-23T17:51:03.402203] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-23T17:51:03.554923] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-23T17:51:04.202227] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-23T17:51:04.663307] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-23T17:51:04.699084] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-09-23T17:51:05.002220] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-23T17:51:05.802210] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-23T17:51:06.007528] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-23T17:51:06.017767] [INFO ] [REMOTE ] CAH: Full fetch complete (74206 records). [2025-09-23T17:51:06.017941] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-23T17:51:06.018946] [FATAL] [VALIDATOR ] CAH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:51:06.019051] [FATAL] [MAIN ] CAH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:51:06.019096] [WARN ] [MAIN ] CAH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:51:06.019138] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-23T17:51:06.019200] [DEBUG] [LOCAL ] CAH: No primary data file found to delete. [2025-09-23T17:51:06.019237] [INFO ] [LOCAL ] CAH: Starting deletion of derivative data. [2025-09-23T17:51:06.019802] [DEBUG] [LOCAL ] CAH: Deleted derivative data file. [2025-09-23T17:51:06.019937] [INFO ] [MAIN ] Update Progress: 388/2372 symbols completed. CAH took 28.9s. Estimated remaining: 4h 21m 1s. Rate: 7.6 symbols/min [2025-09-23T17:51:06.198226] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:06.224944] [DEBUG] [LOCAL ] CANG: Loaded 26659 existing records from primary storage. [2025-09-23T17:51:06.225200] [INFO ] [MAIN ] CANG: Loaded 26659 existing records. [2025-09-23T17:51:06.364385] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T17:51:06.457684] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:06.458510] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-23T17:51:06.458638] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-23T17:51:06.459888] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-23T17:51:06.459951] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-23T17:51:06.599161] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-23T17:51:06.605085] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-23T17:51:06.866798] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:06.993782] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:51:07.402196] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-23T17:51:08.202238] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-23T17:51:08.474113] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T17:51:08.504587] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T17:51:09.002248] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-23T17:51:09.807284] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-23T17:51:09.826049] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T17:51:10.602207] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-23T17:51:10.685766] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T17:51:10.734093] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:51:10.741673] [INFO ] [REMOTE ] CAL: Full fetch complete (61964 records). [2025-09-23T17:51:10.741808] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-23T17:51:11.120324] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-23T17:51:11.120409] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-23T17:51:11.121154] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-23T17:51:11.121257] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-23T17:51:11.123521] [DEBUG] [LOCAL ] CAL: Trimmed 61964 records to 43299 (keeping 200 days of data) [2025-09-23T17:51:11.399845] [DEBUG] [LOCAL ] CAL: Primary data saved (43299 records). [2025-09-23T17:51:11.400096] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-23T17:51:11.400315] [INFO ] [MAIN ] Update Progress: 389/2372 symbols completed. CAL took 32.5s. Estimated remaining: 4h 20m 41s. Rate: 7.6 symbols/min [2025-09-23T17:51:11.413947] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-23T17:51:11.579399] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:11.590023] [DEBUG] [LOCAL ] CAPL: Loaded 5880 existing records from primary storage. [2025-09-23T17:51:11.590145] [INFO ] [MAIN ] CAPL: Loaded 5880 existing records. [2025-09-23T17:51:11.764436] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:11.764730] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-23T17:51:11.764786] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-23T17:51:11.765168] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-23T17:51:11.765248] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-23T17:51:12.126944] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:12.205228] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-23T17:51:12.210899] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T17:51:12.221051] [INFO ] [REMOTE ] CAG: Full fetch complete (77648 records). [2025-09-23T17:51:12.221209] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-23T17:51:12.516722] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T17:51:12.642281] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-23T17:51:12.642352] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-23T17:51:12.643159] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-23T17:51:12.643223] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-23T17:51:12.644778] [DEBUG] [LOCAL ] CAG: Trimmed 77648 records to 53659 (keeping 200 days of data) [2025-09-23T17:51:12.988519] [DEBUG] [LOCAL ] CAG: Primary data saved (53659 records). [2025-09-23T17:51:12.988738] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-23T17:51:12.988900] [INFO ] [MAIN ] Update Progress: 390/2372 symbols completed. CAG took 42.6s. Estimated remaining: 4h 20m 1s. Rate: 7.6 symbols/min [2025-09-23T17:51:13.010630] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-23T17:51:13.163389] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:13.218862] [DEBUG] [LOCAL ] CARR: Loaded 53596 existing records from primary storage. [2025-09-23T17:51:13.219072] [INFO ] [MAIN ] CARR: Loaded 53596 existing records. [2025-09-23T17:51:13.406784] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:13.407185] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-23T17:51:13.407380] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-23T17:51:13.430493] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:51:13.430553] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-23T17:51:13.438383] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-23T17:51:13.802723] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:13.802790] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-23T17:51:13.890691] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T17:51:14.602206] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-23T17:51:14.743016] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:51:15.402183] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-23T17:51:15.429049] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T17:51:16.202213] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-23T17:51:16.974866] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:51:17.002162] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-23T17:51:17.295068] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T17:51:17.424473] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T17:51:17.802187] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-23T17:51:18.602210] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-23T17:51:18.724691] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T17:51:19.402219] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-23T17:51:19.798859] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T17:51:19.892506] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:51:20.202200] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-23T17:51:20.657616] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T17:51:21.002208] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-23T17:51:21.802203] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-23T17:51:22.267300] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T17:51:22.306126] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T17:51:22.602210] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-23T17:51:23.034123] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T17:51:23.402210] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-23T17:51:24.202209] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-23T17:51:24.267807] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T17:51:25.002213] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-23T17:51:25.114785] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T17:51:25.802236] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-23T17:51:25.963898] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T17:51:26.602197] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-23T17:51:27.028055] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:51:27.354560] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:51:27.402230] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-23T17:51:28.059443] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T17:51:28.202243] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-23T17:51:29.002297] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-23T17:51:29.122568] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T17:51:29.802186] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-23T17:51:30.602208] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-23T17:51:30.850501] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T17:51:30.880557] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T17:51:30.886685] [INFO ] [REMOTE ] CANG: Full fetch complete (40525 records). [2025-09-23T17:51:30.886813] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-23T17:51:31.128697] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T17:51:31.181017] [INFO ] [REMOTE ] CAPL: Full fetch complete (8933 records). [2025-09-23T17:51:31.195556] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-23T17:51:31.420336] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-23T17:51:31.542546] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-23T17:51:31.549366] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-23T17:51:31.578845] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-23T17:51:31.591780] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-23T17:51:31.670271] [DEBUG] [LOCAL ] CANG: Trimmed 40525 records to 26721 (keeping 200 days of data) [2025-09-23T17:51:31.743661] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-23T17:51:31.743756] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-23T17:51:31.744107] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-23T17:51:31.744153] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-23T17:51:31.744595] [DEBUG] [LOCAL ] CAPL: Trimmed 8933 records to 5866 (keeping 200 days of data) [2025-09-23T17:51:31.866031] [DEBUG] [LOCAL ] CAPL: Primary data saved (5866 records). [2025-09-23T17:51:31.878916] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-23T17:51:31.884935] [INFO ] [MAIN ] Update Progress: 391/2372 symbols completed. CAPL took 20.5s. Estimated remaining: 4h 20m 49s. Rate: 7.6 symbols/min [2025-09-23T17:51:32.091217] [DEBUG] [LOCAL ] CANG: Primary data saved (26721 records). [2025-09-23T17:51:32.112109] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-23T17:51:32.114382] [INFO ] [MAIN ] Update Progress: 392/2372 symbols completed. CANG took 26.1s. Estimated remaining: 4h 20m 2s. Rate: 7.6 symbols/min [2025-09-23T17:51:32.114199] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:32.205023] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-23T17:51:32.334394] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:32.349473] [DEBUG] [LOCAL ] CARS: Loaded 40297 existing records from primary storage. [2025-09-23T17:51:32.349765] [INFO ] [MAIN ] CARS: Loaded 40297 existing records. [2025-09-23T17:51:32.536170] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:32.536455] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-23T17:51:32.536504] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-23T17:51:32.537687] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-23T17:51:32.537752] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-23T17:51:32.722772] [DEBUG] [LOCAL ] CAT: Loaded 52926 existing records from primary storage. [2025-09-23T17:51:32.734508] [INFO ] [MAIN ] CAT: Loaded 52926 existing records. [2025-09-23T17:51:33.151539] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:33.173385] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-23T17:51:33.204177] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:33.205512] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-23T17:51:33.205667] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-23T17:51:33.207833] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-23T17:51:33.207955] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-23T17:51:33.585364] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T17:51:33.628347] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:33.697931] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T17:51:33.802199] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-23T17:51:34.602317] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-23T17:51:34.674357] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:51:35.207578] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:51:35.402228] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-23T17:51:35.576933] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:51:35.583098] [INFO ] [REMOTE ] CALX: Full fetch complete (54193 records). [2025-09-23T17:51:35.583207] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-23T17:51:35.963594] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-23T17:51:35.963716] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-23T17:51:35.964349] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-23T17:51:35.964391] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-23T17:51:35.966701] [DEBUG] [LOCAL ] CALX: Trimmed 54193 records to 38586 (keeping 200 days of data) [2025-09-23T17:51:36.196918] [DEBUG] [LOCAL ] CALX: Primary data saved (38586 records). [2025-09-23T17:51:36.197062] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-23T17:51:36.197190] [INFO ] [MAIN ] Update Progress: 393/2372 symbols completed. CALX took 40.5s. Estimated remaining: 4h 19m 35s. Rate: 7.6 symbols/min [2025-09-23T17:51:36.208244] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-23T17:51:36.381879] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:36.408033] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T17:51:36.419098] [DEBUG] [LOCAL ] CATO: Loaded 7350 existing records from primary storage. [2025-09-23T17:51:36.419240] [INFO ] [MAIN ] CATO: Loaded 7350 existing records. [2025-09-23T17:51:36.596058] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:36.596304] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-23T17:51:36.596352] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-23T17:51:36.596691] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-23T17:51:36.596753] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-23T17:51:36.953080] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:37.002184] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-23T17:51:37.798217] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T17:51:37.802164] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-23T17:51:38.168856] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T17:51:38.257895] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T17:51:38.602229] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-23T17:51:39.043405] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T17:51:39.402268] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-23T17:51:40.202239] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-23T17:51:40.296228] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T17:51:41.002207] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-23T17:51:41.802177] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-23T17:51:42.173971] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T17:51:42.251002] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T17:51:42.602269] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-23T17:51:43.210393] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T17:51:43.402211] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-23T17:51:44.202197] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-23T17:51:44.742849] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T17:51:44.868444] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T17:51:45.002283] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-23T17:51:45.566817] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T17:51:45.802207] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-23T17:51:46.602181] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-23T17:51:46.696282] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T17:51:46.948054] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T17:51:47.402219] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-23T17:51:47.569203] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T17:51:48.202213] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-23T17:51:49.002209] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-23T17:51:49.100826] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T17:51:49.792496] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T17:51:49.802174] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-23T17:51:49.995799] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T17:51:50.005623] [INFO ] [REMOTE ] CARR: Full fetch complete (77599 records). [2025-09-23T17:51:50.005821] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-23T17:51:50.404582] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-23T17:51:50.404699] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-23T17:51:50.405571] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-23T17:51:50.405636] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-23T17:51:50.407225] [DEBUG] [LOCAL ] CARR: Trimmed 77599 records to 53596 (keeping 200 days of data) [2025-09-23T17:51:50.618624] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-23T17:51:50.749240] [DEBUG] [LOCAL ] CARR: Primary data saved (53596 records). [2025-09-23T17:51:50.749392] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-23T17:51:50.749486] [INFO ] [MAIN ] Update Progress: 394/2372 symbols completed. CARR took 37.8s. Estimated remaining: 4h 20m 1s. Rate: 7.6 symbols/min [2025-09-23T17:51:50.980947] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:51.032823] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-09-23T17:51:51.032967] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-09-23T17:51:51.209715] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:51.209974] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-23T17:51:51.210022] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-23T17:51:51.211109] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-23T17:51:51.211171] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-23T17:51:51.418071] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-23T17:51:51.575404] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:51.713000] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:51:51.740200] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T17:51:52.113992] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:51:52.202160] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-23T17:51:53.002241] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-23T17:51:53.491717] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T17:51:53.802188] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-23T17:51:54.354983] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-23T17:51:54.602197] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-23T17:51:54.860163] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T17:51:55.402247] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-23T17:51:56.202196] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-23T17:51:56.284330] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T17:51:56.626901] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-23T17:51:57.002219] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-23T17:51:57.145968] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T17:51:57.502792] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:51:57.802177] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-23T17:51:58.349039] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T17:51:58.351279] [INFO ] [REMOTE ] CATO: Full fetch complete (12086 records). [2025-09-23T17:51:58.351377] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-23T17:51:58.607311] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-23T17:51:58.727361] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-23T17:51:58.727446] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-23T17:51:58.727790] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-23T17:51:58.727854] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-23T17:51:58.728362] [DEBUG] [LOCAL ] CATO: Trimmed 12086 records to 7317 (keeping 200 days of data) [2025-09-23T17:51:58.771514] [DEBUG] [LOCAL ] CATO: Primary data saved (7317 records). [2025-09-23T17:51:58.771639] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-23T17:51:58.771763] [INFO ] [MAIN ] Update Progress: 395/2372 symbols completed. CATO took 22.6s. Estimated remaining: 4h 19m 54s. Rate: 7.6 symbols/min [2025-09-23T17:51:58.957698] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:59.014187] [DEBUG] [LOCAL ] CB: Loaded 50103 existing records from primary storage. [2025-09-23T17:51:59.014368] [INFO ] [MAIN ] CB: Loaded 50103 existing records. [2025-09-23T17:51:59.209569] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:59.210033] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-23T17:51:59.210105] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-23T17:51:59.211422] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-23T17:51:59.211490] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-23T17:51:59.408392] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-23T17:51:59.591130] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:00.202209] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-23T17:52:00.251986] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:52:00.749573] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:52:01.002219] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-23T17:52:01.802197] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-23T17:52:01.860563] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T17:52:02.602232] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-23T17:52:02.780663] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T17:52:02.974532] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:52:02.980918] [INFO ] [REMOTE ] CARS: Full fetch complete (55402 records). [2025-09-23T17:52:02.981021] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-23T17:52:03.397408] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-23T17:52:03.397542] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-23T17:52:03.398399] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-23T17:52:03.398468] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-23T17:52:03.399885] [DEBUG] [LOCAL ] CARS: Trimmed 55402 records to 40251 (keeping 200 days of data) [2025-09-23T17:52:03.402229] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-23T17:52:03.648967] [DEBUG] [LOCAL ] CARS: Primary data saved (40251 records). [2025-09-23T17:52:03.649100] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-23T17:52:03.649184] [INFO ] [MAIN ] Update Progress: 396/2372 symbols completed. CARS took 31.8s. Estimated remaining: 4h 19m 31s. Rate: 7.6 symbols/min [2025-09-23T17:52:03.835549] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:03.848915] [DEBUG] [LOCAL ] CBAN: Loaded 11144 existing records from primary storage. [2025-09-23T17:52:03.849089] [INFO ] [MAIN ] CBAN: Loaded 11144 existing records. [2025-09-23T17:52:04.041188] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:04.041481] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-23T17:52:04.041536] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-23T17:52:04.042116] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-23T17:52:04.042178] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-23T17:52:04.207450] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-23T17:52:04.436505] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:04.521132] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-23T17:52:05.002170] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-23T17:52:05.032629] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T17:52:05.578716] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T17:52:05.802179] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-23T17:52:06.012881] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T17:52:06.602194] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-23T17:52:07.402254] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-23T17:52:08.202222] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-23T17:52:08.652553] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-09-23T17:52:09.002195] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-23T17:52:09.625560] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (3.02 seconds). [2025-09-23T17:52:09.634160] [INFO ] [REMOTE ] CAT: Full fetch complete (76608 records). [2025-09-23T17:52:09.634283] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-23T17:52:10.047504] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-23T17:52:10.048181] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-23T17:52:10.049575] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-23T17:52:10.048546] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-23T17:52:10.049802] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-23T17:52:10.053298] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-23T17:52:10.055542] [DEBUG] [LOCAL ] CAT: Trimmed 76608 records to 52925 (keeping 200 days of data) [2025-09-23T17:52:10.328507] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T17:52:10.454301] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T17:52:10.484779] [DEBUG] [LOCAL ] CAT: Primary data saved (52925 records). [2025-09-23T17:52:10.484924] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-23T17:52:10.485013] [INFO ] [MAIN ] Update Progress: 397/2372 symbols completed. CAT took 38.4s. Estimated remaining: 4h 19m 18s. Rate: 7.6 symbols/min [2025-09-23T17:52:10.603396] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-23T17:52:10.606386] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T17:52:11.402267] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-23T17:52:12.202278] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-23T17:52:12.414934] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T17:52:12.840518] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-23T17:52:12.912274] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:52:13.002218] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-23T17:52:13.802182] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-23T17:52:14.602297] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-23T17:52:14.752799] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T17:52:15.301483] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T17:52:15.402149] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-23T17:52:15.540340] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T17:52:16.202209] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-23T17:52:17.002173] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-23T17:52:17.055566] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T17:52:17.148798] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:52:17.802246] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-23T17:52:18.400057] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T17:52:18.602202] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-23T17:52:18.610516] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T17:52:19.402248] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-23T17:52:19.992310] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:52:20.202202] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-23T17:52:20.436624] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T17:52:20.706549] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:52:21.002204] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-23T17:52:21.802200] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-23T17:52:22.406182] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:52:22.602210] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-23T17:52:23.402255] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-23T17:52:23.838142] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-23T17:52:23.848982] [INFO ] [REMOTE ] CAVA: Full fetch complete (77275 records). [2025-09-23T17:52:23.849185] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-23T17:52:24.158196] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T17:52:24.191037] [INFO ] [REMOTE ] CBAN: Full fetch complete (16060 records). [2025-09-23T17:52:24.207460] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-23T17:52:24.312953] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-23T17:52:24.319041] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-23T17:52:24.345529] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-23T17:52:24.393246] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-23T17:52:24.467414] [DEBUG] [LOCAL ] CAVA: Trimmed 77275 records to 53550 (keeping 200 days of data) [2025-09-23T17:52:24.835775] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-23T17:52:24.836879] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-23T17:52:24.838027] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-23T17:52:24.838989] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-23T17:52:24.841632] [DEBUG] [LOCAL ] CBAN: Trimmed 16060 records to 11122 (keeping 200 days of data) [2025-09-23T17:52:24.932679] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-23T17:52:24.956284] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-23T17:52:24.982074] [DEBUG] [LOCAL ] CBAN: Primary data saved (11122 records). [2025-09-23T17:52:24.984733] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-23T17:52:24.984878] [INFO ] [MAIN ] Update Progress: 398/2372 symbols completed. CBAN took 21.3s. Estimated remaining: 4h 19m 43s. Rate: 7.6 symbols/min [2025-09-23T17:52:25.188063] [DEBUG] [LOCAL ] CAVA: Primary data saved (53550 records). [2025-09-23T17:52:25.188221] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-23T17:52:25.188311] [INFO ] [MAIN ] Update Progress: 399/2372 symbols completed. CAVA took 34.4s. Estimated remaining: 4h 18m 57s. Rate: 7.6 symbols/min [2025-09-23T17:52:26.474379] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T17:52:26.485705] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-23T17:52:27.944212] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T17:52:27.952536] [INFO ] [REMOTE ] CB: Full fetch complete (72693 records). [2025-09-23T17:52:27.952704] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-23T17:52:28.344392] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-23T17:52:28.344491] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-23T17:52:28.345306] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-23T17:52:28.345372] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-23T17:52:28.346885] [DEBUG] [LOCAL ] CB: Trimmed 72693 records to 50089 (keeping 200 days of data) [2025-09-23T17:52:28.663758] [DEBUG] [LOCAL ] CB: Primary data saved (50089 records). [2025-09-23T17:52:28.663897] [INFO ] [MAIN ] CB: Full history saved. [2025-09-23T17:52:28.663979] [INFO ] [MAIN ] Update Progress: 400/2372 symbols completed. CB took 29.9s. Estimated remaining: 4h 18m 27s. Rate: 7.6 symbols/min [2025-09-23T17:52:29.237885] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:29.325203] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:29.369581] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-23T17:52:29.383328] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-23T17:52:29.340575] [DEBUG] [LOCAL ] CBNA: Loaded 2901 existing records from primary storage. [2025-09-23T17:52:29.389734] [INFO ] [MAIN ] CBNA: Loaded 2901 existing records. [2025-09-23T17:52:29.369480] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:29.427834] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:29.459177] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-23T17:52:29.484738] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-23T17:52:29.507535] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-23T17:52:29.529425] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-23T17:52:29.715442] [DEBUG] [LOCAL ] CBL: Loaded 16762 existing records from primary storage. [2025-09-23T17:52:29.736552] [INFO ] [MAIN ] CBL: Loaded 16762 existing records. [2025-09-23T17:52:29.789850] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:29.925554] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-23T17:52:29.933230] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-23T17:52:29.990887] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-23T17:52:30.003111] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-23T17:52:30.030210] [DEBUG] [LOCAL ] CBRE: Loaded 50664 existing records from primary storage. [2025-09-23T17:52:30.065131] [INFO ] [MAIN ] CBRE: Loaded 50664 existing records. [2025-09-23T17:52:30.395395] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:30.448948] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-23T17:52:30.455179] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-23T17:52:30.567692] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-23T17:52:30.579516] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:30.582828] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-23T17:52:30.585095] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-23T17:52:30.694347] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:30.780233] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-23T17:52:30.786138] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-23T17:52:30.913234] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-23T17:52:30.940396] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:30.958570] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-23T17:52:30.994835] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-23T17:52:31.143443] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-23T17:52:31.200515] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:31.220384] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-23T17:52:31.433553] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:31.460484] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-23T17:52:31.511234] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:31.539313] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-23T17:52:31.576369] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:31.576602] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-23T17:52:31.576938] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-23T17:52:31.762755] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T17:52:31.764539] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-23T17:52:31.790268] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:31.790505] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-23T17:52:31.790897] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-23T17:52:32.123347] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T17:52:32.183589] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T17:52:32.202139] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-23T17:52:32.532718] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T17:52:32.612886] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T17:52:33.002162] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-23T17:52:33.104740] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T17:52:33.297788] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-23T17:52:33.802221] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-23T17:52:34.602199] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-23T17:52:35.402198] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-23T17:52:35.989103] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:52:36.154438] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-23T17:52:36.202151] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-23T17:52:36.318994] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T17:52:37.002242] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-23T17:52:37.604297] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:52:37.802234] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-23T17:52:37.988776] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:52:38.101322] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-23T17:52:38.602270] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-23T17:52:39.402238] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-23T17:52:39.726673] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T17:52:40.203914] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-23T17:52:40.207499] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T17:52:41.002215] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-23T17:52:41.347573] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T17:52:41.808587] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-23T17:52:41.828203] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T17:52:42.602256] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-23T17:52:42.675211] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T17:52:43.402217] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-23T17:52:43.867327] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T17:52:44.071872] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:52:44.202221] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-23T17:52:45.002203] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-23T17:52:45.567108] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T17:52:45.569892] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:52:45.802229] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-23T17:52:46.126401] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T17:52:46.602215] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-23T17:52:47.186673] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T17:52:47.402221] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-23T17:52:48.007012] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T17:52:48.202230] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-23T17:52:48.546257] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T17:52:49.002193] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-23T17:52:49.406982] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T17:52:49.802191] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-23T17:52:50.011846] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:50.012167] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-23T17:52:50.602256] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-23T17:52:51.225770] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T17:52:51.402206] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-23T17:52:52.202180] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-23T17:52:52.919160] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T17:52:53.002177] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-23T17:52:53.173419] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T17:52:53.674825] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:53.675198] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-23T17:52:53.675307] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-23T17:52:53.675387] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-23T17:52:53.676098] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:52:53.676182] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:52:53.676276] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:52:53.676389] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-23T17:52:53.676513] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-23T17:52:53.676582] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-23T17:52:53.676665] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-23T17:52:53.676751] [INFO ] [MAIN ] Update Progress: 401/2372 symbols completed. CBO took 25.0s. Estimated remaining: 4h 19m 43s. Rate: 7.6 symbols/min [2025-09-23T17:52:53.807307] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-23T17:52:53.861153] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:53.895446] [DEBUG] [LOCAL ] CBT: Loaded 31131 existing records from primary storage. [2025-09-23T17:52:53.895627] [INFO ] [MAIN ] CBT: Loaded 31131 existing records. [2025-09-23T17:52:54.087383] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:54.087808] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-23T17:52:54.087865] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-23T17:52:54.089552] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-23T17:52:54.089612] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-23T17:52:54.440789] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:54.520826] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T17:52:54.523886] [INFO ] [REMOTE ] CBL: Full fetch complete (25661 records). [2025-09-23T17:52:54.523985] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-23T17:52:54.607359] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-23T17:52:54.919699] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-23T17:52:54.919790] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-23T17:52:54.920189] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-23T17:52:54.920230] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-23T17:52:54.920933] [DEBUG] [LOCAL ] CBL: Trimmed 25661 records to 16744 (keeping 200 days of data) [2025-09-23T17:52:55.023074] [DEBUG] [LOCAL ] CBL: Primary data saved (16744 records). [2025-09-23T17:52:55.023222] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-23T17:52:55.023324] [INFO ] [MAIN ] Update Progress: 402/2372 symbols completed. CBL took 26.4s. Estimated remaining: 4h 19m 3s. Rate: 7.6 symbols/min [2025-09-23T17:52:55.197712] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:55.220370] [DEBUG] [LOCAL ] CBU: Loaded 22859 existing records from primary storage. [2025-09-23T17:52:55.220513] [INFO ] [MAIN ] CBU: Loaded 22859 existing records. [2025-09-23T17:52:55.411262] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-23T17:52:55.418180] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:55.419363] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-23T17:52:55.419417] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-23T17:52:55.420254] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-23T17:52:55.420318] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-23T17:52:55.797403] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:56.194336] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T17:52:56.202133] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-23T17:52:56.866285] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T17:52:57.002244] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-23T17:52:57.133242] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T17:52:57.487249] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T17:52:57.488332] [INFO ] [REMOTE ] CBNA: Full fetch complete (4690 records). [2025-09-23T17:52:57.488401] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-23T17:52:57.811810] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-23T17:52:57.844424] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-23T17:52:57.844481] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-23T17:52:57.844626] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-23T17:52:57.844699] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-23T17:52:57.845143] [DEBUG] [LOCAL ] CBNA: Trimmed 4690 records to 2892 (keeping 200 days of data) [2025-09-23T17:52:57.862279] [DEBUG] [LOCAL ] CBNA: Primary data saved (2892 records). [2025-09-23T17:52:57.862374] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-23T17:52:57.862456] [INFO ] [MAIN ] Update Progress: 403/2372 symbols completed. CBNA took 29.2s. Estimated remaining: 4h 18m 31s. Rate: 7.6 symbols/min [2025-09-23T17:52:58.043268] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:58.043465] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-23T17:52:58.043522] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-23T17:52:58.043711] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-23T17:52:58.043763] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-23T17:52:58.043807] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-23T17:52:58.043840] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-23T17:52:58.412062] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:58.602179] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-23T17:52:59.106751] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:52:59.402211] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-23T17:52:59.972931] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T17:53:00.205679] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-23T17:53:00.213851] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T17:53:01.002216] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-23T17:53:01.244450] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:01.244848] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-23T17:53:01.711088] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:53:01.802407] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-23T17:53:02.602258] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-23T17:53:02.797286] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:02.797631] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-23T17:53:03.151010] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:53:03.159749] [INFO ] [REMOTE ] CBRE: Full fetch complete (73949 records). [2025-09-23T17:53:03.159922] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-23T17:53:03.407339] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-23T17:53:03.583972] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-23T17:53:03.584087] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-23T17:53:03.585072] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-23T17:53:03.585182] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-23T17:53:03.586926] [DEBUG] [LOCAL ] CBRE: Trimmed 73949 records to 50658 (keeping 200 days of data) [2025-09-23T17:53:03.686875] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:03.688417] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-23T17:53:03.908176] [DEBUG] [LOCAL ] CBRE: Primary data saved (50658 records). [2025-09-23T17:53:03.908316] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-23T17:53:03.908401] [INFO ] [MAIN ] Update Progress: 404/2372 symbols completed. CBRE took 35.2s. Estimated remaining: 4h 18m 14s. Rate: 7.6 symbols/min [2025-09-23T17:53:04.075755] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:04.109705] [DEBUG] [LOCAL ] CBZ: Loaded 33453 existing records from primary storage. [2025-09-23T17:53:04.109874] [INFO ] [MAIN ] CBZ: Loaded 33453 existing records. [2025-09-23T17:53:04.207361] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-23T17:53:04.290817] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:04.291082] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-23T17:53:04.291128] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-23T17:53:04.292066] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-23T17:53:04.292127] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-23T17:53:04.643208] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:05.002221] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-23T17:53:05.300903] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:53:05.802233] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-23T17:53:06.033680] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T17:53:06.602237] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-23T17:53:06.808403] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:06.808763] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-23T17:53:06.940581] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T17:53:07.402221] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-23T17:53:08.072469] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T17:53:08.202191] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-23T17:53:09.003795] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-23T17:53:09.007864] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T17:53:09.212952] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:09.213272] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-23T17:53:09.802213] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-23T17:53:10.602200] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-23T17:53:10.774244] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:53:11.392532] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:53:11.402156] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-23T17:53:12.160723] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T17:53:12.202142] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-23T17:53:13.002201] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-23T17:53:13.141533] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T17:53:13.671257] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:53:13.802164] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-23T17:53:14.057189] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T17:53:14.602269] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-23T17:53:15.402212] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-23T17:53:16.160781] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:53:16.202202] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-23T17:53:16.455783] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T17:53:17.002227] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-23T17:53:17.320866] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T17:53:17.756851] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T17:53:17.802154] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-23T17:53:18.602244] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-23T17:53:18.887388] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:53:19.402251] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-23T17:53:19.601036] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T17:53:20.202206] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-23T17:53:20.373945] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T17:53:21.002420] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-23T17:53:21.124605] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T17:53:21.802257] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-23T17:53:21.865515] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T17:53:22.602219] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-23T17:53:22.728268] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T17:53:23.402219] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-23T17:53:23.939737] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:53:24.202210] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-23T17:53:24.365484] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T17:53:25.002212] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-23T17:53:25.046511] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T17:53:25.050968] [INFO ] [REMOTE ] CBU: Full fetch complete (32183 records). [2025-09-23T17:53:25.051100] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-23T17:53:25.442415] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-23T17:53:25.442548] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-23T17:53:25.443048] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-23T17:53:25.443122] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-23T17:53:25.444067] [DEBUG] [LOCAL ] CBU: Trimmed 32183 records to 22875 (keeping 200 days of data) [2025-09-23T17:53:25.590226] [DEBUG] [LOCAL ] CBU: Primary data saved (22875 records). [2025-09-23T17:53:25.590358] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-23T17:53:25.590531] [INFO ] [MAIN ] Update Progress: 405/2372 symbols completed. CBU took 30.6s. Estimated remaining: 4h 19m 13s. Rate: 7.6 symbols/min [2025-09-23T17:53:25.757732] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:25.811568] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-23T17:53:25.815164] [DEBUG] [LOCAL ] CC: Loaded 53028 existing records from primary storage. [2025-09-23T17:53:25.815357] [INFO ] [MAIN ] CC: Loaded 53028 existing records. [2025-09-23T17:53:26.005930] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:26.006450] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-23T17:53:26.006530] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-23T17:53:26.007968] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-23T17:53:26.008029] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-23T17:53:26.259503] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T17:53:26.371938] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:26.538328] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T17:53:26.547361] [INFO ] [REMOTE ] CBT: Full fetch complete (45924 records). [2025-09-23T17:53:26.547542] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-23T17:53:26.611703] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-23T17:53:26.937127] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-23T17:53:26.937205] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-23T17:53:26.937792] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-23T17:53:26.937872] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-23T17:53:26.940994] [DEBUG] [LOCAL ] CBT: Trimmed 45924 records to 31140 (keeping 200 days of data) [2025-09-23T17:53:27.149950] [DEBUG] [LOCAL ] CBT: Primary data saved (31140 records). [2025-09-23T17:53:27.150167] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-23T17:53:27.150385] [INFO ] [MAIN ] Update Progress: 406/2372 symbols completed. CBT took 33.5s. Estimated remaining: 4h 18m 35s. Rate: 7.6 symbols/min [2025-09-23T17:53:27.324377] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:27.384026] [DEBUG] [LOCAL ] CCI: Loaded 53161 existing records from primary storage. [2025-09-23T17:53:27.384200] [INFO ] [MAIN ] CCI: Loaded 53161 existing records. [2025-09-23T17:53:27.407374] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-23T17:53:27.571239] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:27.571495] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-23T17:53:27.571558] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-23T17:53:27.573258] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-23T17:53:27.573346] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-23T17:53:27.688819] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:27.693455] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-23T17:53:27.975393] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:27.999179] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T17:53:28.202248] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-23T17:53:29.002223] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-23T17:53:29.360804] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:29.361117] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-23T17:53:29.361233] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-23T17:53:29.361387] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-23T17:53:29.362316] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:53:29.362401] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:53:29.362500] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:53:29.362597] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-23T17:53:29.362760] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-23T17:53:29.362859] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-23T17:53:29.362953] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-23T17:53:29.363045] [INFO ] [MAIN ] Update Progress: 407/2372 symbols completed. CBX took 31.5s. Estimated remaining: 4h 17m 59s. Rate: 7.6 symbols/min [2025-09-23T17:53:29.546210] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:29.546471] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-23T17:53:29.546532] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-23T17:53:29.546787] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-23T17:53:29.546880] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-23T17:53:29.546970] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-23T17:53:29.547038] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-23T17:53:29.806570] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-23T17:53:29.920491] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:30.016205] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:53:30.602226] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-23T17:53:31.118334] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T17:53:31.130534] [INFO ] [REMOTE ] CBZ: Full fetch complete (44731 records). [2025-09-23T17:53:31.130824] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-23T17:53:31.409928] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-23T17:53:31.760968] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-23T17:53:31.761177] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-23T17:53:31.762476] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-23T17:53:31.762568] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-23T17:53:31.766538] [DEBUG] [LOCAL ] CBZ: Trimmed 44731 records to 33481 (keeping 200 days of data) [2025-09-23T17:53:32.009825] [DEBUG] [LOCAL ] CBZ: Primary data saved (33481 records). [2025-09-23T17:53:32.009983] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-23T17:53:32.010122] [INFO ] [MAIN ] Update Progress: 408/2372 symbols completed. CBZ took 28.1s. Estimated remaining: 4h 17m 26s. Rate: 7.6 symbols/min [2025-09-23T17:53:32.182090] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:32.201187] [DEBUG] [LOCAL ] CCIF: Loaded 15367 existing records from primary storage. [2025-09-23T17:53:32.201318] [INFO ] [MAIN ] CCIF: Loaded 15367 existing records. [2025-09-23T17:53:32.231971] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-23T17:53:32.386897] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:32.387211] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-23T17:53:32.387266] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-23T17:53:32.387930] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-23T17:53:32.387990] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-23T17:53:32.729279] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-23T17:53:32.797496] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:32.801379] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T17:53:32.870808] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T17:53:33.002217] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-23T17:53:33.802191] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-23T17:53:34.281771] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:53:34.602247] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-23T17:53:34.989546] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T17:53:35.006874] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:53:35.402248] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-23T17:53:36.202227] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-23T17:53:36.297884] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T17:53:37.002254] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-23T17:53:37.547102] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T17:53:37.802202] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-23T17:53:37.976136] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T17:53:38.057943] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-23T17:53:38.602272] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-23T17:53:39.402267] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-23T17:53:39.935320] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T17:53:40.202259] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-23T17:53:40.711628] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-23T17:53:41.002170] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-23T17:53:41.268924] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T17:53:41.802259] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-23T17:53:42.130579] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T17:53:42.487552] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T17:53:42.602251] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-23T17:53:43.297384] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T17:53:43.402232] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-23T17:53:44.202207] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-23T17:53:44.828138] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T17:53:45.002172] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-23T17:53:45.029563] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T17:53:45.645690] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T17:53:45.802255] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-23T17:53:46.167606] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T17:53:46.602262] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-23T17:53:47.402246] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-23T17:53:47.585418] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T17:53:48.202238] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-23T17:53:48.795861] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T17:53:49.002287] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-23T17:53:49.256324] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-23T17:53:49.569576] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:53:49.802220] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-23T17:53:50.231227] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:53:50.602233] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-23T17:53:50.982909] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T17:53:51.402211] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-23T17:53:52.202198] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-23T17:53:53.002189] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-23T17:53:53.461863] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T17:53:53.511523] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:53:53.513102] [INFO ] [REMOTE ] CCIA: Full fetch complete (2018 records). [2025-09-23T17:53:53.513345] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-23T17:53:53.768127] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T17:53:53.768558] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:53:53.768731] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:53:53.768890] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-23T17:53:53.769089] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-23T17:53:53.769148] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-23T17:53:53.773009] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T17:53:53.769517] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-23T17:53:53.783682] [INFO ] [MAIN ] Update Progress: 409/2372 symbols completed. CCIA took 24.4s. Estimated remaining: 4h 18m 25s. Rate: 7.6 symbols/min [2025-09-23T17:53:53.805630] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-23T17:53:53.963181] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:54.046065] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-23T17:53:54.046254] [INFO ] [MAIN ] CCJ: Loaded 53675 existing records. [2025-09-23T17:53:54.243840] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:54.244213] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-23T17:53:54.244300] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-23T17:53:54.245947] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-23T17:53:54.246022] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-23T17:53:54.609397] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-23T17:53:54.615181] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:55.346604] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T17:53:55.402171] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-23T17:53:56.202214] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-23T17:53:56.615265] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T17:53:56.830626] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T17:53:56.840314] [INFO ] [REMOTE ] CCI: Full fetch complete (77000 records). [2025-09-23T17:53:56.840487] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-23T17:53:57.007296] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-23T17:53:57.150131] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T17:53:57.351877] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-23T17:53:57.351973] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-23T17:53:57.352910] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-23T17:53:57.352979] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-23T17:53:57.354660] [DEBUG] [LOCAL ] CCI: Trimmed 77000 records to 53153 (keeping 200 days of data) [2025-09-23T17:53:57.692748] [DEBUG] [LOCAL ] CCI: Primary data saved (53153 records). [2025-09-23T17:53:57.692892] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-23T17:53:57.694094] [INFO ] [MAIN ] Update Progress: 410/2372 symbols completed. CCI took 30.5s. Estimated remaining: 4h 17m 58s. Rate: 7.6 symbols/min [2025-09-23T17:53:57.807326] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-23T17:53:57.865736] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:57.917359] [DEBUG] [LOCAL ] CCK: Loaded 46503 existing records from primary storage. [2025-09-23T17:53:57.917497] [INFO ] [MAIN ] CCK: Loaded 46503 existing records. [2025-09-23T17:53:58.098624] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:58.098948] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-23T17:53:58.099000] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-23T17:53:58.100274] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-23T17:53:58.100339] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-23T17:53:58.453548] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:58.602168] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-23T17:53:58.854428] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T17:53:59.191070] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:53:59.402220] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-23T17:53:59.836079] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:54:00.202198] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-23T17:54:01.002273] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-23T17:54:01.313370] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T17:54:01.802226] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-23T17:54:02.109687] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T17:54:02.366638] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-23T17:54:02.602210] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-23T17:54:03.402214] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-23T17:54:04.202263] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-23T17:54:04.853719] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:54:04.856797] [INFO ] [REMOTE ] CCIF: Full fetch complete (21492 records). [2025-09-23T17:54:04.856889] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-23T17:54:05.264971] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-23T17:54:05.265088] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-23T17:54:05.265537] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-23T17:54:05.265601] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-23T17:54:05.266300] [DEBUG] [LOCAL ] CCIF: Trimmed 21492 records to 15346 (keeping 200 days of data) [2025-09-23T17:54:05.367082] [DEBUG] [LOCAL ] CCIF: Primary data saved (15346 records). [2025-09-23T17:54:05.367227] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-23T17:54:05.367311] [INFO ] [MAIN ] Update Progress: 411/2372 symbols completed. CCIF took 33.4s. Estimated remaining: 4h 17m 49s. Rate: 7.6 symbols/min [2025-09-23T17:54:05.534701] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:05.591886] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-23T17:54:05.592045] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-09-23T17:54:05.766943] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:05.767205] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-23T17:54:05.767253] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-23T17:54:05.768532] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-23T17:54:05.768595] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-23T17:54:06.138559] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:06.139182] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-23T17:54:06.190823] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (4.39 seconds). [2025-09-23T17:54:06.201161] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-23T17:54:06.302681] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (3.70 seconds). [2025-09-23T17:54:06.409208] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-23T17:54:06.602195] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-23T17:54:07.397813] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T17:54:07.406736] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-23T17:54:08.202214] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-23T17:54:08.605595] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-23T17:54:08.631902] [INFO ] [REMOTE ] CC: Full fetch complete (75480 records). [2025-09-23T17:54:08.653274] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-23T17:54:08.687511] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-23T17:54:09.007996] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-23T17:54:09.092870] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-23T17:54:09.093157] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-23T17:54:09.094131] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-23T17:54:09.094219] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-23T17:54:09.096257] [DEBUG] [LOCAL ] CC: Trimmed 75480 records to 53032 (keeping 200 days of data) [2025-09-23T17:54:09.238847] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T17:54:09.511317] [DEBUG] [LOCAL ] CC: Primary data saved (53032 records). [2025-09-23T17:54:09.511532] [INFO ] [MAIN ] CC: Full history saved. [2025-09-23T17:54:09.511785] [INFO ] [MAIN ] Update Progress: 412/2372 symbols completed. CC took 43.9s. Estimated remaining: 4h 17m 24s. Rate: 7.6 symbols/min [2025-09-23T17:54:09.545966] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:54:09.701416] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:09.751814] [DEBUG] [LOCAL ] CCO: Loaded 47602 existing records from primary storage. [2025-09-23T17:54:09.751994] [INFO ] [MAIN ] CCO: Loaded 47602 existing records. [2025-09-23T17:54:09.807800] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-23T17:54:09.938210] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:09.938474] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-23T17:54:09.938523] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-23T17:54:09.939828] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-23T17:54:09.939889] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-23T17:54:10.308027] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:10.602195] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-23T17:54:11.371292] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-23T17:54:11.402166] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-23T17:54:11.562876] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T17:54:11.859792] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T17:54:12.202193] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-23T17:54:13.002289] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-23T17:54:13.264530] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T17:54:13.802258] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-23T17:54:13.983435] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T17:54:14.421681] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T17:54:14.602205] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-23T17:54:15.402226] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-23T17:54:15.912344] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T17:54:16.202253] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-23T17:54:16.530738] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T17:54:16.959415] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:54:17.002189] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-23T17:54:17.338338] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:54:17.802239] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-23T17:54:18.417000] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:54:18.602285] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-23T17:54:19.402208] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-23T17:54:19.795436] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T17:54:19.887138] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T17:54:20.202220] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-23T17:54:21.002201] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-23T17:54:21.402106] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T17:54:21.657261] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-23T17:54:21.802199] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-23T17:54:22.602233] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-23T17:54:22.845393] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T17:54:23.081443] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:54:23.402198] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-23T17:54:23.927779] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T17:54:24.202245] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-23T17:54:24.994190] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T17:54:25.003714] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-23T17:54:25.802266] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-23T17:54:26.278637] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-23T17:54:26.602216] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-23T17:54:26.973280] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T17:54:26.982430] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-09-23T17:54:26.982623] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-23T17:54:27.404722] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-23T17:54:27.425369] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-23T17:54:27.425678] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-23T17:54:27.426783] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-23T17:54:27.427857] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-23T17:54:27.430065] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 53675 (keeping 200 days of data) [2025-09-23T17:54:27.559602] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T17:54:27.589753] [INFO ] [REMOTE ] CCK: Full fetch complete (67765 records). [2025-09-23T17:54:27.592956] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-23T17:54:28.136485] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-23T17:54:28.136967] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-23T17:54:28.138749] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-23T17:54:28.139683] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-23T17:54:28.150940] [DEBUG] [LOCAL ] CCK: Trimmed 67765 records to 46406 (keeping 200 days of data) [2025-09-23T17:54:28.368251] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-09-23T17:54:28.368415] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-23T17:54:28.368526] [INFO ] [MAIN ] Update Progress: 413/2372 symbols completed. CCJ took 34.6s. Estimated remaining: 4h 18m 8s. Rate: 7.6 symbols/min [2025-09-23T17:54:28.650116] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:28.717693] [DEBUG] [LOCAL ] CCRD: Loaded 8988 existing records from primary storage. [2025-09-23T17:54:28.718739] [INFO ] [MAIN ] CCRD: Loaded 8988 existing records. [2025-09-23T17:54:28.816547] [DEBUG] [LOCAL ] CCK: Primary data saved (46406 records). [2025-09-23T17:54:28.824342] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:54:28.839094] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-23T17:54:28.877034] [INFO ] [MAIN ] Update Progress: 414/2372 symbols completed. CCK took 31.2s. Estimated remaining: 4h 17m 25s. Rate: 7.6 symbols/min [2025-09-23T17:54:28.888279] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-23T17:54:29.034901] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:29.060965] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-23T17:54:29.072329] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-23T17:54:29.073056] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-23T17:54:29.118558] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-23T17:54:29.171804] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:29.492949] [DEBUG] [LOCAL ] CCS: Loaded 30741 existing records from primary storage. [2025-09-23T17:54:29.497333] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-09-23T17:54:29.516132] [INFO ] [MAIN ] CCS: Loaded 30741 existing records. [2025-09-23T17:54:29.695338] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-23T17:54:29.757484] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:29.804915] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-23T17:54:29.833763] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:29.834102] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-23T17:54:29.834150] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-23T17:54:29.835136] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-23T17:54:29.835198] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-23T17:54:30.216081] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:30.602254] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-23T17:54:30.604133] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T17:54:30.711685] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T17:54:31.402284] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-23T17:54:31.915255] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T17:54:31.941583] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:54:32.202194] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-23T17:54:32.574745] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T17:54:33.002200] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-23T17:54:33.222444] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T17:54:33.802248] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-23T17:54:34.602253] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-23T17:54:35.317069] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-23T17:54:35.382833] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T17:54:35.387375] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:54:35.402143] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-23T17:54:36.202197] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-23T17:54:36.700414] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T17:54:36.708730] [INFO ] [REMOTE ] CCO: Full fetch complete (66067 records). [2025-09-23T17:54:36.708884] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-23T17:54:37.007306] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-23T17:54:37.108392] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-23T17:54:37.108469] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-23T17:54:37.109191] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-23T17:54:37.109255] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-23T17:54:37.110501] [DEBUG] [LOCAL ] CCO: Trimmed 66067 records to 47684 (keeping 200 days of data) [2025-09-23T17:54:37.371335] [DEBUG] [LOCAL ] CCO: Primary data saved (47684 records). [2025-09-23T17:54:37.371468] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-23T17:54:37.371550] [INFO ] [MAIN ] Update Progress: 415/2372 symbols completed. CCO took 27.9s. Estimated remaining: 4h 17m 20s. Rate: 7.6 symbols/min [2025-09-23T17:54:37.526491] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:54:37.514608] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T17:54:37.580818] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:37.604889] [DEBUG] [LOCAL ] CCU: Loaded 23817 existing records from primary storage. [2025-09-23T17:54:37.605010] [INFO ] [MAIN ] CCU: Loaded 23817 existing records. [2025-09-23T17:54:37.782611] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:37.782875] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-23T17:54:37.782928] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-23T17:54:37.783586] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-23T17:54:37.783698] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-23T17:54:37.811948] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-23T17:54:38.134144] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:38.602222] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-23T17:54:38.926933] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:54:39.402225] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-23T17:54:39.730370] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:54:40.202194] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-23T17:54:40.815695] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T17:54:41.002267] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-23T17:54:41.432618] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T17:54:41.442176] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-23T17:54:41.442350] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-23T17:54:41.581922] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T17:54:41.808707] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-23T17:54:41.873052] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-23T17:54:41.873178] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-23T17:54:41.874079] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-23T17:54:41.874145] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-23T17:54:41.876010] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-09-23T17:54:42.203327] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-09-23T17:54:42.203466] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-23T17:54:42.203551] [INFO ] [MAIN ] Update Progress: 416/2372 symbols completed. CCL took 36.8s. Estimated remaining: 4h 16m 58s. Rate: 7.6 symbols/min [2025-09-23T17:54:42.389776] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:42.390002] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-23T17:54:42.390059] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-23T17:54:42.390256] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-23T17:54:42.390322] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-23T17:54:42.390380] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-23T17:54:42.390421] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-23T17:54:42.609791] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-23T17:54:42.775591] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:43.013795] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T17:54:43.402168] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-23T17:54:43.615850] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:54:44.202193] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-23T17:54:44.323874] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T17:54:45.002196] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-23T17:54:45.095426] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T17:54:45.400338] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T17:54:45.802220] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-23T17:54:46.164354] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-23T17:54:46.602210] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-23T17:54:46.838243] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-23T17:54:47.402197] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-23T17:54:47.630231] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-23T17:54:48.202210] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-23T17:54:49.002218] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-23T17:54:49.459358] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:54:49.470884] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:54:49.802236] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-23T17:54:50.043396] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-23T17:54:50.602198] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-23T17:54:51.402247] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-23T17:54:51.537961] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T17:54:51.652359] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-23T17:54:52.202238] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-23T17:54:53.002225] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-23T17:54:53.199567] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T17:54:53.250478] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-23T17:54:53.802197] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-23T17:54:54.602201] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-23T17:54:54.652931] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T17:54:55.402274] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-23T17:54:55.605623] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T17:54:56.202205] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-23T17:54:56.711236] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T17:54:57.002258] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-23T17:54:57.172746] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:54:57.180396] [INFO ] [REMOTE ] CCS: Full fetch complete (44844 records). [2025-09-23T17:54:57.180585] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-23T17:54:57.309869] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:54:57.338234] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-23T17:54:57.578964] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-23T17:54:57.579049] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-23T17:54:57.579601] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-23T17:54:57.579716] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-23T17:54:57.580977] [DEBUG] [LOCAL ] CCS: Trimmed 44844 records to 30701 (keeping 200 days of data) [2025-09-23T17:54:57.771226] [DEBUG] [LOCAL ] CCS: Primary data saved (30701 records). [2025-09-23T17:54:57.771373] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-23T17:54:57.771467] [INFO ] [MAIN ] Update Progress: 417/2372 symbols completed. CCS took 28.9s. Estimated remaining: 4h 17m 26s. Rate: 7.6 symbols/min [2025-09-23T17:54:57.804239] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-23T17:54:57.950426] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:58.007477] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-23T17:54:58.007714] [INFO ] [MAIN ] CDE: Loaded 53641 existing records. [2025-09-23T17:54:58.191995] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:58.192298] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-23T17:54:58.192349] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-23T17:54:58.193764] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-23T17:54:58.193830] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-23T17:54:58.554757] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:58.564884] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T17:54:58.602149] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-23T17:54:59.402204] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-23T17:54:59.994676] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:54:59.996786] [INFO ] [REMOTE ] CCRD: Full fetch complete (12021 records). [2025-09-23T17:54:59.996857] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-23T17:55:00.219192] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-23T17:55:00.445112] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-23T17:55:00.445269] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-23T17:55:00.445602] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-23T17:55:00.445672] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-23T17:55:00.446167] [DEBUG] [LOCAL ] CCRD: Trimmed 12021 records to 9000 (keeping 200 days of data) [2025-09-23T17:55:00.523117] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T17:55:00.544550] [DEBUG] [LOCAL ] CCRD: Primary data saved (9000 records). [2025-09-23T17:55:00.544738] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-23T17:55:00.544833] [INFO ] [MAIN ] Update Progress: 418/2372 symbols completed. CCRD took 32.2s. Estimated remaining: 4h 16m 54s. Rate: 7.6 symbols/min [2025-09-23T17:55:00.712468] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:00.724790] [DEBUG] [LOCAL ] CDLR: Loaded 9845 existing records from primary storage. [2025-09-23T17:55:00.724919] [INFO ] [MAIN ] CDLR: Loaded 9845 existing records. [2025-09-23T17:55:00.918801] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:00.919092] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-23T17:55:00.919142] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-23T17:55:00.919561] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-23T17:55:00.919621] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-23T17:55:01.010662] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-23T17:55:01.280697] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:01.295218] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T17:55:01.305462] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-23T17:55:01.802257] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-23T17:55:02.391721] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T17:55:02.602216] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-23T17:55:03.402286] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-23T17:55:03.801311] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:55:04.202167] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-23T17:55:04.458399] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T17:55:04.946828] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T17:55:05.002206] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-23T17:55:05.802204] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-23T17:55:06.007120] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T17:55:06.602235] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-23T17:55:07.402455] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-23T17:55:08.202264] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-23T17:55:08.684357] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-09-23T17:55:08.760032] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T17:55:08.875246] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T17:55:09.002167] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-23T17:55:09.136713] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T17:55:09.802178] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-23T17:55:09.813453] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T17:55:10.602187] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-23T17:55:11.342885] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T17:55:11.402169] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-23T17:55:11.516260] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T17:55:12.196564] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T17:55:12.202144] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-23T17:55:13.002172] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-23T17:55:13.235331] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T17:55:13.435033] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T17:55:13.435895] [INFO ] [REMOTE ] CCZ: Full fetch complete (132 records). [2025-09-23T17:55:13.435968] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-23T17:55:13.436342] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:55:13.436440] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:55:13.436485] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:55:13.436550] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-23T17:55:13.436679] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-23T17:55:13.436783] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-23T17:55:13.436858] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-23T17:55:13.436937] [INFO ] [MAIN ] Update Progress: 419/2372 symbols completed. CCZ took 31.2s. Estimated remaining: 4h 17m 9s. Rate: 7.6 symbols/min [2025-09-23T17:55:13.614312] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:13.659251] [DEBUG] [LOCAL ] CDP: Loaded 42674 existing records from primary storage. [2025-09-23T17:55:13.659393] [INFO ] [MAIN ] CDP: Loaded 42674 existing records. [2025-09-23T17:55:13.808028] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-23T17:55:13.855710] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:13.855977] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-23T17:55:13.856033] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-23T17:55:13.857293] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-23T17:55:13.857357] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-23T17:55:14.272015] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:14.602207] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-23T17:55:15.402249] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-23T17:55:15.432204] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T17:55:15.690342] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T17:55:16.202209] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-23T17:55:16.968136] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:55:17.007451] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-23T17:55:17.020588] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T17:55:17.026299] [INFO ] [REMOTE ] CCU: Full fetch complete (33137 records). [2025-09-23T17:55:17.026474] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-23T17:55:17.619165] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-23T17:55:17.620267] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T17:55:17.620427] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-23T17:55:17.621949] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-23T17:55:17.625830] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-23T17:55:17.627965] [DEBUG] [LOCAL ] CCU: Trimmed 33137 records to 23677 (keeping 200 days of data) [2025-09-23T17:55:17.774479] [DEBUG] [LOCAL ] CCU: Primary data saved (23677 records). [2025-09-23T17:55:17.774635] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-23T17:55:17.774796] [INFO ] [MAIN ] Update Progress: 420/2372 symbols completed. CCU took 40.4s. Estimated remaining: 4h 16m 45s. Rate: 7.6 symbols/min [2025-09-23T17:55:17.807300] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-23T17:55:17.946947] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:17.947150] [DEBUG] [LOCAL ] CDRE: No existing data file found in primary storage. [2025-09-23T17:55:17.947205] [WARN ] [MAIN ] CDRE: No existing data found, performing full refresh instead. [2025-09-23T17:55:17.947348] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-23T17:55:17.947390] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-23T17:55:17.947431] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-09-23T17:55:17.947463] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-23T17:55:18.303416] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:18.578433] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T17:55:18.580376] [INFO ] [REMOTE ] CDLR: Full fetch complete (13014 records). [2025-09-23T17:55:18.580451] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-23T17:55:18.580908] [FATAL] [VALIDATOR ] CDLR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:55:18.580994] [FATAL] [MAIN ] CDLR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:55:18.581037] [WARN ] [MAIN ] CDLR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:55:18.581075] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-23T17:55:18.581129] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-09-23T17:55:18.581164] [INFO ] [LOCAL ] CDLR: Starting deletion of derivative data. [2025-09-23T17:55:18.581742] [DEBUG] [LOCAL ] CDLR: Deleted derivative data file. [2025-09-23T17:55:18.581881] [INFO ] [MAIN ] Update Progress: 421/2372 symbols completed. CDLR took 18.0s. Estimated remaining: 4h 16m 4s. Rate: 7.6 symbols/min [2025-09-23T17:55:18.607382] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-23T17:55:18.765956] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:18.827819] [DEBUG] [LOCAL ] CE: Loaded 51561 existing records from primary storage. [2025-09-23T17:55:18.827972] [INFO ] [MAIN ] CE: Loaded 51561 existing records. [2025-09-23T17:55:19.022419] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:19.022729] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-23T17:55:19.022786] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-23T17:55:19.024118] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-23T17:55:19.024179] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-23T17:55:19.379550] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:19.402148] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-23T17:55:19.690031] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T17:55:20.202187] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-23T17:55:20.972995] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:55:21.002151] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-23T17:55:21.079181] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T17:55:21.802160] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-23T17:55:22.425857] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T17:55:22.602201] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-23T17:55:23.402260] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-23T17:55:24.011943] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:55:24.100632] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-23T17:55:24.202184] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-23T17:55:24.519549] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T17:55:25.002193] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-23T17:55:25.802167] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-23T17:55:25.919609] [DEBUG] [REMOTE ] CDRE: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-23T17:55:25.919987] [WARN ] [REMOTE ] CDRE: No data returned for month 2025-02 [2025-09-23T17:55:25.987863] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T17:55:26.064003] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:55:26.602241] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-23T17:55:27.402166] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-23T17:55:27.577980] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T17:55:28.202206] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-23T17:55:28.949832] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T17:55:29.002224] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-23T17:55:29.029338] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:55:29.802199] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-23T17:55:30.602170] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-23T17:55:30.777491] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T17:55:31.123374] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:55:31.402207] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-23T17:55:32.202260] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-23T17:55:32.742598] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-23T17:55:32.940797] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T17:55:33.002162] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-23T17:55:33.433293] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:55:33.802211] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-23T17:55:34.428691] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:55:34.602211] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-23T17:55:35.049758] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T17:55:35.402197] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-23T17:55:35.884443] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T17:55:36.202158] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-23T17:55:36.246806] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T17:55:37.002258] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-23T17:55:37.531838] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:55:37.802195] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-23T17:55:38.506452] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T17:55:38.602246] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-23T17:55:38.829526] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T17:55:38.843638] [INFO ] [REMOTE ] CDE: Full fetch complete (77574 records). [2025-09-23T17:55:38.843865] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-23T17:55:39.300394] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-23T17:55:39.300479] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-23T17:55:39.301299] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-23T17:55:39.301394] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-23T17:55:39.302992] [DEBUG] [LOCAL ] CDE: Trimmed 77574 records to 53641 (keeping 200 days of data) [2025-09-23T17:55:39.402412] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-23T17:55:39.647501] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-23T17:55:39.647774] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-23T17:55:39.648006] [INFO ] [MAIN ] Update Progress: 422/2372 symbols completed. CDE took 41.9s. Estimated remaining: 4h 16m 57s. Rate: 7.6 symbols/min [2025-09-23T17:55:39.845498] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:39.855302] [DEBUG] [LOCAL ] CEE: Loaded 6839 existing records from primary storage. [2025-09-23T17:55:39.855406] [INFO ] [MAIN ] CEE: Loaded 6839 existing records. [2025-09-23T17:55:40.041054] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:40.041786] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-23T17:55:40.041856] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-23T17:55:40.042578] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-23T17:55:40.042755] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-23T17:55:40.207229] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-23T17:55:40.332557] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T17:55:40.471122] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:40.647915] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T17:55:41.002204] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-23T17:55:41.205982] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T17:55:41.694905] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T17:55:41.802217] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-23T17:55:42.393165] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:55:42.602235] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-23T17:55:43.402214] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-23T17:55:43.550264] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:55:43.555075] [INFO ] [REMOTE ] CDRE: Full fetch complete (33210 records). [2025-09-23T17:55:43.555217] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-23T17:55:43.740774] [WARN ] [VALIDATOR ] CDRE: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T17:55:43.741200] [FATAL] [MAIN ] CDRE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:55:43.741280] [WARN ] [MAIN ] CDRE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:55:43.741366] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-23T17:55:43.741447] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-09-23T17:55:43.741496] [INFO ] [LOCAL ] CDRE: Starting deletion of derivative data. [2025-09-23T17:55:43.741564] [DEBUG] [LOCAL ] CDRE: No derivative data file found to delete. [2025-09-23T17:55:43.741708] [INFO ] [MAIN ] Update Progress: 423/2372 symbols completed. CDRE took 26.0s. Estimated remaining: 4h 16m 32s. Rate: 7.6 symbols/min [2025-09-23T17:55:43.910612] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:43.942259] [DEBUG] [LOCAL ] CEPU: Loaded 25921 existing records from primary storage. [2025-09-23T17:55:43.942415] [INFO ] [MAIN ] CEPU: Loaded 25921 existing records. [2025-09-23T17:55:44.139922] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T17:55:44.139424] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:44.143482] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-23T17:55:44.143580] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-23T17:55:44.144460] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-23T17:55:44.144520] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-23T17:55:44.207296] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-23T17:55:44.500568] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:45.002241] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-23T17:55:45.802222] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-23T17:55:46.083893] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T17:55:46.092698] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:55:46.097885] [INFO ] [REMOTE ] CE: Full fetch complete (74896 records). [2025-09-23T17:55:46.098005] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-23T17:55:46.491216] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-23T17:55:46.491308] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-23T17:55:46.492160] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-23T17:55:46.492225] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-23T17:55:46.494788] [DEBUG] [LOCAL ] CE: Trimmed 74896 records to 51554 (keeping 200 days of data) [2025-09-23T17:55:46.602607] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-23T17:55:46.824889] [DEBUG] [LOCAL ] CE: Primary data saved (51554 records). [2025-09-23T17:55:46.825528] [INFO ] [MAIN ] CE: Full history saved. [2025-09-23T17:55:46.825883] [INFO ] [MAIN ] Update Progress: 424/2372 symbols completed. CE took 28.2s. Estimated remaining: 4h 16m 2s. Rate: 7.6 symbols/min [2025-09-23T17:55:47.034182] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:47.047961] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T17:55:47.093963] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T17:55:47.116459] [DEBUG] [LOCAL ] CF: Loaded 52233 existing records from primary storage. [2025-09-23T17:55:47.116616] [INFO ] [MAIN ] CF: Loaded 52233 existing records. [2025-09-23T17:55:47.310259] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:47.310590] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-23T17:55:47.310637] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-23T17:55:47.311958] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-23T17:55:47.312019] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-23T17:55:47.407364] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-23T17:55:47.671940] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:48.202199] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-23T17:55:48.366424] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T17:55:48.715517] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T17:55:49.002247] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-23T17:55:49.802214] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-23T17:55:50.441594] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T17:55:50.602208] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-23T17:55:50.996451] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T17:55:51.072534] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T17:55:51.402191] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-23T17:55:51.875314] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T17:55:52.202200] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-23T17:55:52.687662] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T17:55:53.002238] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-23T17:55:53.809004] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-23T17:55:53.812966] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T17:55:54.534957] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T17:55:54.536378] [INFO ] [REMOTE ] CEE: Full fetch complete (10235 records). [2025-09-23T17:55:54.536449] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-23T17:55:54.611948] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-23T17:55:54.913721] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-23T17:55:54.913863] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-23T17:55:54.914145] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-23T17:55:54.914186] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-23T17:55:54.914678] [DEBUG] [LOCAL ] CEE: Trimmed 10235 records to 6777 (keeping 200 days of data) [2025-09-23T17:55:54.954995] [DEBUG] [LOCAL ] CEE: Primary data saved (6777 records). [2025-09-23T17:55:54.955143] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-23T17:55:54.955251] [INFO ] [MAIN ] Update Progress: 425/2372 symbols completed. CEE took 15.3s. Estimated remaining: 4h 15m 55s. Rate: 7.6 symbols/min [2025-09-23T17:55:55.128938] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:55.129752] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-09-23T17:55:55.129808] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-09-23T17:55:55.130057] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-23T17:55:55.130111] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-23T17:55:55.130157] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-09-23T17:55:55.130189] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-23T17:55:55.404417] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-23T17:55:55.482693] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:56.202168] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-23T17:55:56.337625] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T17:55:56.605498] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T17:55:57.002207] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-23T17:55:57.654157] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T17:55:57.802242] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-23T17:55:58.048732] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T17:55:58.582140] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T17:55:58.602174] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-23T17:55:59.402175] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-23T17:55:59.427620] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T17:56:00.202204] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-23T17:56:00.721676] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T17:56:00.732547] [INFO ] [REMOTE ] CDP: Full fetch complete (61809 records). [2025-09-23T17:56:00.732738] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-23T17:56:01.007326] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-23T17:56:01.132808] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-23T17:56:01.132918] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-23T17:56:01.133697] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-23T17:56:01.133764] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-23T17:56:01.135695] [DEBUG] [LOCAL ] CDP: Trimmed 61809 records to 42704 (keeping 200 days of data) [2025-09-23T17:56:01.413699] [DEBUG] [LOCAL ] CDP: Primary data saved (42704 records). [2025-09-23T17:56:01.413833] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-23T17:56:01.413929] [INFO ] [MAIN ] Update Progress: 426/2372 symbols completed. CDP took 48.0s. Estimated remaining: 4h 15m 40s. Rate: 7.6 symbols/min [2025-09-23T17:56:01.582943] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:01.583138] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-23T17:56:01.583188] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-23T17:56:01.583327] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-23T17:56:01.583369] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-23T17:56:01.583410] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-23T17:56:01.583450] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-23T17:56:01.809918] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-23T17:56:01.953693] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:02.017561] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T17:56:02.199029] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T17:56:02.602192] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-23T17:56:03.402197] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-23T17:56:04.202197] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-23T17:56:04.519451] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:04.519825] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-23T17:56:05.002191] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-23T17:56:05.208109] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:05.208425] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-23T17:56:05.328086] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (3.52 seconds). [2025-09-23T17:56:05.659109] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-23T17:56:05.802191] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-23T17:56:06.503757] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-23T17:56:06.528899] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T17:56:06.602166] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-23T17:56:07.402204] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-23T17:56:07.641160] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:07.641498] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-23T17:56:08.202171] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-23T17:56:08.294422] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T17:56:08.300072] [INFO ] [REMOTE ] CEPU: Full fetch complete (39589 records). [2025-09-23T17:56:08.300162] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-23T17:56:08.695507] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-23T17:56:08.695587] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-23T17:56:08.696144] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-23T17:56:08.696210] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-23T17:56:08.697152] [DEBUG] [LOCAL ] CEPU: Trimmed 39589 records to 25995 (keeping 200 days of data) [2025-09-23T17:56:08.869963] [DEBUG] [LOCAL ] CEPU: Primary data saved (25995 records). [2025-09-23T17:56:08.870110] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-23T17:56:08.870199] [INFO ] [MAIN ] Update Progress: 427/2372 symbols completed. CEPU took 25.1s. Estimated remaining: 4h 15m 31s. Rate: 7.6 symbols/min [2025-09-23T17:56:09.017164] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-23T17:56:09.050329] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:09.093220] [DEBUG] [LOCAL ] CFR: Loaded 33601 existing records from primary storage. [2025-09-23T17:56:09.093378] [INFO ] [MAIN ] CFR: Loaded 33601 existing records. [2025-09-23T17:56:09.278440] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:09.278726] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-23T17:56:09.278784] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-23T17:56:09.279966] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-23T17:56:09.280030] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-23T17:56:09.655666] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:09.722672] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T17:56:09.802170] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-23T17:56:10.294683] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:56:10.602221] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-23T17:56:11.317029] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:56:11.402230] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-23T17:56:12.194583] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:56:12.205513] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-23T17:56:12.847569] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T17:56:13.002195] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-23T17:56:13.632938] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:56:13.802201] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-23T17:56:14.460614] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T17:56:14.602195] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-23T17:56:15.252998] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T17:56:15.402213] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-23T17:56:15.602756] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:15.603077] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-23T17:56:16.017778] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:56:16.202190] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-23T17:56:17.002196] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-23T17:56:17.723607] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T17:56:17.802151] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-23T17:56:18.602199] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-23T17:56:18.623868] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T17:56:19.402226] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-23T17:56:19.827453] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T17:56:19.886527] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:56:20.202208] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-23T17:56:20.379220] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T17:56:21.002246] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-23T17:56:21.201965] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:21.202272] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-23T17:56:21.802212] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-23T17:56:21.991116] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T17:56:22.012883] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:22.013260] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-23T17:56:22.602229] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-23T17:56:23.402243] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-23T17:56:23.603599] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:23.604370] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-23T17:56:24.067931] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T17:56:24.202215] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-23T17:56:25.002266] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-23T17:56:25.772543] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:56:25.781863] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-23T17:56:25.782011] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-23T17:56:25.814538] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-23T17:56:26.193705] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-23T17:56:26.193849] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-23T17:56:26.195058] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-23T17:56:26.195208] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-23T17:56:26.197562] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53624 (keeping 200 days of data) [2025-09-23T17:56:26.317886] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:56:26.563121] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-09-23T17:56:26.563263] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-23T17:56:26.563339] [INFO ] [MAIN ] Update Progress: 428/2372 symbols completed. CFG took 31.6s. Estimated remaining: 4h 16m 7s. Rate: 7.6 symbols/min [2025-09-23T17:56:26.607388] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-23T17:56:26.740526] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:26.779721] [DEBUG] [LOCAL ] CGAU: Loaded 42655 existing records from primary storage. [2025-09-23T17:56:26.779882] [INFO ] [MAIN ] CGAU: Loaded 42655 existing records. [2025-09-23T17:56:26.960238] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:26.960477] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-23T17:56:26.960619] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-23T17:56:26.961630] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-23T17:56:26.961729] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-23T17:56:27.355396] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:27.407314] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-23T17:56:27.422343] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T17:56:27.431464] [INFO ] [REMOTE ] CF: Full fetch complete (75134 records). [2025-09-23T17:56:27.431635] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-23T17:56:27.698598] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:27.744053] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-23T17:56:28.001764] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T17:56:28.153925] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-23T17:56:28.154060] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-23T17:56:28.155777] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-23T17:56:28.155883] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-23T17:56:28.158944] [DEBUG] [LOCAL ] CF: Trimmed 75134 records to 52228 (keeping 200 days of data) [2025-09-23T17:56:28.234798] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-23T17:56:28.560023] [DEBUG] [LOCAL ] CF: Primary data saved (52228 records). [2025-09-23T17:56:28.560189] [INFO ] [MAIN ] CF: Full history saved. [2025-09-23T17:56:28.560330] [INFO ] [MAIN ] Update Progress: 429/2372 symbols completed. CF took 41.7s. Estimated remaining: 4h 15m 33s. Rate: 7.6 symbols/min [2025-09-23T17:56:28.742028] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:28.749335] [DEBUG] [LOCAL ] CGV: Loaded 1425 existing records from primary storage. [2025-09-23T17:56:28.749498] [INFO ] [MAIN ] CGV: Loaded 1425 existing records. [2025-09-23T17:56:28.935609] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:28.935907] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-23T17:56:28.935965] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-23T17:56:28.936252] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-23T17:56:28.936356] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-23T17:56:29.006714] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-23T17:56:29.241916] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:56:29.323399] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:29.802205] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-23T17:56:30.080023] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-23T17:56:30.210020] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T17:56:30.602232] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-23T17:56:31.402195] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-23T17:56:31.957631] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:56:31.971898] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:56:32.202238] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-23T17:56:33.002240] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-23T17:56:33.544173] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T17:56:33.545906] [INFO ] [REMOTE ] CFND: Full fetch complete (2526 records). [2025-09-23T17:56:33.545978] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-23T17:56:33.738428] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 33 unique days, need 200 days [2025-09-23T17:56:33.738811] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:56:33.738890] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:56:33.752303] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-23T17:56:33.761377] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T17:56:33.760445] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-23T17:56:33.769801] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-23T17:56:33.770372] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-23T17:56:33.770894] [INFO ] [MAIN ] Update Progress: 430/2372 symbols completed. CFND took 32.4s. Estimated remaining: 4h 15m 13s. Rate: 7.6 symbols/min [2025-09-23T17:56:33.807283] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-23T17:56:33.950227] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:33.976179] [DEBUG] [LOCAL ] CHCT: Loaded 24051 existing records from primary storage. [2025-09-23T17:56:33.976345] [INFO ] [MAIN ] CHCT: Loaded 24051 existing records. [2025-09-23T17:56:34.158095] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:34.158343] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-23T17:56:34.158390] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-23T17:56:34.159086] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-23T17:56:34.159146] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-23T17:56:34.544527] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:34.602207] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-23T17:56:34.780417] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:56:35.402307] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-23T17:56:35.685105] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-23T17:56:35.991455] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:56:36.202243] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-23T17:56:37.002225] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-23T17:56:37.280203] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-23T17:56:37.745904] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T17:56:37.802203] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-23T17:56:38.229143] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T17:56:38.602238] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-23T17:56:39.402422] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-23T17:56:39.404580] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:56:39.707591] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-23T17:56:40.202228] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-23T17:56:41.002219] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-23T17:56:41.680447] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T17:56:41.777138] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T17:56:41.802210] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-23T17:56:42.602211] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-23T17:56:42.890019] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T17:56:43.320320] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:56:43.402220] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-23T17:56:44.202257] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-23T17:56:44.513420] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T17:56:45.002231] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-23T17:56:45.295572] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:56:45.802225] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-23T17:56:45.962498] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T17:56:46.222773] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-23T17:56:46.602201] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-23T17:56:46.949031] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T17:56:47.402348] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-23T17:56:47.670106] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-23T17:56:48.202185] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-23T17:56:49.002259] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-23T17:56:49.292449] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T17:56:49.409461] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-23T17:56:49.410454] [INFO ] [REMOTE ] CGV: Full fetch complete (2279 records). [2025-09-23T17:56:49.410533] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-23T17:56:49.763192] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-23T17:56:49.763271] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-23T17:56:49.763363] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-23T17:56:49.763491] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-23T17:56:49.763866] [DEBUG] [LOCAL ] CGV: Trimmed 2279 records to 1405 (keeping 200 days of data) [2025-09-23T17:56:49.772820] [DEBUG] [LOCAL ] CGV: Primary data saved (1405 records). [2025-09-23T17:56:49.772883] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-23T17:56:49.772954] [INFO ] [MAIN ] Update Progress: 431/2372 symbols completed. CGV took 21.2s. Estimated remaining: 4h 15m 41s. Rate: 7.6 symbols/min [2025-09-23T17:56:49.807381] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-23T17:56:49.943870] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:49.997918] [DEBUG] [LOCAL ] CHD: Loaded 52034 existing records from primary storage. [2025-09-23T17:56:49.998067] [INFO ] [MAIN ] CHD: Loaded 52034 existing records. [2025-09-23T17:56:50.173860] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:50.174086] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-23T17:56:50.174131] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-23T17:56:50.178721] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-23T17:56:50.178808] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-23T17:56:50.540006] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:50.602149] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-23T17:56:50.939324] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T17:56:51.402256] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-23T17:56:51.957005] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:56:52.202244] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-23T17:56:52.472852] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T17:56:52.911474] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:56:53.002185] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-23T17:56:53.802192] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-23T17:56:54.279711] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:56:54.602199] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-23T17:56:55.177561] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T17:56:55.402202] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-23T17:56:55.664225] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T17:56:56.202202] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-23T17:56:57.002214] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-23T17:56:57.032040] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T17:56:57.332834] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T17:56:57.339155] [INFO ] [REMOTE ] CFR: Full fetch complete (48473 records). [2025-09-23T17:56:57.339275] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-23T17:56:57.758108] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-23T17:56:57.758218] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-23T17:56:57.758901] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-23T17:56:57.758972] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-23T17:56:57.760290] [DEBUG] [LOCAL ] CFR: Trimmed 48473 records to 33622 (keeping 200 days of data) [2025-09-23T17:56:57.820503] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-23T17:56:57.984911] [DEBUG] [LOCAL ] CFR: Primary data saved (33622 records). [2025-09-23T17:56:57.985066] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-23T17:56:57.985180] [INFO ] [MAIN ] Update Progress: 432/2372 symbols completed. CFR took 49.1s. Estimated remaining: 4h 15m 35s. Rate: 7.6 symbols/min [2025-09-23T17:56:58.163788] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:58.179423] [DEBUG] [LOCAL ] CHE: Loaded 14666 existing records from primary storage. [2025-09-23T17:56:58.179547] [INFO ] [MAIN ] CHE: Loaded 14666 existing records. [2025-09-23T17:56:58.359375] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:58.359847] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-23T17:56:58.359905] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-23T17:56:58.360370] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-23T17:56:58.360429] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-23T17:56:58.614927] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-23T17:56:58.791282] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:58.821152] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T17:56:59.247802] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T17:56:59.258410] [INFO ] [REMOTE ] CGAU: Full fetch complete (60502 records). [2025-09-23T17:56:59.258564] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-23T17:56:59.414399] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-23T17:56:59.713113] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-23T17:56:59.713231] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-23T17:56:59.713957] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-23T17:56:59.714143] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-23T17:56:59.730208] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:56:59.736889] [DEBUG] [LOCAL ] CGAU: Trimmed 60502 records to 42686 (keeping 200 days of data) [2025-09-23T17:56:59.992970] [DEBUG] [LOCAL ] CGAU: Primary data saved (42686 records). [2025-09-23T17:56:59.993114] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-23T17:56:59.993217] [INFO ] [MAIN ] Update Progress: 433/2372 symbols completed. CGAU took 33.4s. Estimated remaining: 4h 15m 1s. Rate: 7.6 symbols/min [2025-09-23T17:57:00.165790] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:00.175240] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T17:57:00.204610] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-23T17:57:00.226794] [DEBUG] [LOCAL ] CHGG: Loaded 47754 existing records from primary storage. [2025-09-23T17:57:00.226960] [INFO ] [MAIN ] CHGG: Loaded 47754 existing records. [2025-09-23T17:57:00.425391] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:00.425702] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-23T17:57:00.425762] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-23T17:57:00.426790] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-23T17:57:00.426856] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-23T17:57:00.788415] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:01.002232] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-23T17:57:01.136468] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T17:57:01.802262] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-23T17:57:02.260683] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:57:02.265197] [INFO ] [REMOTE ] CHCT: Full fetch complete (35002 records). [2025-09-23T17:57:02.265370] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-23T17:57:02.607900] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-23T17:57:02.648788] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-23T17:57:02.648882] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-23T17:57:02.649370] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-23T17:57:02.649413] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-23T17:57:02.650419] [DEBUG] [LOCAL ] CHCT: Trimmed 35002 records to 24013 (keeping 200 days of data) [2025-09-23T17:57:02.801240] [DEBUG] [LOCAL ] CHCT: Primary data saved (24013 records). [2025-09-23T17:57:02.801419] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-23T17:57:02.801530] [INFO ] [MAIN ] Update Progress: 434/2372 symbols completed. CHCT took 29.0s. Estimated remaining: 4h 14m 30s. Rate: 7.6 symbols/min [2025-09-23T17:57:02.976550] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:03.013493] [DEBUG] [LOCAL ] CHH: Loaded 32240 existing records from primary storage. [2025-09-23T17:57:03.013635] [INFO ] [MAIN ] CHH: Loaded 32240 existing records. [2025-09-23T17:57:03.201119] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:03.201574] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-23T17:57:03.201635] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-23T17:57:03.202572] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-23T17:57:03.202636] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-23T17:57:03.411456] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-23T17:57:03.560974] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:04.202270] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-23T17:57:04.954060] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-23T17:57:05.002148] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-23T17:57:05.035939] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T17:57:05.114671] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-09-23T17:57:05.500713] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:57:05.802216] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-23T17:57:06.261458] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:57:06.602200] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-23T17:57:07.129042] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:57:07.402258] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-23T17:57:07.929615] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:57:08.202218] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-23T17:57:08.988567] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:57:09.002391] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-23T17:57:09.545036] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:57:09.802214] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-23T17:57:10.458021] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T17:57:10.602191] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-23T17:57:11.113891] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T17:57:11.402188] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-23T17:57:11.976860] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T17:57:12.202166] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-23T17:57:12.471232] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T17:57:13.002206] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-23T17:57:13.802237] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-23T17:57:14.014875] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T17:57:14.602206] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-23T17:57:14.796272] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T17:57:14.869344] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:57:15.402209] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-23T17:57:16.029266] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T17:57:16.202153] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-23T17:57:16.707433] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T17:57:17.002172] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-23T17:57:17.752610] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:57:17.761419] [INFO ] [REMOTE ] CHD: Full fetch complete (74364 records). [2025-09-23T17:57:17.761562] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-23T17:57:17.808818] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-23T17:57:18.181326] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-23T17:57:18.181414] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-23T17:57:18.182205] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-23T17:57:18.182270] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-23T17:57:18.183726] [DEBUG] [LOCAL ] CHD: Trimmed 74364 records to 52024 (keeping 200 days of data) [2025-09-23T17:57:18.516430] [DEBUG] [LOCAL ] CHD: Primary data saved (52024 records). [2025-09-23T17:57:18.516581] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-23T17:57:18.516688] [INFO ] [MAIN ] Update Progress: 435/2372 symbols completed. CHD took 28.7s. Estimated remaining: 4h 14m 57s. Rate: 7.6 symbols/min [2025-09-23T17:57:18.608225] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-23T17:57:18.692848] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:18.713845] [DEBUG] [LOCAL ] CHMI: Loaded 22078 existing records from primary storage. [2025-09-23T17:57:18.714069] [INFO ] [MAIN ] CHMI: Loaded 22078 existing records. [2025-09-23T17:57:18.899348] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:18.899910] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-23T17:57:18.900024] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-23T17:57:18.900832] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-23T17:57:18.900897] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-23T17:57:19.200326] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T17:57:19.359918] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:19.361447] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T17:57:19.402153] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-23T17:57:19.611656] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:57:20.202277] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-23T17:57:20.284317] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T17:57:21.002253] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-23T17:57:21.280347] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T17:57:21.802196] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-23T17:57:21.881299] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T17:57:22.507362] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T17:57:22.602265] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-23T17:57:23.402229] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-23T17:57:23.696198] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T17:57:24.128141] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T17:57:24.202174] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-23T17:57:24.854022] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T17:57:25.002255] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-23T17:57:25.802193] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-23T17:57:25.939859] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:57:26.602226] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-23T17:57:27.402184] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-23T17:57:27.584794] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T17:57:27.690012] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T17:57:28.080779] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T17:57:28.202246] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-23T17:57:28.866435] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T17:57:29.002237] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-23T17:57:29.802160] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-23T17:57:29.821771] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T17:57:30.602211] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-23T17:57:30.700341] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T17:57:30.703815] [INFO ] [REMOTE ] CHE: Full fetch complete (19586 records). [2025-09-23T17:57:30.703890] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-23T17:57:31.066706] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-23T17:57:31.066791] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-23T17:57:31.067144] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-23T17:57:31.067218] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-23T17:57:31.067844] [DEBUG] [LOCAL ] CHE: Trimmed 19586 records to 14740 (keeping 200 days of data) [2025-09-23T17:57:31.173913] [DEBUG] [LOCAL ] CHE: Primary data saved (14740 records). [2025-09-23T17:57:31.174317] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-23T17:57:31.174726] [INFO ] [MAIN ] Update Progress: 436/2372 symbols completed. CHE took 33.2s. Estimated remaining: 4h 15m 10s. Rate: 7.6 symbols/min [2025-09-23T17:57:31.348853] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:31.355779] [DEBUG] [LOCAL ] CHN: Loaded 4800 existing records from primary storage. [2025-09-23T17:57:31.355870] [INFO ] [MAIN ] CHN: Loaded 4800 existing records. [2025-09-23T17:57:31.410496] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-23T17:57:31.535954] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:31.536201] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-23T17:57:31.536262] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-23T17:57:31.536573] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-23T17:57:31.536634] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-23T17:57:31.890066] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:32.132674] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:57:32.202148] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-23T17:57:32.825602] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T17:57:33.002194] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-23T17:57:33.690055] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T17:57:33.699170] [INFO ] [REMOTE ] CHGG: Full fetch complete (70668 records). [2025-09-23T17:57:33.699296] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-23T17:57:33.804636] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-23T17:57:33.900717] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:57:34.123138] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-23T17:57:34.123219] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-23T17:57:34.123982] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-23T17:57:34.124045] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-23T17:57:34.126073] [DEBUG] [LOCAL ] CHGG: Trimmed 70668 records to 47742 (keeping 200 days of data) [2025-09-23T17:57:34.408856] [DEBUG] [LOCAL ] CHGG: Primary data saved (47742 records). [2025-09-23T17:57:34.409070] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-23T17:57:34.409265] [INFO ] [MAIN ] Update Progress: 437/2372 symbols completed. CHGG took 34.4s. Estimated remaining: 4h 14m 42s. Rate: 7.6 symbols/min [2025-09-23T17:57:34.442669] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T17:57:34.602209] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-23T17:57:35.402174] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-23T17:57:35.704994] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T17:57:35.866943] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T17:57:36.202235] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-23T17:57:36.668084] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T17:57:37.002218] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-23T17:57:37.802254] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-23T17:57:38.079981] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T17:57:38.087593] [INFO ] [REMOTE ] CHH: Full fetch complete (46250 records). [2025-09-23T17:57:38.087833] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-23T17:57:38.402835] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T17:57:38.492005] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-23T17:57:38.492096] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-23T17:57:38.492672] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-23T17:57:38.492752] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-23T17:57:38.494116] [DEBUG] [LOCAL ] CHH: Trimmed 46250 records to 32213 (keeping 200 days of data) [2025-09-23T17:57:38.602417] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-23T17:57:38.708688] [DEBUG] [LOCAL ] CHH: Primary data saved (32213 records). [2025-09-23T17:57:38.708823] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-23T17:57:38.708944] [INFO ] [MAIN ] Update Progress: 438/2372 symbols completed. CHH took 35.9s. Estimated remaining: 4h 14m 18s. Rate: 7.6 symbols/min [2025-09-23T17:57:39.219330] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T17:57:39.402209] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-23T17:57:39.772349] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T17:57:40.202205] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-23T17:57:40.556524] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-23T17:57:41.002234] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-23T17:57:41.357555] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T17:57:41.802210] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-23T17:57:42.602222] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-23T17:57:42.942621] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:57:43.046894] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T17:57:43.402241] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-23T17:57:44.202207] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-23T17:57:45.125301] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T17:57:45.126779] [INFO ] [REMOTE ] CHN: Full fetch complete (7571 records). [2025-09-23T17:57:45.126871] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-23T17:57:45.461936] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:57:45.510350] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-23T17:57:45.544610] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-23T17:57:45.544751] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-23T17:57:45.545029] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-23T17:57:45.545094] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-23T17:57:45.545811] [DEBUG] [LOCAL ] CHN: Trimmed 7571 records to 4788 (keeping 200 days of data) [2025-09-23T17:57:45.580107] [DEBUG] [LOCAL ] CHN: Primary data saved (4788 records). [2025-09-23T17:57:45.580258] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-23T17:57:45.580348] [INFO ] [MAIN ] Update Progress: 439/2372 symbols completed. CHN took 14.4s. Estimated remaining: 4h 14m 5s. Rate: 7.6 symbols/min [2025-09-23T17:57:46.701123] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T17:57:46.705600] [INFO ] [REMOTE ] CHMI: Full fetch complete (31569 records). [2025-09-23T17:57:46.705804] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-23T17:57:47.102745] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-23T17:57:47.102887] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-23T17:57:47.103721] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-23T17:57:47.103786] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-23T17:57:47.104904] [DEBUG] [LOCAL ] CHMI: Trimmed 31569 records to 22112 (keeping 200 days of data) [2025-09-23T17:57:47.251038] [DEBUG] [LOCAL ] CHMI: Primary data saved (22112 records). [2025-09-23T17:57:47.251228] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-23T17:57:47.251367] [INFO ] [MAIN ] Update Progress: 440/2372 symbols completed. CHMI took 28.7s. Estimated remaining: 4h 13m 30s. Rate: 7.6 symbols/min [2025-09-23T17:57:47.848863] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:48.037429] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:48.044702] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:48.063601] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:48.065278] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-09-23T17:57:48.065352] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-09-23T17:57:48.065629] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-23T17:57:48.065720] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-23T17:57:48.065789] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-09-23T17:57:48.065849] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-23T17:57:48.502414] [DEBUG] [LOCAL ] CHPT: Loaded 49427 existing records from primary storage. [2025-09-23T17:57:48.528844] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-23T17:57:48.540727] [INFO ] [MAIN ] CHPT: Loaded 49427 existing records. [2025-09-23T17:57:48.540546] [DEBUG] [LOCAL ] CI: Loaded 49924 existing records from primary storage. [2025-09-23T17:57:48.544811] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-09-23T17:57:48.587245] [INFO ] [MAIN ] CI: Loaded 49924 existing records. [2025-09-23T17:57:48.629022] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:48.707198] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-23T17:57:49.073808] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:49.137247] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:49.125492] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-23T17:57:49.153687] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-23T17:57:49.179416] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-23T17:57:49.179674] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-23T17:57:49.179813] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:49.180363] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-23T17:57:49.180420] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-23T17:57:49.181969] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-23T17:57:49.182066] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-23T17:57:49.182111] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-23T17:57:49.187471] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-23T17:57:49.187399] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-23T17:57:49.285190] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-23T17:57:50.216504] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:50.338448] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-23T17:57:50.344523] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T17:57:50.376364] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:50.385707] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-23T17:57:50.391842] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-23T17:57:50.469679] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:50.469942] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-23T17:57:51.072682] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T17:57:51.076606] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-23T17:57:51.999770] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T17:57:52.010833] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-23T17:57:52.066484] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:57:52.070617] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-23T17:57:52.116714] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T17:57:52.202148] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-23T17:57:52.567878] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T17:57:52.883271] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T17:57:53.002210] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-23T17:57:53.437280] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T17:57:53.765262] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T17:57:53.802169] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-23T17:57:53.827266] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:57:54.602237] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-23T17:57:55.193889] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:57:55.372927] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:57:55.402157] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-23T17:57:56.202194] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-23T17:57:56.708705] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T17:57:57.002220] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-23T17:57:57.802241] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-23T17:57:58.039768] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T17:57:58.364101] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T17:57:58.602269] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-23T17:57:59.402230] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-23T17:57:59.426076] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T17:58:00.078222] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-23T17:58:00.202187] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-23T17:58:01.002183] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-23T17:58:01.292926] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T17:58:01.802167] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-23T17:58:01.818598] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T17:58:01.822311] [INFO ] [REMOTE ] CHT: Full fetch complete (27387 records). [2025-09-23T17:58:01.822474] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-23T17:58:02.249005] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-23T17:58:02.249136] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-23T17:58:02.249868] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-23T17:58:02.249959] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-23T17:58:02.251287] [DEBUG] [LOCAL ] CHT: Trimmed 27387 records to 19542 (keeping 200 days of data) [2025-09-23T17:58:02.413806] [DEBUG] [LOCAL ] CHT: Primary data saved (19542 records). [2025-09-23T17:58:02.414971] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-23T17:58:02.415080] [INFO ] [MAIN ] Update Progress: 441/2372 symbols completed. CHT took 15.2s. Estimated remaining: 4h 13m 54s. Rate: 7.6 symbols/min [2025-09-23T17:58:02.416349] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-23T17:58:02.607373] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-23T17:58:02.610610] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:02.633372] [DEBUG] [LOCAL ] CIA: Loaded 16947 existing records from primary storage. [2025-09-23T17:58:02.633538] [INFO ] [MAIN ] CIA: Loaded 16947 existing records. [2025-09-23T17:58:02.822434] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:02.822828] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-23T17:58:02.822884] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-23T17:58:02.823862] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-23T17:58:02.823926] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-23T17:58:03.209087] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:03.402256] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-23T17:58:03.620290] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T17:58:04.001966] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T17:58:04.202290] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-23T17:58:04.334363] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T17:58:05.002204] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-23T17:58:05.626585] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:58:05.802232] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-23T17:58:06.014704] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T17:58:06.602207] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-23T17:58:07.402237] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-23T17:58:07.610549] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T17:58:07.972195] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T17:58:08.202241] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-23T17:58:09.008578] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-23T17:58:09.011743] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-23T17:58:09.755837] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T17:58:09.802186] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-23T17:58:10.140200] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T17:58:10.602187] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-23T17:58:11.413042] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-23T17:58:11.446192] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:58:11.588933] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T17:58:12.202195] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-23T17:58:12.862510] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T17:58:13.002291] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-23T17:58:13.309711] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T17:58:13.802202] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-23T17:58:14.602182] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-23T17:58:14.697470] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T17:58:15.402238] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-23T17:58:15.545696] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:58:16.202165] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-23T17:58:16.220179] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T17:58:16.492462] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T17:58:17.002195] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-23T17:58:17.810243] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-23T17:58:17.835016] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T17:58:18.407102] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T17:58:18.602237] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-23T17:58:19.308521] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T17:58:19.402210] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-23T17:58:19.907235] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T17:58:20.153509] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T17:58:20.202219] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-23T17:58:20.948756] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T17:58:20.951938] [INFO ] [REMOTE ] CIA: Full fetch complete (23309 records). [2025-09-23T17:58:20.952023] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-23T17:58:21.010139] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-23T17:58:21.347854] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-23T17:58:21.347938] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-23T17:58:21.348359] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-23T17:58:21.348421] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-23T17:58:21.349093] [DEBUG] [LOCAL ] CIA: Trimmed 23309 records to 17059 (keeping 200 days of data) [2025-09-23T17:58:21.441413] [DEBUG] [LOCAL ] CIA: Primary data saved (17059 records). [2025-09-23T17:58:21.441579] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-23T17:58:21.441700] [INFO ] [MAIN ] Update Progress: 442/2372 symbols completed. CIA took 19.0s. Estimated remaining: 4h 14m 35s. Rate: 7.6 symbols/min [2025-09-23T17:58:21.609167] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:21.642431] [DEBUG] [LOCAL ] CIB: Loaded 31043 existing records from primary storage. [2025-09-23T17:58:21.642566] [INFO ] [MAIN ] CIB: Loaded 31043 existing records. [2025-09-23T17:58:21.815931] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-23T17:58:21.823143] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:21.824947] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-23T17:58:21.825017] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-23T17:58:21.826115] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-23T17:58:21.826184] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-23T17:58:22.185822] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:22.602218] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-23T17:58:22.924887] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T17:58:23.402196] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-23T17:58:23.526711] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T17:58:24.126214] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T17:58:24.134803] [INFO ] [REMOTE ] CI: Full fetch complete (72521 records). [2025-09-23T17:58:24.134959] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-23T17:58:24.208523] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-23T17:58:24.541320] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-23T17:58:24.541422] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-23T17:58:24.542276] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-23T17:58:24.542342] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-23T17:58:24.543989] [DEBUG] [LOCAL ] CI: Trimmed 72521 records to 49904 (keeping 200 days of data) [2025-09-23T17:58:24.865564] [DEBUG] [LOCAL ] CI: Primary data saved (49904 records). [2025-09-23T17:58:24.865743] [INFO ] [MAIN ] CI: Full history saved. [2025-09-23T17:58:24.865839] [INFO ] [MAIN ] Update Progress: 443/2372 symbols completed. CI took 37.6s. Estimated remaining: 4h 14m 8s. Rate: 7.6 symbols/min [2025-09-23T17:58:25.004779] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-23T17:58:25.062184] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:25.062452] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-23T17:58:25.062695] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-23T17:58:25.063074] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-23T17:58:25.063166] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-23T17:58:25.063362] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-23T17:58:25.063495] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-23T17:58:25.254170] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T17:58:25.476483] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:25.676178] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:58:25.802213] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-23T17:58:26.602258] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-23T17:58:26.715745] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T17:58:26.931830] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T17:58:26.940753] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-23T17:58:26.940880] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-23T17:58:27.346677] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-23T17:58:27.346781] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-23T17:58:27.347675] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-23T17:58:27.347745] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-23T17:58:27.349583] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 53654 (keeping 200 days of data) [2025-09-23T17:58:27.410851] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-23T17:58:27.706610] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-09-23T17:58:27.706794] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-23T17:58:27.706932] [INFO ] [MAIN ] Update Progress: 444/2372 symbols completed. CHWY took 40.5s. Estimated remaining: 4h 13m 38s. Rate: 7.6 symbols/min [2025-09-23T17:58:27.893147] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:27.943395] [DEBUG] [LOCAL ] CIEN: Loaded 52090 existing records from primary storage. [2025-09-23T17:58:27.943570] [INFO ] [MAIN ] CIEN: Loaded 52090 existing records. [2025-09-23T17:58:28.133370] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:28.133900] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-23T17:58:28.134056] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-23T17:58:28.142853] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-23T17:58:28.157487] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-23T17:58:28.213769] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-23T17:58:28.224807] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T17:58:28.271957] [INFO ] [REMOTE ] CHPT: Full fetch complete (73514 records). [2025-09-23T17:58:28.273011] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-23T17:58:28.831423] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:28.869688] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T17:58:28.995535] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-23T17:58:29.004005] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-23T17:58:29.003875] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-23T17:58:29.005543] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-23T17:58:29.023634] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-23T17:58:29.026515] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T17:58:29.034638] [DEBUG] [LOCAL ] CHPT: Trimmed 73514 records to 49401 (keeping 200 days of data) [2025-09-23T17:58:29.344147] [DEBUG] [LOCAL ] CHPT: Primary data saved (49401 records). [2025-09-23T17:58:29.344340] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-23T17:58:29.345756] [INFO ] [MAIN ] Update Progress: 445/2372 symbols completed. CHPT took 42.1s. Estimated remaining: 4h 13m 3s. Rate: 7.6 symbols/min [2025-09-23T17:58:29.516993] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:29.524141] [DEBUG] [LOCAL ] CIF: Loaded 4421 existing records from primary storage. [2025-09-23T17:58:29.524278] [INFO ] [MAIN ] CIF: Loaded 4421 existing records. [2025-09-23T17:58:29.704201] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:29.704449] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-23T17:58:29.704497] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-23T17:58:29.704843] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-23T17:58:29.704904] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-23T17:58:29.805398] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-23T17:58:30.073068] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:30.561592] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:58:30.602165] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-23T17:58:30.916561] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:58:31.402259] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-23T17:58:31.933162] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:58:32.111563] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T17:58:32.202194] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-23T17:58:32.845048] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T17:58:33.002200] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-23T17:58:33.459622] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:58:33.802228] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-23T17:58:34.098344] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-23T17:58:34.602192] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-23T17:58:35.030426] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T17:58:35.402237] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-23T17:58:35.822184] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T17:58:36.202333] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-23T17:58:37.002207] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-23T17:58:37.366538] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T17:58:37.513816] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T17:58:37.802197] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-23T17:58:38.602196] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-23T17:58:39.108637] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:58:39.402196] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-23T17:58:39.903433] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T17:58:40.202265] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-23T17:58:41.002166] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-23T17:58:41.033457] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T17:58:41.133258] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T17:58:41.380893] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-23T17:58:41.802267] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-23T17:58:42.557319] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T17:58:42.602198] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-23T17:58:42.953538] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T17:58:43.402250] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-23T17:58:43.683274] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-23T17:58:44.202250] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-23T17:58:45.002603] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-23T17:58:45.004803] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T17:58:45.802200] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-23T17:58:46.081975] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-23T17:58:46.602222] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-23T17:58:46.779137] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T17:58:46.881428] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-23T17:58:47.402201] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-23T17:58:48.202202] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-23T17:58:48.573245] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-23T17:58:48.574151] [INFO ] [REMOTE ] CICB: Full fetch complete (2118 records). [2025-09-23T17:58:48.574229] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-23T17:58:48.770382] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-23T17:58:48.770684] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:58:48.770854] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:58:48.771101] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-23T17:58:48.784596] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-23T17:58:48.786902] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-23T17:58:48.788205] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T17:58:48.788291] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-23T17:58:48.794593] [INFO ] [MAIN ] Update Progress: 446/2372 symbols completed. CICB took 23.9s. Estimated remaining: 4h 13m 45s. Rate: 7.6 symbols/min [2025-09-23T17:58:48.982560] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:49.007038] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-23T17:58:49.026083] [DEBUG] [LOCAL ] CIG: Loaded 43600 existing records from primary storage. [2025-09-23T17:58:49.026241] [INFO ] [MAIN ] CIG: Loaded 43600 existing records. [2025-09-23T17:58:49.213530] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:49.213841] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-23T17:58:49.213894] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-23T17:58:49.215230] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-23T17:58:49.215295] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-23T17:58:49.583175] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:49.802248] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-23T17:58:50.019877] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T17:58:50.026715] [INFO ] [REMOTE ] CIB: Full fetch complete (44281 records). [2025-09-23T17:58:50.027005] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-23T17:58:50.419937] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-23T17:58:50.420050] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-23T17:58:50.420779] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-23T17:58:50.420864] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-23T17:58:50.422276] [DEBUG] [LOCAL ] CIB: Trimmed 44281 records to 31006 (keeping 200 days of data) [2025-09-23T17:58:50.602284] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-23T17:58:50.622623] [DEBUG] [LOCAL ] CIB: Primary data saved (31006 records). [2025-09-23T17:58:50.622814] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-23T17:58:50.622910] [INFO ] [MAIN ] Update Progress: 447/2372 symbols completed. CIB took 29.2s. Estimated remaining: 4h 13m 11s. Rate: 7.6 symbols/min [2025-09-23T17:58:50.794035] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:50.811244] [DEBUG] [LOCAL ] CII: Loaded 15615 existing records from primary storage. [2025-09-23T17:58:50.811383] [INFO ] [MAIN ] CII: Loaded 15615 existing records. [2025-09-23T17:58:51.008066] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:51.008513] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-23T17:58:51.008620] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-23T17:58:51.009161] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-23T17:58:51.009253] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-23T17:58:51.207566] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T17:58:51.269850] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:58:51.407298] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-23T17:58:51.469943] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:52.202212] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-23T17:58:52.784865] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T17:58:53.002223] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-23T17:58:53.025244] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T17:58:53.802170] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-23T17:58:54.175521] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T17:58:54.602222] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-23T17:58:55.402200] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-23T17:58:55.454595] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:58:55.975155] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:58:56.202205] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-23T17:58:56.344959] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:58:57.002277] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-23T17:58:57.230097] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T17:58:57.417104] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T17:58:57.802210] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-23T17:58:58.602189] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-23T17:58:59.402165] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-23T17:58:59.582617] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T17:58:59.603686] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T17:59:00.202189] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-23T17:59:00.625464] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T17:59:00.638322] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T17:59:01.002164] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-23T17:59:01.802227] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-23T17:59:02.039607] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T17:59:02.602231] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-23T17:59:02.978309] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T17:59:03.292043] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T17:59:03.293298] [INFO ] [REMOTE ] CIF: Full fetch complete (6603 records). [2025-09-23T17:59:03.293367] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-23T17:59:03.407265] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-23T17:59:03.651961] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-23T17:59:03.652041] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-23T17:59:03.652232] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-23T17:59:03.652272] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-23T17:59:03.652696] [DEBUG] [LOCAL ] CIF: Trimmed 6603 records to 4364 (keeping 200 days of data) [2025-09-23T17:59:03.678350] [DEBUG] [LOCAL ] CIF: Primary data saved (4364 records). [2025-09-23T17:59:03.678425] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-23T17:59:03.678502] [INFO ] [MAIN ] Update Progress: 448/2372 symbols completed. CIF took 34.3s. Estimated remaining: 4h 13m 25s. Rate: 7.6 symbols/min [2025-09-23T17:59:03.851855] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:03.899906] [DEBUG] [LOCAL ] CIM: Loaded 37152 existing records from primary storage. [2025-09-23T17:59:03.900049] [INFO ] [MAIN ] CIM: Loaded 37152 existing records. [2025-09-23T17:59:04.084458] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:04.084769] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-23T17:59:04.084827] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-23T17:59:04.085845] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-23T17:59:04.085910] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-23T17:59:04.207326] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-23T17:59:04.501158] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:04.745028] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T17:59:05.002214] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-23T17:59:05.170880] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T17:59:05.802254] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-23T17:59:06.356482] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T17:59:06.602214] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-23T17:59:06.753240] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T17:59:07.162166] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T17:59:07.402201] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-23T17:59:08.202195] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-23T17:59:08.808771] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:59:08.946503] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:59:09.002199] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-23T17:59:09.802230] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-23T17:59:09.982239] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T17:59:10.602191] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-23T17:59:11.309587] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T17:59:11.318777] [INFO ] [REMOTE ] CIEN: Full fetch complete (75543 records). [2025-09-23T17:59:11.318892] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-23T17:59:11.407334] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-23T17:59:11.715442] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-23T17:59:11.715521] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-23T17:59:11.716277] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-23T17:59:11.716341] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-23T17:59:11.717909] [DEBUG] [LOCAL ] CIEN: Trimmed 75543 records to 52087 (keeping 200 days of data) [2025-09-23T17:59:12.047062] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T17:59:12.050562] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T17:59:12.072071] [DEBUG] [LOCAL ] CIEN: Primary data saved (52087 records). [2025-09-23T17:59:12.072208] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-23T17:59:12.072302] [INFO ] [MAIN ] Update Progress: 449/2372 symbols completed. CIEN took 44.4s. Estimated remaining: 4h 13m 19s. Rate: 7.6 symbols/min [2025-09-23T17:59:12.212925] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-23T17:59:12.245868] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:12.250182] [DEBUG] [LOCAL ] CIMN: Loaded 2667 existing records from primary storage. [2025-09-23T17:59:12.250262] [INFO ] [MAIN ] CIMN: Loaded 2667 existing records. [2025-09-23T17:59:12.425037] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:12.425298] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-23T17:59:12.425348] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-23T17:59:12.425674] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-23T17:59:12.425735] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-23T17:59:12.804593] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:13.002209] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-23T17:59:13.475081] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:59:13.478499] [INFO ] [REMOTE ] CII: Full fetch complete (23120 records). [2025-09-23T17:59:13.478605] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-23T17:59:13.808369] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-23T17:59:13.858801] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-23T17:59:13.858889] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-23T17:59:13.859318] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-23T17:59:13.859359] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-23T17:59:13.860009] [DEBUG] [LOCAL ] CII: Trimmed 23120 records to 15526 (keeping 200 days of data) [2025-09-23T17:59:13.955455] [DEBUG] [LOCAL ] CII: Primary data saved (15526 records). [2025-09-23T17:59:13.955625] [INFO ] [MAIN ] CII: Full history saved. [2025-09-23T17:59:13.955780] [INFO ] [MAIN ] Update Progress: 450/2372 symbols completed. CII took 23.3s. Estimated remaining: 4h 12m 46s. Rate: 7.6 symbols/min [2025-09-23T17:59:14.130999] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:14.131207] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-23T17:59:14.131244] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-23T17:59:14.131396] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-23T17:59:14.131438] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-23T17:59:14.131478] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-23T17:59:14.131566] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-23T17:59:14.507766] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:14.602213] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-23T17:59:14.665984] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T17:59:15.023088] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T17:59:15.353144] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T17:59:15.402208] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-23T17:59:15.877874] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T17:59:16.202205] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-23T17:59:17.002240] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-23T17:59:17.703114] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:59:17.802164] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-23T17:59:18.327815] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:59:18.602192] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-23T17:59:18.916191] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T17:59:18.995466] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T17:59:19.402239] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-23T17:59:19.711035] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T17:59:20.202261] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-23T17:59:21.002232] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-23T17:59:21.380422] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:59:21.802248] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-23T17:59:22.187889] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T17:59:22.209773] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:59:22.602219] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-23T17:59:23.402249] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-23T17:59:23.887028] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T17:59:24.156175] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:59:24.163677] [INFO ] [REMOTE ] CIG: Full fetch complete (60871 records). [2025-09-23T17:59:24.163847] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-23T17:59:24.207385] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-23T17:59:24.575347] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-23T17:59:24.575470] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-23T17:59:24.576186] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-23T17:59:24.576252] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-23T17:59:24.577811] [DEBUG] [LOCAL ] CIG: Trimmed 60871 records to 43739 (keeping 200 days of data) [2025-09-23T17:59:24.666469] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T17:59:24.834232] [DEBUG] [LOCAL ] CIG: Primary data saved (43739 records). [2025-09-23T17:59:24.834370] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-23T17:59:24.834454] [INFO ] [MAIN ] Update Progress: 451/2372 symbols completed. CIG took 36.0s. Estimated remaining: 4h 12m 50s. Rate: 7.6 symbols/min [2025-09-23T17:59:25.003541] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-23T17:59:25.003458] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:25.004521] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-23T17:59:25.004577] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-23T17:59:25.004752] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-23T17:59:25.004803] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-23T17:59:25.004903] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-23T17:59:25.004943] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-23T17:59:25.404083] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:25.678218] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-23T17:59:25.802188] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-23T17:59:26.340339] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:59:26.602199] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-23T17:59:26.939363] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T17:59:27.402294] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-23T17:59:27.636954] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:27.637280] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-23T17:59:28.202205] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-23T17:59:28.397591] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:28.397975] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-23T17:59:29.002195] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-23T17:59:29.446828] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-23T17:59:29.802245] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-23T17:59:30.145319] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T17:59:30.602208] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-23T17:59:31.034293] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:59:31.402213] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-23T17:59:31.731831] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T17:59:32.202210] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-23T17:59:32.414558] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:32.414905] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-23T17:59:33.002189] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-23T17:59:33.200462] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:33.200802] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-23T17:59:33.802189] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-23T17:59:34.001111] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:34.001459] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-23T17:59:34.602197] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-23T17:59:35.402211] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-23T17:59:35.710017] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T17:59:36.135270] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:59:36.202168] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-23T17:59:37.002209] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-23T17:59:37.300073] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T17:59:37.453411] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-23T17:59:37.802203] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-23T17:59:38.005032] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:38.005444] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-23T17:59:38.602193] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-23T17:59:39.109886] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:59:39.111137] [INFO ] [REMOTE ] CIMN: Full fetch complete (3901 records). [2025-09-23T17:59:39.111213] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-23T17:59:39.407408] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-23T17:59:39.482916] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-23T17:59:39.483018] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-23T17:59:39.483195] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-23T17:59:39.483235] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-23T17:59:39.483611] [DEBUG] [LOCAL ] CIMN: Trimmed 3901 records to 2681 (keeping 200 days of data) [2025-09-23T17:59:39.500601] [DEBUG] [LOCAL ] CIMN: Primary data saved (2681 records). [2025-09-23T17:59:39.500720] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-23T17:59:39.500814] [INFO ] [MAIN ] Update Progress: 452/2372 symbols completed. CIMN took 27.4s. Estimated remaining: 4h 13m 11s. Rate: 7.6 symbols/min [2025-09-23T17:59:39.670606] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:39.682143] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:39.682551] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-23T17:59:39.690819] [DEBUG] [LOCAL ] CINT: Loaded 18299 existing records from primary storage. [2025-09-23T17:59:39.690958] [INFO ] [MAIN ] CINT: Loaded 18299 existing records. [2025-09-23T17:59:39.881088] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:39.881370] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-23T17:59:39.881423] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-23T17:59:39.881974] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-23T17:59:39.882034] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-23T17:59:40.207354] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-23T17:59:40.275722] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:41.002261] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-23T17:59:41.519699] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-23T17:59:41.696343] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T17:59:41.703104] [INFO ] [REMOTE ] CIM: Full fetch complete (54445 records). [2025-09-23T17:59:41.703245] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-23T17:59:41.803453] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-23T17:59:42.095271] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-23T17:59:42.095364] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-23T17:59:42.096106] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-23T17:59:42.096206] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-23T17:59:42.097427] [DEBUG] [LOCAL ] CIM: Trimmed 54445 records to 37225 (keeping 200 days of data) [2025-09-23T17:59:42.336913] [DEBUG] [LOCAL ] CIM: Primary data saved (37225 records). [2025-09-23T17:59:42.337217] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-23T17:59:42.337499] [INFO ] [MAIN ] Update Progress: 453/2372 symbols completed. CIM took 38.7s. Estimated remaining: 4h 12m 42s. Rate: 7.6 symbols/min [2025-09-23T17:59:42.511182] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:42.534100] [DEBUG] [LOCAL ] CIO: Loaded 20042 existing records from primary storage. [2025-09-23T17:59:42.534226] [INFO ] [MAIN ] CIO: Loaded 20042 existing records. [2025-09-23T17:59:42.607737] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-23T17:59:42.713637] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:42.713925] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-23T17:59:42.713986] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-23T17:59:42.714588] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-23T17:59:42.714679] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-23T17:59:43.001228] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T17:59:43.091695] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:43.093206] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:59:43.402226] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-23T17:59:43.597750] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:43.598078] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-23T17:59:44.202183] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-23T17:59:44.996765] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T17:59:45.002133] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-23T17:59:45.802219] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-23T17:59:46.027954] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:46.028300] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-23T17:59:46.085237] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:59:46.602210] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-23T17:59:47.402231] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-23T17:59:47.572904] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T17:59:48.073176] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T17:59:48.202172] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-23T17:59:48.701917] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T17:59:48.703514] [INFO ] [REMOTE ] CIMO: Full fetch complete (5504 records). [2025-09-23T17:59:48.703606] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-23T17:59:48.895198] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T17:59:48.895510] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:59:48.895585] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:59:48.895691] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-23T17:59:48.895804] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-23T17:59:48.895863] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-23T17:59:48.895925] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-23T17:59:48.896057] [INFO ] [MAIN ] Update Progress: 454/2372 symbols completed. CIMO took 34.9s. Estimated remaining: 4h 12m 28s. Rate: 7.6 symbols/min [2025-09-23T17:59:49.007727] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-23T17:59:49.082576] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:49.126739] [DEBUG] [LOCAL ] CION: Loaded 29391 existing records from primary storage. [2025-09-23T17:59:49.126900] [INFO ] [MAIN ] CION: Loaded 29391 existing records. [2025-09-23T17:59:49.336827] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:49.337069] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-23T17:59:49.337127] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-23T17:59:49.338081] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-23T17:59:49.338144] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-23T17:59:49.747354] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:49.802290] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-23T17:59:50.157629] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T17:59:50.397449] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T17:59:50.602213] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-23T17:59:51.402300] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-23T17:59:51.508569] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T17:59:52.202217] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-23T17:59:52.313822] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T17:59:52.316093] [INFO ] [REMOTE ] CIMP: Full fetch complete (746 records). [2025-09-23T17:59:52.316180] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-23T17:59:52.503061] [WARN ] [VALIDATOR ] CIMP: Validation failed - insufficient historical data. Have 4 unique days, need 200 days [2025-09-23T17:59:52.503263] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:59:52.503347] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:59:52.503421] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-23T17:59:52.503532] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-23T17:59:52.503591] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-23T17:59:52.503669] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-23T17:59:52.503800] [INFO ] [MAIN ] Update Progress: 455/2372 symbols completed. CIMP took 27.7s. Estimated remaining: 4h 12m 2s. Rate: 7.6 symbols/min [2025-09-23T17:59:52.687769] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:52.764639] [DEBUG] [LOCAL ] CIVI: Loaded 52582 existing records from primary storage. [2025-09-23T17:59:52.764835] [INFO ] [MAIN ] CIVI: Loaded 52582 existing records. [2025-09-23T17:59:52.952767] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:52.953127] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-23T17:59:52.953222] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-23T17:59:52.960010] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-23T17:59:52.960130] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-23T17:59:53.007381] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-23T17:59:53.044944] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T17:59:53.359708] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:53.802373] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-23T17:59:53.807170] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:59:54.602185] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-23T17:59:54.618249] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T17:59:55.376415] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T17:59:55.402154] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-23T17:59:56.202194] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-23T17:59:56.350291] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T17:59:57.002175] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-23T17:59:57.350430] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T17:59:57.802200] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-23T17:59:58.399360] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T17:59:58.602224] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-23T17:59:58.709832] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T17:59:59.333908] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T17:59:59.402147] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-23T18:00:00.202196] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-23T18:00:00.256944] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:00:01.002204] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-23T18:00:01.105810] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T18:00:01.802237] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-23T18:00:02.519481] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T18:00:02.602202] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-23T18:00:03.402205] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-23T18:00:04.202244] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-23T18:00:05.948245] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (4.15 seconds). [2025-09-23T18:00:05.956613] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-23T18:00:06.009632] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-09-23T18:00:06.015522] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-23T18:00:06.476288] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T18:00:06.602208] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-23T18:00:06.964930] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T18:00:07.314560] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T18:00:07.402150] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-23T18:00:07.421742] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:00:07.425940] [INFO ] [REMOTE ] CIO: Full fetch complete (28992 records). [2025-09-23T18:00:07.426042] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-23T18:00:07.625720] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (4.22 seconds). [2025-09-23T18:00:07.860535] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-23T18:00:07.860660] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-23T18:00:07.861539] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-23T18:00:07.861625] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-23T18:00:07.863830] [DEBUG] [LOCAL ] CIO: Trimmed 28992 records to 20138 (keeping 200 days of data) [2025-09-23T18:00:07.981428] [DEBUG] [LOCAL ] CIO: Primary data saved (20138 records). [2025-09-23T18:00:07.981555] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-23T18:00:07.981773] [INFO ] [MAIN ] Update Progress: 456/2372 symbols completed. CIO took 25.6s. Estimated remaining: 4h 12m 26s. Rate: 7.6 symbols/min [2025-09-23T18:00:08.157688] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:08.202172] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-23T18:00:08.221933] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-23T18:00:08.222079] [INFO ] [MAIN ] CL: Loaded 53644 existing records. [2025-09-23T18:00:08.403572] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:08.403861] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-23T18:00:08.403911] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-23T18:00:08.407174] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-23T18:00:08.407238] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-23T18:00:08.796850] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:08.805172] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:00:09.002198] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-23T18:00:09.707051] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T18:00:09.789475] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T18:00:09.802157] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-23T18:00:10.602194] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-23T18:00:11.275608] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T18:00:11.279985] [INFO ] [REMOTE ] CINT: Full fetch complete (25902 records). [2025-09-23T18:00:11.280120] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-23T18:00:11.407602] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-23T18:00:11.688362] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-23T18:00:11.688497] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-23T18:00:11.705304] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-23T18:00:11.706208] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-23T18:00:11.707544] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T18:00:11.715387] [DEBUG] [LOCAL ] CINT: Trimmed 25902 records to 18366 (keeping 200 days of data) [2025-09-23T18:00:11.831301] [DEBUG] [LOCAL ] CINT: Primary data saved (18366 records). [2025-09-23T18:00:11.831454] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-23T18:00:11.831563] [INFO ] [MAIN ] Update Progress: 457/2372 symbols completed. CINT took 32.3s. Estimated remaining: 4h 12m 1s. Rate: 7.6 symbols/min [2025-09-23T18:00:12.064358] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:12.116521] [DEBUG] [LOCAL ] CLB: Loaded 33100 existing records from primary storage. [2025-09-23T18:00:12.116849] [INFO ] [MAIN ] CLB: Loaded 33100 existing records. [2025-09-23T18:00:12.210309] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-23T18:00:12.303453] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:12.303844] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-23T18:00:12.303921] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-23T18:00:12.304953] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-23T18:00:12.305017] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-23T18:00:12.674867] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:13.004354] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-23T18:00:13.007798] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T18:00:13.267280] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T18:00:13.275514] [INFO ] [REMOTE ] CION: Full fetch complete (41297 records). [2025-09-23T18:00:13.275794] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-23T18:00:13.691350] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-23T18:00:13.691456] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-23T18:00:13.692077] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-23T18:00:13.692144] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-23T18:00:13.694955] [DEBUG] [LOCAL ] CION: Trimmed 41297 records to 29384 (keeping 200 days of data) [2025-09-23T18:00:13.805895] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-23T18:00:13.898135] [DEBUG] [LOCAL ] CION: Primary data saved (29384 records). [2025-09-23T18:00:13.898289] [INFO ] [MAIN ] CION: Full history saved. [2025-09-23T18:00:13.898405] [INFO ] [MAIN ] Update Progress: 458/2372 symbols completed. CION took 25.0s. Estimated remaining: 4h 11m 29s. Rate: 7.6 symbols/min [2025-09-23T18:00:14.081052] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:14.097019] [DEBUG] [LOCAL ] CLCO: Loaded 12942 existing records from primary storage. [2025-09-23T18:00:14.097154] [INFO ] [MAIN ] CLCO: Loaded 12942 existing records. [2025-09-23T18:00:14.302955] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:14.303284] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-23T18:00:14.303341] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-23T18:00:14.303806] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-23T18:00:14.303869] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-23T18:00:14.607361] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-23T18:00:14.704398] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:15.240909] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T18:00:15.402198] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-23T18:00:15.540456] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-23T18:00:16.058440] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:00:16.202214] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-23T18:00:16.298039] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T18:00:17.002248] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-23T18:00:17.743777] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T18:00:17.802271] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-23T18:00:17.943527] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T18:00:18.602252] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-23T18:00:19.234127] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T18:00:19.402200] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-23T18:00:20.202164] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-23T18:00:20.297427] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:00:20.439148] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T18:00:20.913730] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T18:00:21.002232] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-23T18:00:21.802196] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-23T18:00:22.090974] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T18:00:22.602232] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-23T18:00:23.402165] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-23T18:00:23.611030] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:00:24.144481] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T18:00:24.202255] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-23T18:00:24.256114] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T18:00:25.002237] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-23T18:00:25.345779] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T18:00:25.802200] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-23T18:00:26.602166] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-23T18:00:26.661890] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:00:26.767906] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T18:00:27.402198] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-23T18:00:28.019233] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:00:28.202226] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-23T18:00:28.984866] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T18:00:29.002156] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-23T18:00:29.318319] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:00:29.635751] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T18:00:29.802191] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-23T18:00:30.602199] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-23T18:00:30.681016] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T18:00:31.402227] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-23T18:00:31.987574] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T18:00:32.209901] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-23T18:00:32.229919] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:00:33.002196] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-23T18:00:33.700908] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T18:00:33.802197] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-23T18:00:34.385687] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:00:34.394412] [INFO ] [REMOTE ] CIVI: Full fetch complete (75518 records). [2025-09-23T18:00:34.394567] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-23T18:00:34.607698] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-23T18:00:34.789736] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-23T18:00:34.789840] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-23T18:00:34.790776] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-23T18:00:34.790844] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-23T18:00:34.792376] [DEBUG] [LOCAL ] CIVI: Trimmed 75518 records to 52583 (keeping 200 days of data) [2025-09-23T18:00:35.122823] [DEBUG] [LOCAL ] CIVI: Primary data saved (52583 records). [2025-09-23T18:00:35.122969] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-23T18:00:35.123055] [INFO ] [MAIN ] Update Progress: 459/2372 symbols completed. CIVI took 42.6s. Estimated remaining: 4h 12m 17s. Rate: 7.6 symbols/min [2025-09-23T18:00:35.297226] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:35.305402] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T18:00:35.331493] [DEBUG] [LOCAL ] CLDT: Loaded 25898 existing records from primary storage. [2025-09-23T18:00:35.331668] [INFO ] [MAIN ] CLDT: Loaded 25898 existing records. [2025-09-23T18:00:35.404802] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-23T18:00:35.522041] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:35.522299] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-23T18:00:35.522351] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-23T18:00:35.523082] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-23T18:00:35.523146] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-23T18:00:35.887623] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:35.921872] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-23T18:00:35.952374] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T18:00:36.202202] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-23T18:00:37.002193] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-23T18:00:37.802154] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-23T18:00:38.048290] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T18:00:38.077232] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T18:00:38.504817] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:00:38.506790] [INFO ] [REMOTE ] CLCO: Full fetch complete (23029 records). [2025-09-23T18:00:38.506889] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-23T18:00:38.607258] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-23T18:00:38.924073] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-23T18:00:38.924160] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-23T18:00:38.924600] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-23T18:00:38.924704] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-23T18:00:38.925768] [DEBUG] [LOCAL ] CLCO: Trimmed 23029 records to 12763 (keeping 200 days of data) [2025-09-23T18:00:39.001588] [DEBUG] [LOCAL ] CLCO: Primary data saved (12763 records). [2025-09-23T18:00:39.001790] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-23T18:00:39.001941] [INFO ] [MAIN ] Update Progress: 460/2372 symbols completed. CLCO took 25.1s. Estimated remaining: 4h 11m 52s. Rate: 7.6 symbols/min [2025-09-23T18:00:39.196522] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:39.249991] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-23T18:00:39.250147] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-09-23T18:00:39.409978] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-23T18:00:39.435322] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:39.435565] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-23T18:00:39.435622] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-23T18:00:39.437041] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-23T18:00:39.437104] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-23T18:00:39.829160] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:39.850138] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T18:00:40.202206] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-23T18:00:40.333857] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T18:00:41.002263] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-23T18:00:41.773774] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T18:00:41.802144] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-23T18:00:42.350830] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-23T18:00:42.569289] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:00:42.602176] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-23T18:00:43.402156] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-23T18:00:43.445048] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T18:00:44.202223] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-23T18:00:44.912206] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:00:45.002147] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-23T18:00:45.622269] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:00:45.802238] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-23T18:00:46.602214] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-23T18:00:47.057693] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T18:00:47.067202] [INFO ] [REMOTE ] CLB: Full fetch complete (46333 records). [2025-09-23T18:00:47.067411] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-23T18:00:47.408740] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-23T18:00:47.453403] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-23T18:00:47.453496] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-23T18:00:47.454138] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-23T18:00:47.454202] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-23T18:00:47.455282] [DEBUG] [LOCAL ] CLB: Trimmed 46333 records to 33098 (keeping 200 days of data) [2025-09-23T18:00:47.677820] [DEBUG] [LOCAL ] CLB: Primary data saved (33098 records). [2025-09-23T18:00:47.677988] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-23T18:00:47.678085] [INFO ] [MAIN ] Update Progress: 461/2372 symbols completed. CLB took 35.8s. Estimated remaining: 4h 11m 47s. Rate: 7.6 symbols/min [2025-09-23T18:00:47.847407] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:47.875957] [DEBUG] [LOCAL ] CLH: Loaded 28259 existing records from primary storage. [2025-09-23T18:00:47.876095] [INFO ] [MAIN ] CLH: Loaded 28259 existing records. [2025-09-23T18:00:48.059535] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:48.059837] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-23T18:00:48.059889] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-23T18:00:48.060742] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-23T18:00:48.060804] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-23T18:00:48.453524] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:48.459727] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-23T18:00:48.474934] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-23T18:00:49.002192] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-23T18:00:49.503017] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T18:00:49.578371] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-23T18:00:49.587135] [INFO ] [REMOTE ] CL: Full fetch complete (77226 records). [2025-09-23T18:00:49.587310] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-23T18:00:49.588474] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:00:49.588578] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:00:49.588666] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:00:49.588744] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-23T18:00:49.588812] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-09-23T18:00:49.588850] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-09-23T18:00:49.589353] [DEBUG] [LOCAL ] CL: Deleted derivative data file. [2025-09-23T18:00:49.589464] [INFO ] [MAIN ] Update Progress: 462/2372 symbols completed. CL took 41.6s. Estimated remaining: 4h 11m 15s. Rate: 7.6 symbols/min [2025-09-23T18:00:49.776514] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:49.789335] [DEBUG] [LOCAL ] CLPR: Loaded 11586 existing records from primary storage. [2025-09-23T18:00:49.789472] [INFO ] [MAIN ] CLPR: Loaded 11586 existing records. [2025-09-23T18:00:49.819889] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-23T18:00:50.006929] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (3.40 seconds). [2025-09-23T18:00:50.035461] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T18:00:50.041510] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:50.050011] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-23T18:00:50.050478] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-23T18:00:50.051001] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-23T18:00:50.051062] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-23T18:00:50.412080] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:50.602258] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-23T18:00:50.850776] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T18:00:51.394071] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:00:51.402133] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-23T18:00:52.202155] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-23T18:00:52.281371] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T18:00:53.002187] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-23T18:00:53.304679] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T18:00:53.493044] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:00:53.802198] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-23T18:00:54.602226] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-23T18:00:55.298509] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:00:55.369949] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T18:00:55.402154] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-23T18:00:56.202177] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-23T18:00:56.414607] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T18:00:57.002216] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-23T18:00:57.802180] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-23T18:00:57.891226] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T18:00:57.952174] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T18:00:58.602203] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-23T18:00:59.402194] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-23T18:00:59.620938] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T18:00:59.972841] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T18:01:00.202186] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-23T18:01:01.002192] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-23T18:01:01.707741] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:01:01.802206] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-23T18:01:01.978619] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-23T18:01:02.004571] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:01:02.602194] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-23T18:01:03.260202] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T18:01:03.402199] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-23T18:01:04.202205] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-23T18:01:04.443530] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T18:01:04.603673] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T18:01:04.608063] [INFO ] [REMOTE ] CLDT: Full fetch complete (37061 records). [2025-09-23T18:01:04.608176] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-23T18:01:04.911961] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T18:01:05.001814] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-23T18:01:05.001899] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-23T18:01:05.002405] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-23T18:01:05.002476] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-23T18:01:05.003451] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-23T18:01:05.004404] [DEBUG] [LOCAL ] CLDT: Trimmed 37061 records to 25815 (keeping 200 days of data) [2025-09-23T18:01:05.152739] [DEBUG] [LOCAL ] CLDT: Primary data saved (25815 records). [2025-09-23T18:01:05.152881] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-23T18:01:05.152968] [INFO ] [MAIN ] Update Progress: 463/2372 symbols completed. CLDT took 30.0s. Estimated remaining: 4h 11m 39s. Rate: 7.6 symbols/min [2025-09-23T18:01:05.334308] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:05.334539] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-09-23T18:01:05.334590] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-09-23T18:01:05.334803] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-23T18:01:05.334862] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-23T18:01:05.334920] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-09-23T18:01:05.334965] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-23T18:01:05.693213] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:05.802184] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-23T18:01:06.602197] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-23T18:01:07.198188] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-23T18:01:07.385008] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T18:01:07.402204] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-23T18:01:07.507624] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T18:01:08.202196] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-23T18:01:09.002203] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-23T18:01:09.174839] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T18:01:09.802265] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-23T18:01:10.104782] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T18:01:10.138785] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T18:01:10.602260] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-23T18:01:11.402254] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-23T18:01:11.727864] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T18:01:11.989083] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T18:01:12.202215] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-23T18:01:12.677386] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-23T18:01:13.002243] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-23T18:01:13.802267] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-23T18:01:13.896301] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T18:01:13.997064] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T18:01:14.427416] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T18:01:14.429201] [INFO ] [REMOTE ] CLPR: Full fetch complete (17717 records). [2025-09-23T18:01:14.429298] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-23T18:01:14.611412] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-23T18:01:14.817813] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-23T18:01:14.817905] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-23T18:01:14.818257] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-23T18:01:14.818297] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-23T18:01:14.818903] [DEBUG] [LOCAL ] CLPR: Trimmed 17717 records to 11559 (keeping 200 days of data) [2025-09-23T18:01:14.886425] [DEBUG] [LOCAL ] CLPR: Primary data saved (11559 records). [2025-09-23T18:01:14.886578] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-23T18:01:14.886691] [INFO ] [MAIN ] Update Progress: 464/2372 symbols completed. CLPR took 25.3s. Estimated remaining: 4h 11m 38s. Rate: 7.6 symbols/min [2025-09-23T18:01:15.057165] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:15.057323] [DEBUG] [LOCAL ] CLVT: No existing data file found in primary storage. [2025-09-23T18:01:15.057360] [WARN ] [MAIN ] CLVT: No existing data found, performing full refresh instead. [2025-09-23T18:01:15.057515] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-23T18:01:15.057557] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-23T18:01:15.057599] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-09-23T18:01:15.057662] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-23T18:01:15.409222] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:15.405563] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-23T18:01:16.202214] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-23T18:01:16.830343] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-23T18:01:16.840791] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-09-23T18:01:16.841019] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-23T18:01:17.002507] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-23T18:01:17.252885] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-23T18:01:17.253009] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-23T18:01:17.254163] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-23T18:01:17.254259] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-23T18:01:17.256558] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-09-23T18:01:17.515732] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T18:01:17.632990] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-09-23T18:01:17.633167] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-23T18:01:17.633263] [INFO ] [MAIN ] Update Progress: 465/2372 symbols completed. CLF took 38.6s. Estimated remaining: 4h 11m 9s. Rate: 7.6 symbols/min [2025-09-23T18:01:17.734756] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T18:01:17.807390] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-23T18:01:17.857945] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:17.883884] [DEBUG] [LOCAL ] CLW: Loaded 21949 existing records from primary storage. [2025-09-23T18:01:17.884043] [INFO ] [MAIN ] CLW: Loaded 21949 existing records. [2025-09-23T18:01:18.067261] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:18.067522] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-23T18:01:18.067570] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-23T18:01:18.068274] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-23T18:01:18.068336] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-23T18:01:18.450839] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:18.463111] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T18:01:18.467392] [INFO ] [REMOTE ] CLH: Full fetch complete (41649 records). [2025-09-23T18:01:18.467490] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-23T18:01:18.468300] [FATAL] [VALIDATOR ] CLH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:01:18.468389] [FATAL] [MAIN ] CLH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:01:18.468431] [WARN ] [MAIN ] CLH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:01:18.468494] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-23T18:01:18.468559] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-23T18:01:18.468596] [INFO ] [LOCAL ] CLH: Starting deletion of derivative data. [2025-09-23T18:01:18.469063] [DEBUG] [LOCAL ] CLH: Deleted derivative data file. [2025-09-23T18:01:18.469162] [INFO ] [MAIN ] Update Progress: 466/2372 symbols completed. CLH took 30.8s. Estimated remaining: 4h 10m 32s. Rate: 7.6 symbols/min [2025-09-23T18:01:18.609204] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-23T18:01:18.646055] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:18.704930] [DEBUG] [LOCAL ] CLX: Loaded 51429 existing records from primary storage. [2025-09-23T18:01:18.705187] [INFO ] [MAIN ] CLX: Loaded 51429 existing records. [2025-09-23T18:01:18.892833] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:18.893086] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-23T18:01:18.893136] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-23T18:01:18.894706] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-23T18:01:18.894771] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-23T18:01:19.258482] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:19.402198] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-23T18:01:19.951637] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-23T18:01:20.202236] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-23T18:01:20.317144] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T18:01:20.697323] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T18:01:21.002217] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-23T18:01:21.493340] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T18:01:21.802276] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-23T18:01:22.360567] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:01:22.602269] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-23T18:01:23.192808] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T18:01:23.402231] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-23T18:01:24.203728] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-23T18:01:24.215475] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:01:25.002191] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-23T18:01:25.324259] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T18:01:25.600953] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T18:01:25.802217] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-23T18:01:26.602168] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-23T18:01:26.708264] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T18:01:27.402165] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-23T18:01:27.506960] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:01:27.546096] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T18:01:28.202191] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-23T18:01:28.754845] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T18:01:29.002207] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-23T18:01:29.802214] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-23T18:01:30.602224] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-23T18:01:30.689500] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-23T18:01:30.718578] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T18:01:30.771102] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T18:01:31.402200] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-23T18:01:31.979934] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T18:01:32.202226] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-23T18:01:32.532781] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T18:01:33.002273] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-23T18:01:33.693792] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T18:01:33.802161] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-23T18:01:34.602162] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-23T18:01:34.719279] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T18:01:35.329344] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T18:01:35.402156] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-23T18:01:35.888734] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-23T18:01:36.125820] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T18:01:36.202162] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-23T18:01:37.002213] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-23T18:01:37.762965] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:01:37.802152] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-23T18:01:38.602189] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-23T18:01:39.208540] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-23T18:01:39.218879] [INFO ] [REMOTE ] CLS: Full fetch complete (77449 records). [2025-09-23T18:01:39.219150] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-23T18:01:39.414504] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-23T18:01:39.645569] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-23T18:01:39.645787] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-23T18:01:39.646820] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-23T18:01:39.646959] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-23T18:01:39.648520] [DEBUG] [LOCAL ] CLS: Trimmed 77449 records to 53638 (keeping 200 days of data) [2025-09-23T18:01:39.775440] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T18:01:40.016356] [DEBUG] [LOCAL ] CLS: Primary data saved (53638 records). [2025-09-23T18:01:40.016523] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-23T18:01:40.016605] [INFO ] [MAIN ] Update Progress: 467/2372 symbols completed. CLS took 34.9s. Estimated remaining: 4h 11m 20s. Rate: 7.6 symbols/min [2025-09-23T18:01:40.185869] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:40.186039] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-09-23T18:01:40.186078] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-09-23T18:01:40.186220] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-23T18:01:40.186263] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-23T18:01:40.186305] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-23T18:01:40.186338] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-23T18:01:40.207964] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-23T18:01:40.476248] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:01:40.590012] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:40.620558] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:01:41.002190] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-23T18:01:41.802209] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-23T18:01:42.295746] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T18:01:42.453083] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-23T18:01:42.463350] [INFO ] [REMOTE ] CLX: Full fetch complete (72474 records). [2025-09-23T18:01:42.463550] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-23T18:01:42.464613] [FATAL] [VALIDATOR ] CLX: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:01:42.464838] [FATAL] [MAIN ] CLX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:01:42.464907] [WARN ] [MAIN ] CLX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:01:42.464976] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-23T18:01:42.465059] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-09-23T18:01:42.465136] [INFO ] [LOCAL ] CLX: Starting deletion of derivative data. [2025-09-23T18:01:42.465571] [DEBUG] [LOCAL ] CLX: Deleted derivative data file. [2025-09-23T18:01:42.465732] [INFO ] [MAIN ] Update Progress: 468/2372 symbols completed. CLX took 24.0s. Estimated remaining: 4h 10m 50s. Rate: 7.6 symbols/min [2025-09-23T18:01:42.608604] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-23T18:01:42.643465] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:42.693988] [DEBUG] [LOCAL ] CMA: Loaded 50210 existing records from primary storage. [2025-09-23T18:01:42.694147] [INFO ] [MAIN ] CMA: Loaded 50210 existing records. [2025-09-23T18:01:42.886749] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:42.886989] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-23T18:01:42.887037] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-23T18:01:42.888400] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-23T18:01:42.888462] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-23T18:01:43.266783] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:43.402254] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-23T18:01:43.542066] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T18:01:44.202169] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-23T18:01:44.425345] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T18:01:45.002167] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-23T18:01:45.071533] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:01:45.585245] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:01:45.802209] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-23T18:01:46.201727] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:01:46.566366] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T18:01:46.570633] [INFO ] [REMOTE ] CLW: Full fetch complete (35187 records). [2025-09-23T18:01:46.570821] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-23T18:01:46.607286] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-23T18:01:46.956538] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-23T18:01:46.956619] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-23T18:01:46.957168] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-23T18:01:46.957224] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-23T18:01:46.958070] [DEBUG] [LOCAL ] CLW: Trimmed 35187 records to 21956 (keeping 200 days of data) [2025-09-23T18:01:47.102194] [DEBUG] [LOCAL ] CLW: Primary data saved (21956 records). [2025-09-23T18:01:47.102361] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-23T18:01:47.102465] [INFO ] [MAIN ] Update Progress: 469/2372 symbols completed. CLW took 29.4s. Estimated remaining: 4h 10m 29s. Rate: 7.6 symbols/min [2025-09-23T18:01:47.275415] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:47.297229] [DEBUG] [LOCAL ] CMBT: Loaded 21739 existing records from primary storage. [2025-09-23T18:01:47.297415] [INFO ] [MAIN ] CMBT: Loaded 21739 existing records. [2025-09-23T18:01:47.407336] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-23T18:01:47.494248] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:47.494520] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-23T18:01:47.494570] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-23T18:01:47.495293] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-23T18:01:47.495357] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-23T18:01:47.861739] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:48.095582] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T18:01:48.202200] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-23T18:01:49.002213] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-23T18:01:49.079174] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:01:49.627748] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T18:01:49.802187] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-23T18:01:50.245238] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:01:50.602214] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-23T18:01:51.020974] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T18:01:51.402239] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-23T18:01:51.495755] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T18:01:52.202261] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-23T18:01:52.733620] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:01:53.002259] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-23T18:01:53.648330] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T18:01:53.802155] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-23T18:01:53.987874] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T18:01:54.602281] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-23T18:01:55.184444] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T18:01:55.402218] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-23T18:01:56.067165] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T18:01:56.076690] [INFO ] [REMOTE ] CLVT: Full fetch complete (75232 records). [2025-09-23T18:01:56.077018] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-23T18:01:56.216993] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-23T18:01:56.485725] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-23T18:01:56.485817] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-23T18:01:56.486611] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-23T18:01:56.486684] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-23T18:01:56.491742] [DEBUG] [LOCAL ] CLVT: Trimmed 75232 records to 51969 (keeping 200 days of data) [2025-09-23T18:01:56.801599] [DEBUG] [LOCAL ] CLVT: Primary data saved (51969 records). [2025-09-23T18:01:56.801974] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-23T18:01:56.802066] [INFO ] [MAIN ] Update Progress: 470/2372 symbols completed. CLVT took 41.9s. Estimated remaining: 4h 10m 28s. Rate: 7.6 symbols/min [2025-09-23T18:01:56.984576] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:57.009195] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-23T18:01:57.015363] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T18:01:57.073924] [DEBUG] [LOCAL ] CMC: Loaded 45757 existing records from primary storage. [2025-09-23T18:01:57.074125] [INFO ] [MAIN ] CMC: Loaded 45757 existing records. [2025-09-23T18:01:57.281333] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T18:01:57.309631] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:57.310337] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-23T18:01:57.310392] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-23T18:01:57.312593] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-23T18:01:57.312683] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-23T18:01:57.692426] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:57.802252] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-23T18:01:58.602188] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-23T18:01:58.676916] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T18:01:59.289810] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:01:59.319360] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:01:59.402206] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-23T18:02:00.202200] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-23T18:02:00.488185] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T18:02:01.002196] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-23T18:02:01.801750] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T18:02:01.812311] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-23T18:02:02.312991] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T18:02:02.602250] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-23T18:02:03.117275] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:02:03.402247] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-23T18:02:04.052636] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T18:02:04.207328] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-23T18:02:04.216595] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T18:02:05.002202] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-23T18:02:05.661185] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:02:05.669881] [INFO ] [REMOTE ] CM: Full fetch complete (69421 records). [2025-09-23T18:02:05.670054] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-23T18:02:05.807307] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-23T18:02:06.117890] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-23T18:02:06.117988] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-23T18:02:06.118781] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-23T18:02:06.118846] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-23T18:02:06.120448] [DEBUG] [LOCAL ] CM: Trimmed 69421 records to 48632 (keeping 200 days of data) [2025-09-23T18:02:06.372114] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:02:06.472507] [DEBUG] [LOCAL ] CM: Primary data saved (48632 records). [2025-09-23T18:02:06.472680] [INFO ] [MAIN ] CM: Full history saved. [2025-09-23T18:02:06.472780] [INFO ] [MAIN ] Update Progress: 471/2372 symbols completed. CM took 26.5s. Estimated remaining: 4h 10m 27s. Rate: 7.6 symbols/min [2025-09-23T18:02:06.607453] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-23T18:02:06.677986] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:06.686247] [DEBUG] [LOCAL ] CMCM: Loaded 4698 existing records from primary storage. [2025-09-23T18:02:06.686354] [INFO ] [MAIN ] CMCM: Loaded 4698 existing records. [2025-09-23T18:02:06.876153] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:02:06.876430] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-23T18:02:06.876480] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-23T18:02:06.876881] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-23T18:02:06.876945] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-23T18:02:07.295006] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:07.316804] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T18:02:07.363954] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:02:07.402190] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-23T18:02:08.202244] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-23T18:02:09.002231] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-23T18:02:09.385241] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T18:02:09.615550] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T18:02:09.649781] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T18:02:09.802310] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-23T18:02:10.602203] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-23T18:02:11.169088] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T18:02:11.402198] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-23T18:02:11.654019] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:02:12.094766] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T18:02:12.202237] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-23T18:02:13.002404] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-23T18:02:13.512749] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T18:02:13.634545] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T18:02:13.802236] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-23T18:02:14.602233] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-23T18:02:15.362228] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T18:02:15.373979] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:02:15.402190] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-23T18:02:16.202414] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-23T18:02:16.559193] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T18:02:16.814017] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:02:16.822296] [INFO ] [REMOTE ] CMBT: Full fetch complete (28706 records). [2025-09-23T18:02:16.822677] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-23T18:02:16.823667] [FATAL] [VALIDATOR ] CMBT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:02:16.823783] [FATAL] [MAIN ] CMBT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:02:16.823866] [WARN ] [MAIN ] CMBT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:02:16.823976] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-23T18:02:16.824121] [DEBUG] [LOCAL ] CMBT: No primary data file found to delete. [2025-09-23T18:02:16.824203] [INFO ] [LOCAL ] CMBT: Starting deletion of derivative data. [2025-09-23T18:02:16.824882] [DEBUG] [LOCAL ] CMBT: Deleted derivative data file. [2025-09-23T18:02:16.825143] [INFO ] [MAIN ] Update Progress: 472/2372 symbols completed. CMBT took 29.7s. Estimated remaining: 4h 10m 29s. Rate: 7.6 symbols/min [2025-09-23T18:02:17.000667] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:17.000878] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-23T18:02:17.000932] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-23T18:02:17.001078] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-23T18:02:17.001132] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-23T18:02:17.001233] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-23T18:02:17.001296] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-23T18:02:17.007437] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-23T18:02:17.398624] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:17.429883] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T18:02:17.802225] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-23T18:02:18.039175] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:18.039752] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-23T18:02:18.602262] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-23T18:02:19.261091] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T18:02:19.402266] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-23T18:02:20.202220] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-23T18:02:20.820330] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:02:21.002207] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-23T18:02:21.612625] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T18:02:21.802240] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-23T18:02:22.028952] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:22.029357] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-23T18:02:22.233943] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T18:02:22.602202] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-23T18:02:23.402245] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-23T18:02:23.600628] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:23.601360] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-23T18:02:24.098597] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T18:02:24.202219] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-23T18:02:25.002252] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-23T18:02:25.452787] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:02:25.465948] [INFO ] [REMOTE ] CMC: Full fetch complete (66885 records). [2025-09-23T18:02:25.466279] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-23T18:02:25.808463] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-23T18:02:25.878005] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T18:02:25.988487] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-23T18:02:25.988591] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-23T18:02:25.989466] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-23T18:02:25.989605] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-23T18:02:25.995786] [DEBUG] [LOCAL ] CMC: Trimmed 66885 records to 45728 (keeping 200 days of data) [2025-09-23T18:02:26.070066] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:26.112477] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-23T18:02:26.328680] [DEBUG] [LOCAL ] CMC: Primary data saved (45728 records). [2025-09-23T18:02:26.328844] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-23T18:02:26.328983] [INFO ] [MAIN ] Update Progress: 473/2372 symbols completed. CMC took 29.5s. Estimated remaining: 4h 10m 28s. Rate: 7.6 symbols/min [2025-09-23T18:02:26.608776] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-23T18:02:26.612740] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:26.614408] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-09-23T18:02:26.614472] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-09-23T18:02:26.614639] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-23T18:02:26.614726] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-23T18:02:26.614777] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-23T18:02:26.614813] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-23T18:02:27.008032] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:27.402262] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-23T18:02:28.062370] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:02:28.074165] [INFO ] [REMOTE ] CMA: Full fetch complete (73321 records). [2025-09-23T18:02:28.074578] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-23T18:02:28.207404] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-23T18:02:28.470378] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:28.497884] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-23T18:02:28.544490] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-23T18:02:28.544805] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-23T18:02:28.546068] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-23T18:02:28.546139] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-23T18:02:28.548560] [DEBUG] [LOCAL ] CMA: Trimmed 73321 records to 50140 (keeping 200 days of data) [2025-09-23T18:02:28.890015] [DEBUG] [LOCAL ] CMA: Primary data saved (50140 records). [2025-09-23T18:02:28.890171] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-23T18:02:28.890283] [INFO ] [MAIN ] Update Progress: 474/2372 symbols completed. CMA took 46.4s. Estimated remaining: 4h 9m 58s. Rate: 7.6 symbols/min [2025-09-23T18:02:29.007384] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-23T18:02:29.066152] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:29.066357] [DEBUG] [LOCAL ] CMI: No existing data file found in primary storage. [2025-09-23T18:02:29.066432] [WARN ] [MAIN ] CMI: No existing data found, performing full refresh instead. [2025-09-23T18:02:29.066692] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-23T18:02:29.066751] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-23T18:02:29.066798] [DEBUG] [LOCAL ] CMI: No primary data file found to delete. [2025-09-23T18:02:29.066836] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-23T18:02:29.467832] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:29.494758] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T18:02:29.589047] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T18:02:29.802262] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-23T18:02:30.602228] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-23T18:02:31.078738] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T18:02:31.241682] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:02:31.243901] [INFO ] [REMOTE ] CMCM: Full fetch complete (7051 records). [2025-09-23T18:02:31.243979] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-23T18:02:31.411366] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-23T18:02:31.632246] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-23T18:02:31.632342] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-23T18:02:31.632546] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-23T18:02:31.632588] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-23T18:02:31.633139] [DEBUG] [LOCAL ] CMCM: Trimmed 7051 records to 4730 (keeping 200 days of data) [2025-09-23T18:02:31.662049] [DEBUG] [LOCAL ] CMCM: Primary data saved (4730 records). [2025-09-23T18:02:31.662187] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-23T18:02:31.662278] [INFO ] [MAIN ] Update Progress: 475/2372 symbols completed. CMCM took 25.2s. Estimated remaining: 4h 9m 30s. Rate: 7.6 symbols/min [2025-09-23T18:02:31.845343] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:31.845550] [DEBUG] [LOCAL ] CMP: No existing data file found in primary storage. [2025-09-23T18:02:31.845588] [WARN ] [MAIN ] CMP: No existing data found, performing full refresh instead. [2025-09-23T18:02:31.845821] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-23T18:02:31.845869] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-23T18:02:31.845914] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-23T18:02:31.845948] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-23T18:02:32.209472] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-23T18:02:32.215341] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:32.562419] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T18:02:33.002220] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-23T18:02:33.802211] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-23T18:02:33.985318] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T18:02:34.503076] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:02:34.540637] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T18:02:34.602232] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-23T18:02:35.402179] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-23T18:02:35.565452] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T18:02:36.202244] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-23T18:02:36.573567] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T18:02:36.733135] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T18:02:37.002236] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-23T18:02:37.669997] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:02:37.672627] [INFO ] [REMOTE ] CMDB: Full fetch complete (10699 records). [2025-09-23T18:02:37.672732] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-23T18:02:37.812208] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-23T18:02:37.856494] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 96 unique days, need 200 days [2025-09-23T18:02:37.856845] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:02:37.856930] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:02:37.857017] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-23T18:02:37.857127] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-23T18:02:37.857203] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-23T18:02:37.857297] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-23T18:02:37.857406] [INFO ] [MAIN ] Update Progress: 476/2372 symbols completed. CMDB took 21.0s. Estimated remaining: 4h 9m 15s. Rate: 7.6 symbols/min [2025-09-23T18:02:38.034458] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:38.034775] [DEBUG] [LOCAL ] CMPO: No existing data file found in primary storage. [2025-09-23T18:02:38.034833] [WARN ] [MAIN ] CMPO: No existing data found, performing full refresh instead. [2025-09-23T18:02:38.035013] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-23T18:02:38.035078] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-23T18:02:38.035178] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-09-23T18:02:38.035257] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-23T18:02:38.398117] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:38.602208] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-23T18:02:39.402239] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-23T18:02:39.771756] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T18:02:39.814063] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-23T18:02:40.202206] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-23T18:02:40.511177] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T18:02:41.002238] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-23T18:02:41.811544] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-23T18:02:41.829008] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T18:02:42.602272] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-23T18:02:42.745068] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:02:42.812779] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:02:43.402232] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-23T18:02:44.074376] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T18:02:44.202206] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-23T18:02:45.002232] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-23T18:02:45.516434] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:02:45.762756] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-23T18:02:45.802205] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-23T18:02:46.051458] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T18:02:46.602198] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-23T18:02:47.418020] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-23T18:02:47.446759] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T18:02:47.660867] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T18:02:48.202207] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-23T18:02:48.428300] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T18:02:49.002366] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-23T18:02:49.802210] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-23T18:02:50.097418] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T18:02:50.327185] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:02:50.602191] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-23T18:02:51.389523] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T18:02:51.402147] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-23T18:02:51.637829] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:02:52.202189] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-23T18:02:52.735576] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:02:53.002204] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-23T18:02:53.309243] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T18:02:53.802192] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-23T18:02:54.240705] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T18:02:54.602212] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-23T18:02:55.342801] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:02:55.402285] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-23T18:02:56.202222] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-23T18:02:56.937157] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T18:02:57.002198] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-23T18:02:57.240142] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-23T18:02:57.320451] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T18:02:57.802226] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-23T18:02:58.602267] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-23T18:02:58.658278] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T18:02:59.402214] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-23T18:02:59.762096] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T18:02:59.951072] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T18:03:00.202209] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-23T18:03:00.383625] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:03:01.002200] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-23T18:03:01.802161] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-23T18:03:01.830685] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:03:02.602195] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-23T18:03:03.238878] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-23T18:03:03.402218] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-23T18:03:04.202243] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-23T18:03:04.633818] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T18:03:04.640467] [INFO ] [REMOTE ] CMPO: Full fetch complete (58654 records). [2025-09-23T18:03:04.640697] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-23T18:03:04.641871] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:03:04.642183] [FATAL] [MAIN ] CMPO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:03:04.642259] [WARN ] [MAIN ] CMPO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:03:04.642338] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-23T18:03:04.642409] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-09-23T18:03:04.642447] [INFO ] [LOCAL ] CMPO: Starting deletion of derivative data. [2025-09-23T18:03:04.642547] [DEBUG] [LOCAL ] CMPO: No derivative data file found to delete. [2025-09-23T18:03:04.642634] [INFO ] [MAIN ] Update Progress: 477/2372 symbols completed. CMPO took 26.8s. Estimated remaining: 4h 10m 23s. Rate: 7.6 symbols/min [2025-09-23T18:03:05.043751] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T18:03:05.051792] [INFO ] [REMOTE ] CMP: Full fetch complete (52958 records). [2025-09-23T18:03:05.052102] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-23T18:03:05.053342] [FATAL] [VALIDATOR ] CMP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:03:05.053442] [FATAL] [MAIN ] CMP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:03:05.053490] [WARN ] [MAIN ] CMP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:03:05.053533] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-23T18:03:05.053599] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-23T18:03:05.053637] [INFO ] [LOCAL ] CMP: Starting deletion of derivative data. [2025-09-23T18:03:05.053732] [DEBUG] [LOCAL ] CMP: No derivative data file found to delete. [2025-09-23T18:03:05.053851] [INFO ] [MAIN ] Update Progress: 478/2372 symbols completed. CMP took 33.4s. Estimated remaining: 4h 9m 45s. Rate: 7.6 symbols/min [2025-09-23T18:03:05.600914] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.80 seconds). [2025-09-23T18:03:05.609798] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-09-23T18:03:05.609921] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-23T18:03:06.041163] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-23T18:03:06.041328] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-23T18:03:06.042207] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-23T18:03:06.042298] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-23T18:03:06.068282] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T18:03:06.076898] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53720 (keeping 200 days of data) [2025-09-23T18:03:06.078558] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-23T18:03:06.418332] [DEBUG] [LOCAL ] CMG: Primary data saved (53720 records). [2025-09-23T18:03:06.418502] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-23T18:03:06.418591] [INFO ] [MAIN ] Update Progress: 479/2372 symbols completed. CMG took 40.1s. Estimated remaining: 4h 9m 11s. Rate: 7.6 symbols/min [2025-09-23T18:03:07.467459] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T18:03:07.474746] [INFO ] [REMOTE ] CMI: Full fetch complete (59862 records). [2025-09-23T18:03:07.474854] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-23T18:03:07.879846] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-23T18:03:07.879952] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-23T18:03:07.880795] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-23T18:03:07.880866] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-23T18:03:07.882288] [DEBUG] [LOCAL ] CMI: Trimmed 59862 records to 41900 (keeping 200 days of data) [2025-09-23T18:03:08.157936] [DEBUG] [LOCAL ] CMI: Primary data saved (41900 records). [2025-09-23T18:03:08.158088] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-23T18:03:08.158182] [INFO ] [MAIN ] Update Progress: 480/2372 symbols completed. CMI took 39.3s. Estimated remaining: 4h 8m 39s. Rate: 7.6 symbols/min [2025-09-23T18:03:08.841614] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:08.924140] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:08.993457] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:09.027524] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:09.032774] [DEBUG] [LOCAL ] CMSC: Loaded 5089 existing records from primary storage. [2025-09-23T18:03:09.033031] [INFO ] [MAIN ] CMSC: Loaded 5089 existing records. [2025-09-23T18:03:09.078947] [DEBUG] [LOCAL ] CMSA: Loaded 3375 existing records from primary storage. [2025-09-23T18:03:09.103033] [INFO ] [MAIN ] CMSA: Loaded 3375 existing records. [2025-09-23T18:03:09.375700] [DEBUG] [LOCAL ] CMRE: Loaded 35472 existing records from primary storage. [2025-09-23T18:03:09.392124] [INFO ] [MAIN ] CMRE: Loaded 35472 existing records. [2025-09-23T18:03:09.523976] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:09.567182] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:09.597486] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-23T18:03:09.603664] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-23T18:03:09.609007] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-23T18:03:09.620006] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-23T18:03:09.630772] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-23T18:03:09.636924] [DEBUG] [LOCAL ] CMS: Loaded 52636 existing records from primary storage. [2025-09-23T18:03:09.636119] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-23T18:03:09.637132] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-23T18:03:09.647505] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-23T18:03:09.716798] [INFO ] [MAIN ] CMS: Loaded 52636 existing records. [2025-09-23T18:03:09.790525] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:09.851023] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-23T18:03:09.940486] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-23T18:03:10.028518] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-23T18:03:10.081846] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-23T18:03:10.374888] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:10.541311] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-23T18:03:10.592227] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-23T18:03:10.768852] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-23T18:03:10.854577] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-23T18:03:11.072349] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:11.145043] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-23T18:03:11.183236] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:11.234720] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-23T18:03:11.300392] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:11.306283] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-23T18:03:11.571233] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:11.571789] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-23T18:03:11.627490] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T18:03:11.629233] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-23T18:03:11.857101] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:03:11.858931] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-23T18:03:11.984130] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-23T18:03:11.985974] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-23T18:03:12.333182] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T18:03:12.338869] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-23T18:03:12.454038] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T18:03:12.456769] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-23T18:03:12.523742] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T18:03:12.927699] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T18:03:13.002185] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-23T18:03:13.191475] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:03:13.270985] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:03:13.312894] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T18:03:13.802241] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-23T18:03:14.567161] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T18:03:14.602201] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-23T18:03:15.025776] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T18:03:15.402234] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-23T18:03:16.202183] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-23T18:03:16.867309] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T18:03:17.002235] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-23T18:03:17.084925] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:03:17.427818] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T18:03:17.802215] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-23T18:03:18.602215] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-23T18:03:19.013739] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T18:03:19.345238] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T18:03:19.402234] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-23T18:03:19.758932] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-23T18:03:20.202271] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-23T18:03:20.590554] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T18:03:21.002255] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-23T18:03:21.802260] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-23T18:03:22.443631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:03:22.602189] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-23T18:03:22.856462] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:03:23.402200] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-23T18:03:24.065697] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T18:03:24.131471] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:03:24.202169] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-23T18:03:25.002245] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-23T18:03:25.802170] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-23T18:03:25.837134] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T18:03:26.088631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T18:03:26.602258] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-23T18:03:27.392557] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T18:03:27.402149] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-23T18:03:27.710839] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T18:03:28.202198] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-23T18:03:28.880456] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T18:03:29.002209] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-23T18:03:29.029463] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:03:29.031563] [INFO ] [REMOTE ] CMSC: Full fetch complete (7172 records). [2025-09-23T18:03:29.031635] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-23T18:03:29.421456] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-23T18:03:29.421577] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-23T18:03:29.421867] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-23T18:03:29.421927] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-23T18:03:29.422611] [DEBUG] [LOCAL ] CMSC: Trimmed 7172 records to 5090 (keeping 200 days of data) [2025-09-23T18:03:29.456535] [DEBUG] [LOCAL ] CMSC: Primary data saved (5090 records). [2025-09-23T18:03:29.456679] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-23T18:03:29.456822] [INFO ] [MAIN ] Update Progress: 481/2372 symbols completed. CMSC took 21.3s. Estimated remaining: 4h 9m 24s. Rate: 7.6 symbols/min [2025-09-23T18:03:29.675247] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:29.675453] [DEBUG] [LOCAL ] CMSD: No existing data file found in primary storage. [2025-09-23T18:03:29.675491] [WARN ] [MAIN ] CMSD: No existing data found, performing full refresh instead. [2025-09-23T18:03:29.675639] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-23T18:03:29.675728] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-23T18:03:29.675820] [DEBUG] [LOCAL ] CMSD: No primary data file found to delete. [2025-09-23T18:03:29.675866] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-23T18:03:29.807282] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-23T18:03:30.044098] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:30.232503] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T18:03:30.439550] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T18:03:30.602214] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-23T18:03:31.402252] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-23T18:03:31.638958] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:03:32.202214] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-23T18:03:32.747326] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T18:03:32.773147] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T18:03:33.002241] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-23T18:03:33.802206] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-23T18:03:34.286832] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T18:03:34.602199] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-23T18:03:34.942987] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T18:03:35.402215] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-23T18:03:35.721803] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T18:03:36.202210] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-23T18:03:36.760613] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:03:37.002255] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-23T18:03:37.660548] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T18:03:37.802188] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-23T18:03:38.602222] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-23T18:03:38.735428] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T18:03:38.741301] [INFO ] [REMOTE ] CMRE: Full fetch complete (49470 records). [2025-09-23T18:03:38.741466] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-23T18:03:39.186585] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-23T18:03:39.215243] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-23T18:03:39.215346] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-23T18:03:39.216083] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-23T18:03:39.216167] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-23T18:03:39.216485] [INFO ] [REMOTE ] CMS: Full fetch complete (76017 records). [2025-09-23T18:03:39.217019] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-23T18:03:39.218017] [DEBUG] [LOCAL ] CMRE: Trimmed 49470 records to 35502 (keeping 200 days of data) [2025-09-23T18:03:39.412900] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-23T18:03:39.386793] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T18:03:39.422632] [INFO ] [REMOTE ] CMSA: Full fetch complete (5047 records). [2025-09-23T18:03:39.445092] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-23T18:03:40.063724] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-23T18:03:40.069287] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-23T18:03:40.078711] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-23T18:03:40.092105] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-23T18:03:40.179375] [DEBUG] [LOCAL ] CMS: Trimmed 76017 records to 52611 (keeping 200 days of data) [2025-09-23T18:03:40.180369] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-23T18:03:40.180852] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-23T18:03:40.181297] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-23T18:03:40.181616] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-23T18:03:40.183408] [DEBUG] [LOCAL ] CMSA: Trimmed 5047 records to 3391 (keeping 200 days of data) [2025-09-23T18:03:40.305624] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T18:03:40.310345] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-23T18:03:40.319814] [DEBUG] [LOCAL ] CMSA: Primary data saved (3391 records). [2025-09-23T18:03:40.320917] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-23T18:03:40.321095] [INFO ] [MAIN ] Update Progress: 482/2372 symbols completed. CMSA took 32.1s. Estimated remaining: 4h 9m 27s. Rate: 7.6 symbols/min [2025-09-23T18:03:40.582221] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:40.631893] [DEBUG] [LOCAL ] CMTG: Loaded 37558 existing records from primary storage. [2025-09-23T18:03:40.632938] [INFO ] [MAIN ] CMTG: Loaded 37558 existing records. [2025-09-23T18:03:40.925535] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:40.928219] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-23T18:03:40.928664] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-23T18:03:40.937860] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-23T18:03:40.938077] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T18:03:40.943032] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-23T18:03:40.957070] [DEBUG] [LOCAL ] CMRE: Primary data saved (35502 records). [2025-09-23T18:03:40.957251] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-23T18:03:40.967426] [INFO ] [MAIN ] Update Progress: 483/2372 symbols completed. CMRE took 32.8s. Estimated remaining: 4h 8m 51s. Rate: 7.6 symbols/min [2025-09-23T18:03:41.007235] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-23T18:03:41.313003] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:41.425629] [DEBUG] [LOCAL ] CMU: Loaded 7353 existing records from primary storage. [2025-09-23T18:03:41.439600] [INFO ] [MAIN ] CMU: Loaded 7353 existing records. [2025-09-23T18:03:41.638482] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:41.780982] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:41.800115] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-23T18:03:41.801077] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-23T18:03:41.802291] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-23T18:03:41.802639] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-23T18:03:41.802904] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-23T18:03:41.925748] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T18:03:42.188304] [DEBUG] [LOCAL ] CMS: Primary data saved (52611 records). [2025-09-23T18:03:42.203577] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-23T18:03:42.210059] [INFO ] [MAIN ] Update Progress: 484/2372 symbols completed. CMS took 34.1s. Estimated remaining: 4h 8m 17s. Rate: 7.6 symbols/min [2025-09-23T18:03:42.208773] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:42.411531] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:42.451065] [DEBUG] [LOCAL ] CNA: Loaded 32761 existing records from primary storage. [2025-09-23T18:03:42.451244] [INFO ] [MAIN ] CNA: Loaded 32761 existing records. [2025-09-23T18:03:42.607376] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-23T18:03:42.637840] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:42.638082] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-23T18:03:42.638132] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-23T18:03:42.639066] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-23T18:03:42.639129] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-23T18:03:43.018245] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:43.075304] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:03:43.237581] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T18:03:43.402181] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-23T18:03:44.202202] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-23T18:03:44.529009] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T18:03:44.670394] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T18:03:45.002218] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-23T18:03:45.463805] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T18:03:45.802269] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-23T18:03:46.602259] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-23T18:03:47.087030] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T18:03:47.195237] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:03:47.402211] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-23T18:03:48.202193] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-23T18:03:48.382247] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T18:03:49.002191] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-23T18:03:49.760285] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:03:49.802168] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-23T18:03:49.897290] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:03:50.216317] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T18:03:50.602192] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-23T18:03:51.098236] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T18:03:51.402227] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-23T18:03:52.202195] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-23T18:03:52.407238] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T18:03:53.002189] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-23T18:03:53.414989] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T18:03:53.604039] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T18:03:53.802213] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-23T18:03:54.602209] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-23T18:03:54.785728] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T18:03:55.174110] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T18:03:55.175953] [INFO ] [REMOTE ] CMSD: Full fetch complete (12557 records). [2025-09-23T18:03:55.176028] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-23T18:03:55.407273] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-23T18:03:55.554270] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-23T18:03:55.554350] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-23T18:03:55.554660] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-23T18:03:55.554723] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-23T18:03:55.555211] [DEBUG] [LOCAL ] CMSD: Trimmed 12557 records to 8098 (keeping 200 days of data) [2025-09-23T18:03:55.608916] [DEBUG] [LOCAL ] CMSD: Primary data saved (8098 records). [2025-09-23T18:03:55.609077] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-23T18:03:55.609157] [INFO ] [MAIN ] Update Progress: 485/2372 symbols completed. CMSD took 26.2s. Estimated remaining: 4h 8m 31s. Rate: 7.6 symbols/min [2025-09-23T18:03:55.780592] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:55.833955] [DEBUG] [LOCAL ] CNC: Loaded 53733 existing records from primary storage. [2025-09-23T18:03:55.834110] [INFO ] [MAIN ] CNC: Loaded 53733 existing records. [2025-09-23T18:03:56.030380] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:56.030720] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-23T18:03:56.030798] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-23T18:03:56.032289] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-23T18:03:56.032353] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-23T18:03:56.220711] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-23T18:03:56.409090] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:57.002219] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-23T18:03:57.047499] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T18:03:57.149536] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T18:03:57.802194] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-23T18:03:58.602187] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-23T18:03:58.860924] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T18:03:58.919332] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T18:03:58.962929] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T18:03:59.402166] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-23T18:04:00.202206] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-23T18:04:01.011454] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-23T18:04:01.037741] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T18:04:01.445425] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:04:01.741718] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:04:01.802232] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-23T18:04:02.602203] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-23T18:04:03.173704] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:04:03.402165] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-23T18:04:03.433627] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T18:04:04.202254] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-23T18:04:04.818100] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T18:04:05.002252] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-23T18:04:05.486086] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T18:04:05.782404] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T18:04:05.802145] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-23T18:04:06.445701] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T18:04:06.602236] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-23T18:04:07.402238] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-23T18:04:07.987990] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T18:04:07.989414] [INFO ] [REMOTE ] CMU: Full fetch complete (9677 records). [2025-09-23T18:04:07.989482] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-23T18:04:08.195558] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T18:04:08.205330] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-23T18:04:08.396557] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-23T18:04:08.396672] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-23T18:04:08.396923] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-23T18:04:08.397006] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-23T18:04:08.397445] [DEBUG] [LOCAL ] CMU: Trimmed 9677 records to 7381 (keeping 200 days of data) [2025-09-23T18:04:08.439673] [DEBUG] [LOCAL ] CMU: Primary data saved (7381 records). [2025-09-23T18:04:08.439777] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-23T18:04:08.439860] [INFO ] [MAIN ] Update Progress: 486/2372 symbols completed. CMU took 27.5s. Estimated remaining: 4h 8m 42s. Rate: 7.6 symbols/min [2025-09-23T18:04:08.610203] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:08.622089] [DEBUG] [LOCAL ] CNF: Loaded 10809 existing records from primary storage. [2025-09-23T18:04:08.622210] [INFO ] [MAIN ] CNF: Loaded 10809 existing records. [2025-09-23T18:04:08.803778] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:08.804084] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-23T18:04:08.804135] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-23T18:04:08.804626] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-23T18:04:08.804723] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-23T18:04:09.007423] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-23T18:04:09.176931] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:09.811834] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-23T18:04:09.833602] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T18:04:10.500416] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T18:04:10.602179] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-23T18:04:11.015314] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T18:04:11.402193] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-23T18:04:11.454138] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T18:04:12.202198] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-23T18:04:12.351898] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:04:13.002197] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-23T18:04:13.504348] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T18:04:13.634050] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T18:04:13.802204] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-23T18:04:14.160453] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-23T18:04:14.602228] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-23T18:04:15.402193] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-23T18:04:15.554157] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:04:15.560403] [INFO ] [REMOTE ] CMTG: Full fetch complete (53087 records). [2025-09-23T18:04:15.560501] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-23T18:04:15.948167] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-23T18:04:15.948258] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-23T18:04:15.948909] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-23T18:04:15.948973] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-23T18:04:15.952126] [DEBUG] [LOCAL ] CMTG: Trimmed 53087 records to 37485 (keeping 200 days of data) [2025-09-23T18:04:16.163890] [DEBUG] [LOCAL ] CMTG: Primary data saved (37485 records). [2025-09-23T18:04:16.164033] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-23T18:04:16.164171] [INFO ] [MAIN ] Update Progress: 487/2372 symbols completed. CMTG took 35.8s. Estimated remaining: 4h 8m 33s. Rate: 7.6 symbols/min [2025-09-23T18:04:16.207266] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-23T18:04:16.338589] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:16.392933] [DEBUG] [LOCAL ] CNH: Loaded 53562 existing records from primary storage. [2025-09-23T18:04:16.393084] [INFO ] [MAIN ] CNH: Loaded 53562 existing records. [2025-09-23T18:04:16.574610] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:16.574922] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-23T18:04:16.574971] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-23T18:04:16.576448] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-23T18:04:16.576512] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-23T18:04:16.954872] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:17.009784] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-23T18:04:17.036274] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T18:04:17.575542] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T18:04:17.580842] [INFO ] [REMOTE ] CNA: Full fetch complete (45482 records). [2025-09-23T18:04:17.580966] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-23T18:04:17.807565] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-23T18:04:17.994102] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-23T18:04:17.994185] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-23T18:04:17.994766] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-23T18:04:17.994828] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-23T18:04:17.997787] [DEBUG] [LOCAL ] CNA: Trimmed 45482 records to 32752 (keeping 200 days of data) [2025-09-23T18:04:18.191148] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T18:04:18.208684] [DEBUG] [LOCAL ] CNA: Primary data saved (32752 records). [2025-09-23T18:04:18.208877] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-23T18:04:18.208968] [INFO ] [MAIN ] Update Progress: 488/2372 symbols completed. CNA took 36.0s. Estimated remaining: 4h 8m 3s. Rate: 7.6 symbols/min [2025-09-23T18:04:18.395899] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:18.447594] [DEBUG] [LOCAL ] CNI: Loaded 51660 existing records from primary storage. [2025-09-23T18:04:18.447800] [INFO ] [MAIN ] CNI: Loaded 51660 existing records. [2025-09-23T18:04:18.613393] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-23T18:04:18.639147] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:18.639679] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-23T18:04:18.639822] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-23T18:04:18.641431] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-23T18:04:18.641500] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-23T18:04:18.936847] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T18:04:19.061013] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:19.402213] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-23T18:04:20.202220] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-23T18:04:20.735054] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T18:04:21.002217] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-23T18:04:21.039336] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T18:04:21.155416] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-23T18:04:21.802263] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-23T18:04:22.199794] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T18:04:22.477093] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:04:22.602212] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-23T18:04:23.402254] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-23T18:04:24.202207] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-23T18:04:24.505579] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T18:04:24.775914] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T18:04:25.002237] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-23T18:04:25.144220] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T18:04:25.802205] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-23T18:04:26.338943] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T18:04:26.400773] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T18:04:26.602212] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-23T18:04:27.402194] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-23T18:04:28.041015] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:04:28.202183] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-23T18:04:28.802779] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T18:04:29.002186] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-23T18:04:29.609198] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T18:04:29.802206] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-23T18:04:30.380235] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T18:04:30.602214] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-23T18:04:31.381617] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-23T18:04:31.390789] [INFO ] [REMOTE ] CNC: Full fetch complete (77671 records). [2025-09-23T18:04:31.390969] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-23T18:04:31.407320] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-23T18:04:31.819084] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-23T18:04:31.819204] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-23T18:04:31.822577] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-23T18:04:31.822670] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-23T18:04:31.828085] [DEBUG] [LOCAL ] CNC: Trimmed 77671 records to 53737 (keeping 200 days of data) [2025-09-23T18:04:32.091898] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:04:32.195348] [DEBUG] [LOCAL ] CNC: Primary data saved (53737 records). [2025-09-23T18:04:32.195486] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-23T18:04:32.195593] [INFO ] [MAIN ] Update Progress: 489/2372 symbols completed. CNC took 36.6s. Estimated remaining: 4h 8m 18s. Rate: 7.6 symbols/min [2025-09-23T18:04:32.207304] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-23T18:04:32.372628] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:32.427772] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-09-23T18:04:32.427927] [INFO ] [MAIN ] CNK: Loaded 52908 existing records. [2025-09-23T18:04:32.617006] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:32.617346] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-23T18:04:32.617429] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-23T18:04:32.618881] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-23T18:04:32.618952] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-23T18:04:33.005590] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:33.002501] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-23T18:04:33.092849] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T18:04:33.689476] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T18:04:33.742259] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:04:33.802190] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-23T18:04:34.602214] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-23T18:04:35.276896] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:04:35.402150] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-23T18:04:35.556828] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:04:35.559498] [INFO ] [REMOTE ] CNF: Full fetch complete (12663 records). [2025-09-23T18:04:35.559681] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-23T18:04:35.995481] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-23T18:04:35.995563] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-23T18:04:35.995917] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-23T18:04:35.995981] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-23T18:04:35.996529] [DEBUG] [LOCAL ] CNF: Trimmed 12663 records to 10858 (keeping 200 days of data) [2025-09-23T18:04:36.061614] [DEBUG] [LOCAL ] CNF: Primary data saved (10858 records). [2025-09-23T18:04:36.061782] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-23T18:04:36.061889] [INFO ] [MAIN ] Update Progress: 490/2372 symbols completed. CNF took 27.6s. Estimated remaining: 4h 7m 55s. Rate: 7.6 symbols/min [2025-09-23T18:04:36.209071] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-23T18:04:36.243243] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:36.313349] [DEBUG] [LOCAL ] CNM: Loaded 50963 existing records from primary storage. [2025-09-23T18:04:36.313586] [INFO ] [MAIN ] CNM: Loaded 50963 existing records. [2025-09-23T18:04:36.501706] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:36.502061] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-23T18:04:36.502149] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-23T18:04:36.503487] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-23T18:04:36.503565] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-23T18:04:36.869423] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:37.002192] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-23T18:04:37.138149] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T18:04:37.802159] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-23T18:04:37.922115] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T18:04:38.602211] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-23T18:04:38.702371] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T18:04:39.256085] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T18:04:39.402182] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-23T18:04:39.919498] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:04:40.202198] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-23T18:04:41.002163] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-23T18:04:41.248840] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-23T18:04:41.691433] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:04:41.802172] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-23T18:04:42.246295] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T18:04:42.602187] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-23T18:04:43.402206] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-23T18:04:43.653527] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:04:44.202210] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-23T18:04:44.278396] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T18:04:44.872890] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:04:45.002216] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-23T18:04:45.765966] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T18:04:45.802161] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-23T18:04:46.205336] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T18:04:46.602203] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-23T18:04:47.402252] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-23T18:04:47.570984] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T18:04:47.893521] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T18:04:48.202207] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-23T18:04:48.878386] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T18:04:49.002201] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-23T18:04:49.802221] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-23T18:04:50.047601] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:04:50.455257] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:04:50.470717] [INFO ] [REMOTE ] CNI: Full fetch complete (74305 records). [2025-09-23T18:04:50.471221] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-23T18:04:50.476460] [FATAL] [VALIDATOR ] CNI: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:04:50.476616] [FATAL] [MAIN ] CNI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:04:50.476708] [WARN ] [MAIN ] CNI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:04:50.476859] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-23T18:04:50.476959] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-09-23T18:04:50.477050] [INFO ] [LOCAL ] CNI: Starting deletion of derivative data. [2025-09-23T18:04:50.477846] [DEBUG] [LOCAL ] CNI: Deleted derivative data file. [2025-09-23T18:04:50.478009] [INFO ] [MAIN ] Update Progress: 491/2372 symbols completed. CNI took 32.3s. Estimated remaining: 4h 8m 12s. Rate: 7.6 symbols/min [2025-09-23T18:04:50.607282] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-23T18:04:50.663165] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:50.704386] [DEBUG] [LOCAL ] CNMD: Loaded 32447 existing records from primary storage. [2025-09-23T18:04:50.704540] [INFO ] [MAIN ] CNMD: Loaded 32447 existing records. [2025-09-23T18:04:50.897198] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:50.897477] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-23T18:04:50.897526] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-23T18:04:50.898532] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-23T18:04:50.898594] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-23T18:04:51.292167] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:51.368196] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:04:51.402218] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-23T18:04:52.202182] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-23T18:04:52.236076] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T18:04:52.450794] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T18:04:53.002197] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-23T18:04:53.615909] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:04:53.802207] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-23T18:04:54.366715] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T18:04:54.375806] [INFO ] [REMOTE ] CNH: Full fetch complete (77535 records). [2025-09-23T18:04:54.375958] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-23T18:04:54.607316] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-23T18:04:54.808413] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-23T18:04:54.808605] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-23T18:04:54.809562] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-23T18:04:54.809633] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-23T18:04:54.811870] [DEBUG] [LOCAL ] CNH: Trimmed 77535 records to 53561 (keeping 200 days of data) [2025-09-23T18:04:55.061531] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T18:04:55.176858] [DEBUG] [LOCAL ] CNH: Primary data saved (53561 records). [2025-09-23T18:04:55.177007] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-23T18:04:55.177107] [INFO ] [MAIN ] Update Progress: 492/2372 symbols completed. CNH took 39.0s. Estimated remaining: 4h 7m 52s. Rate: 7.6 symbols/min [2025-09-23T18:04:55.350507] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:55.351735] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-09-23T18:04:55.351788] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-09-23T18:04:55.352180] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-23T18:04:55.352231] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-23T18:04:55.352274] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-09-23T18:04:55.352308] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-23T18:04:55.409251] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-23T18:04:55.735291] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:56.203982] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-23T18:04:56.209940] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T18:04:57.002173] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-23T18:04:57.157475] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T18:04:57.235875] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T18:04:57.802203] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-23T18:04:58.382628] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:04:58.391281] [INFO ] [REMOTE ] CNK: Full fetch complete (75626 records). [2025-09-23T18:04:58.391403] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-23T18:04:58.607522] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-23T18:04:58.792847] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-23T18:04:58.793026] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-23T18:04:58.793975] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-23T18:04:58.794093] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-23T18:04:58.809686] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T18:04:58.815575] [DEBUG] [LOCAL ] CNK: Trimmed 75626 records to 52903 (keeping 200 days of data) [2025-09-23T18:04:59.143394] [DEBUG] [LOCAL ] CNK: Primary data saved (52903 records). [2025-09-23T18:04:59.143532] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-23T18:04:59.143627] [INFO ] [MAIN ] Update Progress: 493/2372 symbols completed. CNK took 26.9s. Estimated remaining: 4h 7m 29s. Rate: 7.6 symbols/min [2025-09-23T18:04:59.312848] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:59.356434] [DEBUG] [LOCAL ] CNO: Loaded 41486 existing records from primary storage. [2025-09-23T18:04:59.356584] [INFO ] [MAIN ] CNO: Loaded 41486 existing records. [2025-09-23T18:04:59.410737] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-23T18:04:59.539911] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:59.540188] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-23T18:04:59.540237] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-23T18:04:59.541532] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-23T18:04:59.541593] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-23T18:05:00.017396] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:00.074554] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:05:00.202263] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-23T18:05:01.002227] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-23T18:05:01.244601] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T18:05:01.486813] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T18:05:01.802359] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-23T18:05:02.312797] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T18:05:02.602221] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-23T18:05:03.082033] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:05:03.402252] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-23T18:05:03.690103] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T18:05:04.202211] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-23T18:05:04.939416] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T18:05:05.002190] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-23T18:05:05.052712] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T18:05:05.802237] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-23T18:05:06.602230] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-23T18:05:06.686634] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:05:06.695288] [INFO ] [REMOTE ] CNM: Full fetch complete (73237 records). [2025-09-23T18:05:06.695424] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-23T18:05:06.696160] [FATAL] [VALIDATOR ] CNM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:05:06.696251] [FATAL] [MAIN ] CNM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:05:06.696294] [WARN ] [MAIN ] CNM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:05:06.696333] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-23T18:05:06.696390] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-09-23T18:05:06.696425] [INFO ] [LOCAL ] CNM: Starting deletion of derivative data. [2025-09-23T18:05:06.696827] [DEBUG] [LOCAL ] CNM: Deleted derivative data file. [2025-09-23T18:05:06.696936] [INFO ] [MAIN ] Update Progress: 494/2372 symbols completed. CNM took 30.6s. Estimated remaining: 4h 7m 20s. Rate: 7.6 symbols/min [2025-09-23T18:05:06.865959] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:06.921010] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-23T18:05:06.921164] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-09-23T18:05:07.110514] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:07.111062] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-23T18:05:07.111134] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-23T18:05:07.113693] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-23T18:05:07.113758] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-23T18:05:07.300302] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T18:05:07.414319] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-23T18:05:07.557590] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:07.602199] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:05:08.202254] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-23T18:05:08.752247] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T18:05:09.002266] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-23T18:05:09.238401] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T18:05:09.802271] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-23T18:05:10.229373] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T18:05:10.602285] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-23T18:05:11.402217] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-23T18:05:11.614131] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T18:05:11.684008] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T18:05:12.202231] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-23T18:05:12.579315] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:05:13.002199] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-23T18:05:13.633415] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T18:05:13.638639] [INFO ] [REMOTE ] CNMD: Full fetch complete (46929 records). [2025-09-23T18:05:13.638795] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-23T18:05:13.806248] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-23T18:05:14.028160] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-23T18:05:14.028243] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-23T18:05:14.028880] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-23T18:05:14.028944] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-23T18:05:14.030712] [DEBUG] [LOCAL ] CNMD: Trimmed 46929 records to 32416 (keeping 200 days of data) [2025-09-23T18:05:14.250857] [DEBUG] [LOCAL ] CNMD: Primary data saved (32416 records). [2025-09-23T18:05:14.251034] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-23T18:05:14.251147] [INFO ] [MAIN ] Update Progress: 495/2372 symbols completed. CNMD took 23.8s. Estimated remaining: 4h 7m 10s. Rate: 7.6 symbols/min [2025-09-23T18:05:14.433305] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:14.463584] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T18:05:14.527984] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-09-23T18:05:14.528152] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-09-23T18:05:14.607309] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-23T18:05:14.728131] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:14.728381] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-23T18:05:14.728429] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-23T18:05:14.729877] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-23T18:05:14.729940] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-23T18:05:15.074462] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T18:05:15.120224] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:15.402245] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-23T18:05:15.756772] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T18:05:16.202231] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-23T18:05:17.002152] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-23T18:05:17.092452] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T18:05:17.594048] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:05:17.802202] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-23T18:05:18.247546] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T18:05:18.602210] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-23T18:05:19.402176] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-23T18:05:19.502102] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:05:19.666380] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:05:20.202228] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-23T18:05:21.002189] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-23T18:05:21.234911] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T18:05:21.766852] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T18:05:21.802162] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-23T18:05:22.196854] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T18:05:22.602197] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-23T18:05:23.402204] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-23T18:05:23.596624] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T18:05:23.921477] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:05:23.928566] [INFO ] [REMOTE ] CNO: Full fetch complete (60564 records). [2025-09-23T18:05:23.928743] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-23T18:05:24.207317] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-23T18:05:24.327533] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-23T18:05:24.327621] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-23T18:05:24.328407] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-23T18:05:24.328467] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-23T18:05:24.329825] [DEBUG] [LOCAL ] CNO: Trimmed 60564 records to 41431 (keeping 200 days of data) [2025-09-23T18:05:24.586682] [DEBUG] [LOCAL ] CNO: Primary data saved (41431 records). [2025-09-23T18:05:24.586831] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-23T18:05:24.586923] [INFO ] [MAIN ] Update Progress: 496/2372 symbols completed. CNO took 25.4s. Estimated remaining: 4h 7m 12s. Rate: 7.6 symbols/min [2025-09-23T18:05:24.762393] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:24.762598] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-23T18:05:24.762698] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-23T18:05:24.763089] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-23T18:05:24.763175] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-23T18:05:24.763395] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-23T18:05:24.763574] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-23T18:05:25.009929] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-23T18:05:25.078946] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T18:05:25.166788] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:25.381465] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:05:25.802225] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-23T18:05:26.008563] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:05:26.009061] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-23T18:05:26.602187] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-23T18:05:26.794490] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T18:05:27.402669] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-23T18:05:27.451217] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:05:28.202211] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-23T18:05:28.943154] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T18:05:29.002170] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-23T18:05:29.101313] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T18:05:29.802238] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-23T18:05:30.499105] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T18:05:30.602211] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-23T18:05:31.402226] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-23T18:05:31.572449] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T18:05:31.601792] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:05:32.202203] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-23T18:05:32.788555] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:05:33.002217] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-23T18:05:33.802180] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-23T18:05:33.899850] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:05:34.317475] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T18:05:34.602192] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-23T18:05:35.402169] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-23T18:05:35.455707] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T18:05:35.861453] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T18:05:36.202213] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-23T18:05:36.974551] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T18:05:37.002167] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-23T18:05:37.435962] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T18:05:37.802216] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-23T18:05:38.482903] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T18:05:38.602186] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-23T18:05:39.402211] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-23T18:05:39.576316] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T18:05:39.984717] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T18:05:40.202204] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-23T18:05:40.795031] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T18:05:41.002193] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-23T18:05:41.802247] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-23T18:05:41.906836] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T18:05:41.917090] [INFO ] [REMOTE ] CNP: Full fetch complete (77361 records). [2025-09-23T18:05:41.917394] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-23T18:05:42.339425] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-23T18:05:42.339630] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-23T18:05:42.340684] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-23T18:05:42.340804] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-23T18:05:42.352239] [DEBUG] [LOCAL ] CNP: Trimmed 77361 records to 53469 (keeping 200 days of data) [2025-09-23T18:05:42.370248] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T18:05:42.603724] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-23T18:05:42.717410] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-23T18:05:42.717559] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-23T18:05:42.717686] [INFO ] [MAIN ] Update Progress: 497/2372 symbols completed. CNP took 36.0s. Estimated remaining: 4h 7m 42s. Rate: 7.6 symbols/min [2025-09-23T18:05:42.891387] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:42.911789] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T18:05:42.918507] [INFO ] [REMOTE ] CNNE: Full fetch complete (49199 records). [2025-09-23T18:05:42.918627] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-23T18:05:43.051701] [DEBUG] [LOCAL ] CNS: Loaded 20981 existing records from primary storage. [2025-09-23T18:05:43.062190] [INFO ] [MAIN ] CNS: Loaded 20981 existing records. [2025-09-23T18:05:43.404164] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-23T18:05:43.459850] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:43.499628] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-23T18:05:43.512867] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-23T18:05:43.516444] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-23T18:05:43.516611] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-23T18:05:43.517342] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-23T18:05:43.517396] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-23T18:05:43.517555] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-23T18:05:43.518160] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-23T18:05:43.584914] [DEBUG] [LOCAL ] CNNE: Trimmed 49199 records to 36888 (keeping 200 days of data) [2025-09-23T18:05:43.994526] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:44.130616] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T18:05:44.163895] [DEBUG] [LOCAL ] CNNE: Primary data saved (36888 records). [2025-09-23T18:05:44.164038] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-23T18:05:44.164127] [INFO ] [MAIN ] Update Progress: 498/2372 symbols completed. CNNE took 49.0s. Estimated remaining: 4h 7m 10s. Rate: 7.6 symbols/min [2025-09-23T18:05:44.207569] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-23T18:05:44.339491] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:44.388837] [DEBUG] [LOCAL ] CNX: Loaded 51393 existing records from primary storage. [2025-09-23T18:05:44.388987] [INFO ] [MAIN ] CNX: Loaded 51393 existing records. [2025-09-23T18:05:44.568421] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:44.568717] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-23T18:05:44.568798] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-23T18:05:44.569986] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-23T18:05:44.570048] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-23T18:05:44.937835] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:45.002157] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-23T18:05:45.029914] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:05:45.688228] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:05:45.697288] [INFO ] [REMOTE ] CNQ: Full fetch complete (77543 records). [2025-09-23T18:05:45.697460] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-23T18:05:45.807105] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-23T18:05:46.167031] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-23T18:05:46.167157] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-23T18:05:46.168115] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-23T18:05:46.168183] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-23T18:05:46.169789] [DEBUG] [LOCAL ] CNQ: Trimmed 77543 records to 53582 (keeping 200 days of data) [2025-09-23T18:05:46.426552] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T18:05:46.555711] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-09-23T18:05:46.555872] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-23T18:05:46.555974] [INFO ] [MAIN ] Update Progress: 499/2372 symbols completed. CNQ took 32.3s. Estimated remaining: 4h 6m 41s. Rate: 7.6 symbols/min [2025-09-23T18:05:46.607399] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-23T18:05:46.738908] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:46.739402] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-09-23T18:05:46.739458] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-09-23T18:05:46.739599] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-23T18:05:46.739663] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-23T18:05:46.739732] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-09-23T18:05:46.739767] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-23T18:05:47.095243] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:47.374552] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T18:05:47.381427] [INFO ] [REMOTE ] CNR: Full fetch complete (55854 records). [2025-09-23T18:05:47.381532] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-23T18:05:47.413123] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-23T18:05:47.577988] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-23T18:05:47.578550] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:05:47.578627] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:05:47.578720] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-23T18:05:47.578788] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-23T18:05:47.578824] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-23T18:05:47.578864] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-23T18:05:47.578923] [INFO ] [MAIN ] Update Progress: 500/2372 symbols completed. CNR took 23.0s. Estimated remaining: 4h 6m 8s. Rate: 7.6 symbols/min [2025-09-23T18:05:47.748313] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:47.806081] [DEBUG] [LOCAL ] COF: Loaded 53611 existing records from primary storage. [2025-09-23T18:05:47.806283] [INFO ] [MAIN ] COF: Loaded 53611 existing records. [2025-09-23T18:05:48.004638] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:48.005121] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-23T18:05:48.005203] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-23T18:05:48.015555] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-23T18:05:48.015683] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-23T18:05:48.048835] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T18:05:48.209346] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-23T18:05:48.391920] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:48.405549] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T18:05:49.002180] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-23T18:05:49.802175] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-23T18:05:50.199620] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T18:05:50.558111] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T18:05:50.587317] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:05:50.602156] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-23T18:05:51.402149] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-23T18:05:51.423975] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T18:05:52.202193] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-23T18:05:52.789538] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T18:05:53.002166] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-23T18:05:53.027233] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T18:05:53.802223] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-23T18:05:54.376150] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:05:54.602282] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-23T18:05:54.838780] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:05:55.402201] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-23T18:05:56.194041] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T18:05:56.202133] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-23T18:05:56.730609] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-23T18:05:57.002399] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-23T18:05:57.091785] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:05:57.802204] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-23T18:05:58.602267] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-23T18:05:58.752526] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:05:58.910445] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:05:59.402220] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-23T18:05:59.966897] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T18:06:00.202248] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-23T18:06:00.380332] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:06:01.002220] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-23T18:06:01.802190] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-23T18:06:02.259401] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T18:06:02.602233] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-23T18:06:03.402229] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-23T18:06:03.920768] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-09-23T18:06:04.202191] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-23T18:06:04.413856] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-23T18:06:04.988190] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-23T18:06:05.002142] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-23T18:06:05.383804] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T18:06:05.784244] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T18:06:05.802145] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-23T18:06:06.371291] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-23T18:06:06.574772] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T18:06:06.578441] [INFO ] [REMOTE ] CNS: Full fetch complete (29644 records). [2025-09-23T18:06:06.578539] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-23T18:06:06.579090] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:06:06.579175] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:06:06.579217] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:06:06.579284] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-23T18:06:06.579373] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-09-23T18:06:06.579430] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-09-23T18:06:06.579807] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-09-23T18:06:06.579912] [INFO ] [MAIN ] Update Progress: 501/2372 symbols completed. CNS took 23.9s. Estimated remaining: 4h 6m 41s. Rate: 7.6 symbols/min [2025-09-23T18:06:06.609426] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-23T18:06:06.766990] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:06.824306] [DEBUG] [LOCAL ] COHR: Loaded 53366 existing records from primary storage. [2025-09-23T18:06:06.824501] [INFO ] [MAIN ] COHR: Loaded 53366 existing records. [2025-09-23T18:06:07.010574] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:07.010889] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-23T18:06:07.010939] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-23T18:06:07.012080] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-23T18:06:07.012141] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-23T18:06:07.378834] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:07.402153] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-23T18:06:08.202197] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-23T18:06:08.403798] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T18:06:09.002268] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-23T18:06:09.040741] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:06:09.484206] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T18:06:09.802192] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-23T18:06:10.564730] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:06:10.602154] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-23T18:06:11.367459] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T18:06:11.402146] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-23T18:06:12.202169] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-23T18:06:12.246503] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T18:06:12.255341] [INFO ] [REMOTE ] COF: Full fetch complete (77388 records). [2025-09-23T18:06:12.255467] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-23T18:06:12.650910] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-23T18:06:12.651058] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-23T18:06:12.651941] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-23T18:06:12.652008] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-23T18:06:12.653595] [DEBUG] [LOCAL ] COF: Trimmed 77388 records to 53610 (keeping 200 days of data) [2025-09-23T18:06:13.001739] [DEBUG] [LOCAL ] COF: Primary data saved (53610 records). [2025-09-23T18:06:13.001887] [INFO ] [MAIN ] COF: Full history saved. [2025-09-23T18:06:13.001973] [INFO ] [MAIN ] Update Progress: 502/2372 symbols completed. COF took 25.4s. Estimated remaining: 4h 6m 28s. Rate: 7.6 symbols/min [2025-09-23T18:06:13.002270] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-23T18:06:13.181130] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-23T18:06:13.220034] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:13.274078] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T18:06:13.296945] [DEBUG] [LOCAL ] COLD: Loaded 51973 existing records from primary storage. [2025-09-23T18:06:13.297089] [INFO ] [MAIN ] COLD: Loaded 51973 existing records. [2025-09-23T18:06:13.475142] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:13.475545] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-23T18:06:13.475603] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-23T18:06:13.477772] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-23T18:06:13.477839] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-23T18:06:13.807319] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-23T18:06:13.848753] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:14.602204] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-23T18:06:15.325807] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-23T18:06:15.402205] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-23T18:06:15.824213] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:06:16.202239] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-23T18:06:16.901443] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-23T18:06:17.002219] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-23T18:06:17.488094] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T18:06:17.756668] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-23T18:06:17.802256] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-23T18:06:18.160717] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T18:06:18.602192] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-23T18:06:19.402171] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-23T18:06:19.443311] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:06:20.202200] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-23T18:06:20.476088] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T18:06:20.679202] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T18:06:21.002192] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-23T18:06:21.760295] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:06:21.802166] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-23T18:06:22.602150] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-23T18:06:22.852105] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T18:06:23.162116] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T18:06:23.168194] [INFO ] [REMOTE ] CODI: Full fetch complete (50208 records). [2025-09-23T18:06:23.168294] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-23T18:06:23.407359] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-23T18:06:23.559231] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-23T18:06:23.559324] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-23T18:06:23.560031] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-23T18:06:23.560096] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-23T18:06:23.561375] [DEBUG] [LOCAL ] CODI: Trimmed 50208 records to 39695 (keeping 200 days of data) [2025-09-23T18:06:23.791541] [DEBUG] [LOCAL ] CODI: Primary data saved (39695 records). [2025-09-23T18:06:23.791746] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-23T18:06:23.791845] [INFO ] [MAIN ] Update Progress: 503/2372 symbols completed. CODI took 37.2s. Estimated remaining: 4h 6m 31s. Rate: 7.6 symbols/min [2025-09-23T18:06:23.966923] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:24.025263] [DEBUG] [LOCAL ] COMP: Loaded 53384 existing records from primary storage. [2025-09-23T18:06:24.025429] [INFO ] [MAIN ] COMP: Loaded 53384 existing records. [2025-09-23T18:06:24.207089] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-23T18:06:24.207310] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:24.208824] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-23T18:06:24.208892] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-23T18:06:24.219946] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-23T18:06:24.234006] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-23T18:06:24.321588] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T18:06:24.605951] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:24.803967] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T18:06:25.002205] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-23T18:06:25.802231] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-23T18:06:26.268451] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-23T18:06:26.446149] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T18:06:26.602198] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-23T18:06:27.402195] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-23T18:06:27.824913] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:06:28.028518] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T18:06:28.202160] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-23T18:06:29.002165] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-23T18:06:29.100833] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T18:06:29.487979] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T18:06:29.802246] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-23T18:06:30.364766] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T18:06:30.373112] [INFO ] [REMOTE ] CNX: Full fetch complete (74763 records). [2025-09-23T18:06:30.373241] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-23T18:06:30.612854] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-23T18:06:30.796251] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-23T18:06:30.796347] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-23T18:06:30.797184] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-23T18:06:30.797249] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-23T18:06:30.800909] [DEBUG] [LOCAL ] CNX: Trimmed 74763 records to 51391 (keeping 200 days of data) [2025-09-23T18:06:31.110574] [DEBUG] [LOCAL ] CNX: Primary data saved (51391 records). [2025-09-23T18:06:31.110933] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-23T18:06:31.111196] [INFO ] [MAIN ] Update Progress: 504/2372 symbols completed. CNX took 46.9s. Estimated remaining: 4h 6m 21s. Rate: 7.6 symbols/min [2025-09-23T18:06:31.297212] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:31.337665] [DEBUG] [LOCAL ] CON: Loaded 38793 existing records from primary storage. [2025-09-23T18:06:31.337831] [INFO ] [MAIN ] CON: Loaded 38793 existing records. [2025-09-23T18:06:31.407253] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-23T18:06:31.525288] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:31.525749] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-23T18:06:31.525820] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-23T18:06:31.526848] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-23T18:06:31.527006] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-23T18:06:31.913099] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:31.952297] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-23T18:06:32.041761] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T18:06:32.202211] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-23T18:06:32.786957] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T18:06:33.002181] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-23T18:06:33.451070] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T18:06:33.802256] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-23T18:06:34.607256] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-23T18:06:34.623671] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T18:06:35.239103] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T18:06:35.402174] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-23T18:06:36.202192] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-23T18:06:36.444839] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T18:06:37.002195] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-23T18:06:37.203308] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T18:06:37.667335] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T18:06:37.802174] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-23T18:06:38.365354] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:06:38.602193] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-23T18:06:39.259160] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T18:06:39.402225] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-23T18:06:40.199155] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T18:06:40.207968] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-23T18:06:40.210152] [INFO ] [REMOTE ] COLD: Full fetch complete (74062 records). [2025-09-23T18:06:40.210401] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-23T18:06:40.639895] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-23T18:06:40.640060] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-23T18:06:40.640994] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-23T18:06:40.641116] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-23T18:06:40.642847] [DEBUG] [LOCAL ] COLD: Trimmed 74062 records to 51991 (keeping 200 days of data) [2025-09-23T18:06:40.974390] [DEBUG] [LOCAL ] COLD: Primary data saved (51991 records). [2025-09-23T18:06:40.974555] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-23T18:06:40.974882] [INFO ] [MAIN ] Update Progress: 505/2372 symbols completed. COLD took 28.0s. Estimated remaining: 4h 6m 20s. Rate: 7.6 symbols/min [2025-09-23T18:06:41.030484] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-23T18:06:41.207351] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:41.230988] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T18:06:41.263238] [DEBUG] [LOCAL ] COOK: Loaded 24380 existing records from primary storage. [2025-09-23T18:06:41.263382] [INFO ] [MAIN ] COOK: Loaded 24380 existing records. [2025-09-23T18:06:41.466253] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:41.467305] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-23T18:06:41.467510] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-23T18:06:41.468462] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-23T18:06:41.468743] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-23T18:06:41.617051] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:06:41.808419] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-23T18:06:41.895963] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:42.602250] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-23T18:06:43.014133] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T18:06:43.023199] [INFO ] [REMOTE ] COHR: Full fetch complete (77087 records). [2025-09-23T18:06:43.023353] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-23T18:06:43.428243] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-23T18:06:43.500423] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T18:06:43.500513] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-23T18:06:43.510814] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-23T18:06:43.512198] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-23T18:06:43.512291] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-23T18:06:43.519310] [DEBUG] [LOCAL ] COHR: Trimmed 77087 records to 53365 (keeping 200 days of data) [2025-09-23T18:06:43.828785] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T18:06:43.873245] [DEBUG] [LOCAL ] COHR: Primary data saved (53365 records). [2025-09-23T18:06:43.873395] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-23T18:06:43.873519] [INFO ] [MAIN ] Update Progress: 506/2372 symbols completed. COHR took 37.3s. Estimated remaining: 4h 5m 53s. Rate: 7.6 symbols/min [2025-09-23T18:06:44.049096] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:44.110237] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-23T18:06:44.110399] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-09-23T18:06:44.208357] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-23T18:06:44.292437] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:44.292885] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-23T18:06:44.292936] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-23T18:06:44.294423] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-23T18:06:44.294485] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-23T18:06:44.659618] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:44.719857] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T18:06:45.002184] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-23T18:06:45.698593] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T18:06:45.743943] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:06:45.802206] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-23T18:06:46.602258] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-23T18:06:47.402251] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-23T18:06:47.474559] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:06:47.547049] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T18:06:47.941062] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T18:06:48.202229] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-23T18:06:49.002202] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-23T18:06:49.621894] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:06:49.802207] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-23T18:06:50.560539] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:06:50.602159] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-23T18:06:51.218695] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:06:51.402186] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-23T18:06:52.126693] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:06:52.139863] [INFO ] [REMOTE ] COMP: Full fetch complete (77071 records). [2025-09-23T18:06:52.140030] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-23T18:06:52.208178] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-23T18:06:52.550268] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-23T18:06:52.550437] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-23T18:06:52.551315] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-23T18:06:52.551399] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-23T18:06:52.553422] [DEBUG] [LOCAL ] COMP: Trimmed 77071 records to 53386 (keeping 200 days of data) [2025-09-23T18:06:52.577984] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T18:06:52.888801] [DEBUG] [LOCAL ] COMP: Primary data saved (53386 records). [2025-09-23T18:06:52.889303] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-23T18:06:52.889546] [INFO ] [MAIN ] Update Progress: 507/2372 symbols completed. COMP took 29.1s. Estimated remaining: 4h 5m 50s. Rate: 7.6 symbols/min [2025-09-23T18:06:53.007261] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-23T18:06:53.063424] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:53.113008] [DEBUG] [LOCAL ] COR: Loaded 47281 existing records from primary storage. [2025-09-23T18:06:53.113154] [INFO ] [MAIN ] COR: Loaded 47281 existing records. [2025-09-23T18:06:53.289282] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:53.289608] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-23T18:06:53.289694] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-23T18:06:53.291020] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-23T18:06:53.291079] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-23T18:06:53.647180] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:53.807369] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-23T18:06:53.827056] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T18:06:53.992163] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T18:06:54.602192] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-23T18:06:55.207020] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T18:06:55.214794] [INFO ] [REMOTE ] CON: Full fetch complete (57182 records). [2025-09-23T18:06:55.214983] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-23T18:06:55.410590] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-23T18:06:55.495942] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:06:55.651291] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-23T18:06:55.651520] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-23T18:06:55.652248] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-23T18:06:55.652312] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-23T18:06:55.653469] [DEBUG] [LOCAL ] CON: Trimmed 57182 records to 38791 (keeping 200 days of data) [2025-09-23T18:06:55.894576] [DEBUG] [LOCAL ] CON: Primary data saved (38791 records). [2025-09-23T18:06:55.894748] [INFO ] [MAIN ] CON: Full history saved. [2025-09-23T18:06:55.894841] [INFO ] [MAIN ] Update Progress: 508/2372 symbols completed. CON took 24.8s. Estimated remaining: 4h 5m 24s. Rate: 7.6 symbols/min [2025-09-23T18:06:56.062302] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:56.122597] [DEBUG] [LOCAL ] COTY: Loaded 53252 existing records from primary storage. [2025-09-23T18:06:56.122794] [INFO ] [MAIN ] COTY: Loaded 53252 existing records. [2025-09-23T18:06:56.207417] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-23T18:06:56.306201] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:56.306513] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-23T18:06:56.306561] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-23T18:06:56.307843] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-23T18:06:56.307906] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-23T18:06:56.657801] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:57.002166] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-23T18:06:57.049578] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:06:57.802209] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-23T18:06:57.852451] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T18:06:58.516632] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:06:58.602150] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-23T18:06:59.402224] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-23T18:06:59.701683] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T18:07:00.202191] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-23T18:07:00.342106] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T18:07:00.375589] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T18:07:01.002240] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-23T18:07:01.615374] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T18:07:01.802192] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-23T18:07:02.398361] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:07:02.602296] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-23T18:07:03.217436] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T18:07:03.402226] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-23T18:07:04.202195] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-23T18:07:04.295801] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T18:07:05.002222] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-23T18:07:05.081073] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T18:07:05.611583] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:07:05.802192] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-23T18:07:06.602261] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-23T18:07:06.675560] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T18:07:06.706125] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T18:07:07.402239] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-23T18:07:08.202241] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-23T18:07:08.808711] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-23T18:07:09.002162] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-23T18:07:09.122673] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T18:07:09.359774] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T18:07:09.802218] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-23T18:07:10.602216] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-23T18:07:11.251552] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T18:07:11.279631] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:07:11.286551] [INFO ] [REMOTE ] COOK: Full fetch complete (32964 records). [2025-09-23T18:07:11.286680] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-23T18:07:11.407274] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-23T18:07:11.684215] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-23T18:07:11.684318] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-23T18:07:11.684871] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-23T18:07:11.684934] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-23T18:07:11.685942] [DEBUG] [LOCAL ] COOK: Trimmed 32964 records to 24522 (keeping 200 days of data) [2025-09-23T18:07:11.840003] [DEBUG] [LOCAL ] COOK: Primary data saved (24522 records). [2025-09-23T18:07:11.840144] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-23T18:07:11.840235] [INFO ] [MAIN ] Update Progress: 509/2372 symbols completed. COOK took 30.9s. Estimated remaining: 4h 5m 45s. Rate: 7.6 symbols/min [2025-09-23T18:07:12.023037] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:12.075046] [DEBUG] [LOCAL ] COUR: Loaded 48918 existing records from primary storage. [2025-09-23T18:07:12.075226] [INFO ] [MAIN ] COUR: Loaded 48918 existing records. [2025-09-23T18:07:12.207241] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-23T18:07:12.269160] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:12.269433] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-23T18:07:12.269483] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-23T18:07:12.271594] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-23T18:07:12.271686] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-23T18:07:12.645718] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:12.739989] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T18:07:12.804299] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T18:07:13.002190] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-23T18:07:13.744793] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:07:13.802155] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-23T18:07:14.550290] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T18:07:14.602157] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-23T18:07:15.151069] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:07:15.402218] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-23T18:07:16.194377] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T18:07:16.203425] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-23T18:07:17.002195] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-23T18:07:17.031869] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T18:07:17.802231] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-23T18:07:17.948126] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T18:07:18.477961] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:07:18.602216] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-23T18:07:19.406702] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-23T18:07:19.408964] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T18:07:19.416808] [INFO ] [REMOTE ] COR: Full fetch complete (68848 records). [2025-09-23T18:07:19.416913] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-23T18:07:19.810049] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-23T18:07:19.810156] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-23T18:07:19.810947] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-23T18:07:19.811010] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-23T18:07:19.812380] [DEBUG] [LOCAL ] COR: Trimmed 68848 records to 47253 (keeping 200 days of data) [2025-09-23T18:07:20.141549] [DEBUG] [LOCAL ] COR: Primary data saved (47253 records). [2025-09-23T18:07:20.145581] [INFO ] [MAIN ] COR: Full history saved. [2025-09-23T18:07:20.145767] [INFO ] [MAIN ] Update Progress: 510/2372 symbols completed. COR took 27.3s. Estimated remaining: 4h 5m 39s. Rate: 7.6 symbols/min [2025-09-23T18:07:20.211144] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-23T18:07:20.248864] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T18:07:20.347732] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:20.400326] [DEBUG] [LOCAL ] CP: Loaded 53286 existing records from primary storage. [2025-09-23T18:07:20.400482] [INFO ] [MAIN ] CP: Loaded 53286 existing records. [2025-09-23T18:07:20.582389] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:20.582689] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-23T18:07:20.582760] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-23T18:07:20.583823] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-23T18:07:20.583905] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-23T18:07:20.950235] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:20.977749] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T18:07:21.002202] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-23T18:07:21.802194] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-23T18:07:21.856787] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T18:07:22.299741] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T18:07:22.602208] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-23T18:07:23.318962] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T18:07:23.402222] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-23T18:07:24.202239] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-23T18:07:24.429819] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T18:07:25.002234] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-23T18:07:25.268517] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T18:07:25.277301] [INFO ] [REMOTE ] COTY: Full fetch complete (77091 records). [2025-09-23T18:07:25.277421] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-23T18:07:25.667039] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-23T18:07:25.667150] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-23T18:07:25.668032] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-23T18:07:25.668093] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-23T18:07:25.669565] [DEBUG] [LOCAL ] COTY: Trimmed 77091 records to 53248 (keeping 200 days of data) [2025-09-23T18:07:25.833069] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-23T18:07:25.977541] [DEBUG] [LOCAL ] COTY: Primary data saved (53248 records). [2025-09-23T18:07:25.977705] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-23T18:07:25.977802] [INFO ] [MAIN ] Update Progress: 511/2372 symbols completed. COTY took 30.1s. Estimated remaining: 4h 5m 23s. Rate: 7.6 symbols/min [2025-09-23T18:07:26.145975] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:26.175978] [DEBUG] [LOCAL ] CPA: Loaded 28894 existing records from primary storage. [2025-09-23T18:07:26.176124] [INFO ] [MAIN ] CPA: Loaded 28894 existing records. [2025-09-23T18:07:26.359998] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:26.360489] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-23T18:07:26.360671] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-23T18:07:26.361479] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-23T18:07:26.361543] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-23T18:07:26.518621] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T18:07:26.621464] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-23T18:07:26.774308] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:26.858255] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-23T18:07:26.867508] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-23T18:07:26.867759] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-23T18:07:27.265395] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-23T18:07:27.265519] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-23T18:07:27.266414] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-23T18:07:27.266494] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-23T18:07:27.268440] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-09-23T18:07:27.449254] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-23T18:07:27.547846] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T18:07:27.644668] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-23T18:07:27.644834] [INFO ] [MAIN ] COP: Full history saved. [2025-09-23T18:07:27.644932] [INFO ] [MAIN ] Update Progress: 512/2372 symbols completed. COP took 43.8s. Estimated remaining: 4h 4m 53s. Rate: 7.6 symbols/min [2025-09-23T18:07:27.811969] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:27.812135] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-23T18:07:27.812171] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-23T18:07:27.812320] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-23T18:07:27.812361] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-23T18:07:27.812401] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-23T18:07:27.812434] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-23T18:07:28.171160] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:28.202142] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-23T18:07:28.615980] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T18:07:28.812831] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T18:07:29.002246] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-23T18:07:29.122817] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:07:29.802210] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-23T18:07:30.295179] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:07:30.602254] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-23T18:07:31.402178] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-23T18:07:31.530727] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T18:07:31.558773] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T18:07:32.202212] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-23T18:07:32.516760] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-23T18:07:32.597834] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T18:07:33.002215] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-23T18:07:33.802231] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-23T18:07:34.602194] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-23T18:07:34.758863] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T18:07:35.057539] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T18:07:35.402209] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-23T18:07:36.202239] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-23T18:07:36.488113] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T18:07:36.527496] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T18:07:37.002198] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-23T18:07:37.802171] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-23T18:07:38.132517] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:07:38.202001] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T18:07:38.602198] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-23T18:07:39.402205] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-23T18:07:39.883227] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-23T18:07:40.033505] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T18:07:40.202201] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-23T18:07:41.002226] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-23T18:07:41.229978] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T18:07:41.446240] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T18:07:41.519466] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-23T18:07:41.802204] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-23T18:07:42.135833] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-23T18:07:42.602250] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-23T18:07:43.402245] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-23T18:07:43.581328] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:07:44.202208] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-23T18:07:45.002199] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-23T18:07:45.132276] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:07:45.337390] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T18:07:45.802215] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-23T18:07:46.093185] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-23T18:07:46.536556] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T18:07:46.544818] [INFO ] [REMOTE ] COUR: Full fetch complete (70900 records). [2025-09-23T18:07:46.544932] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-23T18:07:46.607432] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-23T18:07:46.951825] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-23T18:07:46.951917] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-23T18:07:46.952806] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-23T18:07:46.952873] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-23T18:07:46.954326] [DEBUG] [LOCAL ] COUR: Trimmed 70900 records to 48950 (keeping 200 days of data) [2025-09-23T18:07:47.044733] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T18:07:47.253503] [DEBUG] [LOCAL ] COUR: Primary data saved (48950 records). [2025-09-23T18:07:47.253711] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-23T18:07:47.253812] [INFO ] [MAIN ] Update Progress: 513/2372 symbols completed. COUR took 35.4s. Estimated remaining: 4h 5m 27s. Rate: 7.6 symbols/min [2025-09-23T18:07:47.410004] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-23T18:07:47.428977] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:47.462444] [DEBUG] [LOCAL ] CPAY: Loaded 31224 existing records from primary storage. [2025-09-23T18:07:47.462593] [INFO ] [MAIN ] CPAY: Loaded 31224 existing records. [2025-09-23T18:07:47.642476] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:47.642766] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-23T18:07:47.642823] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-23T18:07:47.643735] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-23T18:07:47.643799] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-23T18:07:48.006847] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:48.202194] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-23T18:07:49.002199] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-23T18:07:49.087028] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T18:07:49.314770] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T18:07:49.802186] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-23T18:07:49.839847] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:07:50.108591] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T18:07:50.602192] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-23T18:07:51.402204] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-23T18:07:51.904711] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T18:07:51.987932] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T18:07:51.989134] [INFO ] [REMOTE ] CPAC: Full fetch complete (1900 records). [2025-09-23T18:07:51.989208] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-23T18:07:52.181779] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T18:07:52.182032] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:07:52.182108] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:07:52.182183] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-23T18:07:52.182252] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-23T18:07:52.182292] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-23T18:07:52.182331] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-23T18:07:52.182397] [INFO ] [MAIN ] Update Progress: 514/2372 symbols completed. CPAC took 24.5s. Estimated remaining: 4h 5m 8s. Rate: 7.6 symbols/min [2025-09-23T18:07:52.207434] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-23T18:07:52.364804] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:52.382791] [DEBUG] [LOCAL ] CPF: Loaded 15454 existing records from primary storage. [2025-09-23T18:07:52.382934] [INFO ] [MAIN ] CPF: Loaded 15454 existing records. [2025-09-23T18:07:52.569062] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:52.569378] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-23T18:07:52.569436] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-23T18:07:52.569998] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-23T18:07:52.570058] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-23T18:07:52.951931] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:53.002208] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-23T18:07:53.650607] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:07:53.802202] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-23T18:07:54.455897] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:07:54.464851] [INFO ] [REMOTE ] CP: Full fetch complete (77130 records). [2025-09-23T18:07:54.465023] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-23T18:07:54.607271] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-23T18:07:54.861823] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-23T18:07:54.862063] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-23T18:07:54.862941] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-23T18:07:54.863011] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-23T18:07:54.864494] [DEBUG] [LOCAL ] CP: Trimmed 77130 records to 53279 (keeping 200 days of data) [2025-09-23T18:07:55.093549] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:07:55.099539] [INFO ] [REMOTE ] CPA: Full fetch complete (42105 records). [2025-09-23T18:07:55.100855] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-23T18:07:55.406175] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-23T18:07:55.518322] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-23T18:07:55.519284] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-23T18:07:55.520351] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-23T18:07:55.520907] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-23T18:07:55.526300] [DEBUG] [LOCAL ] CPA: Trimmed 42105 records to 28837 (keeping 200 days of data) [2025-09-23T18:07:55.711633] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T18:07:55.748588] [DEBUG] [LOCAL ] CP: Primary data saved (53279 records). [2025-09-23T18:07:55.749463] [INFO ] [MAIN ] CP: Full history saved. [2025-09-23T18:07:55.749828] [INFO ] [MAIN ] Update Progress: 515/2372 symbols completed. CP took 35.6s. Estimated remaining: 4h 4m 45s. Rate: 7.6 symbols/min [2025-09-23T18:07:55.959285] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:55.990597] [DEBUG] [LOCAL ] CPK: Loaded 13280 existing records from primary storage. [2025-09-23T18:07:55.991554] [INFO ] [MAIN ] CPK: Loaded 13280 existing records. [2025-09-23T18:07:56.158566] [DEBUG] [LOCAL ] CPA: Primary data saved (28837 records). [2025-09-23T18:07:56.178769] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:56.178666] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-23T18:07:56.179040] [INFO ] [MAIN ] Update Progress: 516/2372 symbols completed. CPA took 30.2s. Estimated remaining: 4h 4m 10s. Rate: 7.6 symbols/min [2025-09-23T18:07:56.179166] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-23T18:07:56.222594] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-23T18:07:56.210298] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-23T18:07:56.251079] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-23T18:07:56.257239] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-23T18:07:56.478464] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:56.731041] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:56.749719] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:07:56.789411] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-09-23T18:07:56.789551] [INFO ] [MAIN ] CPNG: Loaded 53671 existing records. [2025-09-23T18:07:56.965831] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:56.966318] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-23T18:07:56.966514] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-23T18:07:56.967828] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-23T18:07:56.967889] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-23T18:07:57.012442] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-23T18:07:57.161719] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T18:07:57.345897] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:57.802261] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-23T18:07:58.039498] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T18:07:58.573273] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T18:07:58.602265] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-23T18:07:59.402293] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-23T18:07:59.773709] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T18:08:00.202262] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-23T18:08:00.985283] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T18:08:01.002201] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-23T18:08:01.335665] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T18:08:01.802190] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-23T18:08:01.841807] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T18:08:02.602235] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-23T18:08:02.825816] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T18:08:03.191533] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T18:08:03.402213] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-23T18:08:04.202211] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-23T18:08:05.002253] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-23T18:08:05.020204] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T18:08:05.545261] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T18:08:05.802208] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-23T18:08:06.350360] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:08:06.602224] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-23T18:08:06.659164] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-23T18:08:07.402195] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-23T18:08:08.202225] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-23T18:08:08.299092] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T18:08:08.544147] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T18:08:08.747288] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T18:08:09.002209] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-23T18:08:09.601446] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T18:08:09.802230] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-23T18:08:10.602253] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-23T18:08:11.402200] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-23T18:08:11.521437] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T18:08:11.911446] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T18:08:12.202312] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-23T18:08:12.463554] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T18:08:12.851749] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:08:13.002233] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-23T18:08:13.802265] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-23T18:08:14.448379] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T18:08:14.602229] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-23T18:08:15.167569] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T18:08:15.402219] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-23T18:08:15.677840] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T18:08:16.045235] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T18:08:16.202239] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-23T18:08:16.886318] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:08:17.002190] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-23T18:08:17.802257] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-23T18:08:18.602219] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-23T18:08:18.765436] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T18:08:19.013776] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T18:08:19.402238] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-23T18:08:19.551690] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:08:20.202243] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-23T18:08:20.398695] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T18:08:20.404149] [INFO ] [REMOTE ] CPAY: Full fetch complete (45282 records). [2025-09-23T18:08:20.404296] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-23T18:08:20.839126] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-23T18:08:20.839261] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-23T18:08:20.840303] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-23T18:08:20.840382] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-23T18:08:20.842009] [DEBUG] [LOCAL ] CPAY: Trimmed 45282 records to 31109 (keeping 200 days of data) [2025-09-23T18:08:20.950247] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T18:08:20.958135] [INFO ] [REMOTE ] CPF: Full fetch complete (24233 records). [2025-09-23T18:08:20.958535] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-23T18:08:21.005234] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-23T18:08:21.391511] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-23T18:08:21.392226] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-23T18:08:21.393552] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-23T18:08:21.393671] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-23T18:08:21.396311] [DEBUG] [LOCAL ] CPF: Trimmed 24233 records to 15434 (keeping 200 days of data) [2025-09-23T18:08:21.565244] [DEBUG] [LOCAL ] CPAY: Primary data saved (31109 records). [2025-09-23T18:08:21.566959] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-23T18:08:21.567471] [INFO ] [MAIN ] Update Progress: 517/2372 symbols completed. CPAY took 34.3s. Estimated remaining: 4h 5m 5s. Rate: 7.6 symbols/min [2025-09-23T18:08:21.576954] [DEBUG] [LOCAL ] CPF: Primary data saved (15434 records). [2025-09-23T18:08:21.577141] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-23T18:08:21.577251] [INFO ] [MAIN ] Update Progress: 518/2372 symbols completed. CPF took 29.4s. Estimated remaining: 4h 4m 29s. Rate: 7.6 symbols/min [2025-09-23T18:08:21.802220] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-23T18:08:22.669574] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T18:08:22.672488] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-23T18:08:23.030499] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T18:08:23.402260] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-23T18:08:23.580873] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T18:08:23.584336] [INFO ] [REMOTE ] CPK: Full fetch complete (17634 records). [2025-09-23T18:08:23.584418] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-23T18:08:23.979439] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-23T18:08:23.979525] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-23T18:08:23.979908] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-23T18:08:23.979969] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-23T18:08:23.980705] [DEBUG] [LOCAL ] CPK: Trimmed 17634 records to 13338 (keeping 200 days of data) [2025-09-23T18:08:24.077430] [DEBUG] [LOCAL ] CPK: Primary data saved (13338 records). [2025-09-23T18:08:24.077638] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-23T18:08:24.077848] [INFO ] [MAIN ] Update Progress: 519/2372 symbols completed. CPK took 28.3s. Estimated remaining: 4h 4m 1s. Rate: 7.6 symbols/min [2025-09-23T18:08:25.306931] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T18:08:25.319461] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-23T18:08:27.458802] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-23T18:08:27.470408] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-23T18:08:29.447742] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T18:08:29.457311] [INFO ] [REMOTE ] CPNG: Full fetch complete (77667 records). [2025-09-23T18:08:29.457490] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-23T18:08:29.864342] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-23T18:08:29.864424] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-23T18:08:29.865287] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-23T18:08:29.865349] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-23T18:08:29.867474] [DEBUG] [LOCAL ] CPNG: Trimmed 77667 records to 53670 (keeping 200 days of data) [2025-09-23T18:08:30.202866] [DEBUG] [LOCAL ] CPNG: Primary data saved (53670 records). [2025-09-23T18:08:30.203181] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-23T18:08:30.203415] [INFO ] [MAIN ] Update Progress: 520/2372 symbols completed. CPNG took 34.0s. Estimated remaining: 4h 3m 47s. Rate: 7.6 symbols/min [2025-09-23T18:08:30.786245] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:30.874405] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:30.999516] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:31.004770] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:31.046866] [DEBUG] [LOCAL ] CQP: Loaded 19936 existing records from primary storage. [2025-09-23T18:08:31.063578] [INFO ] [MAIN ] CQP: Loaded 19936 existing records. [2025-09-23T18:08:31.151128] [DEBUG] [LOCAL ] CPRI: Loaded 52583 existing records from primary storage. [2025-09-23T18:08:31.168702] [INFO ] [MAIN ] CPRI: Loaded 52583 existing records. [2025-09-23T18:08:31.249798] [DEBUG] [LOCAL ] CPS: Loaded 26249 existing records from primary storage. [2025-09-23T18:08:31.275260] [INFO ] [MAIN ] CPS: Loaded 26249 existing records. [2025-09-23T18:08:31.295792] [DEBUG] [LOCAL ] CPT: Loaded 44347 existing records from primary storage. [2025-09-23T18:08:31.339003] [INFO ] [MAIN ] CPT: Loaded 44347 existing records. [2025-09-23T18:08:31.635688] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:31.735814] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-23T18:08:31.767183] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-23T18:08:31.831553] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:31.871560] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-23T18:08:31.875072] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-23T18:08:31.875247] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-23T18:08:31.841894] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:31.874974] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:31.880610] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-23T18:08:31.906290] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-23T18:08:31.911931] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-23T18:08:31.917281] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-23T18:08:31.911783] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-23T18:08:31.917528] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-23T18:08:31.917460] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-23T18:08:31.947102] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-23T18:08:31.953307] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-23T18:08:31.982346] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-23T18:08:31.982270] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-23T18:08:33.179902] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:33.190707] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-23T18:08:33.395766] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:33.418929] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-23T18:08:33.424777] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:33.418632] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:33.425204] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-23T18:08:33.426746] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-23T18:08:34.218560] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:08:34.222899] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-23T18:08:34.374397] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T18:08:34.379128] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-23T18:08:34.645586] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T18:08:34.653390] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-23T18:08:34.980453] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:08:34.985539] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-23T18:08:35.139101] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:08:35.149775] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-23T18:08:35.263477] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T18:08:35.269355] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-23T18:08:35.751607] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:08:35.757010] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-23T18:08:35.955344] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:08:35.964516] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-23T18:08:36.055850] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:08:36.061469] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-23T18:08:36.628407] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T18:08:36.639476] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-23T18:08:36.757529] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T18:08:37.002176] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-23T18:08:37.071736] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:08:37.349069] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T18:08:37.662912] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T18:08:37.802168] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-23T18:08:37.903285] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T18:08:38.602160] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-23T18:08:39.010080] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T18:08:39.402219] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-23T18:08:40.202161] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-23T18:08:40.334728] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T18:08:40.379050] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T18:08:41.002150] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-23T18:08:41.038157] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T18:08:41.802222] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-23T18:08:42.546042] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:08:42.602192] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-23T18:08:42.983807] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:08:43.402244] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-23T18:08:44.179497] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T18:08:44.202297] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-23T18:08:44.558456] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T18:08:44.733333] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T18:08:45.002192] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-23T18:08:45.676203] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:08:45.681979] [INFO ] [REMOTE ] CQP: Full fetch complete (30876 records). [2025-09-23T18:08:45.682287] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-23T18:08:45.807360] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-23T18:08:46.086354] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-23T18:08:46.086462] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-23T18:08:46.087212] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-23T18:08:46.087334] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-23T18:08:46.088534] [DEBUG] [LOCAL ] CQP: Trimmed 30876 records to 19922 (keeping 200 days of data) [2025-09-23T18:08:46.228154] [DEBUG] [LOCAL ] CQP: Primary data saved (19922 records). [2025-09-23T18:08:46.228435] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-23T18:08:46.228602] [INFO ] [MAIN ] Update Progress: 521/2372 symbols completed. CQP took 16.0s. Estimated remaining: 4h 4m 8s. Rate: 7.6 symbols/min [2025-09-23T18:08:46.403374] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:46.436057] [DEBUG] [LOCAL ] CR: Loaded 24776 existing records from primary storage. [2025-09-23T18:08:46.436329] [INFO ] [MAIN ] CR: Loaded 24776 existing records. [2025-09-23T18:08:46.605036] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-23T18:08:46.628850] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:46.630978] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-23T18:08:46.631123] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-23T18:08:46.632310] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-23T18:08:46.632397] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-23T18:08:46.997390] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:47.402170] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-23T18:08:47.451304] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T18:08:48.084811] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:08:48.202205] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-23T18:08:48.276996] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T18:08:49.002193] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-23T18:08:49.697750] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T18:08:49.802213] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-23T18:08:50.514307] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T18:08:50.602216] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-23T18:08:51.406288] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-23T18:08:51.411783] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:08:51.467994] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T18:08:52.202207] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-23T18:08:53.002202] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-23T18:08:53.209725] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T18:08:53.339848] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:08:53.756342] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T18:08:53.802206] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-23T18:08:54.602227] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-23T18:08:55.410065] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-23T18:08:55.415628] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T18:08:55.625849] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:08:56.202164] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-23T18:08:56.286689] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:08:56.973077] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T18:08:57.002150] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-23T18:08:57.802150] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-23T18:08:58.268037] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T18:08:58.602220] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-23T18:08:59.022597] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T18:08:59.402211] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-23T18:09:00.121468] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:09:00.202158] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-23T18:09:00.234121] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:09:00.238476] [INFO ] [REMOTE ] CPS: Full fetch complete (36292 records). [2025-09-23T18:09:00.238562] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-23T18:09:00.629978] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-23T18:09:00.630074] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-23T18:09:00.630719] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-23T18:09:00.630783] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-23T18:09:00.633176] [DEBUG] [LOCAL ] CPS: Trimmed 36292 records to 26259 (keeping 200 days of data) [2025-09-23T18:09:00.812204] [DEBUG] [LOCAL ] CPS: Primary data saved (26259 records). [2025-09-23T18:09:00.812364] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-23T18:09:00.812479] [INFO ] [MAIN ] Update Progress: 522/2372 symbols completed. CPS took 30.6s. Estimated remaining: 4h 4m 24s. Rate: 7.6 symbols/min [2025-09-23T18:09:00.997110] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:00.997339] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-23T18:09:00.997396] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-23T18:09:00.997563] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-23T18:09:00.997606] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-23T18:09:00.997684] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-23T18:09:00.997739] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-23T18:09:01.009286] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-23T18:09:01.357626] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:01.802260] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-23T18:09:01.895808] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T18:09:01.902835] [INFO ] [REMOTE ] CPT: Full fetch complete (63196 records). [2025-09-23T18:09:01.902949] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-23T18:09:01.905054] [FATAL] [VALIDATOR ] CPT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:09:01.905211] [FATAL] [MAIN ] CPT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:09:01.905275] [WARN ] [MAIN ] CPT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:09:01.905350] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-23T18:09:01.905416] [DEBUG] [LOCAL ] CPT: No primary data file found to delete. [2025-09-23T18:09:01.905470] [INFO ] [LOCAL ] CPT: Starting deletion of derivative data. [2025-09-23T18:09:01.906025] [DEBUG] [LOCAL ] CPT: Deleted derivative data file. [2025-09-23T18:09:01.906123] [INFO ] [MAIN ] Update Progress: 523/2372 symbols completed. CPT took 31.7s. Estimated remaining: 4h 3m 52s. Rate: 7.6 symbols/min [2025-09-23T18:09:02.074354] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:02.074550] [DEBUG] [LOCAL ] CRBG: No existing data file found in primary storage. [2025-09-23T18:09:02.074587] [WARN ] [MAIN ] CRBG: No existing data found, performing full refresh instead. [2025-09-23T18:09:02.074758] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-23T18:09:02.074805] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-23T18:09:02.074846] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-09-23T18:09:02.074876] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-23T18:09:02.435493] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:02.602276] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-23T18:09:03.402164] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-23T18:09:03.471054] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-23T18:09:03.480724] [INFO ] [REMOTE ] CPRI: Full fetch complete (76176 records). [2025-09-23T18:09:03.480910] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-23T18:09:03.876810] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-23T18:09:03.876892] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-23T18:09:03.877803] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-23T18:09:03.877868] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-23T18:09:03.879345] [DEBUG] [LOCAL ] CPRI: Trimmed 76176 records to 52595 (keeping 200 days of data) [2025-09-23T18:09:04.208322] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-23T18:09:04.214901] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-23T18:09:04.229846] [DEBUG] [LOCAL ] CPRI: Primary data saved (52595 records). [2025-09-23T18:09:04.230008] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-23T18:09:04.230121] [INFO ] [MAIN ] Update Progress: 524/2372 symbols completed. CPRI took 34.0s. Estimated remaining: 4h 3m 24s. Rate: 7.6 symbols/min [2025-09-23T18:09:04.408786] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:04.425452] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T18:09:04.470447] [DEBUG] [LOCAL ] CRC: Loaded 44421 existing records from primary storage. [2025-09-23T18:09:04.470601] [INFO ] [MAIN ] CRC: Loaded 44421 existing records. [2025-09-23T18:09:04.646240] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:04.646487] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-23T18:09:04.646533] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-23T18:09:04.647971] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-23T18:09:04.648034] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-23T18:09:05.008806] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-23T18:09:05.011893] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:05.043183] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-23T18:09:05.192865] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:09:05.560308] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T18:09:05.802232] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-23T18:09:06.602214] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-23T18:09:06.620381] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T18:09:07.402242] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-23T18:09:07.934418] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T18:09:08.202264] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-23T18:09:09.002219] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-23T18:09:09.247498] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T18:09:09.474279] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T18:09:09.802231] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-23T18:09:10.005361] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:09:10.308823] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T18:09:10.602210] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-23T18:09:11.076343] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T18:09:11.402179] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-23T18:09:11.941373] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T18:09:12.202198] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-23T18:09:13.002267] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-23T18:09:13.802196] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-23T18:09:13.957038] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T18:09:14.086690] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T18:09:14.220060] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T18:09:14.602306] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-23T18:09:15.402194] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-23T18:09:16.125212] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:09:16.129938] [INFO ] [REMOTE ] CR: Full fetch complete (34971 records). [2025-09-23T18:09:16.130032] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-23T18:09:16.207357] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-23T18:09:16.514560] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-23T18:09:16.514667] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-23T18:09:16.515229] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-23T18:09:16.515291] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-23T18:09:16.516106] [DEBUG] [LOCAL ] CR: Trimmed 34971 records to 24782 (keeping 200 days of data) [2025-09-23T18:09:16.672299] [DEBUG] [LOCAL ] CR: Primary data saved (24782 records). [2025-09-23T18:09:16.672433] [INFO ] [MAIN ] CR: Full history saved. [2025-09-23T18:09:16.672515] [INFO ] [MAIN ] Update Progress: 525/2372 symbols completed. CR took 30.4s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-23T18:09:16.844406] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:16.844585] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-23T18:09:16.844621] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-23T18:09:16.844782] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-23T18:09:16.844823] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-23T18:09:16.844864] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-23T18:09:16.844896] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-23T18:09:17.003873] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-23T18:09:17.210733] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:17.728716] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T18:09:17.802165] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-23T18:09:17.928144] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T18:09:18.537816] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-23T18:09:18.562243] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T18:09:18.602144] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-23T18:09:19.081882] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T18:09:19.402204] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-23T18:09:20.202227] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-23T18:09:20.442449] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:20.442797] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-23T18:09:21.002248] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-23T18:09:21.467752] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-23T18:09:21.802211] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-23T18:09:22.366506] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T18:09:22.381183] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T18:09:22.383559] [INFO ] [REMOTE ] CRBD: Full fetch complete (15456 records). [2025-09-23T18:09:22.383636] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-23T18:09:22.563848] [WARN ] [VALIDATOR ] CRBD: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T18:09:22.564145] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:09:22.564213] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:09:22.564281] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-23T18:09:22.564346] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-23T18:09:22.564382] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-23T18:09:22.564421] [DEBUG] [LOCAL ] CRBD: No derivative data file found to delete. [2025-09-23T18:09:22.564477] [INFO ] [MAIN ] Update Progress: 526/2372 symbols completed. CRBD took 21.8s. Estimated remaining: 4h 3m 17s. Rate: 7.6 symbols/min [2025-09-23T18:09:22.607335] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-23T18:09:22.738228] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:22.794078] [DEBUG] [LOCAL ] CRGY: Loaded 52511 existing records from primary storage. [2025-09-23T18:09:22.794269] [INFO ] [MAIN ] CRGY: Loaded 52511 existing records. [2025-09-23T18:09:22.892138] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:22.894974] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-23T18:09:22.972187] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:22.972437] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-23T18:09:22.972484] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-23T18:09:22.973905] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-23T18:09:22.973967] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-23T18:09:23.324733] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:23.402167] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-23T18:09:24.202189] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-23T18:09:24.412159] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:24.412479] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-23T18:09:24.481865] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T18:09:25.002236] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-23T18:09:25.802217] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-23T18:09:26.545997] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:09:26.602188] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-23T18:09:27.271312] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:09:27.402193] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-23T18:09:27.731614] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:09:28.202229] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-23T18:09:29.002214] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-23T18:09:29.086450] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T18:09:29.563548] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:09:29.802205] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-23T18:09:30.602170] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-23T18:09:30.634544] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T18:09:31.001700] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T18:09:31.402205] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-23T18:09:32.202252] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-23T18:09:32.410626] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:32.411098] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-23T18:09:32.591111] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T18:09:32.657848] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T18:09:33.002231] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-23T18:09:33.359221] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:33.359570] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-23T18:09:33.802192] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-23T18:09:34.602192] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-23T18:09:35.278409] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T18:09:35.402160] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-23T18:09:36.202171] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-23T18:09:36.321960] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T18:09:36.330959] [INFO ] [REMOTE ] CRC: Full fetch complete (62186 records). [2025-09-23T18:09:36.331136] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-23T18:09:36.441481] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:36.452978] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-23T18:09:36.740487] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-23T18:09:36.740755] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-23T18:09:36.741483] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-23T18:09:36.741530] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-23T18:09:36.743143] [DEBUG] [LOCAL ] CRC: Trimmed 62186 records to 44375 (keeping 200 days of data) [2025-09-23T18:09:37.003383] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T18:09:37.003797] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-23T18:09:37.075150] [DEBUG] [LOCAL ] CRC: Primary data saved (44375 records). [2025-09-23T18:09:37.075300] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-23T18:09:37.075390] [INFO ] [MAIN ] Update Progress: 527/2372 symbols completed. CRC took 32.8s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-23T18:09:37.288461] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:37.344868] [DEBUG] [LOCAL ] CRH: Loaded 53472 existing records from primary storage. [2025-09-23T18:09:37.345032] [INFO ] [MAIN ] CRH: Loaded 53472 existing records. [2025-09-23T18:09:37.519145] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:37.519408] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-23T18:09:37.519463] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-23T18:09:37.521827] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-23T18:09:37.521891] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-23T18:09:37.802316] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-23T18:09:37.889245] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:38.602211] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-23T18:09:38.968369] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T18:09:39.402191] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-23T18:09:39.974993] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-23T18:09:40.202214] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-23T18:09:40.655775] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T18:09:40.861051] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T18:09:41.002227] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-23T18:09:41.565756] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T18:09:41.575160] [INFO ] [REMOTE ] CRBG: Full fetch complete (75693 records). [2025-09-23T18:09:41.575365] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-23T18:09:41.813001] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-23T18:09:41.995308] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-23T18:09:41.995455] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-23T18:09:41.996545] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-23T18:09:41.996635] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-23T18:09:41.999259] [DEBUG] [LOCAL ] CRBG: Trimmed 75693 records to 52352 (keeping 200 days of data) [2025-09-23T18:09:42.342790] [DEBUG] [LOCAL ] CRBG: Primary data saved (52352 records). [2025-09-23T18:09:42.342963] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-23T18:09:42.343051] [INFO ] [MAIN ] Update Progress: 528/2372 symbols completed. CRBG took 40.4s. Estimated remaining: 4h 3m 15s. Rate: 7.6 symbols/min [2025-09-23T18:09:42.521622] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:42.560859] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T18:09:42.612096] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-23T18:09:42.615163] [DEBUG] [LOCAL ] CRI: Loaded 49968 existing records from primary storage. [2025-09-23T18:09:42.615321] [INFO ] [MAIN ] CRI: Loaded 49968 existing records. [2025-09-23T18:09:42.794098] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:42.794369] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-23T18:09:42.794418] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-23T18:09:42.795894] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-23T18:09:42.795956] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-23T18:09:43.169767] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:43.404095] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-23T18:09:43.403889] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T18:09:44.202311] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-23T18:09:44.591260] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T18:09:44.810616] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T18:09:45.002179] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-23T18:09:45.802244] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-23T18:09:46.535461] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T18:09:46.602212] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-23T18:09:47.007933] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-23T18:09:47.261341] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T18:09:47.402187] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-23T18:09:47.755683] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T18:09:48.202214] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-23T18:09:49.002222] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-23T18:09:49.193790] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T18:09:49.202715] [INFO ] [REMOTE ] CRGY: Full fetch complete (75955 records). [2025-09-23T18:09:49.202850] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-23T18:09:49.594628] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-23T18:09:49.594757] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-23T18:09:49.595595] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-23T18:09:49.595724] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-23T18:09:49.597718] [DEBUG] [LOCAL ] CRGY: Trimmed 75955 records to 52511 (keeping 200 days of data) [2025-09-23T18:09:49.714624] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T18:09:49.807107] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-23T18:09:49.950962] [DEBUG] [LOCAL ] CRGY: Primary data saved (52511 records). [2025-09-23T18:09:49.951101] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-23T18:09:49.951181] [INFO ] [MAIN ] Update Progress: 529/2372 symbols completed. CRGY took 27.4s. Estimated remaining: 4h 3m 6s. Rate: 7.6 symbols/min [2025-09-23T18:09:50.122892] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:50.175366] [DEBUG] [LOCAL ] CRK: Loaded 52118 existing records from primary storage. [2025-09-23T18:09:50.175632] [INFO ] [MAIN ] CRK: Loaded 52118 existing records. [2025-09-23T18:09:50.362215] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:50.362707] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-23T18:09:50.362830] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-23T18:09:50.373497] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-23T18:09:50.390593] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-23T18:09:50.398239] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T18:09:50.612764] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-23T18:09:50.774128] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:51.402202] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-23T18:09:52.202156] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-23T18:09:52.389661] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-23T18:09:52.828280] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T18:09:52.968026] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-23T18:09:53.002163] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-23T18:09:53.802213] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-23T18:09:53.939070] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T18:09:54.602253] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-23T18:09:55.263627] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T18:09:55.402215] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-23T18:09:55.518197] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-23T18:09:55.527273] [INFO ] [REMOTE ] CRCL: Full fetch complete (29439 records). [2025-09-23T18:09:55.527387] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-23T18:09:55.719820] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 76 unique days, need 200 days [2025-09-23T18:09:55.720340] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:09:55.720444] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:09:55.720521] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-23T18:09:55.720598] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-23T18:09:55.720636] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-23T18:09:55.720739] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-23T18:09:55.720834] [INFO ] [MAIN ] Update Progress: 530/2372 symbols completed. CRCL took 39.0s. Estimated remaining: 4h 2m 51s. Rate: 7.6 symbols/min [2025-09-23T18:09:55.895272] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:55.947445] [DEBUG] [LOCAL ] CRL: Loaded 43362 existing records from primary storage. [2025-09-23T18:09:55.947715] [INFO ] [MAIN ] CRL: Loaded 43362 existing records. [2025-09-23T18:09:56.144762] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:56.145280] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-23T18:09:56.145359] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-23T18:09:56.146780] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-23T18:09:56.146850] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-23T18:09:56.213692] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-23T18:09:56.508193] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T18:09:56.580925] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:56.649218] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T18:09:57.002228] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-23T18:09:57.726151] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T18:09:57.802159] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-23T18:09:58.602209] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-23T18:09:58.880154] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T18:09:59.169079] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:09:59.402215] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-23T18:10:00.016548] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:10:00.202245] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-23T18:10:01.002172] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-23T18:10:01.264717] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T18:10:01.491394] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T18:10:01.802280] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-23T18:10:02.602223] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-23T18:10:02.997246] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:10:03.241490] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-23T18:10:03.402264] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-23T18:10:04.055336] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:10:04.202246] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-23T18:10:04.735992] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T18:10:05.002252] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-23T18:10:05.639436] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T18:10:05.647520] [INFO ] [REMOTE ] CRI: Full fetch complete (70864 records). [2025-09-23T18:10:05.647678] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-23T18:10:05.805989] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-23T18:10:06.038545] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-23T18:10:06.038632] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-23T18:10:06.039425] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-23T18:10:06.039476] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-23T18:10:06.040893] [DEBUG] [LOCAL ] CRI: Trimmed 70864 records to 49985 (keeping 200 days of data) [2025-09-23T18:10:06.354062] [DEBUG] [LOCAL ] CRI: Primary data saved (49985 records). [2025-09-23T18:10:06.354209] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-23T18:10:06.354311] [INFO ] [MAIN ] Update Progress: 531/2372 symbols completed. CRI took 24.0s. Estimated remaining: 4h 2m 52s. Rate: 7.6 symbols/min [2025-09-23T18:10:06.539923] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:06.603946] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-23T18:10:06.607862] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:10:06.637530] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-23T18:10:06.637727] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-09-23T18:10:06.836749] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:06.837086] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-23T18:10:06.837148] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-23T18:10:06.838894] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-23T18:10:06.838961] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-23T18:10:07.204432] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:07.402146] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-23T18:10:07.526144] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T18:10:08.199413] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T18:10:08.207911] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-23T18:10:09.002216] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-23T18:10:09.802177] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-23T18:10:09.947912] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-23T18:10:10.017250] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T18:10:10.334193] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:10:10.602195] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-23T18:10:11.402160] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-23T18:10:11.528529] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T18:10:12.068407] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:10:12.202225] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-23T18:10:13.002271] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-23T18:10:13.777287] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-23T18:10:13.802156] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-23T18:10:14.467738] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T18:10:14.535777] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:10:14.602183] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-23T18:10:15.402216] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-23T18:10:15.921440] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-23T18:10:16.191817] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T18:10:16.200498] [INFO ] [REMOTE ] CRK: Full fetch complete (75514 records). [2025-09-23T18:10:16.200677] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-23T18:10:16.212762] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-23T18:10:16.633919] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-23T18:10:16.634067] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-23T18:10:16.634916] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-23T18:10:16.634982] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-23T18:10:16.636571] [DEBUG] [LOCAL ] CRK: Trimmed 75514 records to 52121 (keeping 200 days of data) [2025-09-23T18:10:16.942343] [DEBUG] [LOCAL ] CRK: Primary data saved (52121 records). [2025-09-23T18:10:16.942501] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-23T18:10:16.942616] [INFO ] [MAIN ] Update Progress: 532/2372 symbols completed. CRK took 27.0s. Estimated remaining: 4h 2m 54s. Rate: 7.6 symbols/min [2025-09-23T18:10:17.011921] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-23T18:10:17.134403] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:17.178879] [DEBUG] [LOCAL ] CRS: Loaded 43444 existing records from primary storage. [2025-09-23T18:10:17.179060] [INFO ] [MAIN ] CRS: Loaded 43444 existing records. [2025-09-23T18:10:17.335796] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T18:10:17.381000] [INFO ] [REMOTE ] CRH: Full fetch complete (77299 records). [2025-09-23T18:10:17.394404] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-23T18:10:17.405842] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:17.406199] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-23T18:10:17.406260] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-23T18:10:17.429358] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-23T18:10:17.429456] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-23T18:10:18.246827] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:18.247414] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-23T18:10:18.248533] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-23T18:10:18.248700] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-23T18:10:18.249612] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-23T18:10:18.249862] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-23T18:10:18.279552] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T18:10:18.279761] [DEBUG] [LOCAL ] CRH: Trimmed 77299 records to 53472 (keeping 200 days of data) [2025-09-23T18:10:18.602866] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-23T18:10:18.629341] [DEBUG] [LOCAL ] CRH: Primary data saved (53472 records). [2025-09-23T18:10:18.629493] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-23T18:10:18.629587] [INFO ] [MAIN ] Update Progress: 533/2372 symbols completed. CRH took 41.6s. Estimated remaining: 4h 2m 24s. Rate: 7.6 symbols/min [2025-09-23T18:10:18.799899] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:18.806170] [DEBUG] [LOCAL ] CRT: Loaded 4932 existing records from primary storage. [2025-09-23T18:10:18.806256] [INFO ] [MAIN ] CRT: Loaded 4932 existing records. [2025-09-23T18:10:18.988323] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:18.988827] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-23T18:10:18.988993] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-23T18:10:18.989470] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-23T18:10:18.989568] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-23T18:10:19.347891] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:19.378465] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-23T18:10:19.402154] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-23T18:10:19.778722] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:10:19.983107] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T18:10:19.996950] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T18:10:20.202201] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-23T18:10:21.002192] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-23T18:10:21.802221] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-23T18:10:22.208025] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T18:10:22.320717] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-23T18:10:22.602200] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-23T18:10:23.068421] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:10:23.402206] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-23T18:10:24.202201] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-23T18:10:24.704364] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T18:10:24.963187] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:10:25.002151] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-23T18:10:25.082857] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-23T18:10:25.802233] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-23T18:10:26.602215] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-23T18:10:26.765321] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T18:10:27.009630] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T18:10:27.043624] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T18:10:27.402256] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-23T18:10:28.202235] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-23T18:10:28.622322] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T18:10:29.002230] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-23T18:10:29.495590] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T18:10:29.498918] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T18:10:29.802193] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-23T18:10:30.602242] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-23T18:10:31.072962] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T18:10:31.082619] [INFO ] [REMOTE ] CRL: Full fetch complete (62374 records). [2025-09-23T18:10:31.082782] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-23T18:10:31.083703] [FATAL] [VALIDATOR ] CRL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:10:31.083806] [FATAL] [MAIN ] CRL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:10:31.083850] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:10:31.083892] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-23T18:10:31.083974] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-23T18:10:31.084033] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-09-23T18:10:31.084482] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-09-23T18:10:31.084595] [INFO ] [MAIN ] Update Progress: 534/2372 symbols completed. CRL took 35.4s. Estimated remaining: 4h 2m 32s. Rate: 7.6 symbols/min [2025-09-23T18:10:31.256054] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:31.297695] [DEBUG] [LOCAL ] CSAN: Loaded 42137 existing records from primary storage. [2025-09-23T18:10:31.297865] [INFO ] [MAIN ] CSAN: Loaded 42137 existing records. [2025-09-23T18:10:31.407357] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-23T18:10:31.481142] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:31.481381] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-23T18:10:31.481429] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-23T18:10:31.482429] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-23T18:10:31.482494] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-23T18:10:31.902380] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:32.202255] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-23T18:10:33.002224] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-23T18:10:33.157712] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-23T18:10:33.319551] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T18:10:33.433827] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T18:10:33.461232] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T18:10:33.802240] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-23T18:10:34.602192] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-23T18:10:35.402268] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-23T18:10:35.941167] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:10:36.007537] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T18:10:36.014702] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T18:10:36.202269] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-23T18:10:37.002271] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-23T18:10:37.343712] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T18:10:37.440427] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T18:10:37.802202] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-23T18:10:38.602231] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-23T18:10:38.981878] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:10:39.059062] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:10:39.402491] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-23T18:10:40.202189] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-23T18:10:41.002202] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-23T18:10:41.767537] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-23T18:10:41.783093] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-23T18:10:41.783290] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-23T18:10:41.813755] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-23T18:10:42.262288] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-23T18:10:42.259815] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-23T18:10:42.271753] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-23T18:10:42.273097] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-23T18:10:42.273269] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-23T18:10:42.280110] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-09-23T18:10:42.410197] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:10:42.579245] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T18:10:42.583063] [INFO ] [REMOTE ] CRT: Full fetch complete (7625 records). [2025-09-23T18:10:42.583399] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-23T18:10:42.607402] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-23T18:10:43.042681] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-23T18:10:43.043115] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-23T18:10:43.043888] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-23T18:10:43.044816] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-23T18:10:43.047619] [DEBUG] [LOCAL ] CRT: Trimmed 7625 records to 4954 (keeping 200 days of data) [2025-09-23T18:10:43.083180] [DEBUG] [LOCAL ] CRT: Primary data saved (4954 records). [2025-09-23T18:10:43.083861] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-23T18:10:43.084293] [INFO ] [MAIN ] Update Progress: 535/2372 symbols completed. CRT took 24.5s. Estimated remaining: 4h 2m 38s. Rate: 7.6 symbols/min [2025-09-23T18:10:43.270367] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:43.284934] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-23T18:10:43.285087] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-23T18:10:43.290061] [INFO ] [MAIN ] Update Progress: 536/2372 symbols completed. CRM took 36.9s. Estimated remaining: 4h 2m 4s. Rate: 7.6 symbols/min [2025-09-23T18:10:43.406277] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-23T18:10:43.488303] [DEBUG] [LOCAL ] CSL: Loaded 31486 existing records from primary storage. [2025-09-23T18:10:43.518455] [INFO ] [MAIN ] CSL: Loaded 31486 existing records. [2025-09-23T18:10:43.518031] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:43.710976] [DEBUG] [LOCAL ] CSR: Loaded 12483 existing records from primary storage. [2025-09-23T18:10:43.726956] [INFO ] [MAIN ] CSR: Loaded 12483 existing records. [2025-09-23T18:10:43.733047] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:43.816542] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-23T18:10:43.838159] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-23T18:10:43.844957] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-23T18:10:43.878334] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-23T18:10:44.006966] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:44.036699] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-23T18:10:44.072188] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-23T18:10:44.110872] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-23T18:10:44.149500] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-23T18:10:44.514087] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:44.536841] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-23T18:10:44.736266] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:44.764875] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T18:10:44.803360] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T18:10:45.002190] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-23T18:10:45.802180] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-23T18:10:46.105282] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T18:10:46.350703] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:10:46.500952] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-23T18:10:46.602195] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-23T18:10:47.402208] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-23T18:10:47.945126] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:10:48.147185] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T18:10:48.202149] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-23T18:10:48.703616] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T18:10:49.002212] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-23T18:10:49.789944] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T18:10:49.802139] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-23T18:10:50.602216] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-23T18:10:50.792894] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T18:10:51.402263] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-23T18:10:51.711460] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T18:10:52.018599] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T18:10:52.202251] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-23T18:10:53.002214] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-23T18:10:53.452060] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:10:53.459311] [INFO ] [REMOTE ] CRS: Full fetch complete (62522 records). [2025-09-23T18:10:53.459509] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-23T18:10:53.807395] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-23T18:10:53.862298] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-23T18:10:53.862384] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-23T18:10:53.863141] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-23T18:10:53.863206] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-23T18:10:53.865878] [DEBUG] [LOCAL ] CRS: Trimmed 62522 records to 43423 (keeping 200 days of data) [2025-09-23T18:10:54.165137] [DEBUG] [LOCAL ] CRS: Primary data saved (43423 records). [2025-09-23T18:10:54.165396] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-23T18:10:54.165874] [INFO ] [MAIN ] Update Progress: 537/2372 symbols completed. CRS took 37.2s. Estimated remaining: 4h 2m 6s. Rate: 7.6 symbols/min [2025-09-23T18:10:54.297773] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:10:54.393826] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:54.444942] [DEBUG] [LOCAL ] CSTM: Loaded 47773 existing records from primary storage. [2025-09-23T18:10:54.445087] [INFO ] [MAIN ] CSTM: Loaded 47773 existing records. [2025-09-23T18:10:54.625440] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-23T18:10:54.632331] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:54.640425] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-23T18:10:54.641417] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T18:10:54.641159] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-23T18:10:54.646195] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-23T18:10:54.646261] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-23T18:10:55.007235] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:55.402249] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-23T18:10:55.898700] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T18:10:56.202252] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-23T18:10:56.894048] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T18:10:57.002174] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-23T18:10:57.474057] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:10:57.802230] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-23T18:10:58.231710] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T18:10:58.500265] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T18:10:58.602263] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-23T18:10:59.402242] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-23T18:10:59.951205] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T18:11:00.164395] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:11:00.202173] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-23T18:11:01.002261] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-23T18:11:01.260738] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:11:01.802233] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-23T18:11:01.981257] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T18:11:02.602301] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-23T18:11:02.978413] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T18:11:02.981425] [INFO ] [REMOTE ] CSR: Full fetch complete (17427 records). [2025-09-23T18:11:02.981513] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-23T18:11:03.367740] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-23T18:11:03.367899] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-23T18:11:03.368229] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-23T18:11:03.368270] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-23T18:11:03.368829] [DEBUG] [LOCAL ] CSR: Trimmed 17427 records to 12558 (keeping 200 days of data) [2025-09-23T18:11:03.405177] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-23T18:11:03.450407] [DEBUG] [LOCAL ] CSR: Primary data saved (12558 records). [2025-09-23T18:11:03.450564] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-23T18:11:03.450723] [INFO ] [MAIN ] Update Progress: 538/2372 symbols completed. CSR took 20.2s. Estimated remaining: 4h 2m 3s. Rate: 7.6 symbols/min [2025-09-23T18:11:03.625295] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:03.640540] [DEBUG] [LOCAL ] CSV: Loaded 13038 existing records from primary storage. [2025-09-23T18:11:03.640695] [INFO ] [MAIN ] CSV: Loaded 13038 existing records. [2025-09-23T18:11:03.830869] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:11:03.831347] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-23T18:11:03.831465] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-23T18:11:03.832281] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-23T18:11:03.832349] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-23T18:11:03.930502] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T18:11:03.966521] [INFO ] [REMOTE ] CSAN: Full fetch complete (60839 records). [2025-09-23T18:11:03.977245] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-23T18:11:04.207822] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-23T18:11:04.554581] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:04.688464] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-23T18:11:04.688575] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-23T18:11:04.689388] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-23T18:11:04.689456] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-23T18:11:04.696867] [DEBUG] [LOCAL ] CSAN: Trimmed 60839 records to 42250 (keeping 200 days of data) [2025-09-23T18:11:04.708427] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:11:04.973037] [DEBUG] [LOCAL ] CSAN: Primary data saved (42250 records). [2025-09-23T18:11:04.973447] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-23T18:11:04.973580] [INFO ] [MAIN ] Update Progress: 539/2372 symbols completed. CSAN took 33.9s. Estimated remaining: 4h 1m 33s. Rate: 7.6 symbols/min [2025-09-23T18:11:05.007368] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-23T18:11:05.150353] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:05.150544] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-23T18:11:05.150600] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-23T18:11:05.150808] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-23T18:11:05.150851] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-23T18:11:05.150895] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-23T18:11:05.150996] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-23T18:11:05.512485] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:05.580436] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:11:05.802199] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-23T18:11:06.026321] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T18:11:06.602302] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-23T18:11:06.922882] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T18:11:07.402305] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-23T18:11:07.948358] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T18:11:08.202246] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-23T18:11:08.845076] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T18:11:08.943970] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T18:11:09.002231] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-23T18:11:09.802246] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-23T18:11:10.021246] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:10.021592] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-23T18:11:10.602166] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-23T18:11:10.759489] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T18:11:10.842338] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:10.842747] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-23T18:11:11.402190] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-23T18:11:12.202253] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-23T18:11:12.381122] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:11:13.002195] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-23T18:11:13.807409] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-23T18:11:13.825566] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T18:11:14.214806] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T18:11:14.223170] [INFO ] [REMOTE ] CSL: Full fetch complete (45081 records). [2025-09-23T18:11:14.223368] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-23T18:11:14.602694] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-23T18:11:14.642715] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T18:11:14.699029] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-23T18:11:14.699122] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-23T18:11:14.699924] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-23T18:11:14.699991] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-23T18:11:14.701221] [DEBUG] [LOCAL ] CSL: Trimmed 45081 records to 31553 (keeping 200 days of data) [2025-09-23T18:11:14.931156] [DEBUG] [LOCAL ] CSL: Primary data saved (31553 records). [2025-09-23T18:11:14.931316] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-23T18:11:14.931428] [INFO ] [MAIN ] Update Progress: 540/2372 symbols completed. CSL took 31.8s. Estimated remaining: 4h 1m 32s. Rate: 7.6 symbols/min [2025-09-23T18:11:15.106076] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:15.115869] [DEBUG] [LOCAL ] CTBB: Loaded 7179 existing records from primary storage. [2025-09-23T18:11:15.115977] [INFO ] [MAIN ] CTBB: Loaded 7179 existing records. [2025-09-23T18:11:15.299170] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:11:15.299463] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-23T18:11:15.299515] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-23T18:11:15.299918] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-23T18:11:15.299984] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-23T18:11:15.410143] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-23T18:11:15.654634] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:15.676189] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:15.676516] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-23T18:11:16.176438] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T18:11:16.202153] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-23T18:11:17.002246] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-23T18:11:17.802167] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-23T18:11:17.832474] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T18:11:18.013805] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:18.014116] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-23T18:11:18.255356] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T18:11:18.602223] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-23T18:11:19.402219] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-23T18:11:19.497990] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T18:11:20.202193] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-23T18:11:20.772586] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:11:20.817520] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:11:21.002206] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-23T18:11:21.504151] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T18:11:21.802192] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-23T18:11:22.180311] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T18:11:22.602216] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-23T18:11:23.402185] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-23T18:11:23.476215] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T18:11:24.048822] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T18:11:24.202230] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-23T18:11:24.400416] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:24.400820] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-23T18:11:25.002235] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-23T18:11:25.802233] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-23T18:11:26.291884] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:11:26.300583] [INFO ] [REMOTE ] CSTM: Full fetch complete (69011 records). [2025-09-23T18:11:26.300785] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-23T18:11:26.607326] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-23T18:11:26.688687] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:11:26.732791] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-23T18:11:26.733044] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-23T18:11:26.734481] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-23T18:11:26.734550] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-23T18:11:26.736086] [DEBUG] [LOCAL ] CSTM: Trimmed 69011 records to 47738 (keeping 200 days of data) [2025-09-23T18:11:26.834918] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:26.836622] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-23T18:11:27.035427] [DEBUG] [LOCAL ] CSTM: Primary data saved (47738 records). [2025-09-23T18:11:27.035564] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-23T18:11:27.035680] [INFO ] [MAIN ] Update Progress: 541/2372 symbols completed. CSTM took 32.9s. Estimated remaining: 4h 1m 38s. Rate: 7.6 symbols/min [2025-09-23T18:11:27.203834] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:27.211470] [DEBUG] [LOCAL ] CTDD: Loaded 5837 existing records from primary storage. [2025-09-23T18:11:27.211604] [INFO ] [MAIN ] CTDD: Loaded 5837 existing records. [2025-09-23T18:11:27.388011] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:11:27.388247] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-23T18:11:27.388294] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-23T18:11:27.388720] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-23T18:11:27.388781] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-23T18:11:27.408853] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-23T18:11:27.750819] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:27.974527] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T18:11:28.202242] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-23T18:11:28.663296] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T18:11:29.002253] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-23T18:11:29.623147] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T18:11:29.802205] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-23T18:11:30.602243] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-23T18:11:30.702756] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:11:31.186154] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T18:11:31.402257] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-23T18:11:31.996086] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T18:11:32.202194] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-23T18:11:32.839378] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:11:32.842242] [INFO ] [REMOTE ] CSV: Full fetch complete (19471 records). [2025-09-23T18:11:32.842344] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-23T18:11:33.016287] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-23T18:11:33.215623] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-23T18:11:33.215734] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-23T18:11:33.216113] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-23T18:11:33.216153] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-23T18:11:33.216846] [DEBUG] [LOCAL ] CSV: Trimmed 19471 records to 13081 (keeping 200 days of data) [2025-09-23T18:11:33.297324] [DEBUG] [LOCAL ] CSV: Primary data saved (13081 records). [2025-09-23T18:11:33.297476] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-23T18:11:33.297563] [INFO ] [MAIN ] Update Progress: 542/2372 symbols completed. CSV took 29.8s. Estimated remaining: 4h 1m 25s. Rate: 7.6 symbols/min [2025-09-23T18:11:33.469271] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:33.469490] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-23T18:11:33.469545] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-23T18:11:33.469731] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-23T18:11:33.469782] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-23T18:11:33.469824] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-23T18:11:33.469856] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-23T18:11:33.811255] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-23T18:11:33.834700] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:33.985520] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T18:11:34.407002] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T18:11:34.602201] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-23T18:11:34.982063] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T18:11:35.402245] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-23T18:11:35.982432] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:11:36.202259] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-23T18:11:36.745797] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:36.746124] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-23T18:11:37.002239] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-23T18:11:37.802213] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-23T18:11:38.099848] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T18:11:38.209375] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T18:11:38.602197] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-23T18:11:39.060423] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T18:11:39.402204] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-23T18:11:40.196196] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:11:40.202130] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-23T18:11:40.614716] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T18:11:41.002211] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-23T18:11:41.802214] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-23T18:11:41.945972] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:11:41.949148] [INFO ] [REMOTE ] CSW: Full fetch complete (7993 records). [2025-09-23T18:11:41.949218] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-23T18:11:42.130495] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-23T18:11:42.130780] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:11:42.130870] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:11:42.130945] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-23T18:11:42.131014] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-23T18:11:42.131064] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-23T18:11:42.131137] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-23T18:11:42.131213] [INFO ] [MAIN ] Update Progress: 543/2372 symbols completed. CSW took 37.2s. Estimated remaining: 4h 1m 20s. Rate: 7.6 symbols/min [2025-09-23T18:11:42.379557] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:42.380007] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-23T18:11:42.380065] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-23T18:11:42.380219] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-23T18:11:42.380263] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-23T18:11:42.380307] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-23T18:11:42.380340] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-23T18:11:42.508523] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T18:11:42.607297] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-23T18:11:42.770921] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:43.375292] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T18:11:43.402212] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-23T18:11:44.025861] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T18:11:44.027448] [INFO ] [REMOTE ] CTBB: Full fetch complete (10982 records). [2025-09-23T18:11:44.027519] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-23T18:11:44.214536] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-23T18:11:44.399982] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-23T18:11:44.400062] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-23T18:11:44.400354] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-23T18:11:44.400393] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-23T18:11:44.400869] [DEBUG] [LOCAL ] CTBB: Trimmed 10982 records to 7105 (keeping 200 days of data) [2025-09-23T18:11:44.443580] [DEBUG] [LOCAL ] CTBB: Primary data saved (7105 records). [2025-09-23T18:11:44.443722] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-23T18:11:44.443818] [INFO ] [MAIN ] Update Progress: 544/2372 symbols completed. CTBB took 29.5s. Estimated remaining: 4h 0m 53s. Rate: 7.6 symbols/min [2025-09-23T18:11:44.610881] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:44.611064] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-09-23T18:11:44.611100] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-09-23T18:11:44.611257] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-23T18:11:44.611298] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-23T18:11:44.611338] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-09-23T18:11:44.611371] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-23T18:11:44.791944] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T18:11:44.983801] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:45.002147] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-23T18:11:45.802199] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-23T18:11:46.260078] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:11:46.453906] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T18:11:46.602250] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-23T18:11:46.931679] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:46.932212] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-23T18:11:47.402269] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-23T18:11:47.619940] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:47.620531] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-23T18:11:48.202241] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-23T18:11:48.420965] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:48.421309] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-23T18:11:49.002203] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-23T18:11:49.196390] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:49.196821] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-23T18:11:49.802212] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-23T18:11:50.336422] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T18:11:50.338101] [INFO ] [REMOTE ] CTDD: Full fetch complete (8544 records). [2025-09-23T18:11:50.338189] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-23T18:11:50.607378] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-23T18:11:50.714680] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-23T18:11:50.714778] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-23T18:11:50.715036] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-23T18:11:50.715076] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-23T18:11:50.715530] [DEBUG] [LOCAL ] CTDD: Trimmed 8544 records to 5842 (keeping 200 days of data) [2025-09-23T18:11:50.751615] [DEBUG] [LOCAL ] CTDD: Primary data saved (5842 records). [2025-09-23T18:11:50.751768] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-23T18:11:50.751876] [INFO ] [MAIN ] Update Progress: 545/2372 symbols completed. CTDD took 23.7s. Estimated remaining: 4h 0m 40s. Rate: 7.6 symbols/min [2025-09-23T18:11:50.899441] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:50.923717] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:50.924354] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-23T18:11:50.961620] [DEBUG] [LOCAL ] CTOS: Loaded 36886 existing records from primary storage. [2025-09-23T18:11:50.961810] [INFO ] [MAIN ] CTOS: Loaded 36886 existing records. [2025-09-23T18:11:51.138597] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:11:51.138882] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-23T18:11:51.138932] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-23T18:11:51.140386] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-23T18:11:51.140449] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-23T18:11:51.407383] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-23T18:11:51.521195] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:51.656982] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:51.657239] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-23T18:11:52.202198] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-23T18:11:52.827611] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T18:11:53.002198] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-23T18:11:53.462743] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T18:11:53.802222] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-23T18:11:54.602261] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-23T18:11:55.131116] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T18:11:55.159202] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T18:11:55.402224] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-23T18:11:55.675969] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-23T18:11:56.202211] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-23T18:11:57.002231] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-23T18:11:57.156502] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T18:11:57.802196] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-23T18:11:57.933452] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:11:58.602213] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-23T18:11:58.690937] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T18:11:59.263946] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T18:11:59.402213] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-23T18:11:59.763841] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T18:12:00.202192] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-23T18:12:00.602961] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:12:00.603419] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-23T18:12:01.002219] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-23T18:12:01.802268] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-23T18:12:02.602258] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-23T18:12:02.715350] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T18:12:03.402246] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-23T18:12:04.202277] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-23T18:12:04.430409] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:12:04.430807] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-23T18:12:04.430927] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-23T18:12:04.430997] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-23T18:12:04.431628] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:12:04.431731] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:12:04.431798] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:12:04.431870] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-23T18:12:04.431934] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-23T18:12:04.431969] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-23T18:12:04.432022] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-23T18:12:04.432102] [INFO ] [MAIN ] Update Progress: 546/2372 symbols completed. CTEST took 31.1s. Estimated remaining: 4h 0m 52s. Rate: 7.6 symbols/min [2025-09-23T18:12:04.603607] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:04.656587] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-23T18:12:04.656782] [INFO ] [MAIN ] CTRA: Loaded 53649 existing records. [2025-09-23T18:12:04.832993] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:04.833235] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-23T18:12:04.833285] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-23T18:12:04.834875] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-23T18:12:04.834938] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-23T18:12:05.189665] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:05.190009] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-23T18:12:05.208414] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-23T18:12:05.802176] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-23T18:12:05.864292] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-23T18:12:05.949111] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T18:12:06.357465] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T18:12:06.602241] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-23T18:12:06.890793] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T18:12:07.402176] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-23T18:12:07.440312] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T18:12:08.202282] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-23T18:12:08.870747] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:12:09.002251] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-23T18:12:09.732295] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T18:12:09.802241] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-23T18:12:10.002008] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:12:10.540074] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T18:12:10.602234] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-23T18:12:11.402224] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-23T18:12:11.824476] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T18:12:12.047087] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:12:12.049563] [INFO ] [REMOTE ] CTEV: Full fetch complete (13486 records). [2025-09-23T18:12:12.049634] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-23T18:12:12.206677] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-23T18:12:12.234130] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-09-23T18:12:12.234369] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:12:12.234445] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:12:12.234492] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-23T18:12:12.234561] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-23T18:12:12.234615] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-23T18:12:12.234688] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-23T18:12:12.234762] [INFO ] [MAIN ] Update Progress: 547/2372 symbols completed. CTEV took 30.1s. Estimated remaining: 4h 0m 43s. Rate: 7.6 symbols/min [2025-09-23T18:12:12.403870] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:12.458618] [DEBUG] [LOCAL ] CTRE: Loaded 49213 existing records from primary storage. [2025-09-23T18:12:12.458807] [INFO ] [MAIN ] CTRE: Loaded 49213 existing records. [2025-09-23T18:12:12.635752] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:12.635967] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-23T18:12:12.636014] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-23T18:12:12.637843] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-23T18:12:12.637906] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-23T18:12:12.992467] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:13.002149] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-23T18:12:13.802189] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-23T18:12:13.840211] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T18:12:14.188959] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:12:14.602195] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-23T18:12:15.256610] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:12:15.402190] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-23T18:12:16.202173] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-23T18:12:16.505616] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T18:12:17.002236] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-23T18:12:17.706197] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-23T18:12:17.802184] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-23T18:12:18.241725] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T18:12:18.349272] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-23T18:12:18.602197] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-23T18:12:19.070045] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:12:19.402218] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-23T18:12:19.649547] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:12:20.202235] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-23T18:12:20.971857] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T18:12:21.002149] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-23T18:12:21.143469] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:12:21.149006] [INFO ] [REMOTE ] CTO: Full fetch complete (41854 records). [2025-09-23T18:12:21.149126] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-23T18:12:21.534299] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-23T18:12:21.534385] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-23T18:12:21.534960] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-23T18:12:21.535024] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-23T18:12:21.536074] [DEBUG] [LOCAL ] CTO: Trimmed 41854 records to 28318 (keeping 200 days of data) [2025-09-23T18:12:21.719658] [DEBUG] [LOCAL ] CTO: Primary data saved (28318 records). [2025-09-23T18:12:21.719815] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-23T18:12:21.719901] [INFO ] [MAIN ] Update Progress: 548/2372 symbols completed. CTO took 37.3s. Estimated remaining: 4h 0m 41s. Rate: 7.6 symbols/min [2025-09-23T18:12:21.807396] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-23T18:12:21.931296] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:21.970132] [DEBUG] [LOCAL ] CTRI: Loaded 37728 existing records from primary storage. [2025-09-23T18:12:21.970273] [INFO ] [MAIN ] CTRI: Loaded 37728 existing records. [2025-09-23T18:12:22.150897] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:22.151183] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-23T18:12:22.151231] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-23T18:12:22.152271] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-23T18:12:22.152338] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-23T18:12:22.534431] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:22.564472] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T18:12:22.602159] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-23T18:12:22.915480] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T18:12:23.402224] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-23T18:12:24.202174] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-23T18:12:24.271364] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T18:12:24.547556] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T18:12:25.002198] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-23T18:12:25.802213] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-23T18:12:25.931727] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T18:12:26.054200] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:12:26.602208] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-23T18:12:27.155473] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:12:27.402205] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-23T18:12:28.197389] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T18:12:28.207927] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-23T18:12:29.002215] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-23T18:12:29.134875] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T18:12:29.141357] [INFO ] [REMOTE ] CTOS: Full fetch complete (53424 records). [2025-09-23T18:12:29.141538] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-23T18:12:29.532607] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-23T18:12:29.532727] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-23T18:12:29.533432] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-23T18:12:29.533486] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-23T18:12:29.534820] [DEBUG] [LOCAL ] CTOS: Trimmed 53424 records to 36812 (keeping 200 days of data) [2025-09-23T18:12:29.746134] [DEBUG] [LOCAL ] CTOS: Primary data saved (36812 records). [2025-09-23T18:12:29.746298] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-23T18:12:29.746392] [INFO ] [MAIN ] Update Progress: 549/2372 symbols completed. CTOS took 39.0s. Estimated remaining: 4h 0m 33s. Rate: 7.6 symbols/min [2025-09-23T18:12:29.809607] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-23T18:12:29.916562] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:29.936375] [DEBUG] [LOCAL ] CTS: Loaded 19390 existing records from primary storage. [2025-09-23T18:12:29.936509] [INFO ] [MAIN ] CTS: Loaded 19390 existing records. [2025-09-23T18:12:30.115839] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:30.116142] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-23T18:12:30.116195] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-23T18:12:30.116852] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-23T18:12:30.116945] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-23T18:12:30.494162] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:30.564414] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T18:12:30.602202] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-23T18:12:30.886722] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T18:12:31.369378] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T18:12:31.402149] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-23T18:12:31.971556] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T18:12:32.202189] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-23T18:12:33.002165] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-23T18:12:33.072746] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T18:12:33.802196] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-23T18:12:33.895154] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T18:12:34.158048] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T18:12:34.602193] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-23T18:12:35.402238] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-23T18:12:35.509974] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T18:12:35.933316] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:12:36.202210] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-23T18:12:36.754910] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T18:12:36.763807] [INFO ] [REMOTE ] CTRE: Full fetch complete (71087 records). [2025-09-23T18:12:36.763980] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-23T18:12:37.007297] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-23T18:12:37.179139] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-23T18:12:37.179233] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-23T18:12:37.180122] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-23T18:12:37.180189] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-23T18:12:37.181735] [DEBUG] [LOCAL ] CTRE: Trimmed 71087 records to 49212 (keeping 200 days of data) [2025-09-23T18:12:37.480413] [DEBUG] [LOCAL ] CTRE: Primary data saved (49212 records). [2025-09-23T18:12:37.480558] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-23T18:12:37.480666] [INFO ] [MAIN ] Update Progress: 550/2372 symbols completed. CTRE took 25.2s. Estimated remaining: 4h 0m 24s. Rate: 7.6 symbols/min [2025-09-23T18:12:37.652433] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:37.652670] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-09-23T18:12:37.652741] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-09-23T18:12:37.652920] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-23T18:12:37.652964] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-23T18:12:37.653006] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-23T18:12:37.653039] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-23T18:12:37.808048] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-23T18:12:38.067880] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:38.097427] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T18:12:38.123771] [INFO ] [REMOTE ] CTRA: Full fetch complete (77664 records). [2025-09-23T18:12:38.125462] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:12:38.125736] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-23T18:12:38.538241] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-23T18:12:38.538341] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-23T18:12:38.539253] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-23T18:12:38.539365] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-23T18:12:38.541984] [DEBUG] [LOCAL ] CTRA: Trimmed 77664 records to 53649 (keeping 200 days of data) [2025-09-23T18:12:38.617460] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-23T18:12:38.685353] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T18:12:38.986370] [DEBUG] [LOCAL ] CTRA: Primary data saved (53649 records). [2025-09-23T18:12:38.986576] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-23T18:12:38.986745] [INFO ] [MAIN ] Update Progress: 551/2372 symbols completed. CTRA took 34.6s. Estimated remaining: 3h 59m 55s. Rate: 7.6 symbols/min [2025-09-23T18:12:39.250375] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:39.250617] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-23T18:12:39.250698] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-23T18:12:39.250860] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-23T18:12:39.250903] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-23T18:12:39.250959] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-23T18:12:39.251027] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-23T18:12:39.407542] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-23T18:12:39.816057] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:40.202189] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-23T18:12:40.490875] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T18:12:40.529208] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T18:12:41.002215] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-23T18:12:41.273252] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T18:12:41.330973] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-23T18:12:41.802204] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-23T18:12:42.602196] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-23T18:12:43.090374] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T18:12:43.173670] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T18:12:43.402186] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-23T18:12:44.202200] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-23T18:12:44.282915] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T18:12:45.002203] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-23T18:12:45.265238] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T18:12:45.802206] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-23T18:12:46.281881] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T18:12:46.602205] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-23T18:12:46.872631] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T18:12:47.402224] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-23T18:12:48.046879] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:12:48.202236] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-23T18:12:49.002267] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-23T18:12:49.073593] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T18:12:49.313466] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-23T18:12:49.571845] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T18:12:49.802237] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-23T18:12:50.043463] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-23T18:12:50.602206] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-23T18:12:51.402210] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-23T18:12:52.214611] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-23T18:12:52.235958] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T18:12:52.280620] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T18:12:53.002196] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-23T18:12:53.384464] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T18:12:53.448002] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T18:12:53.456291] [INFO ] [REMOTE ] CTRI: Full fetch complete (50928 records). [2025-09-23T18:12:53.456436] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-23T18:12:53.814330] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-23T18:12:53.874915] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-23T18:12:53.875014] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-23T18:12:53.875776] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-23T18:12:53.875904] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-23T18:12:53.881297] [DEBUG] [LOCAL ] CTRI: Trimmed 50928 records to 37835 (keeping 200 days of data) [2025-09-23T18:12:54.107907] [DEBUG] [LOCAL ] CTRI: Primary data saved (37835 records). [2025-09-23T18:12:54.108052] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-23T18:12:54.108245] [INFO ] [MAIN ] Update Progress: 552/2372 symbols completed. CTRI took 32.4s. Estimated remaining: 4h 0m 11s. Rate: 7.6 symbols/min [2025-09-23T18:12:54.296277] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:54.375732] [DEBUG] [LOCAL ] CUBE: Loaded 50744 existing records from primary storage. [2025-09-23T18:12:54.375913] [INFO ] [MAIN ] CUBE: Loaded 50744 existing records. [2025-09-23T18:12:54.558288] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:54.558625] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-23T18:12:54.558733] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-23T18:12:54.560976] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-23T18:12:54.561058] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-23T18:12:54.607328] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-23T18:12:54.936810] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:54.946298] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:12:55.402195] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-23T18:12:55.674617] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-23T18:12:56.018354] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T18:12:56.202201] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-23T18:12:56.479552] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-23T18:12:57.002255] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-23T18:12:57.268825] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-23T18:12:57.802254] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-23T18:12:58.115594] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T18:12:58.602314] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-23T18:12:59.402243] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-23T18:13:00.202205] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-23T18:13:00.422516] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T18:13:00.887492] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-23T18:13:01.002227] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-23T18:13:01.152546] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T18:13:01.802288] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-23T18:13:02.242004] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T18:13:02.602206] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-23T18:13:03.339841] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T18:13:03.402200] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-23T18:13:03.734295] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T18:13:03.819212] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T18:13:04.202229] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-23T18:13:05.002261] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-23T18:13:05.486353] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T18:13:05.802197] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-23T18:13:06.263102] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T18:13:06.602229] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-23T18:13:07.402188] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-23T18:13:07.649418] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T18:13:07.659048] [INFO ] [REMOTE ] CTVA: Full fetch complete (76933 records). [2025-09-23T18:13:07.659185] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-23T18:13:07.802443] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T18:13:07.796105] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T18:13:07.822733] [INFO ] [REMOTE ] CUBB: Full fetch complete (934 records). [2025-09-23T18:13:07.837328] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-23T18:13:08.208966] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-23T18:13:08.286547] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T18:13:08.327537] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:13:08.371935] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-23T18:13:08.372209] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:13:08.372396] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-23T18:13:08.372288] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-23T18:13:08.373377] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-23T18:13:08.373471] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-23T18:13:08.373573] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-23T18:13:08.373860] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-23T18:13:08.373969] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-23T18:13:08.374144] [INFO ] [MAIN ] Update Progress: 553/2372 symbols completed. CUBB took 29.4s. Estimated remaining: 4h 0m 24s. Rate: 7.6 symbols/min [2025-09-23T18:13:08.463742] [DEBUG] [LOCAL ] CTVA: Trimmed 76933 records to 53229 (keeping 200 days of data) [2025-09-23T18:13:08.676469] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:08.905209] [DEBUG] [LOCAL ] CUBI: Loaded 27251 existing records from primary storage. [2025-09-23T18:13:08.916463] [INFO ] [MAIN ] CUBI: Loaded 27251 existing records. [2025-09-23T18:13:09.005486] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-23T18:13:09.117503] [DEBUG] [LOCAL ] CTVA: Primary data saved (53229 records). [2025-09-23T18:13:09.132946] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-23T18:13:09.133115] [INFO ] [MAIN ] Update Progress: 554/2372 symbols completed. CTVA took 31.7s. Estimated remaining: 3h 59m 53s. Rate: 7.6 symbols/min [2025-09-23T18:13:09.132837] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:09.218418] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-23T18:13:09.237675] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-23T18:13:09.256184] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-23T18:13:09.266588] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-23T18:13:09.395682] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:09.620615] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:13:09.657534] [INFO ] [REMOTE ] CTS: Full fetch complete (26577 records). [2025-09-23T18:13:09.676079] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-23T18:13:09.776099] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:09.814128] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-23T18:13:09.882030] [DEBUG] [LOCAL ] CUK: Loaded 51015 existing records from primary storage. [2025-09-23T18:13:09.888006] [INFO ] [MAIN ] CUK: Loaded 51015 existing records. [2025-09-23T18:13:10.287359] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:10.320738] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-23T18:13:10.341313] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-23T18:13:10.348192] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-23T18:13:10.348319] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-23T18:13:10.348840] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-23T18:13:10.348900] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-23T18:13:10.349696] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-23T18:13:10.349765] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-23T18:13:10.382515] [DEBUG] [LOCAL ] CTS: Trimmed 26577 records to 19403 (keeping 200 days of data) [2025-09-23T18:13:10.774911] [DEBUG] [LOCAL ] CTS: Primary data saved (19403 records). [2025-09-23T18:13:10.775690] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-23T18:13:10.775870] [INFO ] [MAIN ] Update Progress: 555/2372 symbols completed. CTS took 41.0s. Estimated remaining: 3h 59m 24s. Rate: 7.6 symbols/min [2025-09-23T18:13:10.961121] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:10.965924] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-23T18:13:11.072554] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:11.075629] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-23T18:13:11.108009] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T18:13:11.107422] [DEBUG] [LOCAL ] CULP: Loaded 3114 existing records from primary storage. [2025-09-23T18:13:11.113482] [INFO ] [MAIN ] CULP: Loaded 3114 existing records. [2025-09-23T18:13:11.300818] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:11.301136] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-23T18:13:11.301188] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-23T18:13:11.301609] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-23T18:13:11.301699] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-23T18:13:11.407340] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-23T18:13:11.684032] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:12.202243] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-23T18:13:12.442777] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T18:13:12.920598] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:13:13.002279] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-23T18:13:13.175078] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:13:13.802255] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-23T18:13:14.356152] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:13:14.608902] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-23T18:13:14.614415] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T18:13:15.402238] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-23T18:13:15.953255] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:13:16.202203] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-23T18:13:16.354071] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T18:13:17.002204] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-23T18:13:17.693206] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T18:13:17.802241] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-23T18:13:17.894869] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T18:13:18.602206] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-23T18:13:19.402220] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-23T18:13:19.547507] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T18:13:19.861068] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T18:13:19.977697] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:13:20.202210] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-23T18:13:21.002193] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-23T18:13:21.802224] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-23T18:13:22.119725] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:13:22.399771] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T18:13:22.602158] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-23T18:13:23.281261] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T18:13:23.402174] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-23T18:13:24.202223] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-23T18:13:24.438893] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T18:13:24.617298] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T18:13:25.002259] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-23T18:13:25.370558] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T18:13:25.802227] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-23T18:13:26.181391] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-23T18:13:26.602195] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-23T18:13:27.402230] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-23T18:13:27.774412] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (4.37 seconds). [2025-09-23T18:13:27.783128] [INFO ] [REMOTE ] CUBE: Full fetch complete (72984 records). [2025-09-23T18:13:27.783305] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-23T18:13:28.185550] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-23T18:13:28.185683] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-23T18:13:28.186523] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-23T18:13:28.186590] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-23T18:13:28.188847] [DEBUG] [LOCAL ] CUBE: Trimmed 72984 records to 50740 (keeping 200 days of data) [2025-09-23T18:13:28.248890] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-23T18:13:28.512624] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:13:28.529575] [DEBUG] [LOCAL ] CUBE: Primary data saved (50740 records). [2025-09-23T18:13:28.529707] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-23T18:13:28.529795] [INFO ] [MAIN ] Update Progress: 556/2372 symbols completed. CUBE took 34.4s. Estimated remaining: 3h 59m 49s. Rate: 7.6 symbols/min [2025-09-23T18:13:28.704803] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:28.736063] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-23T18:13:28.774750] [DEBUG] [LOCAL ] CURB: Loaded 32976 existing records from primary storage. [2025-09-23T18:13:28.774916] [INFO ] [MAIN ] CURB: Loaded 32976 existing records. [2025-09-23T18:13:28.973121] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:28.973731] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-23T18:13:28.973805] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-23T18:13:28.974930] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-23T18:13:28.975005] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-23T18:13:29.007325] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-23T18:13:29.102965] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:13:29.371111] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:29.802218] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-23T18:13:30.137722] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T18:13:30.157117] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T18:13:30.602211] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-23T18:13:31.402217] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-23T18:13:31.661941] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:13:32.202270] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-23T18:13:32.792929] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T18:13:32.943079] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:13:33.002213] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-23T18:13:33.802207] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-23T18:13:34.106070] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T18:13:34.602207] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-23T18:13:34.822979] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T18:13:35.402212] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-23T18:13:35.714455] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T18:13:36.202224] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-23T18:13:36.697836] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T18:13:36.703050] [INFO ] [REMOTE ] CUBI: Full fetch complete (39215 records). [2025-09-23T18:13:36.703152] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-23T18:13:37.008672] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-23T18:13:37.100952] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-23T18:13:37.101058] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-23T18:13:37.101631] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-23T18:13:37.101711] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-23T18:13:37.102542] [DEBUG] [LOCAL ] CUBI: Trimmed 39215 records to 27245 (keeping 200 days of data) [2025-09-23T18:13:37.264964] [DEBUG] [LOCAL ] CUBI: Primary data saved (27245 records). [2025-09-23T18:13:37.265180] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-23T18:13:37.265291] [INFO ] [MAIN ] Update Progress: 557/2372 symbols completed. CUBI took 28.9s. Estimated remaining: 3h 59m 43s. Rate: 7.6 symbols/min [2025-09-23T18:13:37.672931] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:13:37.802249] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-23T18:13:38.240972] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T18:13:38.286349] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T18:13:38.602190] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-23T18:13:39.402256] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-23T18:13:39.890411] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T18:13:39.901302] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:13:39.903099] [INFO ] [REMOTE ] CULP: Full fetch complete (4774 records). [2025-09-23T18:13:39.903528] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-23T18:13:40.207288] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-23T18:13:40.291820] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-23T18:13:40.291900] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-23T18:13:40.292042] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-23T18:13:40.292100] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-23T18:13:40.292461] [DEBUG] [LOCAL ] CULP: Trimmed 4774 records to 3010 (keeping 200 days of data) [2025-09-23T18:13:40.309383] [DEBUG] [LOCAL ] CULP: Primary data saved (3010 records). [2025-09-23T18:13:40.309454] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-23T18:13:40.309529] [INFO ] [MAIN ] Update Progress: 558/2372 symbols completed. CULP took 29.5s. Estimated remaining: 3h 59m 19s. Rate: 7.6 symbols/min [2025-09-23T18:13:41.002202] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-23T18:13:41.316955] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T18:13:41.802197] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-23T18:13:42.496473] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:13:42.505623] [INFO ] [REMOTE ] CUK: Full fetch complete (73701 records). [2025-09-23T18:13:42.505817] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-23T18:13:42.930045] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-23T18:13:42.930133] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-23T18:13:42.931024] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-23T18:13:42.931090] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-23T18:13:42.932585] [DEBUG] [LOCAL ] CUK: Trimmed 73701 records to 51014 (keeping 200 days of data) [2025-09-23T18:13:43.250914] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:13:43.259123] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-23T18:13:43.277489] [DEBUG] [LOCAL ] CUK: Primary data saved (51014 records). [2025-09-23T18:13:43.277669] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-23T18:13:43.277783] [INFO ] [MAIN ] Update Progress: 559/2372 symbols completed. CUK took 34.1s. Estimated remaining: 3h 58m 56s. Rate: 7.6 symbols/min [2025-09-23T18:13:44.210375] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T18:13:44.217108] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-23T18:13:45.084096] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T18:13:45.091600] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-23T18:13:46.450746] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:13:46.458500] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-23T18:13:47.418384] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T18:13:47.424283] [INFO ] [REMOTE ] CURB: Full fetch complete (47213 records). [2025-09-23T18:13:47.424394] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-23T18:13:47.827541] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-23T18:13:47.827618] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-23T18:13:47.828224] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-23T18:13:47.828280] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-23T18:13:47.829272] [DEBUG] [LOCAL ] CURB: Trimmed 47213 records to 33003 (keeping 200 days of data) [2025-09-23T18:13:48.038218] [DEBUG] [LOCAL ] CURB: Primary data saved (33003 records). [2025-09-23T18:13:48.038375] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-23T18:13:48.038477] [INFO ] [MAIN ] Update Progress: 560/2372 symbols completed. CURB took 19.5s. Estimated remaining: 3h 58m 37s. Rate: 7.6 symbols/min [2025-09-23T18:13:48.715520] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:48.714099] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:48.757710] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:48.761921] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-09-23T18:13:48.762317] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-09-23T18:13:48.761472] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:48.763718] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-23T18:13:48.763884] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-23T18:13:48.763966] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-09-23T18:13:48.764009] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-23T18:13:48.888191] [DEBUG] [LOCAL ] CVEO: Loaded 15262 existing records from primary storage. [2025-09-23T18:13:48.888569] [INFO ] [MAIN ] CVEO: Loaded 15262 existing records. [2025-09-23T18:13:49.252559] [DEBUG] [LOCAL ] CUZ: Loaded 49416 existing records from primary storage. [2025-09-23T18:13:49.302784] [DEBUG] [LOCAL ] CVE: Loaded 53557 existing records from primary storage. [2025-09-23T18:13:49.309125] [INFO ] [MAIN ] CVE: Loaded 53557 existing records. [2025-09-23T18:13:49.309019] [INFO ] [MAIN ] CUZ: Loaded 49416 existing records. [2025-09-23T18:13:49.352678] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:49.418888] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-23T18:13:49.457839] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-23T18:13:49.644505] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-23T18:13:49.649895] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-23T18:13:49.644445] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:49.693363] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-23T18:13:49.866011] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:49.919685] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:49.944678] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-23T18:13:49.945126] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-23T18:13:49.984626] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-23T18:13:49.994935] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-23T18:13:49.984540] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-23T18:13:50.041997] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-23T18:13:50.111637] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-23T18:13:50.151195] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-23T18:13:50.655961] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:50.721826] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-23T18:13:50.881436] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:50.907422] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-23T18:13:50.995024] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:50.995474] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-23T18:13:51.430749] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T18:13:51.438967] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-23T18:13:51.446085] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T18:13:51.448848] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-23T18:13:51.970783] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T18:13:51.973042] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-23T18:13:52.232910] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:13:52.239818] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-23T18:13:52.421880] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:13:52.458754] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-23T18:13:52.464104] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:13:52.553154] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:13:52.961373] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T18:13:53.002226] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-23T18:13:53.802177] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-23T18:13:53.963982] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T18:13:54.473436] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-23T18:13:54.590962] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T18:13:54.602147] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-23T18:13:55.402163] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-23T18:13:55.646285] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T18:13:56.202233] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-23T18:13:56.561429] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T18:13:57.002228] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-23T18:13:57.513795] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:13:57.698231] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T18:13:57.802199] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-23T18:13:58.602207] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-23T18:13:59.131233] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T18:13:59.402206] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-23T18:14:00.003519] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T18:14:00.026510] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T18:14:00.202207] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-23T18:14:01.002196] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-23T18:14:01.802261] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-23T18:14:01.850445] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:14:02.104257] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T18:14:02.602260] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-23T18:14:03.306998] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:14:03.402177] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-23T18:14:04.208215] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-23T18:14:04.215954] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:14:04.994797] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T18:14:05.005321] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-23T18:14:05.206834] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:14:05.802267] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-23T18:14:06.602210] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-23T18:14:07.121818] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:14:07.300031] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-23T18:14:07.402168] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-23T18:14:07.517134] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T18:14:08.202199] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-23T18:14:08.753097] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T18:14:08.874515] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:14:09.002207] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-23T18:14:09.802211] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-23T18:14:09.946003] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T18:14:10.602227] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-23T18:14:11.375064] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:14:11.402162] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-23T18:14:11.941048] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T18:14:12.202266] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-23T18:14:12.863147] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T18:14:13.002199] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-23T18:14:13.400032] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-23T18:14:13.409171] [INFO ] [REMOTE ] CVE: Full fetch complete (77538 records). [2025-09-23T18:14:13.409339] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-23T18:14:13.808777] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-23T18:14:13.835009] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-23T18:14:13.835673] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:14:13.835787] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-23T18:14:13.840547] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-23T18:14:13.840674] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-23T18:14:13.840836] [INFO ] [REMOTE ] CVEO: Full fetch complete (20088 records). [2025-09-23T18:14:13.841201] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-23T18:14:13.842017] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:14:13.842799] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:14:13.843011] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:14:13.843199] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-23T18:14:13.843466] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-09-23T18:14:13.843527] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-09-23T18:14:13.843635] [DEBUG] [LOCAL ] CVE: Trimmed 77538 records to 53556 (keeping 200 days of data) [2025-09-23T18:14:13.844261] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-09-23T18:14:13.844681] [INFO ] [MAIN ] Update Progress: 561/2372 symbols completed. CVEO took 25.8s. Estimated remaining: 3h 59m 27s. Rate: 7.6 symbols/min [2025-09-23T18:14:14.121457] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:14.171318] [DEBUG] [LOCAL ] CVI: Loaded 46417 existing records from primary storage. [2025-09-23T18:14:14.172251] [INFO ] [MAIN ] CVI: Loaded 46417 existing records. [2025-09-23T18:14:14.457765] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:14.459007] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-23T18:14:14.459084] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-23T18:14:14.460693] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-23T18:14:14.461039] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-23T18:14:14.607018] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-23T18:14:14.855118] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:14.960983] [DEBUG] [LOCAL ] CVE: Primary data saved (53556 records). [2025-09-23T18:14:14.961127] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-23T18:14:14.961214] [INFO ] [MAIN ] Update Progress: 562/2372 symbols completed. CVE took 26.9s. Estimated remaining: 3h 58m 57s. Rate: 7.6 symbols/min [2025-09-23T18:14:15.130667] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:15.147437] [DEBUG] [LOCAL ] CVLG: Loaded 15573 existing records from primary storage. [2025-09-23T18:14:15.147582] [INFO ] [MAIN ] CVLG: Loaded 15573 existing records. [2025-09-23T18:14:15.336590] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:15.336886] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-23T18:14:15.336943] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-23T18:14:15.337534] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-23T18:14:15.337594] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-23T18:14:15.406704] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-23T18:14:15.706524] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:15.735264] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T18:14:15.762998] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T18:14:15.769506] [INFO ] [REMOTE ] CURV: Full fetch complete (39808 records). [2025-09-23T18:14:15.769608] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-23T18:14:16.143811] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-23T18:14:16.143895] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-23T18:14:16.144506] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-23T18:14:16.144546] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-23T18:14:16.145524] [DEBUG] [LOCAL ] CURV: Trimmed 39808 records to 26669 (keeping 200 days of data) [2025-09-23T18:14:16.222218] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-23T18:14:16.291999] [DEBUG] [LOCAL ] CURV: Primary data saved (26669 records). [2025-09-23T18:14:16.292146] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-23T18:14:16.292238] [INFO ] [MAIN ] Update Progress: 563/2372 symbols completed. CURV took 28.3s. Estimated remaining: 3h 58m 28s. Rate: 7.6 symbols/min [2025-09-23T18:14:16.459478] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:16.515539] [DEBUG] [LOCAL ] CVNA: Loaded 53029 existing records from primary storage. [2025-09-23T18:14:16.515714] [INFO ] [MAIN ] CVNA: Loaded 53029 existing records. [2025-09-23T18:14:16.694661] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:16.694921] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-23T18:14:16.694973] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-23T18:14:16.696452] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-23T18:14:16.696514] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-23T18:14:17.007206] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-23T18:14:17.063882] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:17.094239] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T18:14:17.645919] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:14:17.803839] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-23T18:14:17.807750] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T18:14:18.602211] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-23T18:14:19.402198] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-23T18:14:19.654459] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T18:14:19.956213] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:14:20.202237] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-23T18:14:20.386103] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:14:21.002239] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-23T18:14:21.555825] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T18:14:21.563554] [INFO ] [REMOTE ] CUZ: Full fetch complete (70362 records). [2025-09-23T18:14:21.563705] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-23T18:14:21.564376] [FATAL] [VALIDATOR ] CUZ: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:14:21.564464] [FATAL] [MAIN ] CUZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:14:21.564508] [WARN ] [MAIN ] CUZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:14:21.564547] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-23T18:14:21.564602] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-09-23T18:14:21.564636] [INFO ] [LOCAL ] CUZ: Starting deletion of derivative data. [2025-09-23T18:14:21.565053] [DEBUG] [LOCAL ] CUZ: Deleted derivative data file. [2025-09-23T18:14:21.565169] [INFO ] [MAIN ] Update Progress: 564/2372 symbols completed. CUZ took 33.5s. Estimated remaining: 3h 58m 12s. Rate: 7.6 symbols/min [2025-09-23T18:14:21.735771] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:21.788057] [DEBUG] [LOCAL ] CVS: Loaded 53698 existing records from primary storage. [2025-09-23T18:14:21.788201] [INFO ] [MAIN ] CVS: Loaded 53698 existing records. [2025-09-23T18:14:21.808696] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-23T18:14:21.967894] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:21.968186] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-23T18:14:21.968238] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-23T18:14:21.969847] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-23T18:14:21.969908] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-23T18:14:22.337153] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:22.388514] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T18:14:22.602162] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-23T18:14:23.402263] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-23T18:14:23.936194] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T18:14:24.096163] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-23T18:14:24.202200] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-23T18:14:24.500367] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T18:14:24.736357] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T18:14:25.002283] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-23T18:14:25.802210] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-23T18:14:26.286578] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:14:26.602214] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-23T18:14:27.402259] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-23T18:14:27.908490] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:14:27.911085] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-23T18:14:28.202232] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-23T18:14:29.002178] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-23T18:14:29.145498] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T18:14:29.517288] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T18:14:29.802240] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-23T18:14:30.177499] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:14:30.602206] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-23T18:14:31.056152] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T18:14:31.402204] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-23T18:14:32.170208] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T18:14:32.202151] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-23T18:14:33.002257] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-23T18:14:33.526910] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-23T18:14:33.806616] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-23T18:14:33.812136] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:14:34.577001] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T18:14:34.602151] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-23T18:14:34.743675] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T18:14:35.195449] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T18:14:35.402203] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-23T18:14:36.202242] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-23T18:14:36.839147] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T18:14:37.002258] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-23T18:14:37.187116] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T18:14:37.656327] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T18:14:37.659475] [INFO ] [REMOTE ] CVLG: Full fetch complete (20680 records). [2025-09-23T18:14:37.659575] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-23T18:14:37.807418] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-23T18:14:38.082225] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-23T18:14:38.082306] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-23T18:14:38.082813] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-23T18:14:38.082877] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-23T18:14:38.083498] [DEBUG] [LOCAL ] CVLG: Trimmed 20680 records to 15567 (keeping 200 days of data) [2025-09-23T18:14:38.183741] [DEBUG] [LOCAL ] CVLG: Primary data saved (15567 records). [2025-09-23T18:14:38.183891] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-23T18:14:38.183977] [INFO ] [MAIN ] Update Progress: 565/2372 symbols completed. CVLG took 23.2s. Estimated remaining: 3h 58m 32s. Rate: 7.6 symbols/min [2025-09-23T18:14:38.373426] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:38.442472] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-23T18:14:38.442736] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-09-23T18:14:38.605140] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-23T18:14:38.631831] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:38.632178] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-23T18:14:38.632251] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-23T18:14:38.634849] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-23T18:14:38.634966] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-23T18:14:39.003275] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:39.402210] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-23T18:14:39.620063] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T18:14:39.905477] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:14:40.202192] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-23T18:14:41.002247] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-23T18:14:41.333800] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:14:41.514399] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:14:41.802195] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-23T18:14:42.602172] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-23T18:14:42.834844] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T18:14:43.402277] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-23T18:14:43.789756] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-23T18:14:43.828794] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:14:44.202186] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-23T18:14:45.002192] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-23T18:14:45.515973] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T18:14:45.524195] [INFO ] [REMOTE ] CVI: Full fetch complete (67264 records). [2025-09-23T18:14:45.524432] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-23T18:14:45.651565] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-23T18:14:45.808419] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-23T18:14:45.963781] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-23T18:14:45.963893] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-23T18:14:45.964639] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-23T18:14:45.964721] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-23T18:14:45.966093] [DEBUG] [LOCAL ] CVI: Trimmed 67264 records to 46431 (keeping 200 days of data) [2025-09-23T18:14:46.241733] [DEBUG] [LOCAL ] CVI: Primary data saved (46431 records). [2025-09-23T18:14:46.241874] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-23T18:14:46.241957] [INFO ] [MAIN ] Update Progress: 566/2372 symbols completed. CVI took 32.4s. Estimated remaining: 3h 58m 24s. Rate: 7.6 symbols/min [2025-09-23T18:14:46.416409] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:46.438790] [DEBUG] [LOCAL ] CW: Loaded 22575 existing records from primary storage. [2025-09-23T18:14:46.438918] [INFO ] [MAIN ] CW: Loaded 22575 existing records. [2025-09-23T18:14:46.610997] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-23T18:14:46.616588] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:46.617560] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-23T18:14:46.617615] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-23T18:14:46.618388] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-23T18:14:46.618450] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-23T18:14:46.989157] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:47.062532] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-23T18:14:47.402190] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-23T18:14:48.119389] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-23T18:14:48.202151] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-23T18:14:48.305039] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T18:14:48.491153] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T18:14:49.002201] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-23T18:14:49.802217] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-23T18:14:49.978998] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T18:14:49.980276] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:14:50.602194] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-23T18:14:51.378084] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T18:14:51.387545] [INFO ] [REMOTE ] CVS: Full fetch complete (77814 records). [2025-09-23T18:14:51.387755] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-23T18:14:51.409227] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-23T18:14:51.812026] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-23T18:14:51.812176] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-23T18:14:51.813134] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-23T18:14:51.813202] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-23T18:14:51.815218] [DEBUG] [LOCAL ] CVS: Trimmed 77814 records to 53697 (keeping 200 days of data) [2025-09-23T18:14:52.157198] [DEBUG] [LOCAL ] CVS: Primary data saved (53697 records). [2025-09-23T18:14:52.157331] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-23T18:14:52.157417] [INFO ] [MAIN ] Update Progress: 567/2372 symbols completed. CVS took 30.6s. Estimated remaining: 3h 58m 10s. Rate: 7.6 symbols/min [2025-09-23T18:14:52.205731] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-23T18:14:52.369415] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:52.419611] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T18:14:52.468925] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T18:14:52.469964] [DEBUG] [LOCAL ] CWAN: Loaded 52393 existing records from primary storage. [2025-09-23T18:14:52.479862] [INFO ] [MAIN ] CWAN: Loaded 52393 existing records. [2025-09-23T18:14:52.659288] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:52.659564] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-23T18:14:52.659611] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-23T18:14:52.660977] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-23T18:14:52.661038] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-23T18:14:53.013977] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:53.008449] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-23T18:14:53.802213] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-23T18:14:54.329421] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-23T18:14:54.602251] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-23T18:14:54.827679] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T18:14:54.847315] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:14:55.402223] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-23T18:14:56.202169] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-23T18:14:56.447281] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T18:14:57.002267] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-23T18:14:57.520560] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-23T18:14:57.590278] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:14:57.802212] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-23T18:14:57.921172] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T18:14:58.602208] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-23T18:14:59.402216] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-23T18:14:59.831709] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:14:59.872514] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-23T18:14:59.883375] [INFO ] [REMOTE ] CVNA: Full fetch complete (76674 records). [2025-09-23T18:14:59.883579] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-23T18:15:00.209749] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-23T18:15:00.322125] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-23T18:15:00.322231] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-23T18:15:00.323137] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-23T18:15:00.323202] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-23T18:15:00.325392] [DEBUG] [LOCAL ] CVNA: Trimmed 76674 records to 53022 (keeping 200 days of data) [2025-09-23T18:15:00.677600] [DEBUG] [LOCAL ] CVNA: Primary data saved (53022 records). [2025-09-23T18:15:00.677928] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-23T18:15:00.678165] [INFO ] [MAIN ] Update Progress: 568/2372 symbols completed. CVNA took 44.4s. Estimated remaining: 3h 58m 4s. Rate: 7.6 symbols/min [2025-09-23T18:15:00.848290] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:00.898902] [DEBUG] [LOCAL ] CWEN: Loaded 45071 existing records from primary storage. [2025-09-23T18:15:00.899061] [INFO ] [MAIN ] CWEN: Loaded 45071 existing records. [2025-09-23T18:15:01.007430] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-23T18:15:01.076964] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:01.077215] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-23T18:15:01.077273] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-23T18:15:01.078401] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-23T18:15:01.078471] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-23T18:15:01.455607] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:01.721046] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:15:01.762520] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-23T18:15:01.802229] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-23T18:15:02.602241] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-23T18:15:03.062764] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-23T18:15:03.402239] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-23T18:15:04.202225] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-23T18:15:05.677307] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (3.88 seconds). [2025-09-23T18:15:05.686061] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-23T18:15:06.882090] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (4.28 seconds). [2025-09-23T18:15:06.893004] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-23T18:15:06.972011] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (3.57 seconds). [2025-09-23T18:15:06.978144] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-23T18:15:07.824709] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T18:15:07.834306] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-23T18:15:07.868146] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (3.67 seconds). [2025-09-23T18:15:07.893592] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T18:15:08.202444] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-23T18:15:09.002185] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-23T18:15:09.070766] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:15:09.094047] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T18:15:09.297391] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-23T18:15:09.802201] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-23T18:15:10.602210] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-23T18:15:10.930762] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:15:11.174338] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T18:15:11.402215] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-23T18:15:11.542162] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:15:11.545729] [INFO ] [REMOTE ] CW: Full fetch complete (33525 records). [2025-09-23T18:15:11.545855] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-23T18:15:11.926962] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-23T18:15:11.927066] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-23T18:15:11.927626] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-23T18:15:11.927771] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-23T18:15:11.929342] [DEBUG] [LOCAL ] CW: Trimmed 33525 records to 22479 (keeping 200 days of data) [2025-09-23T18:15:12.078585] [DEBUG] [LOCAL ] CW: Primary data saved (22479 records). [2025-09-23T18:15:12.078756] [INFO ] [MAIN ] CW: Full history saved. [2025-09-23T18:15:12.078905] [INFO ] [MAIN ] Update Progress: 569/2372 symbols completed. CW took 25.8s. Estimated remaining: 3h 58m 7s. Rate: 7.6 symbols/min [2025-09-23T18:15:12.207421] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-23T18:15:12.267937] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:12.335111] [DEBUG] [LOCAL ] CWH: Loaded 51418 existing records from primary storage. [2025-09-23T18:15:12.335275] [INFO ] [MAIN ] CWH: Loaded 51418 existing records. [2025-09-23T18:15:12.513955] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:12.514301] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-23T18:15:12.514375] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-23T18:15:12.515868] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-23T18:15:12.515946] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-23T18:15:12.876495] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:13.002198] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-23T18:15:13.513765] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T18:15:13.610923] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T18:15:13.802200] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-23T18:15:14.602233] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-23T18:15:14.739061] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T18:15:15.402249] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-23T18:15:16.027018] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-23T18:15:16.036090] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-23T18:15:16.036220] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-23T18:15:16.208078] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-23T18:15:16.460938] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-23T18:15:16.461102] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-23T18:15:16.462132] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-23T18:15:16.462216] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-23T18:15:16.464445] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-09-23T18:15:16.731586] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T18:15:16.866015] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-23T18:15:16.866165] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-23T18:15:16.867990] [INFO ] [MAIN ] Update Progress: 570/2372 symbols completed. CVX took 38.7s. Estimated remaining: 3h 57m 49s. Rate: 7.6 symbols/min [2025-09-23T18:15:17.012700] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-23T18:15:17.044627] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:17.073409] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T18:15:17.132870] [DEBUG] [LOCAL ] CWK: Loaded 49391 existing records from primary storage. [2025-09-23T18:15:17.133020] [INFO ] [MAIN ] CWK: Loaded 49391 existing records. [2025-09-23T18:15:17.313819] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:17.314102] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-23T18:15:17.314163] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-23T18:15:17.315855] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-23T18:15:17.315919] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-23T18:15:17.678066] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:17.802152] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-23T18:15:18.457121] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-23T18:15:18.602203] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-23T18:15:19.408587] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-23T18:15:19.411269] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-23T18:15:20.120468] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-23T18:15:20.202207] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-23T18:15:20.436162] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T18:15:20.551836] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:15:21.002187] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-23T18:15:21.346546] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:15:21.802250] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-23T18:15:22.397568] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:15:22.602218] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-23T18:15:23.137220] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:15:23.402194] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-23T18:15:23.979340] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:15:23.989504] [INFO ] [REMOTE ] CWAN: Full fetch complete (75103 records). [2025-09-23T18:15:23.989678] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-23T18:15:24.207794] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-23T18:15:24.411609] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-23T18:15:24.411738] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-23T18:15:24.412545] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-23T18:15:24.412682] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-23T18:15:24.414500] [DEBUG] [LOCAL ] CWAN: Trimmed 75103 records to 52401 (keeping 200 days of data) [2025-09-23T18:15:24.753786] [DEBUG] [LOCAL ] CWAN: Primary data saved (52401 records). [2025-09-23T18:15:24.753933] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-23T18:15:24.754066] [INFO ] [MAIN ] Update Progress: 571/2372 symbols completed. CWAN took 32.6s. Estimated remaining: 3h 57m 41s. Rate: 7.6 symbols/min [2025-09-23T18:15:24.935914] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:24.969138] [DEBUG] [LOCAL ] CWT: Loaded 27803 existing records from primary storage. [2025-09-23T18:15:24.969372] [INFO ] [MAIN ] CWT: Loaded 27803 existing records. [2025-09-23T18:15:25.024446] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-23T18:15:25.185509] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T18:15:25.183216] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:25.196244] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-23T18:15:25.196376] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-23T18:15:25.198005] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-23T18:15:25.198071] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-23T18:15:25.565305] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:25.591159] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T18:15:25.802191] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-23T18:15:26.607333] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-23T18:15:26.623629] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T18:15:27.232789] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T18:15:27.402257] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-23T18:15:28.117785] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T18:15:28.202192] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-23T18:15:28.705831] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:15:29.002217] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-23T18:15:29.574897] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:15:29.802180] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-23T18:15:30.586215] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T18:15:30.602147] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-23T18:15:31.128949] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T18:15:31.136425] [INFO ] [REMOTE ] CWEN: Full fetch complete (64021 records). [2025-09-23T18:15:31.136582] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-23T18:15:31.137512] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:15:31.137627] [FATAL] [MAIN ] CWEN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:15:31.137819] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:15:31.137903] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-23T18:15:31.138013] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-09-23T18:15:31.138081] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-09-23T18:15:31.138618] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-09-23T18:15:31.138779] [INFO ] [MAIN ] Update Progress: 572/2372 symbols completed. CWEN took 30.5s. Estimated remaining: 3h 57m 29s. Rate: 7.6 symbols/min [2025-09-23T18:15:31.321922] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:31.322123] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-09-23T18:15:31.322159] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-09-23T18:15:31.322303] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-23T18:15:31.322344] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-23T18:15:31.322385] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-09-23T18:15:31.322417] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-23T18:15:31.410539] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-23T18:15:31.681925] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:31.949333] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:15:32.202249] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-23T18:15:32.472186] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T18:15:33.002238] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-23T18:15:33.802202] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-23T18:15:33.853099] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T18:15:34.602194] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-23T18:15:34.668018] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T18:15:34.849892] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T18:15:34.859426] [INFO ] [REMOTE ] CWH: Full fetch complete (72710 records). [2025-09-23T18:15:34.859690] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-23T18:15:35.348884] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-23T18:15:35.349079] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-23T18:15:35.351111] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-23T18:15:35.351316] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-23T18:15:35.354388] [DEBUG] [LOCAL ] CWH: Trimmed 72710 records to 51415 (keeping 200 days of data) [2025-09-23T18:15:35.422062] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-23T18:15:35.824512] [DEBUG] [LOCAL ] CWH: Primary data saved (51415 records). [2025-09-23T18:15:35.824984] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-23T18:15:35.825278] [INFO ] [MAIN ] Update Progress: 573/2372 symbols completed. CWH took 23.7s. Estimated remaining: 3h 57m 11s. Rate: 7.6 symbols/min [2025-09-23T18:15:36.096568] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:36.163904] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T18:15:36.187754] [DEBUG] [LOCAL ] CXE: Loaded 7246 existing records from primary storage. [2025-09-23T18:15:36.188597] [INFO ] [MAIN ] CXE: Loaded 7246 existing records. [2025-09-23T18:15:36.207619] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-23T18:15:36.505920] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:36.506209] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-23T18:15:36.506260] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-23T18:15:36.506744] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-23T18:15:36.506805] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-23T18:15:36.888292] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:36.923665] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:15:37.002190] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-23T18:15:37.583766] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T18:15:37.802178] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-23T18:15:37.971497] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T18:15:38.282062] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T18:15:38.602210] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-23T18:15:39.402208] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-23T18:15:39.472004] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T18:15:40.202187] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-23T18:15:40.318503] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T18:15:41.002197] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-23T18:15:41.232204] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T18:15:41.802197] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-23T18:15:42.453187] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T18:15:42.602254] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-23T18:15:43.121169] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T18:15:43.402230] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-23T18:15:44.143398] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:15:44.202203] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-23T18:15:44.580927] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:15:45.002251] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-23T18:15:45.340274] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:15:45.802259] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-23T18:15:46.187366] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T18:15:46.602223] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-23T18:15:46.687313] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:15:47.402244] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-23T18:15:48.064125] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T18:15:48.198160] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T18:15:48.204033] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-23T18:15:49.002259] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-23T18:15:49.802258] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-23T18:15:50.117287] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T18:15:50.169293] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:15:50.602192] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-23T18:15:50.657983] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T18:15:51.402226] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-23T18:15:51.806147] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T18:15:51.860839] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:15:51.865484] [INFO ] [REMOTE ] CWT: Full fetch complete (40228 records). [2025-09-23T18:15:51.865602] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-23T18:15:52.207273] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-23T18:15:52.249424] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-23T18:15:52.249523] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-23T18:15:52.250239] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-23T18:15:52.250312] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-23T18:15:52.251848] [DEBUG] [LOCAL ] CWT: Trimmed 40228 records to 27855 (keeping 200 days of data) [2025-09-23T18:15:52.424895] [DEBUG] [LOCAL ] CWT: Primary data saved (27855 records). [2025-09-23T18:15:52.425044] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-23T18:15:52.425168] [INFO ] [MAIN ] Update Progress: 574/2372 symbols completed. CWT took 27.7s. Estimated remaining: 3h 57m 30s. Rate: 7.6 symbols/min [2025-09-23T18:15:52.596322] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:52.602693] [DEBUG] [LOCAL ] CXH: Loaded 4404 existing records from primary storage. [2025-09-23T18:15:52.602827] [INFO ] [MAIN ] CXH: Loaded 4404 existing records. [2025-09-23T18:15:52.781092] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:52.781359] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-23T18:15:52.781409] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-23T18:15:52.781749] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-23T18:15:52.781810] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-23T18:15:53.007152] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-23T18:15:53.208261] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:53.209005] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T18:15:53.802223] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-23T18:15:54.431165] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T18:15:54.602159] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-23T18:15:54.666920] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T18:15:55.090555] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T18:15:55.402250] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-23T18:15:56.202245] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-23T18:15:56.644590] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T18:15:56.700160] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T18:15:56.708498] [INFO ] [REMOTE ] CWK: Full fetch complete (70830 records). [2025-09-23T18:15:56.708688] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-23T18:15:57.007278] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-23T18:15:57.129956] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-23T18:15:57.130040] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-23T18:15:57.130832] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-23T18:15:57.130899] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-23T18:15:57.132354] [DEBUG] [LOCAL ] CWK: Trimmed 70830 records to 49427 (keeping 200 days of data) [2025-09-23T18:15:57.450571] [DEBUG] [LOCAL ] CWK: Primary data saved (49427 records). [2025-09-23T18:15:57.450788] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-23T18:15:57.450908] [INFO ] [MAIN ] Update Progress: 575/2372 symbols completed. CWK took 40.6s. Estimated remaining: 3h 57m 13s. Rate: 7.6 symbols/min [2025-09-23T18:15:57.630133] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:57.677526] [DEBUG] [LOCAL ] CXM: Loaded 47973 existing records from primary storage. [2025-09-23T18:15:57.677773] [INFO ] [MAIN ] CXM: Loaded 47973 existing records. [2025-09-23T18:15:57.807361] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-23T18:15:57.860930] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:57.861196] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-23T18:15:57.861245] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-23T18:15:57.862472] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-23T18:15:57.862534] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-23T18:15:58.227845] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T18:15:58.233856] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:58.602161] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-23T18:15:58.682188] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:15:59.402240] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-23T18:15:59.837950] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T18:15:59.989408] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:16:00.202188] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-23T18:16:01.002204] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-23T18:16:01.009443] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:16:01.428977] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:16:01.802248] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-23T18:16:02.602203] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-23T18:16:02.939152] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T18:16:03.329334] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T18:16:03.402180] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-23T18:16:04.035569] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T18:16:04.037572] [INFO ] [REMOTE ] CXE: Full fetch complete (11892 records). [2025-09-23T18:16:04.037683] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-23T18:16:04.210024] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-23T18:16:04.428821] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-23T18:16:04.428936] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-23T18:16:04.429227] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-23T18:16:04.429269] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-23T18:16:04.429833] [DEBUG] [LOCAL ] CXE: Trimmed 11892 records to 7248 (keeping 200 days of data) [2025-09-23T18:16:04.473946] [DEBUG] [LOCAL ] CXE: Primary data saved (7248 records). [2025-09-23T18:16:04.474098] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-23T18:16:04.474193] [INFO ] [MAIN ] Update Progress: 576/2372 symbols completed. CXE took 28.6s. Estimated remaining: 3h 57m 2s. Rate: 7.6 symbols/min [2025-09-23T18:16:04.649368] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:04.681296] [DEBUG] [LOCAL ] CXT: Loaded 31010 existing records from primary storage. [2025-09-23T18:16:04.681460] [INFO ] [MAIN ] CXT: Loaded 31010 existing records. [2025-09-23T18:16:04.869885] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:04.870129] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-23T18:16:04.870178] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-23T18:16:04.871097] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-23T18:16:04.871161] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-23T18:16:05.013621] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-23T18:16:05.243867] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:05.657732] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T18:16:05.802189] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-23T18:16:06.088503] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T18:16:06.602216] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-23T18:16:06.754848] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T18:16:07.197384] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T18:16:07.402216] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-23T18:16:08.120067] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T18:16:08.202198] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-23T18:16:09.002240] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-23T18:16:09.402024] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T18:16:09.802243] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-23T18:16:09.992904] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T18:16:10.602204] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-23T18:16:11.200212] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T18:16:11.202116] [INFO ] [REMOTE ] CXH: Full fetch complete (5505 records). [2025-09-23T18:16:11.202207] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-23T18:16:11.407303] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-23T18:16:11.595166] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-23T18:16:11.595323] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-23T18:16:11.595534] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-23T18:16:11.595580] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-23T18:16:11.596067] [DEBUG] [LOCAL ] CXH: Trimmed 5505 records to 4406 (keeping 200 days of data) [2025-09-23T18:16:11.621980] [DEBUG] [LOCAL ] CXH: Primary data saved (4406 records). [2025-09-23T18:16:11.622101] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-23T18:16:11.622198] [INFO ] [MAIN ] Update Progress: 577/2372 symbols completed. CXH took 19.2s. Estimated remaining: 3h 56m 52s. Rate: 7.6 symbols/min [2025-09-23T18:16:11.773805] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T18:16:11.837849] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:11.884449] [DEBUG] [LOCAL ] CXW: Loaded 44413 existing records from primary storage. [2025-09-23T18:16:11.884703] [INFO ] [MAIN ] CXW: Loaded 44413 existing records. [2025-09-23T18:16:12.083067] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:12.083356] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-23T18:16:12.083406] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-23T18:16:12.084591] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-23T18:16:12.084681] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-23T18:16:12.207359] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-23T18:16:12.464472] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:12.742138] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T18:16:13.002225] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-23T18:16:13.202694] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T18:16:13.802206] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-23T18:16:14.261581] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T18:16:14.602207] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-23T18:16:15.402204] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-23T18:16:16.202214] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-23T18:16:16.286419] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T18:16:16.611838] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-23T18:16:16.766859] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:16:17.002212] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-23T18:16:17.802208] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-23T18:16:18.520048] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-23T18:16:18.602162] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-23T18:16:19.402161] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-23T18:16:19.480897] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-23T18:16:20.202167] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-23T18:16:20.304777] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-23T18:16:20.313577] [INFO ] [REMOTE ] CX: Full fetch complete (76369 records). [2025-09-23T18:16:20.313766] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-23T18:16:20.730036] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-23T18:16:20.730145] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-23T18:16:20.731424] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-23T18:16:20.731491] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-23T18:16:20.733097] [DEBUG] [LOCAL ] CX: Trimmed 76369 records to 52840 (keeping 200 days of data) [2025-09-23T18:16:21.060915] [DEBUG] [LOCAL ] CX: Primary data saved (52840 records). [2025-09-23T18:16:21.061073] [INFO ] [MAIN ] CX: Full history saved. [2025-09-23T18:16:21.061156] [INFO ] [MAIN ] Update Progress: 578/2372 symbols completed. CX took 49.9s. Estimated remaining: 3h 56m 49s. Rate: 7.6 symbols/min [2025-09-23T18:16:21.280197] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:21.276827] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-23T18:16:21.293534] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-23T18:16:21.319806] [DEBUG] [LOCAL ] CYD: Loaded 26609 existing records from primary storage. [2025-09-23T18:16:21.319997] [INFO ] [MAIN ] CYD: Loaded 26609 existing records. [2025-09-23T18:16:21.514457] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:21.515291] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-23T18:16:21.515379] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-23T18:16:21.516534] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-23T18:16:21.516602] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-23T18:16:21.873848] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:16:21.931963] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-23T18:16:21.931519] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T18:16:21.979612] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:22.602162] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-23T18:16:22.659747] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:16:23.323288] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T18:16:23.402190] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-23T18:16:23.645061] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T18:16:24.202208] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-23T18:16:24.637552] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T18:16:25.002192] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-23T18:16:25.078557] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T18:16:25.802194] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-23T18:16:26.261078] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T18:16:26.602191] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-23T18:16:26.945891] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:16:27.402207] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-23T18:16:27.917981] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T18:16:27.920483] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:16:27.935528] [INFO ] [REMOTE ] CXM: Full fetch complete (69084 records). [2025-09-23T18:16:27.935809] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-23T18:16:28.210680] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-23T18:16:28.584538] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-23T18:16:28.584663] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-23T18:16:28.585629] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-23T18:16:28.585734] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-23T18:16:28.587559] [DEBUG] [LOCAL ] CXM: Trimmed 69084 records to 47985 (keeping 200 days of data) [2025-09-23T18:16:28.920936] [DEBUG] [LOCAL ] CXM: Primary data saved (47985 records). [2025-09-23T18:16:28.921098] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-23T18:16:28.921205] [INFO ] [MAIN ] Update Progress: 579/2372 symbols completed. CXM took 31.5s. Estimated remaining: 3h 56m 41s. Rate: 7.6 symbols/min [2025-09-23T18:16:29.011257] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-23T18:16:29.097300] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:29.142207] [DEBUG] [LOCAL ] CYH: Loaded 47883 existing records from primary storage. [2025-09-23T18:16:29.142423] [INFO ] [MAIN ] CYH: Loaded 47883 existing records. [2025-09-23T18:16:29.328230] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:29.328577] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-23T18:16:29.328631] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-23T18:16:29.329800] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-23T18:16:29.329865] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-23T18:16:29.706440] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:29.802283] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-23T18:16:29.835053] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T18:16:30.602240] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-23T18:16:31.169343] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T18:16:31.243016] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T18:16:31.402177] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-23T18:16:31.741076] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-23T18:16:32.202187] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-23T18:16:32.580908] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:16:33.002208] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-23T18:16:33.192947] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T18:16:33.198670] [INFO ] [REMOTE ] CXT: Full fetch complete (44909 records). [2025-09-23T18:16:33.198803] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-23T18:16:33.585600] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-23T18:16:33.585719] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-23T18:16:33.586402] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-23T18:16:33.586490] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-23T18:16:33.587791] [DEBUG] [LOCAL ] CXT: Trimmed 44909 records to 31082 (keeping 200 days of data) [2025-09-23T18:16:33.801454] [DEBUG] [LOCAL ] CXT: Primary data saved (31082 records). [2025-09-23T18:16:33.801620] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-23T18:16:33.801748] [INFO ] [MAIN ] Update Progress: 580/2372 symbols completed. CXT took 29.3s. Estimated remaining: 3h 56m 23s. Rate: 7.6 symbols/min [2025-09-23T18:16:33.813702] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-23T18:16:34.002859] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:34.003095] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-09-23T18:16:34.003140] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-09-23T18:16:34.003303] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-23T18:16:34.003347] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-23T18:16:34.003389] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-23T18:16:34.003422] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-23T18:16:34.433912] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:34.492333] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T18:16:34.602194] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-23T18:16:34.730434] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T18:16:35.402192] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-23T18:16:35.830485] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T18:16:36.202231] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-23T18:16:36.516160] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T18:16:37.002204] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-23T18:16:37.687690] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:16:37.802207] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-23T18:16:38.299830] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T18:16:38.602223] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-23T18:16:38.806029] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T18:16:39.402209] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-23T18:16:39.909764] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:16:40.202203] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-23T18:16:40.219231] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T18:16:41.002240] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-23T18:16:41.802234] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-23T18:16:42.512610] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:16:42.549105] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-23T18:16:42.602174] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-23T18:16:42.627637] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T18:16:43.402218] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-23T18:16:44.202198] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-23T18:16:44.479866] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T18:16:44.507348] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T18:16:45.002204] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-23T18:16:45.629396] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T18:16:45.802260] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-23T18:16:46.602180] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-23T18:16:46.925539] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:16:46.932854] [INFO ] [REMOTE ] CXW: Full fetch complete (64990 records). [2025-09-23T18:16:46.933025] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-23T18:16:47.175693] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-23T18:16:47.386050] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-23T18:16:47.386144] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-23T18:16:47.386894] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-23T18:16:47.386961] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-23T18:16:47.388291] [DEBUG] [LOCAL ] CXW: Trimmed 64990 records to 44386 (keeping 200 days of data) [2025-09-23T18:16:47.436830] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-23T18:16:47.661206] [DEBUG] [LOCAL ] CXW: Primary data saved (44386 records). [2025-09-23T18:16:47.661340] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-23T18:16:47.661427] [INFO ] [MAIN ] Update Progress: 581/2372 symbols completed. CXW took 36.0s. Estimated remaining: 3h 56m 34s. Rate: 7.6 symbols/min [2025-09-23T18:16:47.834681] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:47.848875] [DEBUG] [LOCAL ] DAC: Loaded 12616 existing records from primary storage. [2025-09-23T18:16:47.849006] [INFO ] [MAIN ] DAC: Loaded 12616 existing records. [2025-09-23T18:16:48.034943] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:48.035494] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-23T18:16:48.035572] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-23T18:16:48.036270] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-23T18:16:48.036374] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-23T18:16:48.205223] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-23T18:16:48.244676] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T18:16:48.443039] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:48.878895] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:16:49.002218] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-23T18:16:49.814576] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-23T18:16:49.839884] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T18:16:50.262341] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T18:16:50.602215] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-23T18:16:51.402216] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-23T18:16:51.530085] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T18:16:52.011340] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:16:52.194323] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T18:16:52.200898] [INFO ] [REMOTE ] CYD: Full fetch complete (32032 records). [2025-09-23T18:16:52.200995] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-23T18:16:52.207357] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-23T18:16:52.605682] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-23T18:16:52.605783] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-23T18:16:52.606256] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-23T18:16:52.606296] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-23T18:16:52.608754] [DEBUG] [LOCAL ] CYD: Trimmed 32032 records to 26605 (keeping 200 days of data) [2025-09-23T18:16:52.766294] [DEBUG] [LOCAL ] CYD: Primary data saved (26605 records). [2025-09-23T18:16:52.766435] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-23T18:16:52.766535] [INFO ] [MAIN ] Update Progress: 582/2372 symbols completed. CYD took 31.7s. Estimated remaining: 3h 56m 17s. Rate: 7.6 symbols/min [2025-09-23T18:16:52.939350] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:52.995253] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-23T18:16:52.995430] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-09-23T18:16:53.008271] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-23T18:16:53.178419] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:53.178707] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-23T18:16:53.178763] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-23T18:16:53.180201] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-23T18:16:53.180263] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-23T18:16:53.532420] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:53.750906] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T18:16:53.802150] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-23T18:16:53.957275] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:16:54.602192] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-23T18:16:55.402216] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-23T18:16:56.052809] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-23T18:16:56.117842] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T18:16:56.202219] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-23T18:16:56.990614] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T18:16:57.002408] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-23T18:16:57.402800] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T18:16:57.802241] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-23T18:16:57.897217] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T18:16:58.602409] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-23T18:16:59.255864] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:16:59.264412] [INFO ] [REMOTE ] CYH: Full fetch complete (70428 records). [2025-09-23T18:16:59.264579] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-23T18:16:59.407314] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-23T18:16:59.678157] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-23T18:16:59.678250] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-23T18:16:59.679059] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-23T18:16:59.679127] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-23T18:16:59.680570] [DEBUG] [LOCAL ] CYH: Trimmed 70428 records to 47841 (keeping 200 days of data) [2025-09-23T18:16:59.969252] [DEBUG] [LOCAL ] CYH: Primary data saved (47841 records). [2025-09-23T18:16:59.969489] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-23T18:16:59.969684] [INFO ] [MAIN ] Update Progress: 583/2372 symbols completed. CYH took 31.0s. Estimated remaining: 3h 56m 7s. Rate: 7.6 symbols/min [2025-09-23T18:17:00.150913] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:00.202160] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-23T18:17:00.204232] [DEBUG] [LOCAL ] DAN: Loaded 49005 existing records from primary storage. [2025-09-23T18:17:00.204421] [INFO ] [MAIN ] DAN: Loaded 49005 existing records. [2025-09-23T18:17:00.438764] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T18:17:00.443443] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:00.454703] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-23T18:17:00.454901] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-23T18:17:00.456584] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-23T18:17:00.456691] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-23T18:17:00.573207] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:17:00.900028] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:01.002287] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-23T18:17:01.802263] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-23T18:17:02.257271] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-23T18:17:02.456807] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T18:17:02.602250] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-23T18:17:03.142230] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T18:17:03.365844] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:17:03.402149] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-23T18:17:04.202188] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-23T18:17:05.002172] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-23T18:17:05.034485] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:17:05.333515] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:17:05.802196] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-23T18:17:06.180963] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:17:06.602201] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-23T18:17:07.402158] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-23T18:17:07.890806] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-23T18:17:08.002412] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T18:17:08.101765] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T18:17:08.115741] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-09-23T18:17:08.115997] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-23T18:17:08.207479] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-23T18:17:08.560214] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-23T18:17:08.560348] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-23T18:17:08.562150] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-23T18:17:08.562278] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-23T18:17:08.566866] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 53647 (keeping 200 days of data) [2025-09-23T18:17:08.931253] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-09-23T18:17:08.931408] [INFO ] [MAIN ] D: Full history saved. [2025-09-23T18:17:08.931568] [INFO ] [MAIN ] Update Progress: 584/2372 symbols completed. D took 35.1s. Estimated remaining: 3h 56m 2s. Rate: 7.6 symbols/min [2025-09-23T18:17:09.007950] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-23T18:17:09.106813] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:09.131018] [DEBUG] [LOCAL ] DAO: Loaded 21421 existing records from primary storage. [2025-09-23T18:17:09.131165] [INFO ] [MAIN ] DAO: Loaded 21421 existing records. [2025-09-23T18:17:09.334012] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:09.334319] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-23T18:17:09.334386] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-23T18:17:09.335046] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-23T18:17:09.335145] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-23T18:17:09.707611] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:09.802186] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-23T18:17:10.194473] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T18:17:10.324742] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:17:10.602206] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-23T18:17:10.691381] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T18:17:11.203155] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T18:17:11.402227] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-23T18:17:12.202214] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-23T18:17:12.495975] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T18:17:12.498861] [INFO ] [REMOTE ] DAC: Full fetch complete (19747 records). [2025-09-23T18:17:12.498958] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-23T18:17:12.499491] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:17:12.499579] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:17:12.499664] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:17:12.499732] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-23T18:17:12.499793] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-23T18:17:12.499840] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-09-23T18:17:12.500311] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-09-23T18:17:12.500431] [INFO ] [MAIN ] Update Progress: 585/2372 symbols completed. DAC took 24.8s. Estimated remaining: 3h 55m 41s. Rate: 7.6 symbols/min [2025-09-23T18:17:12.683010] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:12.757554] [DEBUG] [LOCAL ] DAR: Loaded 51861 existing records from primary storage. [2025-09-23T18:17:12.757763] [INFO ] [MAIN ] DAR: Loaded 51861 existing records. [2025-09-23T18:17:12.956967] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:12.957246] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-23T18:17:12.957296] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-23T18:17:12.958354] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-23T18:17:12.958421] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-23T18:17:13.007469] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-23T18:17:13.346864] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:13.640127] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:17:13.802217] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-23T18:17:14.602271] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-23T18:17:15.402251] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-23T18:17:15.536046] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T18:17:15.840062] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-09-23T18:17:16.140298] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:17:16.161540] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:17:16.202151] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-23T18:17:17.002195] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-23T18:17:17.377289] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:17:17.802206] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-23T18:17:18.241279] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T18:17:18.602224] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-23T18:17:18.999682] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T18:17:19.402197] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-23T18:17:19.942593] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:17:20.202186] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-23T18:17:21.002269] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-23T18:17:21.383884] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T18:17:21.783196] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-23T18:17:21.802263] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-23T18:17:22.370770] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:17:22.602252] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-23T18:17:23.162061] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:17:23.402232] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-23T18:17:23.797784] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T18:17:24.202248] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-23T18:17:25.002162] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-23T18:17:25.193863] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T18:17:25.802195] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-23T18:17:25.942415] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T18:17:26.483633] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T18:17:26.602201] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-23T18:17:26.897509] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T18:17:27.402215] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-23T18:17:27.899436] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:17:28.202250] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-23T18:17:29.002205] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-23T18:17:29.537761] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T18:17:29.568542] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:17:29.802211] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-23T18:17:30.354117] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T18:17:30.602203] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-23T18:17:31.402203] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-23T18:17:31.720674] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T18:17:32.202226] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-23T18:17:32.485557] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T18:17:32.508243] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T18:17:33.002209] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-23T18:17:33.540900] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T18:17:33.549937] [INFO ] [REMOTE ] DAN: Full fetch complete (70872 records). [2025-09-23T18:17:33.550128] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-23T18:17:33.807305] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-23T18:17:33.963629] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-23T18:17:33.963749] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-23T18:17:33.964517] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-23T18:17:33.964561] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-23T18:17:33.966252] [DEBUG] [LOCAL ] DAN: Trimmed 70872 records to 49032 (keeping 200 days of data) [2025-09-23T18:17:34.296291] [DEBUG] [LOCAL ] DAN: Primary data saved (49032 records). [2025-09-23T18:17:34.296471] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-23T18:17:34.296806] [INFO ] [MAIN ] Update Progress: 586/2372 symbols completed. DAN took 34.3s. Estimated remaining: 3h 56m 15s. Rate: 7.6 symbols/min [2025-09-23T18:17:34.491032] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:34.525256] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T18:17:34.573624] [DEBUG] [LOCAL ] DAVA: Loaded 40440 existing records from primary storage. [2025-09-23T18:17:34.573799] [INFO ] [MAIN ] DAVA: Loaded 40440 existing records. [2025-09-23T18:17:34.607347] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-23T18:17:34.686338] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T18:17:34.780413] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:34.780777] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-23T18:17:34.780854] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-23T18:17:34.782203] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-23T18:17:34.782290] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-23T18:17:35.137000] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:35.402200] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-23T18:17:36.202194] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-23T18:17:36.354999] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T18:17:36.367570] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-23T18:17:36.367741] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-23T18:17:36.769812] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-23T18:17:36.769900] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-23T18:17:36.770736] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-23T18:17:36.770806] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-23T18:17:36.772433] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-09-23T18:17:37.007200] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-23T18:17:37.136289] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T18:17:37.148566] [INFO ] [REMOTE ] DAR: Full fetch complete (74556 records). [2025-09-23T18:17:37.149279] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-23T18:17:37.636232] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-23T18:17:37.636569] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-23T18:17:37.636682] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-23T18:17:37.656773] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-23T18:17:37.659535] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-23T18:17:37.659413] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-23T18:17:37.660025] [INFO ] [MAIN ] Update Progress: 587/2372 symbols completed. DAL took 44.9s. Estimated remaining: 3h 55m 54s. Rate: 7.6 symbols/min [2025-09-23T18:17:37.696626] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T18:17:37.711045] [DEBUG] [LOCAL ] DAR: Trimmed 74556 records to 51855 (keeping 200 days of data) [2025-09-23T18:17:37.818842] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-23T18:17:37.968443] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T18:17:37.967050] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:38.127793] [DEBUG] [LOCAL ] DAY: Loaded 49932 existing records from primary storage. [2025-09-23T18:17:38.129414] [INFO ] [MAIN ] DAY: Loaded 49932 existing records. [2025-09-23T18:17:38.323945] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:38.324459] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-23T18:17:38.324518] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-23T18:17:38.325903] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-23T18:17:38.326207] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-23T18:17:38.607036] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-23T18:17:38.779670] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:38.814289] [DEBUG] [LOCAL ] DAR: Primary data saved (51855 records). [2025-09-23T18:17:38.814510] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-23T18:17:38.814678] [INFO ] [MAIN ] Update Progress: 588/2372 symbols completed. DAR took 26.3s. Estimated remaining: 3h 55m 25s. Rate: 7.6 symbols/min [2025-09-23T18:17:38.988904] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:39.007323] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T18:17:39.060351] [DEBUG] [LOCAL ] DB: Loaded 52637 existing records from primary storage. [2025-09-23T18:17:39.060499] [INFO ] [MAIN ] DB: Loaded 52637 existing records. [2025-09-23T18:17:39.244856] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:39.245177] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-23T18:17:39.245235] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-23T18:17:39.246391] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-23T18:17:39.246452] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-23T18:17:39.411671] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-23T18:17:39.632218] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:39.628465] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T18:17:39.636338] [INFO ] [REMOTE ] DAO: Full fetch complete (32581 records). [2025-09-23T18:17:39.636444] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-23T18:17:40.032740] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-23T18:17:40.032825] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-23T18:17:40.033301] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-23T18:17:40.033362] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-23T18:17:40.034504] [DEBUG] [LOCAL ] DAO: Trimmed 32581 records to 21242 (keeping 200 days of data) [2025-09-23T18:17:40.157212] [DEBUG] [LOCAL ] DAO: Primary data saved (21242 records). [2025-09-23T18:17:40.157346] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-23T18:17:40.157432] [INFO ] [MAIN ] Update Progress: 589/2372 symbols completed. DAO took 31.2s. Estimated remaining: 3h 54m 57s. Rate: 7.6 symbols/min [2025-09-23T18:17:40.211771] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-23T18:17:40.327902] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:40.328100] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-23T18:17:40.328155] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-23T18:17:40.328296] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-23T18:17:40.328338] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-23T18:17:40.328378] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-23T18:17:40.328411] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-23T18:17:40.746129] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:40.951352] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T18:17:41.002165] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-23T18:17:41.603130] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:17:41.802239] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-23T18:17:41.933352] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T18:17:42.602256] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-23T18:17:42.824373] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:17:43.355838] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:17:43.402140] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-23T18:17:43.972708] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T18:17:44.202181] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-23T18:17:45.002235] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-23T18:17:45.616886] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T18:17:45.802171] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-23T18:17:46.033737] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T18:17:46.602209] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-23T18:17:47.154222] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:17:47.337029] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T18:17:47.402154] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-23T18:17:48.202205] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-23T18:17:48.293305] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:17:49.002275] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-23T18:17:49.802220] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-23T18:17:50.006269] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T18:17:50.523289] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:17:50.602157] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-23T18:17:51.155859] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:17:51.402228] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-23T18:17:51.970378] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:17:52.202235] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-23T18:17:53.002174] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-23T18:17:53.136817] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T18:17:53.339217] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:17:53.802251] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-23T18:17:54.048876] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:17:54.602252] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-23T18:17:54.866387] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T18:17:55.402195] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-23T18:17:55.900603] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T18:17:56.202232] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-23T18:17:56.555974] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T18:17:57.002218] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-23T18:17:57.738629] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T18:17:57.802201] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-23T18:17:58.132356] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T18:17:58.602217] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-23T18:17:59.402209] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-23T18:17:59.694821] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T18:17:59.771935] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:18:00.202219] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-23T18:18:00.573591] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:18:01.002216] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-23T18:18:01.802210] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-23T18:18:01.971749] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T18:18:01.975971] [INFO ] [REMOTE ] DBD: Full fetch complete (30384 records). [2025-09-23T18:18:01.976067] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-23T18:18:01.976746] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:18:01.976861] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:18:01.976944] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:18:01.977051] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-23T18:18:01.977147] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-23T18:18:01.977193] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-23T18:18:01.977263] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-23T18:18:01.977349] [INFO ] [MAIN ] Update Progress: 590/2372 symbols completed. DBD took 21.8s. Estimated remaining: 3h 55m 31s. Rate: 7.6 symbols/min [2025-09-23T18:18:02.166555] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:02.210982] [DEBUG] [LOCAL ] DBI: Loaded 45104 existing records from primary storage. [2025-09-23T18:18:02.211188] [INFO ] [MAIN ] DBI: Loaded 45104 existing records. [2025-09-23T18:18:02.410045] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:02.429877] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-23T18:18:02.430013] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-23T18:18:02.432563] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-23T18:18:02.432477] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-23T18:18:02.432841] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-23T18:18:02.609822] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-23T18:18:02.809867] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:03.402262] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-23T18:18:04.202207] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-23T18:18:06.226470] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (4.42 seconds). [2025-09-23T18:18:06.234620] [INFO ] [REMOTE ] DAVA: Full fetch complete (55265 records). [2025-09-23T18:18:06.234805] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-23T18:18:06.633172] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-23T18:18:06.633358] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-23T18:18:06.634225] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-23T18:18:06.634312] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-23T18:18:06.645204] [DEBUG] [LOCAL ] DAVA: Trimmed 55265 records to 40534 (keeping 200 days of data) [2025-09-23T18:18:06.664313] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (3.26 seconds). [2025-09-23T18:18:06.731701] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-23T18:18:06.798895] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (4.19 seconds). [2025-09-23T18:18:06.815997] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-23T18:18:06.955716] [DEBUG] [LOCAL ] DAVA: Primary data saved (40534 records). [2025-09-23T18:18:06.955853] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-23T18:18:06.955936] [INFO ] [MAIN ] Update Progress: 591/2372 symbols completed. DAVA took 32.7s. Estimated remaining: 3h 55m 15s. Rate: 7.6 symbols/min [2025-09-23T18:18:07.146277] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:07.157209] [DEBUG] [LOCAL ] DBL: Loaded 9064 existing records from primary storage. [2025-09-23T18:18:07.157323] [INFO ] [MAIN ] DBL: Loaded 9064 existing records. [2025-09-23T18:18:07.345792] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:07.346082] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-23T18:18:07.346235] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-23T18:18:07.346722] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-23T18:18:07.346885] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-23T18:18:07.568515] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-23T18:18:07.664119] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-23T18:18:07.763023] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:07.763326] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-23T18:18:08.030823] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:18:08.131268] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T18:18:08.202151] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-23T18:18:08.314972] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T18:18:09.002206] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-23T18:18:09.183615] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T18:18:09.807382] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-23T18:18:09.820145] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T18:18:10.143064] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:18:10.602202] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-23T18:18:11.402239] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-23T18:18:11.781686] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T18:18:12.132504] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T18:18:12.202175] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-23T18:18:12.302688] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:18:13.002217] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-23T18:18:13.743487] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T18:18:13.802276] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-23T18:18:14.602335] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-23T18:18:14.704621] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T18:18:15.287825] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:18:15.296378] [INFO ] [REMOTE ] DAY: Full fetch complete (71732 records). [2025-09-23T18:18:15.296584] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-23T18:18:15.407385] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-23T18:18:15.739077] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-23T18:18:15.739218] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-23T18:18:15.740286] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-23T18:18:15.740380] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-23T18:18:15.742603] [DEBUG] [LOCAL ] DAY: Trimmed 71732 records to 49894 (keeping 200 days of data) [2025-09-23T18:18:15.984706] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:18:16.072524] [DEBUG] [LOCAL ] DAY: Primary data saved (49894 records). [2025-09-23T18:18:16.072768] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-23T18:18:16.072894] [INFO ] [MAIN ] Update Progress: 592/2372 symbols completed. DAY took 38.4s. Estimated remaining: 3h 55m 10s. Rate: 7.6 symbols/min [2025-09-23T18:18:16.202890] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-23T18:18:16.296153] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:16.296578] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-09-23T18:18:16.297226] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-09-23T18:18:16.297607] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-23T18:18:16.297688] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-23T18:18:16.297753] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-23T18:18:16.297791] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-23T18:18:16.716883] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:16.739810] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T18:18:16.748259] [INFO ] [REMOTE ] DB: Full fetch complete (73706 records). [2025-09-23T18:18:16.748429] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-23T18:18:16.749238] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:18:16.749337] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:18:16.749380] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:18:16.749421] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-23T18:18:16.749481] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-23T18:18:16.749516] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-09-23T18:18:16.749949] [DEBUG] [LOCAL ] DB: Deleted derivative data file. [2025-09-23T18:18:16.750054] [INFO ] [MAIN ] Update Progress: 593/2372 symbols completed. DB took 37.9s. Estimated remaining: 3h 54m 41s. Rate: 7.6 symbols/min [2025-09-23T18:18:16.916958] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:16.955298] [DEBUG] [LOCAL ] DCI: Loaded 37609 existing records from primary storage. [2025-09-23T18:18:16.955463] [INFO ] [MAIN ] DCI: Loaded 37609 existing records. [2025-09-23T18:18:17.010936] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-23T18:18:17.158551] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:17.158857] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-23T18:18:17.158909] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-23T18:18:17.159827] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-23T18:18:17.159891] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-23T18:18:17.522803] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:17.642920] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T18:18:17.802227] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-23T18:18:18.332777] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T18:18:18.602253] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-23T18:18:19.411733] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-23T18:18:19.416824] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T18:18:20.033241] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T18:18:20.202170] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-23T18:18:20.735634] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T18:18:21.002196] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-23T18:18:21.361488] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:18:21.802238] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-23T18:18:22.092441] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:18:22.602199] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-23T18:18:22.990958] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T18:18:23.402235] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-23T18:18:23.927541] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T18:18:24.196482] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T18:18:24.202135] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-23T18:18:24.670172] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T18:18:25.002210] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-23T18:18:25.802209] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-23T18:18:26.071762] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T18:18:26.602207] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-23T18:18:27.158845] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:18:27.402201] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-23T18:18:28.202176] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-23T18:18:28.505773] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T18:18:28.513267] [INFO ] [REMOTE ] DBI: Full fetch complete (66494 records). [2025-09-23T18:18:28.513408] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-23T18:18:28.916305] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-23T18:18:28.916392] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-23T18:18:28.917133] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-23T18:18:28.917197] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-23T18:18:28.918570] [DEBUG] [LOCAL ] DBI: Trimmed 66494 records to 45060 (keeping 200 days of data) [2025-09-23T18:18:29.007525] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-23T18:18:29.192729] [DEBUG] [LOCAL ] DBI: Primary data saved (45060 records). [2025-09-23T18:18:29.192896] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-23T18:18:29.193004] [INFO ] [MAIN ] Update Progress: 594/2372 symbols completed. DBI took 27.2s. Estimated remaining: 3h 54m 46s. Rate: 7.6 symbols/min [2025-09-23T18:18:29.385615] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-23T18:18:29.430353] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:29.445844] [DEBUG] [LOCAL ] DCO: Loaded 13666 existing records from primary storage. [2025-09-23T18:18:29.445968] [INFO ] [MAIN ] DCO: Loaded 13666 existing records. [2025-09-23T18:18:29.602376] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T18:18:29.641119] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:29.644912] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-23T18:18:29.644983] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-23T18:18:29.645473] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-23T18:18:29.645539] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-23T18:18:29.804888] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-23T18:18:30.045153] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:30.047608] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:18:30.602177] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-23T18:18:30.695058] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:18:31.402197] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-23T18:18:31.436598] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T18:18:32.202242] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-23T18:18:33.002185] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-23T18:18:33.081813] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T18:18:33.720902] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:18:33.802158] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-23T18:18:33.823754] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T18:18:34.602189] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-23T18:18:35.351498] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T18:18:35.390305] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:18:35.402153] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-23T18:18:36.198563] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T18:18:36.202141] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-23T18:18:36.812150] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T18:18:37.002212] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-23T18:18:37.630574] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T18:18:37.802213] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-23T18:18:38.602192] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-23T18:18:39.188733] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:18:39.259318] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T18:18:39.402201] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-23T18:18:40.202232] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-23T18:18:40.478578] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T18:18:41.002274] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-23T18:18:41.180684] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:18:41.802207] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-23T18:18:42.602283] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-23T18:18:43.074995] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-23T18:18:43.402300] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-23T18:18:43.541312] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T18:18:43.543331] [INFO ] [REMOTE ] DBL: Full fetch complete (12441 records). [2025-09-23T18:18:43.543403] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-23T18:18:43.912245] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-23T18:18:43.912332] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-23T18:18:43.912727] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-23T18:18:43.912790] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-23T18:18:43.913315] [DEBUG] [LOCAL ] DBL: Trimmed 12441 records to 9081 (keeping 200 days of data) [2025-09-23T18:18:43.969204] [DEBUG] [LOCAL ] DBL: Primary data saved (9081 records). [2025-09-23T18:18:43.969335] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-23T18:18:43.969425] [INFO ] [MAIN ] Update Progress: 595/2372 symbols completed. DBL took 37.0s. Estimated remaining: 3h 54m 59s. Rate: 7.6 symbols/min [2025-09-23T18:18:44.149425] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:44.202443] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-23T18:18:44.204764] [DEBUG] [LOCAL ] DD: Loaded 52821 existing records from primary storage. [2025-09-23T18:18:44.205172] [INFO ] [MAIN ] DD: Loaded 52821 existing records. [2025-09-23T18:18:44.445225] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:44.415781] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T18:18:44.446266] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-23T18:18:44.446524] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-23T18:18:44.453580] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-23T18:18:44.453692] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-23T18:18:44.671690] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T18:18:44.868629] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:45.002159] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-23T18:18:45.746836] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:18:45.802180] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-23T18:18:46.602214] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-23T18:18:46.853769] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:18:46.894514] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T18:18:47.402190] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-23T18:18:48.032573] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T18:18:48.202185] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-23T18:18:48.839619] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T18:18:49.002158] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-23T18:18:49.240525] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T18:18:49.802194] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-23T18:18:50.360561] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T18:18:50.602185] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-23T18:18:51.128810] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T18:18:51.136873] [INFO ] [REMOTE ] DBRG: Full fetch complete (71829 records). [2025-09-23T18:18:51.137003] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-23T18:18:51.137861] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:18:51.137955] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:18:51.137999] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:18:51.138046] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-23T18:18:51.138139] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-23T18:18:51.138197] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-09-23T18:18:51.138258] [DEBUG] [LOCAL ] DBRG: No derivative data file found to delete. [2025-09-23T18:18:51.138340] [INFO ] [MAIN ] Update Progress: 596/2372 symbols completed. DBRG took 35.1s. Estimated remaining: 3h 54m 49s. Rate: 7.6 symbols/min [2025-09-23T18:18:51.327372] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:51.327709] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-09-23T18:18:51.327765] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-09-23T18:18:51.327978] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-23T18:18:51.328027] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-23T18:18:51.328072] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-23T18:18:51.328105] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-23T18:18:51.411040] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-23T18:18:51.712891] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:52.202197] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-23T18:18:52.441694] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T18:18:52.615885] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T18:18:52.622613] [INFO ] [REMOTE ] DCI: Full fetch complete (54348 records). [2025-09-23T18:18:52.622794] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-23T18:18:52.998685] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-23T18:18:52.998775] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-23T18:18:52.999398] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-23T18:18:52.999438] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-23T18:18:53.000528] [DEBUG] [LOCAL ] DCI: Trimmed 54348 records to 37606 (keeping 200 days of data) [2025-09-23T18:18:53.002244] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-23T18:18:53.231993] [DEBUG] [LOCAL ] DCI: Primary data saved (37606 records). [2025-09-23T18:18:53.232133] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-23T18:18:53.232218] [INFO ] [MAIN ] Update Progress: 597/2372 symbols completed. DCI took 36.5s. Estimated remaining: 3h 54m 23s. Rate: 7.6 symbols/min [2025-09-23T18:18:53.802169] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-23T18:18:53.910141] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T18:18:53.928829] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T18:18:53.931988] [INFO ] [REMOTE ] DCO: Full fetch complete (19567 records). [2025-09-23T18:18:53.932064] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-23T18:18:54.294849] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-23T18:18:54.294925] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-23T18:18:54.295326] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-23T18:18:54.295386] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-23T18:18:54.295988] [DEBUG] [LOCAL ] DCO: Trimmed 19567 records to 13718 (keeping 200 days of data) [2025-09-23T18:18:54.379739] [DEBUG] [LOCAL ] DCO: Primary data saved (13718 records). [2025-09-23T18:18:54.379874] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-23T18:18:54.379958] [INFO ] [MAIN ] Update Progress: 598/2372 symbols completed. DCO took 25.2s. Estimated remaining: 3h 53m 55s. Rate: 7.6 symbols/min [2025-09-23T18:18:54.602268] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-23T18:18:55.364806] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T18:18:55.402153] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-23T18:18:56.025752] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T18:18:56.202188] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-23T18:18:57.381925] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-23T18:18:57.393255] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-23T18:18:57.467727] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T18:18:57.802232] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-23T18:18:58.758240] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T18:18:58.768940] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-23T18:18:59.304435] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:18:59.402208] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-23T18:19:00.827157] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T18:19:00.839203] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-23T18:19:01.414835] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-23T18:19:01.426019] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-23T18:19:02.348063] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:19:02.360401] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-23T18:19:03.441551] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:19:03.452411] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-23T18:19:04.143722] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T18:19:04.152524] [INFO ] [REMOTE ] DD: Full fetch complete (76268 records). [2025-09-23T18:19:04.152697] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-23T18:19:04.549746] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-23T18:19:04.549839] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-23T18:19:04.550672] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-23T18:19:04.550737] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-23T18:19:04.552234] [DEBUG] [LOCAL ] DD: Trimmed 76268 records to 52827 (keeping 200 days of data) [2025-09-23T18:19:04.889086] [DEBUG] [LOCAL ] DD: Primary data saved (52827 records). [2025-09-23T18:19:04.889256] [INFO ] [MAIN ] DD: Full history saved. [2025-09-23T18:19:04.889402] [INFO ] [MAIN ] Update Progress: 599/2372 symbols completed. DD took 20.9s. Estimated remaining: 3h 53m 55s. Rate: 7.6 symbols/min [2025-09-23T18:19:04.935841] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:19:04.947127] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-23T18:19:06.355709] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:19:06.366609] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-23T18:19:07.858624] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:19:07.870180] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-23T18:19:09.740193] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T18:19:09.749234] [INFO ] [REMOTE ] DDD: Full fetch complete (73655 records). [2025-09-23T18:19:09.749421] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-23T18:19:10.146535] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-23T18:19:10.146636] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-23T18:19:10.147492] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-23T18:19:10.147546] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-23T18:19:10.149078] [DEBUG] [LOCAL ] DDD: Trimmed 73655 records to 50863 (keeping 200 days of data) [2025-09-23T18:19:10.454278] [DEBUG] [LOCAL ] DDD: Primary data saved (50863 records). [2025-09-23T18:19:10.454566] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-23T18:19:10.454775] [INFO ] [MAIN ] Update Progress: 600/2372 symbols completed. DDD took 19.3s. Estimated remaining: 3h 53m 40s. Rate: 7.6 symbols/min [2025-09-23T18:19:11.101763] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:11.274325] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:11.254025] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:11.273048] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:11.275544] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-09-23T18:19:11.275604] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-09-23T18:19:11.275792] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-23T18:19:11.275847] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-23T18:19:11.276969] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-09-23T18:19:11.277027] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-23T18:19:11.343104] [DEBUG] [LOCAL ] DDT: Loaded 2092 existing records from primary storage. [2025-09-23T18:19:11.368563] [INFO ] [MAIN ] DDT: Loaded 2092 existing records. [2025-09-23T18:19:11.430338] [DEBUG] [LOCAL ] DDS: Loaded 13317 existing records from primary storage. [2025-09-23T18:19:11.452214] [INFO ] [MAIN ] DDS: Loaded 13317 existing records. [2025-09-23T18:19:11.809936] [DEBUG] [LOCAL ] DE: Loaded 47776 existing records from primary storage. [2025-09-23T18:19:11.851213] [INFO ] [MAIN ] DE: Loaded 47776 existing records. [2025-09-23T18:19:12.030795] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:12.120636] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-23T18:19:12.115371] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:12.144472] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-23T18:19:12.174514] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-23T18:19:12.174615] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-23T18:19:12.178843] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-23T18:19:12.189221] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-23T18:19:12.178740] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:12.215783] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-23T18:19:12.216187] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-23T18:19:12.221921] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-23T18:19:12.397290] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:12.470729] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-23T18:19:12.492155] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-23T18:19:12.517343] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-23T18:19:12.537070] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-23T18:19:13.173266] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:13.244933] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-23T18:19:13.308313] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:13.335511] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-23T18:19:13.446424] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:13.446851] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-23T18:19:13.729208] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:19:13.740354] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-23T18:19:13.827213] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T18:19:13.828572] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-23T18:19:14.268292] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T18:19:14.270159] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-23T18:19:14.425534] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T18:19:14.428935] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-23T18:19:14.578335] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T18:19:14.579406] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-23T18:19:14.709168] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:19:14.717607] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-23T18:19:14.923204] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T18:19:14.925585] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-23T18:19:14.926907] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T18:19:14.937876] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-23T18:19:15.037793] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:19:15.402230] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-23T18:19:15.504574] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T18:19:15.630142] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T18:19:16.202180] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-23T18:19:16.281566] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:19:16.391738] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T18:19:16.541845] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-23T18:19:17.002225] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-23T18:19:17.802246] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-23T18:19:18.430026] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T18:19:18.602261] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-23T18:19:18.994621] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T18:19:19.230973] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T18:19:19.402181] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-23T18:19:20.202191] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-23T18:19:20.978125] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:19:21.002154] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-23T18:19:21.217542] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:19:21.802213] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-23T18:19:22.602224] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-23T18:19:22.871195] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T18:19:22.934902] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T18:19:22.942984] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-23T18:19:23.402198] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-23T18:19:23.838612] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T18:19:24.202211] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-23T18:19:25.002251] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-23T18:19:25.802356] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-23T18:19:26.191958] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T18:19:26.591704] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T18:19:26.602189] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-23T18:19:27.083925] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T18:19:27.368412] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T18:19:27.370125] [INFO ] [REMOTE ] DDT: Full fetch complete (2893 records). [2025-09-23T18:19:27.370298] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-23T18:19:27.371575] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:19:27.371751] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:19:27.371836] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:19:27.371981] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-23T18:19:27.372113] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-09-23T18:19:27.372218] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-09-23T18:19:27.372764] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-09-23T18:19:27.372989] [INFO ] [MAIN ] Update Progress: 601/2372 symbols completed. DDT took 16.9s. Estimated remaining: 3h 53m 59s. Rate: 7.6 symbols/min [2025-09-23T18:19:27.407819] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-23T18:19:27.597577] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:27.676807] [DEBUG] [LOCAL ] DEA: Loaded 41546 existing records from primary storage. [2025-09-23T18:19:27.677017] [INFO ] [MAIN ] DEA: Loaded 41546 existing records. [2025-09-23T18:19:27.873812] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:27.874060] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-23T18:19:27.874110] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-23T18:19:27.875493] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-23T18:19:27.875566] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-23T18:19:28.203087] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-23T18:19:28.270585] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:28.272225] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T18:19:29.002206] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-23T18:19:29.619463] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:19:29.802198] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-23T18:19:30.055544] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T18:19:30.602205] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-23T18:19:31.187983] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:19:31.402161] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-23T18:19:31.627342] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T18:19:32.202166] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-23T18:19:32.341347] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T18:19:32.880779] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T18:19:33.002220] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-23T18:19:33.802211] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-23T18:19:34.402873] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:19:34.602197] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-23T18:19:35.171438] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T18:19:35.402169] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-23T18:19:35.543600] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:19:35.546878] [INFO ] [REMOTE ] DDS: Full fetch complete (19254 records). [2025-09-23T18:19:35.546952] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-23T18:19:35.913586] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-23T18:19:35.913710] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-23T18:19:35.914091] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-23T18:19:35.914158] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-23T18:19:35.914772] [DEBUG] [LOCAL ] DDS: Trimmed 19254 records to 13255 (keeping 200 days of data) [2025-09-23T18:19:36.008343] [DEBUG] [LOCAL ] DDS: Primary data saved (13255 records). [2025-09-23T18:19:36.008474] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-23T18:19:36.008590] [INFO ] [MAIN ] Update Progress: 602/2372 symbols completed. DDS took 25.6s. Estimated remaining: 3h 53m 53s. Rate: 7.6 symbols/min [2025-09-23T18:19:36.177109] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:36.203268] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-23T18:19:36.219963] [DEBUG] [LOCAL ] DEC: Loaded 30832 existing records from primary storage. [2025-09-23T18:19:36.220108] [INFO ] [MAIN ] DEC: Loaded 30832 existing records. [2025-09-23T18:19:36.396356] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:36.396604] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-23T18:19:36.396702] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-23T18:19:36.397834] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-23T18:19:36.397896] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-23T18:19:36.755136] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:37.002213] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-23T18:19:37.082585] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:19:37.092098] [INFO ] [REMOTE ] DE: Full fetch complete (69603 records). [2025-09-23T18:19:37.092225] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-23T18:19:37.140850] [DEBUG] [REMOTE ] DEC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-23T18:19:37.168471] [WARN ] [REMOTE ] DEC: No data returned for month 2024-12 [2025-09-23T18:19:37.505523] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-23T18:19:37.505700] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-23T18:19:37.506760] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-23T18:19:37.506828] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-23T18:19:37.508466] [DEBUG] [LOCAL ] DE: Trimmed 69603 records to 47738 (keeping 200 days of data) [2025-09-23T18:19:37.776871] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T18:19:37.802254] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-23T18:19:37.876364] [DEBUG] [LOCAL ] DE: Primary data saved (47738 records). [2025-09-23T18:19:37.876545] [INFO ] [MAIN ] DE: Full history saved. [2025-09-23T18:19:37.876698] [INFO ] [MAIN ] Update Progress: 603/2372 symbols completed. DE took 27.4s. Estimated remaining: 3h 53m 27s. Rate: 7.6 symbols/min [2025-09-23T18:19:38.054789] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:38.055000] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-09-23T18:19:38.055054] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-09-23T18:19:38.055230] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-23T18:19:38.055273] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-23T18:19:38.055313] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-09-23T18:19:38.055345] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-23T18:19:38.438874] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:38.602195] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-23T18:19:39.365192] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:19:39.402151] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-23T18:19:40.202208] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-23T18:19:40.253235] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T18:19:41.002173] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-23T18:19:41.101705] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:19:41.167827] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T18:19:41.802207] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-23T18:19:42.101115] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T18:19:42.602218] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-23T18:19:43.278244] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T18:19:43.402191] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-23T18:19:44.062310] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T18:19:44.202217] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-23T18:19:44.587167] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:19:45.002263] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-23T18:19:45.802190] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-23T18:19:45.855547] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T18:19:46.133249] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T18:19:46.602294] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-23T18:19:46.957504] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T18:19:47.402229] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-23T18:19:48.202184] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-23T18:19:48.273699] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:19:48.881876] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:19:48.890313] [INFO ] [REMOTE ] DDL: Full fetch complete (53312 records). [2025-09-23T18:19:48.890467] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-23T18:19:49.007417] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-23T18:19:49.289160] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-23T18:19:49.289277] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-23T18:19:49.290145] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-23T18:19:49.290210] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-23T18:19:49.291477] [DEBUG] [LOCAL ] DDL: Trimmed 53312 records to 36276 (keeping 200 days of data) [2025-09-23T18:19:49.504699] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T18:19:49.538065] [DEBUG] [LOCAL ] DDL: Primary data saved (36276 records). [2025-09-23T18:19:49.538215] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-23T18:19:49.538331] [INFO ] [MAIN ] Update Progress: 604/2372 symbols completed. DDL took 39.1s. Estimated remaining: 3h 53m 30s. Rate: 7.6 symbols/min [2025-09-23T18:19:49.709091] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:49.759683] [DEBUG] [LOCAL ] DEI: Loaded 48508 existing records from primary storage. [2025-09-23T18:19:49.759854] [INFO ] [MAIN ] DEI: Loaded 48508 existing records. [2025-09-23T18:19:49.813942] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-23T18:19:49.940376] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:49.940662] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-23T18:19:49.940724] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-23T18:19:49.942333] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-23T18:19:49.942395] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-23T18:19:50.301423] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:50.602275] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-23T18:19:50.649066] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T18:19:51.402234] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-23T18:19:51.610400] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T18:19:51.673866] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T18:19:52.202225] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-23T18:19:52.588568] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:19:53.002220] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-23T18:19:53.675740] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T18:19:53.802219] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-23T18:19:54.602179] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-23T18:19:54.692901] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T18:19:55.190235] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:19:55.402244] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-23T18:19:55.993399] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T18:19:56.202195] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-23T18:19:56.493512] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T18:19:56.950973] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T18:19:57.002159] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-23T18:19:57.802236] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-23T18:19:58.073412] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T18:19:58.079310] [INFO ] [REMOTE ] DEC: Full fetch complete (39953 records). [2025-09-23T18:19:58.079605] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-23T18:19:58.274800] [WARN ] [VALIDATOR ] DEC: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T18:19:58.275429] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:19:58.275520] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:19:58.275609] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-23T18:19:58.275754] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-09-23T18:19:58.275837] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-09-23T18:19:58.276305] [DEBUG] [LOCAL ] DEC: Deleted derivative data file. [2025-09-23T18:19:58.276440] [INFO ] [MAIN ] Update Progress: 605/2372 symbols completed. DEC took 22.3s. Estimated remaining: 3h 53m 25s. Rate: 7.6 symbols/min [2025-09-23T18:19:58.449073] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:58.504913] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-09-23T18:19:58.505129] [INFO ] [MAIN ] DELL: Loaded 53735 existing records. [2025-09-23T18:19:58.604104] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-23T18:19:58.687875] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:58.688144] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-23T18:19:58.688194] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-23T18:19:58.690329] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-23T18:19:58.690393] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-23T18:19:59.054551] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:59.079300] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T18:19:59.402241] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-23T18:20:00.202241] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-23T18:20:00.616479] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T18:20:00.652450] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T18:20:01.002159] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-23T18:20:01.673629] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:20:01.802198] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-23T18:20:02.602216] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-23T18:20:02.931426] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T18:20:02.938140] [INFO ] [REMOTE ] DEA: Full fetch complete (63120 records). [2025-09-23T18:20:02.938249] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-23T18:20:03.353059] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-23T18:20:03.353211] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-23T18:20:03.353998] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-23T18:20:03.354116] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-23T18:20:03.384069] [DEBUG] [LOCAL ] DEA: Trimmed 63120 records to 41499 (keeping 200 days of data) [2025-09-23T18:20:03.385365] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-23T18:20:03.402148] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-23T18:20:03.664941] [DEBUG] [LOCAL ] DEA: Primary data saved (41499 records). [2025-09-23T18:20:03.665115] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-23T18:20:03.665232] [INFO ] [MAIN ] Update Progress: 606/2372 symbols completed. DEA took 36.3s. Estimated remaining: 3h 53m 9s. Rate: 7.6 symbols/min [2025-09-23T18:20:03.845423] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:03.898712] [DEBUG] [LOCAL ] DEO: Loaded 49009 existing records from primary storage. [2025-09-23T18:20:03.898896] [INFO ] [MAIN ] DEO: Loaded 49009 existing records. [2025-09-23T18:20:04.080730] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:04.080979] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-23T18:20:04.081029] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-23T18:20:04.082473] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-23T18:20:04.082537] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-23T18:20:04.207358] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-23T18:20:04.453199] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:04.673340] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T18:20:05.002258] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-23T18:20:05.362624] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-23T18:20:05.692418] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T18:20:05.802158] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-23T18:20:06.556124] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T18:20:06.602153] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-23T18:20:07.335334] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T18:20:07.402175] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-23T18:20:07.946059] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:20:08.202243] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-23T18:20:09.002200] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-23T18:20:09.038411] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T18:20:09.808182] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-23T18:20:09.813774] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T18:20:10.518744] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T18:20:10.602165] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-23T18:20:11.006504] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T18:20:11.402207] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-23T18:20:12.202157] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-23T18:20:12.302966] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T18:20:12.311928] [INFO ] [REMOTE ] DECK: Full fetch complete (76591 records). [2025-09-23T18:20:12.312159] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-23T18:20:12.741144] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-23T18:20:12.741242] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-23T18:20:12.742092] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-23T18:20:12.742157] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-23T18:20:12.743661] [DEBUG] [LOCAL ] DECK: Trimmed 76591 records to 53303 (keeping 200 days of data) [2025-09-23T18:20:13.017622] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-23T18:20:13.067132] [DEBUG] [LOCAL ] DECK: Primary data saved (53303 records). [2025-09-23T18:20:13.067289] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-23T18:20:13.067390] [INFO ] [MAIN ] Update Progress: 607/2372 symbols completed. DECK took 35.2s. Estimated remaining: 3h 53m 6s. Rate: 7.6 symbols/min [2025-09-23T18:20:13.243142] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:13.275220] [DEBUG] [LOCAL ] DFH: Loaded 32971 existing records from primary storage. [2025-09-23T18:20:13.275368] [INFO ] [MAIN ] DFH: Loaded 32971 existing records. [2025-09-23T18:20:13.461744] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:13.462131] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-23T18:20:13.462201] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-23T18:20:13.463924] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-23T18:20:13.463992] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-23T18:20:13.862224] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:13.862843] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-23T18:20:13.896110] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-23T18:20:13.934878] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T18:20:14.298096] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:20:14.602322] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-23T18:20:15.402235] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-23T18:20:15.505135] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:20:16.202270] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-23T18:20:17.002181] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-23T18:20:17.076386] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-23T18:20:17.626772] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:20:17.802207] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-23T18:20:18.090792] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:20:18.602161] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-23T18:20:19.010480] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (3.61 seconds). [2025-09-23T18:20:19.018512] [INFO ] [REMOTE ] DEI: Full fetch complete (69176 records). [2025-09-23T18:20:19.018671] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-23T18:20:19.019400] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:20:19.019470] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:20:19.019519] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:20:19.019631] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-23T18:20:19.019736] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-23T18:20:19.019777] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-09-23T18:20:19.020345] [DEBUG] [LOCAL ] DEI: Deleted derivative data file. [2025-09-23T18:20:19.020443] [INFO ] [MAIN ] Update Progress: 608/2372 symbols completed. DEI took 29.5s. Estimated remaining: 3h 52m 52s. Rate: 7.6 symbols/min [2025-09-23T18:20:19.198502] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:19.224231] [DEBUG] [LOCAL ] DFIN: Loaded 23411 existing records from primary storage. [2025-09-23T18:20:19.224388] [INFO ] [MAIN ] DFIN: Loaded 23411 existing records. [2025-09-23T18:20:19.405931] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-23T18:20:19.455430] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:20:19.511800] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:19.513902] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-23T18:20:19.514057] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-23T18:20:19.515054] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-23T18:20:19.515218] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-23T18:20:19.677534] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:20:20.092118] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:20.202260] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-23T18:20:21.002218] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-23T18:20:21.458335] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-23T18:20:21.675789] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T18:20:21.802202] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-23T18:20:21.964086] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T18:20:22.602197] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-23T18:20:23.402179] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-23T18:20:23.525204] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T18:20:23.809327] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T18:20:24.202243] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-23T18:20:24.508633] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:20:25.002205] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-23T18:20:25.802169] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-23T18:20:26.079526] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T18:20:26.323049] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:20:26.602194] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-23T18:20:27.402204] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-23T18:20:27.964050] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T18:20:28.139778] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T18:20:28.202204] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-23T18:20:28.930756] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T18:20:28.939291] [INFO ] [REMOTE ] DEO: Full fetch complete (71481 records). [2025-09-23T18:20:28.939453] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-23T18:20:29.007300] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-23T18:20:29.358603] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-23T18:20:29.358783] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-23T18:20:29.359733] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-23T18:20:29.359816] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-23T18:20:29.361406] [DEBUG] [LOCAL ] DEO: Trimmed 71481 records to 49010 (keeping 200 days of data) [2025-09-23T18:20:29.469066] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T18:20:29.684897] [DEBUG] [LOCAL ] DEO: Primary data saved (49010 records). [2025-09-23T18:20:29.685040] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-23T18:20:29.685154] [INFO ] [MAIN ] Update Progress: 609/2372 symbols completed. DEO took 26.0s. Estimated remaining: 3h 52m 52s. Rate: 7.6 symbols/min [2025-09-23T18:20:29.805138] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-23T18:20:29.871212] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:29.885028] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T18:20:29.899929] [DEBUG] [LOCAL ] DFP: Loaded 11675 existing records from primary storage. [2025-09-23T18:20:29.900086] [INFO ] [MAIN ] DFP: Loaded 11675 existing records. [2025-09-23T18:20:30.086990] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:30.087282] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-23T18:20:30.087332] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-23T18:20:30.087945] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-23T18:20:30.088007] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-23T18:20:30.441751] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:30.602194] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-23T18:20:31.209600] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T18:20:31.402172] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-23T18:20:31.823042] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:20:32.202151] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-23T18:20:32.484534] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:20:33.002206] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-23T18:20:33.802175] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-23T18:20:33.999736] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T18:20:34.437991] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-23T18:20:34.602256] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-23T18:20:34.804800] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:20:35.122932] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T18:20:35.402204] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-23T18:20:36.202238] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-23T18:20:36.234103] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T18:20:37.002241] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-23T18:20:37.802231] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-23T18:20:37.856092] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T18:20:38.213024] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-23T18:20:38.602621] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-23T18:20:38.847726] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:20:39.128249] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T18:20:39.402225] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-23T18:20:40.202248] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-23T18:20:40.989315] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T18:20:41.002171] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-23T18:20:41.323801] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T18:20:41.802227] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-23T18:20:41.890824] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-23T18:20:42.602238] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-23T18:20:43.082857] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T18:20:43.088027] [INFO ] [REMOTE ] DFH: Full fetch complete (49172 records). [2025-09-23T18:20:43.088132] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-23T18:20:43.407377] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-23T18:20:43.479927] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-23T18:20:43.480075] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-23T18:20:43.480911] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-23T18:20:43.481125] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-23T18:20:43.482472] [DEBUG] [LOCAL ] DFH: Trimmed 49172 records to 32858 (keeping 200 days of data) [2025-09-23T18:20:43.707717] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T18:20:43.723000] [DEBUG] [LOCAL ] DFH: Primary data saved (32858 records). [2025-09-23T18:20:43.723159] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-23T18:20:43.723250] [INFO ] [MAIN ] Update Progress: 610/2372 symbols completed. DFH took 30.7s. Estimated remaining: 3h 53m 2s. Rate: 7.6 symbols/min [2025-09-23T18:20:43.895051] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:43.895281] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-09-23T18:20:43.895322] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-09-23T18:20:43.895473] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-23T18:20:43.895517] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-23T18:20:43.895558] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-09-23T18:20:43.895591] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-23T18:20:44.225632] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-23T18:20:44.278409] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:45.002213] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-23T18:20:45.273831] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T18:20:45.768914] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-23T18:20:45.777769] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-09-23T18:20:45.777901] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-23T18:20:45.813765] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-23T18:20:46.183053] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-23T18:20:46.183141] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-23T18:20:46.183984] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-23T18:20:46.184049] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-23T18:20:46.185683] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53735 (keeping 200 days of data) [2025-09-23T18:20:46.533616] [DEBUG] [LOCAL ] DELL: Primary data saved (53735 records). [2025-09-23T18:20:46.533792] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-23T18:20:46.533892] [INFO ] [MAIN ] Update Progress: 611/2372 symbols completed. DELL took 48.3s. Estimated remaining: 3h 52m 39s. Rate: 7.6 symbols/min [2025-09-23T18:20:46.610113] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-23T18:20:46.715109] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:46.729545] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T18:20:46.776719] [DEBUG] [LOCAL ] DGX: Loaded 45280 existing records from primary storage. [2025-09-23T18:20:46.776856] [INFO ] [MAIN ] DGX: Loaded 45280 existing records. [2025-09-23T18:20:46.989121] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:46.992747] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-23T18:20:46.992999] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-23T18:20:46.995127] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-23T18:20:46.995185] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-23T18:20:46.999560] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-23T18:20:47.374677] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:47.402140] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-23T18:20:47.481288] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T18:20:48.202217] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-23T18:20:48.799737] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:20:48.825726] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T18:20:48.828451] [INFO ] [REMOTE ] DFP: Full fetch complete (16210 records). [2025-09-23T18:20:48.828536] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-23T18:20:49.009062] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-23T18:20:49.217698] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-23T18:20:49.217800] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-23T18:20:49.218214] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-23T18:20:49.218276] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-23T18:20:49.218889] [DEBUG] [LOCAL ] DFP: Trimmed 16210 records to 11666 (keeping 200 days of data) [2025-09-23T18:20:49.295775] [DEBUG] [LOCAL ] DFP: Primary data saved (11666 records). [2025-09-23T18:20:49.295967] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-23T18:20:49.296063] [INFO ] [MAIN ] Update Progress: 612/2372 symbols completed. DFP took 19.6s. Estimated remaining: 3h 52m 16s. Rate: 7.6 symbols/min [2025-09-23T18:20:49.463783] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:49.483827] [DEBUG] [LOCAL ] DHF: Loaded 20893 existing records from primary storage. [2025-09-23T18:20:49.483971] [INFO ] [MAIN ] DHF: Loaded 20893 existing records. [2025-09-23T18:20:49.659177] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:49.659438] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-23T18:20:49.659485] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-23T18:20:49.660153] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-23T18:20:49.660214] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-23T18:20:49.807427] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-23T18:20:50.056326] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:50.602213] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-23T18:20:50.685872] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T18:20:51.386502] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:20:51.402158] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-23T18:20:51.680792] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T18:20:52.202301] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-23T18:20:52.890626] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T18:20:53.002252] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-23T18:20:53.198981] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:20:53.802218] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-23T18:20:54.363710] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T18:20:54.602225] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-23T18:20:55.402237] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-23T18:20:56.068576] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T18:20:56.202249] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-23T18:20:56.352493] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:20:56.356923] [INFO ] [REMOTE ] DFIN: Full fetch complete (33380 records). [2025-09-23T18:20:56.357004] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-23T18:20:56.770698] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-23T18:20:56.770839] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-23T18:20:56.771359] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-23T18:20:56.771443] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-23T18:20:56.772517] [DEBUG] [LOCAL ] DFIN: Trimmed 33380 records to 23344 (keeping 200 days of data) [2025-09-23T18:20:56.937747] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (3.14 seconds). [2025-09-23T18:20:56.978439] [DEBUG] [LOCAL ] DFIN: Primary data saved (23344 records). [2025-09-23T18:20:56.978633] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-23T18:20:56.978776] [INFO ] [MAIN ] Update Progress: 613/2372 symbols completed. DFIN took 38.0s. Estimated remaining: 3h 52m 8s. Rate: 7.6 symbols/min [2025-09-23T18:20:57.010160] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-23T18:20:57.167163] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:57.180708] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T18:20:57.241789] [DEBUG] [LOCAL ] DHI: Loaded 53377 existing records from primary storage. [2025-09-23T18:20:57.242007] [INFO ] [MAIN ] DHI: Loaded 53377 existing records. [2025-09-23T18:20:57.453966] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:57.454308] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-23T18:20:57.454357] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-23T18:20:57.455959] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-23T18:20:57.456021] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-23T18:20:57.810929] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-23T18:20:57.815969] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:58.602163] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-23T18:20:58.757325] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T18:20:59.407293] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-23T18:20:59.426572] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T18:21:00.086701] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T18:21:00.156000] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T18:21:00.202171] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-23T18:21:01.002240] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-23T18:21:01.802243] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-23T18:21:02.274752] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T18:21:02.432266] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T18:21:02.607260] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-23T18:21:02.615952] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T18:21:03.402433] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-23T18:21:04.202191] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-23T18:21:05.002241] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-23T18:21:05.793986] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-23T18:21:05.810740] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (3.20 seconds). [2025-09-23T18:21:05.822851] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-23T18:21:05.837066] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T18:21:06.561186] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T18:21:06.602225] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-23T18:21:07.222304] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T18:21:07.402243] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-23T18:21:08.099936] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T18:21:08.204122] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-23T18:21:08.212691] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T18:21:09.002289] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-23T18:21:09.376617] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T18:21:09.802367] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-23T18:21:10.602229] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-23T18:21:10.918109] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T18:21:11.347699] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T18:21:11.394575] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T18:21:11.404346] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-23T18:21:12.106503] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:21:12.109904] [INFO ] [REMOTE ] DHF: Full fetch complete (29501 records). [2025-09-23T18:21:12.109990] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-23T18:21:12.207304] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-23T18:21:12.500421] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-23T18:21:12.500521] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-23T18:21:12.501148] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-23T18:21:12.501213] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-23T18:21:12.502472] [DEBUG] [LOCAL ] DHF: Trimmed 29501 records to 20704 (keeping 200 days of data) [2025-09-23T18:21:12.644513] [DEBUG] [LOCAL ] DHF: Primary data saved (20704 records). [2025-09-23T18:21:12.644718] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-23T18:21:12.644885] [INFO ] [MAIN ] Update Progress: 614/2372 symbols completed. DHF took 23.3s. Estimated remaining: 3h 52m 22s. Rate: 7.6 symbols/min [2025-09-23T18:21:12.935440] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:12.935701] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-23T18:21:12.935759] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-23T18:21:12.935950] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-23T18:21:12.936006] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-23T18:21:12.936061] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-23T18:21:12.936105] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-23T18:21:13.007510] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-23T18:21:13.541675] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:13.802236] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-23T18:21:13.908324] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:21:14.602198] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-23T18:21:14.778155] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T18:21:14.790986] [INFO ] [REMOTE ] DG: Full fetch complete (77235 records). [2025-09-23T18:21:14.791211] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-23T18:21:15.257291] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-23T18:21:15.257390] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-23T18:21:15.258459] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-23T18:21:15.258550] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-23T18:21:15.260900] [DEBUG] [LOCAL ] DG: Trimmed 77235 records to 53308 (keeping 200 days of data) [2025-09-23T18:21:15.403712] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-23T18:21:15.674290] [DEBUG] [LOCAL ] DG: Primary data saved (53308 records). [2025-09-23T18:21:15.674954] [INFO ] [MAIN ] DG: Full history saved. [2025-09-23T18:21:15.675495] [INFO ] [MAIN ] Update Progress: 615/2372 symbols completed. DG took 32.0s. Estimated remaining: 3h 52m 0s. Rate: 7.6 symbols/min [2025-09-23T18:21:15.891555] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:15.950714] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-23T18:21:16.041606] [DEBUG] [LOCAL ] DHT: Loaded 47958 existing records from primary storage. [2025-09-23T18:21:16.041844] [INFO ] [MAIN ] DHT: Loaded 47958 existing records. [2025-09-23T18:21:16.118543] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T18:21:16.207518] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-23T18:21:16.250002] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:21:16.250269] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-23T18:21:16.250332] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-23T18:21:16.251747] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-23T18:21:16.251811] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-23T18:21:16.630924] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:17.015367] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-23T18:21:17.040322] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T18:21:17.682076] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:21:17.802254] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-23T18:21:18.602201] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-23T18:21:19.095886] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-23T18:21:19.188372] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T18:21:19.402242] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-23T18:21:19.996440] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:21:20.202206] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-23T18:21:20.746506] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:21:21.002393] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-23T18:21:21.747896] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:21:21.757338] [INFO ] [REMOTE ] DGX: Full fetch complete (65166 records). [2025-09-23T18:21:21.757491] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-23T18:21:21.807373] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-23T18:21:22.161475] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-23T18:21:22.161559] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-23T18:21:22.162367] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-23T18:21:22.162436] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-23T18:21:22.163941] [DEBUG] [LOCAL ] DGX: Trimmed 65166 records to 45287 (keeping 200 days of data) [2025-09-23T18:21:22.474403] [DEBUG] [LOCAL ] DGX: Primary data saved (45287 records). [2025-09-23T18:21:22.474589] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-23T18:21:22.474835] [INFO ] [MAIN ] Update Progress: 616/2372 symbols completed. DGX took 35.9s. Estimated remaining: 3h 51m 49s. Rate: 7.6 symbols/min [2025-09-23T18:21:22.603873] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-23T18:21:22.663827] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:22.664111] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-09-23T18:21:22.664181] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-09-23T18:21:22.664802] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-23T18:21:22.664869] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-23T18:21:22.664931] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-23T18:21:22.665049] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-23T18:21:22.992263] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T18:21:23.114114] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:23.402159] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-23T18:21:23.445639] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T18:21:24.202150] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-23T18:21:24.244697] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T18:21:24.262811] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T18:21:25.002426] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-23T18:21:25.807686] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-23T18:21:25.839495] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T18:21:25.997820] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T18:21:26.602193] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-23T18:21:27.402191] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-23T18:21:27.833938] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T18:21:28.202199] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-23T18:21:28.642532] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-23T18:21:29.002238] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-23T18:21:29.163662] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T18:21:29.802234] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-23T18:21:30.059668] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T18:21:30.274016] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-23T18:21:30.602233] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-23T18:21:31.402289] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-23T18:21:31.593872] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T18:21:31.838904] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T18:21:32.202220] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-23T18:21:32.998078] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T18:21:33.002257] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-23T18:21:33.539969] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T18:21:33.549612] [INFO ] [REMOTE ] DHI: Full fetch complete (77221 records). [2025-09-23T18:21:33.549783] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-23T18:21:33.807696] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-23T18:21:33.953396] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-23T18:21:33.953497] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-23T18:21:33.954427] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-23T18:21:33.954923] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-23T18:21:33.959578] [DEBUG] [LOCAL ] DHI: Trimmed 77221 records to 53376 (keeping 200 days of data) [2025-09-23T18:21:34.321757] [DEBUG] [LOCAL ] DHI: Primary data saved (53376 records). [2025-09-23T18:21:34.321900] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-23T18:21:34.322031] [INFO ] [MAIN ] Update Progress: 617/2372 symbols completed. DHI took 37.3s. Estimated remaining: 3h 51m 52s. Rate: 7.6 symbols/min [2025-09-23T18:21:34.536536] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:34.539623] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:21:34.566796] [DEBUG] [LOCAL ] DIAX: Loaded 12386 existing records from primary storage. [2025-09-23T18:21:34.566940] [INFO ] [MAIN ] DIAX: Loaded 12386 existing records. [2025-09-23T18:21:34.607350] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-23T18:21:34.777091] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:21:34.777768] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-23T18:21:34.777860] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-23T18:21:34.792597] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T18:21:34.791888] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-23T18:21:34.792855] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-23T18:21:35.200967] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:35.402196] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-23T18:21:35.935404] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T18:21:36.097062] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T18:21:36.202215] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-23T18:21:37.002272] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-23T18:21:37.802200] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-23T18:21:37.986288] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T18:21:38.566195] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:21:38.602216] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-23T18:21:38.767869] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T18:21:39.090380] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T18:21:39.402232] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-23T18:21:40.122337] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T18:21:40.202249] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-23T18:21:40.686822] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T18:21:41.002244] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-23T18:21:41.807375] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-23T18:21:41.810864] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:21:42.602224] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-23T18:21:43.247064] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:21:43.252021] [INFO ] [REMOTE ] DHX: Full fetch complete (20873 records). [2025-09-23T18:21:43.252233] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-23T18:21:43.253112] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:21:43.253450] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:21:43.253539] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:21:43.253627] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-23T18:21:43.253756] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-23T18:21:43.253855] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-09-23T18:21:43.253945] [DEBUG] [LOCAL ] DHX: No derivative data file found to delete. [2025-09-23T18:21:43.254078] [INFO ] [MAIN ] Update Progress: 618/2372 symbols completed. DHX took 20.8s. Estimated remaining: 3h 51m 47s. Rate: 7.6 symbols/min [2025-09-23T18:21:43.411043] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-23T18:21:43.479852] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:43.528907] [DEBUG] [LOCAL ] DIN: Loaded 37289 existing records from primary storage. [2025-09-23T18:21:43.529321] [INFO ] [MAIN ] DIN: Loaded 37289 existing records. [2025-09-23T18:21:43.762224] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T18:21:43.769046] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:21:43.782889] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-23T18:21:43.783044] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-23T18:21:43.785384] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-23T18:21:43.785464] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-23T18:21:44.025938] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T18:21:44.207301] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-23T18:21:44.261768] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:45.002250] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-23T18:21:45.564119] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:21:45.802186] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-23T18:21:45.949486] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T18:21:46.602207] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-23T18:21:47.223077] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:21:47.341276] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T18:21:47.402161] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-23T18:21:47.944295] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T18:21:48.202190] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-23T18:21:49.002191] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-23T18:21:49.802165] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-23T18:21:49.888807] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T18:21:50.607302] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-23T18:21:50.623467] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:21:51.067514] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T18:21:51.076578] [INFO ] [REMOTE ] DHT: Full fetch complete (70080 records). [2025-09-23T18:21:51.076839] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-23T18:21:51.409622] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-23T18:21:51.518664] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-23T18:21:51.518769] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-23T18:21:51.519600] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-23T18:21:51.519667] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-23T18:21:51.521284] [DEBUG] [LOCAL ] DHT: Trimmed 70080 records to 47960 (keeping 200 days of data) [2025-09-23T18:21:51.826145] [DEBUG] [LOCAL ] DHT: Primary data saved (47960 records). [2025-09-23T18:21:51.826286] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-23T18:21:51.826390] [INFO ] [MAIN ] Update Progress: 619/2372 symbols completed. DHT took 36.2s. Estimated remaining: 3h 51m 41s. Rate: 7.6 symbols/min [2025-09-23T18:21:52.001259] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:52.059631] [DEBUG] [LOCAL ] DINO: Loaded 52964 existing records from primary storage. [2025-09-23T18:21:52.059799] [INFO ] [MAIN ] DINO: Loaded 52964 existing records. [2025-09-23T18:21:52.220476] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-23T18:21:52.251835] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:21:52.252870] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-23T18:21:52.252944] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-23T18:21:52.263412] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-23T18:21:52.278217] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-23T18:21:52.386069] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T18:21:52.727398] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:52.762843] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:21:52.895842] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:21:53.002247] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-23T18:21:53.802227] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-23T18:21:54.536623] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T18:21:54.602246] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-23T18:21:55.155854] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:21:55.402264] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-23T18:21:56.040559] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T18:21:56.202185] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-23T18:21:56.890485] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:21:57.002252] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-23T18:21:57.729989] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T18:21:57.760742] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:21:57.802180] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-23T18:21:58.602206] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-23T18:21:59.262638] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T18:21:59.402180] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-23T18:21:59.880128] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:22:00.202198] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-23T18:22:01.002251] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-23T18:22:01.368738] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T18:22:01.379476] [INFO ] [REMOTE ] DHR: Full fetch complete (76877 records). [2025-09-23T18:22:01.379693] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-23T18:22:01.380792] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:22:01.380952] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:22:01.381035] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:22:01.381124] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-23T18:22:01.381208] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-23T18:22:01.381262] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-09-23T18:22:01.381338] [DEBUG] [LOCAL ] DHR: No derivative data file found to delete. [2025-09-23T18:22:01.381456] [INFO ] [MAIN ] Update Progress: 620/2372 symbols completed. DHR took 48.7s. Estimated remaining: 3h 51m 38s. Rate: 7.6 symbols/min [2025-09-23T18:22:01.579710] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:01.639501] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T18:22:01.688411] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-23T18:22:01.688573] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-09-23T18:22:01.807301] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-23T18:22:01.879259] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:22:01.879503] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-23T18:22:01.879552] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-23T18:22:01.881035] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-23T18:22:01.881097] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-23T18:22:02.257145] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:02.602206] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-23T18:22:02.665541] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:22:02.831832] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T18:22:03.402205] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-23T18:22:04.070307] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:22:04.073067] [INFO ] [REMOTE ] DIAX: Full fetch complete (17163 records). [2025-09-23T18:22:04.073148] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-23T18:22:04.207326] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-23T18:22:04.467229] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-23T18:22:04.467315] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-23T18:22:04.467703] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-23T18:22:04.467765] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-23T18:22:04.468325] [DEBUG] [LOCAL ] DIAX: Trimmed 17163 records to 12421 (keeping 200 days of data) [2025-09-23T18:22:04.549252] [DEBUG] [LOCAL ] DIAX: Primary data saved (12421 records). [2025-09-23T18:22:04.549398] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-23T18:22:04.549497] [INFO ] [MAIN ] Update Progress: 621/2372 symbols completed. DIAX took 30.2s. Estimated remaining: 3h 51m 16s. Rate: 7.6 symbols/min [2025-09-23T18:22:04.718269] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:04.718427] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-23T18:22:04.718463] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-23T18:22:04.718609] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-23T18:22:04.718723] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-23T18:22:04.718788] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-23T18:22:04.718822] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-23T18:22:05.007297] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-23T18:22:05.098315] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:05.133924] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-23T18:22:05.799285] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T18:22:05.810878] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-23T18:22:06.057564] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T18:22:06.303845] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T18:22:06.602223] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-23T18:22:07.402190] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-23T18:22:08.202188] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-23T18:22:08.491821] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-23T18:22:08.963892] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-23T18:22:09.002206] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-23T18:22:09.112609] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T18:22:09.331348] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T18:22:09.802213] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-23T18:22:10.602189] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-23T18:22:10.921412] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T18:22:10.923145] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T18:22:11.402195] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-23T18:22:11.678161] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-23T18:22:12.202188] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-23T18:22:13.002208] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-23T18:22:13.284666] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-23T18:22:13.525523] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:22:13.532243] [INFO ] [REMOTE ] DIN: Full fetch complete (55064 records). [2025-09-23T18:22:13.532351] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-23T18:22:13.807305] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-23T18:22:13.944041] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-23T18:22:13.944131] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-23T18:22:13.944878] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-23T18:22:13.944945] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-23T18:22:13.946326] [DEBUG] [LOCAL ] DIN: Trimmed 55064 records to 37264 (keeping 200 days of data) [2025-09-23T18:22:14.189234] [DEBUG] [LOCAL ] DIN: Primary data saved (37264 records). [2025-09-23T18:22:14.189403] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-23T18:22:14.189498] [INFO ] [MAIN ] Update Progress: 622/2372 symbols completed. DIN took 30.9s. Estimated remaining: 3h 51m 13s. Rate: 7.6 symbols/min [2025-09-23T18:22:14.369637] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:14.369939] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-09-23T18:22:14.370047] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-09-23T18:22:14.370210] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-23T18:22:14.370255] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-23T18:22:14.370299] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-23T18:22:14.370333] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-23T18:22:14.608558] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-23T18:22:14.741957] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:14.941179] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T18:22:15.350660] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:22:15.402192] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-23T18:22:16.202198] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-23T18:22:17.002193] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-23T18:22:17.169197] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T18:22:17.802199] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-23T18:22:18.198888] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T18:22:18.349606] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-23T18:22:18.443956] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:22:18.602197] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-23T18:22:19.402195] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-23T18:22:19.669381] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-23T18:22:20.202218] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-23T18:22:20.922981] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T18:22:20.923986] [INFO ] [REMOTE ] DIVY: Full fetch complete (1716 records). [2025-09-23T18:22:20.924071] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-23T18:22:21.008291] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-23T18:22:21.093554] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-23T18:22:21.174249] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T18:22:21.174958] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:22:21.175032] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:22:21.175124] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-23T18:22:21.175190] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-23T18:22:21.175226] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-23T18:22:21.175265] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-23T18:22:21.175350] [INFO ] [MAIN ] Update Progress: 623/2372 symbols completed. DIVY took 16.6s. Estimated remaining: 3h 51m 3s. Rate: 7.6 symbols/min [2025-09-23T18:22:21.349569] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:21.371330] [DEBUG] [LOCAL ] DKL: Loaded 19282 existing records from primary storage. [2025-09-23T18:22:21.371506] [INFO ] [MAIN ] DKL: Loaded 19282 existing records. [2025-09-23T18:22:21.614764] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:22:21.615113] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-23T18:22:21.615173] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-23T18:22:21.615905] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-23T18:22:21.615966] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-23T18:22:21.806460] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-23T18:22:22.068015] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:22.529486] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:22:22.539043] [INFO ] [REMOTE ] DINO: Full fetch complete (76672 records). [2025-09-23T18:22:22.539255] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-23T18:22:22.609913] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-23T18:22:22.990976] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-23T18:22:22.991084] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-23T18:22:22.992024] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-23T18:22:22.992096] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-23T18:22:22.993922] [DEBUG] [LOCAL ] DINO: Trimmed 76672 records to 52963 (keeping 200 days of data) [2025-09-23T18:22:23.350075] [DEBUG] [LOCAL ] DINO: Primary data saved (52963 records). [2025-09-23T18:22:23.350234] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-23T18:22:23.350327] [INFO ] [MAIN ] Update Progress: 624/2372 symbols completed. DINO took 31.5s. Estimated remaining: 3h 50m 39s. Rate: 7.6 symbols/min [2025-09-23T18:22:23.412428] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-23T18:22:23.540317] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:23.540534] [DEBUG] [LOCAL ] DKS: No existing data file found in primary storage. [2025-09-23T18:22:23.540590] [WARN ] [MAIN ] DKS: No existing data found, performing full refresh instead. [2025-09-23T18:22:23.540792] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-23T18:22:23.540835] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-23T18:22:23.540875] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-09-23T18:22:23.540908] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-23T18:22:23.931386] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:24.202274] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-23T18:22:24.272249] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T18:22:24.400321] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-23T18:22:24.427221] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T18:22:25.002237] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-23T18:22:25.723254] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:22:25.802204] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-23T18:22:26.238361] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:22:26.602233] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-23T18:22:27.402200] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-23T18:22:27.455883] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T18:22:28.113327] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T18:22:28.202179] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-23T18:22:28.794330] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T18:22:29.002203] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-23T18:22:29.802203] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-23T18:22:30.355566] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:22:30.474043] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-23T18:22:30.602241] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-23T18:22:31.373763] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:22:31.402166] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-23T18:22:31.512250] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T18:22:32.152221] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T18:22:32.202169] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-23T18:22:33.002249] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-23T18:22:33.128044] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T18:22:33.802195] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-23T18:22:34.322119] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:22:34.602228] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-23T18:22:34.853303] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T18:22:35.402233] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-23T18:22:36.011854] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:22:36.202187] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-23T18:22:36.368131] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T18:22:37.002203] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-23T18:22:37.381299] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:22:37.604730] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T18:22:37.802193] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-23T18:22:38.602210] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-23T18:22:38.739487] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T18:22:39.402244] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-23T18:22:40.202224] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-23T18:22:41.002200] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-23T18:22:41.077634] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-23T18:22:41.096542] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T18:22:41.101552] [INFO ] [REMOTE ] DKL: Full fetch complete (29342 records). [2025-09-23T18:22:41.101723] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-23T18:22:41.102451] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:22:41.102553] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:22:41.102605] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:22:41.102704] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-23T18:22:41.102789] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-23T18:22:41.102837] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-09-23T18:22:41.103366] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-09-23T18:22:41.103517] [INFO ] [MAIN ] Update Progress: 625/2372 symbols completed. DKL took 19.9s. Estimated remaining: 3h 50m 58s. Rate: 7.6 symbols/min [2025-09-23T18:22:41.296540] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:41.296937] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-09-23T18:22:41.297003] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-09-23T18:22:41.297153] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-23T18:22:41.297210] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-23T18:22:41.297286] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-09-23T18:22:41.297338] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-23T18:22:41.674295] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:41.706356] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-23T18:22:41.802178] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-23T18:22:42.422129] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:22:42.602185] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-23T18:22:43.402166] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-23T18:22:43.574028] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T18:22:43.885575] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:22:44.202183] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-23T18:22:45.002224] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-23T18:22:45.430908] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-23T18:22:45.802262] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-23T18:22:46.033818] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T18:22:46.228000] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-23T18:22:46.602215] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-23T18:22:47.180194] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:22:47.188981] [INFO ] [REMOTE ] DK: Full fetch complete (70652 records). [2025-09-23T18:22:47.189174] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-23T18:22:47.412451] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-23T18:22:47.624044] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-23T18:22:47.624132] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-23T18:22:47.625588] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-23T18:22:47.625683] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-23T18:22:47.629786] [DEBUG] [LOCAL ] DK: Trimmed 70652 records to 49391 (keeping 200 days of data) [2025-09-23T18:22:47.952635] [DEBUG] [LOCAL ] DK: Primary data saved (49391 records). [2025-09-23T18:22:47.952980] [INFO ] [MAIN ] DK: Full history saved. [2025-09-23T18:22:47.953077] [INFO ] [MAIN ] Update Progress: 626/2372 symbols completed. DK took 33.8s. Estimated remaining: 3h 50m 47s. Rate: 7.6 symbols/min [2025-09-23T18:22:48.131380] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:48.139341] [DEBUG] [LOCAL ] DLNG: Loaded 6220 existing records from primary storage. [2025-09-23T18:22:48.139447] [INFO ] [MAIN ] DLNG: Loaded 6220 existing records. [2025-09-23T18:22:48.211749] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-23T18:22:48.326322] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:22:48.326636] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-23T18:22:48.326717] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-23T18:22:48.327047] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-23T18:22:48.327110] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-23T18:22:48.696758] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:48.763983] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:22:48.794136] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-23T18:22:48.803935] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-23T18:22:48.804152] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-23T18:22:49.012046] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-23T18:22:49.223727] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-23T18:22:49.223836] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-23T18:22:49.224767] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-23T18:22:49.224846] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-23T18:22:49.226814] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 53788 (keeping 200 days of data) [2025-09-23T18:22:49.596707] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-23T18:22:49.596887] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-23T18:22:49.598462] [INFO ] [MAIN ] Update Progress: 627/2372 symbols completed. DIS took 48.2s. Estimated remaining: 3h 50m 22s. Rate: 7.6 symbols/min [2025-09-23T18:22:49.803065] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:22:49.806802] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:49.802534] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-23T18:22:49.811465] [DEBUG] [LOCAL ] DLR: No existing data file found in primary storage. [2025-09-23T18:22:49.811586] [WARN ] [MAIN ] DLR: No existing data found, performing full refresh instead. [2025-09-23T18:22:49.811928] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-23T18:22:49.811984] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-23T18:22:49.812030] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-23T18:22:49.812067] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-23T18:22:50.229053] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:50.256713] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T18:22:50.602203] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-23T18:22:50.851122] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T18:22:51.402217] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-23T18:22:52.202183] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-23T18:22:52.444215] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T18:22:52.755637] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T18:22:53.002265] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-23T18:22:53.802195] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-23T18:22:54.602231] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-23T18:23:05.103088] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (10.50 seconds). [2025-09-23T18:23:05.109341] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-23T18:23:05.961801] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (13.76 seconds). [2025-09-23T18:23:05.973213] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-23T18:23:05.982980] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T18:23:05.986255] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-23T18:23:06.916347] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T18:23:06.918467] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-23T18:23:07.228952] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (13.43 seconds). [2025-09-23T18:23:07.240587] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-23T18:23:07.404052] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T18:23:07.408092] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-23T18:23:07.739264] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T18:23:07.749808] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-23T18:23:07.861298] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T18:23:07.863948] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-23T18:23:08.262442] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T18:23:08.264353] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-23T18:23:08.644015] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T18:23:08.646113] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-23T18:23:08.799226] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T18:23:08.807890] [INFO ] [REMOTE ] DKS: Full fetch complete (71623 records). [2025-09-23T18:23:08.808058] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-23T18:23:09.046879] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (16.04 seconds). [2025-09-23T18:23:09.136847] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-23T18:23:09.136449] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T18:23:09.162140] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-23T18:23:09.289833] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-23T18:23:09.290158] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-23T18:23:09.291361] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-23T18:23:09.291453] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-23T18:23:09.293602] [DEBUG] [LOCAL ] DKS: Trimmed 71623 records to 49949 (keeping 200 days of data) [2025-09-23T18:23:09.437505] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T18:23:09.453307] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-23T18:23:09.715597] [DEBUG] [LOCAL ] DKS: Primary data saved (49949 records). [2025-09-23T18:23:09.715783] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-23T18:23:09.715870] [INFO ] [MAIN ] Update Progress: 628/2372 symbols completed. DKS took 46.4s. Estimated remaining: 3h 50m 48s. Rate: 7.6 symbols/min [2025-09-23T18:23:09.900878] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:09.901774] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T18:23:09.903803] [INFO ] [REMOTE ] DLNG: Full fetch complete (12060 records). [2025-09-23T18:23:09.903883] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-23T18:23:10.216530] [DEBUG] [LOCAL ] DLX: Loaded 29127 existing records from primary storage. [2025-09-23T18:23:10.230019] [INFO ] [MAIN ] DLX: Loaded 29127 existing records. [2025-09-23T18:23:10.433435] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-23T18:23:10.439387] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-23T18:23:10.450319] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-23T18:23:10.455582] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-23T18:23:10.522785] [DEBUG] [LOCAL ] DLNG: Trimmed 12060 records to 6188 (keeping 200 days of data) [2025-09-23T18:23:10.528194] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:10.529685] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-23T18:23:10.529847] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-23T18:23:10.551212] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-23T18:23:10.569433] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-23T18:23:10.789142] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:23:10.864519] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-23T18:23:10.877856] [DEBUG] [LOCAL ] DLNG: Primary data saved (6188 records). [2025-09-23T18:23:10.878737] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-23T18:23:10.885085] [INFO ] [MAIN ] Update Progress: 629/2372 symbols completed. DLNG took 22.9s. Estimated remaining: 3h 50m 21s. Rate: 7.6 symbols/min [2025-09-23T18:23:11.159505] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:11.186053] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-23T18:23:11.235041] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:11.280164] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T18:23:11.298966] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-23T18:23:11.298679] [DEBUG] [LOCAL ] DLY: Loaded 19427 existing records from primary storage. [2025-09-23T18:23:11.299882] [INFO ] [MAIN ] DLY: Loaded 19427 existing records. [2025-09-23T18:23:11.483131] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:11.483394] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-23T18:23:11.483444] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-23T18:23:11.484228] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-23T18:23:11.484291] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-23T18:23:11.887435] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:11.887909] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-23T18:23:12.176110] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T18:23:12.181784] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-23T18:23:12.292476] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T18:23:12.299631] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-23T18:23:12.693730] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T18:23:12.699353] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-23T18:23:12.870251] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T18:23:12.881667] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-23T18:23:12.971132] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:23:12.978336] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-23T18:23:13.403014] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T18:23:13.409586] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-23T18:23:13.451385] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:23:13.802225] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-23T18:23:14.067551] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T18:23:14.380146] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:23:14.442986] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T18:23:14.602189] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-23T18:23:14.655906] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T18:23:15.402199] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-23T18:23:15.538609] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T18:23:16.202198] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-23T18:23:16.412102] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T18:23:16.417535] [INFO ] [REMOTE ] DLB: Full fetch complete (46752 records). [2025-09-23T18:23:16.417681] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-23T18:23:16.418356] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:23:16.418448] [FATAL] [MAIN ] DLB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:23:16.418491] [WARN ] [MAIN ] DLB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:23:16.418531] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-23T18:23:16.418589] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-09-23T18:23:16.418624] [INFO ] [LOCAL ] DLB: Starting deletion of derivative data. [2025-09-23T18:23:16.418724] [DEBUG] [LOCAL ] DLB: No derivative data file found to delete. [2025-09-23T18:23:16.418806] [INFO ] [MAIN ] Update Progress: 630/2372 symbols completed. DLB took 35.3s. Estimated remaining: 3h 50m 7s. Rate: 7.6 symbols/min [2025-09-23T18:23:16.592139] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:16.598870] [DEBUG] [LOCAL ] DMA: Loaded 4495 existing records from primary storage. [2025-09-23T18:23:16.599040] [INFO ] [MAIN ] DMA: Loaded 4495 existing records. [2025-09-23T18:23:16.811038] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:16.811389] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-23T18:23:16.811453] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-23T18:23:16.811792] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-23T18:23:16.811865] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-23T18:23:17.023990] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-23T18:23:17.369770] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:17.606744] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:23:17.802216] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-23T18:23:18.500885] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T18:23:18.580054] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T18:23:18.602154] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-23T18:23:18.968228] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-23T18:23:19.402198] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-23T18:23:19.784227] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T18:23:20.202201] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-23T18:23:21.002192] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-23T18:23:21.034443] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T18:23:21.802219] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-23T18:23:22.595809] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T18:23:22.602374] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-23T18:23:23.092759] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:23:23.250443] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T18:23:23.402230] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-23T18:23:24.202202] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-23T18:23:25.002236] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-23T18:23:25.111603] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T18:23:25.398409] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T18:23:25.401907] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-23T18:23:25.802219] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-23T18:23:26.138492] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T18:23:26.602253] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-23T18:23:27.402156] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-23T18:23:27.493939] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:23:28.202244] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-23T18:23:29.014724] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-23T18:23:29.017159] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T18:23:29.025752] [INFO ] [REMOTE ] DLR: Full fetch complete (74244 records). [2025-09-23T18:23:29.025872] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-23T18:23:29.476718] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T18:23:29.477772] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T18:23:29.468857] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-23T18:23:29.485022] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-23T18:23:29.486389] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-23T18:23:29.486867] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-23T18:23:29.491775] [DEBUG] [LOCAL ] DLR: Trimmed 74244 records to 51180 (keeping 200 days of data) [2025-09-23T18:23:29.805442] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-23T18:23:29.818905] [DEBUG] [LOCAL ] DLR: Primary data saved (51180 records). [2025-09-23T18:23:29.819067] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-23T18:23:29.819145] [INFO ] [MAIN ] Update Progress: 631/2372 symbols completed. DLR took 40.2s. Estimated remaining: 3h 50m 14s. Rate: 7.6 symbols/min [2025-09-23T18:23:30.006462] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:30.021325] [DEBUG] [LOCAL ] DMB: Loaded 10109 existing records from primary storage. [2025-09-23T18:23:30.021505] [INFO ] [MAIN ] DMB: Loaded 10109 existing records. [2025-09-23T18:23:30.203687] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:30.204026] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-23T18:23:30.204112] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-23T18:23:30.204592] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-23T18:23:30.204699] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-23T18:23:30.569707] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:30.583240] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T18:23:30.602150] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-23T18:23:31.402215] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-23T18:23:31.507805] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T18:23:31.512178] [INFO ] [REMOTE ] DLY: Full fetch complete (28146 records). [2025-09-23T18:23:31.512255] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-23T18:23:31.785585] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T18:23:31.903141] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-23T18:23:31.903251] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-23T18:23:31.903834] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-23T18:23:31.903912] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-23T18:23:31.904963] [DEBUG] [LOCAL ] DLY: Trimmed 28146 records to 19442 (keeping 200 days of data) [2025-09-23T18:23:32.042319] [DEBUG] [LOCAL ] DLY: Primary data saved (19442 records). [2025-09-23T18:23:32.042677] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-23T18:23:32.043025] [INFO ] [MAIN ] Update Progress: 632/2372 symbols completed. DLY took 21.1s. Estimated remaining: 3h 49m 50s. Rate: 7.6 symbols/min [2025-09-23T18:23:32.216034] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-23T18:23:32.220998] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:32.235843] [DEBUG] [LOCAL ] DMO: Loaded 9863 existing records from primary storage. [2025-09-23T18:23:32.236187] [INFO ] [MAIN ] DMO: Loaded 9863 existing records. [2025-09-23T18:23:32.416757] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:32.417071] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-23T18:23:32.417125] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-23T18:23:32.417595] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-23T18:23:32.417690] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-23T18:23:32.770924] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:33.002171] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-23T18:23:33.142333] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T18:23:33.802233] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-23T18:23:34.166675] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T18:23:34.283472] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T18:23:34.602227] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-23T18:23:35.160521] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T18:23:35.402208] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-23T18:23:36.158515] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T18:23:36.202152] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-23T18:23:37.002189] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-23T18:23:37.095271] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T18:23:37.506100] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T18:23:37.802207] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-23T18:23:38.495960] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:23:38.602211] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-23T18:23:39.402245] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-23T18:23:39.989909] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:23:40.195752] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:23:40.202154] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-23T18:23:41.002389] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-23T18:23:41.147712] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:23:41.423062] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T18:23:41.802263] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-23T18:23:42.257419] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T18:23:42.602254] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-23T18:23:43.402273] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-23T18:23:43.578829] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T18:23:43.585451] [INFO ] [REMOTE ] DLX: Full fetch complete (41270 records). [2025-09-23T18:23:43.585619] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-23T18:23:43.980011] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-23T18:23:43.980109] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-23T18:23:43.980772] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-23T18:23:43.980869] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-23T18:23:43.981990] [DEBUG] [LOCAL ] DLX: Trimmed 41270 records to 29096 (keeping 200 days of data) [2025-09-23T18:23:44.091821] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T18:23:44.115949] [INFO ] [REMOTE ] DMA: Full fetch complete (6527 records). [2025-09-23T18:23:44.116325] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-23T18:23:44.209905] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-23T18:23:44.590121] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-23T18:23:44.589998] [DEBUG] [LOCAL ] DLX: Primary data saved (29096 records). [2025-09-23T18:23:44.590299] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-23T18:23:44.590407] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-23T18:23:44.590705] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-23T18:23:44.590911] [INFO ] [MAIN ] Update Progress: 633/2372 symbols completed. DLX took 34.9s. Estimated remaining: 3h 49m 55s. Rate: 7.6 symbols/min [2025-09-23T18:23:44.590999] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-23T18:23:44.597246] [DEBUG] [LOCAL ] DMA: Trimmed 6527 records to 4506 (keeping 200 days of data) [2025-09-23T18:23:44.806814] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:44.813139] [DEBUG] [LOCAL ] DMA: Primary data saved (4506 records). [2025-09-23T18:23:44.813364] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-23T18:23:44.813757] [INFO ] [MAIN ] Update Progress: 634/2372 symbols completed. DMA took 28.4s. Estimated remaining: 3h 49m 26s. Rate: 7.6 symbols/min [2025-09-23T18:23:44.999934] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:45.012134] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-23T18:23:45.039088] [DEBUG] [LOCAL ] DNA: Loaded 48411 existing records from primary storage. [2025-09-23T18:23:45.039276] [INFO ] [MAIN ] DNA: Loaded 48411 existing records. [2025-09-23T18:23:45.135249] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T18:23:45.263349] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:45.275719] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-23T18:23:45.276938] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-23T18:23:45.278302] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-23T18:23:45.278390] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-23T18:23:45.312810] [DEBUG] [LOCAL ] DNOW: Loaded 43495 existing records from primary storage. [2025-09-23T18:23:45.338925] [INFO ] [MAIN ] DNOW: Loaded 43495 existing records. [2025-09-23T18:23:45.739252] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:45.772050] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-23T18:23:45.771990] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T18:23:45.788612] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-23T18:23:45.798274] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-23T18:23:45.798390] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-23T18:23:45.814585] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-23T18:23:45.982705] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:46.253002] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:46.602192] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-23T18:23:46.621600] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T18:23:47.192777] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T18:23:47.402198] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-23T18:23:48.202228] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-23T18:23:48.953688] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T18:23:49.002155] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-23T18:23:49.260765] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:23:49.802206] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-23T18:23:50.195849] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T18:23:50.465199] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T18:23:50.467803] [INFO ] [REMOTE ] DMB: Full fetch complete (15050 records). [2025-09-23T18:23:50.467884] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-23T18:23:50.613786] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-23T18:23:50.851468] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-23T18:23:50.851555] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-23T18:23:50.851985] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-23T18:23:50.852047] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-23T18:23:50.853099] [DEBUG] [LOCAL ] DMB: Trimmed 15050 records to 10158 (keeping 200 days of data) [2025-09-23T18:23:50.919149] [DEBUG] [LOCAL ] DMB: Primary data saved (10158 records). [2025-09-23T18:23:50.919286] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-23T18:23:50.919385] [INFO ] [MAIN ] Update Progress: 635/2372 symbols completed. DMB took 21.1s. Estimated remaining: 3h 49m 13s. Rate: 7.6 symbols/min [2025-09-23T18:23:51.086262] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:51.086457] [DEBUG] [LOCAL ] DNP: No existing data file found in primary storage. [2025-09-23T18:23:51.086495] [WARN ] [MAIN ] DNP: No existing data found, performing full refresh instead. [2025-09-23T18:23:51.086639] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-23T18:23:51.086715] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-23T18:23:51.086762] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-09-23T18:23:51.086795] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-23T18:23:51.395347] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T18:23:51.411089] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-23T18:23:51.474268] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:52.202187] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-23T18:23:52.958812] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T18:23:53.007279] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-23T18:23:53.026789] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:23:53.802250] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-23T18:23:54.113554] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T18:23:54.234180] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:23:54.602304] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-23T18:23:55.402211] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-23T18:23:55.644503] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T18:23:56.202234] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-23T18:23:56.787688] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:23:56.805540] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T18:23:57.002253] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-23T18:23:57.802235] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-23T18:23:57.953057] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:23:57.956001] [INFO ] [REMOTE ] DMO: Full fetch complete (14487 records). [2025-09-23T18:23:57.956111] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-23T18:23:58.335515] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-23T18:23:58.335606] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-23T18:23:58.335947] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-23T18:23:58.336008] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-23T18:23:58.336544] [DEBUG] [LOCAL ] DMO: Trimmed 14487 records to 9855 (keeping 200 days of data) [2025-09-23T18:23:58.405724] [DEBUG] [LOCAL ] DMO: Primary data saved (9855 records). [2025-09-23T18:23:58.405866] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-23T18:23:58.405993] [INFO ] [MAIN ] Update Progress: 636/2372 symbols completed. DMO took 26.4s. Estimated remaining: 3h 49m 4s. Rate: 7.6 symbols/min [2025-09-23T18:23:58.576358] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:58.576548] [DEBUG] [LOCAL ] DOC: No existing data file found in primary storage. [2025-09-23T18:23:58.576585] [WARN ] [MAIN ] DOC: No existing data found, performing full refresh instead. [2025-09-23T18:23:58.576786] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-23T18:23:58.576828] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-23T18:23:58.576868] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-09-23T18:23:58.576900] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-23T18:23:58.607433] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-23T18:23:58.960920] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:58.985018] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:23:59.402215] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-23T18:24:00.081740] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:24:00.202140] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-23T18:24:00.247031] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T18:24:01.002214] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-23T18:24:01.716492] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T18:24:01.802218] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-23T18:24:02.602238] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-23T18:24:02.736172] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T18:24:03.402205] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-23T18:24:04.202203] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-23T18:24:04.984314] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-09-23T18:24:05.002146] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-23T18:24:05.354880] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T18:24:05.802168] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-23T18:24:05.850268] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-23T18:24:05.996193] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T18:24:06.114839] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (3.51 seconds). [2025-09-23T18:24:06.602251] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-23T18:24:07.343840] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:24:07.402193] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-23T18:24:08.202199] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-23T18:24:08.271424] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T18:24:08.334094] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T18:24:09.002210] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-23T18:24:09.635523] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T18:24:09.802304] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-23T18:24:10.602278] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-23T18:24:10.937155] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T18:24:11.181755] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T18:24:11.402211] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-23T18:24:11.664539] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:24:12.202182] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-23T18:24:12.697193] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:24:12.704528] [INFO ] [REMOTE ] DNOW: Full fetch complete (62384 records). [2025-09-23T18:24:12.704725] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-23T18:24:13.009138] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-23T18:24:13.114913] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-23T18:24:13.114994] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-23T18:24:13.115800] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-23T18:24:13.115867] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-23T18:24:13.117176] [DEBUG] [LOCAL ] DNOW: Trimmed 62384 records to 43520 (keeping 200 days of data) [2025-09-23T18:24:13.379864] [DEBUG] [LOCAL ] DNOW: Primary data saved (43520 records). [2025-09-23T18:24:13.380013] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-23T18:24:13.380107] [INFO ] [MAIN ] Update Progress: 637/2372 symbols completed. DNOW took 28.6s. Estimated remaining: 3h 49m 15s. Rate: 7.6 symbols/min [2025-09-23T18:24:13.544682] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:24:13.802203] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-23T18:24:14.379205] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:24:14.602208] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-23T18:24:15.402257] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-23T18:24:15.707634] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T18:24:16.202202] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-23T18:24:16.373793] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T18:24:16.421354] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T18:24:16.431780] [INFO ] [REMOTE ] DNP: Full fetch complete (49451 records). [2025-09-23T18:24:16.432005] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-23T18:24:16.829632] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-23T18:24:16.829754] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-23T18:24:16.830377] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-23T18:24:16.830421] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-23T18:24:16.831617] [DEBUG] [LOCAL ] DNP: Trimmed 49451 records to 33340 (keeping 200 days of data) [2025-09-23T18:24:17.014375] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-23T18:24:17.039381] [DEBUG] [LOCAL ] DNP: Primary data saved (33340 records). [2025-09-23T18:24:17.039543] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-23T18:24:17.039674] [INFO ] [MAIN ] Update Progress: 638/2372 symbols completed. DNP took 26.1s. Estimated remaining: 3h 48m 56s. Rate: 7.6 symbols/min [2025-09-23T18:24:17.927423] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T18:24:17.938241] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-23T18:24:18.555524] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:24:18.602227] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-23T18:24:20.204774] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-23T18:24:20.215455] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-23T18:24:20.374824] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T18:24:20.387243] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-23T18:24:22.290971] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-23T18:24:22.301110] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-23T18:24:23.352851] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (2.97 seconds). [2025-09-23T18:24:23.366144] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-23T18:24:24.545192] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-23T18:24:24.556159] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-23T18:24:25.000185] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T18:24:25.011978] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-23T18:24:26.119724] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:24:26.130291] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-23T18:24:26.681780] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T18:24:26.693244] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-23T18:24:27.627537] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T18:24:27.635562] [INFO ] [REMOTE ] DNA: Full fetch complete (70993 records). [2025-09-23T18:24:27.635734] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-23T18:24:28.102813] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-23T18:24:28.102906] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-23T18:24:28.103722] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-23T18:24:28.103786] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-23T18:24:28.105316] [DEBUG] [LOCAL ] DNA: Trimmed 70993 records to 48395 (keeping 200 days of data) [2025-09-23T18:24:28.404674] [DEBUG] [LOCAL ] DNA: Primary data saved (48395 records). [2025-09-23T18:24:28.404845] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-23T18:24:28.404948] [INFO ] [MAIN ] Update Progress: 639/2372 symbols completed. DNA took 43.8s. Estimated remaining: 3h 48m 57s. Rate: 7.6 symbols/min [2025-09-23T18:24:28.479224] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T18:24:28.487544] [INFO ] [REMOTE ] DOC: Full fetch complete (76981 records). [2025-09-23T18:24:28.487717] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-23T18:24:28.488551] [FATAL] [VALIDATOR ] DOC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:24:28.488667] [FATAL] [MAIN ] DOC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:24:28.488726] [WARN ] [MAIN ] DOC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:24:28.488765] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-23T18:24:28.488824] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-09-23T18:24:28.488859] [INFO ] [LOCAL ] DOC: Starting deletion of derivative data. [2025-09-23T18:24:28.488897] [DEBUG] [LOCAL ] DOC: No derivative data file found to delete. [2025-09-23T18:24:28.488956] [INFO ] [MAIN ] Update Progress: 640/2372 symbols completed. DOC took 30.1s. Estimated remaining: 3h 48m 28s. Rate: 7.6 symbols/min [2025-09-23T18:24:29.018235] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:29.206547] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:29.252534] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:29.254636] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:29.259403] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-09-23T18:24:29.259461] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-09-23T18:24:29.259585] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-23T18:24:29.259623] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-23T18:24:29.259703] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-09-23T18:24:29.260256] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-23T18:24:29.510118] [DEBUG] [LOCAL ] DOCN: Loaded 50462 existing records from primary storage. [2025-09-23T18:24:29.530704] [DEBUG] [LOCAL ] DOUG: Loaded 34760 existing records from primary storage. [2025-09-23T18:24:29.539261] [INFO ] [MAIN ] DOCN: Loaded 50462 existing records. [2025-09-23T18:24:29.560029] [INFO ] [MAIN ] DOUG: Loaded 34760 existing records. [2025-09-23T18:24:29.883066] [DEBUG] [LOCAL ] DOCS: Loaded 51285 existing records from primary storage. [2025-09-23T18:24:29.921241] [INFO ] [MAIN ] DOCS: Loaded 51285 existing records. [2025-09-23T18:24:30.149870] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:30.149750] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:30.182311] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-23T18:24:30.197046] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-23T18:24:30.236705] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-23T18:24:30.236512] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:30.249964] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-23T18:24:30.250419] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-23T18:24:30.271567] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-23T18:24:30.271914] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-23T18:24:30.316813] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-23T18:24:30.337048] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-23T18:24:30.383303] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:30.447913] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-23T18:24:30.468717] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-23T18:24:30.517410] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-23T18:24:30.544830] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-23T18:24:31.417115] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:31.434165] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-23T18:24:31.474479] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:31.480679] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-23T18:24:31.559704] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:31.560119] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-23T18:24:31.583543] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:24:31.591132] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-23T18:24:32.704482] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:24:32.714132] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-23T18:24:32.751832] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:24:32.761031] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-23T18:24:32.972449] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T18:24:32.979860] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-23T18:24:33.166662] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T18:24:33.177600] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-23T18:24:33.726826] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T18:24:33.736458] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-23T18:24:34.111564] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T18:24:34.118378] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-23T18:24:34.608103] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T18:24:34.617315] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-23T18:24:35.398500] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-23T18:24:35.408852] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-23T18:24:35.452613] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T18:24:35.821315] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:24:36.202238] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-23T18:24:36.918683] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-23T18:24:37.002205] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-23T18:24:37.168725] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T18:24:37.289378] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T18:24:37.802240] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-23T18:24:38.602209] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-23T18:24:38.786832] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T18:24:39.013582] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T18:24:39.402210] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-23T18:24:40.097516] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:24:40.202199] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-23T18:24:40.852771] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:24:41.002227] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-23T18:24:41.681369] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T18:24:41.802211] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-23T18:24:42.112861] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:24:42.602221] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-23T18:24:43.094037] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:24:43.402219] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-23T18:24:43.707035] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T18:24:44.202184] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-23T18:24:44.947581] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T18:24:45.002251] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-23T18:24:45.122922] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T18:24:45.802205] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-23T18:24:46.602206] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-23T18:24:46.939960] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T18:24:47.069789] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T18:24:47.402208] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-23T18:24:48.080091] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T18:24:48.202167] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-23T18:24:48.793227] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T18:24:49.002227] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-23T18:24:49.802181] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-23T18:24:49.900447] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T18:24:50.372567] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T18:24:50.602191] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-23T18:24:50.853414] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:24:51.402202] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-23T18:24:52.202228] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-23T18:24:52.346312] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T18:24:52.519722] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:24:52.525601] [INFO ] [REMOTE ] DOUG: Full fetch complete (51583 records). [2025-09-23T18:24:52.525813] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-23T18:24:52.918874] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-23T18:24:52.918998] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-23T18:24:52.919664] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-23T18:24:52.919726] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-23T18:24:52.920806] [DEBUG] [LOCAL ] DOUG: Trimmed 51583 records to 34780 (keeping 200 days of data) [2025-09-23T18:24:53.005761] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-23T18:24:53.122280] [DEBUG] [LOCAL ] DOUG: Primary data saved (34780 records). [2025-09-23T18:24:53.122436] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-23T18:24:53.122524] [INFO ] [MAIN ] Update Progress: 641/2372 symbols completed. DOUG took 24.6s. Estimated remaining: 3h 49m 5s. Rate: 7.6 symbols/min [2025-09-23T18:24:53.291872] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:53.344407] [DEBUG] [LOCAL ] DOV: Loaded 45742 existing records from primary storage. [2025-09-23T18:24:53.344579] [INFO ] [MAIN ] DOV: Loaded 45742 existing records. [2025-09-23T18:24:53.530462] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:53.531075] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-23T18:24:53.531252] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-23T18:24:53.540916] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-23T18:24:53.554746] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-23T18:24:53.561896] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T18:24:53.807334] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-23T18:24:53.973079] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:54.409813] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T18:24:54.423143] [INFO ] [REMOTE ] DOCS: Full fetch complete (74225 records). [2025-09-23T18:24:54.423415] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-23T18:24:54.603713] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-23T18:24:54.827338] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-23T18:24:54.827430] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-23T18:24:54.828340] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-23T18:24:54.828407] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-23T18:24:54.830173] [DEBUG] [LOCAL ] DOCS: Trimmed 74225 records to 51264 (keeping 200 days of data) [2025-09-23T18:24:55.078227] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T18:24:55.168512] [DEBUG] [LOCAL ] DOCS: Primary data saved (51264 records). [2025-09-23T18:24:55.168693] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-23T18:24:55.168851] [INFO ] [MAIN ] Update Progress: 642/2372 symbols completed. DOCS took 26.7s. Estimated remaining: 3h 48m 41s. Rate: 7.6 symbols/min [2025-09-23T18:24:55.347486] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:55.400459] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-23T18:24:55.400626] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-09-23T18:24:55.412156] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-23T18:24:55.587210] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:55.587497] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-23T18:24:55.587554] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-23T18:24:55.589094] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-23T18:24:55.589156] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-23T18:24:55.954386] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:56.202174] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-23T18:24:56.410090] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T18:24:57.002209] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-23T18:24:57.080578] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T18:24:57.088154] [INFO ] [REMOTE ] DOLE: Full fetch complete (53140 records). [2025-09-23T18:24:57.088283] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-23T18:24:57.474705] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-23T18:24:57.474809] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-23T18:24:57.475578] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-23T18:24:57.475663] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-23T18:24:57.477008] [DEBUG] [LOCAL ] DOLE: Trimmed 53140 records to 37844 (keeping 200 days of data) [2025-09-23T18:24:57.712217] [DEBUG] [LOCAL ] DOLE: Primary data saved (37844 records). [2025-09-23T18:24:57.712503] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-23T18:24:57.712730] [INFO ] [MAIN ] Update Progress: 643/2372 symbols completed. DOLE took 29.2s. Estimated remaining: 3h 48m 19s. Rate: 7.6 symbols/min [2025-09-23T18:24:57.807328] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-23T18:24:57.926769] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:57.932442] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T18:24:57.961712] [DEBUG] [LOCAL ] DPG: Loaded 13309 existing records from primary storage. [2025-09-23T18:24:57.961899] [INFO ] [MAIN ] DPG: Loaded 13309 existing records. [2025-09-23T18:24:58.158189] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:58.158428] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-23T18:24:58.158476] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-23T18:24:58.158973] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-23T18:24:58.159032] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-23T18:24:58.536247] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:58.565170] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T18:24:58.602226] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-23T18:24:59.402208] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-23T18:24:59.721836] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T18:24:59.762027] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T18:25:00.029290] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T18:25:00.202183] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-23T18:25:01.002255] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-23T18:25:01.802308] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-23T18:25:02.218674] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T18:25:02.536559] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T18:25:02.602245] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-23T18:25:03.344420] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T18:25:03.402251] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-23T18:25:04.202202] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-23T18:25:04.278590] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:25:04.287599] [INFO ] [REMOTE ] DOCN: Full fetch complete (71190 records). [2025-09-23T18:25:04.287839] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-23T18:25:04.686116] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-23T18:25:04.686235] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-23T18:25:04.687171] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-23T18:25:04.687245] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-23T18:25:04.688828] [DEBUG] [LOCAL ] DOCN: Trimmed 71190 records to 50488 (keeping 200 days of data) [2025-09-23T18:25:04.812745] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:25:05.002195] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-23T18:25:05.010892] [DEBUG] [LOCAL ] DOCN: Primary data saved (50488 records). [2025-09-23T18:25:05.011214] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-23T18:25:05.011350] [INFO ] [MAIN ] Update Progress: 644/2372 symbols completed. DOCN took 36.5s. Estimated remaining: 3h 48m 9s. Rate: 7.6 symbols/min [2025-09-23T18:25:05.216950] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:05.217401] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-09-23T18:25:05.217766] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-09-23T18:25:05.219713] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T18:25:05.220015] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-23T18:25:05.230649] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-23T18:25:05.230732] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-23T18:25:05.230776] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-23T18:25:05.591077] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:05.802192] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-23T18:25:06.602238] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-23T18:25:06.919132] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-23T18:25:07.036570] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T18:25:07.402192] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-23T18:25:08.113738] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T18:25:08.202171] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-23T18:25:08.667776] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T18:25:09.002199] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-23T18:25:09.802206] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-23T18:25:10.366561] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T18:25:10.391480] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T18:25:10.427922] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T18:25:10.602207] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-23T18:25:11.402194] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-23T18:25:12.202184] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-23T18:25:12.686370] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T18:25:12.750470] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-23T18:25:13.002195] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-23T18:25:13.582272] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:25:13.802153] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-23T18:25:13.828700] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T18:25:14.602193] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-23T18:25:15.358252] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:25:15.402183] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-23T18:25:15.855030] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T18:25:16.016930] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T18:25:16.202195] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-23T18:25:16.793282] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T18:25:17.002206] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-23T18:25:17.802190] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-23T18:25:17.818247] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T18:25:18.602197] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-23T18:25:19.379266] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:25:19.402158] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-23T18:25:20.202200] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-23T18:25:20.334271] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:25:20.604781] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T18:25:20.887175] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:25:21.002232] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-23T18:25:21.802194] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-23T18:25:22.602201] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-23T18:25:22.819821] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T18:25:22.962696] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T18:25:23.402191] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-23T18:25:24.202170] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-23T18:25:24.349996] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T18:25:24.474188] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T18:25:24.483453] [INFO ] [REMOTE ] DOV: Full fetch complete (64852 records). [2025-09-23T18:25:24.483579] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-23T18:25:24.867903] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T18:25:24.888957] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-23T18:25:24.892309] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-23T18:25:24.893895] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-23T18:25:24.893984] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-23T18:25:24.895811] [DEBUG] [LOCAL ] DOV: Trimmed 64852 records to 45742 (keeping 200 days of data) [2025-09-23T18:25:25.002512] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-23T18:25:25.191467] [DEBUG] [LOCAL ] DOV: Primary data saved (45742 records). [2025-09-23T18:25:25.191615] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-23T18:25:25.191731] [INFO ] [MAIN ] Update Progress: 645/2372 symbols completed. DOV took 32.1s. Estimated remaining: 3h 48m 34s. Rate: 7.6 symbols/min [2025-09-23T18:25:25.368207] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:25.368442] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-09-23T18:25:25.368498] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-09-23T18:25:25.368692] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-23T18:25:25.368746] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-23T18:25:25.368791] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-23T18:25:25.368825] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-23T18:25:25.738142] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:25.802160] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-23T18:25:26.602239] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-23T18:25:27.091428] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T18:25:27.129530] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T18:25:27.402274] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-23T18:25:28.202169] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-23T18:25:28.242958] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T18:25:28.324815] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T18:25:29.002230] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-23T18:25:29.802211] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-23T18:25:29.973858] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T18:25:30.031828] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T18:25:30.040524] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-23T18:25:30.040729] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-23T18:25:30.434214] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-23T18:25:30.434429] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-23T18:25:30.435587] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-23T18:25:30.435757] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-23T18:25:30.443688] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:25:30.446779] [INFO ] [REMOTE ] DPG: Full fetch complete (18961 records). [2025-09-23T18:25:30.446892] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-23T18:25:30.447086] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-09-23T18:25:30.612400] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-23T18:25:30.932161] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-23T18:25:30.932566] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-23T18:25:30.933087] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-23T18:25:30.933668] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-23T18:25:30.936576] [DEBUG] [LOCAL ] DPG: Trimmed 18961 records to 13368 (keeping 200 days of data) [2025-09-23T18:25:31.134193] [DEBUG] [LOCAL ] DPG: Primary data saved (13368 records). [2025-09-23T18:25:31.135180] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-23T18:25:31.135531] [INFO ] [MAIN ] Update Progress: 646/2372 symbols completed. DPG took 33.4s. Estimated remaining: 3h 48m 21s. Rate: 7.6 symbols/min [2025-09-23T18:25:31.318986] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:31.410200] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-23T18:25:31.420875] [DEBUG] [LOCAL ] DRH: Loaded 50454 existing records from primary storage. [2025-09-23T18:25:31.439062] [INFO ] [MAIN ] DRH: Loaded 50454 existing records. [2025-09-23T18:25:31.638291] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:25:31.639352] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-23T18:25:31.639409] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-23T18:25:31.641799] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-23T18:25:31.642375] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-23T18:25:32.050551] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:32.054477] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-09-23T18:25:32.054732] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-23T18:25:32.054841] [INFO ] [MAIN ] Update Progress: 647/2372 symbols completed. DOW took 36.9s. Estimated remaining: 3h 47m 54s. Rate: 7.6 symbols/min [2025-09-23T18:25:32.235231] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:32.214409] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-23T18:25:32.284610] [DEBUG] [LOCAL ] DRI: Loaded 47858 existing records from primary storage. [2025-09-23T18:25:32.284873] [INFO ] [MAIN ] DRI: Loaded 47858 existing records. [2025-09-23T18:25:32.410146] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T18:25:32.501022] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:25:32.501276] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-23T18:25:32.501324] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-23T18:25:32.502902] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-23T18:25:32.502968] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-23T18:25:32.880704] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:32.933845] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T18:25:33.002214] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-23T18:25:33.705091] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T18:25:33.802149] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-23T18:25:34.602166] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-23T18:25:34.717574] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:25:35.056927] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T18:25:35.402208] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-23T18:25:35.964102] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T18:25:36.202180] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-23T18:25:36.647856] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T18:25:37.002212] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-23T18:25:37.692121] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:25:37.699775] [INFO ] [REMOTE ] DQ: Full fetch complete (62547 records). [2025-09-23T18:25:37.699900] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-23T18:25:37.700605] [FATAL] [VALIDATOR ] DQ: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:25:37.700731] [FATAL] [MAIN ] DQ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:25:37.700776] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:25:37.700843] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-23T18:25:37.700909] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-23T18:25:37.700945] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-09-23T18:25:37.701019] [DEBUG] [LOCAL ] DQ: No derivative data file found to delete. [2025-09-23T18:25:37.701098] [INFO ] [MAIN ] Update Progress: 648/2372 symbols completed. DQ took 32.7s. Estimated remaining: 3h 47m 40s. Rate: 7.6 symbols/min [2025-09-23T18:25:37.802179] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-23T18:25:37.873509] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:37.873753] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-09-23T18:25:37.873808] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-09-23T18:25:37.873984] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-23T18:25:37.874033] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-23T18:25:37.874076] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-09-23T18:25:37.874107] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-23T18:25:38.234080] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:38.266278] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T18:25:38.602246] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-23T18:25:38.944217] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:25:39.402201] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-23T18:25:39.888060] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T18:25:40.202220] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-23T18:25:40.538028] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:25:41.002219] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-23T18:25:41.743320] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T18:25:41.802238] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-23T18:25:42.414076] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:25:42.569247] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T18:25:42.602263] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-23T18:25:43.402205] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-23T18:25:44.191827] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:25:44.202139] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-23T18:25:44.361636] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T18:25:44.707256] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T18:25:45.002209] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-23T18:25:45.802199] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-23T18:25:46.276973] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T18:25:46.602238] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-23T18:25:47.402195] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-23T18:25:47.604692] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T18:25:48.102757] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T18:25:48.202237] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-23T18:25:48.633481] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:25:48.825204] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T18:25:49.002218] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-23T18:25:49.606411] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T18:25:49.802212] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-23T18:25:50.239630] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-23T18:25:50.602213] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-23T18:25:51.402246] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-23T18:25:52.120689] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:25:52.128605] [INFO ] [REMOTE ] DRD: Full fetch complete (48763 records). [2025-09-23T18:25:52.128759] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-23T18:25:52.207741] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-23T18:25:52.511008] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-23T18:25:52.511096] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-23T18:25:52.511747] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-23T18:25:52.511810] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-23T18:25:52.512996] [DEBUG] [LOCAL ] DRD: Trimmed 48763 records to 36687 (keeping 200 days of data) [2025-09-23T18:25:52.741201] [DEBUG] [LOCAL ] DRD: Primary data saved (36687 records). [2025-09-23T18:25:52.741355] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-23T18:25:52.741435] [INFO ] [MAIN ] Update Progress: 649/2372 symbols completed. DRD took 27.5s. Estimated remaining: 3h 47m 51s. Rate: 7.6 symbols/min [2025-09-23T18:25:52.919528] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:52.949626] [DEBUG] [LOCAL ] DSL: Loaded 28194 existing records from primary storage. [2025-09-23T18:25:52.949810] [INFO ] [MAIN ] DSL: Loaded 28194 existing records. [2025-09-23T18:25:53.013042] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-23T18:25:53.140781] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:25:53.148920] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-23T18:25:53.149760] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-23T18:25:53.150200] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T18:25:53.152807] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-23T18:25:53.153618] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-23T18:25:53.329520] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:25:53.568963] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:53.802198] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-23T18:25:54.602327] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-23T18:25:54.834392] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T18:25:55.085333] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T18:25:55.402248] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-23T18:25:55.792183] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-23T18:25:56.202268] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-23T18:25:57.002203] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-23T18:25:57.037733] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T18:25:57.483533] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T18:25:57.723356] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T18:25:57.802153] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-23T18:25:58.602213] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-23T18:25:59.291422] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T18:25:59.402246] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-23T18:25:59.606162] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T18:26:00.202213] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-23T18:26:01.002171] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-23T18:26:01.038165] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T18:26:01.110777] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T18:26:01.118742] [INFO ] [REMOTE ] DRH: Full fetch complete (71458 records). [2025-09-23T18:26:01.118860] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-23T18:26:01.119634] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:26:01.119760] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:26:01.119803] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:26:01.119855] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-23T18:26:01.119969] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-09-23T18:26:01.120029] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-09-23T18:26:01.120534] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-09-23T18:26:01.120717] [INFO ] [MAIN ] Update Progress: 650/2372 symbols completed. DRH took 30.0s. Estimated remaining: 3h 47m 44s. Rate: 7.6 symbols/min [2025-09-23T18:26:01.294567] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:01.311574] [DEBUG] [LOCAL ] DSM: Loaded 15726 existing records from primary storage. [2025-09-23T18:26:01.311725] [INFO ] [MAIN ] DSM: Loaded 15726 existing records. [2025-09-23T18:26:01.502498] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:01.502816] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-23T18:26:01.502893] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-23T18:26:01.503379] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-23T18:26:01.503441] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-23T18:26:01.807785] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-23T18:26:01.896077] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:02.488119] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T18:26:02.491078] [INFO ] [REMOTE ] DRLL: Full fetch complete (16133 records). [2025-09-23T18:26:02.491153] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-23T18:26:02.603989] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-23T18:26:02.831668] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T18:26:02.922026] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-23T18:26:02.922104] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-23T18:26:02.922479] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-23T18:26:02.922581] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-23T18:26:02.923738] [DEBUG] [LOCAL ] DRLL: Trimmed 16133 records to 9710 (keeping 200 days of data) [2025-09-23T18:26:02.986286] [DEBUG] [LOCAL ] DRLL: Primary data saved (9710 records). [2025-09-23T18:26:02.986423] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-23T18:26:02.986525] [INFO ] [MAIN ] Update Progress: 651/2372 symbols completed. DRLL took 25.3s. Estimated remaining: 3h 47m 20s. Rate: 7.6 symbols/min [2025-09-23T18:26:03.157577] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:03.161864] [DEBUG] [LOCAL ] DSMC: Loaded 1965 existing records from primary storage. [2025-09-23T18:26:03.161948] [INFO ] [MAIN ] DSMC: Loaded 1965 existing records. [2025-09-23T18:26:03.357070] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:03.358065] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-23T18:26:03.358257] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-23T18:26:03.358723] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-23T18:26:03.358804] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-23T18:26:03.407393] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-23T18:26:03.433278] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T18:26:03.742983] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:04.202189] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-23T18:26:05.002178] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-23T18:26:05.081390] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:26:05.262150] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T18:26:05.270417] [INFO ] [REMOTE ] DRI: Full fetch complete (69564 records). [2025-09-23T18:26:05.270582] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-23T18:26:05.719330] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-23T18:26:05.719505] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-23T18:26:05.723202] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-23T18:26:05.724065] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-23T18:26:05.723838] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:26:05.732170] [DEBUG] [LOCAL ] DRI: Trimmed 69564 records to 47866 (keeping 200 days of data) [2025-09-23T18:26:05.810347] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-23T18:26:06.066732] [DEBUG] [LOCAL ] DRI: Primary data saved (47866 records). [2025-09-23T18:26:06.066876] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-23T18:26:06.067027] [INFO ] [MAIN ] Update Progress: 652/2372 symbols completed. DRI took 34.0s. Estimated remaining: 3h 46m 60s. Rate: 7.6 symbols/min [2025-09-23T18:26:06.239168] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:06.263989] [DEBUG] [LOCAL ] DSU: Loaded 21791 existing records from primary storage. [2025-09-23T18:26:06.264137] [INFO ] [MAIN ] DSU: Loaded 21791 existing records. [2025-09-23T18:26:06.450399] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:06.450742] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-23T18:26:06.450812] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-23T18:26:06.451741] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-23T18:26:06.451805] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-23T18:26:06.608772] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-23T18:26:06.832035] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:06.960336] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T18:26:07.402208] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-23T18:26:07.651965] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T18:26:08.179106] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T18:26:08.202153] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-23T18:26:08.925444] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T18:26:09.002199] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-23T18:26:09.802169] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-23T18:26:09.866209] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T18:26:10.250518] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T18:26:10.602229] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-23T18:26:10.956012] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-23T18:26:11.402209] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-23T18:26:12.202193] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-23T18:26:12.233631] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T18:26:13.002212] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-23T18:26:13.661544] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T18:26:13.802180] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-23T18:26:14.027315] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T18:26:14.607821] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-23T18:26:14.612119] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T18:26:15.279395] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T18:26:15.402192] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-23T18:26:16.116835] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T18:26:16.202188] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-23T18:26:16.512554] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T18:26:17.002195] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-23T18:26:17.350290] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T18:26:17.802216] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-23T18:26:18.482780] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T18:26:18.602161] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-23T18:26:19.402190] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-23T18:26:19.650028] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:26:20.202191] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-23T18:26:20.349795] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:26:20.352824] [INFO ] [REMOTE ] DSM: Full fetch complete (24777 records). [2025-09-23T18:26:20.352929] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-23T18:26:20.759089] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-23T18:26:20.759246] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-23T18:26:20.759712] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-23T18:26:20.759790] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-23T18:26:20.760508] [DEBUG] [LOCAL ] DSM: Trimmed 24777 records to 15765 (keeping 200 days of data) [2025-09-23T18:26:20.870461] [DEBUG] [LOCAL ] DSM: Primary data saved (15765 records). [2025-09-23T18:26:20.870619] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-23T18:26:20.870784] [INFO ] [MAIN ] Update Progress: 653/2372 symbols completed. DSM took 19.7s. Estimated remaining: 3h 47m 10s. Rate: 7.6 symbols/min [2025-09-23T18:26:21.007422] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-23T18:26:21.065238] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:21.093229] [DEBUG] [LOCAL ] DSX: Loaded 24550 existing records from primary storage. [2025-09-23T18:26:21.093398] [INFO ] [MAIN ] DSX: Loaded 24550 existing records. [2025-09-23T18:26:21.276890] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:21.277553] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-23T18:26:21.277887] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-23T18:26:21.278917] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-23T18:26:21.278980] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-23T18:26:21.502199] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T18:26:21.617896] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T18:26:21.730975] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:21.802175] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-23T18:26:22.602215] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-23T18:26:23.003148] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T18:26:23.127730] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T18:26:23.402229] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-23T18:26:24.202295] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-23T18:26:24.625032] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T18:26:25.002273] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-23T18:26:25.199806] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T18:26:25.266512] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-23T18:26:25.802198] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-23T18:26:26.258564] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:26:26.602205] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-23T18:26:27.402231] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-23T18:26:27.745290] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:26:28.102529] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T18:26:28.202293] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-23T18:26:28.913193] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T18:26:29.002173] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-23T18:26:29.802145] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-23T18:26:29.820434] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T18:26:30.607342] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-23T18:26:30.621561] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T18:26:31.402234] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-23T18:26:31.460239] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T18:26:32.202200] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-23T18:26:32.277539] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T18:26:33.002222] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-23T18:26:33.152467] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T18:26:33.802239] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-23T18:26:34.442967] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T18:26:34.602246] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-23T18:26:34.639686] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T18:26:34.644269] [INFO ] [REMOTE ] DSU: Full fetch complete (32193 records). [2025-09-23T18:26:34.644349] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-23T18:26:35.014386] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-23T18:26:35.014508] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-23T18:26:35.015032] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-23T18:26:35.015113] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-23T18:26:35.015918] [DEBUG] [LOCAL ] DSU: Trimmed 32193 records to 21929 (keeping 200 days of data) [2025-09-23T18:26:35.150037] [DEBUG] [LOCAL ] DSU: Primary data saved (21929 records). [2025-09-23T18:26:35.150166] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-23T18:26:35.150246] [INFO ] [MAIN ] Update Progress: 654/2372 symbols completed. DSU took 29.1s. Estimated remaining: 3h 47m 19s. Rate: 7.6 symbols/min [2025-09-23T18:26:35.383721] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:35.408729] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-23T18:26:35.412170] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:26:35.458905] [DEBUG] [LOCAL ] DT: Loaded 52947 existing records from primary storage. [2025-09-23T18:26:35.459056] [INFO ] [MAIN ] DT: Loaded 52947 existing records. [2025-09-23T18:26:35.635190] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:35.635426] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-23T18:26:35.635473] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-23T18:26:35.636918] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-23T18:26:35.636978] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-23T18:26:35.987173] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:36.202156] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-23T18:26:36.625295] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T18:26:37.002203] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-23T18:26:37.799977] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T18:26:37.810075] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-23T18:26:38.088239] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T18:26:38.309523] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:26:38.310583] [INFO ] [REMOTE ] DSMC: Full fetch complete (2873 records). [2025-09-23T18:26:38.310698] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-23T18:26:38.607322] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-23T18:26:38.684096] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-23T18:26:38.684190] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-23T18:26:38.684336] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-23T18:26:38.684375] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-23T18:26:38.684844] [DEBUG] [LOCAL ] DSMC: Trimmed 2873 records to 1954 (keeping 200 days of data) [2025-09-23T18:26:38.698688] [DEBUG] [LOCAL ] DSMC: Primary data saved (1954 records). [2025-09-23T18:26:38.698822] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-23T18:26:38.698934] [INFO ] [MAIN ] Update Progress: 655/2372 symbols completed. DSMC took 35.7s. Estimated remaining: 3h 46m 59s. Rate: 7.6 symbols/min [2025-09-23T18:26:38.874688] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:38.888935] [DEBUG] [LOCAL ] DTB: Loaded 4724 existing records from primary storage. [2025-09-23T18:26:38.889075] [INFO ] [MAIN ] DTB: Loaded 4724 existing records. [2025-09-23T18:26:39.073695] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:39.073943] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-23T18:26:39.073992] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-23T18:26:39.074305] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-23T18:26:39.074366] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-23T18:26:39.409940] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-23T18:26:39.432760] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:40.202240] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-23T18:26:40.411420] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:26:40.530394] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T18:26:40.779041] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T18:26:41.002212] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-23T18:26:41.802268] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-23T18:26:41.856023] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T18:26:42.602234] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-23T18:26:42.728827] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T18:26:42.735027] [INFO ] [REMOTE ] DSL: Full fetch complete (41331 records). [2025-09-23T18:26:42.735420] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-23T18:26:43.133197] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-23T18:26:43.133285] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-23T18:26:43.133938] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-23T18:26:43.134006] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-23T18:26:43.135111] [DEBUG] [LOCAL ] DSL: Trimmed 41331 records to 28179 (keeping 200 days of data) [2025-09-23T18:26:43.340120] [DEBUG] [LOCAL ] DSL: Primary data saved (28179 records). [2025-09-23T18:26:43.340267] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-23T18:26:43.340358] [INFO ] [MAIN ] Update Progress: 656/2372 symbols completed. DSL took 50.6s. Estimated remaining: 3h 46m 43s. Rate: 7.6 symbols/min [2025-09-23T18:26:43.411245] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-23T18:26:43.527838] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:43.584213] [DEBUG] [LOCAL ] DTE: Loaded 48004 existing records from primary storage. [2025-09-23T18:26:43.584393] [INFO ] [MAIN ] DTE: Loaded 48004 existing records. [2025-09-23T18:26:43.765484] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:43.765802] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-23T18:26:43.765856] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-23T18:26:43.767524] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-23T18:26:43.767588] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-23T18:26:43.951507] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T18:26:44.159504] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:44.207292] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-23T18:26:44.226857] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T18:26:45.002300] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-23T18:26:45.115156] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T18:26:45.802265] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-23T18:26:46.347569] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T18:26:46.602224] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-23T18:26:46.686577] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T18:26:46.950452] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-23T18:26:47.402192] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-23T18:26:48.202191] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-23T18:26:48.291266] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T18:26:48.295961] [INFO ] [REMOTE ] DSX: Full fetch complete (37302 records). [2025-09-23T18:26:48.296092] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-23T18:26:48.700778] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-23T18:26:48.700943] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-23T18:26:48.701487] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-23T18:26:48.701531] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-23T18:26:48.702723] [DEBUG] [LOCAL ] DSX: Trimmed 37302 records to 24442 (keeping 200 days of data) [2025-09-23T18:26:48.795142] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T18:26:48.858560] [DEBUG] [LOCAL ] DSX: Primary data saved (24442 records). [2025-09-23T18:26:48.858723] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-23T18:26:48.858821] [INFO ] [MAIN ] Update Progress: 657/2372 symbols completed. DSX took 28.0s. Estimated remaining: 3h 46m 29s. Rate: 7.6 symbols/min [2025-09-23T18:26:49.008708] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-23T18:26:49.042978] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:49.043127] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-23T18:26:49.043184] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-23T18:26:49.043327] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-23T18:26:49.043369] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-23T18:26:49.043412] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-23T18:26:49.043446] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-23T18:26:49.416666] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:49.802192] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-23T18:26:50.139409] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-23T18:26:50.430523] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:26:50.602256] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-23T18:26:51.402200] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-23T18:26:51.975223] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T18:26:52.202221] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-23T18:26:52.703412] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T18:26:52.812918] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:26:53.002217] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-23T18:26:53.802227] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-23T18:26:54.450806] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T18:26:54.602221] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-23T18:26:54.687879] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T18:26:55.402209] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-23T18:26:55.833087] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:26:55.853355] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T18:26:56.202231] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-23T18:26:56.694094] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T18:26:56.695892] [INFO ] [REMOTE ] DTB: Full fetch complete (6796 records). [2025-09-23T18:26:56.695999] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-23T18:26:57.007381] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-23T18:26:57.066050] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-23T18:26:57.066137] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-23T18:26:57.066342] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-23T18:26:57.066416] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-23T18:26:57.066918] [DEBUG] [LOCAL ] DTB: Trimmed 6796 records to 4728 (keeping 200 days of data) [2025-09-23T18:26:57.098602] [DEBUG] [LOCAL ] DTB: Primary data saved (4728 records). [2025-09-23T18:26:57.098774] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-23T18:26:57.098873] [INFO ] [MAIN ] Update Progress: 658/2372 symbols completed. DTB took 18.4s. Estimated remaining: 3h 46m 21s. Rate: 7.6 symbols/min [2025-09-23T18:26:57.271696] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:57.280140] [DEBUG] [LOCAL ] DTG: Loaded 5902 existing records from primary storage. [2025-09-23T18:26:57.280242] [INFO ] [MAIN ] DTG: Loaded 5902 existing records. [2025-09-23T18:26:57.456092] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:57.456359] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-23T18:26:57.456408] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-23T18:26:57.456720] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-23T18:26:57.456780] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-23T18:26:57.807785] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-23T18:26:57.807661] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:58.612491] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-23T18:26:58.615276] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:26:59.198078] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T18:26:59.402249] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-23T18:26:59.618365] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T18:27:00.017825] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:27:00.202201] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-23T18:27:01.002204] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-23T18:27:01.802200] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-23T18:27:02.343222] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-23T18:27:02.602244] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-23T18:27:03.136665] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T18:27:03.402253] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-23T18:27:03.948034] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-23T18:27:04.202202] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-23T18:27:04.507399] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-23T18:27:04.685720] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T18:27:05.002208] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-23T18:27:05.716966] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-23T18:27:05.726059] [INFO ] [REMOTE ] DT: Full fetch complete (76644 records). [2025-09-23T18:27:05.726251] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-23T18:27:05.807388] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-23T18:27:06.138608] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-23T18:27:06.138745] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-23T18:27:06.139737] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-23T18:27:06.139804] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-23T18:27:06.141598] [DEBUG] [LOCAL ] DT: Trimmed 76644 records to 52944 (keeping 200 days of data) [2025-09-23T18:27:06.406708] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T18:27:06.573411] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T18:27:06.603984] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-23T18:27:06.604418] [DEBUG] [LOCAL ] DT: Primary data saved (52944 records). [2025-09-23T18:27:06.604539] [INFO ] [MAIN ] DT: Full history saved. [2025-09-23T18:27:06.604717] [INFO ] [MAIN ] Update Progress: 659/2372 symbols completed. DT took 31.5s. Estimated remaining: 3h 46m 18s. Rate: 7.6 symbols/min [2025-09-23T18:27:06.870262] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:06.870528] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-23T18:27:06.870584] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-23T18:27:06.870813] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-23T18:27:06.870875] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-23T18:27:06.870939] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-23T18:27:06.870990] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-23T18:27:07.030065] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:27:07.398486] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:07.402171] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-23T18:27:07.597360] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:07.597901] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-23T18:27:08.202211] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-23T18:27:08.566286] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T18:27:09.002215] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-23T18:27:09.802206] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-23T18:27:10.219632] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T18:27:10.602165] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-23T18:27:10.644877] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T18:27:10.929961] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T18:27:11.402271] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-23T18:27:11.684744] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-23T18:27:12.202199] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-23T18:27:12.565145] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T18:27:13.002265] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-23T18:27:13.802240] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-23T18:27:14.401500] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:27:14.602263] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-09-23T18:27:14.622404] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T18:27:14.838983] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:14.839314] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-09-23T18:27:15.402201] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-02. [2025-09-23T18:27:15.636945] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:15.637265] [WARN ] [REMOTE ] DTK: No data returned for month 2025-02 [2025-09-23T18:27:16.202211] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-23T18:27:16.639262] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T18:27:16.640166] [INFO ] [REMOTE ] DTF: Full fetch complete (2159 records). [2025-09-23T18:27:16.640237] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-23T18:27:16.640587] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:27:16.640691] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:27:16.640742] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:27:16.640808] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-23T18:27:16.640872] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-23T18:27:16.640908] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-23T18:27:16.640964] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-23T18:27:16.641043] [INFO ] [MAIN ] Update Progress: 660/2372 symbols completed. DTF took 27.8s. Estimated remaining: 3h 46m 15s. Rate: 7.6 symbols/min [2025-09-23T18:27:16.813428] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:16.867018] [DEBUG] [LOCAL ] DTM: Loaded 44544 existing records from primary storage. [2025-09-23T18:27:16.867263] [INFO ] [MAIN ] DTM: Loaded 44544 existing records. [2025-09-23T18:27:17.008090] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-23T18:27:17.052202] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:27:17.052442] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-23T18:27:17.052491] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-23T18:27:17.053924] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-23T18:27:17.054017] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-23T18:27:17.447874] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:17.722532] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T18:27:17.802261] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-03. [2025-09-23T18:27:18.007850] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:18.008244] [WARN ] [REMOTE ] DTK: No data returned for month 2025-03 [2025-09-23T18:27:18.602193] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-23T18:27:19.402249] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-23T18:27:19.843639] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T18:27:20.202208] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-23T18:27:20.856001] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T18:27:21.002198] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-23T18:27:21.373611] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T18:27:21.405590] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T18:27:21.802232] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-23T18:27:22.439555] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T18:27:22.602247] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-23T18:27:23.402204] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-23T18:27:24.202220] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-04. [2025-09-23T18:27:24.504369] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:24.504757] [WARN ] [REMOTE ] DTK: No data returned for month 2025-04 [2025-09-23T18:27:25.002207] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-05. [2025-09-23T18:27:25.044929] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:27:25.260911] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-23T18:27:25.270664] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:25.271247] [WARN ] [REMOTE ] DTK: No data returned for month 2025-05 [2025-09-23T18:27:25.802210] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-06. [2025-09-23T18:27:25.996764] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:25.997054] [WARN ] [REMOTE ] DTK: No data returned for month 2025-06 [2025-09-23T18:27:26.602199] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-07. [2025-09-23T18:27:26.801864] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:26.802182] [WARN ] [REMOTE ] DTK: No data returned for month 2025-07 [2025-09-23T18:27:27.402227] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-23T18:27:28.202223] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-23T18:27:28.611935] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-23T18:27:28.810956] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:27:28.819996] [INFO ] [REMOTE ] DTE: Full fetch complete (69231 records). [2025-09-23T18:27:28.820150] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-23T18:27:29.002291] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-23T18:27:29.225792] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-23T18:27:29.225890] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-23T18:27:29.226728] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-23T18:27:29.226798] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-23T18:27:29.228500] [DEBUG] [LOCAL ] DTE: Trimmed 69231 records to 47998 (keeping 200 days of data) [2025-09-23T18:27:29.540047] [DEBUG] [LOCAL ] DTE: Primary data saved (47998 records). [2025-09-23T18:27:29.540183] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-23T18:27:29.540265] [INFO ] [MAIN ] Update Progress: 661/2372 symbols completed. DTE took 46.2s. Estimated remaining: 3h 46m 20s. Rate: 7.6 symbols/min [2025-09-23T18:27:29.720066] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:29.727184] [DEBUG] [LOCAL ] DTW: Loaded 4901 existing records from primary storage. [2025-09-23T18:27:29.727278] [INFO ] [MAIN ] DTW: Loaded 4901 existing records. [2025-09-23T18:27:29.807340] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-08. [2025-09-23T18:27:29.918698] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:27:29.919436] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-23T18:27:29.919494] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-23T18:27:29.919814] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-23T18:27:29.919875] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-23T18:27:30.064851] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:30.091051] [WARN ] [REMOTE ] DTK: No data returned for month 2025-08 [2025-09-23T18:27:30.308724] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:30.370708] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:27:30.602256] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-23T18:27:31.239380] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T18:27:31.402205] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-23T18:27:32.202248] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-09. [2025-09-23T18:27:32.536003] [INFO ] [REMOTE ] DTK: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-23T18:27:32.536984] [INFO ] [REMOTE ] DTK: Full fetch complete (232 records). [2025-09-23T18:27:32.537074] [DEBUG] [VALIDATOR ] DTK: Validating primary data. [2025-09-23T18:27:32.537405] [FATAL] [VALIDATOR ] DTK: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:27:32.537520] [FATAL] [MAIN ] DTK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:27:32.537587] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:27:32.537679] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-23T18:27:32.537753] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-23T18:27:32.537789] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-23T18:27:32.537854] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-23T18:27:32.537933] [INFO ] [MAIN ] Update Progress: 662/2372 symbols completed. DTK took 25.9s. Estimated remaining: 3h 45m 59s. Rate: 7.6 symbols/min [2025-09-23T18:27:32.712928] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:32.713084] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-09-23T18:27:32.713120] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-09-23T18:27:32.713260] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-23T18:27:32.713339] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-23T18:27:32.713390] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-09-23T18:27:32.713423] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-23T18:27:33.009416] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-23T18:27:33.078703] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:33.109701] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T18:27:33.733005] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:27:33.802219] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-23T18:27:34.602195] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-23T18:27:35.277280] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T18:27:35.279229] [INFO ] [REMOTE ] DTG: Full fetch complete (9027 records). [2025-09-23T18:27:35.279316] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-23T18:27:35.407321] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-23T18:27:35.664027] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-23T18:27:35.664118] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-23T18:27:35.664375] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-23T18:27:35.664416] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-23T18:27:35.664893] [DEBUG] [LOCAL ] DTG: Trimmed 9027 records to 5902 (keeping 200 days of data) [2025-09-23T18:27:35.704543] [DEBUG] [LOCAL ] DTG: Primary data saved (5902 records). [2025-09-23T18:27:35.704694] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-23T18:27:35.704797] [INFO ] [MAIN ] Update Progress: 663/2372 symbols completed. DTG took 38.6s. Estimated remaining: 3h 45m 39s. Rate: 7.6 symbols/min [2025-09-23T18:27:35.888872] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:35.921706] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T18:27:35.925325] [DEBUG] [LOCAL ] DUKB: Loaded 6388 existing records from primary storage. [2025-09-23T18:27:35.936284] [INFO ] [MAIN ] DUKB: Loaded 6388 existing records. [2025-09-23T18:27:36.114762] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:27:36.115028] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-23T18:27:36.115135] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-23T18:27:36.115554] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-23T18:27:36.115616] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-23T18:27:36.208629] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-23T18:27:36.498755] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:36.793440] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:27:37.002194] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-23T18:27:37.802179] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-23T18:27:38.066690] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T18:27:38.366996] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T18:27:38.602178] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-23T18:27:38.839065] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T18:27:39.016786] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T18:27:39.402191] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-23T18:27:40.202219] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-23T18:27:40.580605] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:27:41.002199] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-23T18:27:41.747929] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T18:27:41.802178] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-23T18:27:42.189272] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T18:27:42.602196] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-23T18:27:43.260235] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T18:27:43.300450] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:27:43.402187] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-23T18:27:44.202236] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-23T18:27:44.973234] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T18:27:45.002145] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-23T18:27:45.106987] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T18:27:45.375889] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T18:27:45.802225] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-23T18:27:46.226686] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T18:27:46.602208] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-23T18:27:47.024165] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T18:27:47.402202] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-23T18:27:48.202242] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-23T18:27:48.678896] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T18:27:49.002193] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-23T18:27:49.406009] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T18:27:49.802199] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-23T18:27:50.206926] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T18:27:50.490909] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-23T18:27:50.602221] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-23T18:27:50.952691] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:27:51.402215] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-23T18:27:51.923953] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T18:27:51.925366] [INFO ] [REMOTE ] DTW: Full fetch complete (7770 records). [2025-09-23T18:27:51.925437] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-23T18:27:52.209036] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-23T18:27:52.294525] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-23T18:27:52.294664] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-23T18:27:52.294905] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-23T18:27:52.294948] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-23T18:27:52.295385] [DEBUG] [LOCAL ] DTW: Trimmed 7770 records to 4899 (keeping 200 days of data) [2025-09-23T18:27:52.325601] [DEBUG] [LOCAL ] DTW: Primary data saved (4899 records). [2025-09-23T18:27:52.325711] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-23T18:27:52.325801] [INFO ] [MAIN ] Update Progress: 664/2372 symbols completed. DTW took 22.8s. Estimated remaining: 3h 45m 54s. Rate: 7.6 symbols/min [2025-09-23T18:27:52.505574] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:52.560698] [DEBUG] [LOCAL ] DV: Loaded 51276 existing records from primary storage. [2025-09-23T18:27:52.560850] [INFO ] [MAIN ] DV: Loaded 51276 existing records. [2025-09-23T18:27:52.741378] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:27:52.741665] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-23T18:27:52.741727] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-23T18:27:52.743309] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-23T18:27:52.743382] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-23T18:27:53.007399] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-23T18:27:53.109276] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:53.810887] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-23T18:27:53.817794] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T18:27:53.846961] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T18:27:54.602226] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-23T18:27:54.934725] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T18:27:55.344628] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T18:27:55.402194] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-23T18:27:55.832482] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:27:56.202195] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-23T18:27:57.002201] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-23T18:27:57.802205] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-23T18:27:57.989162] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T18:27:58.201734] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:27:58.220979] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-23T18:27:58.602200] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-23T18:27:59.402271] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-23T18:28:00.202192] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-23T18:28:00.560240] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-23T18:28:01.004235] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-23T18:28:01.009796] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:28:01.802215] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-23T18:28:01.993907] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T18:28:02.001363] [INFO ] [REMOTE ] DTM: Full fetch complete (64866 records). [2025-09-23T18:28:02.001533] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-23T18:28:02.396665] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-23T18:28:02.396813] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-23T18:28:02.397621] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-23T18:28:02.397719] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-23T18:28:02.399220] [DEBUG] [LOCAL ] DTM: Trimmed 64866 records to 44507 (keeping 200 days of data) [2025-09-23T18:28:02.614875] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-23T18:28:02.683614] [DEBUG] [LOCAL ] DTM: Primary data saved (44507 records). [2025-09-23T18:28:02.683800] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-23T18:28:02.684008] [INFO ] [MAIN ] Update Progress: 665/2372 symbols completed. DTM took 46.0s. Estimated remaining: 3h 45m 52s. Rate: 7.6 symbols/min [2025-09-23T18:28:02.855941] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:02.856198] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-09-23T18:28:02.856414] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-09-23T18:28:02.856619] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-23T18:28:02.856815] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-23T18:28:02.856884] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-09-23T18:28:02.857036] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-23T18:28:03.056698] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-23T18:28:03.068804] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T18:28:03.307393] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:03.369451] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T18:28:03.402176] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-23T18:28:04.202198] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-23T18:28:04.880160] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:28:04.889009] [INFO ] [REMOTE ] DUK: Full fetch complete (77400 records). [2025-09-23T18:28:04.889199] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-23T18:28:05.007294] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-23T18:28:05.290290] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-23T18:28:05.290387] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-23T18:28:05.291305] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-23T18:28:05.291371] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-23T18:28:05.292975] [DEBUG] [LOCAL ] DUK: Trimmed 77400 records to 53460 (keeping 200 days of data) [2025-09-23T18:28:05.650342] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:28:05.686723] [DEBUG] [LOCAL ] DUK: Primary data saved (53460 records). [2025-09-23T18:28:05.686864] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-23T18:28:05.686940] [INFO ] [MAIN ] Update Progress: 666/2372 symbols completed. DUK took 33.1s. Estimated remaining: 3h 45m 31s. Rate: 7.6 symbols/min [2025-09-23T18:28:05.807250] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-23T18:28:05.860665] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:05.914234] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-23T18:28:05.914390] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-09-23T18:28:06.092077] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:06.092373] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-23T18:28:06.092421] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-23T18:28:06.093992] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-23T18:28:06.094051] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-23T18:28:06.452691] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:06.515210] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:28:06.602195] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-23T18:28:07.402211] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-23T18:28:07.594398] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T18:28:07.960627] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T18:28:07.962089] [INFO ] [REMOTE ] DUKB: Full fetch complete (9541 records). [2025-09-23T18:28:07.962162] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-23T18:28:08.214684] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-23T18:28:08.337911] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-23T18:28:08.338094] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-23T18:28:08.338347] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-23T18:28:08.338389] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-23T18:28:08.338881] [DEBUG] [LOCAL ] DUKB: Trimmed 9541 records to 6375 (keeping 200 days of data) [2025-09-23T18:28:08.382563] [DEBUG] [LOCAL ] DUKB: Primary data saved (6375 records). [2025-09-23T18:28:08.382731] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-23T18:28:08.382842] [INFO ] [MAIN ] Update Progress: 667/2372 symbols completed. DUKB took 32.7s. Estimated remaining: 3h 45m 10s. Rate: 7.6 symbols/min [2025-09-23T18:28:08.573103] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:08.639708] [DEBUG] [LOCAL ] DX: Loaded 52475 existing records from primary storage. [2025-09-23T18:28:08.639893] [INFO ] [MAIN ] DX: Loaded 52475 existing records. [2025-09-23T18:28:08.774954] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-23T18:28:08.867401] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:08.867741] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-23T18:28:08.867800] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-23T18:28:08.869343] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-23T18:28:08.869406] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-23T18:28:09.012960] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-23T18:28:09.242234] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:09.701861] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T18:28:09.802245] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-23T18:28:10.591070] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:28:10.602131] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-23T18:28:11.402211] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-23T18:28:11.701845] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T18:28:11.802269] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T18:28:12.202206] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-23T18:28:12.731924] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T18:28:13.002217] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-23T18:28:13.438358] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T18:28:13.802208] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-23T18:28:14.345023] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T18:28:14.602196] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-23T18:28:15.402210] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-23T18:28:15.587844] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T18:28:15.988488] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:28:16.202193] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-23T18:28:17.002173] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-23T18:28:17.040075] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T18:28:17.802240] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-23T18:28:17.848698] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:28:18.391993] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T18:28:18.400875] [INFO ] [REMOTE ] DV: Full fetch complete (73224 records). [2025-09-23T18:28:18.401028] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-23T18:28:18.607388] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-23T18:28:18.823856] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-23T18:28:18.823969] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-23T18:28:18.824911] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-23T18:28:18.824978] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-23T18:28:18.826721] [DEBUG] [LOCAL ] DV: Trimmed 73224 records to 51272 (keeping 200 days of data) [2025-09-23T18:28:19.149135] [DEBUG] [LOCAL ] DV: Primary data saved (51272 records). [2025-09-23T18:28:19.149301] [INFO ] [MAIN ] DV: Full history saved. [2025-09-23T18:28:19.149437] [INFO ] [MAIN ] Update Progress: 668/2372 symbols completed. DV took 26.8s. Estimated remaining: 3h 45m 9s. Rate: 7.6 symbols/min [2025-09-23T18:28:19.336765] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:19.396216] [DEBUG] [LOCAL ] DXC: Loaded 49606 existing records from primary storage. [2025-09-23T18:28:19.396432] [INFO ] [MAIN ] DXC: Loaded 49606 existing records. [2025-09-23T18:28:19.431027] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-23T18:28:19.605253] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:19.605874] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-23T18:28:19.605987] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-23T18:28:19.607372] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-23T18:28:19.607435] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-23T18:28:20.022540] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:20.024831] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-23T18:28:20.090285] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:28:20.202166] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-23T18:28:20.823922] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:28:21.002189] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-23T18:28:21.802222] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-23T18:28:22.275717] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:28:22.519295] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-23T18:28:22.602259] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-23T18:28:22.984749] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:28:23.402245] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-23T18:28:24.202229] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-23T18:28:24.353008] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:28:24.907469] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:28:25.002201] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-23T18:28:25.314373] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T18:28:25.802268] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-23T18:28:26.607623] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-23T18:28:26.632413] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T18:28:27.003427] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T18:28:27.014049] [INFO ] [REMOTE ] DVA: Full fetch complete (59719 records). [2025-09-23T18:28:27.014286] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-23T18:28:27.404688] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-23T18:28:27.432962] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-23T18:28:27.433070] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-23T18:28:27.434060] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-23T18:28:27.434221] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-23T18:28:27.437409] [DEBUG] [LOCAL ] DVA: Trimmed 59719 records to 41451 (keeping 200 days of data) [2025-09-23T18:28:27.704219] [DEBUG] [LOCAL ] DVA: Primary data saved (41451 records). [2025-09-23T18:28:27.704359] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-23T18:28:27.704495] [INFO ] [MAIN ] Update Progress: 669/2372 symbols completed. DVA took 25.0s. Estimated remaining: 3h 45m 3s. Rate: 7.6 symbols/min [2025-09-23T18:28:27.873052] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:27.918680] [DEBUG] [LOCAL ] DXYZ: Loaded 36760 existing records from primary storage. [2025-09-23T18:28:27.918837] [INFO ] [MAIN ] DXYZ: Loaded 36760 existing records. [2025-09-23T18:28:28.117972] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:28.118397] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-23T18:28:28.118461] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-23T18:28:28.119334] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-23T18:28:28.119415] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-23T18:28:28.203811] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-23T18:28:28.494598] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:28.559210] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-23T18:28:29.002199] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-23T18:28:29.037029] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T18:28:29.802191] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-23T18:28:29.882375] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T18:28:30.602240] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-23T18:28:30.928606] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T18:28:31.006056] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T18:28:31.402246] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-23T18:28:32.096677] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T18:28:32.202203] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-23T18:28:33.002242] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-23T18:28:33.609853] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T18:28:33.762236] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-23T18:28:33.802192] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-23T18:28:34.602216] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-23T18:28:34.639925] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T18:28:35.402274] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-23T18:28:35.792712] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T18:28:36.202164] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-23T18:28:36.302740] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T18:28:37.009686] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-23T18:28:37.039138] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:28:37.802193] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-23T18:28:37.834575] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T18:28:38.572175] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:28:38.602151] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-23T18:28:39.092146] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:28:39.402226] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-23T18:28:40.202193] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-23T18:28:40.658019] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T18:28:40.667752] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-23T18:28:40.667934] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-23T18:28:41.005931] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-23T18:28:41.098680] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-23T18:28:41.098895] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-23T18:28:41.100095] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-23T18:28:41.100195] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-23T18:28:41.102002] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 53699 (keeping 200 days of data) [2025-09-23T18:28:41.256893] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T18:28:41.488982] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-23T18:28:41.489126] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-23T18:28:41.489259] [INFO ] [MAIN ] Update Progress: 670/2372 symbols completed. DVN took 35.8s. Estimated remaining: 3h 45m 10s. Rate: 7.6 symbols/min [2025-09-23T18:28:41.669093] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:41.704329] [DEBUG] [LOCAL ] DY: Loaded 29922 existing records from primary storage. [2025-09-23T18:28:41.704482] [INFO ] [MAIN ] DY: Loaded 29922 existing records. [2025-09-23T18:28:41.805318] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-23T18:28:41.849832] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T18:28:41.945220] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:41.945515] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-23T18:28:41.945585] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-23T18:28:41.946476] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-23T18:28:41.946539] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-23T18:28:42.313208] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:42.602164] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-23T18:28:42.695592] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T18:28:43.402188] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-23T18:28:43.433077] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T18:28:43.947765] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:28:44.202229] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-23T18:28:45.002168] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-23T18:28:45.173586] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T18:28:45.802233] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-23T18:28:45.943343] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T18:28:45.953627] [INFO ] [REMOTE ] DX: Full fetch complete (75315 records). [2025-09-23T18:28:45.953835] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-23T18:28:46.364995] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-23T18:28:46.365115] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-23T18:28:46.365998] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-23T18:28:46.366063] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-23T18:28:46.368939] [DEBUG] [LOCAL ] DX: Trimmed 75315 records to 52482 (keeping 200 days of data) [2025-09-23T18:28:46.605190] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-23T18:28:46.699327] [DEBUG] [LOCAL ] DX: Primary data saved (52482 records). [2025-09-23T18:28:46.699473] [INFO ] [MAIN ] DX: Full history saved. [2025-09-23T18:28:46.699596] [INFO ] [MAIN ] Update Progress: 671/2372 symbols completed. DX took 38.3s. Estimated remaining: 3h 44m 55s. Rate: 7.6 symbols/min [2025-09-23T18:28:46.873564] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:46.909820] [DEBUG] [LOCAL ] E: Loaded 33511 existing records from primary storage. [2025-09-23T18:28:46.909978] [INFO ] [MAIN ] E: Loaded 33511 existing records. [2025-09-23T18:28:47.118919] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:47.121773] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-23T18:28:47.129850] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-23T18:28:47.130258] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-23T18:28:47.131769] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-23T18:28:47.131835] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-23T18:28:47.407354] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-23T18:28:47.446556] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T18:28:47.540784] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:47.584049] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:28:48.202225] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-23T18:28:48.959890] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T18:28:49.002155] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-23T18:28:49.787481] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T18:28:49.802151] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-23T18:28:50.602212] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-23T18:28:50.712042] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T18:28:50.768501] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:28:51.402194] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-23T18:28:51.943103] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:28:52.202205] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-23T18:28:52.447194] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:28:53.002261] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-23T18:28:53.638362] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:28:53.802202] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-23T18:28:54.475733] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:28:54.602190] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-23T18:28:55.402219] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-23T18:28:55.819744] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-23T18:28:55.844201] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58200 records). [2025-09-23T18:28:55.854763] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T18:28:55.853556] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-23T18:28:56.209125] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-23T18:28:56.269309] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-23T18:28:56.269395] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-23T18:28:56.270233] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-23T18:28:56.270334] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-23T18:28:56.271605] [DEBUG] [LOCAL ] DXYZ: Trimmed 58200 records to 36762 (keeping 200 days of data) [2025-09-23T18:28:56.491422] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36762 records). [2025-09-23T18:28:56.491566] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-23T18:28:56.491672] [INFO ] [MAIN ] Update Progress: 672/2372 symbols completed. DXYZ took 28.8s. Estimated remaining: 3h 44m 52s. Rate: 7.6 symbols/min [2025-09-23T18:28:56.659739] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:56.700443] [DEBUG] [LOCAL ] EAF: Loaded 43968 existing records from primary storage. [2025-09-23T18:28:56.700604] [INFO ] [MAIN ] EAF: Loaded 43968 existing records. [2025-09-23T18:28:56.883109] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:56.883550] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-23T18:28:56.883614] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-23T18:28:56.884733] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-23T18:28:56.884806] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-23T18:28:57.006893] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-23T18:28:57.019842] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T18:28:57.099724] [INFO ] [REMOTE ] DXC: Full fetch complete (68551 records). [2025-09-23T18:28:57.140115] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-23T18:28:57.420101] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:57.712634] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:28:57.736424] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-23T18:28:57.736621] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-23T18:28:57.737510] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-23T18:28:57.737591] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-23T18:28:57.739997] [DEBUG] [LOCAL ] DXC: Trimmed 68551 records to 49661 (keeping 200 days of data) [2025-09-23T18:28:57.803088] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-23T18:28:58.047375] [DEBUG] [LOCAL ] DXC: Primary data saved (49661 records). [2025-09-23T18:28:58.047527] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-23T18:28:58.047687] [INFO ] [MAIN ] Update Progress: 673/2372 symbols completed. DXC took 38.9s. Estimated remaining: 3h 44m 28s. Rate: 7.6 symbols/min [2025-09-23T18:28:58.218412] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:58.226227] [DEBUG] [LOCAL ] EAI: Loaded 3977 existing records from primary storage. [2025-09-23T18:28:58.226376] [INFO ] [MAIN ] EAI: Loaded 3977 existing records. [2025-09-23T18:28:58.417547] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:58.418134] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-23T18:28:58.418268] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-23T18:28:58.418571] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-23T18:28:58.418632] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-23T18:28:58.621479] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-23T18:28:58.632825] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T18:28:58.820444] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:59.260792] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T18:28:59.402188] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-23T18:28:59.808154] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T18:29:00.202196] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-23T18:29:00.642164] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T18:29:01.002231] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-23T18:29:01.625274] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:29:01.802223] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-23T18:29:02.513046] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T18:29:02.602206] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-23T18:29:02.985621] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:29:03.173088] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T18:29:03.402196] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-23T18:29:04.020626] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T18:29:04.202195] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-23T18:29:04.551046] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T18:29:05.002253] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-23T18:29:05.435142] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:29:05.802181] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-23T18:29:06.602212] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-23T18:29:07.390010] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T18:29:07.402152] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-23T18:29:07.587382] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T18:29:08.202203] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-23T18:29:08.956029] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T18:29:09.002232] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-23T18:29:09.125783] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T18:29:09.130976] [INFO ] [REMOTE ] E: Full fetch complete (48490 records). [2025-09-23T18:29:09.131088] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-23T18:29:09.558976] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-23T18:29:09.559067] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-23T18:29:09.559784] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-23T18:29:09.559848] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-23T18:29:09.560908] [DEBUG] [LOCAL ] E: Trimmed 48490 records to 33441 (keeping 200 days of data) [2025-09-23T18:29:09.787605] [DEBUG] [LOCAL ] E: Primary data saved (33441 records). [2025-09-23T18:29:09.787816] [INFO ] [MAIN ] E: Full history saved. [2025-09-23T18:29:09.787950] [INFO ] [MAIN ] Update Progress: 674/2372 symbols completed. E took 23.1s. Estimated remaining: 3h 44m 30s. Rate: 7.6 symbols/min [2025-09-23T18:29:09.812398] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-23T18:29:09.975218] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:10.006272] [DEBUG] [LOCAL ] EARN: Loaded 30462 existing records from primary storage. [2025-09-23T18:29:10.006445] [INFO ] [MAIN ] EARN: Loaded 30462 existing records. [2025-09-23T18:29:10.241257] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:29:10.241525] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-23T18:29:10.241624] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-23T18:29:10.242305] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-23T18:29:10.242365] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-23T18:29:10.386804] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T18:29:10.604266] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:10.604514] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-23T18:29:10.724957] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T18:29:11.001529] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T18:29:11.402211] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-23T18:29:11.756322] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-23T18:29:12.202250] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-23T18:29:13.002214] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-23T18:29:13.570771] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:29:13.802197] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-23T18:29:14.064006] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T18:29:14.602237] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-23T18:29:15.039453] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T18:29:15.402184] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-23T18:29:15.443461] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:29:16.202255] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-23T18:29:16.567512] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T18:29:16.638263] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T18:29:17.002216] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-23T18:29:17.802213] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-23T18:29:18.242047] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T18:29:18.602212] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-23T18:29:18.880446] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T18:29:19.402256] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-23T18:29:19.900854] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:29:20.202223] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-23T18:29:20.473314] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T18:29:20.481439] [INFO ] [REMOTE ] EAF: Full fetch complete (64893 records). [2025-09-23T18:29:20.481624] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-23T18:29:20.786192] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T18:29:20.798461] [INFO ] [REMOTE ] EAI: Full fetch complete (6143 records). [2025-09-23T18:29:20.808884] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-23T18:29:21.006511] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-23T18:29:21.011854] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-23T18:29:21.018015] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-23T18:29:21.023936] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-23T18:29:21.048569] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-23T18:29:21.085216] [DEBUG] [LOCAL ] EAF: Trimmed 64893 records to 43932 (keeping 200 days of data) [2025-09-23T18:29:21.353187] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-23T18:29:21.353872] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-23T18:29:21.354923] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-23T18:29:21.355253] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-23T18:29:21.356936] [DEBUG] [LOCAL ] EAI: Trimmed 6143 records to 3975 (keeping 200 days of data) [2025-09-23T18:29:21.384677] [DEBUG] [LOCAL ] EAI: Primary data saved (3975 records). [2025-09-23T18:29:21.388252] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-23T18:29:21.388630] [INFO ] [MAIN ] Update Progress: 675/2372 symbols completed. EAI took 23.3s. Estimated remaining: 3h 44m 31s. Rate: 7.6 symbols/min [2025-09-23T18:29:21.572817] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:21.574010] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-09-23T18:29:21.574398] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-09-23T18:29:21.574909] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-23T18:29:21.576304] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-23T18:29:21.577522] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-23T18:29:21.578126] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-23T18:29:21.806679] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-23T18:29:22.094205] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:22.130164] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T18:29:22.173885] [DEBUG] [LOCAL ] EAF: Primary data saved (43932 records). [2025-09-23T18:29:22.174039] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-23T18:29:22.174157] [INFO ] [MAIN ] Update Progress: 676/2372 symbols completed. EAF took 25.7s. Estimated remaining: 3h 44m 5s. Rate: 7.6 symbols/min [2025-09-23T18:29:22.345284] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:22.381568] [DEBUG] [LOCAL ] EB: Loaded 37957 existing records from primary storage. [2025-09-23T18:29:22.381763] [INFO ] [MAIN ] EB: Loaded 37957 existing records. [2025-09-23T18:29:22.561857] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:29:22.562129] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-23T18:29:22.562177] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-23T18:29:22.563020] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-23T18:29:22.563082] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-23T18:29:22.608325] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-23T18:29:22.941063] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:22.967256] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:29:23.402261] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-23T18:29:24.175589] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T18:29:24.202169] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-23T18:29:24.940756] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T18:29:25.002234] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-23T18:29:25.749136] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T18:29:25.802161] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-23T18:29:26.135486] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T18:29:26.140759] [INFO ] [REMOTE ] DY: Full fetch complete (44968 records). [2025-09-23T18:29:26.140863] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-23T18:29:26.550944] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-23T18:29:26.551022] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-23T18:29:26.551624] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-23T18:29:26.551697] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-23T18:29:26.552620] [DEBUG] [LOCAL ] DY: Trimmed 44968 records to 29868 (keeping 200 days of data) [2025-09-23T18:29:26.607280] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-23T18:29:26.743256] [DEBUG] [LOCAL ] DY: Primary data saved (29868 records). [2025-09-23T18:29:26.743397] [INFO ] [MAIN ] DY: Full history saved. [2025-09-23T18:29:26.743485] [INFO ] [MAIN ] Update Progress: 677/2372 symbols completed. DY took 45.3s. Estimated remaining: 3h 43m 49s. Rate: 7.6 symbols/min [2025-09-23T18:29:27.402168] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-23T18:29:27.498133] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T18:29:28.202261] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-23T18:29:28.428523] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T18:29:28.542877] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T18:29:29.002251] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-23T18:29:29.209057] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T18:29:29.802203] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-23T18:29:30.092274] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:29:30.601669] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T18:29:30.606719] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-23T18:29:31.402210] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-23T18:29:32.202216] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-23T18:29:32.233947] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T18:29:32.433230] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T18:29:33.002194] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-23T18:29:33.797768] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T18:29:33.805156] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-23T18:29:33.855764] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T18:29:34.602194] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-23T18:29:35.333453] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T18:29:35.402227] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-23T18:29:35.838332] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T18:29:36.196821] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T18:29:36.201183] [INFO ] [REMOTE ] EARN: Full fetch complete (46505 records). [2025-09-23T18:29:36.201332] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-23T18:29:36.207426] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-23T18:29:36.614311] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-23T18:29:36.614399] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-23T18:29:36.615101] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-23T18:29:36.615167] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-23T18:29:36.616232] [DEBUG] [LOCAL ] EARN: Trimmed 46505 records to 30366 (keeping 200 days of data) [2025-09-23T18:29:36.790500] [DEBUG] [LOCAL ] EARN: Primary data saved (30366 records). [2025-09-23T18:29:36.790638] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-23T18:29:36.790771] [INFO ] [MAIN ] Update Progress: 678/2372 symbols completed. EARN took 27.0s. Estimated remaining: 3h 43m 46s. Rate: 7.6 symbols/min [2025-09-23T18:29:37.002215] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-23T18:29:37.744327] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:29:37.802254] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-23T18:29:38.473441] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:29:38.602200] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-23T18:29:39.186483] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T18:29:39.402180] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-23T18:29:40.091195] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T18:29:40.202231] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-23T18:29:40.456057] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:29:41.002204] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-23T18:29:41.514302] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T18:29:41.802254] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-23T18:29:42.060138] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:29:42.602202] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-23T18:29:43.496055] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T18:29:43.507089] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-23T18:29:43.675185] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T18:29:44.202215] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-23T18:29:44.872339] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:29:45.002253] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-23T18:29:45.150976] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:29:45.158104] [INFO ] [REMOTE ] EB: Full fetch complete (57006 records). [2025-09-23T18:29:45.158316] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-23T18:29:45.782340] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-23T18:29:45.782467] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-23T18:29:45.783760] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-23T18:29:45.783846] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-23T18:29:45.785690] [DEBUG] [LOCAL ] EB: Trimmed 57006 records to 37872 (keeping 200 days of data) [2025-09-23T18:29:46.089918] [DEBUG] [LOCAL ] EB: Primary data saved (37872 records). [2025-09-23T18:29:46.090127] [INFO ] [MAIN ] EB: Full history saved. [2025-09-23T18:29:46.090237] [INFO ] [MAIN ] Update Progress: 679/2372 symbols completed. EB took 23.9s. Estimated remaining: 3h 43m 41s. Rate: 7.6 symbols/min [2025-09-23T18:29:46.703195] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T18:29:46.712473] [INFO ] [REMOTE ] EAT: Full fetch complete (71389 records). [2025-09-23T18:29:46.712674] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-23T18:29:46.713639] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:29:46.713762] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:29:46.713811] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:29:46.713855] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-23T18:29:46.713950] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-23T18:29:46.713997] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-09-23T18:29:46.714056] [DEBUG] [LOCAL ] EAT: No derivative data file found to delete. [2025-09-23T18:29:46.714142] [INFO ] [MAIN ] Update Progress: 680/2372 symbols completed. EAT took 25.3s. Estimated remaining: 3h 43m 15s. Rate: 7.6 symbols/min [2025-09-23T18:29:47.330865] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:47.476138] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:47.476454] [DEBUG] [LOCAL ] EBR: No existing data file found in primary storage. [2025-09-23T18:29:47.471150] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:47.476595] [WARN ] [MAIN ] EBR: No existing data found, performing full refresh instead. [2025-09-23T18:29:47.474880] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:47.476934] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-23T18:29:47.477305] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-23T18:29:47.477683] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-09-23T18:29:47.477807] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-23T18:29:47.477876] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-09-23T18:29:47.478198] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-23T18:29:47.478284] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-23T18:29:47.478369] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-23T18:29:47.478540] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-09-23T18:29:47.478749] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-23T18:29:47.847736] [DEBUG] [LOCAL ] EBF: Loaded 19545 existing records from primary storage. [2025-09-23T18:29:47.919406] [INFO ] [MAIN ] EBF: Loaded 19545 existing records. [2025-09-23T18:29:48.035875] [DEBUG] [LOCAL ] EC: Loaded 49397 existing records from primary storage. [2025-09-23T18:29:48.138562] [INFO ] [MAIN ] EC: Loaded 49397 existing records. [2025-09-23T18:29:48.381134] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:48.408227] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-23T18:29:48.578740] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:48.629977] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-23T18:29:48.630175] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:29:48.649068] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-23T18:29:48.668963] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-23T18:29:48.676530] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:29:48.676829] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-23T18:29:48.676884] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-23T18:29:48.676976] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-23T18:29:48.677058] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-23T18:29:48.712726] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-23T18:29:48.740335] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-23T18:29:49.396569] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:49.405228] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-23T18:29:49.433987] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:49.434300] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-23T18:29:49.890410] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T18:29:49.900342] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-23T18:29:50.139909] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T18:29:50.143607] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-23T18:29:50.265262] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:29:50.602203] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-23T18:29:50.793858] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T18:29:50.933585] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:29:51.048731] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T18:29:51.402255] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-23T18:29:52.137733] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T18:29:52.202195] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-23T18:29:52.233536] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T18:29:53.002205] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-23T18:29:53.689766] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T18:29:53.765771] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T18:29:53.802225] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-23T18:29:54.602209] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-23T18:29:54.942554] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:29:55.402232] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-23T18:29:56.188973] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T18:29:56.202141] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-23T18:29:56.708464] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:29:57.002207] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-23T18:29:57.484193] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T18:29:57.802205] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-23T18:29:58.282080] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:29:58.602199] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-23T18:29:59.153246] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T18:29:59.402223] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-23T18:29:59.674624] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T18:30:00.202193] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-23T18:30:00.279438] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T18:30:01.002207] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-23T18:30:01.802280] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-23T18:30:02.364768] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T18:30:02.602238] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-23T18:30:03.402298] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-23T18:30:03.438116] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-23T18:30:04.202218] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-23T18:30:05.069835] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-09-23T18:30:05.074267] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-23T18:30:06.438604] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-09-23T18:30:06.447636] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-23T18:30:07.034364] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T18:30:07.039461] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-23T18:30:07.628982] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (5.03 seconds). [2025-09-23T18:30:07.639979] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-23T18:30:07.729078] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (3.53 seconds). [2025-09-23T18:30:07.801506] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T18:30:07.845893] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:30:08.202200] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-23T18:30:08.848288] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T18:30:09.002184] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-23T18:30:09.460848] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T18:30:09.802209] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-23T18:30:10.381259] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:30:10.602222] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-23T18:30:11.024268] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T18:30:11.293113] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T18:30:11.402233] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-23T18:30:12.202212] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-23T18:30:13.002201] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-23T18:30:13.756130] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-23T18:30:13.759489] [INFO ] [REMOTE ] EBF: Full fetch complete (27400 records). [2025-09-23T18:30:13.759612] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-23T18:30:13.825709] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-23T18:30:14.139375] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-23T18:30:14.139470] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-23T18:30:14.139951] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-23T18:30:14.140013] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-23T18:30:14.140892] [DEBUG] [LOCAL ] EBF: Trimmed 27400 records to 19531 (keeping 200 days of data) [2025-09-23T18:30:14.260371] [DEBUG] [LOCAL ] EBF: Primary data saved (19531 records). [2025-09-23T18:30:14.260566] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-23T18:30:14.260695] [INFO ] [MAIN ] Update Progress: 681/2372 symbols completed. EBF took 27.5s. Estimated remaining: 3h 43m 56s. Rate: 7.6 symbols/min [2025-09-23T18:30:14.438272] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:14.469554] [DEBUG] [LOCAL ] ECAT: Loaded 29793 existing records from primary storage. [2025-09-23T18:30:14.469804] [INFO ] [MAIN ] ECAT: Loaded 29793 existing records. [2025-09-23T18:30:14.615118] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-23T18:30:14.677536] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-23T18:30:14.702303] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:30:14.702614] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-23T18:30:14.702699] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-23T18:30:14.703778] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-23T18:30:14.703844] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-23T18:30:15.081942] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:15.402179] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-23T18:30:15.568458] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-23T18:30:15.576462] [INFO ] [REMOTE ] EBR: Full fetch complete (62800 records). [2025-09-23T18:30:15.576720] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-23T18:30:15.963964] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-23T18:30:15.964059] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-23T18:30:15.964823] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-23T18:30:15.964887] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-23T18:30:15.966311] [DEBUG] [LOCAL ] EBR: Trimmed 62800 records to 43083 (keeping 200 days of data) [2025-09-23T18:30:16.219048] [DEBUG] [LOCAL ] EBR: Primary data saved (43083 records). [2025-09-23T18:30:16.219184] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-23T18:30:16.219262] [INFO ] [MAIN ] Update Progress: 682/2372 symbols completed. EBR took 29.5s. Estimated remaining: 3h 43m 33s. Rate: 7.6 symbols/min [2025-09-23T18:30:16.393203] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:16.393459] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-09-23T18:30:16.393540] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-09-23T18:30:16.393780] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-23T18:30:16.393858] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-23T18:30:16.393949] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-09-23T18:30:16.394026] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-23T18:30:16.783095] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:16.783853] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-23T18:30:16.827608] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T18:30:16.848428] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T18:30:16.907027] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-09-23T18:30:17.002183] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-23T18:30:17.802197] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-23T18:30:18.171058] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:30:18.442818] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T18:30:18.450279] [INFO ] [REMOTE ] EBS: Full fetch complete (67383 records). [2025-09-23T18:30:18.450398] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-23T18:30:18.629570] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-23T18:30:18.856699] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-23T18:30:18.856809] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-23T18:30:18.858082] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-23T18:30:18.858148] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-23T18:30:18.861614] [DEBUG] [LOCAL ] EBS: Trimmed 67383 records to 46807 (keeping 200 days of data) [2025-09-23T18:30:19.072811] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:30:19.154215] [DEBUG] [LOCAL ] EBS: Primary data saved (46807 records). [2025-09-23T18:30:19.154371] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-23T18:30:19.154459] [INFO ] [MAIN ] Update Progress: 683/2372 symbols completed. EBS took 32.4s. Estimated remaining: 3h 43m 13s. Rate: 7.6 symbols/min [2025-09-23T18:30:19.322919] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:19.323094] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-23T18:30:19.323149] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-23T18:30:19.323302] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-23T18:30:19.323348] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-23T18:30:19.323388] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-23T18:30:19.323420] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-23T18:30:19.407450] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-23T18:30:19.686271] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:20.202249] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-23T18:30:20.392009] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T18:30:20.861514] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T18:30:21.002202] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-23T18:30:21.187053] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T18:30:21.802254] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-23T18:30:22.074173] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T18:30:22.602248] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-23T18:30:23.043327] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T18:30:23.070420] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T18:30:23.078353] [INFO ] [REMOTE ] EC: Full fetch complete (71988 records). [2025-09-23T18:30:23.078509] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-23T18:30:23.407463] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-23T18:30:23.511899] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-23T18:30:23.511989] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-23T18:30:23.512855] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-23T18:30:23.512964] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-23T18:30:23.516516] [DEBUG] [LOCAL ] EC: Trimmed 71988 records to 49369 (keeping 200 days of data) [2025-09-23T18:30:23.805200] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T18:30:23.817305] [DEBUG] [LOCAL ] EC: Primary data saved (49369 records). [2025-09-23T18:30:23.817470] [INFO ] [MAIN ] EC: Full history saved. [2025-09-23T18:30:23.817602] [INFO ] [MAIN ] Update Progress: 684/2372 symbols completed. EC took 37.1s. Estimated remaining: 3h 42m 57s. Rate: 7.6 symbols/min [2025-09-23T18:30:24.005823] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:24.006245] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-23T18:30:24.006302] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-23T18:30:24.006572] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-23T18:30:24.006663] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-23T18:30:24.006733] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-23T18:30:24.006778] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-23T18:30:24.209593] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-23T18:30:24.380384] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:25.002224] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-23T18:30:25.802208] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-23T18:30:25.815776] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T18:30:26.602194] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-23T18:30:26.928006] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T18:30:26.982507] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-23T18:30:27.402345] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-23T18:30:28.017754] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T18:30:28.044582] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:30:28.202153] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-23T18:30:28.556311] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T18:30:29.002195] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-23T18:30:29.336598] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T18:30:29.802269] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-23T18:30:30.144287] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T18:30:30.602199] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-23T18:30:31.402193] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-23T18:30:31.533120] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T18:30:32.202186] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-23T18:30:32.776929] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T18:30:32.814216] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T18:30:33.002223] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-23T18:30:33.354251] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T18:30:33.802197] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-23T18:30:34.252814] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T18:30:34.602205] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-23T18:30:35.402191] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-23T18:30:36.202169] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-23T18:30:36.231235] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T18:30:36.292046] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T18:30:36.588866] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-23T18:30:37.002199] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-23T18:30:37.802206] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-23T18:30:38.043908] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:30:38.602250] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-23T18:30:39.070908] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T18:30:39.135584] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T18:30:39.402242] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-23T18:30:39.687941] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-23T18:30:40.202211] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-23T18:30:41.002220] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-23T18:30:41.371996] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T18:30:41.722508] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T18:30:41.802177] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-23T18:30:42.602195] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-23T18:30:42.664820] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T18:30:43.402196] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-23T18:30:43.813742] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-23T18:30:43.814710] [INFO ] [REMOTE ] ECCU: Full fetch complete (4415 records). [2025-09-23T18:30:43.814783] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-23T18:30:44.024860] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-23T18:30:44.025285] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:30:44.025466] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:30:44.025548] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-23T18:30:44.025693] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-23T18:30:44.025750] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-23T18:30:44.025809] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-23T18:30:44.025964] [INFO ] [MAIN ] Update Progress: 685/2372 symbols completed. ECCU took 20.2s. Estimated remaining: 3h 43m 19s. Rate: 7.6 symbols/min [2025-09-23T18:30:44.200398] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:44.200774] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-23T18:30:44.200846] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-23T18:30:44.201148] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-23T18:30:44.201216] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-23T18:30:44.201372] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-23T18:30:44.201482] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-23T18:30:44.206852] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-23T18:30:44.359282] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T18:30:44.640915] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:45.002221] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-23T18:30:45.627605] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:30:45.634336] [INFO ] [REMOTE ] ECAT: Full fetch complete (42519 records). [2025-09-23T18:30:45.634521] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-23T18:30:45.802810] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-23T18:30:46.029511] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-23T18:30:46.029624] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-23T18:30:46.031202] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-23T18:30:46.031318] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-23T18:30:46.035972] [DEBUG] [LOCAL ] ECAT: Trimmed 42519 records to 29687 (keeping 200 days of data) [2025-09-23T18:30:46.239052] [DEBUG] [LOCAL ] ECAT: Primary data saved (29687 records). [2025-09-23T18:30:46.239197] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-23T18:30:46.239316] [INFO ] [MAIN ] Update Progress: 686/2372 symbols completed. ECAT took 32.0s. Estimated remaining: 3h 42m 57s. Rate: 7.6 symbols/min [2025-09-23T18:30:46.356463] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T18:30:46.427993] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:46.429530] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-23T18:30:46.429592] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-23T18:30:46.429831] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-23T18:30:46.429885] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-23T18:30:46.429930] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-23T18:30:46.429985] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-23T18:30:46.586387] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T18:30:46.614438] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-23T18:30:46.870401] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:46.943288] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T18:30:47.402184] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-23T18:30:47.793329] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T18:30:48.202226] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-23T18:30:49.002207] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-23T18:30:49.318548] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T18:30:49.700713] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T18:30:49.708319] [INFO ] [REMOTE ] ECC: Full fetch complete (61022 records). [2025-09-23T18:30:49.708425] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-23T18:30:49.807384] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-23T18:30:50.095152] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-23T18:30:50.095285] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-23T18:30:50.096044] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-23T18:30:50.096105] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-23T18:30:50.097465] [DEBUG] [LOCAL ] ECC: Trimmed 61022 records to 43440 (keeping 200 days of data) [2025-09-23T18:30:50.169937] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T18:30:50.365162] [DEBUG] [LOCAL ] ECC: Primary data saved (43440 records). [2025-09-23T18:30:50.365309] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-23T18:30:50.365450] [INFO ] [MAIN ] Update Progress: 687/2372 symbols completed. ECC took 34.1s. Estimated remaining: 3h 42m 40s. Rate: 7.6 symbols/min [2025-09-23T18:30:50.531447] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:50.568323] [DEBUG] [LOCAL ] ECG: Loaded 34377 existing records from primary storage. [2025-09-23T18:30:50.568489] [INFO ] [MAIN ] ECG: Loaded 34377 existing records. [2025-09-23T18:30:50.607324] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-23T18:30:50.761924] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:30:50.762314] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-23T18:30:50.762386] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-23T18:30:50.763530] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-23T18:30:50.763830] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-23T18:30:51.126441] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:51.277801] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T18:30:51.402218] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-23T18:30:51.732186] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T18:30:52.202246] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-23T18:30:52.538608] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-23T18:30:53.002205] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-23T18:30:53.337516] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T18:30:53.802214] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-23T18:30:54.602188] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-23T18:30:54.973762] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T18:30:55.007075] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T18:30:55.007841] [INFO ] [REMOTE ] ECCC: Full fetch complete (1286 records). [2025-09-23T18:30:55.007922] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-23T18:30:55.201234] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-23T18:30:55.201698] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:30:55.201780] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:30:55.201855] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-23T18:30:55.201929] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-23T18:30:55.201997] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-23T18:30:55.202068] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-23T18:30:55.202172] [INFO ] [MAIN ] Update Progress: 688/2372 symbols completed. ECCC took 36.0s. Estimated remaining: 3h 42m 25s. Rate: 7.6 symbols/min [2025-09-23T18:30:55.376035] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:55.402214] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-23T18:30:55.462055] [DEBUG] [LOCAL ] ECL: Loaded 46762 existing records from primary storage. [2025-09-23T18:30:55.462247] [INFO ] [MAIN ] ECL: Loaded 46762 existing records. [2025-09-23T18:30:55.684043] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:30:55.684312] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-23T18:30:55.684361] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-23T18:30:55.685985] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-23T18:30:55.686047] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-23T18:30:55.799476] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T18:30:56.081881] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:56.202206] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-23T18:30:56.853232] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T18:30:57.002242] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-23T18:30:57.730278] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T18:30:57.802217] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-23T18:30:58.602254] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-23T18:30:58.936615] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T18:30:59.231958] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T18:30:59.402195] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-23T18:31:00.202194] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-23T18:31:01.002191] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-23T18:31:01.261873] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T18:31:01.318510] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T18:31:01.697489] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T18:31:01.802193] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-23T18:31:02.602207] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-23T18:31:03.402223] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-23T18:31:03.583436] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-23T18:31:03.702090] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T18:31:03.747688] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T18:31:04.202327] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-23T18:31:05.002223] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-23T18:31:05.356271] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T18:31:05.802180] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-23T18:31:05.902821] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:31:06.173816] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T18:31:06.602192] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-23T18:31:07.005070] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T18:31:07.402184] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-23T18:31:08.202247] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-23T18:31:08.782396] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T18:31:08.783337] [INFO ] [REMOTE ] ECCW: Full fetch complete (1421 records). [2025-09-23T18:31:08.783413] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-23T18:31:08.976696] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-23T18:31:08.976980] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:31:08.977094] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:31:08.977235] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-23T18:31:08.977374] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-23T18:31:08.977468] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-23T18:31:08.977605] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-23T18:31:08.977722] [INFO ] [MAIN ] Update Progress: 689/2372 symbols completed. ECCW took 25.0s. Estimated remaining: 3h 42m 31s. Rate: 7.6 symbols/min [2025-09-23T18:31:09.003226] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-23T18:31:09.125634] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T18:31:09.207826] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:09.230864] [DEBUG] [LOCAL ] ECO: Loaded 18495 existing records from primary storage. [2025-09-23T18:31:09.231012] [INFO ] [MAIN ] ECO: Loaded 18495 existing records. [2025-09-23T18:31:09.381037] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T18:31:09.416279] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:09.416525] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-23T18:31:09.416573] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-23T18:31:09.417503] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-23T18:31:09.417563] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-23T18:31:09.766978] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:09.802165] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-23T18:31:10.602256] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-23T18:31:10.903327] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T18:31:11.049216] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T18:31:11.402293] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-23T18:31:12.202200] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-23T18:31:12.576393] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:31:13.002234] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-23T18:31:13.244130] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-23T18:31:13.802179] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-23T18:31:14.134800] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:31:14.602209] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-23T18:31:14.877332] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T18:31:15.402186] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-23T18:31:15.901619] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:31:16.202241] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-23T18:31:16.309828] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T18:31:17.002217] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-23T18:31:17.182585] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:31:17.547769] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T18:31:17.548707] [INFO ] [REMOTE ] ECCX: Full fetch complete (1490 records). [2025-09-23T18:31:17.548778] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-23T18:31:17.728575] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-23T18:31:17.728793] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:31:17.728862] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:31:17.728935] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-23T18:31:17.728997] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-23T18:31:17.729033] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-23T18:31:17.729077] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-23T18:31:17.729152] [INFO ] [MAIN ] Update Progress: 690/2372 symbols completed. ECCX took 31.5s. Estimated remaining: 3h 42m 25s. Rate: 7.6 symbols/min [2025-09-23T18:31:17.807331] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-23T18:31:17.964529] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:18.016662] [DEBUG] [LOCAL ] ECVT: Loaded 43080 existing records from primary storage. [2025-09-23T18:31:18.016840] [INFO ] [MAIN ] ECVT: Loaded 43080 existing records. [2025-09-23T18:31:18.208881] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:18.209127] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-23T18:31:18.209175] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-23T18:31:18.210328] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-23T18:31:18.210393] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-23T18:31:18.587316] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:18.602165] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-23T18:31:18.899274] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T18:31:19.402221] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-23T18:31:19.784847] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T18:31:20.202258] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-23T18:31:20.257286] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T18:31:21.002236] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-23T18:31:21.569850] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:31:21.802251] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-23T18:31:22.185557] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:31:22.602217] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-23T18:31:23.136147] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T18:31:23.402208] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-23T18:31:23.638108] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:31:24.202261] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-23T18:31:24.897746] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T18:31:25.002217] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-23T18:31:25.354764] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T18:31:25.802213] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-23T18:31:26.316812] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:31:26.602236] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-23T18:31:27.056149] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T18:31:27.402240] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-23T18:31:27.785958] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T18:31:28.202213] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-23T18:31:28.675352] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T18:31:28.680531] [INFO ] [REMOTE ] ECG: Full fetch complete (51564 records). [2025-09-23T18:31:28.680663] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-23T18:31:29.007311] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-23T18:31:29.109144] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-23T18:31:29.109244] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-23T18:31:29.109925] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-23T18:31:29.109988] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-23T18:31:29.111178] [DEBUG] [LOCAL ] ECG: Trimmed 51564 records to 34265 (keeping 200 days of data) [2025-09-23T18:31:29.328115] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:31:29.361359] [DEBUG] [LOCAL ] ECG: Primary data saved (34265 records). [2025-09-23T18:31:29.361521] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-23T18:31:29.361619] [INFO ] [MAIN ] Update Progress: 691/2372 symbols completed. ECG took 39.0s. Estimated remaining: 3h 42m 26s. Rate: 7.6 symbols/min [2025-09-23T18:31:29.545683] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:29.609138] [DEBUG] [LOCAL ] ED: Loaded 52808 existing records from primary storage. [2025-09-23T18:31:29.609302] [INFO ] [MAIN ] ED: Loaded 52808 existing records. [2025-09-23T18:31:29.801815] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:29.802086] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-23T18:31:29.802134] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-23T18:31:29.802221] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-23T18:31:29.804238] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-23T18:31:29.804320] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-23T18:31:30.176361] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:31:30.214539] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:30.602255] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-23T18:31:31.123679] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:31:31.131243] [INFO ] [REMOTE ] ECL: Full fetch complete (67255 records). [2025-09-23T18:31:31.131384] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-23T18:31:31.132201] [FATAL] [VALIDATOR ] ECL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:31:31.132310] [FATAL] [MAIN ] ECL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:31:31.132363] [WARN ] [MAIN ] ECL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:31:31.132442] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-23T18:31:31.132517] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-23T18:31:31.132553] [INFO ] [LOCAL ] ECL: Starting deletion of derivative data. [2025-09-23T18:31:31.133035] [DEBUG] [LOCAL ] ECL: Deleted derivative data file. [2025-09-23T18:31:31.133132] [INFO ] [MAIN ] Update Progress: 692/2372 symbols completed. ECL took 35.9s. Estimated remaining: 3h 42m 3s. Rate: 7.6 symbols/min [2025-09-23T18:31:31.315766] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:31.315993] [DEBUG] [LOCAL ] EDD: No existing data file found in primary storage. [2025-09-23T18:31:31.316063] [WARN ] [MAIN ] EDD: No existing data found, performing full refresh instead. [2025-09-23T18:31:31.316219] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-23T18:31:31.316263] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-23T18:31:31.316306] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-09-23T18:31:31.316338] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-23T18:31:31.407396] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-23T18:31:31.702988] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:32.122251] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:31:32.202173] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-23T18:31:32.665885] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T18:31:33.002205] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-23T18:31:33.802166] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-23T18:31:34.009015] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T18:31:34.178923] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:31:34.602213] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-23T18:31:34.711016] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T18:31:35.402199] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-23T18:31:35.988442] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:31:36.202167] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-23T18:31:36.543091] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T18:31:37.002229] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-23T18:31:37.645492] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:31:37.802191] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-23T18:31:38.578446] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T18:31:38.602161] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-23T18:31:39.293254] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T18:31:39.402201] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-23T18:31:39.849032] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:31:39.856766] [INFO ] [REMOTE ] ECVT: Full fetch complete (59884 records). [2025-09-23T18:31:39.856921] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-23T18:31:40.211741] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-23T18:31:40.267604] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-23T18:31:40.281715] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-23T18:31:40.282615] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-23T18:31:40.283859] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:31:40.283925] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-23T18:31:40.290819] [DEBUG] [LOCAL ] ECVT: Trimmed 59884 records to 43046 (keeping 200 days of data) [2025-09-23T18:31:40.541805] [DEBUG] [LOCAL ] ECVT: Primary data saved (43046 records). [2025-09-23T18:31:40.541957] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-23T18:31:40.542044] [INFO ] [MAIN ] Update Progress: 693/2372 symbols completed. ECVT took 22.8s. Estimated remaining: 3h 41m 59s. Rate: 7.6 symbols/min [2025-09-23T18:31:40.717261] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:40.717463] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-09-23T18:31:40.717517] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-09-23T18:31:40.717695] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-23T18:31:40.717745] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-23T18:31:40.717787] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-09-23T18:31:40.717833] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-23T18:31:41.007722] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-23T18:31:41.091168] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:41.754509] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:31:41.802209] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-23T18:31:42.211048] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T18:31:42.602237] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-23T18:31:42.628091] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T18:31:43.402201] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-23T18:31:44.058606] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T18:31:44.202182] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-23T18:31:44.501346] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T18:31:45.005876] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-23T18:31:45.010311] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T18:31:45.802205] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-23T18:31:46.393734] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T18:31:46.602200] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-23T18:31:46.843717] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T18:31:47.402202] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-23T18:31:47.592236] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T18:31:48.202215] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-23T18:31:48.762571] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T18:31:49.002226] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-23T18:31:49.282996] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T18:31:49.637339] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T18:31:49.802261] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-23T18:31:50.602199] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-23T18:31:51.402211] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-23T18:31:51.475594] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T18:31:51.691215] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T18:31:52.202259] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-23T18:31:52.333767] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T18:31:52.337321] [INFO ] [REMOTE ] ECO: Full fetch complete (29434 records). [2025-09-23T18:31:52.337401] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-23T18:31:52.704423] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-23T18:31:52.704506] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-23T18:31:52.705170] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-23T18:31:52.705250] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-23T18:31:52.706601] [DEBUG] [LOCAL ] ECO: Trimmed 29434 records to 18531 (keeping 200 days of data) [2025-09-23T18:31:52.833079] [DEBUG] [LOCAL ] ECO: Primary data saved (18531 records). [2025-09-23T18:31:52.833229] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-23T18:31:52.833316] [INFO ] [MAIN ] Update Progress: 694/2372 symbols completed. ECO took 43.9s. Estimated remaining: 3h 42m 2s. Rate: 7.6 symbols/min [2025-09-23T18:31:53.004896] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:53.003289] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-23T18:31:53.025919] [DEBUG] [LOCAL ] EDN: Loaded 18016 existing records from primary storage. [2025-09-23T18:31:53.026041] [INFO ] [MAIN ] EDN: Loaded 18016 existing records. [2025-09-23T18:31:53.220772] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:53.226329] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T18:31:53.226541] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-23T18:31:53.230575] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-23T18:31:53.231639] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-23T18:31:53.231729] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-23T18:31:53.584127] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:53.802166] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-23T18:31:54.444162] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T18:31:54.452916] [INFO ] [REMOTE ] ED: Full fetch complete (76374 records). [2025-09-23T18:31:54.453065] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-23T18:31:54.608011] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-23T18:31:54.877179] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-23T18:31:54.877288] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-23T18:31:54.878211] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-23T18:31:54.878331] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-23T18:31:54.880067] [DEBUG] [LOCAL ] ED: Trimmed 76374 records to 52803 (keeping 200 days of data) [2025-09-23T18:31:54.989300] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:31:55.235756] [DEBUG] [LOCAL ] ED: Primary data saved (52803 records). [2025-09-23T18:31:55.235901] [INFO ] [MAIN ] ED: Full history saved. [2025-09-23T18:31:55.238974] [INFO ] [MAIN ] Update Progress: 695/2372 symbols completed. ED took 25.9s. Estimated remaining: 3h 41m 40s. Rate: 7.6 symbols/min [2025-09-23T18:31:55.408505] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:55.406958] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-23T18:31:55.457119] [DEBUG] [LOCAL ] EDU: Loaded 45124 existing records from primary storage. [2025-09-23T18:31:55.457291] [INFO ] [MAIN ] EDU: Loaded 45124 existing records. [2025-09-23T18:31:55.660364] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:55.660685] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-23T18:31:55.660745] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-23T18:31:55.661962] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-23T18:31:55.662030] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-23T18:31:56.020914] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:31:56.086116] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:56.202213] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-23T18:31:56.499676] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:31:56.785528] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T18:31:57.002197] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-23T18:31:57.781631] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T18:31:57.802155] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-23T18:31:58.602237] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-23T18:31:58.885106] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T18:31:59.402213] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-23T18:31:59.545483] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T18:32:00.202240] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-23T18:32:00.527446] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:32:01.002208] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-23T18:32:01.749462] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T18:32:01.802200] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-23T18:32:01.906581] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T18:32:02.454407] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:32:02.602205] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-23T18:32:03.402196] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-23T18:32:04.202200] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-23T18:32:04.337704] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T18:32:04.413426] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T18:32:05.002209] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-23T18:32:05.219776] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:32:05.802311] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-23T18:32:06.062353] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:32:06.602199] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-23T18:32:07.105322] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T18:32:07.402172] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-23T18:32:07.789772] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-23T18:32:08.045781] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:32:08.048549] [INFO ] [REMOTE ] EDF: Full fetch complete (21094 records). [2025-09-23T18:32:08.048633] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-23T18:32:08.205687] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-23T18:32:08.415011] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-23T18:32:08.415112] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-23T18:32:08.415512] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-23T18:32:08.415550] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-23T18:32:08.416131] [DEBUG] [LOCAL ] EDF: Trimmed 21094 records to 13537 (keeping 200 days of data) [2025-09-23T18:32:08.495105] [DEBUG] [LOCAL ] EDF: Primary data saved (13537 records). [2025-09-23T18:32:08.495240] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-23T18:32:08.495314] [INFO ] [MAIN ] Update Progress: 696/2372 symbols completed. EDF took 28.0s. Estimated remaining: 3h 41m 45s. Rate: 7.6 symbols/min [2025-09-23T18:32:08.665424] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:08.696879] [DEBUG] [LOCAL ] EE: Loaded 32535 existing records from primary storage. [2025-09-23T18:32:08.697023] [INFO ] [MAIN ] EE: Loaded 32535 existing records. [2025-09-23T18:32:08.873112] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:08.873368] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-23T18:32:08.873416] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-23T18:32:08.874389] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-23T18:32:08.874451] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-23T18:32:09.011327] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-23T18:32:09.228787] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:09.624550] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:32:09.629623] [INFO ] [REMOTE ] EDD: Full fetch complete (39112 records). [2025-09-23T18:32:09.629747] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-23T18:32:09.813600] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-23T18:32:09.959973] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T18:32:10.031362] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-23T18:32:10.031457] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-23T18:32:10.032103] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-23T18:32:10.032169] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-23T18:32:10.033289] [DEBUG] [LOCAL ] EDD: Trimmed 39112 records to 27154 (keeping 200 days of data) [2025-09-23T18:32:10.192036] [DEBUG] [LOCAL ] EDD: Primary data saved (27154 records). [2025-09-23T18:32:10.192167] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-23T18:32:10.192240] [INFO ] [MAIN ] Update Progress: 697/2372 symbols completed. EDD took 39.1s. Estimated remaining: 3h 41m 22s. Rate: 7.6 symbols/min [2025-09-23T18:32:10.363478] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:10.368006] [DEBUG] [LOCAL ] EEA: Loaded 2752 existing records from primary storage. [2025-09-23T18:32:10.368085] [INFO ] [MAIN ] EEA: Loaded 2752 existing records. [2025-09-23T18:32:10.545590] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:10.545879] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-23T18:32:10.545925] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-23T18:32:10.546153] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-23T18:32:10.546211] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-23T18:32:10.608981] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-23T18:32:10.907557] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:10.923734] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:32:11.402252] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-23T18:32:12.091006] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T18:32:12.170165] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T18:32:12.202192] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-23T18:32:13.002211] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-23T18:32:13.475940] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:32:13.802151] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-23T18:32:13.806593] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T18:32:14.602191] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-23T18:32:14.944697] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T18:32:15.179190] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:32:15.402189] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-23T18:32:16.202198] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-23T18:32:16.596084] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T18:32:16.973584] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T18:32:17.002183] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-23T18:32:17.478220] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T18:32:17.802263] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-23T18:32:18.602204] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-23T18:32:18.643930] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T18:32:19.402210] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-23T18:32:19.977637] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:32:19.978529] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T18:32:19.985485] [INFO ] [REMOTE ] EDN: Full fetch complete (30602 records). [2025-09-23T18:32:19.985698] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-23T18:32:20.212546] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-23T18:32:20.374824] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-23T18:32:20.374928] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-23T18:32:20.375480] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-23T18:32:20.375544] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-23T18:32:20.376330] [DEBUG] [LOCAL ] EDN: Trimmed 30602 records to 18115 (keeping 200 days of data) [2025-09-23T18:32:20.481780] [DEBUG] [LOCAL ] EDN: Primary data saved (18115 records). [2025-09-23T18:32:20.481938] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-23T18:32:20.482053] [INFO ] [MAIN ] Update Progress: 698/2372 symbols completed. EDN took 27.6s. Estimated remaining: 3h 41m 20s. Rate: 7.6 symbols/min [2025-09-23T18:32:20.654566] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:20.654820] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-09-23T18:32:20.654876] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-09-23T18:32:20.655026] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-23T18:32:20.655115] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-23T18:32:20.655202] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-23T18:32:20.655275] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-23T18:32:20.764121] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T18:32:21.003054] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-23T18:32:21.023245] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:21.802230] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-23T18:32:22.316345] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T18:32:22.602159] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-23T18:32:22.987997] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:32:23.078183] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T18:32:23.402196] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-23T18:32:23.753546] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-23T18:32:24.202258] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-23T18:32:25.002236] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-23T18:32:25.680525] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T18:32:25.768503] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T18:32:25.802150] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-23T18:32:26.602186] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-23T18:32:26.923745] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:32:27.402263] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-23T18:32:28.027379] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T18:32:28.060815] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T18:32:28.202183] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-23T18:32:28.666889] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:32:29.002215] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-23T18:32:29.802231] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-23T18:32:30.474503] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T18:32:30.602189] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-23T18:32:31.351403] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T18:32:31.402192] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-23T18:32:31.525784] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T18:32:32.202196] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-23T18:32:32.921974] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:32:32.929715] [INFO ] [REMOTE ] EDU: Full fetch complete (66554 records). [2025-09-23T18:32:32.929884] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-23T18:32:33.009440] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-23T18:32:33.359399] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-23T18:32:33.359519] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-23T18:32:33.360540] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-23T18:32:33.360700] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-23T18:32:33.382204] [DEBUG] [LOCAL ] EDU: Trimmed 66554 records to 45060 (keeping 200 days of data) [2025-09-23T18:32:33.382885] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:32:33.513039] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:32:33.514992] [INFO ] [REMOTE ] EEA: Full fetch complete (3981 records). [2025-09-23T18:32:33.519198] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-23T18:32:33.808772] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-23T18:32:33.996576] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-23T18:32:33.996986] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-23T18:32:33.997464] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-23T18:32:33.997538] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-23T18:32:33.998718] [DEBUG] [LOCAL ] EEA: Trimmed 3981 records to 2710 (keeping 200 days of data) [2025-09-23T18:32:34.020628] [DEBUG] [LOCAL ] EEA: Primary data saved (2710 records). [2025-09-23T18:32:34.021270] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-23T18:32:34.021620] [INFO ] [MAIN ] Update Progress: 699/2372 symbols completed. EEA took 23.8s. Estimated remaining: 3h 41m 25s. Rate: 7.6 symbols/min [2025-09-23T18:32:34.205697] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:34.239205] [DEBUG] [LOCAL ] EDU: Primary data saved (45060 records). [2025-09-23T18:32:34.239365] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-23T18:32:34.239463] [INFO ] [MAIN ] Update Progress: 700/2372 symbols completed. EDU took 39.0s. Estimated remaining: 3h 40m 59s. Rate: 7.6 symbols/min [2025-09-23T18:32:34.469561] [DEBUG] [LOCAL ] EFC: Loaded 46187 existing records from primary storage. [2025-09-23T18:32:34.469730] [INFO ] [MAIN ] EFC: Loaded 46187 existing records. [2025-09-23T18:32:34.468463] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:34.607003] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-23T18:32:34.671746] [DEBUG] [LOCAL ] EFR: Loaded 14225 existing records from primary storage. [2025-09-23T18:32:34.676406] [INFO ] [MAIN ] EFR: Loaded 14225 existing records. [2025-09-23T18:32:34.689128] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:34.742546] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-23T18:32:34.754154] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-23T18:32:34.782374] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-23T18:32:34.782517] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-23T18:32:34.972249] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:34.993352] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-23T18:32:35.026475] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-23T18:32:35.035566] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-23T18:32:35.053071] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-23T18:32:35.467325] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:35.487758] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-23T18:32:35.653600] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:35.654721] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T18:32:35.679954] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T18:32:36.202179] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-23T18:32:37.002167] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-23T18:32:37.249948] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:32:37.590231] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-23T18:32:37.787633] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:32:37.802138] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-23T18:32:38.602211] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-23T18:32:38.644526] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T18:32:39.402236] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-23T18:32:39.985264] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:32:39.990674] [INFO ] [REMOTE ] EE: Full fetch complete (43617 records). [2025-09-23T18:32:39.990788] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-23T18:32:40.208475] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-23T18:32:40.395637] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-23T18:32:40.396042] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-23T18:32:40.397006] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-23T18:32:40.397148] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-23T18:32:40.399887] [DEBUG] [LOCAL ] EE: Trimmed 43617 records to 32586 (keeping 200 days of data) [2025-09-23T18:32:40.511031] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T18:32:40.624422] [DEBUG] [LOCAL ] EE: Primary data saved (32586 records). [2025-09-23T18:32:40.624573] [INFO ] [MAIN ] EE: Full history saved. [2025-09-23T18:32:40.624713] [INFO ] [MAIN ] Update Progress: 701/2372 symbols completed. EE took 32.1s. Estimated remaining: 3h 40m 47s. Rate: 7.6 symbols/min [2025-09-23T18:32:40.793557] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:40.793802] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-09-23T18:32:40.793858] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-09-23T18:32:40.794002] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-23T18:32:40.794058] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-23T18:32:40.794124] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-23T18:32:40.794160] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-23T18:32:41.012470] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-23T18:32:40.995023] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:32:41.192237] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:41.634383] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T18:32:41.802277] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-23T18:32:42.338534] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T18:32:42.602263] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-23T18:32:43.402199] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-23T18:32:43.634889] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T18:32:44.202183] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-23T18:32:44.251037] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T18:32:44.310523] [DEBUG] [REMOTE ] EFC: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-23T18:32:44.310891] [WARN ] [REMOTE ] EFC: No data returned for month 2025-01 [2025-09-23T18:32:45.002210] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-23T18:32:45.747882] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T18:32:45.802240] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-23T18:32:46.602188] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-23T18:32:46.821765] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:32:47.198385] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T18:32:47.402228] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-23T18:32:48.115153] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T18:32:48.202202] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-23T18:32:48.703665] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T18:32:49.002194] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-23T18:32:49.802200] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-23T18:32:50.333018] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T18:32:50.336165] [INFO ] [REMOTE ] EEX: Full fetch complete (20090 records). [2025-09-23T18:32:50.336321] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-23T18:32:50.606404] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-23T18:32:50.753899] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-23T18:32:50.754579] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-23T18:32:50.755343] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-23T18:32:50.755853] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-23T18:32:50.757212] [DEBUG] [LOCAL ] EEX: Trimmed 20090 records to 12091 (keeping 200 days of data) [2025-09-23T18:32:50.844788] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T18:32:50.875161] [DEBUG] [LOCAL ] EEX: Primary data saved (12091 records). [2025-09-23T18:32:50.875324] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-23T18:32:50.875437] [INFO ] [MAIN ] Update Progress: 702/2372 symbols completed. EEX took 30.4s. Estimated remaining: 3h 40m 45s. Rate: 7.6 symbols/min [2025-09-23T18:32:51.063856] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:51.124387] [DEBUG] [LOCAL ] EFX: Loaded 44961 existing records from primary storage. [2025-09-23T18:32:51.124744] [INFO ] [MAIN ] EFX: Loaded 44961 existing records. [2025-09-23T18:32:51.242841] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-23T18:32:51.328150] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:51.328467] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-23T18:32:51.328532] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-23T18:32:51.329937] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-23T18:32:51.330030] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-23T18:32:51.407332] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-23T18:32:51.711973] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:52.108699] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T18:32:52.202203] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-23T18:32:53.002194] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-23T18:32:53.575435] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T18:32:53.802168] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-23T18:32:54.078218] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T18:32:54.406716] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T18:32:54.602196] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-23T18:32:55.402169] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-23T18:32:55.550523] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T18:32:56.202205] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-23T18:32:57.002170] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-23T18:32:57.173981] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T18:32:57.588501] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:32:57.637306] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T18:32:57.802210] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-23T18:32:58.602210] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-23T18:32:59.211102] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:32:59.275245] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T18:32:59.402201] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-23T18:33:00.064907] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T18:33:00.202199] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-23T18:33:01.002194] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-23T18:33:01.802202] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-23T18:33:02.004531] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:33:02.232189] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T18:33:02.602183] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-23T18:33:03.402178] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-23T18:33:04.202193] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-23T18:33:04.445426] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-23T18:33:04.687766] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:33:04.690040] [INFO ] [REMOTE ] EFT: Full fetch complete (17271 records). [2025-09-23T18:33:04.690114] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-23T18:33:04.690896] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:33:04.690982] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:33:04.691036] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:33:04.691159] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-23T18:33:04.691246] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-23T18:33:04.691295] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-09-23T18:33:04.691375] [DEBUG] [LOCAL ] EFT: No derivative data file found to delete. [2025-09-23T18:33:04.691461] [INFO ] [MAIN ] Update Progress: 703/2372 symbols completed. EFT took 24.1s. Estimated remaining: 3h 40m 51s. Rate: 7.6 symbols/min [2025-09-23T18:33:04.866116] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:04.921915] [DEBUG] [LOCAL ] EFXT: Loaded 29392 existing records from primary storage. [2025-09-23T18:33:04.922086] [INFO ] [MAIN ] EFXT: Loaded 29392 existing records. [2025-09-23T18:33:05.007284] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-23T18:33:05.112321] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:05.112591] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-23T18:33:05.112637] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-23T18:33:05.114424] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-23T18:33:05.114485] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-23T18:33:05.518484] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:05.539700] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-23T18:33:05.576842] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:33:05.755610] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T18:33:05.758511] [INFO ] [REMOTE ] EFR: Full fetch complete (18485 records). [2025-09-23T18:33:05.758595] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-23T18:33:05.807333] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-23T18:33:06.151833] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-23T18:33:06.151950] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-23T18:33:06.152446] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-23T18:33:06.152489] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-23T18:33:06.153409] [DEBUG] [LOCAL ] EFR: Trimmed 18485 records to 14232 (keeping 200 days of data) [2025-09-23T18:33:06.259505] [DEBUG] [LOCAL ] EFR: Primary data saved (14232 records). [2025-09-23T18:33:06.259679] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-23T18:33:06.259848] [INFO ] [MAIN ] Update Progress: 704/2372 symbols completed. EFR took 32.0s. Estimated remaining: 3h 40m 28s. Rate: 7.6 symbols/min [2025-09-23T18:33:06.435917] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:06.436111] [DEBUG] [LOCAL ] EG: No existing data file found in primary storage. [2025-09-23T18:33:06.436150] [WARN ] [MAIN ] EG: No existing data found, performing full refresh instead. [2025-09-23T18:33:06.436301] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-23T18:33:06.436344] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-23T18:33:06.436386] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-09-23T18:33:06.436420] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-23T18:33:06.620222] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-23T18:33:06.805713] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:07.402209] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-23T18:33:07.697346] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-23T18:33:08.202189] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-23T18:33:08.237237] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:33:09.002234] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-23T18:33:09.172753] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T18:33:09.476515] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:33:09.802226] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-23T18:33:10.408155] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:33:10.602237] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-23T18:33:11.211778] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:33:11.220022] [INFO ] [REMOTE ] EFC: Full fetch complete (59789 records). [2025-09-23T18:33:11.220183] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-23T18:33:11.413596] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-23T18:33:11.415777] [WARN ] [VALIDATOR ] EFC: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T18:33:11.417240] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:33:11.417319] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:33:11.417392] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-23T18:33:11.417465] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-09-23T18:33:11.417624] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-09-23T18:33:11.418415] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-09-23T18:33:11.418513] [INFO ] [MAIN ] Update Progress: 705/2372 symbols completed. EFC took 37.4s. Estimated remaining: 3h 40m 14s. Rate: 7.6 symbols/min [2025-09-23T18:33:11.589581] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:11.659674] [DEBUG] [LOCAL ] EGO: Loaded 51470 existing records from primary storage. [2025-09-23T18:33:11.659837] [INFO ] [MAIN ] EGO: Loaded 51470 existing records. [2025-09-23T18:33:11.841849] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:11.842171] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-23T18:33:11.842231] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-23T18:33:11.844046] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-23T18:33:11.844111] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-23T18:33:12.213237] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-23T18:33:12.213080] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:12.304241] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T18:33:12.612390] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:33:13.002182] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-23T18:33:13.155756] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T18:33:13.802194] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-23T18:33:14.218801] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T18:33:14.602231] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-23T18:33:15.060346] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T18:33:15.402197] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-23T18:33:16.123676] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:33:16.202156] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-23T18:33:16.679927] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T18:33:17.002210] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-23T18:33:17.802214] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-23T18:33:18.588973] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-23T18:33:18.602137] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-23T18:33:18.954505] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T18:33:19.180409] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-23T18:33:19.402174] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-23T18:33:19.828179] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T18:33:20.202195] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-23T18:33:20.933348] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:33:21.002217] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-23T18:33:21.452736] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T18:33:21.802204] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-23T18:33:22.602187] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-23T18:33:22.807828] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:33:23.402200] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-23T18:33:23.472423] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T18:33:23.587811] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T18:33:24.202233] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-23T18:33:24.826509] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:33:25.002201] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-23T18:33:25.754867] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T18:33:25.802153] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-23T18:33:25.911943] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T18:33:26.602170] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-23T18:33:26.682838] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T18:33:27.402202] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-23T18:33:28.202254] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-23T18:33:28.467225] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T18:33:28.476561] [INFO ] [REMOTE ] EFX: Full fetch complete (64351 records). [2025-09-23T18:33:28.476714] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-23T18:33:28.910235] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-23T18:33:28.910361] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-23T18:33:28.911511] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-23T18:33:28.911585] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-23T18:33:28.915387] [DEBUG] [LOCAL ] EFX: Trimmed 64351 records to 44864 (keeping 200 days of data) [2025-09-23T18:33:29.015145] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-23T18:33:29.164086] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T18:33:29.234484] [DEBUG] [LOCAL ] EFX: Primary data saved (44864 records). [2025-09-23T18:33:29.234628] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-23T18:33:29.234749] [INFO ] [MAIN ] Update Progress: 706/2372 symbols completed. EFX took 38.4s. Estimated remaining: 3h 40m 29s. Rate: 7.6 symbols/min [2025-09-23T18:33:29.427836] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:29.462236] [DEBUG] [LOCAL ] EGP: Loaded 31337 existing records from primary storage. [2025-09-23T18:33:29.462404] [INFO ] [MAIN ] EGP: Loaded 31337 existing records. [2025-09-23T18:33:29.643822] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:29.644067] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-23T18:33:29.644116] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-23T18:33:29.645197] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-23T18:33:29.645259] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-23T18:33:29.822926] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-23T18:33:30.016970] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:30.298542] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T18:33:30.602248] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-23T18:33:30.776182] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T18:33:31.402287] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-23T18:33:31.591172] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-23T18:33:31.617322] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T18:33:32.202255] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-23T18:33:32.442799] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T18:33:33.002219] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-23T18:33:33.464488] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:33:33.471868] [INFO ] [REMOTE ] EG: Full fetch complete (43849 records). [2025-09-23T18:33:33.472028] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-23T18:33:33.807446] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-23T18:33:33.860316] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-23T18:33:33.860410] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-23T18:33:33.861075] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-23T18:33:33.861140] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-23T18:33:33.863842] [DEBUG] [LOCAL ] EG: Trimmed 43849 records to 28707 (keeping 200 days of data) [2025-09-23T18:33:34.054231] [DEBUG] [LOCAL ] EG: Primary data saved (28707 records). [2025-09-23T18:33:34.054375] [INFO ] [MAIN ] EG: Full history saved. [2025-09-23T18:33:34.054466] [INFO ] [MAIN ] Update Progress: 707/2372 symbols completed. EG took 27.8s. Estimated remaining: 3h 40m 14s. Rate: 7.6 symbols/min [2025-09-23T18:33:34.251785] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:34.294952] [DEBUG] [LOCAL ] EGY: Loaded 42312 existing records from primary storage. [2025-09-23T18:33:34.295120] [INFO ] [MAIN ] EGY: Loaded 42312 existing records. [2025-09-23T18:33:34.472146] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:34.472381] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-23T18:33:34.472488] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-23T18:33:34.473433] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-23T18:33:34.473493] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-23T18:33:34.613939] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-23T18:33:34.878638] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:34.924731] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-23T18:33:35.259522] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T18:33:35.402275] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-23T18:33:35.480555] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T18:33:36.202243] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-23T18:33:36.731694] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T18:33:37.002272] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-23T18:33:37.802182] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-23T18:33:37.972686] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T18:33:38.128002] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T18:33:38.602197] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-23T18:33:38.883750] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:33:39.402202] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-23T18:33:39.506723] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:33:40.202230] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-23T18:33:40.511072] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T18:33:41.002256] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-23T18:33:41.304159] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T18:33:41.802270] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-23T18:33:42.407747] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:33:42.602211] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-23T18:33:43.067448] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:33:43.402211] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-23T18:33:43.764076] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T18:33:44.202208] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-23T18:33:45.010383] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-23T18:33:45.030433] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:33:45.471946] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T18:33:45.802202] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-23T18:33:46.264623] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:33:46.270336] [INFO ] [REMOTE ] EFXT: Full fetch complete (44213 records). [2025-09-23T18:33:46.270442] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-23T18:33:46.606984] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-23T18:33:46.687769] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-23T18:33:46.687917] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-23T18:33:46.688812] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-23T18:33:46.688950] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-23T18:33:46.690214] [DEBUG] [LOCAL ] EFXT: Trimmed 44213 records to 29358 (keeping 200 days of data) [2025-09-23T18:33:46.798815] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:33:46.895451] [DEBUG] [LOCAL ] EFXT: Primary data saved (29358 records). [2025-09-23T18:33:46.895595] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-23T18:33:46.895704] [INFO ] [MAIN ] Update Progress: 708/2372 symbols completed. EFXT took 42.2s. Estimated remaining: 3h 40m 17s. Rate: 7.6 symbols/min [2025-09-23T18:33:47.076446] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:47.106460] [DEBUG] [LOCAL ] EHAB: Loaded 30099 existing records from primary storage. [2025-09-23T18:33:47.106602] [INFO ] [MAIN ] EHAB: Loaded 30099 existing records. [2025-09-23T18:33:47.294791] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:47.295092] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-23T18:33:47.295149] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-23T18:33:47.295973] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-23T18:33:47.296035] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-23T18:33:47.407293] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-23T18:33:47.680286] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:48.202199] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-23T18:33:48.294704] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T18:33:48.857171] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:33:48.866010] [INFO ] [REMOTE ] EGO: Full fetch complete (73331 records). [2025-09-23T18:33:48.866175] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-23T18:33:49.007319] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-23T18:33:49.277812] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-23T18:33:49.277929] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-23T18:33:49.278940] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-23T18:33:49.279108] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-23T18:33:49.296709] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T18:33:49.302685] [DEBUG] [LOCAL ] EGO: Trimmed 73331 records to 51496 (keeping 200 days of data) [2025-09-23T18:33:49.616950] [DEBUG] [LOCAL ] EGO: Primary data saved (51496 records). [2025-09-23T18:33:49.617122] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-23T18:33:49.617221] [INFO ] [MAIN ] Update Progress: 709/2372 symbols completed. EGO took 38.2s. Estimated remaining: 3h 39m 57s. Rate: 7.6 symbols/min [2025-09-23T18:33:49.808243] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:49.808354] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-23T18:33:49.853381] [DEBUG] [LOCAL ] EHC: Loaded 41502 existing records from primary storage. [2025-09-23T18:33:49.853561] [INFO ] [MAIN ] EHC: Loaded 41502 existing records. [2025-09-23T18:33:50.044866] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:50.045356] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-23T18:33:50.045411] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-23T18:33:50.047240] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-23T18:33:50.047339] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-23T18:33:50.426702] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:50.448075] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T18:33:50.602151] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-23T18:33:51.177011] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:33:51.402213] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-23T18:33:51.886957] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T18:33:52.202202] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-23T18:33:52.547791] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T18:33:53.002210] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-23T18:33:53.696599] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:33:53.802190] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-23T18:33:53.978320] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:33:54.602271] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-23T18:33:54.967955] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T18:33:55.402207] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-23T18:33:55.763180] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T18:33:56.202199] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-23T18:33:56.342830] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:33:56.348236] [INFO ] [REMOTE ] EGP: Full fetch complete (45104 records). [2025-09-23T18:33:56.348382] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-23T18:33:56.348998] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:33:56.349106] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:33:56.349182] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:33:56.349291] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-23T18:33:56.349375] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-23T18:33:56.349415] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-09-23T18:33:56.349817] [DEBUG] [LOCAL ] EGP: Deleted derivative data file. [2025-09-23T18:33:56.349918] [INFO ] [MAIN ] Update Progress: 710/2372 symbols completed. EGP took 27.1s. Estimated remaining: 3h 39m 46s. Rate: 7.6 symbols/min [2025-09-23T18:33:56.532874] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:56.544205] [DEBUG] [LOCAL ] EHI: Loaded 10286 existing records from primary storage. [2025-09-23T18:33:56.544344] [INFO ] [MAIN ] EHI: Loaded 10286 existing records. [2025-09-23T18:33:56.731237] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:56.731543] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-23T18:33:56.731621] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-23T18:33:56.732096] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-23T18:33:56.732162] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-23T18:33:57.008859] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-23T18:33:57.113145] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T18:33:57.139829] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:57.802208] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-23T18:33:58.182533] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:33:58.602217] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-23T18:33:59.017215] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T18:33:59.402254] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-23T18:33:59.588469] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T18:34:00.202191] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-23T18:34:00.476739] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T18:34:01.002209] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-23T18:34:01.772992] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T18:34:01.780326] [INFO ] [REMOTE ] EGY: Full fetch complete (61846 records). [2025-09-23T18:34:01.780533] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-23T18:34:01.807297] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-23T18:34:02.182127] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-23T18:34:02.182224] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-23T18:34:02.183046] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-23T18:34:02.183114] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-23T18:34:02.184702] [DEBUG] [LOCAL ] EGY: Trimmed 61846 records to 42328 (keeping 200 days of data) [2025-09-23T18:34:02.436756] [DEBUG] [LOCAL ] EGY: Primary data saved (42328 records). [2025-09-23T18:34:02.436889] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-23T18:34:02.436986] [INFO ] [MAIN ] Update Progress: 711/2372 symbols completed. EGY took 28.4s. Estimated remaining: 3h 39m 34s. Rate: 7.6 symbols/min [2025-09-23T18:34:02.603467] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-23T18:34:02.607019] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:02.633129] [DEBUG] [LOCAL ] EIC: Loaded 24344 existing records from primary storage. [2025-09-23T18:34:02.633266] [INFO ] [MAIN ] EIC: Loaded 24344 existing records. [2025-09-23T18:34:02.845719] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:34:02.846521] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-23T18:34:02.848321] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:34:02.847261] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-23T18:34:02.857628] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-23T18:34:02.858278] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-23T18:34:03.022356] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T18:34:03.214550] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:34:03.257204] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:03.402189] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-23T18:34:04.202184] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-23T18:34:04.679756] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T18:34:05.002232] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-23T18:34:05.134142] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T18:34:05.802204] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-23T18:34:06.223255] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T18:34:06.571528] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T18:34:06.602150] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-23T18:34:07.402248] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-23T18:34:07.653343] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T18:34:08.202202] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-23T18:34:08.957474] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:34:09.002168] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-23T18:34:09.390722] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:34:09.802195] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-23T18:34:10.468538] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:34:10.602258] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-23T18:34:11.319715] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T18:34:11.402153] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-23T18:34:11.602343] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T18:34:12.202199] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-23T18:34:12.234041] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:34:12.238624] [INFO ] [REMOTE ] EHAB: Full fetch complete (41407 records). [2025-09-23T18:34:12.238749] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-23T18:34:12.239610] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:34:12.239722] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:34:12.239788] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:34:12.239859] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-23T18:34:12.239950] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-09-23T18:34:12.240007] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-09-23T18:34:12.240355] [DEBUG] [LOCAL ] EHAB: Deleted derivative data file. [2025-09-23T18:34:12.240449] [INFO ] [MAIN ] Update Progress: 712/2372 symbols completed. EHAB took 25.3s. Estimated remaining: 3h 39m 30s. Rate: 7.6 symbols/min [2025-09-23T18:34:12.409087] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:12.409263] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-23T18:34:12.409299] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-23T18:34:12.409444] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-23T18:34:12.409485] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-23T18:34:12.409525] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-23T18:34:12.409556] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-23T18:34:12.764827] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:12.772354] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T18:34:13.002212] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-23T18:34:13.261081] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-23T18:34:13.802201] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-23T18:34:14.602195] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-23T18:34:14.977493] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T18:34:14.983734] [INFO ] [REMOTE ] EHC: Full fetch complete (58875 records). [2025-09-23T18:34:14.983842] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-23T18:34:15.393138] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:34:15.392895] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-23T18:34:15.393284] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-23T18:34:15.396379] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-23T18:34:15.396464] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-23T18:34:15.398482] [DEBUG] [LOCAL ] EHC: Trimmed 58875 records to 41442 (keeping 200 days of data) [2025-09-23T18:34:15.453571] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-23T18:34:15.661939] [DEBUG] [LOCAL ] EHC: Primary data saved (41442 records). [2025-09-23T18:34:15.662090] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-23T18:34:15.662177] [INFO ] [MAIN ] Update Progress: 713/2372 symbols completed. EHC took 26.0s. Estimated remaining: 3h 39m 12s. Rate: 7.6 symbols/min [2025-09-23T18:34:15.836242] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:15.836558] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-23T18:34:15.836614] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-23T18:34:15.836794] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-23T18:34:15.836837] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-23T18:34:15.836925] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-23T18:34:15.836966] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-23T18:34:16.209264] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-23T18:34:16.243025] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:16.236930] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T18:34:16.657208] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T18:34:17.002217] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-23T18:34:17.798904] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T18:34:17.802153] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-23T18:34:18.389674] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T18:34:18.602231] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-23T18:34:18.930439] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T18:34:19.402189] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-23T18:34:20.202203] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-23T18:34:20.333324] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:34:20.571704] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-23T18:34:21.002208] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-23T18:34:21.277618] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-23T18:34:21.802224] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-23T18:34:22.602195] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-23T18:34:22.727127] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:34:23.402235] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-23T18:34:23.467442] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T18:34:23.826836] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T18:34:24.202216] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-23T18:34:24.916328] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T18:34:25.002177] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-23T18:34:25.408318] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T18:34:25.802207] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-23T18:34:26.115335] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T18:34:26.602194] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-23T18:34:27.370253] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T18:34:27.372947] [INFO ] [REMOTE ] EHI: Full fetch complete (16384 records). [2025-09-23T18:34:27.373044] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-23T18:34:27.407461] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-23T18:34:27.755996] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-23T18:34:27.756112] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-23T18:34:27.756502] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-23T18:34:27.756545] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-23T18:34:27.757093] [DEBUG] [LOCAL ] EHI: Trimmed 16384 records to 10315 (keeping 200 days of data) [2025-09-23T18:34:27.818337] [DEBUG] [LOCAL ] EHI: Primary data saved (10315 records). [2025-09-23T18:34:27.818546] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-23T18:34:27.818691] [INFO ] [MAIN ] Update Progress: 714/2372 symbols completed. EHI took 31.5s. Estimated remaining: 3h 39m 14s. Rate: 7.6 symbols/min [2025-09-23T18:34:27.925624] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T18:34:27.997775] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:27.997970] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-23T18:34:27.998028] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-23T18:34:27.998184] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-23T18:34:27.998227] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-23T18:34:27.998268] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-23T18:34:27.998301] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-23T18:34:28.207373] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-23T18:34:28.375078] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:28.555610] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T18:34:29.002217] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-23T18:34:29.802199] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-23T18:34:29.967475] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T18:34:30.247977] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T18:34:30.602230] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-23T18:34:31.056333] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T18:34:31.402205] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-23T18:34:31.733752] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T18:34:32.202197] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-23T18:34:33.002228] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-23T18:34:33.210445] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T18:34:33.575838] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T18:34:33.802203] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-23T18:34:34.251319] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-23T18:34:34.602249] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-23T18:34:34.921744] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T18:34:35.402193] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-23T18:34:36.024171] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T18:34:36.202220] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-23T18:34:36.808577] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T18:34:37.002206] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-23T18:34:37.322424] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T18:34:37.802204] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-23T18:34:38.602223] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-23T18:34:38.984816] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:34:39.033835] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:34:39.402195] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-23T18:34:39.964248] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T18:34:39.965711] [INFO ] [REMOTE ] EICB: Full fetch complete (2662 records). [2025-09-23T18:34:39.965797] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-23T18:34:40.174676] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T18:34:40.174900] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:34:40.174959] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:34:40.175039] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-23T18:34:40.175142] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-23T18:34:40.175196] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-23T18:34:40.175239] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-23T18:34:40.175336] [INFO ] [MAIN ] Update Progress: 715/2372 symbols completed. EICB took 24.5s. Estimated remaining: 3h 39m 16s. Rate: 7.6 symbols/min [2025-09-23T18:34:40.205758] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-23T18:34:40.356439] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:40.382527] [DEBUG] [LOCAL ] EIG: Loaded 20316 existing records from primary storage. [2025-09-23T18:34:40.382691] [INFO ] [MAIN ] EIG: Loaded 20316 existing records. [2025-09-23T18:34:40.560136] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:34:40.560429] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-23T18:34:40.560519] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-23T18:34:40.561290] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-23T18:34:40.561351] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-23T18:34:40.794333] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T18:34:40.955226] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:41.002226] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-23T18:34:41.802241] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-23T18:34:42.144226] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:34:42.542665] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T18:34:42.602188] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-23T18:34:43.386440] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T18:34:43.402161] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-23T18:34:44.202258] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-23T18:34:44.399202] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T18:34:45.002199] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-23T18:34:45.173461] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T18:34:45.744507] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-23T18:34:45.802232] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-23T18:34:46.602396] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-23T18:34:46.920042] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T18:34:47.061734] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T18:34:47.402219] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-23T18:34:47.830609] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T18:34:48.202207] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-23T18:34:48.938634] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T18:34:49.002177] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-23T18:34:49.802206] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-23T18:34:49.927100] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T18:34:49.930615] [INFO ] [REMOTE ] EIC: Full fetch complete (35483 records). [2025-09-23T18:34:49.930780] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-23T18:34:50.187774] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T18:34:50.227570] [INFO ] [REMOTE ] EICA: Full fetch complete (1263 records). [2025-09-23T18:34:50.227713] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-23T18:34:50.576906] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-23T18:34:50.577304] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-23T18:34:50.577419] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-23T18:34:50.578176] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-23T18:34:50.578385] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-23T18:34:50.578282] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:34:50.578638] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:34:50.578741] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-23T18:34:50.578932] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-23T18:34:50.579005] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-23T18:34:50.579089] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-23T18:34:50.579186] [INFO ] [MAIN ] Update Progress: 716/2372 symbols completed. EICA took 38.3s. Estimated remaining: 3h 39m 14s. Rate: 7.6 symbols/min [2025-09-23T18:34:50.610747] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-23T18:34:50.675006] [DEBUG] [LOCAL ] EIC: Trimmed 35483 records to 24236 (keeping 200 days of data) [2025-09-23T18:34:50.875946] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:50.952797] [DEBUG] [LOCAL ] EIC: Primary data saved (24236 records). [2025-09-23T18:34:50.953084] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-23T18:34:50.953187] [INFO ] [MAIN ] Update Progress: 717/2372 symbols completed. EIC took 48.5s. Estimated remaining: 3h 38m 49s. Rate: 7.6 symbols/min [2025-09-23T18:34:50.979824] [DEBUG] [LOCAL ] EIX: Loaded 53346 existing records from primary storage. [2025-09-23T18:34:50.980055] [INFO ] [MAIN ] EIX: Loaded 53346 existing records. [2025-09-23T18:34:51.189247] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:34:51.189895] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-23T18:34:51.189967] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-23T18:34:51.191216] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-23T18:34:51.191278] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-23T18:34:51.410018] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-23T18:34:51.480697] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T18:34:51.601854] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:52.202197] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-23T18:34:52.548779] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:34:53.002239] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-23T18:34:53.802193] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-23T18:34:53.844905] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T18:34:54.553254] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-23T18:34:54.602203] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-23T18:34:55.037143] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T18:34:55.052391] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T18:34:55.402268] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-23T18:34:55.962953] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T18:34:55.965317] [INFO ] [REMOTE ] EICC: Full fetch complete (7866 records). [2025-09-23T18:34:55.965407] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-23T18:34:55.965960] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:34:55.966060] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:34:55.966114] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:34:55.966164] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-23T18:34:55.966266] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-23T18:34:55.966318] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-23T18:34:55.966404] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-23T18:34:55.966563] [INFO ] [MAIN ] Update Progress: 718/2372 symbols completed. EICC took 28.1s. Estimated remaining: 3h 38m 34s. Rate: 7.6 symbols/min [2025-09-23T18:34:56.202250] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-23T18:34:57.007399] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-23T18:34:57.009318] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T18:34:57.802210] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-23T18:34:58.601523] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T18:34:58.612744] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-23T18:34:58.665603] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T18:34:59.402300] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-23T18:35:00.068502] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T18:35:00.202195] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-23T18:35:00.278732] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T18:35:00.283041] [INFO ] [REMOTE ] EIG: Full fetch complete (26946 records). [2025-09-23T18:35:00.283160] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-23T18:35:00.676147] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-23T18:35:00.676280] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-23T18:35:00.677084] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-23T18:35:00.677210] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-23T18:35:00.678341] [DEBUG] [LOCAL ] EIG: Trimmed 26946 records to 20345 (keeping 200 days of data) [2025-09-23T18:35:00.823622] [DEBUG] [LOCAL ] EIG: Primary data saved (20345 records). [2025-09-23T18:35:00.823828] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-23T18:35:00.823966] [INFO ] [MAIN ] Update Progress: 719/2372 symbols completed. EIG took 20.6s. Estimated remaining: 3h 38m 19s. Rate: 7.6 symbols/min [2025-09-23T18:35:01.815920] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T18:35:01.832482] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-23T18:35:03.549726] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T18:35:03.561056] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-23T18:35:05.215729] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:35:05.227408] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-23T18:35:06.729447] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T18:35:06.741819] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-23T18:35:08.358840] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T18:35:08.371548] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-23T18:35:10.240686] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T18:35:10.252312] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-23T18:35:11.946338] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T18:35:11.955217] [INFO ] [REMOTE ] EIX: Full fetch complete (76953 records). [2025-09-23T18:35:11.955398] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-23T18:35:12.387348] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-23T18:35:12.387491] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-23T18:35:12.389147] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-23T18:35:12.389220] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-23T18:35:12.391424] [DEBUG] [LOCAL ] EIX: Trimmed 76953 records to 53345 (keeping 200 days of data) [2025-09-23T18:35:12.736942] [DEBUG] [LOCAL ] EIX: Primary data saved (53345 records). [2025-09-23T18:35:12.737118] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-23T18:35:12.737324] [INFO ] [MAIN ] Update Progress: 720/2372 symbols completed. EIX took 22.2s. Estimated remaining: 3h 38m 20s. Rate: 7.6 symbols/min [2025-09-23T18:35:13.293273] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:13.448146] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:13.467680] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:13.446250] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:13.482539] [DEBUG] [LOCAL ] ELC: Loaded 3492 existing records from primary storage. [2025-09-23T18:35:13.482771] [INFO ] [MAIN ] ELC: Loaded 3492 existing records. [2025-09-23T18:35:13.706898] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:13.729686] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-23T18:35:13.729888] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-23T18:35:13.744255] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-23T18:35:13.744459] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-23T18:35:13.750788] [DEBUG] [LOCAL ] ELF: Loaded 52315 existing records from primary storage. [2025-09-23T18:35:13.811093] [INFO ] [MAIN ] ELF: Loaded 52315 existing records. [2025-09-23T18:35:13.924677] [DEBUG] [LOCAL ] EL: Loaded 53412 existing records from primary storage. [2025-09-23T18:35:13.966087] [INFO ] [MAIN ] EL: Loaded 53412 existing records. [2025-09-23T18:35:14.027681] [DEBUG] [LOCAL ] ELAN: Loaded 53187 existing records from primary storage. [2025-09-23T18:35:14.065969] [INFO ] [MAIN ] ELAN: Loaded 53187 existing records. [2025-09-23T18:35:14.567700] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:14.686003] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-23T18:35:14.754331] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:14.746195] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-23T18:35:14.802893] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-23T18:35:14.802783] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-23T18:35:14.803187] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-23T18:35:14.803290] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-23T18:35:14.797436] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:14.808919] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-23T18:35:14.843432] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:14.832190] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-23T18:35:14.854188] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-23T18:35:14.909208] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-23T18:35:14.936748] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-23T18:35:15.036264] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-23T18:35:15.062833] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-23T18:35:15.721153] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T18:35:15.812615] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-23T18:35:15.888050] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:15.885154] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:15.909969] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-23T18:35:15.929555] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-23T18:35:15.972193] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:15.972786] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-23T18:35:16.553465] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T18:35:16.555911] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-23T18:35:16.904716] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T18:35:16.906152] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-23T18:35:17.319989] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:35:17.331287] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-23T18:35:17.357039] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-23T18:35:17.358470] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-23T18:35:17.652175] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:35:17.662305] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-23T18:35:17.791261] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T18:35:17.792842] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-23T18:35:18.238937] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-23T18:35:18.249954] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-23T18:35:18.349718] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T18:35:18.351262] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-23T18:35:18.560885] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:35:18.571537] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-23T18:35:18.779562] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:35:18.781074] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-23T18:35:19.307103] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T18:35:19.308700] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-23T18:35:19.340151] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T18:35:19.350179] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-23T18:35:19.825872] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T18:35:19.829867] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-23T18:35:19.828976] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:35:19.872586] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T18:35:20.202191] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-23T18:35:20.362511] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T18:35:20.363682] [INFO ] [REMOTE ] ELC: Full fetch complete (5147 records). [2025-09-23T18:35:20.363755] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-23T18:35:20.745004] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-23T18:35:20.745108] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-23T18:35:20.745275] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-23T18:35:20.745314] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-23T18:35:20.745717] [DEBUG] [LOCAL ] ELC: Trimmed 5147 records to 3497 (keeping 200 days of data) [2025-09-23T18:35:20.768700] [DEBUG] [LOCAL ] ELC: Primary data saved (3497 records). [2025-09-23T18:35:20.768805] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-23T18:35:20.768888] [INFO ] [MAIN ] Update Progress: 721/2372 symbols completed. ELC took 8.0s. Estimated remaining: 3h 38m 12s. Rate: 7.6 symbols/min [2025-09-23T18:35:20.955434] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:21.018108] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-23T18:35:21.021790] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:35:21.045009] [DEBUG] [LOCAL ] ELME: Loaded 39258 existing records from primary storage. [2025-09-23T18:35:21.045465] [INFO ] [MAIN ] ELME: Loaded 39258 existing records. [2025-09-23T18:35:21.240080] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:21.240320] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-23T18:35:21.240369] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-23T18:35:21.241722] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-23T18:35:21.241790] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-23T18:35:21.619681] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:21.688398] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:35:21.802177] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-23T18:35:22.602155] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-23T18:35:23.015535] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T18:35:23.097835] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-23T18:35:23.402210] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-23T18:35:24.202205] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-23T18:35:24.437249] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T18:35:25.002217] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-23T18:35:25.094778] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T18:35:25.802212] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-23T18:35:25.935591] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T18:35:26.602155] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-23T18:35:26.770177] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T18:35:27.402160] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-23T18:35:27.749444] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T18:35:28.001152] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T18:35:28.202201] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-23T18:35:29.002207] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-23T18:35:29.260747] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T18:35:29.617376] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T18:35:29.802202] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-23T18:35:30.195282] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T18:35:30.602211] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-23T18:35:31.115213] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T18:35:31.402201] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-23T18:35:32.202210] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-23T18:35:32.638886] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T18:35:32.723852] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T18:35:33.002241] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-23T18:35:33.802220] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-23T18:35:34.209726] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T18:35:34.275147] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:35:34.602196] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-23T18:35:35.402177] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-23T18:35:35.665520] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T18:35:35.705722] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T18:35:36.202242] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-23T18:35:37.008721] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-23T18:35:37.011309] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T18:35:37.208566] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T18:35:37.802206] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-23T18:35:38.604077] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-23T18:35:38.890443] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T18:35:38.902529] [INFO ] [REMOTE ] ELAN: Full fetch complete (76858 records). [2025-09-23T18:35:38.902883] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-23T18:35:39.152729] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T18:35:39.407699] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-23T18:35:39.438255] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-23T18:35:39.438373] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-23T18:35:39.439390] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-23T18:35:39.439558] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-23T18:35:39.441171] [DEBUG] [LOCAL ] ELAN: Trimmed 76858 records to 53196 (keeping 200 days of data) [2025-09-23T18:35:39.786599] [DEBUG] [LOCAL ] ELAN: Primary data saved (53196 records). [2025-09-23T18:35:39.786788] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-23T18:35:39.786886] [INFO ] [MAIN ] Update Progress: 722/2372 symbols completed. ELAN took 27.0s. Estimated remaining: 3h 38m 30s. Rate: 7.6 symbols/min [2025-09-23T18:35:39.961440] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:39.961639] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-09-23T18:35:39.961766] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-09-23T18:35:39.961919] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-23T18:35:39.961963] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-23T18:35:39.962005] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-09-23T18:35:39.962039] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-23T18:35:40.215916] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-23T18:35:40.342002] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:40.406260] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T18:35:41.002196] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-23T18:35:41.656586] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-23T18:35:41.802239] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-23T18:35:41.914606] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T18:35:42.048572] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T18:35:42.602217] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-23T18:35:43.402201] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-23T18:35:43.855574] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T18:35:43.904796] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:35:44.202203] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-23T18:35:45.002228] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-23T18:35:45.693589] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-23T18:35:45.776392] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:35:45.811273] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-23T18:35:45.814804] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T18:35:46.602205] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-23T18:35:47.402199] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-23T18:35:47.801395] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-23T18:35:47.810304] [INFO ] [REMOTE ] ELF: Full fetch complete (75378 records). [2025-09-23T18:35:47.810452] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-23T18:35:48.262973] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-23T18:35:48.239612] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-23T18:35:48.264153] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-23T18:35:48.265306] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-23T18:35:48.265527] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-23T18:35:48.267502] [DEBUG] [LOCAL ] ELF: Trimmed 75378 records to 52288 (keeping 200 days of data) [2025-09-23T18:35:48.376301] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T18:35:48.394303] [INFO ] [REMOTE ] EL: Full fetch complete (77334 records). [2025-09-23T18:35:48.395787] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-23T18:35:48.922943] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-23T18:35:48.925883] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-23T18:35:48.928848] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-23T18:35:48.929499] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-23T18:35:48.951438] [DEBUG] [LOCAL ] EL: Trimmed 77334 records to 53403 (keeping 200 days of data) [2025-09-23T18:35:48.954528] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:35:48.963706] [INFO ] [REMOTE ] ELME: Full fetch complete (55752 records). [2025-09-23T18:35:48.964588] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-23T18:35:49.365455] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T18:35:49.466525] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-23T18:35:49.711501] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-23T18:35:49.712464] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-23T18:35:49.713868] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-23T18:35:49.714782] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-23T18:35:49.720937] [DEBUG] [LOCAL ] ELME: Trimmed 55752 records to 39265 (keeping 200 days of data) [2025-09-23T18:35:49.826459] [DEBUG] [LOCAL ] ELF: Primary data saved (52288 records). [2025-09-23T18:35:49.827991] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-23T18:35:49.828673] [INFO ] [MAIN ] Update Progress: 723/2372 symbols completed. ELF took 37.1s. Estimated remaining: 3h 38m 27s. Rate: 7.5 symbols/min [2025-09-23T18:35:50.025111] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:50.026451] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-23T18:35:50.028221] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-23T18:35:50.029307] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-23T18:35:50.029937] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-23T18:35:50.030800] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-23T18:35:50.031150] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-23T18:35:50.539418] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:50.540557] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-23T18:35:50.672878] [DEBUG] [LOCAL ] EL: Primary data saved (53403 records). [2025-09-23T18:35:50.673507] [INFO ] [MAIN ] EL: Full history saved. [2025-09-23T18:35:50.674133] [INFO ] [MAIN ] Update Progress: 724/2372 symbols completed. EL took 37.9s. Estimated remaining: 3h 38m 3s. Rate: 7.6 symbols/min [2025-09-23T18:35:50.862982] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:50.864315] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-09-23T18:35:50.864902] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-09-23T18:35:50.866743] [DEBUG] [LOCAL ] ELME: Primary data saved (39265 records). [2025-09-23T18:35:50.867068] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-23T18:35:50.866980] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-23T18:35:50.867185] [INFO ] [MAIN ] Update Progress: 725/2372 symbols completed. ELME took 30.1s. Estimated remaining: 3h 37m 37s. Rate: 7.6 symbols/min [2025-09-23T18:35:50.892995] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-23T18:35:50.938169] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:35:50.947119] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-23T18:35:50.976242] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-23T18:35:50.986788] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T18:35:50.998345] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-23T18:35:51.193330] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:51.209184] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-09-23T18:35:51.219616] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-09-23T18:35:51.253064] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-23T18:35:51.253455] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-23T18:35:51.269053] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-23T18:35:51.340974] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-23T18:35:51.406916] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-23T18:35:51.474596] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T18:35:51.575161] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:51.832139] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:52.202190] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-23T18:35:52.530606] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T18:35:53.002201] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-23T18:35:53.284954] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-23T18:35:53.622630] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T18:35:53.802195] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-23T18:35:54.135081] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T18:35:54.602198] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-23T18:35:54.911701] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-23T18:35:55.402199] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-23T18:35:56.007998] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T18:35:56.202199] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-23T18:35:57.002194] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-23T18:35:57.060045] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T18:35:57.334562] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T18:35:57.802209] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-23T18:35:58.602210] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-23T18:35:59.351127] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T18:35:59.402206] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-23T18:35:59.666534] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-23T18:35:59.728630] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T18:36:00.202194] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-23T18:36:00.555403] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:36:01.002217] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-23T18:36:01.802225] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-23T18:36:02.349481] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:36:02.602215] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-23T18:36:03.402201] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-23T18:36:04.202224] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-23T18:36:06.738551] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-23T18:36:06.739479] [INFO ] [REMOTE ] ELPC: Full fetch complete (1486 records). [2025-09-23T18:36:06.739572] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-23T18:36:06.936941] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-23T18:36:06.937156] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:36:06.937229] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:36:06.937299] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-23T18:36:06.937367] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-23T18:36:06.937404] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-23T18:36:06.937475] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-23T18:36:06.937559] [INFO ] [MAIN ] Update Progress: 726/2372 symbols completed. ELPC took 17.1s. Estimated remaining: 3h 37m 48s. Rate: 7.6 symbols/min [2025-09-23T18:36:07.115323] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:07.115536] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-23T18:36:07.115753] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-23T18:36:07.116124] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-23T18:36:07.116295] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-23T18:36:07.116356] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-23T18:36:07.116395] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-23T18:36:07.488029] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:07.488345] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-23T18:36:07.517132] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (5.71 seconds). [2025-09-23T18:36:07.527436] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-23T18:36:07.644224] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (5.04 seconds). [2025-09-23T18:36:07.649926] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-23T18:36:08.675412] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T18:36:08.679418] [INFO ] [REMOTE ] ELP: Full fetch complete (37680 records). [2025-09-23T18:36:08.679507] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-23T18:36:09.006968] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:09.042702] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-23T18:36:09.057529] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-23T18:36:09.057803] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-23T18:36:09.058740] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-23T18:36:09.059360] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-23T18:36:09.059406] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-23T18:36:09.060472] [DEBUG] [LOCAL ] ELP: Trimmed 37680 records to 25828 (keeping 200 days of data) [2025-09-23T18:36:09.221109] [DEBUG] [LOCAL ] ELP: Primary data saved (25828 records). [2025-09-23T18:36:09.221266] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-23T18:36:09.221347] [INFO ] [MAIN ] Update Progress: 727/2372 symbols completed. ELP took 29.4s. Estimated remaining: 3h 37m 27s. Rate: 7.6 symbols/min [2025-09-23T18:36:09.398956] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:09.397942] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:09.399928] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-23T18:36:09.400339] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-23T18:36:09.438224] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (5.24 seconds). [2025-09-23T18:36:09.454534] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-23T18:36:09.464359] [DEBUG] [LOCAL ] EMD: Loaded 21191 existing records from primary storage. [2025-09-23T18:36:09.464509] [INFO ] [MAIN ] EMD: Loaded 21191 existing records. [2025-09-23T18:36:09.647423] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:09.647546] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:09.648368] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-23T18:36:09.648285] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-23T18:36:09.648495] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-23T18:36:09.649764] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-23T18:36:09.649828] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-23T18:36:09.819347] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-23T18:36:10.068157] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:10.070453] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-23T18:36:10.096351] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:10.096609] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-23T18:36:10.602238] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-23T18:36:10.836427] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:36:11.402240] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-23T18:36:11.601266] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:11.601564] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-23T18:36:11.925423] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:36:12.202248] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-23T18:36:13.002294] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-23T18:36:13.802244] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-23T18:36:13.840759] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T18:36:14.385959] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T18:36:14.602209] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-23T18:36:15.402177] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-23T18:36:15.997710] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-23T18:36:16.202229] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-23T18:36:17.002261] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-23T18:36:17.231291] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-23T18:36:17.802248] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-23T18:36:18.105281] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T18:36:18.536846] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (3.13 seconds). [2025-09-23T18:36:18.570935] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T18:36:18.602155] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-23T18:36:19.060193] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-09-23T18:36:19.355964] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T18:36:19.402152] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-23T18:36:20.147159] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T18:36:20.202167] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-23T18:36:21.009855] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-23T18:36:21.011760] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T18:36:21.802205] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-23T18:36:22.446271] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T18:36:22.602171] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-23T18:36:23.402245] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-23T18:36:23.478053] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T18:36:23.769131] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:36:24.202198] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-23T18:36:24.941878] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:36:25.002211] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-23T18:36:25.392179] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T18:36:25.802204] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-23T18:36:26.419363] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:36:26.602225] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-23T18:36:26.622802] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T18:36:26.625915] [INFO ] [REMOTE ] EMA: Full fetch complete (7954 records). [2025-09-23T18:36:26.626000] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-23T18:36:26.822440] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 82 unique days, need 200 days [2025-09-23T18:36:26.822736] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:36:26.822811] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:36:26.822883] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-23T18:36:26.822952] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-23T18:36:26.822991] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-23T18:36:26.823066] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-23T18:36:26.823180] [INFO ] [MAIN ] Update Progress: 728/2372 symbols completed. EMA took 19.9s. Estimated remaining: 3h 37m 41s. Rate: 7.6 symbols/min [2025-09-23T18:36:27.010246] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:27.047494] [DEBUG] [LOCAL ] EME: Loaded 31792 existing records from primary storage. [2025-09-23T18:36:27.047668] [INFO ] [MAIN ] EME: Loaded 31792 existing records. [2025-09-23T18:36:27.225736] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:27.226044] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-23T18:36:27.226105] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-23T18:36:27.227129] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-23T18:36:27.227189] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-23T18:36:27.407502] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-23T18:36:27.607970] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:28.202176] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-23T18:36:28.238493] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T18:36:29.002200] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-23T18:36:29.726341] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T18:36:29.802186] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-23T18:36:30.369779] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-23T18:36:30.440219] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-23T18:36:30.602233] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-23T18:36:31.008891] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T18:36:31.402292] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-23T18:36:32.138564] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T18:36:32.171821] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:36:32.202143] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-23T18:36:33.002253] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-23T18:36:33.322316] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:36:33.326583] [INFO ] [REMOTE ] EMD: Full fetch complete (32179 records). [2025-09-23T18:36:33.326791] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-23T18:36:33.726356] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-23T18:36:33.726440] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-23T18:36:33.726968] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-23T18:36:33.727031] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-23T18:36:33.727845] [DEBUG] [LOCAL ] EMD: Trimmed 32179 records to 21115 (keeping 200 days of data) [2025-09-23T18:36:33.815582] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-23T18:36:33.858570] [DEBUG] [LOCAL ] EMD: Primary data saved (21115 records). [2025-09-23T18:36:33.858738] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-23T18:36:33.858836] [INFO ] [MAIN ] Update Progress: 729/2372 symbols completed. EMD took 24.6s. Estimated remaining: 3h 37m 31s. Rate: 7.6 symbols/min [2025-09-23T18:36:34.035449] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:34.041560] [DEBUG] [LOCAL ] EMF: Loaded 3627 existing records from primary storage. [2025-09-23T18:36:34.041699] [INFO ] [MAIN ] EMF: Loaded 3627 existing records. [2025-09-23T18:36:34.246104] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:34.246900] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-23T18:36:34.247000] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-23T18:36:34.247407] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-23T18:36:34.247541] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-23T18:36:34.438734] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T18:36:34.607336] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-23T18:36:34.661536] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:35.298945] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:36:35.312466] [INFO ] [REMOTE ] ELS: Full fetch complete (70511 records). [2025-09-23T18:36:35.312693] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-23T18:36:35.410809] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-23T18:36:35.705913] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-23T18:36:35.706003] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-23T18:36:35.706849] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-23T18:36:35.706912] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-23T18:36:35.708315] [DEBUG] [LOCAL ] ELS: Trimmed 70511 records to 49399 (keeping 200 days of data) [2025-09-23T18:36:36.008235] [DEBUG] [LOCAL ] ELS: Primary data saved (49399 records). [2025-09-23T18:36:36.008393] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-23T18:36:36.008483] [INFO ] [MAIN ] Update Progress: 730/2372 symbols completed. ELS took 45.3s. Estimated remaining: 3h 37m 10s. Rate: 7.6 symbols/min [2025-09-23T18:36:36.181361] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:36.209711] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-23T18:36:36.230214] [DEBUG] [LOCAL ] EMN: Loaded 50340 existing records from primary storage. [2025-09-23T18:36:36.230374] [INFO ] [MAIN ] EMN: Loaded 50340 existing records. [2025-09-23T18:36:36.455291] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T18:36:36.454868] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T18:36:36.458014] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:36.466761] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-23T18:36:36.466935] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-23T18:36:36.467251] [INFO ] [REMOTE ] ELV: Full fetch complete (73216 records). [2025-09-23T18:36:36.467341] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-23T18:36:36.499510] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-23T18:36:36.531844] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-23T18:36:37.025805] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-23T18:36:37.242967] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-23T18:36:37.242856] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:37.243309] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-23T18:36:37.244242] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-23T18:36:37.244307] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-23T18:36:37.245780] [DEBUG] [LOCAL ] ELV: Trimmed 73216 records to 50571 (keeping 200 days of data) [2025-09-23T18:36:37.595871] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:36:37.623336] [DEBUG] [LOCAL ] ELV: Primary data saved (50571 records). [2025-09-23T18:36:37.623514] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-23T18:36:37.623601] [INFO ] [MAIN ] Update Progress: 731/2372 symbols completed. ELV took 46.8s. Estimated remaining: 3h 36m 48s. Rate: 7.6 symbols/min [2025-09-23T18:36:37.807373] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-23T18:36:37.811152] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:37.827424] [DEBUG] [LOCAL ] EMO: Loaded 12340 existing records from primary storage. [2025-09-23T18:36:37.827609] [INFO ] [MAIN ] EMO: Loaded 12340 existing records. [2025-09-23T18:36:38.030961] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:38.024967] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T18:36:38.034185] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-23T18:36:38.034806] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-23T18:36:38.035910] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-23T18:36:38.035974] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-23T18:36:38.442416] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:38.602193] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-23T18:36:39.402206] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-23T18:36:39.443691] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T18:36:39.460733] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T18:36:40.202224] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-23T18:36:40.944988] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:36:41.002217] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-23T18:36:41.534393] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:36:41.613204] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T18:36:41.802200] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-23T18:36:42.602223] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-23T18:36:43.028431] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:36:43.380586] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:36:43.402154] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-23T18:36:44.202193] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-23T18:36:44.925151] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:36:44.957637] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:36:45.002183] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-23T18:36:45.496258] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:36:45.802199] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-23T18:36:46.275171] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T18:36:46.602268] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-23T18:36:47.402299] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-23T18:36:47.932567] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:36:48.202216] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-23T18:36:48.502045] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T18:36:48.726162] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T18:36:49.002209] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-23T18:36:49.650578] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:36:49.802160] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-23T18:36:50.334779] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T18:36:50.602304] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-23T18:36:51.338411] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T18:36:51.402201] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-23T18:36:52.202169] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-23T18:36:52.362933] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T18:36:53.002208] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-23T18:36:53.506914] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T18:36:53.802163] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-23T18:36:54.084203] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T18:36:54.332177] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T18:36:54.602210] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-23T18:36:55.402188] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-23T18:36:55.747695] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:36:55.939282] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:36:56.202185] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-23T18:36:57.002197] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-23T18:36:57.542515] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T18:36:57.543580] [INFO ] [REMOTE ] EMF: Full fetch complete (7326 records). [2025-09-23T18:36:57.543673] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-23T18:36:57.811043] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-23T18:36:57.874294] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T18:36:57.970001] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-23T18:36:57.970092] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-23T18:36:57.970305] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-23T18:36:57.970344] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-23T18:36:57.970770] [DEBUG] [LOCAL ] EMF: Trimmed 7326 records to 3595 (keeping 200 days of data) [2025-09-23T18:36:57.992789] [DEBUG] [LOCAL ] EMF: Primary data saved (3595 records). [2025-09-23T18:36:57.992869] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-23T18:36:57.992945] [INFO ] [MAIN ] Update Progress: 732/2372 symbols completed. EMF took 24.1s. Estimated remaining: 3h 37m 8s. Rate: 7.6 symbols/min [2025-09-23T18:36:58.162543] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:58.166841] [DEBUG] [LOCAL ] EMP: Loaded 3032 existing records from primary storage. [2025-09-23T18:36:58.166920] [INFO ] [MAIN ] EMP: Loaded 3032 existing records. [2025-09-23T18:36:58.361923] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:58.362285] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-23T18:36:58.362352] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-23T18:36:58.362733] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-23T18:36:58.362806] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-23T18:36:58.617494] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-23T18:36:58.761257] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:58.762470] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T18:36:59.402254] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-23T18:37:00.054089] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T18:37:00.202220] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-23T18:37:00.303316] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:37:01.002195] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-23T18:37:01.584692] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T18:37:01.606826] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:37:01.802241] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-23T18:37:02.602157] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-23T18:37:02.631144] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:37:02.636499] [INFO ] [REMOTE ] EMO: Full fetch complete (17038 records). [2025-09-23T18:37:02.636623] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-23T18:37:02.637504] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:37:02.637609] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:37:02.637697] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:37:02.637782] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-23T18:37:02.637876] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-09-23T18:37:02.637986] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-09-23T18:37:02.638591] [DEBUG] [LOCAL ] EMO: Deleted derivative data file. [2025-09-23T18:37:02.638737] [INFO ] [MAIN ] Update Progress: 733/2372 symbols completed. EMO took 25.0s. Estimated remaining: 3h 36m 52s. Rate: 7.6 symbols/min [2025-09-23T18:37:02.812485] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:02.885934] [DEBUG] [LOCAL ] EMR: Loaded 53258 existing records from primary storage. [2025-09-23T18:37:02.886106] [INFO ] [MAIN ] EMR: Loaded 53258 existing records. [2025-09-23T18:37:03.038185] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T18:37:03.075571] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:03.075832] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-23T18:37:03.075882] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-23T18:37:03.077366] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-23T18:37:03.077428] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-23T18:37:03.407536] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-23T18:37:03.474436] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:03.838513] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T18:37:04.202268] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-23T18:37:04.701539] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T18:37:05.002230] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-23T18:37:05.802211] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-23T18:37:06.265723] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T18:37:06.523622] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:37:06.602156] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-23T18:37:07.402219] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-23T18:37:07.760934] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T18:37:08.098102] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T18:37:08.202214] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-23T18:37:09.002274] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-23T18:37:09.572057] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:37:09.627354] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T18:37:09.802202] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-23T18:37:10.166410] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T18:37:10.602193] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-23T18:37:11.402224] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-23T18:37:12.202196] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-23T18:37:12.264902] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T18:37:12.917020] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:37:13.002240] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-23T18:37:13.751311] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T18:37:13.802185] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-23T18:37:14.570572] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T18:37:14.579031] [INFO ] [REMOTE ] EMN: Full fetch complete (71940 records). [2025-09-23T18:37:14.579215] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-23T18:37:14.612638] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-23T18:37:14.984071] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-23T18:37:14.984170] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-23T18:37:14.985146] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-23T18:37:14.985234] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-23T18:37:14.986917] [DEBUG] [LOCAL ] EMN: Trimmed 71940 records to 50354 (keeping 200 days of data) [2025-09-23T18:37:15.315576] [DEBUG] [LOCAL ] EMN: Primary data saved (50354 records). [2025-09-23T18:37:15.316090] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-23T18:37:15.316478] [INFO ] [MAIN ] Update Progress: 734/2372 symbols completed. EMN took 39.3s. Estimated remaining: 3h 36m 55s. Rate: 7.6 symbols/min [2025-09-23T18:37:15.418832] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-23T18:37:15.516701] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:15.537117] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T18:37:15.592403] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:37:15.614495] [DEBUG] [LOCAL ] ENB: Loaded 53518 existing records from primary storage. [2025-09-23T18:37:15.614634] [INFO ] [MAIN ] ENB: Loaded 53518 existing records. [2025-09-23T18:37:15.798966] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:15.799258] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-23T18:37:15.799320] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-23T18:37:15.800771] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-23T18:37:15.800834] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-23T18:37:16.096336] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T18:37:16.179442] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:16.202141] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-23T18:37:17.002221] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-23T18:37:17.802160] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-23T18:37:18.071102] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T18:37:18.536460] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T18:37:18.538185] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:37:18.539522] [INFO ] [REMOTE ] EMP: Full fetch complete (4252 records). [2025-09-23T18:37:18.550274] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-23T18:37:18.551189] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:37:18.551298] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:37:18.551692] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:37:18.551819] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-23T18:37:18.551917] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-23T18:37:18.551997] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-09-23T18:37:18.552387] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-09-23T18:37:18.552539] [INFO ] [MAIN ] Update Progress: 735/2372 symbols completed. EMP took 20.6s. Estimated remaining: 3h 36m 37s. Rate: 7.6 symbols/min [2025-09-23T18:37:18.610098] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-23T18:37:18.733426] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:18.740569] [DEBUG] [LOCAL ] ENFY: Loaded 3051 existing records from primary storage. [2025-09-23T18:37:18.740684] [INFO ] [MAIN ] ENFY: Loaded 3051 existing records. [2025-09-23T18:37:18.916728] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:18.917010] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-23T18:37:18.917067] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-23T18:37:18.917387] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-23T18:37:18.917448] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-23T18:37:19.281884] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:19.402208] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-23T18:37:19.916279] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-23T18:37:20.202219] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-23T18:37:20.575942] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T18:37:21.002206] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-23T18:37:21.313088] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T18:37:21.324256] [INFO ] [REMOTE ] EME: Full fetch complete (46958 records). [2025-09-23T18:37:21.324406] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-23T18:37:21.724200] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-23T18:37:21.724307] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-23T18:37:21.725227] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-23T18:37:21.725301] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-23T18:37:21.727151] [DEBUG] [LOCAL ] EME: Trimmed 46958 records to 31702 (keeping 200 days of data) [2025-09-23T18:37:21.809897] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-23T18:37:21.956855] [DEBUG] [LOCAL ] EME: Primary data saved (31702 records). [2025-09-23T18:37:21.957008] [INFO ] [MAIN ] EME: Full history saved. [2025-09-23T18:37:21.957143] [INFO ] [MAIN ] Update Progress: 736/2372 symbols completed. EME took 55.1s. Estimated remaining: 3h 36m 18s. Rate: 7.6 symbols/min [2025-09-23T18:37:22.126463] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:22.169260] [DEBUG] [LOCAL ] ENIC: Loaded 36699 existing records from primary storage. [2025-09-23T18:37:22.169404] [INFO ] [MAIN ] ENIC: Loaded 36699 existing records. [2025-09-23T18:37:22.365125] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:22.365556] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-23T18:37:22.365662] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-23T18:37:22.372355] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T18:37:22.374805] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-23T18:37:22.375726] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-23T18:37:22.604666] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-23T18:37:22.773002] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:22.853284] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T18:37:23.061022] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T18:37:23.402271] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-23T18:37:24.202215] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-23T18:37:24.874851] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:37:25.002214] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-23T18:37:25.802210] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-23T18:37:26.119812] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T18:37:26.123589] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T18:37:26.447786] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:37:26.456532] [INFO ] [REMOTE ] EMR: Full fetch complete (77110 records). [2025-09-23T18:37:26.456726] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-23T18:37:26.609975] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-23T18:37:26.882127] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-23T18:37:26.882260] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-23T18:37:26.883288] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-23T18:37:26.883356] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-23T18:37:26.885051] [DEBUG] [LOCAL ] EMR: Trimmed 77110 records to 53256 (keeping 200 days of data) [2025-09-23T18:37:27.238093] [DEBUG] [LOCAL ] EMR: Primary data saved (53256 records). [2025-09-23T18:37:27.238252] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-23T18:37:27.238391] [INFO ] [MAIN ] Update Progress: 737/2372 symbols completed. EMR took 24.6s. Estimated remaining: 3h 36m 5s. Rate: 7.6 symbols/min [2025-09-23T18:37:27.409524] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-23T18:37:27.446684] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:27.453547] [DEBUG] [LOCAL ] ENO: Loaded 1966 existing records from primary storage. [2025-09-23T18:37:27.453740] [INFO ] [MAIN ] ENO: Loaded 1966 existing records. [2025-09-23T18:37:27.656918] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:27.657247] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-23T18:37:27.657296] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-23T18:37:27.657599] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-23T18:37:27.657700] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-23T18:37:27.805007] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T18:37:28.014950] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:28.202163] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-23T18:37:28.377970] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T18:37:28.624688] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T18:37:29.002202] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-23T18:37:29.802212] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-23T18:37:30.127316] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T18:37:30.602244] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-23T18:37:30.935978] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T18:37:31.356276] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T18:37:31.402250] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-23T18:37:32.202230] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-23T18:37:33.002212] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-23T18:37:33.280717] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T18:37:33.534413] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T18:37:33.687518] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T18:37:33.802192] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-23T18:37:34.602202] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-23T18:37:34.919440] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T18:37:35.152715] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:37:35.402191] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-23T18:37:35.717712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T18:37:36.202189] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-23T18:37:36.621305] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-23T18:37:37.002205] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-23T18:37:37.505734] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T18:37:37.802197] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-23T18:37:38.602213] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-23T18:37:38.986492] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T18:37:39.402163] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-23T18:37:39.452933] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:37:40.003197] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T18:37:40.004368] [INFO ] [REMOTE ] ENFY: Full fetch complete (5616 records). [2025-09-23T18:37:40.004441] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-23T18:37:40.211098] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-23T18:37:40.389121] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-23T18:37:40.389208] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-23T18:37:40.389401] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-23T18:37:40.389441] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-23T18:37:40.389941] [DEBUG] [LOCAL ] ENFY: Trimmed 5616 records to 3059 (keeping 200 days of data) [2025-09-23T18:37:40.411101] [DEBUG] [LOCAL ] ENFY: Primary data saved (3059 records). [2025-09-23T18:37:40.411270] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-23T18:37:40.411405] [INFO ] [MAIN ] Update Progress: 738/2372 symbols completed. ENFY took 21.9s. Estimated remaining: 3h 36m 8s. Rate: 7.6 symbols/min [2025-09-23T18:37:40.590957] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:40.657549] [DEBUG] [LOCAL ] ENOV: Loaded 45225 existing records from primary storage. [2025-09-23T18:37:40.657747] [INFO ] [MAIN ] ENOV: Loaded 45225 existing records. [2025-09-23T18:37:40.799951] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T18:37:40.840266] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:40.840485] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-23T18:37:40.840532] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-23T18:37:40.841855] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-23T18:37:40.841917] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-23T18:37:41.022302] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-23T18:37:41.209814] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:41.802229] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-23T18:37:42.296580] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T18:37:42.602261] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-23T18:37:43.292042] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T18:37:43.407391] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-23T18:37:43.420380] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T18:37:44.202235] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-23T18:37:44.880181] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:37:45.002145] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-23T18:37:45.653750] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T18:37:45.802195] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-23T18:37:46.165830] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T18:37:46.602210] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-23T18:37:47.402188] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-23T18:37:47.514312] [DEBUG] [REMOTE ] ENIC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-23T18:37:47.514717] [WARN ] [REMOTE ] ENIC: No data returned for month 2025-04 [2025-09-23T18:37:47.644897] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:37:47.739913] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-23T18:37:48.202202] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-23T18:37:49.002202] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-23T18:37:49.656920] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:37:49.802193] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-23T18:37:50.582101] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:37:50.602150] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-23T18:37:50.946572] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:37:51.402198] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-23T18:37:51.916917] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T18:37:52.202223] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-23T18:37:52.267068] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:37:52.627869] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T18:37:53.002256] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-23T18:37:53.802210] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-23T18:37:54.340843] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:37:54.602196] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-23T18:37:55.041205] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T18:37:55.352427] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T18:37:55.402191] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-23T18:37:56.202207] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-23T18:37:56.380568] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:37:57.002199] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-23T18:37:57.434204] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T18:37:57.447054] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T18:37:57.448038] [INFO ] [REMOTE ] ENO: Full fetch complete (3130 records). [2025-09-23T18:37:57.448109] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-23T18:37:57.813314] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-23T18:37:57.820829] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-23T18:37:57.821874] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-23T18:37:57.822039] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-23T18:37:57.822081] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-23T18:37:57.822437] [DEBUG] [LOCAL ] ENO: Trimmed 3130 records to 1954 (keeping 200 days of data) [2025-09-23T18:37:57.834787] [DEBUG] [LOCAL ] ENO: Primary data saved (1954 records). [2025-09-23T18:37:57.834850] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-23T18:37:57.834919] [INFO ] [MAIN ] Update Progress: 739/2372 symbols completed. ENO took 30.6s. Estimated remaining: 3h 36m 21s. Rate: 7.5 symbols/min [2025-09-23T18:37:58.011538] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:58.057629] [DEBUG] [LOCAL ] ENR: Loaded 42631 existing records from primary storage. [2025-09-23T18:37:58.057839] [INFO ] [MAIN ] ENR: Loaded 42631 existing records. [2025-09-23T18:37:58.237619] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:58.237899] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-23T18:37:58.237956] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-23T18:37:58.239018] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-23T18:37:58.239079] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-23T18:37:58.591757] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:58.602143] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-23T18:37:59.402925] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-23T18:37:59.408121] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T18:37:59.417350] [INFO ] [REMOTE ] ENB: Full fetch complete (77492 records). [2025-09-23T18:37:59.417518] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-23T18:37:59.880660] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-23T18:37:59.880853] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-23T18:37:59.881871] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-23T18:37:59.881982] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-23T18:37:59.900319] [DEBUG] [LOCAL ] ENB: Trimmed 77492 records to 53518 (keeping 200 days of data) [2025-09-23T18:37:59.904049] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T18:38:00.206814] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-23T18:38:00.257759] [DEBUG] [LOCAL ] ENB: Primary data saved (53518 records). [2025-09-23T18:38:00.257890] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-23T18:38:00.257978] [INFO ] [MAIN ] Update Progress: 740/2372 symbols completed. ENB took 44.9s. Estimated remaining: 3h 36m 1s. Rate: 7.6 symbols/min [2025-09-23T18:38:00.426700] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:00.458390] [DEBUG] [LOCAL ] ENS: Loaded 29351 existing records from primary storage. [2025-09-23T18:38:00.458528] [INFO ] [MAIN ] ENS: Loaded 29351 existing records. [2025-09-23T18:38:00.641797] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:00.642141] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-23T18:38:00.656275] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-23T18:38:00.657420] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:38:00.662571] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-23T18:38:00.663037] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-23T18:38:00.706726] [INFO ] [REMOTE ] ENIC: Full fetch complete (45308 records). [2025-09-23T18:38:00.733806] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-23T18:38:01.022991] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-23T18:38:01.065442] [WARN ] [VALIDATOR ] ENIC: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T18:38:01.095987] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:38:01.114374] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:38:01.126219] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-23T18:38:01.142999] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-09-23T18:38:01.154545] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-09-23T18:38:01.165705] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-09-23T18:38:01.176071] [INFO ] [MAIN ] Update Progress: 741/2372 symbols completed. ENIC took 39.2s. Estimated remaining: 3h 35m 38s. Rate: 7.6 symbols/min [2025-09-23T18:38:01.309302] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:01.418437] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:01.418618] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-09-23T18:38:01.418688] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-09-23T18:38:01.418843] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-23T18:38:01.418889] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-23T18:38:01.418929] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-23T18:38:01.418960] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-23T18:38:01.805507] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-23T18:38:01.805395] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:01.954570] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T18:38:02.119898] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T18:38:02.602258] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-23T18:38:02.917630] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:38:03.402188] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-23T18:38:04.042384] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:38:04.202202] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-23T18:38:04.782800] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T18:38:05.002290] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-23T18:38:05.685056] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T18:38:05.802198] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-23T18:38:06.250403] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:38:06.258205] [INFO ] [REMOTE ] ENOV: Full fetch complete (63084 records). [2025-09-23T18:38:06.258358] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-23T18:38:06.608790] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-23T18:38:06.655581] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-23T18:38:06.655709] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-23T18:38:06.656518] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-23T18:38:06.656567] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-23T18:38:06.657985] [DEBUG] [LOCAL ] ENOV: Trimmed 63084 records to 45210 (keeping 200 days of data) [2025-09-23T18:38:06.932465] [DEBUG] [LOCAL ] ENOV: Primary data saved (45210 records). [2025-09-23T18:38:06.932593] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-23T18:38:06.932708] [INFO ] [MAIN ] Update Progress: 742/2372 symbols completed. ENOV took 26.5s. Estimated remaining: 3h 35m 25s. Rate: 7.6 symbols/min [2025-09-23T18:38:07.120467] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:07.135757] [DEBUG] [LOCAL ] EOD: Loaded 14053 existing records from primary storage. [2025-09-23T18:38:07.135876] [INFO ] [MAIN ] EOD: Loaded 14053 existing records. [2025-09-23T18:38:07.332831] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:07.333341] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-23T18:38:07.333411] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-23T18:38:07.341412] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-23T18:38:07.361589] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-23T18:38:07.408638] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T18:38:07.408732] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-23T18:38:07.713880] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:38:07.775893] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:08.202172] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-23T18:38:08.678806] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:38:08.918340] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:38:09.002241] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-23T18:38:09.796104] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:38:09.802138] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-23T18:38:10.494589] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T18:38:10.602200] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-23T18:38:11.169664] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T18:38:11.402222] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-23T18:38:12.202181] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-23T18:38:12.271499] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T18:38:13.002237] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-23T18:38:13.520533] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:38:13.802221] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-23T18:38:14.602254] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-23T18:38:14.632555] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T18:38:15.087534] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T18:38:15.250879] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T18:38:15.402225] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-23T18:38:16.202197] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-23T18:38:16.585272] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T18:38:17.002236] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-23T18:38:17.606557] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:38:17.623999] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T18:38:17.802208] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-23T18:38:18.602197] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-23T18:38:19.054409] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T18:38:19.402303] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-23T18:38:19.510826] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T18:38:20.202284] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-23T18:38:20.495866] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T18:38:20.892943] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-23T18:38:21.002267] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-23T18:38:21.802268] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-23T18:38:21.891401] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:38:22.602278] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-23T18:38:23.349803] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T18:38:23.402251] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-23T18:38:23.560733] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T18:38:24.202204] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-23T18:38:24.530871] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:38:24.959632] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T18:38:25.002213] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-23T18:38:25.802203] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-23T18:38:26.248560] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T18:38:26.602190] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-23T18:38:27.059355] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:38:27.067595] [INFO ] [REMOTE ] ENR: Full fetch complete (58051 records). [2025-09-23T18:38:27.067840] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-23T18:38:27.408813] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-23T18:38:27.529559] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-23T18:38:27.529780] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-23T18:38:27.531471] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-23T18:38:27.532177] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-23T18:38:27.532076] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T18:38:27.538243] [DEBUG] [LOCAL ] ENR: Trimmed 58051 records to 42760 (keeping 200 days of data) [2025-09-23T18:38:27.853933] [DEBUG] [LOCAL ] ENR: Primary data saved (42760 records). [2025-09-23T18:38:27.854170] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-23T18:38:27.854316] [INFO ] [MAIN ] Update Progress: 743/2372 symbols completed. ENR took 30.0s. Estimated remaining: 3h 35m 46s. Rate: 7.6 symbols/min [2025-09-23T18:38:28.043445] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:28.103149] [DEBUG] [LOCAL ] EOG: Loaded 53341 existing records from primary storage. [2025-09-23T18:38:28.103345] [INFO ] [MAIN ] EOG: Loaded 53341 existing records. [2025-09-23T18:38:28.210352] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-23T18:38:28.299233] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:28.300320] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-23T18:38:28.300391] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-23T18:38:28.301929] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-23T18:38:28.301993] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-23T18:38:28.537500] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:38:28.708049] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:29.002214] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-23T18:38:29.230181] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:38:29.802194] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-23T18:38:29.920547] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T18:38:30.602191] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-23T18:38:30.758429] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T18:38:30.762246] [INFO ] [REMOTE ] EOD: Full fetch complete (19845 records). [2025-09-23T18:38:30.762338] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-23T18:38:31.135802] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-23T18:38:31.135883] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-23T18:38:31.136300] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-23T18:38:31.136340] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-23T18:38:31.136955] [DEBUG] [LOCAL ] EOD: Trimmed 19845 records to 13989 (keeping 200 days of data) [2025-09-23T18:38:31.217319] [DEBUG] [LOCAL ] EOD: Primary data saved (13989 records). [2025-09-23T18:38:31.217467] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-23T18:38:31.218079] [INFO ] [MAIN ] Update Progress: 744/2372 symbols completed. EOD took 24.3s. Estimated remaining: 3h 35m 28s. Rate: 7.6 symbols/min [2025-09-23T18:38:31.392282] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:31.403945] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-23T18:38:31.404323] [DEBUG] [LOCAL ] EOI: Loaded 10586 existing records from primary storage. [2025-09-23T18:38:31.405627] [INFO ] [MAIN ] EOI: Loaded 10586 existing records. [2025-09-23T18:38:31.591785] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:31.592117] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-23T18:38:31.592195] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-23T18:38:31.592841] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-23T18:38:31.592984] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-23T18:38:31.679910] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T18:38:31.991524] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:32.202188] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-23T18:38:32.804215] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T18:38:32.993604] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T18:38:33.004044] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-23T18:38:33.802195] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-23T18:38:33.830150] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T18:38:34.602248] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-23T18:38:34.872898] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T18:38:35.091830] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:38:35.402252] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-23T18:38:35.962609] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T18:38:36.202282] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-23T18:38:37.002211] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-23T18:38:37.316971] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T18:38:37.321955] [INFO ] [REMOTE ] ENVA: Full fetch complete (36587 records). [2025-09-23T18:38:37.322090] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-23T18:38:37.716495] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-23T18:38:37.716611] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-23T18:38:37.717204] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-23T18:38:37.717260] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-23T18:38:37.718340] [DEBUG] [LOCAL ] ENVA: Trimmed 36587 records to 25785 (keeping 200 days of data) [2025-09-23T18:38:37.803507] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-23T18:38:37.873750] [DEBUG] [LOCAL ] ENVA: Primary data saved (25785 records). [2025-09-23T18:38:37.873886] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-23T18:38:37.873963] [INFO ] [MAIN ] Update Progress: 745/2372 symbols completed. ENVA took 36.7s. Estimated remaining: 3h 35m 17s. Rate: 7.6 symbols/min [2025-09-23T18:38:38.043821] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:38.060746] [DEBUG] [LOCAL ] EOS: Loaded 15475 existing records from primary storage. [2025-09-23T18:38:38.060933] [INFO ] [MAIN ] EOS: Loaded 15475 existing records. [2025-09-23T18:38:38.252683] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:38.252961] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-23T18:38:38.253012] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-23T18:38:38.253553] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-23T18:38:38.253614] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-23T18:38:38.620480] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-23T18:38:38.626278] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:38.794439] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T18:38:38.818505] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T18:38:39.402196] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-23T18:38:39.870186] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:38:39.875638] [INFO ] [REMOTE ] ENS: Full fetch complete (41901 records). [2025-09-23T18:38:39.875803] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-23T18:38:40.213373] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-23T18:38:40.265423] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-23T18:38:40.265505] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-23T18:38:40.266160] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-23T18:38:40.266226] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-23T18:38:40.267254] [DEBUG] [LOCAL ] ENS: Trimmed 41901 records to 29449 (keeping 200 days of data) [2025-09-23T18:38:40.447777] [DEBUG] [LOCAL ] ENS: Primary data saved (29449 records). [2025-09-23T18:38:40.447911] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-23T18:38:40.447993] [INFO ] [MAIN ] Update Progress: 746/2372 symbols completed. ENS took 40.2s. Estimated remaining: 3h 34m 57s. Rate: 7.6 symbols/min [2025-09-23T18:38:40.622859] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:40.631860] [DEBUG] [LOCAL ] EOT: Loaded 6845 existing records from primary storage. [2025-09-23T18:38:40.631979] [INFO ] [MAIN ] EOT: Loaded 6845 existing records. [2025-09-23T18:38:40.816954] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:40.817353] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-23T18:38:40.817406] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-23T18:38:40.817722] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-23T18:38:40.817784] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-23T18:38:41.007574] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-23T18:38:41.186240] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T18:38:41.220988] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:41.244321] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T18:38:41.802199] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-23T18:38:41.847747] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T18:38:42.604848] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-23T18:38:42.609542] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T18:38:43.402236] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-23T18:38:43.605166] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:38:44.022712] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T18:38:44.202204] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-23T18:38:44.894540] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T18:38:45.002193] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-23T18:38:45.802243] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-23T18:38:46.101192] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T18:38:46.410615] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T18:38:46.602241] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-23T18:38:47.037033] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T18:38:47.402212] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-23T18:38:48.161406] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T18:38:48.202154] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-23T18:38:48.308047] [DEBUG] [REMOTE ] EOT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-23T18:38:48.308359] [WARN ] [REMOTE ] EOT: No data returned for month 2025-03 [2025-09-23T18:38:49.002250] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-23T18:38:49.802200] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-23T18:38:50.547867] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T18:38:50.582933] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:38:50.602154] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-23T18:38:51.402202] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-23T18:38:52.094485] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T18:38:52.150865] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T18:38:52.202193] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-23T18:38:52.786140] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T18:38:53.002194] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-23T18:38:53.744254] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T18:38:53.802153] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-23T18:38:54.602245] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-23T18:38:54.632148] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T18:38:55.402191] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-23T18:38:55.497848] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T18:38:55.992858] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T18:38:56.202207] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-23T18:38:56.700338] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T18:38:57.002208] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-23T18:38:57.685821] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:38:57.802193] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-23T18:38:58.269759] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T18:38:58.602250] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-23T18:38:59.402313] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-23T18:38:59.428340] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T18:39:00.023339] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T18:39:00.025227] [INFO ] [REMOTE ] EOT: Full fetch complete (9827 records). [2025-09-23T18:39:00.025296] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-23T18:39:00.204272] [WARN ] [VALIDATOR ] EOT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T18:39:00.204402] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-23T18:39:00.205093] [FATAL] [MAIN ] EOT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:39:00.205879] [WARN ] [MAIN ] EOT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:39:00.205953] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-23T18:39:00.206038] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-09-23T18:39:00.206093] [INFO ] [LOCAL ] EOT: Starting deletion of derivative data. [2025-09-23T18:39:00.206473] [DEBUG] [LOCAL ] EOT: Deleted derivative data file. [2025-09-23T18:39:00.206583] [INFO ] [MAIN ] Update Progress: 747/2372 symbols completed. EOT took 19.8s. Estimated remaining: 3h 35m 15s. Rate: 7.5 symbols/min [2025-09-23T18:39:00.376860] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:00.403574] [DEBUG] [LOCAL ] EPAC: Loaded 27030 existing records from primary storage. [2025-09-23T18:39:00.403758] [INFO ] [MAIN ] EPAC: Loaded 27030 existing records. [2025-09-23T18:39:00.578375] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:00.578615] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-23T18:39:00.578691] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-23T18:39:00.579472] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-23T18:39:00.579533] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-23T18:39:00.934026] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:01.002182] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-23T18:39:01.802245] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-23T18:39:02.538937] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:39:02.602247] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-23T18:39:02.919336] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-23T18:39:03.402216] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-23T18:39:03.884705] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T18:39:03.886906] [INFO ] [REMOTE ] EOI: Full fetch complete (15952 records). [2025-09-23T18:39:03.886984] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-23T18:39:04.207306] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-23T18:39:04.279487] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-23T18:39:04.279572] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-23T18:39:04.279990] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-23T18:39:04.280052] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-23T18:39:04.280577] [DEBUG] [LOCAL ] EOI: Trimmed 15952 records to 10531 (keeping 200 days of data) [2025-09-23T18:39:04.345462] [DEBUG] [LOCAL ] EOI: Primary data saved (10531 records). [2025-09-23T18:39:04.345581] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-23T18:39:04.345686] [INFO ] [MAIN ] Update Progress: 748/2372 symbols completed. EOI took 33.1s. Estimated remaining: 3h 34m 59s. Rate: 7.6 symbols/min [2025-09-23T18:39:04.511666] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:04.551746] [DEBUG] [LOCAL ] EPAM: Loaded 39649 existing records from primary storage. [2025-09-23T18:39:04.551882] [INFO ] [MAIN ] EPAM: Loaded 39649 existing records. [2025-09-23T18:39:04.736386] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:04.736958] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-23T18:39:04.750710] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-23T18:39:04.751731] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-23T18:39:04.753694] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-23T18:39:04.757416] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-23T18:39:05.005617] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-23T18:39:05.073991] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T18:39:05.125931] [INFO ] [REMOTE ] EOS: Full fetch complete (23045 records). [2025-09-23T18:39:05.132535] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:05.133315] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-23T18:39:05.506486] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-23T18:39:05.506613] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-23T18:39:05.507115] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-23T18:39:05.507192] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-23T18:39:05.508030] [DEBUG] [LOCAL ] EOS: Trimmed 23045 records to 15392 (keeping 200 days of data) [2025-09-23T18:39:05.603870] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T18:39:05.639877] [DEBUG] [LOCAL ] EOS: Primary data saved (15392 records). [2025-09-23T18:39:05.640000] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-23T18:39:05.640082] [INFO ] [MAIN ] Update Progress: 749/2372 symbols completed. EOS took 27.8s. Estimated remaining: 3h 34m 37s. Rate: 7.6 symbols/min [2025-09-23T18:39:05.807886] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:05.807952] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-23T18:39:05.846529] [DEBUG] [LOCAL ] EPC: Loaded 39905 existing records from primary storage. [2025-09-23T18:39:05.846696] [INFO ] [MAIN ] EPC: Loaded 39905 existing records. [2025-09-23T18:39:06.028474] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:06.028903] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-23T18:39:06.028974] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-23T18:39:06.035288] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-23T18:39:06.042368] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-23T18:39:06.074757] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T18:39:06.398973] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:06.602180] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-23T18:39:07.402230] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-23T18:39:07.496933] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T18:39:08.149169] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T18:39:08.202199] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-23T18:39:08.439020] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T18:39:09.002249] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-23T18:39:09.556045] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:39:09.802269] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-23T18:39:10.602259] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-23T18:39:10.767020] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T18:39:10.866523] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T18:39:11.402238] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-23T18:39:11.618163] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T18:39:12.202261] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-23T18:39:13.002218] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-23T18:39:13.027376] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T18:39:13.036132] [INFO ] [REMOTE ] EOG: Full fetch complete (77270 records). [2025-09-23T18:39:13.036553] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-23T18:39:13.429479] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-23T18:39:13.429562] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-23T18:39:13.430457] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-23T18:39:13.430520] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-23T18:39:13.432151] [DEBUG] [LOCAL ] EOG: Trimmed 77270 records to 53341 (keeping 200 days of data) [2025-09-23T18:39:13.765036] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:39:13.796862] [DEBUG] [LOCAL ] EOG: Primary data saved (53341 records). [2025-09-23T18:39:13.797028] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-23T18:39:13.797120] [INFO ] [MAIN ] Update Progress: 750/2372 symbols completed. EOG took 45.9s. Estimated remaining: 3h 34m 29s. Rate: 7.6 symbols/min [2025-09-23T18:39:13.808614] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-23T18:39:13.980039] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:13.994064] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T18:39:14.047067] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-23T18:39:14.047230] [INFO ] [MAIN ] EPD: Loaded 53616 existing records. [2025-09-23T18:39:14.229048] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:14.229302] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-23T18:39:14.229352] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-23T18:39:14.230669] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-23T18:39:14.230733] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-23T18:39:14.600947] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:14.602155] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-23T18:39:15.402168] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-23T18:39:15.490229] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T18:39:16.202263] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-23T18:39:16.398906] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:39:17.002208] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-23T18:39:17.127035] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-23T18:39:17.802258] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-23T18:39:18.602173] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-23T18:39:18.664807] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-23T18:39:18.691987] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T18:39:19.402240] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-23T18:39:19.506470] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T18:39:19.780395] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:39:20.204468] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-23T18:39:20.208688] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:39:21.002216] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-23T18:39:21.423936] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T18:39:21.802202] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-23T18:39:22.452558] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T18:39:22.602196] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-23T18:39:23.078599] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:39:23.402190] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-23T18:39:23.669743] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T18:39:24.202233] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-23T18:39:25.002251] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-23T18:39:25.053423] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T18:39:25.802227] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-23T18:39:25.871025] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:39:26.210895] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T18:39:26.602232] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-23T18:39:27.209080] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:39:27.215104] [INFO ] [REMOTE ] EPAC: Full fetch complete (39082 records). [2025-09-23T18:39:27.215234] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-23T18:39:27.419246] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-23T18:39:27.611684] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-23T18:39:27.611815] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-23T18:39:27.612544] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-23T18:39:27.612663] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-23T18:39:27.617924] [DEBUG] [LOCAL ] EPAC: Trimmed 39082 records to 27051 (keeping 200 days of data) [2025-09-23T18:39:27.779268] [DEBUG] [LOCAL ] EPAC: Primary data saved (27051 records). [2025-09-23T18:39:27.779404] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-23T18:39:27.779592] [INFO ] [MAIN ] Update Progress: 751/2372 symbols completed. EPAC took 27.6s. Estimated remaining: 3h 34m 34s. Rate: 7.6 symbols/min [2025-09-23T18:39:27.948585] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:27.996852] [DEBUG] [LOCAL ] EPR: Loaded 44290 existing records from primary storage. [2025-09-23T18:39:27.997030] [INFO ] [MAIN ] EPR: Loaded 44290 existing records. [2025-09-23T18:39:28.209714] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-23T18:39:28.210874] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:28.213533] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-23T18:39:28.213628] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-23T18:39:28.215420] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-23T18:39:28.215511] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-23T18:39:28.821120] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-23T18:39:28.883216] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T18:39:28.983512] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:29.002236] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-23T18:39:29.301115] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T18:39:29.802215] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-23T18:39:30.602200] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-23T18:39:31.402207] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-23T18:39:31.704789] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T18:39:32.026878] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (3.02 seconds). [2025-09-23T18:39:32.202151] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-23T18:39:32.527570] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T18:39:32.601104] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-23T18:39:33.002194] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-23T18:39:33.802156] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-23T18:39:34.053211] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-23T18:39:34.180208] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T18:39:34.602216] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-23T18:39:34.917412] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T18:39:35.402220] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-23T18:39:36.202174] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-23T18:39:36.555315] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T18:39:36.661013] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T18:39:37.002215] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-23T18:39:37.309021] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T18:39:37.316040] [INFO ] [REMOTE ] EPC: Full fetch complete (56718 records). [2025-09-23T18:39:37.316177] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-23T18:39:37.718328] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-23T18:39:37.718441] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-23T18:39:37.719525] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-23T18:39:37.719639] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-23T18:39:37.720989] [DEBUG] [LOCAL ] EPC: Trimmed 56718 records to 39891 (keeping 200 days of data) [2025-09-23T18:39:37.820594] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-23T18:39:37.979600] [DEBUG] [LOCAL ] EPC: Primary data saved (39891 records). [2025-09-23T18:39:37.979771] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-23T18:39:37.979942] [INFO ] [MAIN ] Update Progress: 752/2372 symbols completed. EPC took 32.3s. Estimated remaining: 3h 34m 31s. Rate: 7.6 symbols/min [2025-09-23T18:39:38.154574] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:38.154797] [DEBUG] [LOCAL ] EPRT: No existing data file found in primary storage. [2025-09-23T18:39:38.154852] [WARN ] [MAIN ] EPRT: No existing data found, performing full refresh instead. [2025-09-23T18:39:38.154993] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-23T18:39:38.155071] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-23T18:39:38.155127] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-09-23T18:39:38.155183] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-23T18:39:38.535041] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:38.607269] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-23T18:39:38.627275] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:39:39.407405] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-23T18:39:39.419817] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T18:39:39.430861] [INFO ] [REMOTE ] EPAM: Full fetch complete (56098 records). [2025-09-23T18:39:39.431004] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-23T18:39:39.832281] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-23T18:39:39.832466] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-23T18:39:39.833569] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-23T18:39:39.833678] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-23T18:39:39.837556] [DEBUG] [LOCAL ] EPAM: Trimmed 56098 records to 39711 (keeping 200 days of data) [2025-09-23T18:39:39.990775] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T18:39:40.149587] [DEBUG] [LOCAL ] EPAM: Primary data saved (39711 records). [2025-09-23T18:39:40.149770] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-23T18:39:40.149914] [INFO ] [MAIN ] Update Progress: 753/2372 symbols completed. EPAM took 35.8s. Estimated remaining: 3h 34m 11s. Rate: 7.6 symbols/min [2025-09-23T18:39:40.213854] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-23T18:39:40.328161] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:40.342304] [DEBUG] [LOCAL ] EQBK: Loaded 10916 existing records from primary storage. [2025-09-23T18:39:40.342464] [INFO ] [MAIN ] EQBK: Loaded 10916 existing records. [2025-09-23T18:39:40.533394] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:40.533945] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-23T18:39:40.534012] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-23T18:39:40.534510] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-23T18:39:40.534573] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-23T18:39:40.911802] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:41.002275] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-23T18:39:41.208027] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T18:39:41.219194] [INFO ] [REMOTE ] EPD: Full fetch complete (77645 records). [2025-09-23T18:39:41.219386] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-23T18:39:41.626711] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-23T18:39:41.626863] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-23T18:39:41.628066] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-23T18:39:41.638083] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-23T18:39:41.657270] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:39:41.667030] [DEBUG] [LOCAL ] EPD: Trimmed 77645 records to 53616 (keeping 200 days of data) [2025-09-23T18:39:41.676291] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T18:39:41.805768] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-23T18:39:42.030063] [DEBUG] [LOCAL ] EPD: Primary data saved (53616 records). [2025-09-23T18:39:42.030216] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-23T18:39:42.030376] [INFO ] [MAIN ] Update Progress: 754/2372 symbols completed. EPD took 28.2s. Estimated remaining: 3h 33m 50s. Rate: 7.6 symbols/min [2025-09-23T18:39:42.202562] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:42.259005] [DEBUG] [LOCAL ] EQH: Loaded 52672 existing records from primary storage. [2025-09-23T18:39:42.259161] [INFO ] [MAIN ] EQH: Loaded 52672 existing records. [2025-09-23T18:39:42.433508] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:42.433814] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-23T18:39:42.433864] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-23T18:39:42.435161] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-23T18:39:42.435222] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-23T18:39:42.607351] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-23T18:39:42.796147] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:42.980601] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T18:39:43.402192] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-23T18:39:44.011772] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:39:44.202168] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-23T18:39:44.261737] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T18:39:44.824672] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T18:39:45.002222] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-23T18:39:45.802172] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-23T18:39:45.828086] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T18:39:46.602208] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-23T18:39:47.079023] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:39:47.402195] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-23T18:39:48.020688] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T18:39:48.186047] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T18:39:48.202150] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-23T18:39:49.002202] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-23T18:39:49.601559] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:39:49.802189] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-23T18:39:50.325833] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T18:39:50.602193] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-23T18:39:51.402189] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-23T18:39:51.478237] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T18:39:51.891859] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T18:39:52.202232] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-23T18:39:52.818008] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T18:39:52.847602] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:39:53.002198] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-23T18:39:53.469540] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T18:39:53.802232] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-23T18:39:54.602225] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-23T18:39:55.402228] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-23T18:39:55.475337] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:39:55.878978] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T18:39:56.086856] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:39:56.202261] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-23T18:39:57.002198] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-23T18:39:57.533286] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T18:39:57.802207] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-23T18:39:58.566479] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T18:39:58.602146] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-23T18:39:59.402209] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-23T18:39:59.597480] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T18:39:59.926098] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T18:40:00.208919] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-23T18:40:00.217393] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T18:40:01.002238] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-23T18:40:01.326395] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:40:01.329223] [INFO ] [REMOTE ] EQBK: Full fetch complete (15286 records). [2025-09-23T18:40:01.329306] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-23T18:40:01.329822] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:40:01.329911] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:40:01.329975] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:40:01.330039] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-23T18:40:01.330114] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-09-23T18:40:01.330165] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-09-23T18:40:01.330842] [DEBUG] [LOCAL ] EQBK: Deleted derivative data file. [2025-09-23T18:40:01.330939] [INFO ] [MAIN ] Update Progress: 755/2372 symbols completed. EQBK took 21.2s. Estimated remaining: 3h 34m 6s. Rate: 7.6 symbols/min [2025-09-23T18:40:01.540074] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:01.600253] [DEBUG] [LOCAL ] EQNR: Loaded 53042 existing records from primary storage. [2025-09-23T18:40:01.600406] [INFO ] [MAIN ] EQNR: Loaded 53042 existing records. [2025-09-23T18:40:01.804400] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-23T18:40:01.811037] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:01.812584] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-23T18:40:01.812889] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-23T18:40:01.815269] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-23T18:40:01.815363] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-23T18:40:02.218227] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:02.602905] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-23T18:40:02.606573] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T18:40:03.402197] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-23T18:40:03.947804] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T18:40:04.207384] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-23T18:40:04.216338] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T18:40:04.981243] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T18:40:04.990279] [INFO ] [REMOTE ] EPR: Full fetch complete (62886 records). [2025-09-23T18:40:04.990575] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-23T18:40:05.009016] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-23T18:40:05.446338] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-23T18:40:05.446594] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-23T18:40:05.448184] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-23T18:40:05.448320] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-23T18:40:05.450914] [DEBUG] [LOCAL ] EPR: Trimmed 62886 records to 44248 (keeping 200 days of data) [2025-09-23T18:40:05.612114] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:40:05.804468] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-23T18:40:05.813315] [DEBUG] [LOCAL ] EPR: Primary data saved (44248 records). [2025-09-23T18:40:05.814713] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-23T18:40:05.814878] [INFO ] [MAIN ] Update Progress: 756/2372 symbols completed. EPR took 38.0s. Estimated remaining: 3h 33m 51s. Rate: 7.6 symbols/min [2025-09-23T18:40:06.013890] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:06.077742] [DEBUG] [LOCAL ] EQR: Loaded 51410 existing records from primary storage. [2025-09-23T18:40:06.077965] [INFO ] [MAIN ] EQR: Loaded 51410 existing records. [2025-09-23T18:40:06.261092] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:06.261378] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-23T18:40:06.261427] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-23T18:40:06.262569] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-23T18:40:06.262631] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-23T18:40:06.605505] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-23T18:40:06.627337] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:07.027581] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T18:40:07.221330] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:40:07.229840] [INFO ] [REMOTE ] EPRT: Full fetch complete (68679 records). [2025-09-23T18:40:07.230006] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-23T18:40:07.412243] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-23T18:40:07.656681] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-23T18:40:07.656976] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-23T18:40:07.658076] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-23T18:40:07.658147] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-23T18:40:07.659834] [DEBUG] [LOCAL ] EPRT: Trimmed 68679 records to 48693 (keeping 200 days of data) [2025-09-23T18:40:07.969761] [DEBUG] [LOCAL ] EPRT: Primary data saved (48693 records). [2025-09-23T18:40:07.969899] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-23T18:40:07.970008] [INFO ] [MAIN ] Update Progress: 757/2372 symbols completed. EPRT took 30.0s. Estimated remaining: 3h 33m 31s. Rate: 7.6 symbols/min [2025-09-23T18:40:08.202176] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-23T18:40:08.488557] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T18:40:09.007484] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-23T18:40:09.032136] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T18:40:09.692140] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T18:40:09.802195] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-23T18:40:10.536428] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T18:40:10.602164] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-23T18:40:11.388799] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T18:40:11.402145] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-23T18:40:11.998614] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:40:12.202203] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-23T18:40:12.942055] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:40:13.002164] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-23T18:40:13.802171] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-23T18:40:13.966473] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T18:40:14.602154] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-23T18:40:14.722638] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T18:40:15.407272] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-23T18:40:15.428368] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T18:40:16.202184] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-23T18:40:16.403013] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T18:40:17.002239] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-23T18:40:17.075520] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T18:40:17.607554] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T18:40:17.802214] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-23T18:40:18.374890] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T18:40:18.602210] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-23T18:40:19.281466] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T18:40:19.402216] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-23T18:40:20.202170] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-23T18:40:20.340493] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T18:40:20.943534] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T18:40:21.002217] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-23T18:40:21.571750] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T18:40:21.582241] [INFO ] [REMOTE ] EQH: Full fetch complete (76310 records). [2025-09-23T18:40:21.582436] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-23T18:40:21.808141] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-23T18:40:22.045996] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-23T18:40:22.046101] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-23T18:40:22.047066] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-23T18:40:22.047134] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-23T18:40:22.048777] [DEBUG] [LOCAL ] EQH: Trimmed 76310 records to 52669 (keeping 200 days of data) [2025-09-23T18:40:22.388430] [DEBUG] [LOCAL ] EQH: Primary data saved (52669 records). [2025-09-23T18:40:22.388587] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-23T18:40:22.388697] [INFO ] [MAIN ] Update Progress: 758/2372 symbols completed. EQH took 40.4s. Estimated remaining: 3h 33m 37s. Rate: 7.6 symbols/min [2025-09-23T18:40:22.662999] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T18:40:22.679537] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-23T18:40:23.537037] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T18:40:23.549611] [INFO ] [REMOTE ] EQNR: Full fetch complete (76756 records). [2025-09-23T18:40:23.549840] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-23T18:40:23.949168] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-23T18:40:23.949383] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-23T18:40:23.950307] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-23T18:40:23.950424] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-23T18:40:23.952381] [DEBUG] [LOCAL ] EQNR: Trimmed 76756 records to 53041 (keeping 200 days of data) [2025-09-23T18:40:24.091803] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T18:40:24.104881] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-23T18:40:24.328810] [DEBUG] [LOCAL ] EQNR: Primary data saved (53041 records). [2025-09-23T18:40:24.328975] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-23T18:40:24.329260] [INFO ] [MAIN ] Update Progress: 759/2372 symbols completed. EQNR took 23.0s. Estimated remaining: 3h 33m 16s. Rate: 7.6 symbols/min [2025-09-23T18:40:25.517567] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:40:25.532050] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-23T18:40:27.234973] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T18:40:27.246358] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-23T18:40:28.597387] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T18:40:28.606298] [INFO ] [REMOTE ] EQR: Full fetch complete (73712 records). [2025-09-23T18:40:28.606597] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-23T18:40:28.998586] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-23T18:40:28.998707] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-23T18:40:28.999566] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-23T18:40:28.999613] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-23T18:40:29.001207] [DEBUG] [LOCAL ] EQR: Trimmed 73712 records to 51413 (keeping 200 days of data) [2025-09-23T18:40:29.320633] [DEBUG] [LOCAL ] EQR: Primary data saved (51413 records). [2025-09-23T18:40:29.320852] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-23T18:40:29.320941] [INFO ] [MAIN ] Update Progress: 760/2372 symbols completed. EQR took 23.5s. Estimated remaining: 3h 33m 2s. Rate: 7.6 symbols/min [2025-09-23T18:40:29.957140] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:29.906540] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:30.020938] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:30.041680] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:30.041933] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-23T18:40:30.042088] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-23T18:40:30.043813] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-23T18:40:30.043928] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-23T18:40:30.044031] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-23T18:40:30.044161] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-23T18:40:30.057989] [DEBUG] [LOCAL ] EQV: Loaded 2833 existing records from primary storage. [2025-09-23T18:40:30.076820] [INFO ] [MAIN ] EQV: Loaded 2833 existing records. [2025-09-23T18:40:30.486261] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:30.550543] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-23T18:40:30.550456] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-23T18:40:30.560975] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-23T18:40:30.587769] [DEBUG] [LOCAL ] ERJ: Loaded 50813 existing records from primary storage. [2025-09-23T18:40:30.587838] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-09-23T18:40:30.598868] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-23T18:40:30.619228] [INFO ] [MAIN ] ERJ: Loaded 50813 existing records. [2025-09-23T18:40:30.705679] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-23T18:40:30.905091] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:30.925547] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-23T18:40:31.107395] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:31.149869] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:31.150301] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-23T18:40:31.160825] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-23T18:40:31.171258] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-23T18:40:31.176408] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-23T18:40:31.189599] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-23T18:40:31.199729] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-23T18:40:31.261433] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-23T18:40:31.281262] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-23T18:40:31.750964] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:31.803950] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-23T18:40:31.803673] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T18:40:31.890229] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-23T18:40:32.105485] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:32.116065] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-23T18:40:32.172517] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:32.172987] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-23T18:40:32.476995] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T18:40:32.478050] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-23T18:40:32.743594] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-23T18:40:32.744507] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-23T18:40:32.849435] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T18:40:32.851491] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-23T18:40:33.085000] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T18:40:33.086147] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-23T18:40:33.611037] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T18:40:33.618220] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-23T18:40:33.620064] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T18:40:33.807726] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-23T18:40:33.814409] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:40:33.935513] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T18:40:34.134990] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T18:40:34.477121] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T18:40:34.602177] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-23T18:40:34.945047] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T18:40:35.402183] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-23T18:40:35.692803] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-23T18:40:36.202202] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-23T18:40:37.002203] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-23T18:40:37.423622] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T18:40:37.802199] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-23T18:40:38.602160] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-23T18:40:38.725912] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T18:40:39.257711] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T18:40:39.286563] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T18:40:39.402191] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-23T18:40:40.202195] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-23T18:40:40.922177] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T18:40:41.002213] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-23T18:40:41.802209] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-23T18:40:42.096061] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T18:40:42.230666] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:40:42.602164] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-23T18:40:42.870242] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T18:40:43.222660] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T18:40:43.224067] [INFO ] [REMOTE ] EQS: Full fetch complete (2538 records). [2025-09-23T18:40:43.224142] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-23T18:40:43.407280] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-23T18:40:43.412832] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-23T18:40:43.413741] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:40:43.413813] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:40:43.413884] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-23T18:40:43.413945] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-23T18:40:43.413984] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-23T18:40:43.414026] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-23T18:40:43.414098] [INFO ] [MAIN ] Update Progress: 761/2372 symbols completed. EQS took 14.1s. Estimated remaining: 3h 33m 7s. Rate: 7.6 symbols/min [2025-09-23T18:40:43.596689] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:43.596869] [DEBUG] [LOCAL ] ERO: No existing data file found in primary storage. [2025-09-23T18:40:43.596908] [WARN ] [MAIN ] ERO: No existing data found, performing full refresh instead. [2025-09-23T18:40:43.597054] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-23T18:40:43.597099] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-23T18:40:43.597142] [DEBUG] [LOCAL ] ERO: No primary data file found to delete. [2025-09-23T18:40:43.597233] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-23T18:40:43.987228] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:44.202191] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-23T18:40:45.002199] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-23T18:40:45.354617] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T18:40:45.601745] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T18:40:45.606286] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T18:40:45.802195] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-23T18:40:46.602208] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-23T18:40:47.402215] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-23T18:40:47.666607] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T18:40:47.759327] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T18:40:48.202164] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-23T18:40:48.320921] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T18:40:49.002190] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-23T18:40:49.802179] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-23T18:40:50.171952] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T18:40:50.205183] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:40:50.602225] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-23T18:40:51.201691] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T18:40:51.402191] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-23T18:40:51.738033] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:40:52.202215] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-23T18:40:52.857294] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T18:40:53.002201] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-23T18:40:53.802168] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-23T18:40:54.182182] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T18:40:54.236491] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T18:40:54.602259] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-23T18:40:55.166863] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T18:40:55.402223] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-23T18:40:55.446602] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:40:55.910509] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T18:40:56.202222] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-23T18:40:56.791469] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T18:40:57.002243] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-23T18:40:57.480059] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T18:40:57.481155] [INFO ] [REMOTE ] EQV: Full fetch complete (5733 records). [2025-09-23T18:40:57.481226] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-23T18:40:57.805682] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-23T18:40:57.844199] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-23T18:40:57.844299] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-23T18:40:57.844469] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-23T18:40:57.844509] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-23T18:40:57.844938] [DEBUG] [LOCAL ] EQV: Trimmed 5733 records to 2828 (keeping 200 days of data) [2025-09-23T18:40:57.862582] [DEBUG] [LOCAL ] EQV: Primary data saved (2828 records). [2025-09-23T18:40:57.862728] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-23T18:40:57.863038] [INFO ] [MAIN ] Update Progress: 762/2372 symbols completed. EQV took 28.5s. Estimated remaining: 3h 33m 13s. Rate: 7.6 symbols/min [2025-09-23T18:40:58.042120] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:58.042348] [DEBUG] [LOCAL ] ES: No existing data file found in primary storage. [2025-09-23T18:40:58.042404] [WARN ] [MAIN ] ES: No existing data found, performing full refresh instead. [2025-09-23T18:40:58.042561] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-23T18:40:58.042604] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-23T18:40:58.042673] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-09-23T18:40:58.042728] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-23T18:40:58.397711] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:58.602224] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-23T18:40:59.114180] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T18:40:59.402263] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-23T18:41:00.098484] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:41:00.202252] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-23T18:41:01.002223] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-23T18:41:01.440967] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-23T18:41:01.808068] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-23T18:41:01.826269] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T18:41:02.442511] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T18:41:02.602198] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-23T18:41:03.154347] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T18:41:03.162989] [INFO ] [REMOTE ] ERJ: Full fetch complete (72204 records). [2025-09-23T18:41:03.163144] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-23T18:41:03.414004] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-23T18:41:03.585513] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-23T18:41:03.585626] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-23T18:41:03.586518] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-23T18:41:03.586572] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-23T18:41:03.588162] [DEBUG] [LOCAL ] ERJ: Trimmed 72204 records to 50792 (keeping 200 days of data) [2025-09-23T18:41:03.895589] [DEBUG] [LOCAL ] ERJ: Primary data saved (50792 records). [2025-09-23T18:41:03.895760] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-23T18:41:03.895853] [INFO ] [MAIN ] Update Progress: 763/2372 symbols completed. ERJ took 34.6s. Estimated remaining: 3h 33m 1s. Rate: 7.6 symbols/min [2025-09-23T18:41:04.064798] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:04.094395] [DEBUG] [LOCAL ] ESAB: Loaded 25962 existing records from primary storage. [2025-09-23T18:41:04.094582] [INFO ] [MAIN ] ESAB: Loaded 25962 existing records. [2025-09-23T18:41:04.203097] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-23T18:41:04.279559] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:04.279992] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-23T18:41:04.280151] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-23T18:41:04.281436] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-23T18:41:04.281501] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-23T18:41:04.608621] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T18:41:04.689327] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:04.712971] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:41:05.002236] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-23T18:41:05.587703] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T18:41:05.802197] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-23T18:41:06.260116] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T18:41:06.602204] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-23T18:41:07.061836] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T18:41:07.402188] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-23T18:41:07.695895] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T18:41:08.202278] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-23T18:41:09.002215] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-23T18:41:09.235413] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T18:41:09.245747] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-23T18:41:09.245914] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-23T18:41:09.643693] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-23T18:41:09.644186] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-23T18:41:09.645619] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-23T18:41:09.645748] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-23T18:41:09.668364] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T18:41:09.675913] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-09-23T18:41:09.686817] [INFO ] [REMOTE ] ERO: Full fetch complete (59046 records). [2025-09-23T18:41:09.689104] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-23T18:41:09.691884] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T18:41:09.802740] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-23T18:41:10.344880] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-23T18:41:10.345775] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-23T18:41:10.346803] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-23T18:41:10.347169] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-23T18:41:10.350844] [DEBUG] [LOCAL ] ERO: Trimmed 59046 records to 41133 (keeping 200 days of data) [2025-09-23T18:41:10.535032] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-23T18:41:10.535964] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-23T18:41:10.536985] [INFO ] [MAIN ] Update Progress: 764/2372 symbols completed. EQT took 41.2s. Estimated remaining: 3h 32m 50s. Rate: 7.6 symbols/min [2025-09-23T18:41:10.606851] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-23T18:41:10.730324] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:10.808751] [DEBUG] [LOCAL ] ESE: Loaded 16560 existing records from primary storage. [2025-09-23T18:41:10.836449] [INFO ] [MAIN ] ESE: Loaded 16560 existing records. [2025-09-23T18:41:11.042962] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:11.045736] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-23T18:41:11.046422] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-23T18:41:11.047917] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-23T18:41:11.048311] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-23T18:41:11.405592] [DEBUG] [LOCAL ] ERO: Primary data saved (41133 records). [2025-09-23T18:41:11.431598] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-23T18:41:11.441312] [INFO ] [MAIN ] Update Progress: 765/2372 symbols completed. ERO took 28.0s. Estimated remaining: 3h 32m 27s. Rate: 7.6 symbols/min [2025-09-23T18:41:11.463394] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:11.464070] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-23T18:41:11.668708] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:11.703703] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T18:41:11.762368] [DEBUG] [LOCAL ] ESI: Loaded 50861 existing records from primary storage. [2025-09-23T18:41:11.762567] [INFO ] [MAIN ] ESI: Loaded 50861 existing records. [2025-09-23T18:41:11.961366] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:11.962429] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T18:41:11.967148] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-23T18:41:11.967467] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-23T18:41:11.968904] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-23T18:41:11.968965] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-23T18:41:12.207349] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-23T18:41:12.286495] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T18:41:12.390746] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:13.002203] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-23T18:41:13.253963] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:41:13.802288] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-23T18:41:13.980735] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:41:14.602249] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-23T18:41:15.323296] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:41:15.343465] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T18:41:15.402161] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-23T18:41:16.202202] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-23T18:41:16.898200] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:41:17.002175] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-23T18:41:17.718441] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:41:17.802167] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-23T18:41:18.602205] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-23T18:41:18.730189] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:41:18.755970] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T18:41:19.402218] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-23T18:41:20.202178] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-23T18:41:20.236313] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T18:41:20.801025] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T18:41:21.002188] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-23T18:41:21.413341] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T18:41:21.802207] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-23T18:41:22.611034] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-23T18:41:22.638886] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T18:41:22.666855] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T18:41:23.402199] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-23T18:41:23.809030] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:41:24.202198] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-23T18:41:24.853540] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:41:24.862591] [INFO ] [REMOTE ] ES: Full fetch complete (76153 records). [2025-09-23T18:41:24.862811] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-23T18:41:25.024927] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-23T18:41:25.319099] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T18:41:25.323040] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-23T18:41:25.323120] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-23T18:41:25.329217] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-23T18:41:25.330211] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-23T18:41:25.332214] [DEBUG] [LOCAL ] ES: Trimmed 76153 records to 52528 (keeping 200 days of data) [2025-09-23T18:41:25.677490] [DEBUG] [LOCAL ] ES: Primary data saved (52528 records). [2025-09-23T18:41:25.677687] [INFO ] [MAIN ] ES: Full history saved. [2025-09-23T18:41:25.677852] [INFO ] [MAIN ] Update Progress: 766/2372 symbols completed. ES took 27.8s. Estimated remaining: 3h 32m 33s. Rate: 7.6 symbols/min [2025-09-23T18:41:25.807352] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-23T18:41:25.873449] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:25.918584] [DEBUG] [LOCAL ] ESNT: Loaded 38709 existing records from primary storage. [2025-09-23T18:41:25.918801] [INFO ] [MAIN ] ESNT: Loaded 38709 existing records. [2025-09-23T18:41:26.097147] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:26.097473] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-23T18:41:26.097552] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-23T18:41:26.098721] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-23T18:41:26.098811] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-23T18:41:26.515821] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:26.602159] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-23T18:41:26.724696] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T18:41:26.789918] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T18:41:27.402202] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-23T18:41:27.823610] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T18:41:28.202195] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-23T18:41:28.769915] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T18:41:29.002206] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-23T18:41:29.802281] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-23T18:41:29.856888] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T18:41:30.602195] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-23T18:41:30.656443] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T18:41:31.356276] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T18:41:31.402201] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-23T18:41:31.711538] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:41:32.202266] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-23T18:41:32.701682] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:41:33.002249] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-23T18:41:33.179081] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:41:33.802243] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-23T18:41:34.418554] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T18:41:34.597799] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T18:41:34.602199] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-23T18:41:35.402181] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-23T18:41:36.021573] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:41:36.202205] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-23T18:41:36.598326] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T18:41:37.002198] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-23T18:41:37.451452] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T18:41:37.802203] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-23T18:41:38.018762] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T18:41:38.023893] [INFO ] [REMOTE ] ESAB: Full fetch complete (35326 records). [2025-09-23T18:41:38.024013] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-23T18:41:38.437754] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-23T18:41:38.437866] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-23T18:41:38.438457] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-23T18:41:38.438521] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-23T18:41:38.440457] [DEBUG] [LOCAL ] ESAB: Trimmed 35326 records to 26041 (keeping 200 days of data) [2025-09-23T18:41:38.605829] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-23T18:41:38.631283] [DEBUG] [LOCAL ] ESAB: Primary data saved (26041 records). [2025-09-23T18:41:38.631422] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-23T18:41:38.631606] [INFO ] [MAIN ] Update Progress: 767/2372 symbols completed. ESAB took 34.7s. Estimated remaining: 3h 32m 35s. Rate: 7.5 symbols/min [2025-09-23T18:41:38.825889] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:38.877628] [DEBUG] [LOCAL ] ESRT: Loaded 46390 existing records from primary storage. [2025-09-23T18:41:38.877833] [INFO ] [MAIN ] ESRT: Loaded 46390 existing records. [2025-09-23T18:41:39.074455] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:39.074824] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-23T18:41:39.074893] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-23T18:41:39.076491] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-23T18:41:39.076553] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-23T18:41:39.407309] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-23T18:41:39.464466] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:39.619483] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-23T18:41:40.080282] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:41:40.202193] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-23T18:41:40.804574] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:41:41.002210] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-23T18:41:41.225475] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T18:41:41.802227] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-23T18:41:42.602200] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-23T18:41:42.820880] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T18:41:42.833281] [INFO ] [REMOTE ] ESI: Full fetch complete (72351 records). [2025-09-23T18:41:42.833466] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-23T18:41:43.274728] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-23T18:41:43.274936] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-23T18:41:43.275895] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-23T18:41:43.275993] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-23T18:41:43.278672] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:41:43.287235] [DEBUG] [LOCAL ] ESI: Trimmed 72351 records to 50856 (keeping 200 days of data) [2025-09-23T18:41:43.421279] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-23T18:41:43.619833] [DEBUG] [LOCAL ] ESI: Primary data saved (50856 records). [2025-09-23T18:41:43.619974] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-23T18:41:43.620070] [INFO ] [MAIN ] Update Progress: 768/2372 symbols completed. ESI took 32.2s. Estimated remaining: 3h 32m 21s. Rate: 7.6 symbols/min [2025-09-23T18:41:43.800636] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:43.832550] [DEBUG] [LOCAL ] ESS: Loaded 30116 existing records from primary storage. [2025-09-23T18:41:43.832812] [INFO ] [MAIN ] ESS: Loaded 30116 existing records. [2025-09-23T18:41:44.018485] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:44.018779] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-23T18:41:44.018831] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-23T18:41:44.019783] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-23T18:41:44.019868] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-23T18:41:44.209678] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-23T18:41:44.426139] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:44.429345] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T18:41:44.450266] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T18:41:44.454114] [INFO ] [REMOTE ] ESE: Full fetch complete (21964 records). [2025-09-23T18:41:44.454202] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-23T18:41:44.835036] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-23T18:41:44.835127] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-23T18:41:44.835558] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-23T18:41:44.835597] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-23T18:41:44.836205] [DEBUG] [LOCAL ] ESE: Trimmed 21964 records to 16640 (keeping 200 days of data) [2025-09-23T18:41:44.954028] [DEBUG] [LOCAL ] ESE: Primary data saved (16640 records). [2025-09-23T18:41:44.954181] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-23T18:41:44.954301] [INFO ] [MAIN ] Update Progress: 769/2372 symbols completed. ESE took 34.4s. Estimated remaining: 3h 31m 59s. Rate: 7.6 symbols/min [2025-09-23T18:41:45.009142] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-23T18:41:45.130080] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:45.193694] [DEBUG] [LOCAL ] ESTC: Loaded 50184 existing records from primary storage. [2025-09-23T18:41:45.194386] [INFO ] [MAIN ] ESTC: Loaded 50184 existing records. [2025-09-23T18:41:45.373328] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:45.373753] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-23T18:41:45.373809] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-23T18:41:45.375610] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-23T18:41:45.375702] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-23T18:41:45.781000] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:45.802148] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-23T18:41:45.846913] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:41:46.309301] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:41:46.602210] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-23T18:41:47.412593] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-23T18:41:47.418557] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:41:48.202202] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-23T18:41:48.481555] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T18:41:48.910171] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-23T18:41:49.002347] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-23T18:41:49.557247] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:41:49.802252] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-23T18:41:50.210350] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T18:41:50.602245] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-23T18:41:51.046697] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:41:51.402186] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-23T18:41:52.109944] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T18:41:52.116390] [INFO ] [REMOTE ] ESNT: Full fetch complete (57215 records). [2025-09-23T18:41:52.116522] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-23T18:41:52.207278] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-23T18:41:52.528046] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-23T18:41:52.528325] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-23T18:41:52.529098] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-23T18:41:52.529160] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-23T18:41:52.530354] [DEBUG] [LOCAL ] ESNT: Trimmed 57215 records to 38672 (keeping 200 days of data) [2025-09-23T18:41:52.793079] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T18:41:52.814666] [DEBUG] [LOCAL ] ESNT: Primary data saved (38672 records). [2025-09-23T18:41:52.814796] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-23T18:41:52.814887] [INFO ] [MAIN ] Update Progress: 770/2372 symbols completed. ESNT took 27.1s. Estimated remaining: 3h 31m 51s. Rate: 7.6 symbols/min [2025-09-23T18:41:52.984349] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:53.002184] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-23T18:41:53.041467] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-23T18:41:53.041600] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-09-23T18:41:53.225546] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:53.225807] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-23T18:41:53.225856] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-23T18:41:53.228667] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-23T18:41:53.228728] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-23T18:41:53.594557] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:53.694905] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:41:53.802206] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-23T18:41:54.602180] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-23T18:41:54.744494] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T18:41:55.402185] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-23T18:41:55.733558] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T18:41:55.823675] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T18:41:56.202243] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-23T18:41:56.601526] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T18:41:57.002204] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-23T18:41:57.802245] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-23T18:41:58.086677] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T18:41:58.602247] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-23T18:41:58.676359] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T18:41:59.402165] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-23T18:41:59.604637] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T18:41:59.669244] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T18:42:00.202249] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-23T18:42:01.002227] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-23T18:42:01.622179] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-23T18:42:01.698365] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:42:01.802202] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-23T18:42:02.013484] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T18:42:02.602225] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-23T18:42:03.402193] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-23T18:42:03.645867] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T18:42:04.202240] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-23T18:42:05.002201] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-23T18:42:05.769171] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T18:42:05.802170] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-23T18:42:06.212119] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (3.61 seconds). [2025-09-23T18:42:06.565135] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T18:42:06.586254] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-09-23T18:42:06.602149] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-23T18:42:07.295803] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:42:07.402185] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-23T18:42:08.071889] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:42:08.202198] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-23T18:42:09.002260] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-23T18:42:09.482281] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-23T18:42:09.802236] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-23T18:42:09.949163] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T18:42:09.958163] [INFO ] [REMOTE ] ESTC: Full fetch complete (72172 records). [2025-09-23T18:42:09.958352] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-23T18:42:10.370554] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-23T18:42:10.370675] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-23T18:42:10.371568] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-23T18:42:10.371683] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-23T18:42:10.373660] [DEBUG] [LOCAL ] ESTC: Trimmed 72172 records to 50162 (keeping 200 days of data) [2025-09-23T18:42:10.602185] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-23T18:42:10.684557] [DEBUG] [LOCAL ] ESTC: Primary data saved (50162 records). [2025-09-23T18:42:10.684719] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-23T18:42:10.684837] [INFO ] [MAIN ] Update Progress: 771/2372 symbols completed. ESTC took 25.7s. Estimated remaining: 3h 32m 4s. Rate: 7.5 symbols/min [2025-09-23T18:42:10.891008] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:10.893064] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T18:42:10.893249] [DEBUG] [LOCAL ] ETB: No existing data file found in primary storage. [2025-09-23T18:42:10.900614] [WARN ] [MAIN ] ETB: No existing data found, performing full refresh instead. [2025-09-23T18:42:10.901559] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-23T18:42:10.901639] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-23T18:42:10.901806] [INFO ] [REMOTE ] ESRT: Full fetch complete (66363 records). [2025-09-23T18:42:10.901874] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-23T18:42:10.902008] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-23T18:42:10.902210] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-23T18:42:11.647858] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:11.668769] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-23T18:42:11.684977] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-23T18:42:11.685880] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-23T18:42:11.686739] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-23T18:42:11.686934] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-23T18:42:11.688360] [DEBUG] [LOCAL ] ESRT: Trimmed 66363 records to 46352 (keeping 200 days of data) [2025-09-23T18:42:11.976134] [DEBUG] [LOCAL ] ESRT: Primary data saved (46352 records). [2025-09-23T18:42:11.976292] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-23T18:42:11.976417] [INFO ] [MAIN ] Update Progress: 772/2372 symbols completed. ESRT took 33.3s. Estimated remaining: 3h 31m 42s. Rate: 7.6 symbols/min [2025-09-23T18:42:12.110129] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:42:12.183840] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:12.204441] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-23T18:42:12.226158] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-23T18:42:12.262615] [DEBUG] [LOCAL ] ETD: Loaded 27409 existing records from primary storage. [2025-09-23T18:42:12.262794] [INFO ] [MAIN ] ETD: Loaded 27409 existing records. [2025-09-23T18:42:12.447066] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:42:12.447444] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-23T18:42:12.447592] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-23T18:42:12.454531] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:42:12.455411] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-23T18:42:12.457439] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-23T18:42:12.819937] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:13.002215] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-23T18:42:13.292717] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T18:42:13.471492] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T18:42:13.802215] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-23T18:42:14.602204] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-23T18:42:14.767188] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T18:42:15.373351] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:42:15.402175] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-23T18:42:16.202273] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-23T18:42:16.715109] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:42:16.800087] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T18:42:17.002237] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-23T18:42:17.802238] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-23T18:42:17.970868] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T18:42:18.602186] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-23T18:42:18.980478] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:42:19.388327] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:42:19.402146] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-23T18:42:20.202189] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-23T18:42:20.233177] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T18:42:21.002227] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-23T18:42:21.737493] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T18:42:21.802159] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-23T18:42:22.602150] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-23T18:42:22.653546] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-23T18:42:22.778989] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T18:42:23.193239] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T18:42:23.402185] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-23T18:42:24.202248] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-23T18:42:25.002283] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-23T18:42:25.287060] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T18:42:25.388515] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T18:42:25.805746] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-23T18:42:25.810775] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T18:42:26.602260] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-23T18:42:27.214780] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:42:27.220091] [INFO ] [REMOTE ] ESS: Full fetch complete (43296 records). [2025-09-23T18:42:27.220215] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-23T18:42:27.407460] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-23T18:42:27.539338] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T18:42:27.645080] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-23T18:42:27.645209] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-23T18:42:27.646096] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-23T18:42:27.646162] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-23T18:42:27.647299] [DEBUG] [LOCAL ] ESS: Trimmed 43296 records to 30026 (keeping 200 days of data) [2025-09-23T18:42:27.845762] [DEBUG] [LOCAL ] ESS: Primary data saved (30026 records). [2025-09-23T18:42:27.845905] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-23T18:42:27.845995] [INFO ] [MAIN ] Update Progress: 773/2372 symbols completed. ESS took 44.2s. Estimated remaining: 3h 31m 51s. Rate: 7.5 symbols/min [2025-09-23T18:42:28.023253] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:28.041522] [DEBUG] [LOCAL ] ETG: Loaded 16734 existing records from primary storage. [2025-09-23T18:42:28.041744] [INFO ] [MAIN ] ETG: Loaded 16734 existing records. [2025-09-23T18:42:28.214166] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-23T18:42:28.237961] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:42:28.239591] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-23T18:42:28.239664] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-23T18:42:28.240335] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-23T18:42:28.240402] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-23T18:42:28.597508] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:29.002406] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-23T18:42:29.499395] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:42:29.501343] [INFO ] [REMOTE ] ETB: Full fetch complete (17712 records). [2025-09-23T18:42:29.501421] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-23T18:42:29.802891] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-23T18:42:29.887875] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-23T18:42:29.887968] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-23T18:42:29.888421] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-23T18:42:29.888464] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-23T18:42:29.889256] [DEBUG] [LOCAL ] ETB: Trimmed 17712 records to 11919 (keeping 200 days of data) [2025-09-23T18:42:29.966844] [DEBUG] [LOCAL ] ETB: Primary data saved (11919 records). [2025-09-23T18:42:29.967001] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-23T18:42:29.967077] [INFO ] [MAIN ] Update Progress: 774/2372 symbols completed. ETB took 19.3s. Estimated remaining: 3h 31m 31s. Rate: 7.6 symbols/min [2025-09-23T18:42:30.135875] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:30.152782] [DEBUG] [LOCAL ] ETJ: Loaded 16753 existing records from primary storage. [2025-09-23T18:42:30.152906] [INFO ] [MAIN ] ETJ: Loaded 16753 existing records. [2025-09-23T18:42:30.416575] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:42:30.416977] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-23T18:42:30.417078] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-23T18:42:30.417794] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-23T18:42:30.417906] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-23T18:42:30.753840] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (3.35 seconds). [2025-09-23T18:42:30.802402] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-23T18:42:30.883090] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:30.911636] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T18:42:31.217796] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:42:31.402205] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-23T18:42:32.202242] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-23T18:42:32.570734] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T18:42:32.832558] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T18:42:32.842288] [INFO ] [REMOTE ] ET: Full fetch complete (77565 records). [2025-09-23T18:42:32.842477] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-23T18:42:32.843685] [FATAL] [VALIDATOR ] ET: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:42:32.843802] [FATAL] [MAIN ] ET: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:42:32.843864] [WARN ] [MAIN ] ET: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:42:32.843921] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-23T18:42:32.843984] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-09-23T18:42:32.844021] [INFO ] [LOCAL ] ET: Starting deletion of derivative data. [2025-09-23T18:42:32.844506] [DEBUG] [LOCAL ] ET: Deleted derivative data file. [2025-09-23T18:42:32.844615] [INFO ] [MAIN ] Update Progress: 775/2372 symbols completed. ET took 40.0s. Estimated remaining: 3h 31m 12s. Rate: 7.6 symbols/min [2025-09-23T18:42:33.007494] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-23T18:42:33.037748] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:33.054813] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T18:42:33.123769] [DEBUG] [LOCAL ] ETN: Loaded 52837 existing records from primary storage. [2025-09-23T18:42:33.123957] [INFO ] [MAIN ] ETN: Loaded 52837 existing records. [2025-09-23T18:42:33.315979] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:42:33.316249] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-23T18:42:33.316297] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-23T18:42:33.318387] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-23T18:42:33.318449] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-23T18:42:33.671104] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:33.802194] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-23T18:42:33.927241] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T18:42:34.602228] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-23T18:42:35.242813] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T18:42:35.402169] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-23T18:42:35.869447] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T18:42:36.031615] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T18:42:36.202211] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-23T18:42:37.002203] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-23T18:42:37.295454] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T18:42:37.802242] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-23T18:42:38.602170] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-23T18:42:38.840687] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:42:39.087478] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-23T18:42:39.402231] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-23T18:42:39.507113] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T18:42:40.062026] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T18:42:40.202174] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-23T18:42:41.002198] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-23T18:42:41.428254] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:42:41.802201] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-23T18:42:42.607987] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-23T18:42:42.614401] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:42:42.942818] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T18:42:43.402201] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-23T18:42:44.202196] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-23T18:42:44.431932] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T18:42:44.436826] [INFO ] [REMOTE ] ETD: Full fetch complete (37978 records). [2025-09-23T18:42:44.436938] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-23T18:42:44.840234] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-23T18:42:44.840322] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-23T18:42:44.841152] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-23T18:42:44.841222] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-23T18:42:44.842236] [DEBUG] [LOCAL ] ETD: Trimmed 37978 records to 27418 (keeping 200 days of data) [2025-09-23T18:42:44.955450] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T18:42:45.005962] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-23T18:42:45.034828] [DEBUG] [LOCAL ] ETD: Primary data saved (27418 records). [2025-09-23T18:42:45.035368] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-23T18:42:45.035490] [INFO ] [MAIN ] Update Progress: 776/2372 symbols completed. ETD took 33.1s. Estimated remaining: 3h 31m 13s. Rate: 7.6 symbols/min [2025-09-23T18:42:45.222991] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:45.223201] [DEBUG] [LOCAL ] ETO: No existing data file found in primary storage. [2025-09-23T18:42:45.223263] [WARN ] [MAIN ] ETO: No existing data found, performing full refresh instead. [2025-09-23T18:42:45.223414] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-23T18:42:45.223459] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-23T18:42:45.223501] [DEBUG] [LOCAL ] ETO: No primary data file found to delete. [2025-09-23T18:42:45.223534] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-23T18:42:45.595224] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:45.608108] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T18:42:45.802177] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-23T18:42:46.035067] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T18:42:46.602184] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-23T18:42:47.324952] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T18:42:47.402161] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-23T18:42:47.457584] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T18:42:48.054478] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T18:42:48.202199] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-23T18:42:48.896240] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T18:42:49.002217] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-23T18:42:49.627713] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T18:42:49.802254] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-23T18:42:50.602208] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-23T18:42:51.009141] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T18:42:51.402224] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-23T18:42:51.853380] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-23T18:42:52.029021] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T18:42:52.202215] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-23T18:42:52.893791] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:42:53.002217] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-23T18:42:53.615071] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T18:42:53.802211] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-23T18:42:54.252581] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T18:42:54.602250] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-23T18:42:55.402241] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-23T18:42:55.523614] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:42:56.049932] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T18:42:56.202296] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-23T18:42:56.897723] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:42:56.900520] [INFO ] [REMOTE ] ETG: Full fetch complete (24984 records). [2025-09-23T18:42:56.900612] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-23T18:42:57.006522] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-23T18:42:57.280906] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-23T18:42:57.280986] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-23T18:42:57.281449] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-23T18:42:57.281489] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-23T18:42:57.282138] [DEBUG] [LOCAL ] ETG: Trimmed 24984 records to 16618 (keeping 200 days of data) [2025-09-23T18:42:57.382542] [DEBUG] [LOCAL ] ETG: Primary data saved (16618 records). [2025-09-23T18:42:57.382710] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-23T18:42:57.382857] [INFO ] [MAIN ] Update Progress: 777/2372 symbols completed. ETG took 29.5s. Estimated remaining: 3h 31m 14s. Rate: 7.6 symbols/min [2025-09-23T18:42:57.561230] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T18:42:57.560898] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:57.563483] [DEBUG] [LOCAL ] ETR: No existing data file found in primary storage. [2025-09-23T18:42:57.563888] [WARN ] [MAIN ] ETR: No existing data found, performing full refresh instead. [2025-09-23T18:42:57.564037] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-23T18:42:57.564079] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-23T18:42:57.564121] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-09-23T18:42:57.564152] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-23T18:42:57.807326] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-23T18:42:57.922210] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:58.602258] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-23T18:42:58.971741] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:42:59.126166] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T18:42:59.402316] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-23T18:42:59.954193] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T18:42:59.955702] [INFO ] [REMOTE ] ETO: Full fetch complete (9268 records). [2025-09-23T18:42:59.955776] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-23T18:43:00.207417] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-23T18:43:00.333766] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-23T18:43:00.333843] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-23T18:43:00.334076] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-23T18:43:00.334113] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-23T18:43:00.334527] [DEBUG] [LOCAL ] ETO: Trimmed 9268 records to 6492 (keeping 200 days of data) [2025-09-23T18:43:00.374030] [DEBUG] [LOCAL ] ETO: Primary data saved (6492 records). [2025-09-23T18:43:00.374145] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-23T18:43:00.374217] [INFO ] [MAIN ] Update Progress: 778/2372 symbols completed. ETO took 15.3s. Estimated remaining: 3h 30m 56s. Rate: 7.6 symbols/min [2025-09-23T18:43:00.542760] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:00.565149] [DEBUG] [LOCAL ] ETV: Loaded 21450 existing records from primary storage. [2025-09-23T18:43:00.565284] [INFO ] [MAIN ] ETV: Loaded 21450 existing records. [2025-09-23T18:43:00.740432] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:00.740743] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-23T18:43:00.740798] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-23T18:43:00.741912] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-23T18:43:00.741975] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-23T18:43:01.011943] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-23T18:43:01.093308] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:01.802199] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-23T18:43:02.318416] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T18:43:02.602224] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-23T18:43:02.757492] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T18:43:03.022019] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-23T18:43:03.402259] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-23T18:43:04.202210] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-23T18:43:04.436084] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T18:43:04.462543] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T18:43:05.002199] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-23T18:43:05.581980] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T18:43:05.780952] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:43:05.802144] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-23T18:43:06.602233] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-23T18:43:07.402169] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-23T18:43:07.629596] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T18:43:08.090924] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T18:43:08.202234] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-23T18:43:08.415858] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T18:43:09.002194] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-23T18:43:09.055547] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T18:43:09.802174] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-23T18:43:10.033876] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T18:43:10.037115] [INFO ] [REMOTE ] ETJ: Full fetch complete (24918 records). [2025-09-23T18:43:10.037192] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-23T18:43:10.397444] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-23T18:43:10.397552] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-23T18:43:10.398100] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-23T18:43:10.398164] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-23T18:43:10.399151] [DEBUG] [LOCAL ] ETJ: Trimmed 24918 records to 16617 (keeping 200 days of data) [2025-09-23T18:43:10.496560] [DEBUG] [LOCAL ] ETJ: Primary data saved (16617 records). [2025-09-23T18:43:10.496731] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-23T18:43:10.496843] [INFO ] [MAIN ] Update Progress: 779/2372 symbols completed. ETJ took 40.5s. Estimated remaining: 3h 30m 53s. Rate: 7.6 symbols/min [2025-09-23T18:43:10.607315] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-23T18:43:10.665836] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:10.689827] [DEBUG] [LOCAL ] ETW: Loaded 25180 existing records from primary storage. [2025-09-23T18:43:10.689970] [INFO ] [MAIN ] ETW: Loaded 25180 existing records. [2025-09-23T18:43:10.866331] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:10.866594] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-23T18:43:10.866664] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-23T18:43:10.867406] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-23T18:43:10.867509] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-23T18:43:11.224552] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:11.402202] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-23T18:43:12.021068] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-23T18:43:12.211278] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-23T18:43:12.217557] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T18:43:12.301420] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T18:43:13.002220] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-23T18:43:13.802233] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-23T18:43:13.895467] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:43:14.521118] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-23T18:43:14.535795] [INFO ] [REMOTE ] ETN: Full fetch complete (76580 records). [2025-09-23T18:43:14.536008] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-23T18:43:14.606585] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-23T18:43:14.741668] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T18:43:14.978620] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-23T18:43:14.978786] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-23T18:43:14.979747] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-23T18:43:14.979814] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-23T18:43:14.981331] [DEBUG] [LOCAL ] ETN: Trimmed 76580 records to 52836 (keeping 200 days of data) [2025-09-23T18:43:15.315832] [DEBUG] [LOCAL ] ETN: Primary data saved (52836 records). [2025-09-23T18:43:15.315984] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-23T18:43:15.316072] [INFO ] [MAIN ] Update Progress: 780/2372 symbols completed. ETN took 42.5s. Estimated remaining: 3h 30m 38s. Rate: 7.6 symbols/min [2025-09-23T18:43:15.405855] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-23T18:43:15.487898] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:15.495209] [DEBUG] [LOCAL ] ETX: Loaded 4913 existing records from primary storage. [2025-09-23T18:43:15.495313] [INFO ] [MAIN ] ETX: Loaded 4913 existing records. [2025-09-23T18:43:15.698939] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:15.699696] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-23T18:43:15.699848] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-23T18:43:15.700265] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-23T18:43:15.700346] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-23T18:43:15.897943] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:43:16.092576] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:16.169306] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T18:43:16.202185] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-23T18:43:16.929345] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T18:43:17.002249] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-23T18:43:17.733814] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T18:43:17.802209] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-23T18:43:18.486920] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T18:43:18.602213] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-23T18:43:19.356843] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T18:43:19.402187] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-23T18:43:20.202195] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-23T18:43:20.680549] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:43:21.002233] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-23T18:43:21.202590] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T18:43:21.802212] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-23T18:43:22.304176] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T18:43:22.536202] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:43:22.602241] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-23T18:43:23.047173] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T18:43:23.402202] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-23T18:43:24.202207] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-23T18:43:24.581256] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:43:25.002202] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-23T18:43:25.069933] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T18:43:25.073893] [INFO ] [REMOTE ] ETV: Full fetch complete (31749 records). [2025-09-23T18:43:25.074014] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-23T18:43:25.459768] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-23T18:43:25.459854] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-23T18:43:25.460442] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-23T18:43:25.460506] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-23T18:43:25.462675] [DEBUG] [LOCAL ] ETV: Trimmed 31749 records to 21362 (keeping 200 days of data) [2025-09-23T18:43:25.558199] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T18:43:25.608110] [DEBUG] [LOCAL ] ETV: Primary data saved (21362 records). [2025-09-23T18:43:25.608253] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-23T18:43:25.608350] [INFO ] [MAIN ] Update Progress: 781/2372 symbols completed. ETV took 25.2s. Estimated remaining: 3h 30m 35s. Rate: 7.6 symbols/min [2025-09-23T18:43:25.783848] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:25.802248] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-23T18:43:25.814257] [DEBUG] [LOCAL ] ETY: Loaded 22861 existing records from primary storage. [2025-09-23T18:43:25.814386] [INFO ] [MAIN ] ETY: Loaded 22861 existing records. [2025-09-23T18:43:25.995753] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:25.996026] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-23T18:43:25.996090] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-23T18:43:25.996753] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-23T18:43:25.996844] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-23T18:43:26.281456] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-23T18:43:26.384307] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:26.602206] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-23T18:43:27.402195] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-23T18:43:27.452674] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T18:43:27.872494] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T18:43:28.202195] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-23T18:43:29.002241] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-23T18:43:29.468593] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T18:43:29.720424] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T18:43:29.802260] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-23T18:43:30.584713] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T18:43:30.602248] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-23T18:43:31.402218] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-23T18:43:32.202411] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-23T18:43:32.712915] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:43:32.846043] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T18:43:33.002163] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-23T18:43:33.083618] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-23T18:43:33.474709] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T18:43:33.802204] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-23T18:43:34.602163] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-23T18:43:34.652708] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T18:43:34.654814] [INFO ] [REMOTE ] ETX: Full fetch complete (7032 records). [2025-09-23T18:43:34.654932] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-23T18:43:35.032388] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-23T18:43:35.032482] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-23T18:43:35.032736] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-23T18:43:35.032867] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-23T18:43:35.033323] [DEBUG] [LOCAL ] ETX: Trimmed 7032 records to 4964 (keeping 200 days of data) [2025-09-23T18:43:35.068209] [DEBUG] [LOCAL ] ETX: Primary data saved (4964 records). [2025-09-23T18:43:35.068338] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-23T18:43:35.068472] [INFO ] [MAIN ] Update Progress: 782/2372 symbols completed. ETX took 19.8s. Estimated remaining: 3h 30m 30s. Rate: 7.6 symbols/min [2025-09-23T18:43:35.243559] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:35.269790] [DEBUG] [LOCAL ] EVC: Loaded 19774 existing records from primary storage. [2025-09-23T18:43:35.269915] [INFO ] [MAIN ] EVC: Loaded 19774 existing records. [2025-09-23T18:43:35.415859] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-23T18:43:35.463063] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:35.463386] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-23T18:43:35.463453] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-23T18:43:35.464091] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-23T18:43:35.464177] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-23T18:43:35.831275] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:35.918784] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T18:43:36.202181] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-23T18:43:36.244109] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T18:43:37.002195] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-23T18:43:37.153338] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:43:37.802196] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-23T18:43:38.602174] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-23T18:43:38.691584] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T18:43:38.906567] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T18:43:38.911082] [INFO ] [REMOTE ] ETW: Full fetch complete (36288 records). [2025-09-23T18:43:38.911252] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-23T18:43:39.308637] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-23T18:43:39.308746] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-23T18:43:39.309284] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-23T18:43:39.309323] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-23T18:43:39.310186] [DEBUG] [LOCAL ] ETW: Trimmed 36288 records to 25080 (keeping 200 days of data) [2025-09-23T18:43:39.407568] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-23T18:43:39.476981] [DEBUG] [LOCAL ] ETW: Primary data saved (25080 records). [2025-09-23T18:43:39.477229] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-23T18:43:39.477424] [INFO ] [MAIN ] Update Progress: 783/2372 symbols completed. ETW took 29.0s. Estimated remaining: 3h 30m 15s. Rate: 7.6 symbols/min [2025-09-23T18:43:39.650804] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:39.689078] [DEBUG] [LOCAL ] EVEX: Loaded 29592 existing records from primary storage. [2025-09-23T18:43:39.689287] [INFO ] [MAIN ] EVEX: Loaded 29592 existing records. [2025-09-23T18:43:39.869175] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:39.869755] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-23T18:43:39.869829] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-23T18:43:39.870487] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-23T18:43:39.870548] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-23T18:43:40.225405] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-23T18:43:40.265832] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:40.303326] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T18:43:40.421231] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T18:43:41.002197] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-23T18:43:41.455622] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:43:41.802210] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-23T18:43:42.590451] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:43:42.602164] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-23T18:43:42.769230] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T18:43:43.333393] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T18:43:43.402182] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-23T18:43:44.202209] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-23T18:43:44.441467] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:43:45.002269] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-23T18:43:45.074526] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T18:43:45.802200] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-23T18:43:46.588741] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T18:43:46.602175] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-23T18:43:46.972219] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T18:43:47.412724] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-23T18:43:47.415432] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T18:43:48.202218] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-23T18:43:48.453776] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T18:43:49.002272] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-23T18:43:49.054745] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T18:43:49.780333] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T18:43:49.784271] [INFO ] [REMOTE ] ETY: Full fetch complete (34152 records). [2025-09-23T18:43:49.784362] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-23T18:43:49.807376] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-23T18:43:50.162145] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-23T18:43:50.162232] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-23T18:43:50.162852] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-23T18:43:50.162915] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-23T18:43:50.163850] [DEBUG] [LOCAL ] ETY: Trimmed 34152 records to 22694 (keeping 200 days of data) [2025-09-23T18:43:50.327335] [DEBUG] [LOCAL ] ETY: Primary data saved (22694 records). [2025-09-23T18:43:50.327590] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-23T18:43:50.327716] [INFO ] [MAIN ] Update Progress: 784/2372 symbols completed. ETY took 24.7s. Estimated remaining: 3h 30m 13s. Rate: 7.6 symbols/min [2025-09-23T18:43:50.517604] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:50.531974] [DEBUG] [LOCAL ] EVF: Loaded 9041 existing records from primary storage. [2025-09-23T18:43:50.532109] [INFO ] [MAIN ] EVF: Loaded 9041 existing records. [2025-09-23T18:43:50.611273] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-23T18:43:50.724350] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:50.724779] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-23T18:43:50.724840] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-23T18:43:50.725391] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-23T18:43:50.725453] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-23T18:43:51.178378] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:51.399987] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:43:51.404913] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-23T18:43:51.583031] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T18:43:51.947804] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T18:43:52.202203] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-23T18:43:52.911961] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T18:43:53.002166] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-23T18:43:53.653500] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:43:53.802257] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-23T18:43:54.246988] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T18:43:54.602229] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-23T18:43:55.402253] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-23T18:43:55.740235] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T18:43:56.202227] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-23T18:43:56.820940] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:43:56.831719] [INFO ] [REMOTE ] ETR: Full fetch complete (76974 records). [2025-09-23T18:43:56.831880] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-23T18:43:57.017166] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-23T18:43:57.280518] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-23T18:43:57.280785] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-23T18:43:57.282386] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-23T18:43:57.282948] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-23T18:43:57.283639] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T18:43:57.290859] [DEBUG] [LOCAL ] ETR: Trimmed 76974 records to 53225 (keeping 200 days of data) [2025-09-23T18:43:57.642830] [DEBUG] [LOCAL ] ETR: Primary data saved (53225 records). [2025-09-23T18:43:57.643130] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-23T18:43:57.643214] [INFO ] [MAIN ] Update Progress: 785/2372 symbols completed. ETR took 1m 0s. Estimated remaining: 3h 30m 4s. Rate: 7.6 symbols/min [2025-09-23T18:43:57.812906] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-23T18:43:57.815631] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:57.832106] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T18:43:57.842896] [DEBUG] [LOCAL ] EVG: Loaded 5780 existing records from primary storage. [2025-09-23T18:43:57.843380] [INFO ] [MAIN ] EVG: Loaded 5780 existing records. [2025-09-23T18:43:58.021053] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:58.021355] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-23T18:43:58.021404] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-23T18:43:58.022170] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-23T18:43:58.022231] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-23T18:43:58.393864] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:58.602248] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-23T18:43:58.672881] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T18:43:59.402200] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-23T18:44:00.098043] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:44:00.202194] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-23T18:44:01.002271] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-23T18:44:01.802255] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-23T18:44:02.203116] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-23T18:44:02.400531] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T18:44:02.462424] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T18:44:02.602168] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-23T18:44:02.625871] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:44:03.402196] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-23T18:44:03.774089] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:44:04.202196] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-23T18:44:04.482692] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T18:44:04.989061] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T18:44:04.992268] [INFO ] [REMOTE ] EVC: Full fetch complete (31094 records). [2025-09-23T18:44:04.992348] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-23T18:44:05.007276] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-23T18:44:05.383935] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-23T18:44:05.384037] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-23T18:44:05.384598] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-23T18:44:05.384639] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-23T18:44:05.386483] [DEBUG] [LOCAL ] EVC: Trimmed 31094 records to 19546 (keeping 200 days of data) [2025-09-23T18:44:05.514512] [DEBUG] [LOCAL ] EVC: Primary data saved (19546 records). [2025-09-23T18:44:05.514638] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-23T18:44:05.514761] [INFO ] [MAIN ] Update Progress: 786/2372 symbols completed. EVC took 30.4s. Estimated remaining: 3h 29m 56s. Rate: 7.6 symbols/min [2025-09-23T18:44:05.693640] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:05.729577] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T18:44:05.749841] [DEBUG] [LOCAL ] EVH: Loaded 49345 existing records from primary storage. [2025-09-23T18:44:05.750001] [INFO ] [MAIN ] EVH: Loaded 49345 existing records. [2025-09-23T18:44:05.811982] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-23T18:44:05.933962] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:05.934189] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-23T18:44:05.934238] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-23T18:44:05.935437] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-23T18:44:05.935499] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-23T18:44:06.291532] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:06.602257] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-23T18:44:06.693866] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T18:44:07.402202] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-23T18:44:07.964477] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T18:44:08.202215] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-23T18:44:08.223849] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T18:44:09.002213] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-23T18:44:09.621005] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T18:44:09.802227] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-23T18:44:10.329998] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T18:44:10.602254] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-23T18:44:10.966383] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T18:44:11.213813] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:44:11.402204] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-23T18:44:12.202194] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-23T18:44:13.002214] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-23T18:44:13.077412] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:44:13.085875] [INFO ] [REMOTE ] EVEX: Full fetch complete (41541 records). [2025-09-23T18:44:13.086031] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-23T18:44:13.478608] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-23T18:44:13.478803] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-23T18:44:13.479449] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-23T18:44:13.479574] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-23T18:44:13.480831] [DEBUG] [LOCAL ] EVEX: Trimmed 41541 records to 29806 (keeping 200 days of data) [2025-09-23T18:44:13.625069] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T18:44:13.695754] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T18:44:13.702235] [DEBUG] [LOCAL ] EVEX: Primary data saved (29806 records). [2025-09-23T18:44:13.702331] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-23T18:44:13.702418] [INFO ] [MAIN ] Update Progress: 787/2372 symbols completed. EVEX took 34.2s. Estimated remaining: 3h 29m 48s. Rate: 7.6 symbols/min [2025-09-23T18:44:13.804728] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-23T18:44:13.895957] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:13.908735] [DEBUG] [LOCAL ] EVN: Loaded 10956 existing records from primary storage. [2025-09-23T18:44:13.908878] [INFO ] [MAIN ] EVN: Loaded 10956 existing records. [2025-09-23T18:44:14.103685] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:14.103963] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-23T18:44:14.104049] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-23T18:44:14.104585] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-23T18:44:14.104674] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-23T18:44:14.465312] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:14.602195] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-23T18:44:15.402195] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-23T18:44:15.900854] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T18:44:16.127310] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-23T18:44:16.163337] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T18:44:16.166506] [INFO ] [REMOTE ] EVF: Full fetch complete (11805 records). [2025-09-23T18:44:16.166598] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-23T18:44:16.207283] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-23T18:44:16.567903] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-23T18:44:16.567995] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-23T18:44:16.568315] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-23T18:44:16.568357] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-23T18:44:16.568995] [DEBUG] [LOCAL ] EVF: Trimmed 11805 records to 9163 (keeping 200 days of data) [2025-09-23T18:44:16.622281] [DEBUG] [LOCAL ] EVF: Primary data saved (9163 records). [2025-09-23T18:44:16.622409] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-23T18:44:16.622491] [INFO ] [MAIN ] Update Progress: 788/2372 symbols completed. EVF took 26.3s. Estimated remaining: 3h 29m 30s. Rate: 7.6 symbols/min [2025-09-23T18:44:16.801765] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:16.845927] [DEBUG] [LOCAL ] EVR: Loaded 35778 existing records from primary storage. [2025-09-23T18:44:16.846069] [INFO ] [MAIN ] EVR: Loaded 35778 existing records. [2025-09-23T18:44:17.006183] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-23T18:44:17.035522] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:17.036266] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T18:44:17.037300] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-23T18:44:17.039085] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-23T18:44:17.040216] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-23T18:44:17.040282] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-23T18:44:17.415503] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:17.802241] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-23T18:44:17.932167] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:44:18.602251] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-23T18:44:19.208927] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T18:44:19.402214] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-23T18:44:20.202164] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-23T18:44:20.590403] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-23T18:44:20.708260] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T18:44:20.736546] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T18:44:21.002221] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-23T18:44:21.381956] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T18:44:21.802229] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-23T18:44:22.602196] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-23T18:44:22.942217] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:44:23.021171] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T18:44:23.402217] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-23T18:44:24.202198] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-23T18:44:24.725312] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T18:44:25.002249] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-23T18:44:25.644867] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:44:25.693227] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:44:25.802188] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-23T18:44:26.602148] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-23T18:44:26.678847] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T18:44:27.402196] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-23T18:44:27.866617] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T18:44:28.202179] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-23T18:44:28.678699] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:44:29.002276] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-23T18:44:29.457737] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T18:44:29.621456] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:44:29.802201] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-23T18:44:30.602194] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-23T18:44:30.612252] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T18:44:31.337238] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T18:44:31.402180] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-23T18:44:31.918856] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T18:44:32.202208] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-23T18:44:33.002233] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-23T18:44:33.097990] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:44:33.802208] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-23T18:44:34.233296] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:44:34.430277] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T18:44:34.438407] [INFO ] [REMOTE ] EVH: Full fetch complete (71747 records). [2025-09-23T18:44:34.438535] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-23T18:44:34.612744] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-23T18:44:34.846109] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-23T18:44:34.846226] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-23T18:44:34.847096] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-23T18:44:34.847161] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-23T18:44:34.848594] [DEBUG] [LOCAL ] EVH: Trimmed 71747 records to 49348 (keeping 200 days of data) [2025-09-23T18:44:35.075803] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T18:44:35.158114] [DEBUG] [LOCAL ] EVH: Primary data saved (49348 records). [2025-09-23T18:44:35.158269] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-23T18:44:35.158358] [INFO ] [MAIN ] Update Progress: 789/2372 symbols completed. EVH took 29.6s. Estimated remaining: 3h 29m 44s. Rate: 7.5 symbols/min [2025-09-23T18:44:35.342263] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:35.359815] [DEBUG] [LOCAL ] EVT: Loaded 17313 existing records from primary storage. [2025-09-23T18:44:35.359952] [INFO ] [MAIN ] EVT: Loaded 17313 existing records. [2025-09-23T18:44:35.412182] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-23T18:44:35.539883] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:35.540120] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-23T18:44:35.540174] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-23T18:44:35.540883] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-23T18:44:35.540943] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-23T18:44:35.917686] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:36.202196] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-23T18:44:36.575781] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T18:44:36.969563] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T18:44:37.002187] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-23T18:44:37.523483] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T18:44:37.525100] [INFO ] [REMOTE ] EVG: Full fetch complete (8032 records). [2025-09-23T18:44:37.525176] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-23T18:44:37.807274] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-23T18:44:37.915726] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-23T18:44:37.915836] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-23T18:44:37.916121] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-23T18:44:37.916230] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-23T18:44:37.916746] [DEBUG] [LOCAL ] EVG: Trimmed 8032 records to 5777 (keeping 200 days of data) [2025-09-23T18:44:37.952705] [DEBUG] [LOCAL ] EVG: Primary data saved (5777 records). [2025-09-23T18:44:37.952836] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-23T18:44:37.952923] [INFO ] [MAIN ] Update Progress: 790/2372 symbols completed. EVG took 40.3s. Estimated remaining: 3h 29m 25s. Rate: 7.6 symbols/min [2025-09-23T18:44:38.124596] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:38.124858] [DEBUG] [LOCAL ] EVTC: No existing data file found in primary storage. [2025-09-23T18:44:38.124915] [WARN ] [MAIN ] EVTC: No existing data found, performing full refresh instead. [2025-09-23T18:44:38.125108] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-23T18:44:38.125161] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-23T18:44:38.125206] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-09-23T18:44:38.125240] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-23T18:44:38.484874] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:38.602197] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-23T18:44:39.170519] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T18:44:39.327151] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T18:44:39.329623] [INFO ] [REMOTE ] EVN: Full fetch complete (17461 records). [2025-09-23T18:44:39.329743] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-23T18:44:39.407338] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-23T18:44:39.703266] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-23T18:44:39.703346] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-23T18:44:39.703744] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-23T18:44:39.703806] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-23T18:44:39.704338] [DEBUG] [LOCAL ] EVN: Trimmed 17461 records to 10996 (keeping 200 days of data) [2025-09-23T18:44:39.772057] [DEBUG] [LOCAL ] EVN: Primary data saved (10996 records). [2025-09-23T18:44:39.772225] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-23T18:44:39.772363] [INFO ] [MAIN ] Update Progress: 791/2372 symbols completed. EVN took 26.1s. Estimated remaining: 3h 29m 5s. Rate: 7.6 symbols/min [2025-09-23T18:44:39.945796] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:39.984113] [DEBUG] [LOCAL ] EVTL: Loaded 36915 existing records from primary storage. [2025-09-23T18:44:39.984273] [INFO ] [MAIN ] EVTL: Loaded 36915 existing records. [2025-09-23T18:44:40.160297] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:40.160591] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-23T18:44:40.160660] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-23T18:44:40.161700] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-23T18:44:40.161762] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-23T18:44:40.207288] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-23T18:44:40.515822] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:40.719817] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:44:40.981997] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T18:44:41.002158] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-23T18:44:41.668733] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T18:44:41.802239] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-23T18:44:42.602252] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-23T18:44:43.212219] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T18:44:43.402195] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-23T18:44:43.603347] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T18:44:44.202217] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-23T18:44:44.534565] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T18:44:45.002151] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-23T18:44:45.113444] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T18:44:45.802172] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-23T18:44:46.000798] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T18:44:46.602208] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-23T18:44:46.855861] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:44:47.402232] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-23T18:44:47.649699] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:44:48.202238] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-23T18:44:48.414589] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T18:44:49.002233] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-23T18:44:49.534734] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T18:44:49.540231] [INFO ] [REMOTE ] EVR: Full fetch complete (50733 records). [2025-09-23T18:44:49.540360] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-23T18:44:49.807398] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-23T18:44:49.974152] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-23T18:44:49.974281] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-23T18:44:49.975117] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-23T18:44:49.975204] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-23T18:44:49.976741] [DEBUG] [LOCAL ] EVR: Trimmed 50733 records to 35659 (keeping 200 days of data) [2025-09-23T18:44:50.061172] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T18:44:50.229928] [DEBUG] [LOCAL ] EVR: Primary data saved (35659 records). [2025-09-23T18:44:50.230099] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-23T18:44:50.230213] [INFO ] [MAIN ] Update Progress: 792/2372 symbols completed. EVR took 33.6s. Estimated remaining: 3h 29m 2s. Rate: 7.6 symbols/min [2025-09-23T18:44:50.401416] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:50.424483] [DEBUG] [LOCAL ] EVTR: Loaded 23026 existing records from primary storage. [2025-09-23T18:44:50.424621] [INFO ] [MAIN ] EVTR: Loaded 23026 existing records. [2025-09-23T18:44:50.604361] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-23T18:44:50.606921] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:50.608139] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-23T18:44:50.608214] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-23T18:44:50.609094] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-23T18:44:50.609161] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-23T18:44:50.937043] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T18:44:51.020247] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:51.402183] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-23T18:44:51.720822] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:44:52.202255] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-23T18:44:52.573103] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T18:44:53.002204] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-23T18:44:53.807285] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-23T18:44:53.824558] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T18:44:54.191610] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T18:44:54.602303] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-23T18:44:54.816975] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T18:44:55.402166] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-23T18:44:55.715421] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:44:56.202244] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-23T18:44:56.670361] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:44:57.002237] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-23T18:44:57.250123] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T18:44:57.802168] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-23T18:44:57.846204] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T18:44:58.602203] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-23T18:44:59.245316] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T18:44:59.402179] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-23T18:44:59.530257] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:45:00.110056] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T18:45:00.202219] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-23T18:45:01.002229] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-23T18:45:01.256224] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:45:01.802243] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-23T18:45:02.422095] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:45:02.602264] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-23T18:45:03.402255] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-23T18:45:04.202206] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-23T18:45:05.664548] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-09-23T18:45:05.671681] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-23T18:45:07.013912] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (5.21 seconds). [2025-09-23T18:45:07.024713] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-23T18:45:07.354204] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T18:45:07.360504] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-23T18:45:07.397169] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (3.19 seconds). [2025-09-23T18:45:07.402227] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-23T18:45:07.566469] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (4.16 seconds). [2025-09-23T18:45:08.000236] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:45:08.003064] [INFO ] [REMOTE ] EVT: Full fetch complete (25301 records). [2025-09-23T18:45:08.003163] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-23T18:45:08.003722] [FATAL] [VALIDATOR ] EVT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:45:08.003805] [FATAL] [MAIN ] EVT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:45:08.003868] [WARN ] [MAIN ] EVT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:45:08.003942] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-23T18:45:08.004007] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-09-23T18:45:08.004044] [INFO ] [LOCAL ] EVT: Starting deletion of derivative data. [2025-09-23T18:45:08.004491] [DEBUG] [LOCAL ] EVT: Deleted derivative data file. [2025-09-23T18:45:08.004585] [INFO ] [MAIN ] Update Progress: 793/2372 symbols completed. EVT took 32.8s. Estimated remaining: 3h 29m 14s. Rate: 7.5 symbols/min [2025-09-23T18:45:08.179558] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:08.193578] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T18:45:08.202133] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-23T18:45:08.250463] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-23T18:45:08.250634] [INFO ] [MAIN ] EW: Loaded 53396 existing records. [2025-09-23T18:45:08.437559] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:08.437838] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-23T18:45:08.437887] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-23T18:45:08.438979] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-23T18:45:08.439039] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-23T18:45:08.828068] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:08.856202] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T18:45:08.903345] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T18:45:09.002220] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-23T18:45:09.802233] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-23T18:45:10.076794] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T18:45:10.602160] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-23T18:45:10.697505] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:45:11.402161] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-23T18:45:11.550348] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:45:12.202202] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-23T18:45:13.002190] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-23T18:45:13.802169] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-23T18:45:14.115554] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-23T18:45:14.575969] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-23T18:45:14.582019] [INFO ] [REMOTE ] EVTR: Full fetch complete (31698 records). [2025-09-23T18:45:14.582156] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-23T18:45:14.615519] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-23T18:45:14.964955] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-23T18:45:14.965077] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-23T18:45:14.965627] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-23T18:45:14.965705] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-23T18:45:14.966514] [DEBUG] [LOCAL ] EVTR: Trimmed 31698 records to 23118 (keeping 200 days of data) [2025-09-23T18:45:15.110522] [DEBUG] [LOCAL ] EVTR: Primary data saved (23118 records). [2025-09-23T18:45:15.110720] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-23T18:45:15.110833] [INFO ] [MAIN ] Update Progress: 794/2372 symbols completed. EVTR took 24.9s. Estimated remaining: 3h 29m 4s. Rate: 7.5 symbols/min [2025-09-23T18:45:15.290389] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:45:15.314066] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:15.319930] [INFO ] [REMOTE ] EVTC: Full fetch complete (37831 records). [2025-09-23T18:45:15.320038] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-23T18:45:15.583947] [DEBUG] [LOCAL ] EXG: Loaded 34542 existing records from primary storage. [2025-09-23T18:45:15.610865] [INFO ] [MAIN ] EXG: Loaded 34542 existing records. [2025-09-23T18:45:15.901458] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-23T18:45:15.927796] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-23T18:45:15.928506] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-23T18:45:15.934572] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:15.935093] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-23T18:45:15.935389] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-23T18:45:15.935703] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-23T18:45:15.936689] [DEBUG] [LOCAL ] EVTC: Trimmed 37831 records to 26511 (keeping 200 days of data) [2025-09-23T18:45:15.937155] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-23T18:45:15.937329] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-23T18:45:16.118319] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-09-23T18:45:16.173595] [INFO ] [REMOTE ] EVTL: Full fetch complete (50311 records). [2025-09-23T18:45:16.197245] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-23T18:45:16.794218] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:16.826265] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-23T18:45:16.839978] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-23T18:45:16.896162] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-23T18:45:16.984886] [DEBUG] [LOCAL ] EVTC: Primary data saved (26511 records). [2025-09-23T18:45:17.000841] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-23T18:45:17.004419] [INFO ] [MAIN ] Update Progress: 795/2372 symbols completed. EVTC took 39.1s. Estimated remaining: 3h 28m 44s. Rate: 7.6 symbols/min [2025-09-23T18:45:17.048741] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-23T18:45:17.060257] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-23T18:45:17.081365] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-23T18:45:17.086915] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-23T18:45:17.140885] [DEBUG] [LOCAL ] EVTL: Trimmed 50311 records to 37168 (keeping 200 days of data) [2025-09-23T18:45:17.241557] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:17.242075] [DEBUG] [LOCAL ] EXK: No existing data file found in primary storage. [2025-09-23T18:45:17.267508] [WARN ] [MAIN ] EXK: No existing data found, performing full refresh instead. [2025-09-23T18:45:17.269422] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-23T18:45:17.269523] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-23T18:45:17.270852] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-23T18:45:17.272611] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-23T18:45:17.671610] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:17.673480] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-23T18:45:17.783059] [DEBUG] [LOCAL ] EVTL: Primary data saved (37168 records). [2025-09-23T18:45:17.783191] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-23T18:45:17.783274] [INFO ] [MAIN ] Update Progress: 796/2372 symbols completed. EVTL took 38.0s. Estimated remaining: 3h 28m 22s. Rate: 7.6 symbols/min [2025-09-23T18:45:17.950232] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:17.984606] [DEBUG] [LOCAL ] EXP: Loaded 30188 existing records from primary storage. [2025-09-23T18:45:17.984766] [INFO ] [MAIN ] EXP: Loaded 30188 existing records. [2025-09-23T18:45:18.163299] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:18.163548] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-23T18:45:18.163597] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-23T18:45:18.164415] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-23T18:45:18.164476] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-23T18:45:18.541938] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:45:18.547133] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:18.554419] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-23T18:45:18.584785] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T18:45:18.602146] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-23T18:45:19.230970] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T18:45:19.402214] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-23T18:45:19.607541] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T18:45:20.202166] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-23T18:45:20.532307] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T18:45:20.761662] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:45:21.002232] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-23T18:45:21.121016] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T18:45:21.802246] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-23T18:45:22.582462] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T18:45:22.602153] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-23T18:45:23.089544] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T18:45:23.402252] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-23T18:45:24.202202] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-23T18:45:24.585170] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:45:24.710823] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T18:45:25.002256] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-23T18:45:25.210422] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T18:45:25.802209] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-23T18:45:26.501514] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:45:26.602202] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-23T18:45:26.748119] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T18:45:27.402251] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-23T18:45:28.124268] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T18:45:28.202154] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-23T18:45:28.888568] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:45:29.002157] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-23T18:45:29.709556] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T18:45:29.802159] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-23T18:45:30.202627] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T18:45:30.602200] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-23T18:45:31.224300] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T18:45:31.402175] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-23T18:45:32.202166] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-23T18:45:32.259969] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:45:33.002195] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-23T18:45:33.298170] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T18:45:33.330926] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:45:33.802201] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-23T18:45:34.457805] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T18:45:34.602207] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-23T18:45:35.030250] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T18:45:35.402189] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-23T18:45:36.202194] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-23T18:45:36.484313] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T18:45:36.550923] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T18:45:37.002188] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-23T18:45:37.309383] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T18:45:37.802209] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-23T18:45:38.299981] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T18:45:38.602187] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-23T18:45:38.779587] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:45:39.402250] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-23T18:45:40.059119] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T18:45:40.202184] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-23T18:45:40.850052] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:45:40.855516] [INFO ] [REMOTE ] EXP: Full fetch complete (43227 records). [2025-09-23T18:45:40.855609] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-23T18:45:41.013110] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-23T18:45:41.281273] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-23T18:45:41.281363] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-23T18:45:41.282032] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-23T18:45:41.282094] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-23T18:45:41.283051] [DEBUG] [LOCAL ] EXP: Trimmed 43227 records to 30120 (keeping 200 days of data) [2025-09-23T18:45:41.477349] [DEBUG] [LOCAL ] EXP: Primary data saved (30120 records). [2025-09-23T18:45:41.477484] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-23T18:45:41.477567] [INFO ] [MAIN ] Update Progress: 797/2372 symbols completed. EXP took 23.7s. Estimated remaining: 3h 28m 45s. Rate: 7.5 symbols/min [2025-09-23T18:45:41.802166] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-23T18:45:41.976175] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T18:45:42.602196] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-23T18:45:42.872544] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T18:45:42.934527] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T18:45:43.402214] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-23T18:45:44.202185] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-23T18:45:44.382435] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T18:45:45.002189] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-23T18:45:45.004340] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T18:45:45.014566] [INFO ] [REMOTE ] EW: Full fetch complete (77347 records). [2025-09-23T18:45:45.014770] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-23T18:45:45.349303] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T18:45:45.393569] [INFO ] [REMOTE ] EXG: Full fetch complete (49965 records). [2025-09-23T18:45:45.413007] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-23T18:45:45.529534] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-23T18:45:45.541591] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-23T18:45:45.562589] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-23T18:45:45.562701] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-23T18:45:45.625335] [DEBUG] [LOCAL ] EW: Trimmed 77347 records to 53396 (keeping 200 days of data) [2025-09-23T18:45:45.963669] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-23T18:45:45.964362] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-23T18:45:45.965440] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-23T18:45:45.965791] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-23T18:45:45.972412] [DEBUG] [LOCAL ] EXG: Trimmed 49965 records to 34386 (keeping 200 days of data) [2025-09-23T18:45:46.407841] [DEBUG] [LOCAL ] EXG: Primary data saved (34386 records). [2025-09-23T18:45:46.408971] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-23T18:45:46.409154] [INFO ] [MAIN ] Update Progress: 798/2372 symbols completed. EXG took 31.3s. Estimated remaining: 3h 28m 31s. Rate: 7.5 symbols/min [2025-09-23T18:45:46.424167] [DEBUG] [LOCAL ] EW: Primary data saved (53396 records). [2025-09-23T18:45:46.424325] [INFO ] [MAIN ] EW: Full history saved. [2025-09-23T18:45:46.424419] [INFO ] [MAIN ] Update Progress: 799/2372 symbols completed. EW took 38.4s. Estimated remaining: 3h 28m 8s. Rate: 7.6 symbols/min [2025-09-23T18:45:46.947744] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-23T18:45:46.958235] [INFO ] [REMOTE ] EXK: Full fetch complete (76447 records). [2025-09-23T18:45:46.958370] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-23T18:45:47.346431] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-23T18:45:47.346515] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-23T18:45:47.347366] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-23T18:45:47.347430] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-23T18:45:47.349814] [DEBUG] [LOCAL ] EXK: Trimmed 76447 records to 53111 (keeping 200 days of data) [2025-09-23T18:45:47.652682] [DEBUG] [LOCAL ] EXK: Primary data saved (53111 records). [2025-09-23T18:45:47.652827] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-23T18:45:47.652902] [INFO ] [MAIN ] Update Progress: 800/2372 symbols completed. EXK took 30.6s. Estimated remaining: 3h 27m 47s. Rate: 7.6 symbols/min [2025-09-23T18:45:48.345891] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:48.346915] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:48.295056] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:48.372104] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:48.445366] [DEBUG] [LOCAL ] FAF: Loaded 42036 existing records from primary storage. [2025-09-23T18:45:48.445596] [INFO ] [MAIN ] FAF: Loaded 42036 existing records. [2025-09-23T18:45:48.597252] [DEBUG] [LOCAL ] EXR: Loaded 45520 existing records from primary storage. [2025-09-23T18:45:48.597596] [INFO ] [MAIN ] EXR: Loaded 45520 existing records. [2025-09-23T18:45:48.608946] [DEBUG] [LOCAL ] EXPD: Loaded 48212 existing records from primary storage. [2025-09-23T18:45:48.633993] [INFO ] [MAIN ] EXPD: Loaded 48212 existing records. [2025-09-23T18:45:48.761197] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-23T18:45:48.841255] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-09-23T18:45:48.770389] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:48.907608] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-23T18:45:48.945677] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-23T18:45:48.997345] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-23T18:45:49.052417] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-23T18:45:49.170298] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:49.291875] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-23T18:45:49.292143] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:49.305754] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-23T18:45:49.327639] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-23T18:45:49.300471] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:49.338118] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-23T18:45:49.348508] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-23T18:45:49.348573] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-23T18:45:49.364671] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-23T18:45:49.364528] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-23T18:45:49.378098] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-23T18:45:49.387969] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-23T18:45:49.422576] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-23T18:45:49.428459] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-23T18:45:50.388498] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:50.481069] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-23T18:45:50.737570] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:50.798403] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-23T18:45:50.804539] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:50.839856] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:50.840360] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-23T18:45:50.841084] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-23T18:45:52.024776] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:45:52.031929] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-23T18:45:52.190458] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:45:52.199203] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-23T18:45:52.306608] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:45:52.315924] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-23T18:45:53.088081] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T18:45:53.096869] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-23T18:45:53.270298] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-23T18:45:53.283090] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-23T18:45:53.445911] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T18:45:53.455191] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-23T18:45:53.598729] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T18:45:53.802212] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-23T18:45:54.000133] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:45:54.602238] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-23T18:45:55.033465] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T18:45:55.155121] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:45:55.303800] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T18:45:55.402247] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-23T18:45:55.810236] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T18:45:56.202208] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-23T18:45:56.753030] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T18:45:57.002260] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-23T18:45:57.588045] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T18:45:57.802256] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-23T18:45:58.602175] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-23T18:45:58.801918] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T18:45:59.131632] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:45:59.402236] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-23T18:46:00.044275] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T18:46:00.202264] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-23T18:46:00.998080] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T18:46:01.006556] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-23T18:46:01.802222] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-23T18:46:02.609462] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-23T18:46:02.630661] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-23T18:46:02.732486] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T18:46:03.402171] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-23T18:46:03.673373] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T18:46:03.744712] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:46:04.202199] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-23T18:46:04.898317] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T18:46:05.002224] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-23T18:46:05.802223] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-23T18:46:06.377314] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:46:06.573538] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-23T18:46:06.602153] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-23T18:46:06.939896] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:46:07.402216] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-23T18:46:08.202229] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-23T18:46:08.931407] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T18:46:09.002212] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-23T18:46:09.381068] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-23T18:46:09.481560] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:46:09.802213] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-23T18:46:10.237052] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:46:10.602202] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-23T18:46:11.402175] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-23T18:46:11.486167] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T18:46:12.202191] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-23T18:46:12.928607] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T18:46:12.940156] [INFO ] [REMOTE ] EXPD: Full fetch complete (69184 records). [2025-09-23T18:46:12.940435] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-23T18:46:13.011921] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-23T18:46:13.595391] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-23T18:46:13.595567] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-23T18:46:13.597145] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-23T18:46:13.609578] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-23T18:46:13.616518] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T18:46:13.633704] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-09-23T18:46:13.669098] [DEBUG] [LOCAL ] EXPD: Trimmed 69184 records to 48158 (keeping 200 days of data) [2025-09-23T18:46:13.810786] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-23T18:46:14.117940] [DEBUG] [LOCAL ] EXPD: Primary data saved (48158 records). [2025-09-23T18:46:14.118165] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-23T18:46:14.120311] [INFO ] [MAIN ] Update Progress: 801/2372 symbols completed. EXPD took 26.5s. Estimated remaining: 3h 28m 15s. Rate: 7.5 symbols/min [2025-09-23T18:46:14.316888] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:14.378350] [DEBUG] [LOCAL ] FBIN: Loaded 50429 existing records from primary storage. [2025-09-23T18:46:14.378594] [INFO ] [MAIN ] FBIN: Loaded 50429 existing records. [2025-09-23T18:46:14.602508] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:14.602316] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-23T18:46:14.604116] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-23T18:46:14.604262] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-23T18:46:14.612335] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-23T18:46:14.623616] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-23T18:46:14.689372] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:46:14.750218] [INFO ] [REMOTE ] EXR: Full fetch complete (65759 records). [2025-09-23T18:46:14.750448] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-23T18:46:15.355823] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:15.409072] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-23T18:46:15.455440] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-23T18:46:15.455553] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-23T18:46:15.456463] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-23T18:46:15.456530] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-23T18:46:15.458585] [DEBUG] [LOCAL ] EXR: Trimmed 65759 records to 45526 (keeping 200 days of data) [2025-09-23T18:46:15.608456] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T18:46:15.683908] [INFO ] [REMOTE ] FAF: Full fetch complete (57511 records). [2025-09-23T18:46:15.709498] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-23T18:46:15.976594] [DEBUG] [LOCAL ] EXR: Primary data saved (45526 records). [2025-09-23T18:46:15.982876] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-23T18:46:15.994367] [INFO ] [MAIN ] Update Progress: 802/2372 symbols completed. EXR took 28.3s. Estimated remaining: 3h 27m 55s. Rate: 7.6 symbols/min [2025-09-23T18:46:16.376542] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-23T18:46:16.395220] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:16.393472] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-23T18:46:16.396217] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-23T18:46:16.396668] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-23T18:46:16.398570] [DEBUG] [LOCAL ] FAF: Trimmed 57511 records to 42006 (keeping 200 days of data) [2025-09-23T18:46:16.523937] [DEBUG] [LOCAL ] FBK: Loaded 25489 existing records from primary storage. [2025-09-23T18:46:16.528322] [INFO ] [MAIN ] FBK: Loaded 25489 existing records. [2025-09-23T18:46:16.831880] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:16.834852] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-23T18:46:16.839066] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-23T18:46:16.840441] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-23T18:46:16.840907] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-23T18:46:17.059773] [DEBUG] [LOCAL ] FAF: Primary data saved (42006 records). [2025-09-23T18:46:17.119902] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-23T18:46:17.134634] [INFO ] [MAIN ] Update Progress: 803/2372 symbols completed. FAF took 29.5s. Estimated remaining: 3h 27m 34s. Rate: 7.6 symbols/min [2025-09-23T18:46:17.444522] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T18:46:17.490692] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-23T18:46:17.473172] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:17.554685] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:17.523552] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-23T18:46:17.565217] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-23T18:46:17.617845] [DEBUG] [LOCAL ] FBP: Loaded 46272 existing records from primary storage. [2025-09-23T18:46:17.618020] [INFO ] [MAIN ] FBP: Loaded 46272 existing records. [2025-09-23T18:46:17.808813] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-23T18:46:17.815202] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:17.815516] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-23T18:46:17.816334] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-23T18:46:17.817435] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-23T18:46:17.817530] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-23T18:46:18.187854] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:18.602244] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-23T18:46:18.739158] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T18:46:19.268766] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T18:46:19.402234] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-23T18:46:19.910005] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T18:46:20.043744] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T18:46:20.205167] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-23T18:46:20.209058] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-23T18:46:21.002236] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-23T18:46:21.136134] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T18:46:21.802227] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-23T18:46:22.373805] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:46:22.602229] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-23T18:46:23.008358] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T18:46:23.402193] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-23T18:46:24.010483] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:46:24.202206] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-23T18:46:24.838424] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:46:25.002203] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-23T18:46:25.578893] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:46:25.802207] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-23T18:46:26.441795] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:46:26.602202] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-23T18:46:27.138856] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:46:27.402286] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-23T18:46:27.900735] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T18:46:28.202207] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-23T18:46:28.424379] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:46:29.002193] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-23T18:46:29.549778] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T18:46:29.802222] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-23T18:46:30.555676] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T18:46:30.602204] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-23T18:46:31.160707] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T18:46:31.402197] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-23T18:46:32.202190] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-23T18:46:32.992832] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T18:46:33.003134] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-23T18:46:33.082234] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-23T18:46:33.114502] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T18:46:33.802198] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-23T18:46:34.129793] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:46:34.592255] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T18:46:34.602157] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-23T18:46:35.402175] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-23T18:46:35.649314] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:46:36.202197] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-23T18:46:36.708931] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:46:37.002193] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-23T18:46:37.802178] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-23T18:46:37.905349] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T18:46:37.913978] [INFO ] [REMOTE ] FBIN: Full fetch complete (72628 records). [2025-09-23T18:46:37.914220] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-23T18:46:38.326460] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-23T18:46:38.326634] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-23T18:46:38.327614] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-23T18:46:38.327713] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-23T18:46:38.329354] [DEBUG] [LOCAL ] FBIN: Trimmed 72628 records to 50411 (keeping 200 days of data) [2025-09-23T18:46:38.619061] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-23T18:46:38.659068] [DEBUG] [LOCAL ] FBIN: Primary data saved (50411 records). [2025-09-23T18:46:38.659211] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-23T18:46:38.659321] [INFO ] [MAIN ] Update Progress: 804/2372 symbols completed. FBIN took 24.5s. Estimated remaining: 3h 27m 53s. Rate: 7.5 symbols/min [2025-09-23T18:46:38.841319] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:38.885981] [DEBUG] [LOCAL ] FBRT: Loaded 34333 existing records from primary storage. [2025-09-23T18:46:38.886314] [INFO ] [MAIN ] FBRT: Loaded 34333 existing records. [2025-09-23T18:46:39.087977] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:39.088944] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-23T18:46:39.089252] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-23T18:46:39.090746] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-23T18:46:39.090815] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-23T18:46:39.311631] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-23T18:46:39.396994] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-23T18:46:39.425075] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T18:46:39.456760] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-23T18:46:39.484969] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-23T18:46:39.641557] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:40.027441] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:46:40.027606] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-23T18:46:40.027861] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-23T18:46:40.037010] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-23T18:46:40.037094] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-23T18:46:40.038868] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-23T18:46:40.228426] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-23T18:46:40.383328] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-23T18:46:40.383494] [INFO ] [MAIN ] F: Full history saved. [2025-09-23T18:46:40.383610] [INFO ] [MAIN ] Update Progress: 805/2372 symbols completed. F took 52.7s. Estimated remaining: 3h 27m 33s. Rate: 7.6 symbols/min [2025-09-23T18:46:40.555331] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:40.574378] [DEBUG] [LOCAL ] FC: Loaded 15403 existing records from primary storage. [2025-09-23T18:46:40.574512] [INFO ] [MAIN ] FC: Loaded 15403 existing records. [2025-09-23T18:46:40.841715] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:40.842848] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-23T18:46:40.843087] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-23T18:46:40.844004] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-23T18:46:40.844064] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-23T18:46:41.005763] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-23T18:46:41.005637] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:46:41.113732] [INFO ] [REMOTE ] FBP: Full fetch complete (66253 records). [2025-09-23T18:46:41.128113] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-23T18:46:41.355575] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:41.635508] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T18:46:41.662907] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-23T18:46:41.663140] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-23T18:46:41.663999] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-23T18:46:41.664082] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-23T18:46:41.665617] [DEBUG] [LOCAL ] FBP: Trimmed 66253 records to 46254 (keeping 200 days of data) [2025-09-23T18:46:41.847493] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-23T18:46:41.954416] [DEBUG] [LOCAL ] FBP: Primary data saved (46254 records). [2025-09-23T18:46:41.954551] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-23T18:46:41.954632] [INFO ] [MAIN ] Update Progress: 806/2372 symbols completed. FBP took 24.8s. Estimated remaining: 3h 27m 12s. Rate: 7.6 symbols/min [2025-09-23T18:46:42.141048] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:42.185723] [DEBUG] [LOCAL ] FCF: Loaded 39806 existing records from primary storage. [2025-09-23T18:46:42.185933] [INFO ] [MAIN ] FCF: Loaded 39806 existing records. [2025-09-23T18:46:42.383177] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:42.383476] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-23T18:46:42.392887] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-23T18:46:42.401344] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-23T18:46:42.403504] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-23T18:46:42.477209] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:46:42.610148] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-23T18:46:42.787601] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:42.800337] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:46:42.804985] [INFO ] [REMOTE ] FBK: Full fetch complete (32917 records). [2025-09-23T18:46:42.805191] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-23T18:46:43.192446] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-23T18:46:43.192538] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-23T18:46:43.193095] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-23T18:46:43.193159] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-23T18:46:43.194203] [DEBUG] [LOCAL ] FBK: Trimmed 32917 records to 25604 (keeping 200 days of data) [2025-09-23T18:46:43.369703] [DEBUG] [LOCAL ] FBK: Primary data saved (25604 records). [2025-09-23T18:46:43.369857] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-23T18:46:43.369974] [INFO ] [MAIN ] Update Progress: 807/2372 symbols completed. FBK took 27.4s. Estimated remaining: 3h 26m 52s. Rate: 7.6 symbols/min [2025-09-23T18:46:43.403297] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-23T18:46:43.561236] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:43.579101] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:46:43.608594] [DEBUG] [LOCAL ] FCN: Loaded 26353 existing records from primary storage. [2025-09-23T18:46:43.608762] [INFO ] [MAIN ] FCN: Loaded 26353 existing records. [2025-09-23T18:46:43.796781] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:43.797026] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-23T18:46:43.797074] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-23T18:46:43.797795] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-23T18:46:43.797872] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-23T18:46:44.171994] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:44.202200] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-23T18:46:44.906560] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:46:45.002189] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-23T18:46:45.618122] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T18:46:45.802208] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-23T18:46:46.360019] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:46:46.602187] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-23T18:46:47.165413] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:46:47.402198] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-23T18:46:47.977000] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T18:46:48.207277] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-23T18:46:48.218202] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T18:46:49.002227] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-23T18:46:49.423262] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T18:46:49.793141] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:46:49.802160] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-23T18:46:50.602198] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-23T18:46:50.831343] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T18:46:51.402263] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-23T18:46:51.603783] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T18:46:52.202172] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-23T18:46:52.394538] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T18:46:53.002226] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-23T18:46:53.573065] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:46:53.802206] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-23T18:46:54.380731] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T18:46:54.602223] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-23T18:46:55.168504] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T18:46:55.336236] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T18:46:55.402238] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-23T18:46:56.202201] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-23T18:46:57.002169] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-23T18:46:57.005378] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T18:46:57.278770] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T18:46:57.802154] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-23T18:46:57.898998] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T18:46:58.453919] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T18:46:58.602205] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-23T18:46:59.402214] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-23T18:46:59.666745] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T18:47:00.202227] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-23T18:47:00.563313] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T18:47:01.002209] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-23T18:47:01.802173] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-23T18:47:01.878341] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T18:47:01.914451] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T18:47:02.602184] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-23T18:47:02.717924] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:47:03.402216] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-23T18:47:03.493123] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:47:04.202207] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-23T18:47:04.310759] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T18:47:05.002163] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-23T18:47:05.138574] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T18:47:05.802276] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-23T18:47:06.282825] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T18:47:06.291427] [INFO ] [REMOTE ] FBRT: Full fetch complete (48270 records). [2025-09-23T18:47:06.291703] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-23T18:47:06.607407] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-23T18:47:06.729704] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-23T18:47:06.729819] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-23T18:47:06.730548] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-23T18:47:06.730633] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-23T18:47:06.731989] [DEBUG] [LOCAL ] FBRT: Trimmed 48270 records to 34381 (keeping 200 days of data) [2025-09-23T18:47:06.837842] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:47:06.965567] [DEBUG] [LOCAL ] FBRT: Primary data saved (34381 records). [2025-09-23T18:47:06.965746] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-23T18:47:06.965848] [INFO ] [MAIN ] Update Progress: 808/2372 symbols completed. FBRT took 28.3s. Estimated remaining: 3h 27m 14s. Rate: 7.5 symbols/min [2025-09-23T18:47:07.150412] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:07.190979] [DEBUG] [LOCAL ] FCPT: Loaded 37416 existing records from primary storage. [2025-09-23T18:47:07.191163] [INFO ] [MAIN ] FCPT: Loaded 37416 existing records. [2025-09-23T18:47:07.404837] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T18:47:07.404132] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-23T18:47:07.412051] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:07.413616] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-23T18:47:07.413698] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-23T18:47:07.414567] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-23T18:47:07.414670] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-23T18:47:07.808426] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:08.202197] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-23T18:47:08.427087] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T18:47:09.002226] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-23T18:47:09.590481] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:47:09.802220] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-23T18:47:10.544526] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:47:10.602149] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-23T18:47:10.831838] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T18:47:11.402211] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-23T18:47:12.005351] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:47:12.202235] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-23T18:47:12.268414] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T18:47:13.002201] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-23T18:47:13.548950] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:47:13.802207] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-23T18:47:14.238144] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T18:47:14.240967] [INFO ] [REMOTE ] FC: Full fetch complete (21535 records). [2025-09-23T18:47:14.241040] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-23T18:47:14.604610] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-23T18:47:14.605680] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-23T18:47:14.605771] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-23T18:47:14.606223] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-23T18:47:14.606265] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-23T18:47:14.607084] [DEBUG] [LOCAL ] FC: Trimmed 21535 records to 15388 (keeping 200 days of data) [2025-09-23T18:47:14.697734] [DEBUG] [LOCAL ] FC: Primary data saved (15388 records). [2025-09-23T18:47:14.697879] [INFO ] [MAIN ] FC: Full history saved. [2025-09-23T18:47:14.697967] [INFO ] [MAIN ] Update Progress: 809/2372 symbols completed. FC took 34.3s. Estimated remaining: 3h 27m 6s. Rate: 7.5 symbols/min [2025-09-23T18:47:14.872282] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:14.872473] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-23T18:47:14.872527] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-23T18:47:14.872706] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-23T18:47:14.872821] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-23T18:47:14.872885] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-23T18:47:14.872920] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-23T18:47:15.227002] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:15.399512] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T18:47:15.408089] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-23T18:47:15.799228] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T18:47:15.805731] [INFO ] [REMOTE ] FCF: Full fetch complete (58010 records). [2025-09-23T18:47:15.805859] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-23T18:47:16.194249] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-23T18:47:16.194416] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-23T18:47:16.195283] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-23T18:47:16.195370] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-23T18:47:16.209588] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-23T18:47:16.197113] [DEBUG] [LOCAL ] FCF: Trimmed 58010 records to 39757 (keeping 200 days of data) [2025-09-23T18:47:16.212573] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T18:47:16.464773] [DEBUG] [LOCAL ] FCF: Primary data saved (39757 records). [2025-09-23T18:47:16.464915] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-23T18:47:16.465035] [INFO ] [MAIN ] Update Progress: 810/2372 symbols completed. FCF took 34.5s. Estimated remaining: 3h 26m 46s. Rate: 7.6 symbols/min [2025-09-23T18:47:16.648484] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T18:47:16.651698] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:16.668341] [DEBUG] [LOCAL ] FCT: Loaded 14298 existing records from primary storage. [2025-09-23T18:47:16.668475] [INFO ] [MAIN ] FCT: Loaded 14298 existing records. [2025-09-23T18:47:16.845775] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:16.846117] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-23T18:47:16.846197] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-23T18:47:16.846780] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-23T18:47:16.846843] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-23T18:47:17.007289] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-23T18:47:17.226533] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:17.567705] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T18:47:17.802249] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-23T18:47:18.105593] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-23T18:47:18.602206] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-23T18:47:18.941624] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T18:47:19.402191] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-23T18:47:19.678192] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-23T18:47:20.202203] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-23T18:47:20.577272] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T18:47:21.002202] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-23T18:47:21.802176] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-23T18:47:22.079466] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T18:47:22.602230] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-23T18:47:22.739680] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:47:22.743939] [INFO ] [REMOTE ] FCN: Full fetch complete (35621 records). [2025-09-23T18:47:22.744030] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-23T18:47:23.125062] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-23T18:47:23.125157] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-23T18:47:23.125742] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-23T18:47:23.125806] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-23T18:47:23.126808] [DEBUG] [LOCAL ] FCN: Trimmed 35621 records to 26312 (keeping 200 days of data) [2025-09-23T18:47:23.289774] [DEBUG] [LOCAL ] FCN: Primary data saved (26312 records). [2025-09-23T18:47:23.289922] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-23T18:47:23.290013] [INFO ] [MAIN ] Update Progress: 811/2372 symbols completed. FCN took 39.9s. Estimated remaining: 3h 26m 36s. Rate: 7.6 symbols/min [2025-09-23T18:47:23.407279] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-23T18:47:23.472977] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:23.529565] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-23T18:47:23.529759] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-09-23T18:47:23.707751] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:23.708038] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-23T18:47:23.708085] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-23T18:47:23.709305] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-23T18:47:23.709365] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-23T18:47:24.098164] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:24.131637] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:47:24.152835] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:47:24.202244] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-23T18:47:25.002231] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-23T18:47:25.802225] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-23T18:47:26.208407] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-23T18:47:26.348239] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-23T18:47:26.371405] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T18:47:26.602211] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-23T18:47:27.402196] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-23T18:47:27.627413] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T18:47:28.202218] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-23T18:47:28.241895] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T18:47:29.002250] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-23T18:47:29.352097] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T18:47:29.802166] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-23T18:47:29.874522] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T18:47:30.602190] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-23T18:47:30.709566] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T18:47:31.402248] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-23T18:47:31.703421] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-23T18:47:32.154356] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T18:47:32.202145] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-23T18:47:33.002214] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-23T18:47:33.267835] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T18:47:33.504854] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:47:33.505759] [INFO ] [REMOTE ] FCRX: Full fetch complete (1644 records). [2025-09-23T18:47:33.505846] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-23T18:47:33.686629] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-23T18:47:33.686856] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:47:33.686902] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:47:33.686940] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-23T18:47:33.687000] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-23T18:47:33.687035] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-23T18:47:33.687074] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-23T18:47:33.687129] [INFO ] [MAIN ] Update Progress: 812/2372 symbols completed. FCRX took 19.0s. Estimated remaining: 3h 26m 33s. Rate: 7.6 symbols/min [2025-09-23T18:47:33.807379] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-23T18:47:33.858433] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:33.891929] [DEBUG] [LOCAL ] FDP: Loaded 30411 existing records from primary storage. [2025-09-23T18:47:33.892075] [INFO ] [MAIN ] FDP: Loaded 30411 existing records. [2025-09-23T18:47:34.070370] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:34.070625] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-23T18:47:34.070703] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-23T18:47:34.071620] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-23T18:47:34.071713] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-23T18:47:34.431681] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:34.602168] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-23T18:47:34.658556] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:47:35.402195] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-23T18:47:35.597697] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T18:47:35.967731] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T18:47:36.202189] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-23T18:47:37.002206] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-23T18:47:37.802198] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-23T18:47:38.032109] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T18:47:38.212077] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T18:47:38.602241] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-23T18:47:38.948717] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T18:47:39.402207] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-23T18:47:40.202195] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-23T18:47:40.592016] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T18:47:40.593948] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T18:47:41.002145] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-23T18:47:41.466325] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T18:47:41.802206] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-23T18:47:42.602167] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-23T18:47:42.834860] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T18:47:42.878785] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T18:47:43.402267] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-23T18:47:43.660667] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:47:44.202200] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-23T18:47:44.533199] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T18:47:45.002261] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-23T18:47:45.117951] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:47:45.802214] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-23T18:47:46.169052] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T18:47:46.513881] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T18:47:46.517087] [INFO ] [REMOTE ] FCT: Full fetch complete (21093 records). [2025-09-23T18:47:46.517198] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-23T18:47:46.607313] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-23T18:47:46.903355] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-23T18:47:46.903440] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-23T18:47:46.904020] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-23T18:47:46.904087] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-23T18:47:46.904780] [DEBUG] [LOCAL ] FCT: Trimmed 21093 records to 14327 (keeping 200 days of data) [2025-09-23T18:47:47.000572] [DEBUG] [LOCAL ] FCT: Primary data saved (14327 records). [2025-09-23T18:47:47.000761] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-23T18:47:47.000866] [INFO ] [MAIN ] Update Progress: 813/2372 symbols completed. FCT took 30.5s. Estimated remaining: 3h 26m 35s. Rate: 7.5 symbols/min [2025-09-23T18:47:47.179900] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:47.207403] [DEBUG] [LOCAL ] FDS: Loaded 25991 existing records from primary storage. [2025-09-23T18:47:47.207541] [INFO ] [MAIN ] FDS: Loaded 25991 existing records. [2025-09-23T18:47:47.386590] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:47.386867] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-23T18:47:47.386917] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-23T18:47:47.387754] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-23T18:47:47.387815] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-23T18:47:47.408079] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-23T18:47:47.741259] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:48.202145] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-23T18:47:48.342908] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T18:47:48.762100] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T18:47:49.002222] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-23T18:47:49.063083] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T18:47:49.802215] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-23T18:47:50.602270] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-23T18:47:50.875223] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T18:47:50.881622] [INFO ] [REMOTE ] FCPT: Full fetch complete (53284 records). [2025-09-23T18:47:50.881759] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-23T18:47:51.272531] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-23T18:47:51.272635] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-23T18:47:51.273418] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-23T18:47:51.273543] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-23T18:47:51.274807] [DEBUG] [LOCAL ] FCPT: Trimmed 53284 records to 37424 (keeping 200 days of data) [2025-09-23T18:47:51.442032] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-23T18:47:51.512738] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-23T18:47:51.551052] [DEBUG] [LOCAL ] FCPT: Primary data saved (37424 records). [2025-09-23T18:47:51.551215] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-23T18:47:51.551309] [INFO ] [MAIN ] Update Progress: 814/2372 symbols completed. FCPT took 44.6s. Estimated remaining: 3h 26m 20s. Rate: 7.6 symbols/min [2025-09-23T18:47:51.737980] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:51.757717] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:47:51.813373] [DEBUG] [LOCAL ] FDX: Loaded 51613 existing records from primary storage. [2025-09-23T18:47:51.813517] [INFO ] [MAIN ] FDX: Loaded 51613 existing records. [2025-09-23T18:47:51.993263] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:51.993521] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-23T18:47:51.993569] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-23T18:47:51.994862] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-23T18:47:51.994921] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-23T18:47:52.207383] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-23T18:47:52.351210] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:52.855335] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T18:47:53.002166] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-23T18:47:53.236387] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T18:47:53.802189] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-23T18:47:53.864040] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T18:47:54.602254] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-23T18:47:55.402197] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-23T18:47:55.532139] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T18:47:56.202205] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-23T18:47:56.234548] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:47:56.688804] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:47:56.693788] [INFO ] [REMOTE ] FDP: Full fetch complete (42746 records). [2025-09-23T18:47:56.693918] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-23T18:47:57.007281] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-23T18:47:57.096455] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-23T18:47:57.096629] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-23T18:47:57.097421] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-23T18:47:57.097566] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-23T18:47:57.099146] [DEBUG] [LOCAL ] FDP: Trimmed 42746 records to 30430 (keeping 200 days of data) [2025-09-23T18:47:57.224224] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:47:57.318841] [DEBUG] [LOCAL ] FDP: Primary data saved (30430 records). [2025-09-23T18:47:57.318992] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-23T18:47:57.319078] [INFO ] [MAIN ] Update Progress: 815/2372 symbols completed. FDP took 23.6s. Estimated remaining: 3h 26m 8s. Rate: 7.6 symbols/min [2025-09-23T18:47:57.498591] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:57.549155] [DEBUG] [LOCAL ] FE: Loaded 53438 existing records from primary storage. [2025-09-23T18:47:57.549300] [INFO ] [MAIN ] FE: Loaded 53438 existing records. [2025-09-23T18:47:57.728952] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:57.729381] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-23T18:47:57.729436] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-23T18:47:57.730621] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-23T18:47:57.730717] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-23T18:47:57.807267] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-23T18:47:58.111664] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:58.602212] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-23T18:47:59.133760] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-23T18:47:59.148281] [INFO ] [REMOTE ] FCX: Full fetch complete (77739 records). [2025-09-23T18:47:59.148501] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-23T18:47:59.405612] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-23T18:47:59.732864] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-23T18:47:59.733162] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-23T18:47:59.734662] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-23T18:47:59.737139] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T18:47:59.735188] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-23T18:47:59.762561] [DEBUG] [LOCAL ] FCX: Trimmed 77739 records to 53700 (keeping 200 days of data) [2025-09-23T18:47:59.766223] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T18:48:00.096017] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-09-23T18:48:00.096187] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-23T18:48:00.096287] [INFO ] [MAIN ] Update Progress: 816/2372 symbols completed. FCX took 36.8s. Estimated remaining: 3h 25m 51s. Rate: 7.6 symbols/min [2025-09-23T18:48:00.207309] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-23T18:48:00.268832] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:00.268965] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-23T18:48:00.269018] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-23T18:48:00.269158] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-23T18:48:00.269204] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-23T18:48:00.269245] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-23T18:48:00.269278] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-23T18:48:00.620633] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:01.002164] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-23T18:48:01.120244] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T18:48:01.352115] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-23T18:48:01.709853] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:48:01.802222] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-23T18:48:02.602235] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-23T18:48:03.402248] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-23T18:48:04.158919] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T18:48:04.202148] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-23T18:48:05.002243] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-23T18:48:05.173168] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T18:48:05.222834] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:48:05.737634] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (3.14 seconds). [2025-09-23T18:48:05.802165] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-23T18:48:06.327223] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T18:48:06.602213] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-23T18:48:06.921501] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T18:48:07.402177] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-23T18:48:07.526222] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T18:48:08.202239] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-23T18:48:08.342296] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T18:48:09.002200] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-23T18:48:09.642476] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:48:09.802226] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-23T18:48:10.609239] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-23T18:48:10.629920] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T18:48:11.166359] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T18:48:11.402196] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-23T18:48:11.615934] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:48:12.202217] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-23T18:48:12.549038] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T18:48:13.002233] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-23T18:48:13.034586] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T18:48:13.041341] [INFO ] [REMOTE ] FDS: Full fetch complete (36728 records). [2025-09-23T18:48:13.041493] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-23T18:48:13.422002] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-23T18:48:13.422090] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-23T18:48:13.423051] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-23T18:48:13.423113] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-23T18:48:13.423995] [DEBUG] [LOCAL ] FDS: Trimmed 36728 records to 26130 (keeping 200 days of data) [2025-09-23T18:48:13.590092] [DEBUG] [LOCAL ] FDS: Primary data saved (26130 records). [2025-09-23T18:48:13.590232] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-23T18:48:13.590319] [INFO ] [MAIN ] Update Progress: 817/2372 symbols completed. FDS took 26.6s. Estimated remaining: 3h 25m 53s. Rate: 7.6 symbols/min [2025-09-23T18:48:13.766352] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:13.802217] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-23T18:48:13.818551] [DEBUG] [LOCAL ] FERG: Loaded 49036 existing records from primary storage. [2025-09-23T18:48:13.818745] [INFO ] [MAIN ] FERG: Loaded 49036 existing records. [2025-09-23T18:48:13.995980] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:13.996254] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-23T18:48:13.996302] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-23T18:48:13.997457] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-23T18:48:13.997518] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-23T18:48:14.345535] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:14.602200] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-23T18:48:15.376089] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-23T18:48:15.402173] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-23T18:48:15.438601] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T18:48:15.916859] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T18:48:16.202198] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-23T18:48:17.002224] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-23T18:48:17.076488] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:48:17.337616] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T18:48:17.802236] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-23T18:48:17.843190] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T18:48:18.602303] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-23T18:48:19.122320] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T18:48:19.402274] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-23T18:48:20.101871] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:48:20.202211] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-23T18:48:21.002177] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-23T18:48:21.198908] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T18:48:21.321987] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T18:48:21.619774] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T18:48:21.802199] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-23T18:48:22.602213] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-23T18:48:22.888752] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-23T18:48:23.270082] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T18:48:23.402169] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-23T18:48:24.202258] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-23T18:48:25.002224] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-23T18:48:25.802255] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-23T18:48:26.247329] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-23T18:48:26.422609] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-23T18:48:26.599812] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T18:48:26.600824] [INFO ] [REMOTE ] FENG: Full fetch complete (2119 records). [2025-09-23T18:48:26.600909] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-23T18:48:26.613468] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-23T18:48:26.799637] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T18:48:26.799885] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:48:26.799967] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:48:26.800066] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-23T18:48:26.800195] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-23T18:48:26.800270] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-23T18:48:26.800367] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-23T18:48:26.800477] [INFO ] [MAIN ] Update Progress: 818/2372 symbols completed. FENG took 26.7s. Estimated remaining: 3h 25m 55s. Rate: 7.5 symbols/min [2025-09-23T18:48:26.986461] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:27.010487] [DEBUG] [LOCAL ] FET: Loaded 12626 existing records from primary storage. [2025-09-23T18:48:27.010672] [INFO ] [MAIN ] FET: Loaded 12626 existing records. [2025-09-23T18:48:27.225942] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:27.226309] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-23T18:48:27.230210] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-23T18:48:27.231022] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-23T18:48:27.231106] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-23T18:48:27.232441] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-23T18:48:27.420947] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-23T18:48:27.606419] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:28.202166] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-23T18:48:28.269871] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:48:29.002202] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-23T18:48:29.550959] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T18:48:29.600780] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T18:48:29.802210] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-23T18:48:30.090096] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T18:48:30.103268] [INFO ] [REMOTE ] FE: Full fetch complete (77190 records). [2025-09-23T18:48:30.103514] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-23T18:48:30.524144] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-23T18:48:30.524293] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-23T18:48:30.525323] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-23T18:48:30.525423] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-23T18:48:30.527041] [DEBUG] [LOCAL ] FE: Trimmed 77190 records to 53435 (keeping 200 days of data) [2025-09-23T18:48:30.625525] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-23T18:48:30.767465] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:48:30.883137] [DEBUG] [LOCAL ] FE: Primary data saved (53435 records). [2025-09-23T18:48:30.883422] [INFO ] [MAIN ] FE: Full history saved. [2025-09-23T18:48:30.883700] [INFO ] [MAIN ] Update Progress: 819/2372 symbols completed. FE took 33.6s. Estimated remaining: 3h 25m 40s. Rate: 7.6 symbols/min [2025-09-23T18:48:31.059574] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:31.092160] [DEBUG] [LOCAL ] FF: Loaded 25726 existing records from primary storage. [2025-09-23T18:48:31.092330] [INFO ] [MAIN ] FF: Loaded 25726 existing records. [2025-09-23T18:48:31.285019] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:31.285309] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-23T18:48:31.285359] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-23T18:48:31.286046] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-23T18:48:31.286163] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-23T18:48:31.407399] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-23T18:48:31.682076] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:32.202163] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-23T18:48:32.308865] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:48:32.316238] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T18:48:33.002155] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-23T18:48:33.036035] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T18:48:33.802227] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-23T18:48:33.857562] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T18:48:34.592905] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:48:34.602198] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-23T18:48:35.384042] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T18:48:35.402140] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-23T18:48:36.202196] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-23T18:48:36.728015] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:48:37.002251] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-23T18:48:37.738839] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T18:48:37.788058] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:48:37.802144] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-23T18:48:38.572115] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T18:48:38.602157] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-23T18:48:39.264029] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T18:48:39.402232] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-23T18:48:40.202188] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-23T18:48:40.825180] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:48:41.002243] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-23T18:48:41.565410] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T18:48:41.802225] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-23T18:48:41.856758] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T18:48:41.871227] [INFO ] [REMOTE ] FDX: Full fetch complete (74423 records). [2025-09-23T18:48:41.871446] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-23T18:48:42.316398] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-23T18:48:42.316577] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-23T18:48:42.317520] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-23T18:48:42.317585] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-23T18:48:42.320328] [DEBUG] [LOCAL ] FDX: Trimmed 74423 records to 51622 (keeping 200 days of data) [2025-09-23T18:48:42.624190] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-23T18:48:42.669045] [DEBUG] [LOCAL ] FDX: Primary data saved (51622 records). [2025-09-23T18:48:42.669409] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-23T18:48:42.669673] [INFO ] [MAIN ] Update Progress: 820/2372 symbols completed. FDX took 51.1s. Estimated remaining: 3h 25m 39s. Rate: 7.5 symbols/min [2025-09-23T18:48:42.794065] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T18:48:42.870411] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:42.879803] [DEBUG] [LOCAL ] FFA: Loaded 5609 existing records from primary storage. [2025-09-23T18:48:42.879921] [INFO ] [MAIN ] FFA: Loaded 5609 existing records. [2025-09-23T18:48:43.054616] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:43.054973] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-23T18:48:43.055065] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-23T18:48:43.055487] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-23T18:48:43.055546] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-23T18:48:43.409234] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-23T18:48:43.417931] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:44.052009] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:48:44.055409] [INFO ] [REMOTE ] FET: Full fetch complete (18147 records). [2025-09-23T18:48:44.055616] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-23T18:48:44.205253] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-23T18:48:44.439698] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-23T18:48:44.439891] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-23T18:48:44.440419] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-23T18:48:44.440587] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-23T18:48:44.452627] [DEBUG] [LOCAL ] FET: Trimmed 18147 records to 12690 (keeping 200 days of data) [2025-09-23T18:48:44.480244] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T18:48:44.570318] [DEBUG] [LOCAL ] FET: Primary data saved (12690 records). [2025-09-23T18:48:44.570492] [INFO ] [MAIN ] FET: Full history saved. [2025-09-23T18:48:44.570613] [INFO ] [MAIN ] Update Progress: 821/2372 symbols completed. FET took 17.8s. Estimated remaining: 3h 25m 20s. Rate: 7.6 symbols/min [2025-09-23T18:48:44.751276] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:44.774933] [DEBUG] [LOCAL ] FFC: Loaded 16591 existing records from primary storage. [2025-09-23T18:48:44.775092] [INFO ] [MAIN ] FFC: Loaded 16591 existing records. [2025-09-23T18:48:44.958776] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:44.959139] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-23T18:48:44.959206] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-23T18:48:44.960437] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-23T18:48:44.960500] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-23T18:48:45.014382] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-23T18:48:45.318612] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:48:45.355358] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:45.488721] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-23T18:48:45.802252] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-23T18:48:46.602252] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-23T18:48:46.656106] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T18:48:47.360289] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:48:47.402162] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-23T18:48:47.977779] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:48:48.202216] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-23T18:48:49.002201] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-23T18:48:49.431505] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:48:49.679228] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T18:48:49.802172] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-23T18:48:50.602239] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-23T18:48:51.146497] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T18:48:51.402275] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-23T18:48:51.710135] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T18:48:51.721193] [INFO ] [REMOTE ] FERG: Full fetch complete (71049 records). [2025-09-23T18:48:51.721421] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-23T18:48:51.880512] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T18:48:52.175522] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-23T18:48:52.175667] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-23T18:48:52.176587] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-23T18:48:52.176672] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-23T18:48:52.178273] [DEBUG] [LOCAL ] FERG: Trimmed 71049 records to 49033 (keeping 200 days of data) [2025-09-23T18:48:52.248160] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-23T18:48:52.528956] [DEBUG] [LOCAL ] FERG: Primary data saved (49033 records). [2025-09-23T18:48:52.529094] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-23T18:48:52.529178] [INFO ] [MAIN ] Update Progress: 822/2372 symbols completed. FERG took 38.9s. Estimated remaining: 3h 25m 12s. Rate: 7.6 symbols/min [2025-09-23T18:48:52.753704] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:52.797786] [DEBUG] [LOCAL ] FFWM: Loaded 36236 existing records from primary storage. [2025-09-23T18:48:52.797955] [INFO ] [MAIN ] FFWM: Loaded 36236 existing records. [2025-09-23T18:48:52.973099] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:52.973321] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-23T18:48:52.973369] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-23T18:48:52.974266] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-23T18:48:52.974327] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-23T18:48:53.007387] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-23T18:48:53.333857] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:53.363757] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T18:48:53.410812] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T18:48:53.802218] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-23T18:48:54.602203] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-23T18:48:55.082845] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T18:48:55.402218] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-23T18:48:55.466916] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T18:48:56.202195] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-23T18:48:56.423748] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T18:48:57.002207] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-23T18:48:57.102321] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T18:48:57.802230] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-23T18:48:57.978084] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:48:58.607455] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-23T18:48:58.611030] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T18:48:58.615726] [INFO ] [REMOTE ] FF: Full fetch complete (37110 records). [2025-09-23T18:48:58.615890] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-23T18:48:59.004876] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-23T18:48:59.004981] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-23T18:48:59.005663] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-23T18:48:59.005727] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-23T18:48:59.006620] [DEBUG] [LOCAL ] FF: Trimmed 37110 records to 25538 (keeping 200 days of data) [2025-09-23T18:48:59.161441] [DEBUG] [LOCAL ] FF: Primary data saved (25538 records). [2025-09-23T18:48:59.161575] [INFO ] [MAIN ] FF: Full history saved. [2025-09-23T18:48:59.161681] [INFO ] [MAIN ] Update Progress: 823/2372 symbols completed. FF took 28.3s. Estimated remaining: 3h 25m 2s. Rate: 7.6 symbols/min [2025-09-23T18:48:59.331306] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:59.351524] [DEBUG] [LOCAL ] FG: Loaded 22417 existing records from primary storage. [2025-09-23T18:48:59.351938] [INFO ] [MAIN ] FG: Loaded 22417 existing records. [2025-09-23T18:48:59.407682] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-23T18:48:59.536755] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:59.537001] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-23T18:48:59.537049] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-23T18:48:59.537807] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-23T18:48:59.537869] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-23T18:48:59.779299] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T18:48:59.937574] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:00.070203] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T18:49:00.202238] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-23T18:49:01.002258] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-23T18:49:01.139103] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T18:49:01.598577] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T18:49:01.802293] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-23T18:49:02.602221] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-23T18:49:03.116306] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T18:49:03.118015] [INFO ] [REMOTE ] FFA: Full fetch complete (8181 records). [2025-09-23T18:49:03.118092] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-23T18:49:03.402624] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-23T18:49:03.562614] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-23T18:49:03.555538] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T18:49:03.569914] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-23T18:49:03.570329] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-23T18:49:03.570608] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-23T18:49:03.571503] [DEBUG] [LOCAL ] FFA: Trimmed 8181 records to 5632 (keeping 200 days of data) [2025-09-23T18:49:03.606875] [DEBUG] [LOCAL ] FFA: Primary data saved (5632 records). [2025-09-23T18:49:03.606976] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-23T18:49:03.607061] [INFO ] [MAIN ] Update Progress: 824/2372 symbols completed. FFA took 20.9s. Estimated remaining: 3h 24m 47s. Rate: 7.6 symbols/min [2025-09-23T18:49:03.783268] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:03.789958] [DEBUG] [LOCAL ] FGN: Loaded 3942 existing records from primary storage. [2025-09-23T18:49:03.790080] [INFO ] [MAIN ] FGN: Loaded 3942 existing records. [2025-09-23T18:49:03.973629] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:03.973894] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-23T18:49:03.973969] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-23T18:49:03.974213] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-23T18:49:03.974272] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-23T18:49:04.210879] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-23T18:49:04.341365] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:04.425489] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:49:05.002169] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-23T18:49:05.113450] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T18:49:05.802220] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-23T18:49:06.391675] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:49:06.602198] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-23T18:49:06.861765] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T18:49:07.402246] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-23T18:49:07.945911] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:49:07.960864] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T18:49:08.202194] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-23T18:49:09.002202] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-23T18:49:09.099699] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T18:49:09.570638] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T18:49:09.802225] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-23T18:49:10.599470] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T18:49:10.603516] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-23T18:49:11.402201] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-23T18:49:11.604768] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T18:49:11.977539] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T18:49:12.202220] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-23T18:49:13.002199] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-23T18:49:13.165950] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T18:49:13.467857] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T18:49:13.802198] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-23T18:49:14.602221] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-23T18:49:14.627089] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T18:49:15.311194] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T18:49:15.402186] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-23T18:49:16.202159] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-23T18:49:16.520813] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T18:49:17.002207] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-23T18:49:17.163031] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T18:49:17.168832] [INFO ] [REMOTE ] FFWM: Full fetch complete (51646 records). [2025-09-23T18:49:17.168947] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-23T18:49:17.550331] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-23T18:49:17.550436] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-23T18:49:17.551112] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-23T18:49:17.551176] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-23T18:49:17.552276] [DEBUG] [LOCAL ] FFWM: Trimmed 51646 records to 36225 (keeping 200 days of data) [2025-09-23T18:49:17.756086] [DEBUG] [LOCAL ] FFWM: Primary data saved (36225 records). [2025-09-23T18:49:17.756244] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-23T18:49:17.756346] [INFO ] [MAIN ] Update Progress: 825/2372 symbols completed. FFWM took 25.2s. Estimated remaining: 3h 24m 51s. Rate: 7.6 symbols/min [2025-09-23T18:49:17.809063] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-23T18:49:17.930962] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:17.931132] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-23T18:49:17.931167] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-23T18:49:17.931310] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-23T18:49:17.931351] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-23T18:49:17.931391] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-23T18:49:17.931423] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-23T18:49:18.048690] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:49:18.306094] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:18.436400] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T18:49:18.602206] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-23T18:49:19.402207] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-23T18:49:19.856691] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T18:49:20.178272] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T18:49:20.182752] [INFO ] [REMOTE ] FFC: Full fetch complete (24718 records). [2025-09-23T18:49:20.182848] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-23T18:49:20.211703] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-23T18:49:20.563403] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-23T18:49:20.563519] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-23T18:49:20.564028] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-23T18:49:20.564090] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-23T18:49:20.564739] [DEBUG] [LOCAL ] FFC: Trimmed 24718 records to 16600 (keeping 200 days of data) [2025-09-23T18:49:20.670912] [DEBUG] [LOCAL ] FFC: Primary data saved (16600 records). [2025-09-23T18:49:20.671077] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-23T18:49:20.671182] [INFO ] [MAIN ] Update Progress: 826/2372 symbols completed. FFC took 36.1s. Estimated remaining: 3h 24m 33s. Rate: 7.6 symbols/min [2025-09-23T18:49:20.846683] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:20.860203] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T18:49:20.896636] [DEBUG] [LOCAL ] FHI: Loaded 40812 existing records from primary storage. [2025-09-23T18:49:20.896841] [INFO ] [MAIN ] FHI: Loaded 40812 existing records. [2025-09-23T18:49:21.006450] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-23T18:49:21.104768] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:21.105086] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-23T18:49:21.105185] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-23T18:49:21.106451] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-23T18:49:21.106529] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-23T18:49:21.501708] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:21.802196] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-23T18:49:22.000025] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T18:49:22.025093] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:49:22.025499] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-23T18:49:22.602206] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-23T18:49:23.071216] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T18:49:23.402226] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-23T18:49:24.202232] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-23T18:49:24.578437] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T18:49:24.776941] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T18:49:25.002199] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-23T18:49:25.392974] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T18:49:25.802237] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-23T18:49:26.602182] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-23T18:49:27.056925] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T18:49:27.218766] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T18:49:27.402227] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-23T18:49:28.202184] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-23T18:49:28.292872] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:49:28.573124] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-23T18:49:29.002229] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-23T18:49:29.361891] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T18:49:29.802246] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-23T18:49:30.469969] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T18:49:30.602210] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-23T18:49:31.402185] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-23T18:49:31.645744] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T18:49:31.981171] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T18:49:32.202255] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-23T18:49:33.002221] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-23T18:49:33.198530] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:49:33.435789] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T18:49:33.436923] [INFO ] [REMOTE ] FGN: Full fetch complete (5757 records). [2025-09-23T18:49:33.436995] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-23T18:49:33.807274] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-23T18:49:33.815368] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-23T18:49:33.816283] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-23T18:49:33.816483] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-23T18:49:33.816526] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-23T18:49:33.817024] [DEBUG] [LOCAL ] FGN: Trimmed 5757 records to 3923 (keeping 200 days of data) [2025-09-23T18:49:33.843366] [DEBUG] [LOCAL ] FGN: Primary data saved (3923 records). [2025-09-23T18:49:33.843476] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-23T18:49:33.843559] [INFO ] [MAIN ] Update Progress: 827/2372 symbols completed. FGN took 30.2s. Estimated remaining: 3h 24m 35s. Rate: 7.6 symbols/min [2025-09-23T18:49:34.031614] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:34.087614] [DEBUG] [LOCAL ] FHN: Loaded 53369 existing records from primary storage. [2025-09-23T18:49:34.087813] [INFO ] [MAIN ] FHN: Loaded 53369 existing records. [2025-09-23T18:49:34.278387] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:34.278709] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-23T18:49:34.278767] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-23T18:49:34.280626] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-23T18:49:34.280724] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-23T18:49:34.586311] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T18:49:34.616721] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-23T18:49:34.657611] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:35.402194] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-23T18:49:35.753137] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T18:49:35.757482] [INFO ] [REMOTE ] FG: Full fetch complete (27150 records). [2025-09-23T18:49:35.757628] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-23T18:49:36.159289] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-23T18:49:36.159439] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-23T18:49:36.160321] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-23T18:49:36.160389] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-23T18:49:36.161595] [DEBUG] [LOCAL ] FG: Trimmed 27150 records to 22512 (keeping 200 days of data) [2025-09-23T18:49:36.216560] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-23T18:49:36.309178] [DEBUG] [LOCAL ] FG: Primary data saved (22512 records). [2025-09-23T18:49:36.309361] [INFO ] [MAIN ] FG: Full history saved. [2025-09-23T18:49:36.309468] [INFO ] [MAIN ] Update Progress: 828/2372 symbols completed. FG took 37.1s. Estimated remaining: 3h 24m 17s. Rate: 7.6 symbols/min [2025-09-23T18:49:36.491757] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:36.518534] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T18:49:36.579157] [DEBUG] [LOCAL ] FI: Loaded 53506 existing records from primary storage. [2025-09-23T18:49:36.579401] [INFO ] [MAIN ] FI: Loaded 53506 existing records. [2025-09-23T18:49:36.686915] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T18:49:36.775245] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:36.775581] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-23T18:49:36.775632] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-23T18:49:36.777384] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-23T18:49:36.777446] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-23T18:49:37.007423] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-23T18:49:37.137737] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:37.802206] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-23T18:49:38.582696] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:49:38.602154] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-23T18:49:39.200620] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:49:39.402208] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-23T18:49:40.158495] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T18:49:40.202289] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-23T18:49:41.002162] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-23T18:49:41.108988] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T18:49:41.316798] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:49:41.802196] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-23T18:49:42.333299] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T18:49:42.447431] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T18:49:42.602214] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-23T18:49:43.158238] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T18:49:43.402243] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-23T18:49:43.817031] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-23T18:49:44.202258] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-23T18:49:44.944115] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T18:49:44.945520] [INFO ] [REMOTE ] FGSN: Full fetch complete (7531 records). [2025-09-23T18:49:44.945592] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-23T18:49:45.008620] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-23T18:49:45.137071] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 170 unique days, need 200 days [2025-09-23T18:49:45.137757] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:49:45.137827] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:49:45.137896] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-23T18:49:45.137961] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-23T18:49:45.137997] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-23T18:49:45.138048] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-23T18:49:45.138129] [INFO ] [MAIN ] Update Progress: 829/2372 symbols completed. FGSN took 27.4s. Estimated remaining: 3h 24m 11s. Rate: 7.6 symbols/min [2025-09-23T18:49:45.308532] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:45.330859] [DEBUG] [LOCAL ] FICO: Loaded 20499 existing records from primary storage. [2025-09-23T18:49:45.331035] [INFO ] [MAIN ] FICO: Loaded 20499 existing records. [2025-09-23T18:49:45.510211] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:45.510543] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-23T18:49:45.510597] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-23T18:49:45.511234] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-23T18:49:45.511294] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-23T18:49:45.807313] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-23T18:49:45.874860] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:46.375699] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:49:46.602224] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-23T18:49:47.312086] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T18:49:47.402161] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-23T18:49:48.202206] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-23T18:49:48.328592] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T18:49:48.711953] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:49:48.838897] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T18:49:49.002168] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-23T18:49:49.802213] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-23T18:49:50.507420] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T18:49:50.602152] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-23T18:49:51.213346] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:49:51.402188] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-23T18:49:51.750241] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T18:49:52.202261] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-23T18:49:52.983637] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T18:49:53.002163] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-23T18:49:53.361133] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T18:49:53.802199] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-23T18:49:53.821974] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T18:49:54.602207] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-23T18:49:55.266201] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T18:49:55.364546] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T18:49:55.402145] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-23T18:49:56.202192] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-23T18:49:56.564875] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T18:49:57.002221] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-23T18:49:57.779997] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T18:49:57.802182] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-23T18:49:58.472494] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T18:49:58.602251] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-23T18:49:59.402242] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-23T18:49:59.709443] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-23T18:49:59.902174] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:50:00.202265] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-23T18:50:00.752539] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:50:01.002258] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-23T18:50:01.198418] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:50:01.802276] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-23T18:50:02.231861] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T18:50:02.238912] [INFO ] [REMOTE ] FHI: Full fetch complete (57911 records). [2025-09-23T18:50:02.239093] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-23T18:50:02.628860] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-23T18:50:02.651007] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-23T18:50:02.651127] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-23T18:50:02.652093] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-23T18:50:02.652163] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-23T18:50:02.653854] [DEBUG] [LOCAL ] FHI: Trimmed 57911 records to 40816 (keeping 200 days of data) [2025-09-23T18:50:02.914391] [DEBUG] [LOCAL ] FHI: Primary data saved (40816 records). [2025-09-23T18:50:02.914520] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-23T18:50:02.914618] [INFO ] [MAIN ] Update Progress: 830/2372 symbols completed. FHI took 42.2s. Estimated remaining: 3h 24m 21s. Rate: 7.5 symbols/min [2025-09-23T18:50:03.086302] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:03.086506] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-23T18:50:03.086564] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-23T18:50:03.086741] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-23T18:50:03.086793] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-23T18:50:03.086838] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-23T18:50:03.086874] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-23T18:50:03.415121] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-23T18:50:03.463954] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:03.878445] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T18:50:03.971999] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T18:50:04.202239] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-23T18:50:04.512103] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T18:50:05.002263] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-23T18:50:05.327194] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-23T18:50:05.802204] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-23T18:50:06.041345] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-23T18:50:06.043870] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T18:50:06.602232] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-23T18:50:07.402201] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-23T18:50:08.002820] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:50:08.202238] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-23T18:50:08.528467] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T18:50:08.872076] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:50:09.002428] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-23T18:50:09.260498] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-23T18:50:09.802226] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-23T18:50:10.092022] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-23T18:50:10.602209] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-23T18:50:11.402229] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-23T18:50:11.541219] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:50:11.545112] [INFO ] [REMOTE ] FICO: Full fetch complete (28356 records). [2025-09-23T18:50:11.545272] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-23T18:50:11.708222] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-23T18:50:11.948524] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-23T18:50:11.948700] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-23T18:50:11.949286] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-23T18:50:11.949335] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-23T18:50:11.950068] [DEBUG] [LOCAL ] FICO: Trimmed 28356 records to 20466 (keeping 200 days of data) [2025-09-23T18:50:12.078855] [DEBUG] [LOCAL ] FICO: Primary data saved (20466 records). [2025-09-23T18:50:12.078983] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-23T18:50:12.079062] [INFO ] [MAIN ] Update Progress: 831/2372 symbols completed. FICO took 26.9s. Estimated remaining: 3h 24m 15s. Rate: 7.5 symbols/min [2025-09-23T18:50:12.217046] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-23T18:50:12.249812] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:12.296459] [DEBUG] [LOCAL ] FIGS: Loaded 48969 existing records from primary storage. [2025-09-23T18:50:12.296624] [INFO ] [MAIN ] FIGS: Loaded 48969 existing records. [2025-09-23T18:50:12.481995] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:12.482282] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-23T18:50:12.482332] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-23T18:50:12.483403] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-23T18:50:12.483465] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-23T18:50:12.898021] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:13.002188] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-23T18:50:13.802168] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-23T18:50:13.876371] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T18:50:14.002803] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:50:14.003178] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-23T18:50:14.314330] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T18:50:14.602198] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-23T18:50:14.956250] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T18:50:15.402195] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-23T18:50:16.202187] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-23T18:50:17.002226] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-23T18:50:17.292679] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T18:50:17.302041] [INFO ] [REMOTE ] FHN: Full fetch complete (77276 records). [2025-09-23T18:50:17.302192] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-23T18:50:17.695100] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-23T18:50:17.695191] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-23T18:50:17.696090] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-23T18:50:17.696155] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-23T18:50:17.697681] [DEBUG] [LOCAL ] FHN: Trimmed 77276 records to 53369 (keeping 200 days of data) [2025-09-23T18:50:17.802777] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-23T18:50:17.841785] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T18:50:17.854157] [INFO ] [REMOTE ] FI: Full fetch complete (77160 records). [2025-09-23T18:50:17.855557] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-23T18:50:18.484360] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-23T18:50:18.484803] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-23T18:50:18.486038] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-23T18:50:18.486471] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-23T18:50:18.491405] [DEBUG] [LOCAL ] FI: Trimmed 77160 records to 53505 (keeping 200 days of data) [2025-09-23T18:50:18.616857] [DEBUG] [LOCAL ] FHN: Primary data saved (53369 records). [2025-09-23T18:50:18.618131] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-23T18:50:18.618839] [INFO ] [MAIN ] Update Progress: 832/2372 symbols completed. FHN took 44.8s. Estimated remaining: 3h 24m 5s. Rate: 7.5 symbols/min [2025-09-23T18:50:18.811480] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:18.978915] [DEBUG] [LOCAL ] FIHL: Loaded 40389 existing records from primary storage. [2025-09-23T18:50:19.019848] [INFO ] [MAIN ] FIHL: Loaded 40389 existing records. [2025-09-23T18:50:19.148944] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:50:19.208436] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-23T18:50:19.301804] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:19.306611] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-23T18:50:19.307895] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-23T18:50:19.310794] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-23T18:50:19.311415] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-23T18:50:19.429353] [DEBUG] [LOCAL ] FI: Primary data saved (53505 records). [2025-09-23T18:50:19.435351] [INFO ] [MAIN ] FI: Full history saved. [2025-09-23T18:50:19.435542] [INFO ] [MAIN ] Update Progress: 833/2372 symbols completed. FI took 43.1s. Estimated remaining: 3h 23m 44s. Rate: 7.6 symbols/min [2025-09-23T18:50:19.809365] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:19.893721] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:19.896419] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-23T18:50:19.902005] [DEBUG] [LOCAL ] FINS: Loaded 8193 existing records from primary storage. [2025-09-23T18:50:19.902232] [INFO ] [MAIN ] FINS: Loaded 8193 existing records. [2025-09-23T18:50:20.117663] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-09-23T18:50:20.123688] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:20.135499] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-23T18:50:20.135572] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-23T18:50:20.136121] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-23T18:50:20.136206] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-23T18:50:20.211098] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-23T18:50:20.498528] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:20.810333] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T18:50:20.844022] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T18:50:21.002207] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-23T18:50:21.619876] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:50:21.802195] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-23T18:50:22.556288] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:50:22.602144] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-23T18:50:22.941461] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-23T18:50:22.950032] [INFO ] [REMOTE ] FIG: Full fetch complete (15024 records). [2025-09-23T18:50:22.950113] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-23T18:50:23.132246] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-23T18:50:23.132577] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:50:23.132696] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:50:23.132790] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-23T18:50:23.132874] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-23T18:50:23.132914] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-23T18:50:23.132978] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-23T18:50:23.133061] [INFO ] [MAIN ] Update Progress: 834/2372 symbols completed. FIG took 20.2s. Estimated remaining: 3h 23m 28s. Rate: 7.6 symbols/min [2025-09-23T18:50:23.260689] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T18:50:23.323223] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:23.366918] [DEBUG] [LOCAL ] FINV: Loaded 45117 existing records from primary storage. [2025-09-23T18:50:23.367072] [INFO ] [MAIN ] FINV: Loaded 45117 existing records. [2025-09-23T18:50:23.407304] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-23T18:50:23.572554] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:23.572845] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-23T18:50:23.572898] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-23T18:50:23.574084] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-23T18:50:23.574162] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-23T18:50:23.949282] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:24.092888] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:50:24.202201] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-23T18:50:25.002214] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-23T18:50:25.802202] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-23T18:50:25.947195] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T18:50:26.321720] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T18:50:26.602205] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-23T18:50:26.878580] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T18:50:27.402197] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-23T18:50:27.814277] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T18:50:28.202192] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-23T18:50:28.300070] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:50:29.002196] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-23T18:50:29.517517] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:50:29.802197] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-23T18:50:30.291956] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T18:50:30.572610] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T18:50:30.602156] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-23T18:50:31.402232] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-23T18:50:32.134303] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:50:32.202231] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-23T18:50:32.489636] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:50:33.002226] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-23T18:50:33.265916] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T18:50:33.503634] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T18:50:33.802225] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-23T18:50:34.602196] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-23T18:50:34.861281] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T18:50:35.402197] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-23T18:50:36.005528] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:50:36.202205] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-23T18:50:37.002206] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-23T18:50:37.094266] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T18:50:37.262989] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:50:37.801473] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T18:50:37.803984] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-23T18:50:38.602215] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-23T18:50:39.352834] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T18:50:39.381273] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:50:39.402148] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-23T18:50:40.202190] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-23T18:50:40.708561] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T18:50:40.710372] [INFO ] [REMOTE ] FINS: Full fetch complete (12772 records). [2025-09-23T18:50:40.710492] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-23T18:50:41.007321] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-23T18:50:41.092286] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-23T18:50:41.092399] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-23T18:50:41.092847] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-23T18:50:41.092920] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-23T18:50:41.093477] [DEBUG] [LOCAL ] FINS: Trimmed 12772 records to 8218 (keeping 200 days of data) [2025-09-23T18:50:41.149601] [DEBUG] [LOCAL ] FINS: Primary data saved (8218 records). [2025-09-23T18:50:41.149756] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-23T18:50:41.149905] [INFO ] [MAIN ] Update Progress: 835/2372 symbols completed. FINS took 21.7s. Estimated remaining: 3h 23m 39s. Rate: 7.5 symbols/min [2025-09-23T18:50:41.329889] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:41.362613] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T18:50:41.429336] [DEBUG] [LOCAL ] FIS: Loaded 53366 existing records from primary storage. [2025-09-23T18:50:41.429494] [INFO ] [MAIN ] FIS: Loaded 53366 existing records. [2025-09-23T18:50:41.605766] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:41.606025] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-23T18:50:41.606086] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-23T18:50:41.607291] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-23T18:50:41.607352] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-23T18:50:41.812096] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-23T18:50:41.960521] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:42.602191] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-23T18:50:42.735349] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:50:43.364378] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T18:50:43.402182] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-23T18:50:43.668408] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T18:50:44.202206] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-23T18:50:44.580434] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T18:50:44.588557] [INFO ] [REMOTE ] FIHL: Full fetch complete (55853 records). [2025-09-23T18:50:44.588787] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-23T18:50:44.985093] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-23T18:50:44.985197] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-23T18:50:44.985968] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-23T18:50:44.986061] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-23T18:50:44.987472] [DEBUG] [LOCAL ] FIHL: Trimmed 55853 records to 40370 (keeping 200 days of data) [2025-09-23T18:50:45.050432] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-23T18:50:45.260966] [DEBUG] [LOCAL ] FIHL: Primary data saved (40370 records). [2025-09-23T18:50:45.261218] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-23T18:50:45.261467] [INFO ] [MAIN ] Update Progress: 836/2372 symbols completed. FIHL took 26.6s. Estimated remaining: 3h 23m 24s. Rate: 7.6 symbols/min [2025-09-23T18:50:45.447214] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:45.522668] [DEBUG] [LOCAL ] FIX: Loaded 30683 existing records from primary storage. [2025-09-23T18:50:45.522858] [INFO ] [MAIN ] FIX: Loaded 30683 existing records. [2025-09-23T18:50:45.590945] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:50:45.719255] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:45.719521] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-23T18:50:45.719585] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-23T18:50:45.720387] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-23T18:50:45.720468] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-23T18:50:45.807337] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-23T18:50:46.115722] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:46.479701] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T18:50:46.602166] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-23T18:50:46.928965] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T18:50:47.402201] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-23T18:50:47.975834] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:50:48.202162] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-23T18:50:48.611526] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T18:50:49.002204] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-23T18:50:49.638357] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:50:49.802173] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-23T18:50:50.457780] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T18:50:50.602202] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-23T18:50:51.402201] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-23T18:50:51.607475] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:50:52.121311] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T18:50:52.202147] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-23T18:50:52.966304] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:50:53.002155] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-23T18:50:53.802258] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-23T18:50:53.841088] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T18:50:54.350867] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:50:54.602249] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-23T18:50:55.411272] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-23T18:50:55.417344] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T18:50:55.902502] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T18:50:56.202199] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-23T18:50:57.002313] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-23T18:50:57.062768] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T18:50:57.075302] [INFO ] [REMOTE ] FINV: Full fetch complete (63512 records). [2025-09-23T18:50:57.075564] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-23T18:50:57.494122] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-23T18:50:57.494270] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-23T18:50:57.495128] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-23T18:50:57.495194] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-23T18:50:57.496730] [DEBUG] [LOCAL ] FINV: Trimmed 63512 records to 45120 (keeping 200 days of data) [2025-09-23T18:50:57.655207] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:50:57.811707] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-23T18:50:57.830894] [DEBUG] [LOCAL ] FINV: Primary data saved (45120 records). [2025-09-23T18:50:57.831017] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-23T18:50:57.831144] [INFO ] [MAIN ] Update Progress: 837/2372 symbols completed. FINV took 34.7s. Estimated remaining: 3h 23m 24s. Rate: 7.5 symbols/min [2025-09-23T18:50:58.397252] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T18:50:58.405517] [INFO ] [REMOTE ] FIGS: Full fetch complete (71049 records). [2025-09-23T18:50:58.405678] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-23T18:50:58.629810] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-23T18:50:58.802738] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-23T18:50:58.802846] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-23T18:50:58.803756] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-23T18:50:58.803825] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-23T18:50:58.805500] [DEBUG] [LOCAL ] FIGS: Trimmed 71049 records to 48950 (keeping 200 days of data) [2025-09-23T18:50:59.112499] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T18:50:59.137577] [DEBUG] [LOCAL ] FIGS: Primary data saved (48950 records). [2025-09-23T18:50:59.137751] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-23T18:50:59.137871] [INFO ] [MAIN ] Update Progress: 838/2372 symbols completed. FIGS took 47.1s. Estimated remaining: 3h 23m 4s. Rate: 7.6 symbols/min [2025-09-23T18:50:59.402447] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-23T18:51:00.416395] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T18:51:00.428406] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-23T18:51:00.485300] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T18:51:01.002207] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-23T18:51:02.404385] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:51:02.410619] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-23T18:51:03.236048] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-23T18:51:03.248085] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-23T18:51:05.683743] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (3.27 seconds). [2025-09-23T18:51:05.690483] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-23T18:51:06.629300] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T18:51:06.636081] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-23T18:51:06.851092] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (3.60 seconds). [2025-09-23T18:51:06.862875] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-23T18:51:08.062721] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T18:51:08.069961] [INFO ] [REMOTE ] FIX: Full fetch complete (45664 records). [2025-09-23T18:51:08.070134] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-23T18:51:08.487538] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-23T18:51:08.487914] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-23T18:51:08.488688] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-23T18:51:08.488753] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-23T18:51:08.489948] [DEBUG] [LOCAL ] FIX: Trimmed 45664 records to 30519 (keeping 200 days of data) [2025-09-23T18:51:08.702066] [DEBUG] [LOCAL ] FIX: Primary data saved (30519 records). [2025-09-23T18:51:08.702224] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-23T18:51:08.702335] [INFO ] [MAIN ] Update Progress: 839/2372 symbols completed. FIX took 23.4s. Estimated remaining: 3h 22m 59s. Rate: 7.6 symbols/min [2025-09-23T18:51:08.743322] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T18:51:08.753830] [INFO ] [REMOTE ] FIS: Full fetch complete (77170 records). [2025-09-23T18:51:08.754034] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-23T18:51:09.159903] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-23T18:51:09.160002] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-23T18:51:09.160982] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-23T18:51:09.161052] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-23T18:51:09.162744] [DEBUG] [LOCAL ] FIS: Trimmed 77170 records to 53366 (keeping 200 days of data) [2025-09-23T18:51:09.520609] [DEBUG] [LOCAL ] FIS: Primary data saved (53366 records). [2025-09-23T18:51:09.520806] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-23T18:51:09.520924] [INFO ] [MAIN ] Update Progress: 840/2372 symbols completed. FIS took 28.4s. Estimated remaining: 3h 22m 38s. Rate: 7.6 symbols/min [2025-09-23T18:51:10.258791] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:10.302534] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:10.306228] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:10.316568] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-23T18:51:10.335847] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:10.336178] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-23T18:51:10.337103] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-23T18:51:10.337191] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-23T18:51:10.337372] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-23T18:51:10.337456] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-23T18:51:10.440351] [DEBUG] [LOCAL ] FLC: Loaded 5602 existing records from primary storage. [2025-09-23T18:51:10.452016] [INFO ] [MAIN ] FLC: Loaded 5602 existing records. [2025-09-23T18:51:10.778143] [DEBUG] [LOCAL ] FLG: Loaded 53331 existing records from primary storage. [2025-09-23T18:51:10.810751] [DEBUG] [LOCAL ] FLNG: Loaded 34117 existing records from primary storage. [2025-09-23T18:51:10.826433] [INFO ] [MAIN ] FLG: Loaded 53331 existing records. [2025-09-23T18:51:10.832136] [INFO ] [MAIN ] FLNG: Loaded 34117 existing records. [2025-09-23T18:51:11.096424] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:11.160990] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:11.189796] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-23T18:51:11.195449] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-23T18:51:11.205867] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-23T18:51:11.242630] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-23T18:51:11.287701] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:11.288021] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-23T18:51:11.303884] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-23T18:51:11.391022] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-23T18:51:11.419564] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-23T18:51:11.430297] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:11.471793] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-23T18:51:11.471945] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-23T18:51:11.464418] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-23T18:51:11.483221] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:11.529122] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-23T18:51:11.504631] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-23T18:51:11.545281] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-23T18:51:11.544946] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-23T18:51:11.892981] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:12.002446] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-23T18:51:12.077834] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-23T18:51:12.385968] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:12.440827] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-23T18:51:12.446857] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:12.453575] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-23T18:51:12.538611] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:12.538932] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-23T18:51:12.705890] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:12.706222] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-23T18:51:12.706743] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-23T18:51:13.119742] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:13.120055] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-23T18:51:13.120502] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-23T18:51:13.280218] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T18:51:13.282985] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-23T18:51:14.463536] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:51:14.465530] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-23T18:51:14.809523] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:14.811107] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-23T18:51:14.812148] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-23T18:51:14.842436] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-23T18:51:14.851165] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-23T18:51:14.898530] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T18:51:14.959044] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-23T18:51:15.055562] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:15.055980] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-23T18:51:15.402233] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-23T18:51:15.938765] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T18:51:16.196192] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:51:16.203992] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-23T18:51:16.568158] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T18:51:17.002236] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-23T18:51:17.802201] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-23T18:51:18.203478] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T18:51:18.539311] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T18:51:18.602172] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-23T18:51:19.402191] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-23T18:51:19.936328] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T18:51:20.202172] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-23T18:51:20.378707] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-23T18:51:20.599363] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T18:51:21.002213] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-23T18:51:21.802211] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-23T18:51:22.149463] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T18:51:22.411551] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T18:51:22.602204] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-23T18:51:23.402189] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-23T18:51:23.715566] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T18:51:24.175114] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T18:51:24.202152] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-23T18:51:25.002189] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-23T18:51:25.802205] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-23T18:51:26.602194] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-23T18:51:27.099315] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-09-23T18:51:27.310314] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-23T18:51:27.402180] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-23T18:51:27.484578] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:51:27.485688] [INFO ] [REMOTE ] FIXT: Full fetch complete (1720 records). [2025-09-23T18:51:27.485759] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-23T18:51:27.572050] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T18:51:27.676043] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-23T18:51:27.676249] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:51:27.676317] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:51:27.676387] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-23T18:51:27.676451] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-23T18:51:27.676487] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-23T18:51:27.676526] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-23T18:51:27.676606] [INFO ] [MAIN ] Update Progress: 841/2372 symbols completed. FIXT took 18.2s. Estimated remaining: 3h 22m 49s. Rate: 7.5 symbols/min [2025-09-23T18:51:27.847803] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:27.903619] [DEBUG] [LOCAL ] FLO: Loaded 51894 existing records from primary storage. [2025-09-23T18:51:27.903827] [INFO ] [MAIN ] FLO: Loaded 51894 existing records. [2025-09-23T18:51:28.108886] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:28.109181] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-23T18:51:28.109235] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-23T18:51:28.110791] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-23T18:51:28.110855] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-23T18:51:28.209752] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-23T18:51:28.502412] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:28.747213] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:51:29.002210] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-23T18:51:29.304969] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T18:51:29.802219] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-23T18:51:30.602237] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-23T18:51:30.868134] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-23T18:51:31.108166] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T18:51:31.402190] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-23T18:51:31.963906] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T18:51:32.202287] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-23T18:51:32.868392] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:51:33.002250] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-23T18:51:33.635417] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T18:51:33.721169] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T18:51:33.802194] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-23T18:51:34.602212] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-23T18:51:34.739198] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:51:34.740550] [INFO ] [REMOTE ] FLC: Full fetch complete (8039 records). [2025-09-23T18:51:34.740618] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-23T18:51:35.140516] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-23T18:51:35.140604] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-23T18:51:35.140883] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-23T18:51:35.140948] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-23T18:51:35.141382] [DEBUG] [LOCAL ] FLC: Trimmed 8039 records to 5537 (keeping 200 days of data) [2025-09-23T18:51:35.177159] [DEBUG] [LOCAL ] FLC: Primary data saved (5537 records). [2025-09-23T18:51:35.177281] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-23T18:51:35.177370] [INFO ] [MAIN ] Update Progress: 842/2372 symbols completed. FLC took 25.6s. Estimated remaining: 3h 22m 40s. Rate: 7.5 symbols/min [2025-09-23T18:51:35.366141] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:35.366332] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-23T18:51:35.366372] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-23T18:51:35.366520] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-23T18:51:35.366564] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-23T18:51:35.366606] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-23T18:51:35.366661] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-23T18:51:35.410619] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-23T18:51:35.794572] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:36.202170] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-23T18:51:36.342684] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T18:51:36.421348] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:36.421682] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-23T18:51:36.851557] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:51:37.002231] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-23T18:51:37.717395] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:51:37.802145] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-23T18:51:38.573013] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:51:38.602166] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-23T18:51:39.402216] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-23T18:51:39.640900] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T18:51:40.202224] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-23T18:51:40.969047] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T18:51:41.002147] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-23T18:51:41.665017] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T18:51:41.674080] [INFO ] [REMOTE ] FLG: Full fetch complete (77290 records). [2025-09-23T18:51:41.674235] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-23T18:51:41.807290] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-23T18:51:42.089337] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-23T18:51:42.089437] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-23T18:51:42.090355] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-23T18:51:42.090425] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-23T18:51:42.092061] [DEBUG] [LOCAL ] FLG: Trimmed 77290 records to 53329 (keeping 200 days of data) [2025-09-23T18:51:42.433708] [DEBUG] [LOCAL ] FLG: Primary data saved (53329 records). [2025-09-23T18:51:42.433922] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-23T18:51:42.435100] [INFO ] [MAIN ] Update Progress: 843/2372 symbols completed. FLG took 32.9s. Estimated remaining: 3h 22m 31s. Rate: 7.6 symbols/min [2025-09-23T18:51:42.604072] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-23T18:51:42.624593] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:42.680035] [DEBUG] [LOCAL ] FLR: Loaded 53122 existing records from primary storage. [2025-09-23T18:51:42.680305] [INFO ] [MAIN ] FLR: Loaded 53122 existing records. [2025-09-23T18:51:42.832533] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T18:51:42.927915] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:42.928371] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-23T18:51:42.928467] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-23T18:51:42.935033] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-23T18:51:42.944138] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-23T18:51:42.978479] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:51:43.310954] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:43.402152] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-23T18:51:43.710905] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T18:51:44.202237] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-23T18:51:45.002248] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-23T18:51:45.070047] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:51:45.261184] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:51:45.802217] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-23T18:51:46.607744] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-23T18:51:46.653275] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T18:51:47.402240] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-23T18:51:47.438912] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T18:51:47.445879] [INFO ] [REMOTE ] FLNG: Full fetch complete (50967 records). [2025-09-23T18:51:47.445989] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-23T18:51:47.856629] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-23T18:51:47.856759] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-23T18:51:47.857478] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-23T18:51:47.857520] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-23T18:51:47.858733] [DEBUG] [LOCAL ] FLNG: Trimmed 50967 records to 34056 (keeping 200 days of data) [2025-09-23T18:51:47.966776] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T18:51:48.098016] [DEBUG] [LOCAL ] FLNG: Primary data saved (34056 records). [2025-09-23T18:51:48.098165] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-23T18:51:48.098294] [INFO ] [MAIN ] Update Progress: 844/2372 symbols completed. FLNG took 38.6s. Estimated remaining: 3h 22m 19s. Rate: 7.6 symbols/min [2025-09-23T18:51:48.207304] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-23T18:51:48.268944] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:48.314611] [DEBUG] [LOCAL ] FLS: Loaded 50181 existing records from primary storage. [2025-09-23T18:51:48.314786] [INFO ] [MAIN ] FLS: Loaded 50181 existing records. [2025-09-23T18:51:48.490843] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:48.491128] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-23T18:51:48.491177] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-23T18:51:48.492472] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-23T18:51:48.492537] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-23T18:51:48.866084] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:48.924798] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T18:51:49.002193] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-23T18:51:49.090440] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T18:51:49.802201] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-23T18:51:50.252417] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T18:51:50.602241] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-23T18:51:51.300619] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:51:51.402265] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-23T18:51:51.995381] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:51:52.202220] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-23T18:51:52.669975] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:51:53.002246] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-23T18:51:53.566954] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T18:51:53.802202] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-23T18:51:54.549009] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T18:51:54.602151] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-23T18:51:54.691874] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T18:51:55.402245] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-23T18:51:56.203971] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-23T18:51:56.210562] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T18:51:56.724236] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T18:51:57.002215] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-23T18:51:57.079022] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T18:51:57.085092] [INFO ] [REMOTE ] FLOC: Full fetch complete (37066 records). [2025-09-23T18:51:57.085234] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-23T18:51:57.282082] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-09-23T18:51:57.282515] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:51:57.282661] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:51:57.282726] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-23T18:51:57.282789] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-23T18:51:57.282824] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-23T18:51:57.282862] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-23T18:51:57.282933] [INFO ] [MAIN ] Update Progress: 845/2372 symbols completed. FLOC took 22.1s. Estimated remaining: 3h 22m 13s. Rate: 7.6 symbols/min [2025-09-23T18:51:57.456210] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:57.508211] [DEBUG] [LOCAL ] FLUT: Loaded 50933 existing records from primary storage. [2025-09-23T18:51:57.508371] [INFO ] [MAIN ] FLUT: Loaded 50933 existing records. [2025-09-23T18:51:57.690355] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:57.690593] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-23T18:51:57.690662] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-23T18:51:57.691984] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-23T18:51:57.692049] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-23T18:51:57.807340] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-23T18:51:58.074938] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:58.602189] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-23T18:51:58.645384] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:51:59.112376] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:51:59.402265] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-23T18:51:59.937571] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T18:52:00.202205] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-23T18:52:00.858322] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T18:52:01.002230] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-23T18:52:01.802218] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-23T18:52:01.957807] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T18:52:02.516357] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T18:52:02.525327] [INFO ] [REMOTE ] FLO: Full fetch complete (74856 records). [2025-09-23T18:52:02.525488] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-23T18:52:02.607290] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-23T18:52:02.977913] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-23T18:52:02.978024] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-23T18:52:02.979126] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-23T18:52:02.979198] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-23T18:52:02.980956] [DEBUG] [LOCAL ] FLO: Trimmed 74856 records to 51894 (keeping 200 days of data) [2025-09-23T18:52:03.321892] [DEBUG] [LOCAL ] FLO: Primary data saved (51894 records). [2025-09-23T18:52:03.322037] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-23T18:52:03.322125] [INFO ] [MAIN ] Update Progress: 846/2372 symbols completed. FLO took 35.6s. Estimated remaining: 3h 22m 2s. Rate: 7.6 symbols/min [2025-09-23T18:52:03.403253] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-23T18:52:03.536525] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T18:52:03.539808] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:03.572240] [DEBUG] [LOCAL ] FLXR: Loaded 19779 existing records from primary storage. [2025-09-23T18:52:03.572379] [INFO ] [MAIN ] FLXR: Loaded 19779 existing records. [2025-09-23T18:52:03.753680] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:03.753942] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-23T18:52:03.753990] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-23T18:52:03.754609] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-23T18:52:03.754707] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-23T18:52:04.127913] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:04.188195] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T18:52:04.202174] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-23T18:52:04.936342] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T18:52:05.002177] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-23T18:52:05.187531] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T18:52:05.723468] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:52:05.802177] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-23T18:52:06.361439] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T18:52:06.602245] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-23T18:52:07.402216] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-23T18:52:08.202265] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-23T18:52:08.610878] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T18:52:08.868990] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T18:52:08.979119] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T18:52:09.002225] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-23T18:52:09.802233] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-23T18:52:10.602284] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-23T18:52:10.993268] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T18:52:11.123762] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T18:52:11.215103] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T18:52:11.402251] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-23T18:52:12.202248] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-23T18:52:12.411466] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T18:52:13.002202] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-23T18:52:13.802214] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-23T18:52:14.075594] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T18:52:14.166735] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T18:52:14.602265] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-23T18:52:15.132879] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T18:52:15.402261] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-23T18:52:16.072016] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T18:52:16.202189] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-23T18:52:16.578186] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T18:52:16.588826] [INFO ] [REMOTE ] FLR: Full fetch complete (76301 records). [2025-09-23T18:52:16.588993] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-23T18:52:16.984033] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-23T18:52:16.984150] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-23T18:52:16.985236] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-23T18:52:16.985328] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-23T18:52:17.007762] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-23T18:52:17.011894] [DEBUG] [LOCAL ] FLR: Trimmed 76301 records to 53120 (keeping 200 days of data) [2025-09-23T18:52:17.014693] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:52:17.330183] [DEBUG] [LOCAL ] FLR: Primary data saved (53120 records). [2025-09-23T18:52:17.330363] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-23T18:52:17.330469] [INFO ] [MAIN ] Update Progress: 847/2372 symbols completed. FLR took 34.9s. Estimated remaining: 3h 22m 5s. Rate: 7.5 symbols/min [2025-09-23T18:52:17.497706] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:17.548060] [DEBUG] [LOCAL ] FMC: Loaded 51794 existing records from primary storage. [2025-09-23T18:52:17.548213] [INFO ] [MAIN ] FMC: Loaded 51794 existing records. [2025-09-23T18:52:17.726574] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:17.726907] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-23T18:52:17.726958] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-23T18:52:17.728612] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-23T18:52:17.728701] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-23T18:52:17.807364] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-23T18:52:18.092479] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:18.602191] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-23T18:52:18.725919] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T18:52:19.402239] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-23T18:52:19.552474] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:52:19.854769] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:52:19.859536] [INFO ] [REMOTE ] FLXR: Full fetch complete (24692 records). [2025-09-23T18:52:19.859704] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-23T18:52:20.220381] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-23T18:52:20.233547] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-23T18:52:20.233608] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-23T18:52:20.234152] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-23T18:52:20.234336] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-23T18:52:20.235163] [DEBUG] [LOCAL ] FLXR: Trimmed 24692 records to 19843 (keeping 200 days of data) [2025-09-23T18:52:20.360418] [DEBUG] [LOCAL ] FLXR: Primary data saved (19843 records). [2025-09-23T18:52:20.360548] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-23T18:52:20.360632] [INFO ] [MAIN ] Update Progress: 848/2372 symbols completed. FLXR took 17.0s. Estimated remaining: 3h 21m 48s. Rate: 7.6 symbols/min [2025-09-23T18:52:20.529240] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:20.537277] [DEBUG] [LOCAL ] FMN: Loaded 6172 existing records from primary storage. [2025-09-23T18:52:20.537383] [INFO ] [MAIN ] FMN: Loaded 6172 existing records. [2025-09-23T18:52:20.719099] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:20.719586] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-23T18:52:20.719764] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-23T18:52:20.720261] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-23T18:52:20.720408] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-23T18:52:21.003274] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-23T18:52:21.114060] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:21.118439] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T18:52:21.619522] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:52:21.802308] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-23T18:52:22.490906] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T18:52:22.602165] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-23T18:52:22.935000] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T18:52:23.402195] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-23T18:52:24.202244] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-23T18:52:24.882542] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-23T18:52:25.002271] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-23T18:52:25.531052] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T18:52:25.802194] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-23T18:52:26.007258] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T18:52:26.602181] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-23T18:52:26.954163] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (3.55 seconds). [2025-09-23T18:52:27.102913] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:52:27.125898] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T18:52:27.402196] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-23T18:52:27.895368] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T18:52:28.202181] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-23T18:52:29.002266] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-23T18:52:29.569855] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T18:52:29.802203] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-23T18:52:29.876075] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:52:30.602195] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-23T18:52:31.402219] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-23T18:52:31.712753] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T18:52:32.023866] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T18:52:32.024174] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T18:52:32.202254] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-23T18:52:32.640346] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T18:52:33.002262] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-23T18:52:33.802197] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-23T18:52:34.602240] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-23T18:52:34.837243] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T18:52:35.066382] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:52:35.402187] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-23T18:52:35.447984] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T18:52:36.202238] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-23T18:52:37.002249] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-23T18:52:37.675989] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:52:37.677497] [INFO ] [REMOTE ] FMN: Full fetch complete (10182 records). [2025-09-23T18:52:37.677580] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-23T18:52:37.805952] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-23T18:52:38.076873] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-23T18:52:38.078513] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-23T18:52:38.078871] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-23T18:52:38.078404] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-23T18:52:38.079031] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-23T18:52:38.088274] [DEBUG] [LOCAL ] FMN: Trimmed 10182 records to 6172 (keeping 200 days of data) [2025-09-23T18:52:38.107461] [INFO ] [REMOTE ] FLUT: Full fetch complete (72724 records). [2025-09-23T18:52:38.116128] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-23T18:52:38.395706] [DEBUG] [LOCAL ] FMN: Primary data saved (6172 records). [2025-09-23T18:52:38.436338] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-23T18:52:38.475214] [INFO ] [MAIN ] Update Progress: 849/2372 symbols completed. FMN took 18.1s. Estimated remaining: 3h 21m 58s. Rate: 7.5 symbols/min [2025-09-23T18:52:38.596424] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-23T18:52:38.652520] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-23T18:52:38.699474] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-23T18:52:38.693195] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-23T18:52:38.723637] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-23T18:52:38.788868] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:38.789879] [INFO ] [REMOTE ] FLS: Full fetch complete (71313 records). [2025-09-23T18:52:38.790009] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-23T18:52:38.803290] [DEBUG] [LOCAL ] FLUT: Trimmed 72724 records to 50884 (keeping 200 days of data) [2025-09-23T18:52:39.211913] [DEBUG] [LOCAL ] FMS: Loaded 30396 existing records from primary storage. [2025-09-23T18:52:39.239808] [INFO ] [MAIN ] FMS: Loaded 30396 existing records. [2025-09-23T18:52:39.802012] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-23T18:52:39.844681] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:39.845193] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-23T18:52:39.847971] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-23T18:52:39.848801] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-23T18:52:39.850550] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-23T18:52:39.851193] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-23T18:52:39.855735] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-23T18:52:39.856161] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-23T18:52:39.972527] [DEBUG] [LOCAL ] FLS: Trimmed 71313 records to 50186 (keeping 200 days of data) [2025-09-23T18:52:40.509500] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-23T18:52:40.580234] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-23T18:52:40.574194] [DEBUG] [LOCAL ] FLUT: Primary data saved (50884 records). [2025-09-23T18:52:40.599783] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-23T18:52:40.600278] [INFO ] [MAIN ] Update Progress: 850/2372 symbols completed. FLUT took 43.3s. Estimated remaining: 3h 21m 40s. Rate: 7.5 symbols/min [2025-09-23T18:52:40.746939] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:40.766204] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-23T18:52:40.885413] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:41.029975] [DEBUG] [LOCAL ] FMX: Loaded 40726 existing records from primary storage. [2025-09-23T18:52:41.031369] [INFO ] [MAIN ] FMX: Loaded 40726 existing records. [2025-09-23T18:52:41.248149] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:41.249228] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-23T18:52:41.249676] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-23T18:52:41.251999] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-23T18:52:41.252353] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-23T18:52:41.693522] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:41.695843] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-23T18:52:41.705620] [DEBUG] [LOCAL ] FLS: Primary data saved (50186 records). [2025-09-23T18:52:41.705888] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-23T18:52:41.706032] [INFO ] [MAIN ] Update Progress: 851/2372 symbols completed. FLS took 53.6s. Estimated remaining: 3h 21m 19s. Rate: 7.6 symbols/min [2025-09-23T18:52:41.902554] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:41.921872] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T18:52:41.928470] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-23T18:52:41.930870] [DEBUG] [LOCAL ] FMY: Loaded 1383 existing records from primary storage. [2025-09-23T18:52:41.932026] [INFO ] [MAIN ] FMY: Loaded 1383 existing records. [2025-09-23T18:52:42.121018] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:42.121441] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-23T18:52:42.121526] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-23T18:52:42.121823] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-23T18:52:42.121966] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-23T18:52:42.257717] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T18:52:42.324778] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-23T18:52:42.533332] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:42.602193] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-23T18:52:43.009487] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T18:52:43.126887] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:52:43.177587] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T18:52:43.402197] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-23T18:52:43.751317] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-23T18:52:43.942914] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T18:52:44.202212] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-23T18:52:44.953159] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T18:52:45.002199] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-23T18:52:45.444831] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T18:52:45.802207] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-23T18:52:46.602179] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-23T18:52:47.402217] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-23T18:52:47.538944] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T18:52:48.064945] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T18:52:48.071250] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:52:48.202196] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-23T18:52:49.002224] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-23T18:52:49.280453] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-23T18:52:49.684881] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T18:52:49.802202] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-23T18:52:50.602211] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-23T18:52:50.883313] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:52:51.402205] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-23T18:52:51.766200] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T18:52:51.937699] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T18:52:51.947294] [INFO ] [REMOTE ] FMC: Full fetch complete (74881 records). [2025-09-23T18:52:51.947453] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-23T18:52:52.207454] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-23T18:52:52.352281] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-23T18:52:52.352363] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-23T18:52:52.353380] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-23T18:52:52.353483] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-23T18:52:52.359220] [DEBUG] [LOCAL ] FMC: Trimmed 74881 records to 51787 (keeping 200 days of data) [2025-09-23T18:52:52.677207] [DEBUG] [LOCAL ] FMC: Primary data saved (51787 records). [2025-09-23T18:52:52.677343] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-23T18:52:52.677529] [INFO ] [MAIN ] Update Progress: 852/2372 symbols completed. FMC took 35.3s. Estimated remaining: 3h 21m 17s. Rate: 7.6 symbols/min [2025-09-23T18:52:52.857823] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:52.900048] [DEBUG] [LOCAL ] FN: Loaded 39605 existing records from primary storage. [2025-09-23T18:52:52.900238] [INFO ] [MAIN ] FN: Loaded 39605 existing records. [2025-09-23T18:52:53.007309] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-23T18:52:53.080967] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:53.081268] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-23T18:52:53.081333] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-23T18:52:53.082233] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-23T18:52:53.082314] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-23T18:52:53.446264] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:53.501215] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T18:52:53.802217] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-23T18:52:54.045773] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T18:52:54.602217] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-23T18:52:55.052878] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T18:52:55.402245] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-23T18:52:55.664830] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T18:52:55.968080] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T18:52:56.202223] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-23T18:52:57.002203] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-23T18:52:57.706125] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:52:57.802154] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-23T18:52:58.179113] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:52:58.602192] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-23T18:52:58.991348] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T18:52:59.402245] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-23T18:52:59.580331] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T18:52:59.695448] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-23T18:53:00.202227] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-23T18:53:01.002222] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-23T18:53:01.308438] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:53:01.367072] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T18:53:01.802198] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-23T18:53:02.303440] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:53:02.304342] [INFO ] [REMOTE ] FMY: Full fetch complete (1956 records). [2025-09-23T18:53:02.304439] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-23T18:53:02.607323] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-23T18:53:02.678861] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-23T18:53:02.678948] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-23T18:53:02.679067] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-23T18:53:02.679129] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-23T18:53:02.679503] [DEBUG] [LOCAL ] FMY: Trimmed 1956 records to 1382 (keeping 200 days of data) [2025-09-23T18:53:02.689770] [DEBUG] [LOCAL ] FMY: Primary data saved (1382 records). [2025-09-23T18:53:02.689871] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-23T18:53:02.690000] [INFO ] [MAIN ] Update Progress: 853/2372 symbols completed. FMY took 21.0s. Estimated remaining: 3h 21m 13s. Rate: 7.5 symbols/min [2025-09-23T18:53:02.857711] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:02.929673] [DEBUG] [LOCAL ] FNB: Loaded 52454 existing records from primary storage. [2025-09-23T18:53:02.929854] [INFO ] [MAIN ] FNB: Loaded 52454 existing records. [2025-09-23T18:53:03.113522] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:03.113766] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-23T18:53:03.113831] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-23T18:53:03.116042] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-23T18:53:03.116104] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-23T18:53:03.407353] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-23T18:53:03.473324] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:03.813836] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T18:53:04.202260] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-23T18:53:04.738119] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T18:53:05.002203] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-23T18:53:05.778492] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T18:53:05.802160] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-23T18:53:06.334263] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T18:53:06.602187] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-23T18:53:07.402194] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-23T18:53:08.082202] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T18:53:08.211070] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-23T18:53:08.216576] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-23T18:53:08.312099] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T18:53:08.317690] [INFO ] [REMOTE ] FMS: Full fetch complete (42328 records). [2025-09-23T18:53:08.317846] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-23T18:53:08.722765] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-23T18:53:08.722858] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-23T18:53:08.723461] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-23T18:53:08.723502] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-23T18:53:08.724708] [DEBUG] [LOCAL ] FMS: Trimmed 42328 records to 30385 (keeping 200 days of data) [2025-09-23T18:53:08.918681] [DEBUG] [LOCAL ] FMS: Primary data saved (30385 records). [2025-09-23T18:53:08.918817] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-23T18:53:08.918901] [INFO ] [MAIN ] Update Progress: 854/2372 symbols completed. FMS took 30.4s. Estimated remaining: 3h 21m 2s. Rate: 7.6 symbols/min [2025-09-23T18:53:09.008157] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-23T18:53:09.089556] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:09.148702] [DEBUG] [LOCAL ] FND: Loaded 52159 existing records from primary storage. [2025-09-23T18:53:09.148855] [INFO ] [MAIN ] FND: Loaded 52159 existing records. [2025-09-23T18:53:09.330248] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:09.330602] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-23T18:53:09.330680] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-23T18:53:09.331847] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-23T18:53:09.331910] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-23T18:53:09.707458] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:09.760311] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T18:53:09.802156] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-23T18:53:10.531148] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:53:10.539601] [INFO ] [REMOTE ] FMX: Full fetch complete (57714 records). [2025-09-23T18:53:10.539755] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-23T18:53:10.607440] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-23T18:53:10.930307] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-23T18:53:10.930386] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-23T18:53:10.931131] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-23T18:53:10.931193] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-23T18:53:10.932450] [DEBUG] [LOCAL ] FMX: Trimmed 57714 records to 40734 (keeping 200 days of data) [2025-09-23T18:53:11.210864] [DEBUG] [LOCAL ] FMX: Primary data saved (40734 records). [2025-09-23T18:53:11.211032] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-23T18:53:11.211184] [INFO ] [MAIN ] Update Progress: 855/2372 symbols completed. FMX took 30.6s. Estimated remaining: 3h 20m 44s. Rate: 7.6 symbols/min [2025-09-23T18:53:11.455531] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:11.452595] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-23T18:53:11.509248] [DEBUG] [LOCAL ] FNF: Loaded 49257 existing records from primary storage. [2025-09-23T18:53:11.509432] [INFO ] [MAIN ] FNF: Loaded 49257 existing records. [2025-09-23T18:53:11.692098] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:11.692616] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-23T18:53:11.692840] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-23T18:53:11.701827] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-23T18:53:11.714102] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-23T18:53:11.789989] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T18:53:12.098987] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:12.202159] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-23T18:53:12.279787] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:53:13.002222] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-23T18:53:13.118005] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:53:13.491698] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T18:53:13.802187] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-23T18:53:14.561017] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T18:53:14.602158] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-23T18:53:15.402227] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-23T18:53:15.475603] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:53:16.049285] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:53:16.202242] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-23T18:53:16.993756] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T18:53:17.003127] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-23T18:53:17.552743] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:53:17.802250] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-23T18:53:18.297274] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T18:53:18.602211] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-23T18:53:19.046989] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T18:53:19.402204] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-23T18:53:20.210306] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-23T18:53:20.216993] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:53:20.588012] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T18:53:21.002197] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-23T18:53:21.633936] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:53:21.802234] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-23T18:53:22.602227] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-23T18:53:22.802857] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T18:53:23.114621] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:53:23.402200] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-23T18:53:24.004808] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:53:24.202220] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-23T18:53:25.002253] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-23T18:53:25.261623] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T18:53:25.630833] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T18:53:25.802218] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-23T18:53:26.291330] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T18:53:26.602211] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-23T18:53:27.069209] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T18:53:27.402256] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-23T18:53:27.997199] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:53:28.202184] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-23T18:53:28.699917] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:53:29.002210] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-23T18:53:29.802189] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-23T18:53:29.835730] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:53:30.602234] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-23T18:53:30.675099] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T18:53:31.079026] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T18:53:31.085533] [INFO ] [REMOTE ] FN: Full fetch complete (56445 records). [2025-09-23T18:53:31.085692] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-23T18:53:31.408367] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-23T18:53:31.481854] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-23T18:53:31.481935] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-23T18:53:31.482702] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-23T18:53:31.482764] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-23T18:53:31.484031] [DEBUG] [LOCAL ] FN: Trimmed 56445 records to 39497 (keeping 200 days of data) [2025-09-23T18:53:31.720851] [DEBUG] [LOCAL ] FN: Primary data saved (39497 records). [2025-09-23T18:53:31.720993] [INFO ] [MAIN ] FN: Full history saved. [2025-09-23T18:53:31.721092] [INFO ] [MAIN ] Update Progress: 856/2372 symbols completed. FN took 39.0s. Estimated remaining: 3h 20m 58s. Rate: 7.5 symbols/min [2025-09-23T18:53:31.887689] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:31.934346] [DEBUG] [LOCAL ] FNV: Loaded 46472 existing records from primary storage. [2025-09-23T18:53:31.934485] [INFO ] [MAIN ] FNV: Loaded 46472 existing records. [2025-09-23T18:53:32.115558] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:32.115972] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-23T18:53:32.116129] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-23T18:53:32.117306] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-23T18:53:32.117372] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-23T18:53:32.243694] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-23T18:53:32.305224] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T18:53:32.533660] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:32.831205] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:53:32.839933] [INFO ] [REMOTE ] FNB: Full fetch complete (75633 records). [2025-09-23T18:53:32.840075] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-23T18:53:33.014876] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-23T18:53:33.231063] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-23T18:53:33.231145] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-23T18:53:33.232025] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-23T18:53:33.232091] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-23T18:53:33.233523] [DEBUG] [LOCAL ] FNB: Trimmed 75633 records to 52450 (keeping 200 days of data) [2025-09-23T18:53:33.563097] [DEBUG] [LOCAL ] FNB: Primary data saved (52450 records). [2025-09-23T18:53:33.563220] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-23T18:53:33.563299] [INFO ] [MAIN ] Update Progress: 857/2372 symbols completed. FNB took 30.9s. Estimated remaining: 3h 20m 39s. Rate: 7.6 symbols/min [2025-09-23T18:53:33.735599] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:33.749993] [DEBUG] [LOCAL ] FOA: Loaded 13132 existing records from primary storage. [2025-09-23T18:53:33.750131] [INFO ] [MAIN ] FOA: Loaded 13132 existing records. [2025-09-23T18:53:33.813605] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-23T18:53:33.967387] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:33.971336] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-23T18:53:33.973300] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T18:53:33.985754] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-23T18:53:33.986837] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-23T18:53:33.986912] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-23T18:53:34.369862] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:34.438337] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:53:34.602192] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-23T18:53:35.156215] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T18:53:35.402166] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-23T18:53:35.711474] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:53:36.202216] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-23T18:53:36.739051] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:53:37.002195] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-23T18:53:37.551093] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:53:37.802219] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-23T18:53:38.396924] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:53:38.602238] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-23T18:53:39.107603] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:53:39.402158] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-23T18:53:39.440332] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T18:53:40.202193] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-23T18:53:40.713090] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T18:53:41.002188] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-23T18:53:41.506232] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T18:53:41.802183] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-23T18:53:42.535494] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T18:53:42.544282] [INFO ] [REMOTE ] FND: Full fetch complete (74359 records). [2025-09-23T18:53:42.544452] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-23T18:53:42.607390] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-23T18:53:42.893475] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T18:53:42.973813] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-23T18:53:42.973897] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-23T18:53:42.974851] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-23T18:53:42.974916] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-23T18:53:42.976513] [DEBUG] [LOCAL ] FND: Trimmed 74359 records to 52147 (keeping 200 days of data) [2025-09-23T18:53:43.290842] [DEBUG] [LOCAL ] FND: Primary data saved (52147 records). [2025-09-23T18:53:43.290987] [INFO ] [MAIN ] FND: Full history saved. [2025-09-23T18:53:43.291087] [INFO ] [MAIN ] Update Progress: 858/2372 symbols completed. FND took 34.4s. Estimated remaining: 3h 20m 34s. Rate: 7.5 symbols/min [2025-09-23T18:53:43.407271] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-23T18:53:43.472291] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:43.483278] [DEBUG] [LOCAL ] FOF: Loaded 8383 existing records from primary storage. [2025-09-23T18:53:43.483472] [INFO ] [MAIN ] FOF: Loaded 8383 existing records. [2025-09-23T18:53:43.693819] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:43.694147] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-23T18:53:43.694201] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-23T18:53:43.694588] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-23T18:53:43.694678] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-23T18:53:44.059878] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:44.071493] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T18:53:44.183372] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T18:53:44.192129] [INFO ] [REMOTE ] FNF: Full fetch complete (69497 records). [2025-09-23T18:53:44.192293] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-23T18:53:44.207350] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-23T18:53:44.631074] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-23T18:53:44.631172] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-23T18:53:44.632058] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-23T18:53:44.632125] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-23T18:53:44.633606] [DEBUG] [LOCAL ] FNF: Trimmed 69497 records to 49223 (keeping 200 days of data) [2025-09-23T18:53:44.939485] [DEBUG] [LOCAL ] FNF: Primary data saved (49223 records). [2025-09-23T18:53:44.939625] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-23T18:53:44.939746] [INFO ] [MAIN ] Update Progress: 859/2372 symbols completed. FNF took 33.7s. Estimated remaining: 3h 20m 15s. Rate: 7.6 symbols/min [2025-09-23T18:53:45.007494] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-23T18:53:45.117366] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:45.138298] [DEBUG] [LOCAL ] FOR: Loaded 20202 existing records from primary storage. [2025-09-23T18:53:45.138434] [INFO ] [MAIN ] FOR: Loaded 20202 existing records. [2025-09-23T18:53:45.315786] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:45.316054] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-23T18:53:45.316101] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-23T18:53:45.316721] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-23T18:53:45.316783] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-23T18:53:45.671572] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:45.802234] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-23T18:53:46.029303] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T18:53:46.194390] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T18:53:46.404144] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T18:53:46.602252] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-23T18:53:47.402180] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-23T18:53:47.425014] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T18:53:48.202348] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-23T18:53:48.725710] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T18:53:49.002244] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-23T18:53:49.069352] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:53:49.485547] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T18:53:49.802256] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-23T18:53:50.527540] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T18:53:50.602274] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-23T18:53:51.315900] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T18:53:51.402236] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-23T18:53:51.909762] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T18:53:52.202213] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-23T18:53:52.781454] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T18:53:53.002202] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-23T18:53:53.768255] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T18:53:53.802154] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-23T18:53:54.505807] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:53:54.508961] [INFO ] [REMOTE ] FOA: Full fetch complete (22437 records). [2025-09-23T18:53:54.509037] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-23T18:53:54.607382] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-23T18:53:54.888696] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-23T18:53:54.888779] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-23T18:53:54.889232] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-23T18:53:54.889270] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-23T18:53:54.889870] [DEBUG] [LOCAL ] FOA: Trimmed 22437 records to 13184 (keeping 200 days of data) [2025-09-23T18:53:54.966124] [DEBUG] [LOCAL ] FOA: Primary data saved (13184 records). [2025-09-23T18:53:54.966263] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-23T18:53:54.966348] [INFO ] [MAIN ] Update Progress: 860/2372 symbols completed. FOA took 21.4s. Estimated remaining: 3h 20m 11s. Rate: 7.6 symbols/min [2025-09-23T18:53:55.132444] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:55.181490] [DEBUG] [LOCAL ] FOUR: Loaded 49522 existing records from primary storage. [2025-09-23T18:53:55.181629] [INFO ] [MAIN ] FOUR: Loaded 49522 existing records. [2025-09-23T18:53:55.358360] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:55.358660] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-23T18:53:55.358722] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-23T18:53:55.359956] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-23T18:53:55.360016] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-23T18:53:55.407345] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-23T18:53:55.732531] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:55.949448] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T18:53:56.202182] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-23T18:53:56.789244] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:53:57.002259] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-23T18:53:57.537735] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T18:53:57.538515] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T18:53:57.802206] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-23T18:53:58.523985] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T18:53:58.602186] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-23T18:53:59.402185] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-23T18:53:59.507452] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T18:53:59.837135] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T18:54:00.202270] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-23T18:54:01.002242] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-23T18:54:01.802224] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-23T18:54:02.132787] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-23T18:54:02.165712] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:54:02.602213] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-23T18:54:03.402239] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-23T18:54:04.202327] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-23T18:54:04.367191] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T18:54:05.002263] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-23T18:54:05.118233] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T18:54:05.125786] [INFO ] [REMOTE ] FNV: Full fetch complete (66002 records). [2025-09-23T18:54:05.125902] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-23T18:54:05.484825] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:54:05.515287] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-09-23T18:54:05.616793] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-23T18:54:05.616984] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-23T18:54:05.618042] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-23T18:54:05.618232] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-23T18:54:05.628580] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T18:54:05.632995] [DEBUG] [LOCAL ] FNV: Trimmed 66002 records to 46430 (keeping 200 days of data) [2025-09-23T18:54:05.832007] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-23T18:54:05.948175] [DEBUG] [LOCAL ] FNV: Primary data saved (46430 records). [2025-09-23T18:54:05.948357] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-23T18:54:05.948453] [INFO ] [MAIN ] Update Progress: 861/2372 symbols completed. FNV took 34.2s. Estimated remaining: 3h 20m 9s. Rate: 7.5 symbols/min [2025-09-23T18:54:06.126364] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:06.145177] [DEBUG] [LOCAL ] FPF: Loaded 17594 existing records from primary storage. [2025-09-23T18:54:06.145307] [INFO ] [MAIN ] FPF: Loaded 17594 existing records. [2025-09-23T18:54:06.333696] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:06.334001] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-23T18:54:06.334057] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-23T18:54:06.334717] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-23T18:54:06.334812] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-23T18:54:06.609760] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-23T18:54:06.715705] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:07.180759] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:54:07.356292] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T18:54:07.359732] [INFO ] [REMOTE ] FOR: Full fetch complete (29857 records). [2025-09-23T18:54:07.359816] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-23T18:54:07.412384] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-23T18:54:07.731748] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-23T18:54:07.731828] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-23T18:54:07.732343] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-23T18:54:07.732380] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-23T18:54:07.733112] [DEBUG] [LOCAL ] FOR: Trimmed 29857 records to 20132 (keeping 200 days of data) [2025-09-23T18:54:07.848780] [DEBUG] [LOCAL ] FOR: Primary data saved (20132 records). [2025-09-23T18:54:07.848905] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-23T18:54:07.848984] [INFO ] [MAIN ] Update Progress: 862/2372 symbols completed. FOR took 22.9s. Estimated remaining: 3h 19m 50s. Rate: 7.6 symbols/min [2025-09-23T18:54:07.976740] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T18:54:08.037673] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:08.056696] [DEBUG] [LOCAL ] FPH: Loaded 19781 existing records from primary storage. [2025-09-23T18:54:08.056826] [INFO ] [MAIN ] FPH: Loaded 19781 existing records. [2025-09-23T18:54:08.207261] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-23T18:54:08.238518] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:08.238747] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-23T18:54:08.238803] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-23T18:54:08.239407] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-23T18:54:08.239467] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-23T18:54:08.591820] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:09.002171] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-23T18:54:09.003060] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T18:54:09.710929] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T18:54:09.802193] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-23T18:54:10.602216] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-23T18:54:11.196337] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:54:11.354736] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T18:54:11.402239] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-23T18:54:12.202215] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-23T18:54:12.221422] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T18:54:13.002208] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-23T18:54:13.802221] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-23T18:54:13.953209] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T18:54:14.602193] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-23T18:54:14.910833] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T18:54:15.402179] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-23T18:54:15.420986] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T18:54:15.801109] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T18:54:16.128419] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T18:54:16.130906] [INFO ] [REMOTE ] FOF: Full fetch complete (11844 records). [2025-09-23T18:54:16.130985] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-23T18:54:16.207455] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-23T18:54:16.503097] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-23T18:54:16.503234] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-23T18:54:16.503584] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-23T18:54:16.503628] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-23T18:54:16.504188] [DEBUG] [LOCAL ] FOF: Trimmed 11844 records to 8395 (keeping 200 days of data) [2025-09-23T18:54:16.556770] [DEBUG] [LOCAL ] FOF: Primary data saved (8395 records). [2025-09-23T18:54:16.556915] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-23T18:54:16.557001] [INFO ] [MAIN ] Update Progress: 863/2372 symbols completed. FOF took 33.3s. Estimated remaining: 3h 19m 43s. Rate: 7.6 symbols/min [2025-09-23T18:54:16.725054] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:16.761010] [DEBUG] [LOCAL ] FPI: Loaded 31107 existing records from primary storage. [2025-09-23T18:54:16.761200] [INFO ] [MAIN ] FPI: Loaded 31107 existing records. [2025-09-23T18:54:16.941394] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:16.941698] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-23T18:54:16.941756] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-23T18:54:16.942794] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-23T18:54:16.942856] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-23T18:54:17.007436] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-23T18:54:17.343003] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T18:54:17.369155] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:17.802212] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-23T18:54:18.090332] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T18:54:18.602199] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-23T18:54:19.402197] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-23T18:54:19.682008] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T18:54:19.712038] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T18:54:20.202320] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-23T18:54:20.353064] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T18:54:21.002205] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-23T18:54:21.161488] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T18:54:21.802251] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-23T18:54:22.416771] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T18:54:22.602223] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-23T18:54:22.874534] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T18:54:23.401400] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T18:54:23.404910] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-23T18:54:24.202284] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-23T18:54:25.002229] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-23T18:54:25.161180] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T18:54:25.206028] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:54:25.650619] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T18:54:25.802225] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-23T18:54:26.602164] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-23T18:54:26.961151] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:54:27.403516] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-23T18:54:27.405934] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T18:54:28.074439] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T18:54:28.202190] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-23T18:54:29.002224] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-23T18:54:29.803326] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-23T18:54:29.806630] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T18:54:29.828437] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:54:29.832419] [INFO ] [REMOTE ] FPH: Full fetch complete (31627 records). [2025-09-23T18:54:29.832502] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-23T18:54:30.241115] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-23T18:54:30.241212] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-23T18:54:30.241876] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-23T18:54:30.241941] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-23T18:54:30.242832] [DEBUG] [LOCAL ] FPH: Trimmed 31627 records to 19740 (keeping 200 days of data) [2025-09-23T18:54:30.355483] [DEBUG] [LOCAL ] FPH: Primary data saved (19740 records). [2025-09-23T18:54:30.355661] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-23T18:54:30.355771] [INFO ] [MAIN ] Update Progress: 864/2372 symbols completed. FPH took 22.5s. Estimated remaining: 3h 19m 46s. Rate: 7.5 symbols/min [2025-09-23T18:54:30.529394] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:30.574814] [DEBUG] [LOCAL ] FR: Loaded 46677 existing records from primary storage. [2025-09-23T18:54:30.574994] [INFO ] [MAIN ] FR: Loaded 46677 existing records. [2025-09-23T18:54:30.607373] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-23T18:54:30.759012] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:30.759692] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-23T18:54:30.759815] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-23T18:54:30.767011] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-23T18:54:30.767119] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-23T18:54:30.855553] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T18:54:31.156178] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:31.402216] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-23T18:54:31.543779] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T18:54:32.202222] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-23T18:54:32.820274] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T18:54:33.002259] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-23T18:54:33.062605] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T18:54:33.802212] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-23T18:54:34.471989] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T18:54:34.602199] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-23T18:54:34.918211] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T18:54:35.259503] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T18:54:35.402225] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-23T18:54:36.202253] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-23T18:54:36.542835] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:54:37.002272] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-23T18:54:37.592142] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:54:37.733970] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T18:54:37.802223] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-23T18:54:38.555758] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T18:54:38.559779] [INFO ] [REMOTE ] FPF: Full fetch complete (26319 records). [2025-09-23T18:54:38.559900] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-23T18:54:38.607431] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-23T18:54:38.976226] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-23T18:54:38.976337] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-23T18:54:38.977275] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-23T18:54:38.977396] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-23T18:54:38.978375] [DEBUG] [LOCAL ] FPF: Trimmed 26319 records to 17613 (keeping 200 days of data) [2025-09-23T18:54:39.095072] [DEBUG] [LOCAL ] FPF: Primary data saved (17613 records). [2025-09-23T18:54:39.095239] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-23T18:54:39.095350] [INFO ] [MAIN ] Update Progress: 865/2372 symbols completed. FPF took 33.1s. Estimated remaining: 3h 19m 39s. Rate: 7.5 symbols/min [2025-09-23T18:54:39.293188] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:39.311285] [DEBUG] [LOCAL ] FRA: Loaded 14592 existing records from primary storage. [2025-09-23T18:54:39.311428] [INFO ] [MAIN ] FRA: Loaded 14592 existing records. [2025-09-23T18:54:39.407544] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-23T18:54:39.505623] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:39.505890] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-23T18:54:39.505941] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-23T18:54:39.506509] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-23T18:54:39.506570] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-23T18:54:39.877497] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:40.057389] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:54:40.202256] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-23T18:54:41.008128] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-23T18:54:41.030174] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T18:54:41.121364] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T18:54:41.802231] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-23T18:54:42.602234] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-23T18:54:42.703820] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:54:43.330043] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T18:54:43.347907] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:54:43.360852] [INFO ] [REMOTE ] FOUR: Full fetch complete (71941 records). [2025-09-23T18:54:43.361076] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-23T18:54:43.407523] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-23T18:54:43.867833] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-23T18:54:43.868061] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-23T18:54:43.869380] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-23T18:54:43.869538] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-23T18:54:43.871389] [DEBUG] [LOCAL ] FOUR: Trimmed 71941 records to 49524 (keeping 200 days of data) [2025-09-23T18:54:44.181745] [DEBUG] [LOCAL ] FOUR: Primary data saved (49524 records). [2025-09-23T18:54:44.181886] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-23T18:54:44.182135] [INFO ] [MAIN ] Update Progress: 866/2372 symbols completed. FOUR took 49.2s. Estimated remaining: 3h 19m 26s. Rate: 7.6 symbols/min [2025-09-23T18:54:44.212028] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-23T18:54:44.356785] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:44.376512] [DEBUG] [LOCAL ] FRGE: Loaded 18734 existing records from primary storage. [2025-09-23T18:54:44.376672] [INFO ] [MAIN ] FRGE: Loaded 18734 existing records. [2025-09-23T18:54:44.553384] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:44.553715] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-23T18:54:44.553785] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-23T18:54:44.554363] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-23T18:54:44.554424] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-23T18:54:44.910250] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:44.931259] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T18:54:45.002182] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-23T18:54:45.580994] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T18:54:45.802209] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-23T18:54:46.256233] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T18:54:46.608703] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-23T18:54:46.624811] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T18:54:47.402211] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-23T18:54:47.427258] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T18:54:47.998508] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T18:54:48.202205] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-23T18:54:49.002185] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-23T18:54:49.274051] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T18:54:49.802194] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-23T18:54:50.404144] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T18:54:50.602186] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-23T18:54:50.850892] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T18:54:51.402235] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-23T18:54:51.549310] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T18:54:52.202226] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-23T18:54:52.793411] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:54:53.002200] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-23T18:54:53.116806] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T18:54:53.121917] [INFO ] [REMOTE ] FPI: Full fetch complete (44088 records). [2025-09-23T18:54:53.122014] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-23T18:54:53.521592] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-23T18:54:53.521723] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-23T18:54:53.522378] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-23T18:54:53.522476] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-23T18:54:53.523554] [DEBUG] [LOCAL ] FPI: Trimmed 44088 records to 31151 (keeping 200 days of data) [2025-09-23T18:54:53.721693] [DEBUG] [LOCAL ] FPI: Primary data saved (31151 records). [2025-09-23T18:54:53.721834] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-23T18:54:53.721965] [INFO ] [MAIN ] Update Progress: 867/2372 symbols completed. FPI took 37.2s. Estimated remaining: 3h 19m 21s. Rate: 7.5 symbols/min [2025-09-23T18:54:53.807539] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-23T18:54:53.895768] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:53.953728] [DEBUG] [LOCAL ] FRO: Loaded 51881 existing records from primary storage. [2025-09-23T18:54:53.953877] [INFO ] [MAIN ] FRO: Loaded 51881 existing records. [2025-09-23T18:54:54.144868] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:54.145284] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-23T18:54:54.145354] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-23T18:54:54.146572] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-23T18:54:54.146676] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-23T18:54:54.464347] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T18:54:54.536551] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:54.602149] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-23T18:54:55.090425] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T18:54:55.402220] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-23T18:54:55.926019] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T18:54:56.112509] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:54:56.202170] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-23T18:54:57.002239] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-23T18:54:57.760392] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T18:54:57.802160] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-23T18:54:58.268980] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:54:58.367772] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T18:54:58.602199] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-23T18:54:59.402206] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-23T18:55:00.048462] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T18:55:00.202188] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-23T18:55:00.794870] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:55:01.002202] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-23T18:55:01.802290] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-23T18:55:02.028209] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T18:55:02.219746] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T18:55:02.437490] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T18:55:02.602278] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-23T18:55:03.402173] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-23T18:55:03.570075] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T18:55:04.202214] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-23T18:55:04.225236] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T18:55:05.002200] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-23T18:55:05.702779] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T18:55:05.802159] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-23T18:55:05.853733] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T18:55:06.602204] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-23T18:55:07.351107] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:55:07.358935] [INFO ] [REMOTE ] FR: Full fetch complete (66530 records). [2025-09-23T18:55:07.359084] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-23T18:55:07.414053] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-23T18:55:07.479757] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T18:55:07.777936] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-23T18:55:07.778031] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-23T18:55:07.778850] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-23T18:55:07.778913] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-23T18:55:07.780309] [DEBUG] [LOCAL ] FR: Trimmed 66530 records to 46597 (keeping 200 days of data) [2025-09-23T18:55:08.076841] [DEBUG] [LOCAL ] FR: Primary data saved (46597 records). [2025-09-23T18:55:08.076977] [INFO ] [MAIN ] FR: Full history saved. [2025-09-23T18:55:08.077116] [INFO ] [MAIN ] Update Progress: 868/2372 symbols completed. FR took 37.7s. Estimated remaining: 3h 19m 24s. Rate: 7.5 symbols/min [2025-09-23T18:55:08.207337] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-23T18:55:08.251359] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:08.297308] [DEBUG] [LOCAL ] FRT: Loaded 42371 existing records from primary storage. [2025-09-23T18:55:08.297453] [INFO ] [MAIN ] FRT: Loaded 42371 existing records. [2025-09-23T18:55:08.475016] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:08.475340] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-23T18:55:08.475401] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-23T18:55:08.484382] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-23T18:55:08.484475] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-23T18:55:08.529431] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:55:08.581902] [INFO ] [REMOTE ] FRA: Full fetch complete (24237 records). [2025-09-23T18:55:08.592539] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-23T18:55:09.008497] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-23T18:55:09.140915] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:09.260371] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-23T18:55:09.260457] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-23T18:55:09.260978] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-23T18:55:09.261062] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-23T18:55:09.261820] [DEBUG] [LOCAL ] FRA: Trimmed 24237 records to 14584 (keeping 200 days of data) [2025-09-23T18:55:09.352408] [DEBUG] [LOCAL ] FRA: Primary data saved (14584 records). [2025-09-23T18:55:09.352561] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-23T18:55:09.352738] [INFO ] [MAIN ] Update Progress: 869/2372 symbols completed. FRA took 30.3s. Estimated remaining: 3h 19m 5s. Rate: 7.5 symbols/min [2025-09-23T18:55:09.523202] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:09.572703] [DEBUG] [LOCAL ] FSCO: Loaded 36753 existing records from primary storage. [2025-09-23T18:55:09.572856] [INFO ] [MAIN ] FSCO: Loaded 36753 existing records. [2025-09-23T18:55:09.752144] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:09.752601] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-23T18:55:09.752720] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-23T18:55:09.754449] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-23T18:55:09.754513] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-23T18:55:09.817413] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-23T18:55:10.164860] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T18:55:10.147368] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T18:55:10.171591] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:10.192442] [INFO ] [REMOTE ] FRGE: Full fetch complete (34204 records). [2025-09-23T18:55:10.193452] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-23T18:55:10.595042] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-23T18:55:10.595132] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-23T18:55:10.595768] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-23T18:55:10.595830] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-23T18:55:10.596662] [DEBUG] [LOCAL ] FRGE: Trimmed 34204 records to 18585 (keeping 200 days of data) [2025-09-23T18:55:10.602215] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-23T18:55:10.712345] [DEBUG] [LOCAL ] FRGE: Primary data saved (18585 records). [2025-09-23T18:55:10.712480] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-23T18:55:10.712565] [INFO ] [MAIN ] Update Progress: 870/2372 symbols completed. FRGE took 26.5s. Estimated remaining: 3h 18m 45s. Rate: 7.6 symbols/min [2025-09-23T18:55:10.882402] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:10.935419] [DEBUG] [LOCAL ] FSK: Loaded 49383 existing records from primary storage. [2025-09-23T18:55:10.935761] [INFO ] [MAIN ] FSK: Loaded 49383 existing records. [2025-09-23T18:55:11.140228] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T18:55:11.151545] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:11.152245] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-23T18:55:11.152318] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-23T18:55:11.153516] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-23T18:55:11.153582] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-23T18:55:11.409987] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-23T18:55:11.526528] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:12.139346] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:55:12.202232] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-23T18:55:13.007333] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-23T18:55:13.025167] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T18:55:13.380233] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:55:13.802189] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-23T18:55:14.270888] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T18:55:14.602196] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-23T18:55:15.123960] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:55:15.402199] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-23T18:55:15.891934] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T18:55:16.202193] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-23T18:55:16.437398] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T18:55:17.002198] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-23T18:55:17.553934] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:55:17.802202] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-23T18:55:18.602294] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-23T18:55:18.830535] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T18:55:18.899705] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T18:55:19.402249] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-23T18:55:20.031971] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T18:55:20.202193] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-23T18:55:20.779742] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:55:21.002260] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-23T18:55:21.338296] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T18:55:21.802271] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-23T18:55:22.602166] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-23T18:55:22.783413] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T18:55:23.295845] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:55:23.402244] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-23T18:55:24.062306] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T18:55:24.202203] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-23T18:55:24.856825] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:55:24.865611] [INFO ] [REMOTE ] FRO: Full fetch complete (75434 records). [2025-09-23T18:55:24.865838] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-23T18:55:25.007351] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-23T18:55:25.261303] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-23T18:55:25.261384] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-23T18:55:25.262261] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-23T18:55:25.262327] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-23T18:55:25.266592] [DEBUG] [LOCAL ] FRO: Trimmed 75434 records to 51894 (keeping 200 days of data) [2025-09-23T18:55:25.530394] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:55:25.633687] [DEBUG] [LOCAL ] FRO: Primary data saved (51894 records). [2025-09-23T18:55:25.633833] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-23T18:55:25.633916] [INFO ] [MAIN ] Update Progress: 871/2372 symbols completed. FRO took 31.9s. Estimated remaining: 3h 18m 49s. Rate: 7.5 symbols/min [2025-09-23T18:55:25.800924] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:25.802225] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-23T18:55:25.853039] [DEBUG] [LOCAL ] FSLY: Loaded 51270 existing records from primary storage. [2025-09-23T18:55:25.853188] [INFO ] [MAIN ] FSLY: Loaded 51270 existing records. [2025-09-23T18:55:26.032358] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:26.032602] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-23T18:55:26.032673] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-23T18:55:26.033710] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-23T18:55:26.033769] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-23T18:55:26.394612] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:26.420409] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:55:26.602152] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-23T18:55:27.071699] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T18:55:27.402229] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-23T18:55:28.202206] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-23T18:55:28.580684] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-23T18:55:28.918441] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:55:29.002148] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-23T18:55:29.090083] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:55:29.802246] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-23T18:55:30.602194] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-23T18:55:30.702414] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T18:55:31.113561] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T18:55:31.402269] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-23T18:55:31.829721] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T18:55:32.202302] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-23T18:55:32.645102] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T18:55:33.002203] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-23T18:55:33.802201] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-23T18:55:34.105568] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T18:55:34.505243] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T18:55:34.602173] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-23T18:55:35.402244] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-23T18:55:35.465131] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T18:55:35.648137] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:55:36.202326] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-23T18:55:36.714190] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:55:37.002254] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-23T18:55:37.376187] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T18:55:37.384443] [INFO ] [REMOTE ] FSCO: Full fetch complete (53892 records). [2025-09-23T18:55:37.384738] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-23T18:55:37.796593] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-23T18:55:37.796801] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-23T18:55:37.797870] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-23T18:55:37.797945] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-23T18:55:37.799761] [DEBUG] [LOCAL ] FSCO: Trimmed 53892 records to 36851 (keeping 200 days of data) [2025-09-23T18:55:37.802230] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-23T18:55:38.030454] [DEBUG] [LOCAL ] FSCO: Primary data saved (36851 records). [2025-09-23T18:55:38.030619] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-23T18:55:38.030746] [INFO ] [MAIN ] Update Progress: 872/2372 symbols completed. FSCO took 28.7s. Estimated remaining: 3h 18m 49s. Rate: 7.5 symbols/min [2025-09-23T18:55:38.208948] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:38.261452] [DEBUG] [LOCAL ] FSM: Loaded 53288 existing records from primary storage. [2025-09-23T18:55:38.261618] [INFO ] [MAIN ] FSM: Loaded 53288 existing records. [2025-09-23T18:55:38.460088] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:38.460547] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-23T18:55:38.460618] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-23T18:55:38.461832] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-23T18:55:38.461897] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-23T18:55:38.619395] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-23T18:55:38.695300] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T18:55:38.920830] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:39.402211] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-23T18:55:39.718561] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T18:55:40.202159] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-23T18:55:40.243096] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T18:55:40.796623] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:55:41.002192] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-23T18:55:41.684473] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:55:41.698556] [INFO ] [REMOTE ] FSK: Full fetch complete (71390 records). [2025-09-23T18:55:41.698750] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-23T18:55:41.803963] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-23T18:55:42.100350] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-23T18:55:42.100464] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-23T18:55:42.101346] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-23T18:55:42.101411] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-23T18:55:42.102835] [DEBUG] [LOCAL ] FSK: Trimmed 71390 records to 49398 (keeping 200 days of data) [2025-09-23T18:55:42.409745] [DEBUG] [LOCAL ] FSK: Primary data saved (49398 records). [2025-09-23T18:55:42.409876] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-23T18:55:42.410014] [INFO ] [MAIN ] Update Progress: 873/2372 symbols completed. FSK took 31.7s. Estimated remaining: 3h 18m 35s. Rate: 7.5 symbols/min [2025-09-23T18:55:42.599497] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:42.609059] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-23T18:55:42.613368] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:55:42.656394] [DEBUG] [LOCAL ] FSS: Loaded 34636 existing records from primary storage. [2025-09-23T18:55:42.656528] [INFO ] [MAIN ] FSS: Loaded 34636 existing records. [2025-09-23T18:55:42.835302] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:42.835603] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-23T18:55:42.835687] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-23T18:55:42.836477] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-23T18:55:42.836536] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-23T18:55:43.189104] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:43.389667] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T18:55:43.397213] [INFO ] [REMOTE ] FRT: Full fetch complete (60261 records). [2025-09-23T18:55:43.397357] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-23T18:55:43.409288] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-23T18:55:43.790200] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-23T18:55:43.790315] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-23T18:55:43.791047] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-23T18:55:43.791109] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-23T18:55:43.792380] [DEBUG] [LOCAL ] FRT: Trimmed 60261 records to 42360 (keeping 200 days of data) [2025-09-23T18:55:44.037695] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T18:55:44.091049] [DEBUG] [LOCAL ] FRT: Primary data saved (42360 records). [2025-09-23T18:55:44.091173] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-23T18:55:44.091271] [INFO ] [MAIN ] Update Progress: 874/2372 symbols completed. FRT took 36.0s. Estimated remaining: 3h 18m 16s. Rate: 7.6 symbols/min [2025-09-23T18:55:44.207307] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-23T18:55:44.266587] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:44.274511] [DEBUG] [LOCAL ] FT: Loaded 6280 existing records from primary storage. [2025-09-23T18:55:44.274624] [INFO ] [MAIN ] FT: Loaded 6280 existing records. [2025-09-23T18:55:44.527199] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:44.527542] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-23T18:55:44.527598] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-23T18:55:44.527921] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-23T18:55:44.527981] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-23T18:55:44.915741] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:44.949612] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T18:55:45.002207] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-23T18:55:45.368744] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T18:55:45.802210] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-23T18:55:46.234231] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T18:55:46.602192] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-23T18:55:46.877338] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T18:55:47.402217] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-23T18:55:48.202172] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-23T18:55:48.451557] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T18:55:48.498228] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T18:55:48.611977] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T18:55:49.002249] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-23T18:55:49.802197] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-23T18:55:50.339586] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:55:50.602220] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-23T18:55:51.159265] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:55:51.228286] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T18:55:51.402205] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-23T18:55:52.202258] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-23T18:55:52.796511] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T18:55:52.809878] [INFO ] [REMOTE ] FSLY: Full fetch complete (74980 records). [2025-09-23T18:55:52.810093] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-23T18:55:53.011462] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-23T18:55:53.217407] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-23T18:55:53.217489] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-23T18:55:53.218418] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-23T18:55:53.218485] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-23T18:55:53.219992] [DEBUG] [LOCAL ] FSLY: Trimmed 74980 records to 51274 (keeping 200 days of data) [2025-09-23T18:55:53.516337] [DEBUG] [LOCAL ] FSLY: Primary data saved (51274 records). [2025-09-23T18:55:53.516476] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-23T18:55:53.516565] [INFO ] [MAIN ] Update Progress: 875/2372 symbols completed. FSLY took 27.9s. Estimated remaining: 3h 18m 11s. Rate: 7.6 symbols/min [2025-09-23T18:55:53.694774] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:53.701492] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:55:53.731493] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T18:55:53.745015] [DEBUG] [LOCAL ] FTHY: Loaded 11687 existing records from primary storage. [2025-09-23T18:55:53.745512] [INFO ] [MAIN ] FTHY: Loaded 11687 existing records. [2025-09-23T18:55:53.809627] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-23T18:55:53.932484] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:53.932769] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-23T18:55:53.932824] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-23T18:55:53.933254] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-23T18:55:53.933317] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-23T18:55:54.313612] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:54.335459] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T18:55:54.602204] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-23T18:55:55.402202] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-23T18:55:55.551858] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T18:55:56.202219] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-23T18:55:56.625725] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T18:55:56.767781] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:55:57.002194] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-23T18:55:57.802209] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-23T18:55:58.428877] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T18:55:58.602225] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-23T18:55:59.402218] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-23T18:55:59.551961] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:55:59.982688] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T18:56:00.038001] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T18:56:00.202189] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-23T18:56:01.002203] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-23T18:56:01.651065] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:56:01.802197] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-23T18:56:02.293784] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:56:02.510821] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:56:02.602205] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-23T18:56:03.249167] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T18:56:03.402204] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-23T18:56:04.202197] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-23T18:56:05.002189] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-23T18:56:05.163022] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T18:56:05.256738] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:56:05.802196] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-23T18:56:06.098328] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T18:56:06.602197] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-23T18:56:07.286727] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T18:56:07.402206] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-23T18:56:08.101111] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T18:56:08.202192] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-23T18:56:08.325095] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:56:09.002218] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-23T18:56:09.748715] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T18:56:09.802221] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-23T18:56:10.495794] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:56:10.500988] [INFO ] [REMOTE ] FSS: Full fetch complete (48090 records). [2025-09-23T18:56:10.501137] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-23T18:56:10.608211] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-23T18:56:10.621885] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T18:56:10.911438] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-23T18:56:10.911531] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-23T18:56:10.912238] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-23T18:56:10.912306] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-23T18:56:10.913567] [DEBUG] [LOCAL ] FSS: Trimmed 48090 records to 34552 (keeping 200 days of data) [2025-09-23T18:56:11.162705] [DEBUG] [LOCAL ] FSS: Primary data saved (34552 records). [2025-09-23T18:56:11.162860] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-23T18:56:11.162951] [INFO ] [MAIN ] Update Progress: 876/2372 symbols completed. FSS took 28.8s. Estimated remaining: 3h 18m 20s. Rate: 7.5 symbols/min [2025-09-23T18:56:11.344698] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:11.397415] [DEBUG] [LOCAL ] FTI: Loaded 53303 existing records from primary storage. [2025-09-23T18:56:11.397587] [INFO ] [MAIN ] FTI: Loaded 53303 existing records. [2025-09-23T18:56:11.408895] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-23T18:56:11.582326] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:11.582602] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-23T18:56:11.582683] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-23T18:56:11.583835] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-23T18:56:11.583898] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-23T18:56:12.007616] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:12.202199] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-23T18:56:12.233783] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T18:56:12.501887] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T18:56:12.512345] [INFO ] [REMOTE ] FSM: Full fetch complete (76683 records). [2025-09-23T18:56:12.512495] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-23T18:56:12.935809] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-23T18:56:12.935901] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-23T18:56:12.936813] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-23T18:56:12.936880] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-23T18:56:12.938402] [DEBUG] [LOCAL ] FSM: Trimmed 76683 records to 53288 (keeping 200 days of data) [2025-09-23T18:56:13.026007] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-23T18:56:13.257216] [DEBUG] [LOCAL ] FSM: Primary data saved (53288 records). [2025-09-23T18:56:13.257374] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-23T18:56:13.257461] [INFO ] [MAIN ] Update Progress: 877/2372 symbols completed. FSM took 35.2s. Estimated remaining: 3h 18m 2s. Rate: 7.5 symbols/min [2025-09-23T18:56:13.648216] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T18:56:13.802174] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-23T18:56:13.952812] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T18:56:14.434273] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T18:56:14.436016] [INFO ] [REMOTE ] FT: Full fetch complete (9040 records). [2025-09-23T18:56:14.436086] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-23T18:56:14.620137] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-23T18:56:14.815332] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-23T18:56:14.815412] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-23T18:56:14.815634] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-23T18:56:14.815713] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-23T18:56:14.816150] [DEBUG] [LOCAL ] FT: Trimmed 9040 records to 6291 (keeping 200 days of data) [2025-09-23T18:56:14.853441] [DEBUG] [LOCAL ] FT: Primary data saved (6291 records). [2025-09-23T18:56:14.853573] [INFO ] [MAIN ] FT: Full history saved. [2025-09-23T18:56:14.853683] [INFO ] [MAIN ] Update Progress: 878/2372 symbols completed. FT took 30.8s. Estimated remaining: 3h 17m 43s. Rate: 7.6 symbols/min [2025-09-23T18:56:15.402200] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-23T18:56:16.146449] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T18:56:16.172805] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T18:56:16.202160] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-23T18:56:16.962695] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T18:56:17.002184] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-23T18:56:17.805244] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-23T18:56:17.806253] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T18:56:18.602200] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-23T18:56:19.039482] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T18:56:19.395364] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T18:56:19.402138] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-23T18:56:20.202270] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-23T18:56:20.354201] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:56:20.356757] [INFO ] [REMOTE ] FTHY: Full fetch complete (17649 records). [2025-09-23T18:56:20.356854] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-23T18:56:20.743784] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-23T18:56:20.743869] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-23T18:56:20.744286] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-23T18:56:20.744326] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-23T18:56:20.744959] [DEBUG] [LOCAL ] FTHY: Trimmed 17649 records to 11693 (keeping 200 days of data) [2025-09-23T18:56:20.821857] [DEBUG] [LOCAL ] FTHY: Primary data saved (11693 records). [2025-09-23T18:56:20.822047] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-23T18:56:20.822190] [INFO ] [MAIN ] Update Progress: 879/2372 symbols completed. FTHY took 27.3s. Estimated remaining: 3h 17m 32s. Rate: 7.6 symbols/min [2025-09-23T18:56:21.577554] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T18:56:21.588694] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-23T18:56:22.969740] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:56:22.981793] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-23T18:56:24.274038] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:56:24.285799] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-23T18:56:25.573825] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T18:56:25.585055] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-23T18:56:27.437775] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T18:56:27.449814] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-23T18:56:29.246266] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T18:56:29.258326] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-23T18:56:31.071395] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T18:56:31.080485] [INFO ] [REMOTE ] FTI: Full fetch complete (77127 records). [2025-09-23T18:56:31.080630] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-23T18:56:31.478759] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-23T18:56:31.478870] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-23T18:56:31.479805] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-23T18:56:31.479872] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-23T18:56:31.481413] [DEBUG] [LOCAL ] FTI: Trimmed 77127 records to 53303 (keeping 200 days of data) [2025-09-23T18:56:31.818087] [DEBUG] [LOCAL ] FTI: Primary data saved (53303 records). [2025-09-23T18:56:31.818245] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-23T18:56:31.818333] [INFO ] [MAIN ] Update Progress: 880/2372 symbols completed. FTI took 20.7s. Estimated remaining: 3h 17m 29s. Rate: 7.6 symbols/min [2025-09-23T18:56:32.474873] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:32.498021] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:32.559344] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:32.555668] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:32.563591] [DEBUG] [LOCAL ] FTWO: Loaded 1779 existing records from primary storage. [2025-09-23T18:56:32.563966] [INFO ] [MAIN ] FTWO: Loaded 1779 existing records. [2025-09-23T18:56:32.799925] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:32.816340] [DEBUG] [LOCAL ] FTK: Loaded 32110 existing records from primary storage. [2025-09-23T18:56:32.816898] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-23T18:56:32.816962] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-23T18:56:32.817070] [INFO ] [MAIN ] FTK: Loaded 32110 existing records. [2025-09-23T18:56:32.828371] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-23T18:56:32.848320] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-23T18:56:32.981992] [DEBUG] [LOCAL ] FTS: Loaded 42110 existing records from primary storage. [2025-09-23T18:56:33.050423] [INFO ] [MAIN ] FTS: Loaded 42110 existing records. [2025-09-23T18:56:33.075022] [DEBUG] [LOCAL ] FTV: Loaded 52917 existing records from primary storage. [2025-09-23T18:56:33.124800] [INFO ] [MAIN ] FTV: Loaded 52917 existing records. [2025-09-23T18:56:33.298061] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:33.380075] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-23T18:56:33.460067] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-23T18:56:33.593784] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-23T18:56:33.664430] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:33.702157] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-23T18:56:33.745998] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-23T18:56:33.723111] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:33.794759] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-23T18:56:33.783859] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-23T18:56:33.814350] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-23T18:56:33.908498] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-23T18:56:33.908756] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-23T18:56:33.927317] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-23T18:56:33.927449] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-23T18:56:33.899719] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:33.961937] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-23T18:56:34.717212] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T18:56:34.796040] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-23T18:56:34.838523] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:34.855950] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-23T18:56:34.956424] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:34.957428] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-23T18:56:35.033165] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:35.033451] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-23T18:56:35.580129] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T18:56:35.581839] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-23T18:56:35.794824] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T18:56:35.799871] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-23T18:56:35.898401] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T18:56:35.899825] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-23T18:56:36.048131] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T18:56:36.056340] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-23T18:56:36.207200] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T18:56:36.208432] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-23T18:56:36.381592] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:56:36.396466] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-23T18:56:36.550753] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:56:36.553271] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T18:56:36.559939] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-23T18:56:36.560218] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-23T18:56:36.885944] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T18:56:36.887315] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-23T18:56:37.077321] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T18:56:37.088350] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-23T18:56:37.184007] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-23T18:56:37.256870] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T18:56:37.716266] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T18:56:37.802206] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-23T18:56:38.163453] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:56:38.602200] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-23T18:56:39.051778] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T18:56:39.058370] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T18:56:39.402251] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-23T18:56:39.921381] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T18:56:40.202189] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-23T18:56:40.612804] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-23T18:56:40.613931] [INFO ] [REMOTE ] FTWO: Full fetch complete (3506 records). [2025-09-23T18:56:40.614022] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-23T18:56:40.985274] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-23T18:56:40.985382] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-23T18:56:40.985532] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-23T18:56:40.985573] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-23T18:56:40.985952] [DEBUG] [LOCAL ] FTWO: Trimmed 3506 records to 1776 (keeping 200 days of data) [2025-09-23T18:56:40.997204] [DEBUG] [LOCAL ] FTWO: Primary data saved (1776 records). [2025-09-23T18:56:40.997269] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-23T18:56:40.997362] [INFO ] [MAIN ] Update Progress: 881/2372 symbols completed. FTWO took 9.2s. Estimated remaining: 3h 17m 23s. Rate: 7.6 symbols/min [2025-09-23T18:56:41.008296] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-23T18:56:41.187963] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:41.249419] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-23T18:56:41.249598] [INFO ] [MAIN ] FUBO: Loaded 53700 existing records. [2025-09-23T18:56:41.427131] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:41.427455] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-23T18:56:41.427528] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-23T18:56:41.428962] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-23T18:56:41.429023] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-23T18:56:41.796927] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:41.802185] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-23T18:56:42.132938] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T18:56:42.602199] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-23T18:56:42.716892] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T18:56:43.402200] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-23T18:56:44.202171] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-23T18:56:44.309710] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T18:56:45.002206] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-23T18:56:45.208868] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:56:45.762686] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T18:56:45.802163] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-23T18:56:46.326243] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T18:56:46.602204] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-23T18:56:47.170933] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T18:56:47.402223] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-23T18:56:48.202276] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-23T18:56:48.691403] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:56:48.809077] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-23T18:56:49.002179] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-23T18:56:49.723448] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:56:49.802156] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-23T18:56:50.602196] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-23T18:56:50.930153] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T18:56:51.402173] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-23T18:56:51.646430] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T18:56:51.687591] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T18:56:52.202257] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-23T18:56:53.002194] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-23T18:56:53.257557] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T18:56:53.770962] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T18:56:53.802168] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-23T18:56:54.447771] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T18:56:54.602166] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-23T18:56:54.956326] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T18:56:55.402247] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-23T18:56:56.202241] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-23T18:56:56.430293] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T18:56:56.866327] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T18:56:57.002192] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-23T18:56:57.693132] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:56:57.802234] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-23T18:56:58.382085] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T18:56:58.602200] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-23T18:56:59.402207] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-23T18:56:59.746945] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T18:57:00.202163] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-23T18:57:00.313380] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T18:57:00.664414] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:57:00.671109] [INFO ] [REMOTE ] FTS: Full fetch complete (60060 records). [2025-09-23T18:57:00.671257] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-23T18:57:01.016149] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-23T18:57:01.082508] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-23T18:57:01.082603] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-23T18:57:01.083778] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-23T18:57:01.083932] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-23T18:57:01.085816] [DEBUG] [LOCAL ] FTS: Trimmed 60060 records to 42123 (keeping 200 days of data) [2025-09-23T18:57:01.361950] [DEBUG] [LOCAL ] FTS: Primary data saved (42123 records). [2025-09-23T18:57:01.362086] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-23T18:57:01.362250] [INFO ] [MAIN ] Update Progress: 882/2372 symbols completed. FTS took 29.5s. Estimated remaining: 3h 17m 36s. Rate: 7.5 symbols/min [2025-09-23T18:57:01.532880] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:01.571678] [DEBUG] [LOCAL ] FUL: Loaded 33021 existing records from primary storage. [2025-09-23T18:57:01.571815] [INFO ] [MAIN ] FUL: Loaded 33021 existing records. [2025-09-23T18:57:01.766252] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:01.766704] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-23T18:57:01.766771] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-23T18:57:01.768032] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-23T18:57:01.768121] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-23T18:57:01.816573] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-23T18:57:02.140884] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:02.602258] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-23T18:57:03.178470] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-09-23T18:57:03.205010] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-23T18:57:03.212416] [INFO ] [REMOTE ] FTK: Full fetch complete (42448 records). [2025-09-23T18:57:03.212519] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-23T18:57:03.412696] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-23T18:57:03.611878] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-23T18:57:03.611957] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-23T18:57:03.612738] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-23T18:57:03.612802] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-23T18:57:03.613861] [DEBUG] [LOCAL ] FTK: Trimmed 42448 records to 32220 (keeping 200 days of data) [2025-09-23T18:57:03.804245] [DEBUG] [LOCAL ] FTK: Primary data saved (32220 records). [2025-09-23T18:57:03.804388] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-23T18:57:03.804533] [INFO ] [MAIN ] Update Progress: 883/2372 symbols completed. FTK took 32.0s. Estimated remaining: 3h 17m 19s. Rate: 7.5 symbols/min [2025-09-23T18:57:03.977105] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:04.032099] [DEBUG] [LOCAL ] FUN: Loaded 51566 existing records from primary storage. [2025-09-23T18:57:04.032247] [INFO ] [MAIN ] FUN: Loaded 51566 existing records. [2025-09-23T18:57:04.218163] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:04.218852] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-23T18:57:04.218926] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-23T18:57:04.220475] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-23T18:57:04.220538] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-23T18:57:04.590992] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:04.591293] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-23T18:57:04.790560] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T18:57:05.002226] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-23T18:57:05.355800] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T18:57:05.395636] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (3.58 seconds). [2025-09-23T18:57:05.408635] [INFO ] [REMOTE ] FTV: Full fetch complete (76251 records). [2025-09-23T18:57:05.408825] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-23T18:57:05.804588] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-23T18:57:05.804990] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-23T18:57:05.806112] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-23T18:57:05.804748] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-23T18:57:05.806364] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-23T18:57:05.812557] [DEBUG] [LOCAL ] FTV: Trimmed 76251 records to 52917 (keeping 200 days of data) [2025-09-23T18:57:05.996065] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:57:06.234722] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:57:06.249504] [DEBUG] [LOCAL ] FTV: Primary data saved (52917 records). [2025-09-23T18:57:06.257238] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-23T18:57:06.257440] [INFO ] [MAIN ] Update Progress: 884/2372 symbols completed. FTV took 34.4s. Estimated remaining: 3h 17m 2s. Rate: 7.6 symbols/min [2025-09-23T18:57:06.439923] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:06.467736] [DEBUG] [LOCAL ] FVR: Loaded 22151 existing records from primary storage. [2025-09-23T18:57:06.467893] [INFO ] [MAIN ] FVR: Loaded 22151 existing records. [2025-09-23T18:57:06.617623] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-23T18:57:06.663302] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:06.663546] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-23T18:57:06.663595] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-23T18:57:06.664363] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-23T18:57:06.664426] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-23T18:57:07.053417] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:07.402240] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-23T18:57:07.669987] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T18:57:07.968498] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:57:08.202198] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-23T18:57:08.559685] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T18:57:09.002258] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-23T18:57:09.802424] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-23T18:57:09.827290] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T18:57:10.185121] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:57:10.602198] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-23T18:57:11.258315] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T18:57:11.402200] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-23T18:57:11.844390] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T18:57:12.202162] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-23T18:57:12.365273] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T18:57:13.002192] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-23T18:57:13.515547] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T18:57:13.802223] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-23T18:57:14.602181] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-23T18:57:15.402215] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-23T18:57:16.238470] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-23T18:57:16.249291] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-23T18:57:16.280228] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (3.28 seconds). [2025-09-23T18:57:16.339555] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T18:57:16.495229] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T18:57:17.002207] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-23T18:57:17.802223] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-23T18:57:18.048286] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T18:57:18.602235] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-23T18:57:18.977099] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T18:57:18.988450] [INFO ] [REMOTE ] FUBO: Full fetch complete (77753 records). [2025-09-23T18:57:18.988591] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-23T18:57:19.300875] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T18:57:19.407331] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-23T18:57:19.433193] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-23T18:57:19.433287] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-23T18:57:19.434199] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-23T18:57:19.434264] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-23T18:57:19.436041] [DEBUG] [LOCAL ] FUBO: Trimmed 77753 records to 53700 (keeping 200 days of data) [2025-09-23T18:57:19.752840] [DEBUG] [LOCAL ] FUBO: Primary data saved (53700 records). [2025-09-23T18:57:19.752982] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-23T18:57:19.753089] [INFO ] [MAIN ] Update Progress: 885/2372 symbols completed. FUBO took 38.8s. Estimated remaining: 3h 17m 3s. Rate: 7.5 symbols/min [2025-09-23T18:57:19.933184] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:19.966897] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T18:57:20.011757] [DEBUG] [LOCAL ] FVRR: Loaded 40203 existing records from primary storage. [2025-09-23T18:57:20.011945] [INFO ] [MAIN ] FVRR: Loaded 40203 existing records. [2025-09-23T18:57:20.195176] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:20.195452] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-23T18:57:20.195518] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-23T18:57:20.196722] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-23T18:57:20.196786] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-23T18:57:20.208015] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-23T18:57:20.567090] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:20.581872] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T18:57:21.002247] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-23T18:57:21.377227] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T18:57:21.802259] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-23T18:57:22.540184] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:57:22.599743] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T18:57:22.604504] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-23T18:57:23.402235] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-23T18:57:23.835092] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:57:24.202209] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-23T18:57:24.832859] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T18:57:25.002197] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-23T18:57:25.350949] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T18:57:25.802171] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-23T18:57:25.935119] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T18:57:26.602199] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-23T18:57:27.310823] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:57:27.402150] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-23T18:57:28.156776] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T18:57:28.202152] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-23T18:57:28.780751] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:57:28.789757] [INFO ] [REMOTE ] FUN: Full fetch complete (72373 records). [2025-09-23T18:57:28.789894] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-23T18:57:29.007372] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-23T18:57:29.197528] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-23T18:57:29.197619] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-23T18:57:29.198615] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-23T18:57:29.198703] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-23T18:57:29.200295] [DEBUG] [LOCAL ] FUN: Trimmed 72373 records to 51566 (keeping 200 days of data) [2025-09-23T18:57:29.431170] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T18:57:29.544184] [DEBUG] [LOCAL ] FUN: Primary data saved (51566 records). [2025-09-23T18:57:29.544354] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-23T18:57:29.544464] [INFO ] [MAIN ] Update Progress: 886/2372 symbols completed. FUN took 25.7s. Estimated remaining: 3h 16m 58s. Rate: 7.5 symbols/min [2025-09-23T18:57:29.726900] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:29.730077] [DEBUG] [LOCAL ] FXED: Loaded 1217 existing records from primary storage. [2025-09-23T18:57:29.730152] [INFO ] [MAIN ] FXED: Loaded 1217 existing records. [2025-09-23T18:57:29.807379] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-23T18:57:29.919545] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:29.919844] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-23T18:57:29.919895] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-23T18:57:29.920180] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-23T18:57:29.920240] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-23T18:57:30.299565] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:30.553289] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:57:30.559506] [INFO ] [REMOTE ] FUL: Full fetch complete (46780 records). [2025-09-23T18:57:30.559612] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-23T18:57:30.607304] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-23T18:57:30.939693] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-23T18:57:30.939783] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-23T18:57:30.940435] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-23T18:57:30.940475] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-23T18:57:30.941511] [DEBUG] [LOCAL ] FUL: Trimmed 46780 records to 32980 (keeping 200 days of data) [2025-09-23T18:57:31.143226] [DEBUG] [LOCAL ] FUL: Primary data saved (32980 records). [2025-09-23T18:57:31.143360] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-23T18:57:31.143444] [INFO ] [MAIN ] Update Progress: 887/2372 symbols completed. FUL took 29.8s. Estimated remaining: 3h 16m 40s. Rate: 7.6 symbols/min [2025-09-23T18:57:31.321050] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:31.347412] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:57:31.397447] [DEBUG] [LOCAL ] G: Loaded 49754 existing records from primary storage. [2025-09-23T18:57:31.397635] [INFO ] [MAIN ] G: Loaded 49754 existing records. [2025-09-23T18:57:31.409114] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-23T18:57:31.580880] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:31.581106] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-23T18:57:31.581153] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-23T18:57:31.582326] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-23T18:57:31.582387] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-23T18:57:31.837502] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T18:57:31.944920] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T18:57:31.983186] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:32.202200] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-23T18:57:33.002249] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-23T18:57:33.422706] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T18:57:33.435305] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T18:57:33.802241] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-23T18:57:34.602205] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-23T18:57:35.335008] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T18:57:35.402191] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-23T18:57:35.825138] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T18:57:36.202216] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-23T18:57:36.454378] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-23T18:57:36.641175] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:57:37.002251] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-23T18:57:37.802240] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-23T18:57:38.582500] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:57:38.602143] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-23T18:57:38.764394] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T18:57:39.402238] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-23T18:57:39.737134] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T18:57:40.202281] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-23T18:57:40.423034] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T18:57:41.002239] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-23T18:57:41.652249] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T18:57:41.802246] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-23T18:57:42.543375] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T18:57:42.579106] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T18:57:42.602164] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-23T18:57:43.402197] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-23T18:57:43.725333] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-23T18:57:44.161319] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T18:57:44.202204] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-23T18:57:45.002245] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-23T18:57:45.549740] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T18:57:45.802206] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-23T18:57:46.085800] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-23T18:57:46.132554] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T18:57:46.136141] [INFO ] [REMOTE ] FVR: Full fetch complete (30643 records). [2025-09-23T18:57:46.136227] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-23T18:57:46.509891] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-23T18:57:46.509978] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-23T18:57:46.510504] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-23T18:57:46.510544] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-23T18:57:46.512042] [DEBUG] [LOCAL ] FVR: Trimmed 30643 records to 22125 (keeping 200 days of data) [2025-09-23T18:57:46.606874] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-23T18:57:46.647547] [DEBUG] [LOCAL ] FVR: Primary data saved (22125 records). [2025-09-23T18:57:46.647706] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-23T18:57:46.647802] [INFO ] [MAIN ] Update Progress: 888/2372 symbols completed. FVR took 40.4s. Estimated remaining: 3h 16m 44s. Rate: 7.5 symbols/min [2025-09-23T18:57:46.818682] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:46.845705] [DEBUG] [LOCAL ] GAB: Loaded 27907 existing records from primary storage. [2025-09-23T18:57:46.845874] [INFO ] [MAIN ] GAB: Loaded 27907 existing records. [2025-09-23T18:57:47.033609] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:47.033895] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-23T18:57:47.033946] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-23T18:57:47.034719] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-23T18:57:47.034781] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-23T18:57:47.407322] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-23T18:57:47.445750] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:48.202159] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-23T18:57:48.317117] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T18:57:48.753539] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:57:49.002195] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-23T18:57:49.111489] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T18:57:49.802195] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-23T18:57:50.602172] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-23T18:57:50.658062] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T18:57:51.015711] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T18:57:51.119460] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:57:51.127903] [INFO ] [REMOTE ] G: Full fetch complete (71569 records). [2025-09-23T18:57:51.128057] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-23T18:57:51.407374] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-23T18:57:51.523808] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-23T18:57:51.523912] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-23T18:57:51.524911] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-23T18:57:51.525026] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-23T18:57:51.527124] [DEBUG] [LOCAL ] G: Trimmed 71569 records to 49763 (keeping 200 days of data) [2025-09-23T18:57:51.843197] [DEBUG] [LOCAL ] G: Primary data saved (49763 records). [2025-09-23T18:57:51.843357] [INFO ] [MAIN ] G: Full history saved. [2025-09-23T18:57:51.843447] [INFO ] [MAIN ] Update Progress: 889/2372 symbols completed. G took 20.7s. Estimated remaining: 3h 16m 32s. Rate: 7.5 symbols/min [2025-09-23T18:57:51.929232] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T18:57:52.027316] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:52.033873] [DEBUG] [LOCAL ] GAM: Loaded 4217 existing records from primary storage. [2025-09-23T18:57:52.034026] [INFO ] [MAIN ] GAM: Loaded 4217 existing records. [2025-09-23T18:57:52.211496] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-23T18:57:52.219084] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:52.219476] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-23T18:57:52.219535] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-23T18:57:52.219837] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-23T18:57:52.219900] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-23T18:57:52.590440] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:53.002210] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-23T18:57:53.408137] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:57:53.802247] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-23T18:57:54.220727] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T18:57:54.287096] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T18:57:54.294426] [INFO ] [REMOTE ] FVRR: Full fetch complete (58839 records). [2025-09-23T18:57:54.294531] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-23T18:57:54.607294] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-23T18:57:54.693897] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-23T18:57:54.693983] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-23T18:57:54.694757] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-23T18:57:54.694820] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-23T18:57:54.696194] [DEBUG] [LOCAL ] FVRR: Trimmed 58839 records to 40210 (keeping 200 days of data) [2025-09-23T18:57:54.922234] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T18:57:54.939159] [DEBUG] [LOCAL ] FVRR: Primary data saved (40210 records). [2025-09-23T18:57:54.939290] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-23T18:57:54.939373] [INFO ] [MAIN ] Update Progress: 890/2372 symbols completed. FVRR took 35.2s. Estimated remaining: 3h 16m 16s. Rate: 7.6 symbols/min [2025-09-23T18:57:55.131037] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:55.181983] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-23T18:57:55.182154] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-09-23T18:57:55.372855] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:55.373148] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-23T18:57:55.373197] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-23T18:57:55.374359] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-23T18:57:55.374422] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-23T18:57:55.407315] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-23T18:57:55.761989] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:55.853434] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T18:57:56.202192] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-23T18:57:57.002229] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-23T18:57:57.297572] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T18:57:57.421400] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T18:57:57.802212] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-23T18:57:58.602181] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-23T18:57:58.697514] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T18:57:59.298989] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T18:57:59.402227] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-23T18:58:00.050267] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T18:58:00.202209] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-23T18:58:00.803433] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T18:58:00.804329] [INFO ] [REMOTE ] FXED: Full fetch complete (1786 records). [2025-09-23T18:58:00.804400] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-23T18:58:01.007848] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-23T18:58:01.174775] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-23T18:58:01.174856] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-23T18:58:01.174946] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-23T18:58:01.175037] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-23T18:58:01.175404] [DEBUG] [LOCAL ] FXED: Trimmed 1786 records to 1225 (keeping 200 days of data) [2025-09-23T18:58:01.183452] [DEBUG] [LOCAL ] FXED: Primary data saved (1225 records). [2025-09-23T18:58:01.183514] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-23T18:58:01.183595] [INFO ] [MAIN ] Update Progress: 891/2372 symbols completed. FXED took 31.6s. Estimated remaining: 3h 16m 5s. Rate: 7.6 symbols/min [2025-09-23T18:58:01.358036] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:01.377537] [DEBUG] [LOCAL ] GATX: Loaded 18149 existing records from primary storage. [2025-09-23T18:58:01.377705] [INFO ] [MAIN ] GATX: Loaded 18149 existing records. [2025-09-23T18:58:01.564835] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:01.565144] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-23T18:58:01.565196] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-23T18:58:01.565818] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-23T18:58:01.565904] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-23T18:58:01.807356] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-23T18:58:01.963594] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:02.498159] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T18:58:02.595800] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T18:58:02.602358] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-23T18:58:03.402196] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-23T18:58:03.419996] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T18:58:04.202211] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-23T18:58:04.656060] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T18:58:05.002239] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-23T18:58:05.608442] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T18:58:05.802224] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-23T18:58:06.094453] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T18:58:06.602177] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-23T18:58:07.402249] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-23T18:58:07.626975] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T18:58:07.657571] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:58:08.013893] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T18:58:08.202191] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-23T18:58:08.994800] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T18:58:09.002139] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-23T18:58:09.802196] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-23T18:58:10.224013] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T18:58:10.229363] [INFO ] [REMOTE ] GAB: Full fetch complete (39478 records). [2025-09-23T18:58:10.229460] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-23T18:58:10.609149] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-23T18:58:10.625776] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-23T18:58:10.625867] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-23T18:58:10.626631] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-23T18:58:10.626712] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-23T18:58:10.627884] [DEBUG] [LOCAL ] GAB: Trimmed 39478 records to 27947 (keeping 200 days of data) [2025-09-23T18:58:10.800323] [DEBUG] [LOCAL ] GAB: Primary data saved (27947 records). [2025-09-23T18:58:10.800495] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-23T18:58:10.800597] [INFO ] [MAIN ] Update Progress: 892/2372 symbols completed. GAB took 24.2s. Estimated remaining: 3h 15m 60s. Rate: 7.6 symbols/min [2025-09-23T18:58:10.970021] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:10.984300] [DEBUG] [LOCAL ] GBAB: Loaded 13020 existing records from primary storage. [2025-09-23T18:58:10.984413] [INFO ] [MAIN ] GBAB: Loaded 13020 existing records. [2025-09-23T18:58:11.166173] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:11.166709] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-23T18:58:11.166769] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-23T18:58:11.196267] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-23T18:58:11.196363] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-23T18:58:11.276101] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T18:58:11.410116] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-23T18:58:11.402261] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T18:58:11.590978] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:12.202153] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-23T18:58:12.439073] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T18:58:13.002167] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-23T18:58:13.303005] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T18:58:13.352162] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:58:13.802215] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-23T18:58:14.252679] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T18:58:14.253837] [INFO ] [REMOTE ] GAM: Full fetch complete (6903 records). [2025-09-23T18:58:14.253913] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-23T18:58:14.639359] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-23T18:58:14.628895] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-23T18:58:14.639501] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-23T18:58:14.640684] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-23T18:58:14.640752] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-23T18:58:14.641347] [DEBUG] [LOCAL ] GAM: Trimmed 6903 records to 4195 (keeping 200 days of data) [2025-09-23T18:58:14.666179] [DEBUG] [LOCAL ] GAM: Primary data saved (4195 records). [2025-09-23T18:58:14.666269] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-23T18:58:14.666354] [INFO ] [MAIN ] Update Progress: 893/2372 symbols completed. GAM took 22.8s. Estimated remaining: 3h 15m 45s. Rate: 7.6 symbols/min [2025-09-23T18:58:14.839030] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:14.876339] [DEBUG] [LOCAL ] GBCI: Loaded 40084 existing records from primary storage. [2025-09-23T18:58:14.876484] [INFO ] [MAIN ] GBCI: Loaded 40084 existing records. [2025-09-23T18:58:15.050870] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:15.051140] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-23T18:58:15.051188] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-23T18:58:15.052319] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-23T18:58:15.052381] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-23T18:58:15.404700] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-23T18:58:15.438495] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T18:58:15.442706] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:16.202171] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-23T18:58:16.277843] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T18:58:17.002239] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-23T18:58:17.802240] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-23T18:58:17.945191] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T18:58:18.215061] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T18:58:18.480008] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T18:58:18.602174] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-23T18:58:19.402211] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-23T18:58:19.781584] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T18:58:20.202156] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-23T18:58:20.431090] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T18:58:20.898122] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T18:58:21.002241] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-23T18:58:21.802196] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-23T18:58:22.602217] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-23T18:58:22.955539] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T18:58:22.989709] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:58:23.151569] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T18:58:23.402219] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-23T18:58:24.202269] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-23T18:58:25.002167] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-23T18:58:25.082938] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T18:58:25.462921] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T18:58:25.713365] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T18:58:25.802238] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-23T18:58:26.469818] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T18:58:26.602193] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-23T18:58:27.402187] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-23T18:58:27.431345] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T18:58:28.202220] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-23T18:58:28.696763] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-23T18:58:29.002182] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-23T18:58:29.301761] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T18:58:29.621562] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T18:58:29.802204] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-23T18:58:30.602241] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-23T18:58:31.402218] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-23T18:58:31.735561] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T18:58:32.062821] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T18:58:32.110814] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T18:58:32.202241] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-23T18:58:33.002288] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-23T18:58:33.384320] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T18:58:33.388498] [INFO ] [REMOTE ] GATX: Full fetch complete (25399 records). [2025-09-23T18:58:33.388721] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-23T18:58:33.676054] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T18:58:33.801837] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-23T18:58:33.801916] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-23T18:58:33.802419] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-23T18:58:33.802495] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-23T18:58:33.802712] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-23T18:58:33.804389] [DEBUG] [LOCAL ] GATX: Trimmed 25399 records to 18146 (keeping 200 days of data) [2025-09-23T18:58:33.929271] [DEBUG] [LOCAL ] GATX: Primary data saved (18146 records). [2025-09-23T18:58:33.929418] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-23T18:58:33.929506] [INFO ] [MAIN ] Update Progress: 894/2372 symbols completed. GATX took 32.7s. Estimated remaining: 3h 15m 56s. Rate: 7.5 symbols/min [2025-09-23T18:58:34.117368] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:34.117690] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-23T18:58:34.117748] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-23T18:58:34.117913] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-23T18:58:34.117978] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-23T18:58:34.118072] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-23T18:58:34.118143] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-23T18:58:34.515940] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:34.602178] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-23T18:58:35.270109] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:58:35.273043] [INFO ] [REMOTE ] GBAB: Full fetch complete (20339 records). [2025-09-23T18:58:35.273132] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-23T18:58:35.396123] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T18:58:35.406778] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-23T18:58:35.673404] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-23T18:58:35.673512] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-23T18:58:35.674009] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-23T18:58:35.674071] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-23T18:58:35.674636] [DEBUG] [LOCAL ] GBAB: Trimmed 20339 records to 13017 (keeping 200 days of data) [2025-09-23T18:58:35.755377] [DEBUG] [LOCAL ] GBAB: Primary data saved (13017 records). [2025-09-23T18:58:35.755531] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-23T18:58:35.755623] [INFO ] [MAIN ] Update Progress: 895/2372 symbols completed. GBAB took 25.0s. Estimated remaining: 3h 15m 38s. Rate: 7.6 symbols/min [2025-09-23T18:58:35.925968] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:35.972136] [DEBUG] [LOCAL ] GBTG: Loaded 40434 existing records from primary storage. [2025-09-23T18:58:35.972308] [INFO ] [MAIN ] GBTG: Loaded 40434 existing records. [2025-09-23T18:58:36.157376] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:36.157736] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-23T18:58:36.157794] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-23T18:58:36.158850] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-23T18:58:36.158927] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-23T18:58:36.214776] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-23T18:58:36.543537] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:36.567215] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-23T18:58:36.977135] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:58:37.002160] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-23T18:58:37.339419] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T18:58:37.802193] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-23T18:58:38.602189] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-23T18:58:39.402246] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-23T18:58:39.836721] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T18:58:39.846208] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-23T18:58:39.846349] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-23T18:58:40.083371] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T18:58:40.208866] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-23T18:58:40.321997] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-23T18:58:40.318159] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:58:40.322165] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-23T18:58:40.331363] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-23T18:58:40.332053] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-23T18:58:40.333490] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-23T18:58:40.665498] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-23T18:58:40.665676] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-23T18:58:40.665791] [INFO ] [MAIN ] Update Progress: 896/2372 symbols completed. GAP took 45.7s. Estimated remaining: 3h 15m 25s. Rate: 7.6 symbols/min [2025-09-23T18:58:40.833475] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:40.862977] [DEBUG] [LOCAL ] GBX: Loaded 29314 existing records from primary storage. [2025-09-23T18:58:40.863113] [INFO ] [MAIN ] GBX: Loaded 29314 existing records. [2025-09-23T18:58:41.011083] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-23T18:58:41.042593] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:41.042874] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-23T18:58:41.042935] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-23T18:58:41.043743] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-23T18:58:41.043805] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-23T18:58:41.404892] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:41.802162] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-23T18:58:41.839585] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T18:58:42.304435] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T18:58:42.329850] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T18:58:42.602188] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-23T18:58:43.402193] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-23T18:58:43.479790] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:58:43.715726] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-23T18:58:44.202227] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-23T18:58:45.002192] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-23T18:58:45.605592] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T18:58:45.632923] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T18:58:45.802170] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-23T18:58:46.602238] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-23T18:58:47.277250] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:58:47.402189] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-23T18:58:47.713978] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T18:58:48.202217] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-23T18:58:48.979464] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T18:58:49.002160] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-23T18:58:49.326035] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T18:58:49.802201] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-23T18:58:50.201570] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T18:58:50.602186] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-23T18:58:51.297612] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T18:58:51.402208] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-23T18:58:51.553700] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T18:58:52.202209] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-23T18:58:52.457902] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T18:58:52.535241] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:58:53.002296] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-23T18:58:53.277765] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-23T18:58:53.802200] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-23T18:58:54.148302] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:58:54.602200] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-23T18:58:55.402214] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-23T18:58:55.868950] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T18:58:56.202231] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-23T18:58:56.689054] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:58:56.695863] [INFO ] [REMOTE ] GBCI: Full fetch complete (57781 records). [2025-09-23T18:58:56.696038] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-23T18:58:57.007263] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-23T18:58:57.088267] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-23T18:58:57.088355] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-23T18:58:57.089175] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-23T18:58:57.089239] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-23T18:58:57.090556] [DEBUG] [LOCAL ] GBCI: Trimmed 57781 records to 40099 (keeping 200 days of data) [2025-09-23T18:58:57.188409] [DEBUG] [REMOTE ] GBLI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-23T18:58:57.190121] [WARN ] [REMOTE ] GBLI: No data returned for month 2025-09 [2025-09-23T18:58:57.190724] [INFO ] [REMOTE ] GBLI: Full fetch complete (1316 records). [2025-09-23T18:58:57.191450] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-23T18:58:57.194183] [FATAL] [VALIDATOR ] GBLI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:58:57.195965] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:58:57.196582] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:58:57.197334] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-23T18:58:57.198102] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-23T18:58:57.198603] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-23T18:58:57.199057] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-23T18:58:57.199251] [INFO ] [MAIN ] Update Progress: 897/2372 symbols completed. GBLI took 23.3s. Estimated remaining: 3h 15m 31s. Rate: 7.5 symbols/min [2025-09-23T18:58:57.422791] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:57.532965] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:58:57.590330] [DEBUG] [LOCAL ] GCI: Loaded 44231 existing records from primary storage. [2025-09-23T18:58:57.596099] [DEBUG] [LOCAL ] GBCI: Primary data saved (40099 records). [2025-09-23T18:58:57.596174] [INFO ] [MAIN ] GCI: Loaded 44231 existing records. [2025-09-23T18:58:57.596346] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-23T18:58:57.628528] [INFO ] [MAIN ] Update Progress: 898/2372 symbols completed. GBCI took 43.0s. Estimated remaining: 3h 15m 11s. Rate: 7.6 symbols/min [2025-09-23T18:58:57.802424] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-23T18:58:57.926711] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:57.960029] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-23T18:58:57.959898] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:57.960309] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-23T18:58:57.961681] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-23T18:58:57.961743] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-23T18:58:58.159151] [DEBUG] [LOCAL ] GCO: Loaded 25807 existing records from primary storage. [2025-09-23T18:58:58.193576] [INFO ] [MAIN ] GCO: Loaded 25807 existing records. [2025-09-23T18:58:58.549043] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:58.540297] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:58.550079] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-23T18:58:58.550181] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-23T18:58:58.550977] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-23T18:58:58.551056] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-23T18:58:58.608275] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-23T18:58:58.937511] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:58.962773] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T18:58:59.402219] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-23T18:59:00.202193] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-23T18:59:00.323415] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T18:59:00.539193] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T18:59:01.002192] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-23T18:59:01.378471] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:59:01.802239] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-23T18:59:02.061429] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T18:59:02.602186] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-23T18:59:02.851162] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:59:03.402280] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-23T18:59:04.038022] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:59:04.202166] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-23T18:59:04.244604] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T18:59:05.002214] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-23T18:59:05.342697] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T18:59:05.802191] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-23T18:59:06.117550] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:59:06.124609] [INFO ] [REMOTE ] GBTG: Full fetch complete (56658 records). [2025-09-23T18:59:06.124797] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-23T18:59:06.525809] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-23T18:59:06.525886] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-23T18:59:06.526566] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-23T18:59:06.526620] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-23T18:59:06.527776] [DEBUG] [LOCAL ] GBTG: Trimmed 56658 records to 40353 (keeping 200 days of data) [2025-09-23T18:59:06.619332] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-23T18:59:06.718072] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T18:59:06.794133] [DEBUG] [LOCAL ] GBTG: Primary data saved (40353 records). [2025-09-23T18:59:06.794284] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-23T18:59:06.794485] [INFO ] [MAIN ] Update Progress: 899/2372 symbols completed. GBTG took 31.0s. Estimated remaining: 3h 15m 5s. Rate: 7.6 symbols/min [2025-09-23T18:59:06.975160] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:06.996510] [DEBUG] [LOCAL ] GCTS: Loaded 19736 existing records from primary storage. [2025-09-23T18:59:06.996677] [INFO ] [MAIN ] GCTS: Loaded 19736 existing records. [2025-09-23T18:59:07.185920] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:07.186215] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-23T18:59:07.186278] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-23T18:59:07.186792] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-23T18:59:07.186854] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-23T18:59:07.412210] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-23T18:59:07.584235] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:07.883028] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T18:59:08.202167] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-23T18:59:08.676708] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T18:59:08.908580] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T18:59:09.002156] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-23T18:59:09.802244] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-23T18:59:10.078899] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T18:59:10.495115] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T18:59:10.602166] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-23T18:59:11.402188] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-23T18:59:11.964886] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:59:12.083862] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T18:59:12.202204] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-23T18:59:13.002211] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-23T18:59:13.290052] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T18:59:13.802210] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-23T18:59:14.010025] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T18:59:14.602239] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-23T18:59:14.950138] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T18:59:15.402270] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-23T18:59:15.493218] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T18:59:16.202184] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-23T18:59:16.367354] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T18:59:17.002164] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-23T18:59:17.043076] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T18:59:17.802197] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-23T18:59:18.265245] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:59:18.269920] [INFO ] [REMOTE ] GBX: Full fetch complete (42700 records). [2025-09-23T18:59:18.270058] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-23T18:59:18.614547] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-23T18:59:18.664625] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-23T18:59:18.664815] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-23T18:59:18.665833] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-23T18:59:18.665953] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-23T18:59:18.683017] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T18:59:18.688289] [DEBUG] [LOCAL ] GBX: Trimmed 42700 records to 29268 (keeping 200 days of data) [2025-09-23T18:59:18.888248] [DEBUG] [LOCAL ] GBX: Primary data saved (29268 records). [2025-09-23T18:59:18.888400] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-23T18:59:18.888580] [INFO ] [MAIN ] Update Progress: 900/2372 symbols completed. GBX took 38.2s. Estimated remaining: 3h 15m 3s. Rate: 7.5 symbols/min [2025-09-23T18:59:19.072537] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:19.083736] [DEBUG] [LOCAL ] GCV: Loaded 7100 existing records from primary storage. [2025-09-23T18:59:19.083860] [INFO ] [MAIN ] GCV: Loaded 7100 existing records. [2025-09-23T18:59:19.271201] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:19.271440] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-23T18:59:19.271486] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-23T18:59:19.271865] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-23T18:59:19.271944] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-23T18:59:19.417213] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-23T18:59:19.638964] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:19.828365] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T18:59:20.202503] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-23T18:59:20.230188] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:59:20.861974] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T18:59:21.002232] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-23T18:59:21.622879] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T18:59:21.802231] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-23T18:59:22.592741] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T18:59:22.599141] [INFO ] [REMOTE ] GCO: Full fetch complete (36077 records). [2025-09-23T18:59:22.599244] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-23T18:59:22.610523] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-23T18:59:22.977119] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-23T18:59:22.977236] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-23T18:59:22.977836] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-23T18:59:22.977898] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-23T18:59:22.978755] [DEBUG] [LOCAL ] GCO: Trimmed 36077 records to 25688 (keeping 200 days of data) [2025-09-23T18:59:23.136147] [DEBUG] [LOCAL ] GCO: Primary data saved (25688 records). [2025-09-23T18:59:23.136282] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-23T18:59:23.136394] [INFO ] [MAIN ] Update Progress: 901/2372 symbols completed. GCO took 25.5s. Estimated remaining: 3h 14m 49s. Rate: 7.6 symbols/min [2025-09-23T18:59:23.309571] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:23.374740] [DEBUG] [LOCAL ] GD: Loaded 47324 existing records from primary storage. [2025-09-23T18:59:23.375292] [INFO ] [MAIN ] GD: Loaded 47324 existing records. [2025-09-23T18:59:23.408110] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-23T18:59:23.566395] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:23.566715] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-23T18:59:23.566780] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-23T18:59:23.568194] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-23T18:59:23.568254] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-23T18:59:23.738749] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T18:59:23.884911] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T18:59:23.962995] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:24.202192] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-23T18:59:25.002286] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-23T18:59:25.764016] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T18:59:25.802232] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-23T18:59:26.220911] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T18:59:26.602242] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-23T18:59:26.793499] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T18:59:27.185446] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T18:59:27.402237] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-23T18:59:28.202200] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-23T18:59:28.239046] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T18:59:29.002266] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-23T18:59:29.185717] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T18:59:29.686703] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T18:59:29.802213] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-23T18:59:30.606118] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-23T18:59:30.607181] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T18:59:31.402248] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-23T18:59:31.827544] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T18:59:32.202256] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-23T18:59:32.410232] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T18:59:33.002234] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-23T18:59:33.183505] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:59:33.802200] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-23T18:59:34.468682] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:59:34.602160] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-23T18:59:34.744050] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T18:59:35.402206] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-23T18:59:35.859745] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T18:59:36.202212] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-23T18:59:36.392012] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T18:59:37.002205] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-23T18:59:37.731492] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T18:59:37.802208] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-23T18:59:38.239385] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T18:59:38.243409] [INFO ] [REMOTE ] GCTS: Full fetch complete (26948 records). [2025-09-23T18:59:38.243499] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-23T18:59:38.608368] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-23T18:59:38.638181] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-23T18:59:38.638250] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-23T18:59:38.638843] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-23T18:59:38.639071] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-23T18:59:38.639860] [DEBUG] [LOCAL ] GCTS: Trimmed 26948 records to 19810 (keeping 200 days of data) [2025-09-23T18:59:38.758501] [DEBUG] [LOCAL ] GCTS: Primary data saved (19810 records). [2025-09-23T18:59:38.758661] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-23T18:59:38.758782] [INFO ] [MAIN ] Update Progress: 902/2372 symbols completed. GCTS took 32.0s. Estimated remaining: 3h 14m 54s. Rate: 7.5 symbols/min [2025-09-23T18:59:38.927915] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:38.983922] [DEBUG] [LOCAL ] GDDY: Loaded 49765 existing records from primary storage. [2025-09-23T18:59:38.984129] [INFO ] [MAIN ] GDDY: Loaded 49765 existing records. [2025-09-23T18:59:39.168984] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:39.173789] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-23T18:59:39.173962] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-23T18:59:39.176024] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-23T18:59:39.176089] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-23T18:59:39.176290] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T18:59:39.407298] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-23T18:59:39.485535] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:59:39.514372] [INFO ] [REMOTE ] GCI: Full fetch complete (63063 records). [2025-09-23T18:59:39.529933] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-23T18:59:39.586345] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:39.990848] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-23T18:59:39.990936] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-23T18:59:39.991905] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-23T18:59:39.991990] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-23T18:59:39.995142] [DEBUG] [LOCAL ] GCI: Trimmed 63063 records to 44222 (keeping 200 days of data) [2025-09-23T18:59:40.108980] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:59:40.122065] [INFO ] [REMOTE ] GCV: Full fetch complete (9238 records). [2025-09-23T18:59:40.122816] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-23T18:59:40.218390] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-23T18:59:40.556803] [DEBUG] [LOCAL ] GCI: Primary data saved (44222 records). [2025-09-23T18:59:40.568098] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-23T18:59:40.579717] [INFO ] [MAIN ] Update Progress: 903/2372 symbols completed. GCI took 43.4s. Estimated remaining: 3h 14m 36s. Rate: 7.5 symbols/min [2025-09-23T18:59:40.869962] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:40.870185] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-23T18:59:40.870289] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-23T18:59:40.870885] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-23T18:59:40.870947] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-23T18:59:40.871500] [DEBUG] [LOCAL ] GCV: Trimmed 9238 records to 7128 (keeping 200 days of data) [2025-09-23T18:59:40.909264] [DEBUG] [LOCAL ] GDIV: Loaded 3716 existing records from primary storage. [2025-09-23T18:59:40.909929] [INFO ] [MAIN ] GDIV: Loaded 3716 existing records. [2025-09-23T18:59:41.004750] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-23T18:59:41.020991] [DEBUG] [LOCAL ] GCV: Primary data saved (7128 records). [2025-09-23T18:59:41.027982] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-23T18:59:41.033307] [INFO ] [MAIN ] Update Progress: 904/2372 symbols completed. GCV took 22.1s. Estimated remaining: 3h 14m 16s. Rate: 7.6 symbols/min [2025-09-23T18:59:41.201271] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:41.212699] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-23T18:59:41.218118] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-23T18:59:41.223597] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-23T18:59:41.233926] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-23T18:59:41.377270] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:41.399541] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-23T18:59:41.402238] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-23T18:59:41.418346] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-23T18:59:41.423521] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-23T18:59:41.442092] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-23T18:59:41.447121] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-23T18:59:41.976945] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:41.988224] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-23T18:59:42.060049] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:42.087854] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T18:59:42.603529] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-23T18:59:42.603724] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:59:42.608541] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T18:59:42.928361] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-23T18:59:43.402213] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-23T18:59:43.745850] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T18:59:44.202195] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-23T18:59:44.521711] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-23T18:59:45.002226] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-23T18:59:45.802191] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-23T18:59:46.602166] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-23T18:59:46.782788] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T18:59:46.964578] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-23T18:59:47.274393] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:59:47.402204] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-23T18:59:48.202268] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-23T18:59:48.565115] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-23T18:59:48.825118] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T18:59:49.002195] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-23T18:59:49.802199] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-23T18:59:50.563935] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T18:59:50.602165] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-23T18:59:50.944495] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T18:59:50.959312] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-23T18:59:51.402207] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-23T18:59:51.779973] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T18:59:52.202198] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-23T18:59:53.002209] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-23T18:59:53.547577] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:59:53.802191] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-23T18:59:54.145091] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T18:59:54.602169] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-23T18:59:54.883636] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-23T18:59:54.924473] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T18:59:55.402201] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-23T18:59:55.719853] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T18:59:56.202206] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-23T18:59:56.739852] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T18:59:57.002195] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-23T18:59:57.351827] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T18:59:57.802204] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-23T18:59:58.214185] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T18:59:58.602191] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-23T18:59:58.925758] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T18:59:59.402246] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-23T19:00:00.202238] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-23T19:00:01.002182] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-23T19:00:01.249587] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T19:00:01.750460] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T19:00:01.802226] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-23T19:00:02.077745] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T19:00:02.079152] [INFO ] [REMOTE ] GDIV: Full fetch complete (5434 records). [2025-09-23T19:00:02.079241] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-23T19:00:02.510987] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-23T19:00:02.511113] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-23T19:00:02.511391] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-23T19:00:02.511459] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-23T19:00:02.512170] [DEBUG] [LOCAL ] GDIV: Trimmed 5434 records to 3705 (keeping 200 days of data) [2025-09-23T19:00:02.538732] [DEBUG] [LOCAL ] GDIV: Primary data saved (3705 records). [2025-09-23T19:00:02.538917] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-23T19:00:02.539032] [INFO ] [MAIN ] Update Progress: 905/2372 symbols completed. GDIV took 22.0s. Estimated remaining: 3h 14m 30s. Rate: 7.5 symbols/min [2025-09-23T19:00:02.616297] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-23T19:00:02.762032] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:02.770250] [DEBUG] [LOCAL ] GDO: Loaded 6067 existing records from primary storage. [2025-09-23T19:00:02.770409] [INFO ] [MAIN ] GDO: Loaded 6067 existing records. [2025-09-23T19:00:02.981743] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:02.982035] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-23T19:00:02.982084] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-23T19:00:02.982362] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-23T19:00:02.982423] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-23T19:00:03.358252] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:03.402196] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-23T19:00:04.202212] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-23T19:00:04.971985] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T19:00:05.002197] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-23T19:00:06.066479] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T19:00:06.067899] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-23T19:00:06.205988] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (3.59 seconds). [2025-09-23T19:00:06.216494] [INFO ] [REMOTE ] GD: Full fetch complete (70504 records). [2025-09-23T19:00:06.216696] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-23T19:00:06.604859] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T19:00:06.621526] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-23T19:00:06.664548] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-23T19:00:06.664409] [INFO ] [REMOTE ] GDL: Full fetch complete (3609 records). [2025-09-23T19:00:06.662471] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-23T19:00:06.666470] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-23T19:00:06.666573] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-23T19:00:06.695379] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-23T19:00:06.767542] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-23T19:00:06.841405] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (5.04 seconds). [2025-09-23T19:00:06.847257] [DEBUG] [LOCAL ] GD: Trimmed 70504 records to 47274 (keeping 200 days of data) [2025-09-23T19:00:07.254525] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-23T19:00:07.255303] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-23T19:00:07.259049] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-23T19:00:07.259135] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-23T19:00:07.261595] [DEBUG] [LOCAL ] GDL: Trimmed 3609 records to 2482 (keeping 200 days of data) [2025-09-23T19:00:07.283248] [DEBUG] [LOCAL ] GDL: Primary data saved (2482 records). [2025-09-23T19:00:07.285309] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-23T19:00:07.285700] [INFO ] [MAIN ] Update Progress: 906/2372 symbols completed. GDL took 26.2s. Estimated remaining: 3h 14m 17s. Rate: 7.5 symbols/min [2025-09-23T19:00:07.404232] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-23T19:00:07.421016] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T19:00:07.570069] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:07.727709] [DEBUG] [LOCAL ] GD: Primary data saved (47274 records). [2025-09-23T19:00:07.727974] [INFO ] [MAIN ] GD: Full history saved. [2025-09-23T19:00:07.728142] [INFO ] [MAIN ] Update Progress: 907/2372 symbols completed. GD took 44.6s. Estimated remaining: 3h 13m 57s. Rate: 7.6 symbols/min [2025-09-23T19:00:07.864249] [DEBUG] [LOCAL ] GDOT: Loaded 38655 existing records from primary storage. [2025-09-23T19:00:07.885769] [INFO ] [MAIN ] GDOT: Loaded 38655 existing records. [2025-09-23T19:00:08.040618] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:08.143109] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:08.143414] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-23T19:00:08.143479] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-23T19:00:08.149724] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-23T19:00:08.150926] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-23T19:00:08.151346] [DEBUG] [LOCAL ] GDV: Loaded 19856 existing records from primary storage. [2025-09-23T19:00:08.212152] [INFO ] [MAIN ] GDV: Loaded 19856 existing records. [2025-09-23T19:00:08.212023] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-23T19:00:08.671034] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:08.710347] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-23T19:00:08.735954] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:08.736033] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-23T19:00:08.737215] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-23T19:00:08.737282] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-23T19:00:08.843044] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T19:00:09.011204] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-23T19:00:09.143619] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:09.172703] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T19:00:09.802243] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-23T19:00:09.826748] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:00:10.602236] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-23T19:00:11.009617] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-23T19:00:11.037517] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T19:00:11.402203] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-23T19:00:12.202232] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-23T19:00:12.946585] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:00:13.002204] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-23T19:00:13.184995] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T19:00:13.802218] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-23T19:00:14.602273] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-23T19:00:14.622501] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T19:00:15.014844] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T19:00:15.402236] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-23T19:00:15.830487] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T19:00:16.009201] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:00:16.202242] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-23T19:00:16.901868] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T19:00:17.002220] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-23T19:00:17.802283] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-23T19:00:17.899526] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T19:00:18.560168] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T19:00:18.602339] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-23T19:00:19.130701] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T19:00:19.132563] [INFO ] [REMOTE ] GDO: Full fetch complete (9518 records). [2025-09-23T19:00:19.132696] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-23T19:00:19.409074] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-23T19:00:19.567933] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-23T19:00:19.568024] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-23T19:00:19.568294] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-23T19:00:19.568333] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-23T19:00:19.568902] [DEBUG] [LOCAL ] GDO: Trimmed 9518 records to 6025 (keeping 200 days of data) [2025-09-23T19:00:19.606674] [DEBUG] [LOCAL ] GDO: Primary data saved (6025 records). [2025-09-23T19:00:19.606844] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-23T19:00:19.606942] [INFO ] [MAIN ] Update Progress: 908/2372 symbols completed. GDO took 17.1s. Estimated remaining: 3h 13m 55s. Rate: 7.5 symbols/min [2025-09-23T19:00:19.781359] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:19.842382] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-23T19:00:19.842595] [INFO ] [MAIN ] GE: Loaded 53713 existing records. [2025-09-23T19:00:20.022557] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:20.022872] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-23T19:00:20.022929] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-23T19:00:20.024480] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-23T19:00:20.024544] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-23T19:00:20.212348] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-23T19:00:20.380289] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:21.002248] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-23T19:00:21.199065] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T19:00:21.220050] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T19:00:21.220245] [INFO ] [REMOTE ] GDDY: Full fetch complete (71233 records). [2025-09-23T19:00:21.225130] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-23T19:00:21.640432] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-23T19:00:21.640523] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-23T19:00:21.641441] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-23T19:00:21.641552] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-23T19:00:21.643064] [DEBUG] [LOCAL ] GDDY: Trimmed 71233 records to 49746 (keeping 200 days of data) [2025-09-23T19:00:21.814918] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-23T19:00:21.946534] [DEBUG] [LOCAL ] GDDY: Primary data saved (49746 records). [2025-09-23T19:00:21.946723] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-23T19:00:21.946827] [INFO ] [MAIN ] Update Progress: 909/2372 symbols completed. GDDY took 43.2s. Estimated remaining: 3h 13m 38s. Rate: 7.6 symbols/min [2025-09-23T19:00:22.120596] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:22.140452] [DEBUG] [LOCAL ] GEF: Loaded 20694 existing records from primary storage. [2025-09-23T19:00:22.140583] [INFO ] [MAIN ] GEF: Loaded 20694 existing records. [2025-09-23T19:00:22.319910] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:22.320168] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-23T19:00:22.320216] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-23T19:00:22.320911] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-23T19:00:22.320973] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-23T19:00:22.607576] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-23T19:00:22.695637] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:22.842172] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:00:22.877262] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T19:00:23.402248] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-23T19:00:23.774884] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T19:00:24.202244] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-23T19:00:25.002230] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-23T19:00:25.095542] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T19:00:25.208923] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T19:00:25.802230] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-23T19:00:26.072316] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:00:26.602201] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-23T19:00:27.314410] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T19:00:27.402161] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-23T19:00:27.483562] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T19:00:28.202265] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-23T19:00:28.889011] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T19:00:29.002193] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-23T19:00:29.802219] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-23T19:00:29.836014] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T19:00:30.423680] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:00:30.524139] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T19:00:30.602224] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-23T19:00:31.386371] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T19:00:31.402153] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-23T19:00:32.202233] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-23T19:00:32.601736] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T19:00:33.002231] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-23T19:00:33.802217] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-23T19:00:33.992506] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T19:00:34.063122] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:00:34.602197] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-23T19:00:34.708638] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T19:00:35.402178] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-23T19:00:35.449439] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T19:00:35.989456] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T19:00:36.202202] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-23T19:00:37.002217] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-23T19:00:37.638171] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T19:00:37.807356] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-23T19:00:37.817393] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:00:38.602204] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-23T19:00:39.284717] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:00:39.402207] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-23T19:00:39.917687] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:00:40.202200] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-23T19:00:40.780601] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T19:00:40.788032] [INFO ] [REMOTE ] GDOT: Full fetch complete (52534 records). [2025-09-23T19:00:40.788154] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-23T19:00:41.007293] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-23T19:00:41.200940] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T19:00:41.199983] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-23T19:00:41.201109] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-23T19:00:41.206598] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-23T19:00:41.206822] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-23T19:00:41.208199] [DEBUG] [LOCAL ] GDOT: Trimmed 52534 records to 38662 (keeping 200 days of data) [2025-09-23T19:00:41.442346] [DEBUG] [LOCAL ] GDOT: Primary data saved (38662 records). [2025-09-23T19:00:41.442512] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-23T19:00:41.442600] [INFO ] [MAIN ] Update Progress: 910/2372 symbols completed. GDOT took 34.2s. Estimated remaining: 3h 13m 49s. Rate: 7.5 symbols/min [2025-09-23T19:00:41.611540] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:41.646298] [DEBUG] [LOCAL ] GEL: Loaded 34191 existing records from primary storage. [2025-09-23T19:00:41.646437] [INFO ] [MAIN ] GEL: Loaded 34191 existing records. [2025-09-23T19:00:41.807862] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-23T19:00:41.833547] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:41.834081] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-23T19:00:41.834177] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-23T19:00:41.875197] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T19:00:41.879058] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-23T19:00:41.879553] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-23T19:00:42.250668] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:42.602194] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-23T19:00:42.681423] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T19:00:42.686599] [INFO ] [REMOTE ] GEF: Full fetch complete (29480 records). [2025-09-23T19:00:42.686828] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-23T19:00:43.078829] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-23T19:00:43.078912] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-23T19:00:43.079419] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-23T19:00:43.079459] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-23T19:00:43.080192] [DEBUG] [LOCAL ] GEF: Trimmed 29480 records to 20743 (keeping 200 days of data) [2025-09-23T19:00:43.208879] [DEBUG] [LOCAL ] GEF: Primary data saved (20743 records). [2025-09-23T19:00:43.209008] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-23T19:00:43.209101] [INFO ] [MAIN ] Update Progress: 911/2372 symbols completed. GEF took 21.3s. Estimated remaining: 3h 13m 31s. Rate: 7.5 symbols/min [2025-09-23T19:00:43.382493] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:43.414716] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-23T19:00:43.437497] [DEBUG] [LOCAL ] GENI: Loaded 52914 existing records from primary storage. [2025-09-23T19:00:43.437686] [INFO ] [MAIN ] GENI: Loaded 52914 existing records. [2025-09-23T19:00:43.616260] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:43.616475] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-23T19:00:43.616527] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-23T19:00:43.617541] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-23T19:00:43.617602] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-23T19:00:44.008177] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:00:44.013317] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:44.207280] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-23T19:00:44.217336] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:00:45.002209] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-23T19:00:45.802209] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-23T19:00:45.949783] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T19:00:46.602163] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-23T19:00:46.763087] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T19:00:46.810431] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T19:00:47.402247] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-23T19:00:47.461287] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T19:00:48.169212] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T19:00:48.172509] [INFO ] [REMOTE ] GDV: Full fetch complete (28825 records). [2025-09-23T19:00:48.172590] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-23T19:00:48.207274] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-23T19:00:48.552018] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-23T19:00:48.552147] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-23T19:00:48.552675] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-23T19:00:48.552737] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-23T19:00:48.553412] [DEBUG] [LOCAL ] GDV: Trimmed 28825 records to 19729 (keeping 200 days of data) [2025-09-23T19:00:48.671892] [DEBUG] [LOCAL ] GDV: Primary data saved (19729 records). [2025-09-23T19:00:48.672032] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-23T19:00:48.672118] [INFO ] [MAIN ] Update Progress: 912/2372 symbols completed. GDV took 40.9s. Estimated remaining: 3h 13m 19s. Rate: 7.6 symbols/min [2025-09-23T19:00:48.838454] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:48.891576] [DEBUG] [LOCAL ] GEO: Loaded 52179 existing records from primary storage. [2025-09-23T19:00:48.891749] [INFO ] [MAIN ] GEO: Loaded 52179 existing records. [2025-09-23T19:00:49.007338] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-23T19:00:49.068939] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:49.069218] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-23T19:00:49.069264] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-23T19:00:49.070343] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-23T19:00:49.070404] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-23T19:00:49.420468] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:49.802189] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-23T19:00:49.922953] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T19:00:50.602206] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-23T19:00:50.808036] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T19:00:51.402180] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-23T19:00:51.445221] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-23T19:00:52.037404] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T19:00:52.202246] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-23T19:00:52.496259] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:00:53.002200] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-23T19:00:53.802173] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-23T19:00:53.870011] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T19:00:54.026993] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T19:00:54.602199] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-23T19:00:55.402198] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-23T19:00:55.568621] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:00:55.944182] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T19:00:56.202213] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-23T19:00:56.555252] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T19:00:57.002213] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-23T19:00:57.802193] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-23T19:00:58.125704] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T19:00:58.549587] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:00:58.602198] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-23T19:00:59.402197] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-23T19:00:59.547138] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T19:01:00.202234] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-23T19:01:00.208733] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T19:01:01.002217] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-23T19:01:01.319085] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T19:01:01.802316] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-23T19:01:02.384385] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-23T19:01:02.453502] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:01:02.602210] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-23T19:01:03.402201] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-23T19:01:03.739328] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T19:01:03.749712] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-23T19:01:03.749899] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-23T19:01:04.176175] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-23T19:01:04.176369] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-23T19:01:04.177958] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-23T19:01:04.178048] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-23T19:01:04.179844] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 53713 (keeping 200 days of data) [2025-09-23T19:01:04.237696] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-23T19:01:04.326604] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T19:01:04.601169] [DEBUG] [LOCAL ] GE: Primary data saved (53713 records). [2025-09-23T19:01:04.601322] [INFO ] [MAIN ] GE: Full history saved. [2025-09-23T19:01:04.601409] [INFO ] [MAIN ] Update Progress: 913/2372 symbols completed. GE took 45.0s. Estimated remaining: 3h 13m 24s. Rate: 7.5 symbols/min [2025-09-23T19:01:04.770758] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:04.812947] [DEBUG] [LOCAL ] GES: Loaded 40196 existing records from primary storage. [2025-09-23T19:01:04.813171] [INFO ] [MAIN ] GES: Loaded 40196 existing records. [2025-09-23T19:01:05.006155] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-23T19:01:05.006075] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:05.007535] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-23T19:01:05.007603] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-23T19:01:05.008623] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-23T19:01:05.008719] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-23T19:01:05.230212] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T19:01:05.434209] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:05.496815] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:01:05.802211] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-23T19:01:06.461280] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:01:06.602197] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-23T19:01:07.186341] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T19:01:07.402203] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-23T19:01:08.063468] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T19:01:08.202182] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-23T19:01:08.600520] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T19:01:09.002218] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-23T19:01:09.043846] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T19:01:09.048570] [INFO ] [REMOTE ] GEL: Full fetch complete (48685 records). [2025-09-23T19:01:09.048729] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-23T19:01:09.446075] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-23T19:01:09.446202] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-23T19:01:09.448162] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-23T19:01:09.448227] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-23T19:01:09.450237] [DEBUG] [LOCAL ] GEL: Trimmed 48685 records to 34033 (keeping 200 days of data) [2025-09-23T19:01:09.663556] [DEBUG] [LOCAL ] GEL: Primary data saved (34033 records). [2025-09-23T19:01:09.663737] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-23T19:01:09.663860] [INFO ] [MAIN ] Update Progress: 914/2372 symbols completed. GEL took 28.2s. Estimated remaining: 3h 13m 11s. Rate: 7.5 symbols/min [2025-09-23T19:01:09.809537] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-23T19:01:09.835237] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:09.881511] [DEBUG] [LOCAL ] GETY: Loaded 36102 existing records from primary storage. [2025-09-23T19:01:09.881747] [INFO ] [MAIN ] GETY: Loaded 36102 existing records. [2025-09-23T19:01:10.090317] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:10.090730] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-23T19:01:10.090810] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-23T19:01:10.091619] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-23T19:01:10.091723] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-23T19:01:10.498920] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:10.602221] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-23T19:01:10.665715] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:01:11.356444] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:01:11.402146] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-23T19:01:12.185967] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:01:12.202133] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-23T19:01:12.729440] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T19:01:13.002218] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-23T19:01:13.561081] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T19:01:13.802187] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-23T19:01:14.320122] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T19:01:14.602241] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-23T19:01:15.339561] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T19:01:15.402208] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-23T19:01:16.042975] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:01:16.202228] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-23T19:01:16.486396] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T19:01:17.002198] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-23T19:01:17.802166] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-23T19:01:17.959579] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T19:01:17.970541] [INFO ] [REMOTE ] GENI: Full fetch complete (75438 records). [2025-09-23T19:01:17.970777] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-23T19:01:18.405579] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-23T19:01:18.405740] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-23T19:01:18.406826] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-23T19:01:18.407229] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-23T19:01:18.410555] [DEBUG] [LOCAL ] GENI: Trimmed 75438 records to 52913 (keeping 200 days of data) [2025-09-23T19:01:18.573634] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T19:01:18.602190] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-23T19:01:18.798293] [DEBUG] [LOCAL ] GENI: Primary data saved (52913 records). [2025-09-23T19:01:18.798461] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-23T19:01:18.798632] [INFO ] [MAIN ] Update Progress: 915/2372 symbols completed. GENI took 35.6s. Estimated remaining: 3h 13m 5s. Rate: 7.5 symbols/min [2025-09-23T19:01:18.973364] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:19.032492] [DEBUG] [LOCAL ] GEV: Loaded 53150 existing records from primary storage. [2025-09-23T19:01:19.032683] [INFO ] [MAIN ] GEV: Loaded 53150 existing records. [2025-09-23T19:01:19.216093] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:19.216477] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-23T19:01:19.216556] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-23T19:01:19.217991] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-23T19:01:19.218073] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-23T19:01:19.411432] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-23T19:01:19.604231] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:19.809956] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T19:01:19.847420] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-23T19:01:20.202204] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-23T19:01:20.866703] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:01:20.880415] [INFO ] [REMOTE ] GEO: Full fetch complete (75607 records). [2025-09-23T19:01:20.880670] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-23T19:01:21.007330] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-23T19:01:21.288021] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-23T19:01:21.288156] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-23T19:01:21.289160] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-23T19:01:21.289249] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-23T19:01:21.291673] [DEBUG] [LOCAL ] GEO: Trimmed 75607 records to 52152 (keeping 200 days of data) [2025-09-23T19:01:21.620801] [DEBUG] [LOCAL ] GEO: Primary data saved (52152 records). [2025-09-23T19:01:21.620996] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-23T19:01:21.621145] [INFO ] [MAIN ] Update Progress: 916/2372 symbols completed. GEO took 32.9s. Estimated remaining: 3h 12m 49s. Rate: 7.6 symbols/min [2025-09-23T19:01:21.810927] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-23T19:01:21.851412] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:21.847240] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T19:01:21.865576] [DEBUG] [LOCAL ] GF: Loaded 3368 existing records from primary storage. [2025-09-23T19:01:21.865722] [INFO ] [MAIN ] GF: Loaded 3368 existing records. [2025-09-23T19:01:22.042151] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:22.042444] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-23T19:01:22.042533] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-23T19:01:22.042850] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-23T19:01:22.042922] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-23T19:01:22.403718] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:22.561611] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:01:22.602200] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-23T19:01:23.402245] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-23T19:01:23.927069] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-23T19:01:24.025667] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-23T19:01:24.061870] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:01:24.202198] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-23T19:01:24.613205] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T19:01:25.002221] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-23T19:01:25.802262] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-23T19:01:26.602250] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-23T19:01:26.931017] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:01:27.045623] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T19:01:27.402220] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-23T19:01:27.851552] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T19:01:28.202261] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-23T19:01:28.574812] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T19:01:29.002253] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-23T19:01:29.322924] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-23T19:01:29.782598] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T19:01:29.802162] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-23T19:01:30.602236] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-23T19:01:31.402242] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-23T19:01:31.682331] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T19:01:31.688732] [INFO ] [REMOTE ] GES: Full fetch complete (60092 records). [2025-09-23T19:01:31.688905] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-23T19:01:32.174346] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-23T19:01:32.174506] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-23T19:01:32.175327] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-23T19:01:32.175462] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-23T19:01:32.177080] [DEBUG] [LOCAL ] GES: Trimmed 60092 records to 40095 (keeping 200 days of data) [2025-09-23T19:01:32.204831] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-23T19:01:32.276714] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-23T19:01:32.480122] [DEBUG] [LOCAL ] GES: Primary data saved (40095 records). [2025-09-23T19:01:32.480470] [INFO ] [MAIN ] GES: Full history saved. [2025-09-23T19:01:32.480635] [INFO ] [MAIN ] Update Progress: 917/2372 symbols completed. GES took 27.9s. Estimated remaining: 3h 12m 46s. Rate: 7.5 symbols/min [2025-09-23T19:01:32.525735] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T19:01:32.653333] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T19:01:33.002249] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-23T19:01:33.802267] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-23T19:01:34.389178] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T19:01:34.602215] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-23T19:01:35.109737] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T19:01:35.156215] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T19:01:35.402262] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-23T19:01:36.202197] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-23T19:01:36.484779] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T19:01:36.515522] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T19:01:37.002200] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-23T19:01:37.802199] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-23T19:01:38.199533] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T19:01:38.602217] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-23T19:01:39.402209] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-23T19:01:39.446074] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-23T19:01:39.698787] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T19:01:39.772554] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-23T19:01:39.773468] [INFO ] [REMOTE ] GF: Full fetch complete (5392 records). [2025-09-23T19:01:39.773539] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-23T19:01:40.165256] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-23T19:01:40.165353] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-23T19:01:40.165522] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-23T19:01:40.165561] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-23T19:01:40.165977] [DEBUG] [LOCAL ] GF: Trimmed 5392 records to 3269 (keeping 200 days of data) [2025-09-23T19:01:40.185750] [DEBUG] [LOCAL ] GF: Primary data saved (3269 records). [2025-09-23T19:01:40.185835] [INFO ] [MAIN ] GF: Full history saved. [2025-09-23T19:01:40.185924] [INFO ] [MAIN ] Update Progress: 918/2372 symbols completed. GF took 18.6s. Estimated remaining: 3h 12m 38s. Rate: 7.5 symbols/min [2025-09-23T19:01:40.202156] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-23T19:01:41.002229] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-23T19:01:42.047583] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T19:01:42.058417] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-23T19:01:42.451700] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-23T19:01:42.602188] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-23T19:01:43.103322] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:01:43.402230] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-23T19:01:45.088108] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-23T19:01:45.100697] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-23T19:01:45.118922] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:01:45.125507] [INFO ] [REMOTE ] GETY: Full fetch complete (55891 records). [2025-09-23T19:01:45.125621] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-23T19:01:45.542419] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-23T19:01:45.542785] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-23T19:01:45.543691] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-23T19:01:45.543756] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-23T19:01:45.545023] [DEBUG] [LOCAL ] GETY: Trimmed 55891 records to 36040 (keeping 200 days of data) [2025-09-23T19:01:45.765212] [DEBUG] [LOCAL ] GETY: Primary data saved (36040 records). [2025-09-23T19:01:45.765369] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-23T19:01:45.765488] [INFO ] [MAIN ] Update Progress: 919/2372 symbols completed. GETY took 36.1s. Estimated remaining: 3h 12m 26s. Rate: 7.6 symbols/min [2025-09-23T19:01:47.538475] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-23T19:01:47.549957] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-23T19:01:50.001120] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-23T19:01:50.009939] [INFO ] [REMOTE ] GEV: Full fetch complete (77004 records). [2025-09-23T19:01:50.010085] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-23T19:01:50.409713] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-23T19:01:50.409818] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-23T19:01:50.410804] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-23T19:01:50.410873] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-23T19:01:50.412483] [DEBUG] [LOCAL ] GEV: Trimmed 77004 records to 53146 (keeping 200 days of data) [2025-09-23T19:01:50.762986] [DEBUG] [LOCAL ] GEV: Primary data saved (53146 records). [2025-09-23T19:01:50.763134] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-23T19:01:50.763231] [INFO ] [MAIN ] Update Progress: 920/2372 symbols completed. GEV took 32.0s. Estimated remaining: 3h 12m 13s. Rate: 7.6 symbols/min [2025-09-23T19:01:51.291269] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:51.522818] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:51.527085] [DEBUG] [LOCAL ] GFR: Loaded 8382 existing records from primary storage. [2025-09-23T19:01:51.549462] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:51.550843] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:51.551111] [INFO ] [MAIN ] GFR: Loaded 8382 existing records. [2025-09-23T19:01:51.783855] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:51.795348] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-23T19:01:51.795413] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-23T19:01:51.795853] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-23T19:01:51.795918] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-23T19:01:51.794868] [DEBUG] [LOCAL ] GFF: Loaded 30950 existing records from primary storage. [2025-09-23T19:01:51.855765] [INFO ] [MAIN ] GFF: Loaded 30950 existing records. [2025-09-23T19:01:52.004928] [DEBUG] [LOCAL ] GFL: Loaded 48052 existing records from primary storage. [2025-09-23T19:01:52.030541] [INFO ] [MAIN ] GFL: Loaded 48052 existing records. [2025-09-23T19:01:52.121114] [DEBUG] [LOCAL ] GFI: Loaded 53104 existing records from primary storage. [2025-09-23T19:01:52.146818] [INFO ] [MAIN ] GFI: Loaded 53104 existing records. [2025-09-23T19:01:52.486339] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:52.580943] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-23T19:01:52.610733] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-23T19:01:52.695711] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:52.743344] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:52.754064] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-23T19:01:52.776441] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-23T19:01:52.695802] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-23T19:01:52.776576] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-23T19:01:52.787639] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-23T19:01:52.799968] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-23T19:01:52.820787] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:52.816829] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-23T19:01:52.799919] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-23T19:01:52.832184] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-23T19:01:52.831926] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-23T19:01:52.923063] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-23T19:01:53.947235] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:53.950785] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:53.947745] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T19:01:53.968856] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-23T19:01:53.979442] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-23T19:01:53.982362] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-23T19:01:53.987268] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:53.988344] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-23T19:01:54.456679] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T19:01:54.459120] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-23T19:01:54.905011] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:01:54.907989] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-23T19:01:55.337985] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T19:01:55.344801] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-23T19:01:55.421286] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T19:01:55.424836] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-23T19:01:55.518205] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T19:01:55.527059] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-23T19:01:55.655596] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T19:01:55.666433] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-23T19:01:55.991472] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T19:01:55.994876] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-23T19:01:56.390250] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T19:01:56.396977] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-23T19:01:56.571660] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T19:01:56.574513] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-23T19:01:56.748085] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T19:01:57.002208] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-23T19:01:57.155806] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:01:57.249970] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T19:01:57.339204] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T19:01:57.802190] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-23T19:01:58.379851] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:01:58.602215] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-23T19:01:58.719926] [DEBUG] [REMOTE ] GFR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-23T19:01:58.720228] [WARN ] [REMOTE ] GFR: No data returned for month 2025-07 [2025-09-23T19:01:58.755152] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T19:01:59.402208] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-23T19:02:00.202195] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-23T19:02:01.002195] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-23T19:02:01.100387] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T19:02:01.442498] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T19:02:01.802230] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-23T19:02:02.474262] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T19:02:02.602199] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-23T19:02:02.812914] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T19:02:03.402195] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-23T19:02:03.667286] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:02:03.891912] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T19:02:03.893686] [INFO ] [REMOTE ] GFR: Full fetch complete (12100 records). [2025-09-23T19:02:03.893761] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-23T19:02:04.076544] [WARN ] [VALIDATOR ] GFR: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-23T19:02:04.076825] [FATAL] [MAIN ] GFR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:02:04.076894] [WARN ] [MAIN ] GFR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:02:04.076965] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-23T19:02:04.077030] [DEBUG] [LOCAL ] GFR: No primary data file found to delete. [2025-09-23T19:02:04.077104] [INFO ] [LOCAL ] GFR: Starting deletion of derivative data. [2025-09-23T19:02:04.077570] [DEBUG] [LOCAL ] GFR: Deleted derivative data file. [2025-09-23T19:02:04.077702] [INFO ] [MAIN ] Update Progress: 921/2372 symbols completed. GFR took 13.3s. Estimated remaining: 3h 12m 14s. Rate: 7.5 symbols/min [2025-09-23T19:02:04.216133] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-23T19:02:04.253059] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:04.310690] [DEBUG] [LOCAL ] GGB: Loaded 51011 existing records from primary storage. [2025-09-23T19:02:04.310854] [INFO ] [MAIN ] GGB: Loaded 51011 existing records. [2025-09-23T19:02:04.491960] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:04.492269] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-23T19:02:04.492352] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-23T19:02:04.493535] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-23T19:02:04.493601] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-23T19:02:04.856702] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:05.002194] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-23T19:02:05.802193] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-23T19:02:06.049260] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T19:02:06.349796] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T19:02:06.602197] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-23T19:02:07.402226] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-23T19:02:07.446312] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T19:02:08.202224] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-23T19:02:08.250595] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T19:02:09.002212] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-23T19:02:09.127856] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T19:02:09.175135] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T19:02:09.802218] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-23T19:02:10.203912] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T19:02:10.602222] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-23T19:02:11.402184] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-23T19:02:11.510857] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:02:11.537148] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T19:02:12.202260] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-23T19:02:13.002223] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-23T19:02:13.304286] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T19:02:13.459034] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:02:13.802245] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-23T19:02:14.101371] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:02:14.602261] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-23T19:02:15.402163] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-23T19:02:15.535099] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T19:02:15.541738] [INFO ] [REMOTE ] GFF: Full fetch complete (44243 records). [2025-09-23T19:02:15.541831] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-23T19:02:15.733283] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T19:02:15.972320] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-23T19:02:15.972418] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-23T19:02:15.973074] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-23T19:02:15.973136] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-23T19:02:15.974103] [DEBUG] [LOCAL ] GFF: Trimmed 44243 records to 30900 (keeping 200 days of data) [2025-09-23T19:02:16.170428] [DEBUG] [LOCAL ] GFF: Primary data saved (30900 records). [2025-09-23T19:02:16.170579] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-23T19:02:16.170697] [INFO ] [MAIN ] Update Progress: 922/2372 symbols completed. GFF took 25.4s. Estimated remaining: 3h 12m 12s. Rate: 7.5 symbols/min [2025-09-23T19:02:16.202822] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-23T19:02:16.351628] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:16.391192] [DEBUG] [LOCAL ] GGG: Loaded 41029 existing records from primary storage. [2025-09-23T19:02:16.391330] [INFO ] [MAIN ] GGG: Loaded 41029 existing records. [2025-09-23T19:02:16.580355] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:16.580619] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-23T19:02:16.580700] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-23T19:02:16.581573] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-23T19:02:16.581635] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-23T19:02:16.983600] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:17.003150] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T19:02:17.003227] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-23T19:02:17.802212] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-23T19:02:18.138475] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T19:02:18.245382] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T19:02:18.602263] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-23T19:02:19.402361] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-23T19:02:19.447838] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T19:02:19.863907] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T19:02:20.202191] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-23T19:02:21.002289] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-23T19:02:21.266708] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T19:02:21.282154] [INFO ] [REMOTE ] GFL: Full fetch complete (68702 records). [2025-09-23T19:02:21.282417] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-23T19:02:21.803534] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-23T19:02:21.879254] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-23T19:02:21.879669] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-23T19:02:21.880824] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-23T19:02:21.880983] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-23T19:02:21.916245] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T19:02:21.914411] [DEBUG] [LOCAL ] GFL: Trimmed 68702 records to 48045 (keeping 200 days of data) [2025-09-23T19:02:22.207706] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:02:22.321727] [DEBUG] [LOCAL ] GFL: Primary data saved (48045 records). [2025-09-23T19:02:22.321898] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-23T19:02:22.322022] [INFO ] [MAIN ] Update Progress: 923/2372 symbols completed. GFL took 31.6s. Estimated remaining: 3h 12m 2s. Rate: 7.5 symbols/min [2025-09-23T19:02:22.505853] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:22.521976] [DEBUG] [LOCAL ] GGT: Loaded 14114 existing records from primary storage. [2025-09-23T19:02:22.522158] [INFO ] [MAIN ] GGT: Loaded 14114 existing records. [2025-09-23T19:02:22.607372] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-23T19:02:22.720904] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:22.721151] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-23T19:02:22.721199] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-23T19:02:22.721701] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-23T19:02:22.721763] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-23T19:02:23.076722] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:23.402217] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-23T19:02:23.754230] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T19:02:24.061407] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:02:24.152954] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:02:24.202253] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-23T19:02:25.002225] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-23T19:02:25.108359] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:02:25.802203] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-23T19:02:26.571834] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:02:26.602201] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-23T19:02:26.852849] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T19:02:27.402238] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-23T19:02:27.936176] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T19:02:27.957146] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T19:02:28.202233] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-23T19:02:29.002209] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-23T19:02:29.721447] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T19:02:29.802256] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-23T19:02:30.602221] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-23T19:02:30.620937] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T19:02:30.976500] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T19:02:30.985864] [INFO ] [REMOTE ] GFI: Full fetch complete (76286 records). [2025-09-23T19:02:30.986033] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-23T19:02:31.398243] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-23T19:02:31.398363] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-23T19:02:31.399406] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-23T19:02:31.399476] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-23T19:02:31.402215] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-23T19:02:31.402848] [DEBUG] [LOCAL ] GFI: Trimmed 76286 records to 53106 (keeping 200 days of data) [2025-09-23T19:02:31.744089] [DEBUG] [LOCAL ] GFI: Primary data saved (53106 records). [2025-09-23T19:02:31.744241] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-23T19:02:31.744330] [INFO ] [MAIN ] Update Progress: 924/2372 symbols completed. GFI took 41.0s. Estimated remaining: 3h 11m 56s. Rate: 7.5 symbols/min [2025-09-23T19:02:31.920250] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:31.954841] [DEBUG] [LOCAL ] GGZ: Loaded 2460 existing records from primary storage. [2025-09-23T19:02:31.955086] [INFO ] [MAIN ] GGZ: Loaded 2460 existing records. [2025-09-23T19:02:32.004685] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:02:32.163205] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:32.163511] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-23T19:02:32.163566] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-23T19:02:32.163879] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-23T19:02:32.163940] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-23T19:02:32.207301] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-23T19:02:32.525682] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:32.952485] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T19:02:32.980284] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:02:33.002220] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-23T19:02:33.607475] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T19:02:33.802216] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-23T19:02:34.602284] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-23T19:02:35.260743] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:02:35.402199] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-23T19:02:36.202168] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-23T19:02:36.363521] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T19:02:36.592299] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-23T19:02:36.627886] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:02:37.002208] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-23T19:02:37.802224] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-23T19:02:38.129579] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:02:38.602241] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-23T19:02:39.304914] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:02:39.402241] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-23T19:02:39.804267] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:02:39.814172] [INFO ] [REMOTE ] GGG: Full fetch complete (59255 records). [2025-09-23T19:02:39.814408] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-23T19:02:40.043934] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T19:02:40.215314] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-23T19:02:40.280566] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-23T19:02:40.280689] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-23T19:02:40.281590] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-23T19:02:40.281688] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-23T19:02:40.283194] [DEBUG] [LOCAL ] GGG: Trimmed 59255 records to 40996 (keeping 200 days of data) [2025-09-23T19:02:40.548945] [DEBUG] [LOCAL ] GGG: Primary data saved (40996 records). [2025-09-23T19:02:40.549079] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-23T19:02:40.549161] [INFO ] [MAIN ] Update Progress: 925/2372 symbols completed. GGG took 24.4s. Estimated remaining: 3h 11m 49s. Rate: 7.5 symbols/min [2025-09-23T19:02:40.740140] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T19:02:40.744375] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:40.751339] [DEBUG] [LOCAL ] GHC: Loaded 2629 existing records from primary storage. [2025-09-23T19:02:40.751428] [INFO ] [MAIN ] GHC: Loaded 2629 existing records. [2025-09-23T19:02:40.948915] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:40.949192] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-23T19:02:40.949241] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-23T19:02:40.949498] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-23T19:02:40.949559] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-23T19:02:41.007493] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-23T19:02:41.339696] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:41.616460] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T19:02:41.802228] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-23T19:02:42.226478] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T19:02:42.602245] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-23T19:02:43.402198] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-23T19:02:43.456148] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T19:02:43.720288] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T19:02:44.202217] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-23T19:02:45.002246] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-23T19:02:45.344032] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T19:02:45.702953] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:02:45.711601] [INFO ] [REMOTE ] GGB: Full fetch complete (73992 records). [2025-09-23T19:02:45.711776] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-23T19:02:45.810796] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-23T19:02:46.117942] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-23T19:02:46.118045] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-23T19:02:46.119069] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-23T19:02:46.119140] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-23T19:02:46.120830] [DEBUG] [LOCAL ] GGB: Trimmed 73992 records to 51019 (keeping 200 days of data) [2025-09-23T19:02:46.402977] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T19:02:46.441354] [DEBUG] [LOCAL ] GGB: Primary data saved (51019 records). [2025-09-23T19:02:46.441513] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-23T19:02:46.441827] [INFO ] [MAIN ] Update Progress: 926/2372 symbols completed. GGB took 42.4s. Estimated remaining: 3h 11m 38s. Rate: 7.5 symbols/min [2025-09-23T19:02:46.610405] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-23T19:02:46.635855] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:46.641761] [DEBUG] [LOCAL ] GHG: Loaded 3157 existing records from primary storage. [2025-09-23T19:02:46.641864] [INFO ] [MAIN ] GHG: Loaded 3157 existing records. [2025-09-23T19:02:46.832291] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:46.832795] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-23T19:02:46.832856] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-23T19:02:46.833095] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-23T19:02:46.833156] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-23T19:02:47.155911] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T19:02:47.248847] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:47.402202] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-23T19:02:48.163563] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T19:02:48.166833] [INFO ] [REMOTE ] GGT: Full fetch complete (18714 records). [2025-09-23T19:02:48.166910] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-23T19:02:48.207266] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-23T19:02:48.584039] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-23T19:02:48.584309] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-23T19:02:48.585107] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-23T19:02:48.585174] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-23T19:02:48.585847] [DEBUG] [LOCAL ] GGT: Trimmed 18714 records to 14153 (keeping 200 days of data) [2025-09-23T19:02:48.675450] [DEBUG] [LOCAL ] GGT: Primary data saved (14153 records). [2025-09-23T19:02:48.675632] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-23T19:02:48.675786] [INFO ] [MAIN ] Update Progress: 927/2372 symbols completed. GGT took 26.4s. Estimated remaining: 3h 11m 21s. Rate: 7.6 symbols/min [2025-09-23T19:02:48.782133] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T19:02:48.853489] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:48.862143] [DEBUG] [LOCAL ] GHI: Loaded 6952 existing records from primary storage. [2025-09-23T19:02:48.862357] [INFO ] [MAIN ] GHI: Loaded 6952 existing records. [2025-09-23T19:02:49.009616] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-23T19:02:49.040803] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:49.041043] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-23T19:02:49.041093] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-23T19:02:49.041484] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-23T19:02:49.041544] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-23T19:02:49.426896] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:49.431494] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T19:02:49.802194] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-23T19:02:50.126339] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T19:02:50.602191] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-23T19:02:51.059077] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T19:02:51.402202] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-23T19:02:52.202190] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-23T19:02:52.341709] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T19:02:52.590004] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T19:02:53.002247] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-23T19:02:53.575037] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T19:02:53.802200] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-23T19:02:54.371343] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T19:02:54.602205] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-23T19:02:55.247685] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T19:02:55.402193] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-23T19:02:55.818166] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T19:02:56.202243] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-23T19:02:56.514931] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-23T19:02:57.002196] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-23T19:02:57.380303] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T19:02:57.802215] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-23T19:02:58.116677] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T19:02:58.602207] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-23T19:02:59.078143] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T19:02:59.402196] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-23T19:02:59.514777] [DEBUG] [REMOTE ] GHG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-23T19:02:59.515068] [WARN ] [REMOTE ] GHG: No data returned for month 2025-07 [2025-09-23T19:03:00.202195] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-23T19:03:00.704464] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T19:03:01.002196] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-23T19:03:01.802180] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-23T19:03:01.878895] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T19:03:01.880197] [INFO ] [REMOTE ] GHG: Full fetch complete (3452 records). [2025-09-23T19:03:01.880268] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-23T19:03:02.071860] [WARN ] [VALIDATOR ] GHG: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-23T19:03:02.072110] [FATAL] [MAIN ] GHG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:03:02.072194] [WARN ] [MAIN ] GHG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:03:02.072280] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-23T19:03:02.072362] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-23T19:03:02.072414] [INFO ] [LOCAL ] GHG: Starting deletion of derivative data. [2025-09-23T19:03:02.072922] [DEBUG] [LOCAL ] GHG: Deleted derivative data file. [2025-09-23T19:03:02.073024] [INFO ] [MAIN ] Update Progress: 928/2372 symbols completed. GHG took 15.6s. Estimated remaining: 3h 11m 22s. Rate: 7.5 symbols/min [2025-09-23T19:03:02.244713] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:02.252156] [DEBUG] [LOCAL ] GHLD: Loaded 4078 existing records from primary storage. [2025-09-23T19:03:02.252269] [INFO ] [MAIN ] GHLD: Loaded 4078 existing records. [2025-09-23T19:03:02.428806] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:02.429047] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-23T19:03:02.429095] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-23T19:03:02.429387] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-23T19:03:02.429448] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-23T19:03:02.608070] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-23T19:03:02.798065] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:03.402216] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-23T19:03:03.953046] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-23T19:03:03.954111] [INFO ] [REMOTE ] GGZ: Full fetch complete (4157 records). [2025-09-23T19:03:03.954180] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-23T19:03:04.212465] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-23T19:03:04.321120] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-23T19:03:04.321207] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-23T19:03:04.321349] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-23T19:03:04.321388] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-23T19:03:04.321796] [DEBUG] [LOCAL ] GGZ: Trimmed 4157 records to 2462 (keeping 200 days of data) [2025-09-23T19:03:04.337745] [DEBUG] [LOCAL ] GGZ: Primary data saved (2462 records). [2025-09-23T19:03:04.337813] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-23T19:03:04.337909] [INFO ] [MAIN ] Update Progress: 929/2372 symbols completed. GGZ took 32.6s. Estimated remaining: 3h 11m 5s. Rate: 7.6 symbols/min [2025-09-23T19:03:04.444562] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T19:03:04.514405] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:04.529896] [DEBUG] [LOCAL ] GHM: Loaded 14159 existing records from primary storage. [2025-09-23T19:03:04.530020] [INFO ] [MAIN ] GHM: Loaded 14159 existing records. [2025-09-23T19:03:04.666743] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T19:03:04.722766] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:04.723002] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-23T19:03:04.723050] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-23T19:03:04.723517] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-23T19:03:04.723611] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-23T19:03:04.831154] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T19:03:05.007371] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-23T19:03:05.101675] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:05.511784] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T19:03:05.802263] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-23T19:03:06.468808] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T19:03:06.602209] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-23T19:03:07.301706] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T19:03:07.402195] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-23T19:03:08.029078] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T19:03:08.202218] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-23T19:03:09.002237] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-23T19:03:09.124922] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:03:09.357737] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T19:03:09.802283] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-23T19:03:10.289131] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T19:03:10.602215] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-23T19:03:11.303987] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T19:03:11.402212] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-23T19:03:12.202224] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-23T19:03:12.751063] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:03:12.948287] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T19:03:13.002267] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-23T19:03:13.802266] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-23T19:03:14.602248] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-23T19:03:14.640625] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:03:15.027668] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:03:15.402263] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-23T19:03:15.426740] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:03:15.931223] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T19:03:16.202253] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-23T19:03:16.578453] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T19:03:17.002202] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-23T19:03:17.657835] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T19:03:17.659131] [INFO ] [REMOTE ] GHC: Full fetch complete (3246 records). [2025-09-23T19:03:17.659208] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-23T19:03:17.807584] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-23T19:03:18.081244] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-23T19:03:18.081364] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-23T19:03:18.081571] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-23T19:03:18.081613] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-23T19:03:18.082107] [DEBUG] [LOCAL ] GHC: Trimmed 3246 records to 2627 (keeping 200 days of data) [2025-09-23T19:03:18.101964] [DEBUG] [LOCAL ] GHC: Primary data saved (2627 records). [2025-09-23T19:03:18.102149] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-23T19:03:18.102337] [INFO ] [MAIN ] Update Progress: 930/2372 symbols completed. GHC took 37.6s. Estimated remaining: 3h 11m 6s. Rate: 7.5 symbols/min [2025-09-23T19:03:18.293008] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:18.320036] [DEBUG] [LOCAL ] GHY: Loaded 20934 existing records from primary storage. [2025-09-23T19:03:18.320233] [INFO ] [MAIN ] GHY: Loaded 20934 existing records. [2025-09-23T19:03:18.526404] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T19:03:18.531879] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:18.535801] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-23T19:03:18.535926] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-23T19:03:18.537043] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-23T19:03:18.537121] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-23T19:03:18.607424] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-23T19:03:18.913747] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:19.158898] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T19:03:19.402242] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-23T19:03:19.762912] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T19:03:20.202203] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-23T19:03:20.626374] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T19:03:21.002211] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-23T19:03:21.400125] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T19:03:21.802215] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-23T19:03:22.456187] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T19:03:22.602212] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-23T19:03:23.256675] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T19:03:23.402217] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-23T19:03:24.157177] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T19:03:24.202240] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-23T19:03:25.002206] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-23T19:03:25.469761] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:03:25.600058] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T19:03:25.802209] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-23T19:03:26.453517] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T19:03:26.602201] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-23T19:03:27.353400] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T19:03:27.402212] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-23T19:03:27.993119] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T19:03:27.994635] [INFO ] [REMOTE ] GHLD: Full fetch complete (4734 records). [2025-09-23T19:03:27.994734] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-23T19:03:28.207317] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-23T19:03:28.371503] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-23T19:03:28.371674] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-23T19:03:28.371867] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-23T19:03:28.371966] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-23T19:03:28.372441] [DEBUG] [LOCAL ] GHLD: Trimmed 4734 records to 4110 (keeping 200 days of data) [2025-09-23T19:03:28.402224] [DEBUG] [LOCAL ] GHLD: Primary data saved (4110 records). [2025-09-23T19:03:28.402361] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-23T19:03:28.402562] [INFO ] [MAIN ] Update Progress: 931/2372 symbols completed. GHLD took 26.3s. Estimated remaining: 3h 11m 2s. Rate: 7.5 symbols/min [2025-09-23T19:03:28.571194] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:28.615795] [DEBUG] [LOCAL ] GIB: Loaded 32195 existing records from primary storage. [2025-09-23T19:03:28.615956] [INFO ] [MAIN ] GIB: Loaded 32195 existing records. [2025-09-23T19:03:28.791803] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:28.792058] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-23T19:03:28.792110] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-23T19:03:28.793369] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-23T19:03:28.793432] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-23T19:03:29.007922] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-23T19:03:29.070518] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T19:03:29.092728] [INFO ] [REMOTE ] GHI: Full fetch complete (11805 records). [2025-09-23T19:03:29.098072] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-23T19:03:29.271282] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:29.607099] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-23T19:03:29.607186] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-23T19:03:29.607523] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-23T19:03:29.607621] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-23T19:03:29.608206] [DEBUG] [LOCAL ] GHI: Trimmed 11805 records to 6895 (keeping 200 days of data) [2025-09-23T19:03:29.658783] [DEBUG] [LOCAL ] GHI: Primary data saved (6895 records). [2025-09-23T19:03:29.658963] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-23T19:03:29.659168] [INFO ] [MAIN ] Update Progress: 932/2372 symbols completed. GHI took 41.0s. Estimated remaining: 3h 10m 43s. Rate: 7.6 symbols/min [2025-09-23T19:03:29.807260] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-23T19:03:29.860975] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:29.882915] [DEBUG] [LOCAL ] GIC: Loaded 13763 existing records from primary storage. [2025-09-23T19:03:29.883054] [INFO ] [MAIN ] GIC: Loaded 13763 existing records. [2025-09-23T19:03:30.068446] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:30.068736] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-23T19:03:30.068793] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-23T19:03:30.069323] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-23T19:03:30.069400] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-23T19:03:30.236048] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:03:30.462526] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:30.524628] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T19:03:30.602161] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-23T19:03:31.388059] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T19:03:31.402150] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-23T19:03:32.202161] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-23T19:03:32.596234] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T19:03:32.791956] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T19:03:33.002234] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-23T19:03:33.802215] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-23T19:03:33.930269] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:03:34.602267] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-23T19:03:35.040669] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:03:35.402202] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-23T19:03:35.474700] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T19:03:36.202258] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-23T19:03:36.376952] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T19:03:36.885053] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T19:03:36.889136] [INFO ] [REMOTE ] GHM: Full fetch complete (21551 records). [2025-09-23T19:03:36.889239] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-23T19:03:37.007809] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-23T19:03:37.276398] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-23T19:03:37.276477] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-23T19:03:37.276937] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-23T19:03:37.276999] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-23T19:03:37.278070] [DEBUG] [LOCAL ] GHM: Trimmed 21551 records to 14136 (keeping 200 days of data) [2025-09-23T19:03:37.373240] [DEBUG] [LOCAL ] GHM: Primary data saved (14136 records). [2025-09-23T19:03:37.373380] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-23T19:03:37.373494] [INFO ] [MAIN ] Update Progress: 933/2372 symbols completed. GHM took 33.0s. Estimated remaining: 3h 10m 35s. Rate: 7.6 symbols/min [2025-09-23T19:03:37.549478] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:37.609025] [DEBUG] [LOCAL ] GIL: Loaded 43097 existing records from primary storage. [2025-09-23T19:03:37.609173] [INFO ] [MAIN ] GIL: Loaded 43097 existing records. [2025-09-23T19:03:37.794555] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:37.794871] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-23T19:03:37.794957] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-23T19:03:37.796239] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-23T19:03:37.796302] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-23T19:03:37.807518] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-23T19:03:37.927237] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T19:03:38.192311] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:38.602225] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-23T19:03:38.667172] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T19:03:39.402187] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-23T19:03:39.544517] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T19:03:40.202188] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-23T19:03:40.592459] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T19:03:41.002209] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-23T19:03:41.349419] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T19:03:41.679436] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T19:03:41.802246] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-23T19:03:42.602211] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-23T19:03:43.051423] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T19:03:43.402226] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-23T19:03:43.869235] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:03:44.202196] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-23T19:03:44.316197] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:03:45.002200] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-23T19:03:45.245102] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T19:03:45.802212] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-23T19:03:45.823777] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T19:03:46.602256] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-23T19:03:47.141465] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T19:03:47.195283] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:03:47.402280] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-23T19:03:48.202237] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-23T19:03:48.610408] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T19:03:49.002249] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-23T19:03:49.648262] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:03:49.802194] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-23T19:03:50.377721] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T19:03:50.406459] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:03:50.602203] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-23T19:03:51.402245] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-23T19:03:51.769535] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:03:52.074048] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T19:03:52.077616] [INFO ] [REMOTE ] GHY: Full fetch complete (31834 records). [2025-09-23T19:03:52.077744] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-23T19:03:52.217763] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-23T19:03:52.454855] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-23T19:03:52.454935] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-23T19:03:52.455539] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-23T19:03:52.455583] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-23T19:03:52.457037] [DEBUG] [LOCAL ] GHY: Trimmed 31834 records to 20835 (keeping 200 days of data) [2025-09-23T19:03:52.591744] [DEBUG] [LOCAL ] GHY: Primary data saved (20835 records). [2025-09-23T19:03:52.591874] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-23T19:03:52.591955] [INFO ] [MAIN ] Update Progress: 934/2372 symbols completed. GHY took 34.5s. Estimated remaining: 3h 10m 38s. Rate: 7.5 symbols/min [2025-09-23T19:03:52.766512] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:52.828065] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-09-23T19:03:52.828230] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-09-23T19:03:53.003977] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-23T19:03:53.004329] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:53.005757] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-23T19:03:53.005815] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-23T19:03:53.007295] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-23T19:03:53.007361] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-23T19:03:53.359675] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:53.424902] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T19:03:53.802168] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-23T19:03:54.413600] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T19:03:54.602165] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-23T19:03:55.390777] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T19:03:55.402219] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-23T19:03:55.589496] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T19:03:56.202244] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-23T19:03:57.002271] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-23T19:03:57.209281] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T19:03:57.241464] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:03:57.802203] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-23T19:03:58.079639] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T19:03:58.602201] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-23T19:03:58.767266] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T19:03:59.402194] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-23T19:03:59.932191] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T19:04:00.202206] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-23T19:04:00.833431] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T19:04:00.899683] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:04:00.905009] [INFO ] [REMOTE ] GIB: Full fetch complete (44971 records). [2025-09-23T19:04:00.905108] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-23T19:04:01.004783] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-23T19:04:01.318073] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-23T19:04:01.318400] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-23T19:04:01.319687] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-23T19:04:01.319759] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-23T19:04:01.321951] [DEBUG] [LOCAL ] GIB: Trimmed 44971 records to 32109 (keeping 200 days of data) [2025-09-23T19:04:01.540806] [DEBUG] [LOCAL ] GIB: Primary data saved (32109 records). [2025-09-23T19:04:01.540957] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-23T19:04:01.541069] [INFO ] [MAIN ] Update Progress: 935/2372 symbols completed. GIB took 33.1s. Estimated remaining: 3h 10m 32s. Rate: 7.5 symbols/min [2025-09-23T19:04:01.726041] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:01.776915] [DEBUG] [LOCAL ] GKOS: Loaded 43097 existing records from primary storage. [2025-09-23T19:04:01.777117] [INFO ] [MAIN ] GKOS: Loaded 43097 existing records. [2025-09-23T19:04:01.808957] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-23T19:04:01.978028] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:01.978392] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-23T19:04:01.978481] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-23T19:04:01.980076] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-23T19:04:01.980149] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-23T19:04:02.360326] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:02.573495] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T19:04:02.602144] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-23T19:04:02.620885] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:04:02.623924] [INFO ] [REMOTE ] GIC: Full fetch complete (20387 records). [2025-09-23T19:04:02.624011] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-23T19:04:03.078563] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-23T19:04:03.078676] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-23T19:04:03.079187] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-23T19:04:03.079250] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-23T19:04:03.080015] [DEBUG] [LOCAL ] GIC: Trimmed 20387 records to 13706 (keeping 200 days of data) [2025-09-23T19:04:03.172255] [DEBUG] [LOCAL ] GIC: Primary data saved (13706 records). [2025-09-23T19:04:03.172391] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-23T19:04:03.172475] [INFO ] [MAIN ] Update Progress: 936/2372 symbols completed. GIC took 33.5s. Estimated remaining: 3h 10m 14s. Rate: 7.5 symbols/min [2025-09-23T19:04:03.346839] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:03.397701] [DEBUG] [LOCAL ] GL: Loaded 37985 existing records from primary storage. [2025-09-23T19:04:03.397844] [INFO ] [MAIN ] GL: Loaded 37985 existing records. [2025-09-23T19:04:03.409492] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-23T19:04:03.591028] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:03.591258] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-23T19:04:03.591306] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-23T19:04:03.592559] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-23T19:04:03.592621] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-23T19:04:03.973892] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:04.001977] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T19:04:04.202191] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-23T19:04:04.590968] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T19:04:05.002207] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-23T19:04:05.802294] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-23T19:04:05.930304] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:04:05.942699] [INFO ] [REMOTE ] GIL: Full fetch complete (61250 records). [2025-09-23T19:04:05.942922] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-23T19:04:06.515318] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-23T19:04:06.515811] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-23T19:04:06.517838] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-23T19:04:06.518698] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-23T19:04:06.521431] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:04:06.532519] [DEBUG] [LOCAL ] GIL: Trimmed 61250 records to 43161 (keeping 200 days of data) [2025-09-23T19:04:06.609565] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-23T19:04:06.808405] [DEBUG] [LOCAL ] GIL: Primary data saved (43161 records). [2025-09-23T19:04:06.808543] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-23T19:04:06.808627] [INFO ] [MAIN ] Update Progress: 937/2372 symbols completed. GIL took 29.4s. Estimated remaining: 3h 9m 60s. Rate: 7.6 symbols/min [2025-09-23T19:04:06.984236] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:07.029764] [DEBUG] [LOCAL ] GLOB: Loaded 47283 existing records from primary storage. [2025-09-23T19:04:07.029917] [INFO ] [MAIN ] GLOB: Loaded 47283 existing records. [2025-09-23T19:04:07.207380] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:07.207627] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-23T19:04:07.207707] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-23T19:04:07.209016] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-23T19:04:07.209078] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-23T19:04:07.408036] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-23T19:04:07.586308] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:07.625356] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T19:04:08.202204] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-23T19:04:08.318041] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T19:04:08.613211] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:04:09.002265] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-23T19:04:09.281326] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T19:04:09.802235] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-23T19:04:10.135194] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:04:10.602222] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-23T19:04:11.282722] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:04:11.402253] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-23T19:04:11.859812] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T19:04:12.202226] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-23T19:04:12.542867] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T19:04:13.002196] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-23T19:04:13.598133] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T19:04:13.802241] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-23T19:04:14.382252] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:04:14.602196] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-23T19:04:15.230738] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T19:04:15.402218] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-23T19:04:15.730178] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T19:04:16.202204] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-23T19:04:16.597004] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T19:04:17.002258] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-23T19:04:17.431579] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:04:17.802260] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-23T19:04:18.602166] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-23T19:04:18.657258] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:04:19.335067] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:04:19.402177] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-23T19:04:20.017475] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:04:20.202255] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-23T19:04:20.555748] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T19:04:21.002195] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-23T19:04:21.802200] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-23T19:04:22.058094] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T19:04:22.120812] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T19:04:22.602208] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-23T19:04:22.894868] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T19:04:23.402247] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-23T19:04:24.081221] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T19:04:24.202181] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-23T19:04:24.545160] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T19:04:25.002227] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-23T19:04:25.802196] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-23T19:04:25.842448] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:04:26.233025] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:04:26.602197] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-23T19:04:27.013470] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T19:04:27.402218] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-23T19:04:27.773372] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:04:28.202205] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-23T19:04:29.002188] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-23T19:04:29.303539] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T19:04:29.406140] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:04:29.412539] [INFO ] [REMOTE ] GL: Full fetch complete (55698 records). [2025-09-23T19:04:29.412726] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-23T19:04:29.808116] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-23T19:04:29.811546] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-23T19:04:29.812355] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-23T19:04:29.813283] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-23T19:04:29.813468] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-23T19:04:29.815004] [DEBUG] [LOCAL ] GL: Trimmed 55698 records to 37987 (keeping 200 days of data) [2025-09-23T19:04:30.063486] [DEBUG] [LOCAL ] GL: Primary data saved (37987 records). [2025-09-23T19:04:30.063667] [INFO ] [MAIN ] GL: Full history saved. [2025-09-23T19:04:30.063775] [INFO ] [MAIN ] Update Progress: 938/2372 symbols completed. GL took 26.9s. Estimated remaining: 3h 10m 15s. Rate: 7.5 symbols/min [2025-09-23T19:04:30.240329] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:30.251402] [DEBUG] [LOCAL ] GLP: Loaded 9519 existing records from primary storage. [2025-09-23T19:04:30.251533] [INFO ] [MAIN ] GLP: Loaded 9519 existing records. [2025-09-23T19:04:30.443982] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:30.444368] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-23T19:04:30.444567] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-23T19:04:30.454361] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-23T19:04:30.459563] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-23T19:04:30.556442] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T19:04:30.604795] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-23T19:04:30.853130] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:31.400151] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T19:04:31.407060] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-23T19:04:31.409034] [INFO ] [REMOTE ] GKOS: Full fetch complete (59933 records). [2025-09-23T19:04:31.409194] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-23T19:04:31.799361] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-23T19:04:31.799458] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-23T19:04:31.800254] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-23T19:04:31.800321] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-23T19:04:31.801734] [DEBUG] [LOCAL ] GKOS: Trimmed 59933 records to 43115 (keeping 200 days of data) [2025-09-23T19:04:32.062275] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:04:32.065178] [DEBUG] [LOCAL ] GKOS: Primary data saved (43115 records). [2025-09-23T19:04:32.065563] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-23T19:04:32.068473] [INFO ] [MAIN ] Update Progress: 939/2372 symbols completed. GKOS took 30.5s. Estimated remaining: 3h 9m 58s. Rate: 7.5 symbols/min [2025-09-23T19:04:32.205635] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-23T19:04:32.255080] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:32.309045] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-23T19:04:32.309282] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-09-23T19:04:32.524157] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-23T19:04:32.529820] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:32.539727] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-23T19:04:32.540042] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-23T19:04:32.540588] [INFO ] [REMOTE ] GIS: Full fetch complete (77650 records). [2025-09-23T19:04:32.540813] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-23T19:04:32.547277] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-23T19:04:32.615326] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-23T19:04:33.007066] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-23T19:04:33.102997] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T19:04:33.402114] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:33.402576] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-23T19:04:33.403024] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-23T19:04:33.404606] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-23T19:04:33.404709] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-23T19:04:33.407061] [DEBUG] [LOCAL ] GIS: Trimmed 77650 records to 53675 (keeping 200 days of data) [2025-09-23T19:04:33.763186] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-09-23T19:04:33.763351] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-23T19:04:33.763443] [INFO ] [MAIN ] Update Progress: 940/2372 symbols completed. GIS took 41.2s. Estimated remaining: 3h 9m 41s. Rate: 7.5 symbols/min [2025-09-23T19:04:33.807357] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-23T19:04:33.941195] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:33.993294] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-23T19:04:33.993457] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-09-23T19:04:34.173576] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:34.173906] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-23T19:04:34.173985] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-23T19:04:34.175471] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-23T19:04:34.175541] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-23T19:04:34.537075] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:34.545736] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T19:04:34.602166] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-23T19:04:34.702098] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T19:04:35.402217] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-23T19:04:36.202184] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-23T19:04:36.470417] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T19:04:36.732607] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T19:04:36.884767] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:04:37.002233] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-23T19:04:37.802203] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-23T19:04:38.602165] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-23T19:04:38.830108] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T19:04:39.402242] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-23T19:04:39.545058] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T19:04:39.887918] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T19:04:39.988977] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T19:04:39.997870] [INFO ] [REMOTE ] GLOB: Full fetch complete (63254 records). [2025-09-23T19:04:39.998020] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-23T19:04:40.208577] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-23T19:04:40.440340] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-23T19:04:40.440467] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-23T19:04:40.441343] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-23T19:04:40.441414] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-23T19:04:40.442923] [DEBUG] [LOCAL ] GLOB: Trimmed 63254 records to 47351 (keeping 200 days of data) [2025-09-23T19:04:40.733079] [DEBUG] [LOCAL ] GLOB: Primary data saved (47351 records). [2025-09-23T19:04:40.733231] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-23T19:04:40.733320] [INFO ] [MAIN ] Update Progress: 941/2372 symbols completed. GLOB took 33.9s. Estimated remaining: 3h 9m 31s. Rate: 7.6 symbols/min [2025-09-23T19:04:40.907048] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:40.961780] [DEBUG] [LOCAL ] GME: Loaded 53761 existing records from primary storage. [2025-09-23T19:04:40.961939] [INFO ] [MAIN ] GME: Loaded 53761 existing records. [2025-09-23T19:04:41.007441] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-23T19:04:41.158328] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:41.158566] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-23T19:04:41.158614] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-23T19:04:41.159911] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-23T19:04:41.159972] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-23T19:04:41.511929] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:41.802202] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-23T19:04:41.999503] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T19:04:42.307244] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T19:04:42.602197] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-23T19:04:43.144716] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T19:04:43.402197] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-23T19:04:44.202242] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-23T19:04:44.351941] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T19:04:44.812100] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T19:04:45.002256] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-23T19:04:45.802217] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-23T19:04:46.501707] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T19:04:46.591523] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-23T19:04:46.602184] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-23T19:04:47.402196] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-23T19:04:47.681915] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T19:04:47.878671] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T19:04:48.202230] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-23T19:04:48.577871] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T19:04:49.002256] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-23T19:04:49.721285] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T19:04:49.803047] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-23T19:04:49.806176] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T19:04:50.393242] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T19:04:50.602227] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-23T19:04:51.402226] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-23T19:04:52.202204] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-23T19:04:52.973411] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-23T19:04:53.002161] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-23T19:04:53.383243] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T19:04:53.654516] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T19:04:53.802148] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-23T19:04:54.602188] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-23T19:04:55.103402] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-23T19:04:55.402187] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-23T19:04:55.648293] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-23T19:04:56.202283] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-23T19:04:56.896236] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T19:04:56.899084] [INFO ] [REMOTE ] GLP: Full fetch complete (14411 records). [2025-09-23T19:04:56.899180] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-23T19:04:57.010662] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-23T19:04:57.276412] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-23T19:04:57.363712] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-23T19:04:57.363863] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-23T19:04:57.364259] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-23T19:04:57.364305] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-23T19:04:57.364913] [DEBUG] [LOCAL ] GLP: Trimmed 14411 records to 9512 (keeping 200 days of data) [2025-09-23T19:04:57.423149] [DEBUG] [LOCAL ] GLP: Primary data saved (9512 records). [2025-09-23T19:04:57.423355] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-23T19:04:57.423478] [INFO ] [MAIN ] Update Progress: 942/2372 symbols completed. GLP took 27.4s. Estimated remaining: 3h 9m 37s. Rate: 7.5 symbols/min [2025-09-23T19:04:57.604631] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:57.654477] [DEBUG] [LOCAL ] GMED: Loaded 48319 existing records from primary storage. [2025-09-23T19:04:57.654631] [INFO ] [MAIN ] GMED: Loaded 48319 existing records. [2025-09-23T19:04:57.806108] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-23T19:04:57.843460] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:57.844930] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-23T19:04:57.845124] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-23T19:04:57.856836] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-23T19:04:57.873919] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-23T19:04:57.985840] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-23T19:04:58.260537] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:58.603691] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-23T19:04:58.613763] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T19:04:59.399110] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T19:04:59.409190] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-23T19:05:00.202184] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-23T19:05:01.002182] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-23T19:05:01.124129] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:05:01.184067] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-23T19:05:01.802240] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-23T19:05:02.528613] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-23T19:05:02.539714] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-23T19:05:02.539875] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-23T19:05:02.608819] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-23T19:05:03.046303] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-23T19:05:03.050725] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-23T19:05:03.051839] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-23T19:05:03.052197] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-23T19:05:03.055732] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T19:05:03.067156] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53728 (keeping 200 days of data) [2025-09-23T19:05:03.402195] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-23T19:05:03.420463] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-23T19:05:03.420559] [INFO ] [MAIN ] GM: Full history saved. [2025-09-23T19:05:03.420638] [INFO ] [MAIN ] Update Progress: 943/2372 symbols completed. GM took 29.7s. Estimated remaining: 3h 9m 26s. Rate: 7.5 symbols/min [2025-09-23T19:05:03.625771] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:03.663841] [DEBUG] [LOCAL ] GMRE: Loaded 37625 existing records from primary storage. [2025-09-23T19:05:03.664021] [INFO ] [MAIN ] GMRE: Loaded 37625 existing records. [2025-09-23T19:05:03.854259] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:03.854565] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-23T19:05:03.854618] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-23T19:05:03.855559] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-23T19:05:03.855625] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-23T19:05:04.260362] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:04.260851] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-23T19:05:04.294784] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-23T19:05:04.731618] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-23T19:05:04.741223] [INFO ] [REMOTE ] GLW: Full fetch complete (77614 records). [2025-09-23T19:05:04.766824] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-23T19:05:04.801707] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:05:05.007359] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-23T19:05:05.191520] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-23T19:05:05.191717] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-23T19:05:05.192723] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-23T19:05:05.192957] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-23T19:05:05.194737] [DEBUG] [LOCAL ] GLW: Trimmed 77614 records to 53635 (keeping 200 days of data) [2025-09-23T19:05:05.327164] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T19:05:05.561502] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-23T19:05:05.561669] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-23T19:05:05.561773] [INFO ] [MAIN ] Update Progress: 944/2372 symbols completed. GLW took 33.5s. Estimated remaining: 3h 9m 9s. Rate: 7.5 symbols/min [2025-09-23T19:05:05.740469] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:05.761210] [DEBUG] [LOCAL ] GNE: Loaded 17531 existing records from primary storage. [2025-09-23T19:05:05.761337] [INFO ] [MAIN ] GNE: Loaded 17531 existing records. [2025-09-23T19:05:05.807468] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-23T19:05:05.948424] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:05.948720] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-23T19:05:05.948775] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-23T19:05:05.949368] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-23T19:05:05.949429] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-23T19:05:06.307158] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:06.602243] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-23T19:05:06.938910] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:05:07.207068] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T19:05:07.402186] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-23T19:05:07.441259] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T19:05:08.202234] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-23T19:05:08.707076] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T19:05:08.753462] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T19:05:09.002224] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-23T19:05:09.755072] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T19:05:09.802251] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-23T19:05:10.592667] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T19:05:10.602193] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-23T19:05:11.384049] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T19:05:11.402195] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-23T19:05:12.202201] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-23T19:05:12.660008] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T19:05:13.002206] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-23T19:05:13.802217] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-23T19:05:14.058449] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T19:05:14.465384] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-23T19:05:14.602172] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-23T19:05:15.068971] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T19:05:15.402174] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-23T19:05:15.435101] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T19:05:16.202241] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-23T19:05:16.883342] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T19:05:17.002196] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-23T19:05:17.042069] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T19:05:17.802202] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-23T19:05:18.602177] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-23T19:05:18.693833] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T19:05:19.402236] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-23T19:05:19.669240] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:05:19.985634] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T19:05:20.202201] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-23T19:05:20.739089] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T19:05:21.002267] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-23T19:05:21.642153] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:05:21.691171] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T19:05:21.802212] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-23T19:05:22.602213] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-23T19:05:23.152549] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:05:23.156401] [INFO ] [REMOTE ] GNE: Full fetch complete (22261 records). [2025-09-23T19:05:23.156497] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-23T19:05:23.407433] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-23T19:05:23.522261] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-23T19:05:23.522342] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-23T19:05:23.522824] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-23T19:05:23.522885] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-23T19:05:23.523520] [DEBUG] [LOCAL ] GNE: Trimmed 22261 records to 17661 (keeping 200 days of data) [2025-09-23T19:05:23.634756] [DEBUG] [LOCAL ] GNE: Primary data saved (17661 records). [2025-09-23T19:05:23.634898] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-23T19:05:23.635012] [INFO ] [MAIN ] Update Progress: 945/2372 symbols completed. GNE took 18.1s. Estimated remaining: 3h 9m 16s. Rate: 7.5 symbols/min [2025-09-23T19:05:23.834674] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:23.861177] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:05:23.905931] [DEBUG] [LOCAL ] GNK: Loaded 40728 existing records from primary storage. [2025-09-23T19:05:23.906083] [INFO ] [MAIN ] GNK: Loaded 40728 existing records. [2025-09-23T19:05:24.104306] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:24.104599] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-23T19:05:24.104686] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-23T19:05:24.105740] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-23T19:05:24.105802] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-23T19:05:24.207356] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-23T19:05:24.485541] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:25.002235] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-23T19:05:25.501815] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-23T19:05:25.514447] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-09-23T19:05:25.514634] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-23T19:05:25.803087] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-23T19:05:25.968901] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-23T19:05:25.969322] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-23T19:05:25.972056] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-23T19:05:25.972146] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-23T19:05:25.973920] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 53762 (keeping 200 days of data) [2025-09-23T19:05:26.116401] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-23T19:05:26.273076] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:05:26.393035] [DEBUG] [LOCAL ] GME: Primary data saved (53762 records). [2025-09-23T19:05:26.393184] [INFO ] [MAIN ] GME: Full history saved. [2025-09-23T19:05:26.393270] [INFO ] [MAIN ] Update Progress: 946/2372 symbols completed. GME took 45.7s. Estimated remaining: 3h 9m 0s. Rate: 7.5 symbols/min [2025-09-23T19:05:26.561611] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:26.609495] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-23T19:05:26.616577] [DEBUG] [LOCAL ] GNL: Loaded 47345 existing records from primary storage. [2025-09-23T19:05:26.616782] [INFO ] [MAIN ] GNL: Loaded 47345 existing records. [2025-09-23T19:05:26.822632] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:26.823265] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-23T19:05:26.823358] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-23T19:05:26.824515] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-23T19:05:26.824579] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-23T19:05:27.134167] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T19:05:27.231462] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:27.402188] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-23T19:05:27.912918] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T19:05:28.202196] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-23T19:05:29.013831] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-23T19:05:29.016572] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T19:05:29.612841] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:05:29.802283] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-23T19:05:30.396522] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T19:05:30.602229] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-23T19:05:31.119756] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T19:05:31.402193] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-23T19:05:31.775454] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T19:05:31.783875] [INFO ] [REMOTE ] GMRE: Full fetch complete (53610 records). [2025-09-23T19:05:31.784090] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-23T19:05:32.186852] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-23T19:05:32.186957] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-23T19:05:32.188164] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-23T19:05:32.188280] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-23T19:05:32.191686] [DEBUG] [LOCAL ] GMRE: Trimmed 53610 records to 37709 (keeping 200 days of data) [2025-09-23T19:05:32.202220] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-23T19:05:32.462137] [DEBUG] [LOCAL ] GMRE: Primary data saved (37709 records). [2025-09-23T19:05:32.462431] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-23T19:05:32.462723] [INFO ] [MAIN ] Update Progress: 947/2372 symbols completed. GMRE took 29.0s. Estimated remaining: 3h 8m 50s. Rate: 7.5 symbols/min [2025-09-23T19:05:32.649448] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:32.704538] [DEBUG] [LOCAL ] GNRC: Loaded 45155 existing records from primary storage. [2025-09-23T19:05:32.704771] [INFO ] [MAIN ] GNRC: Loaded 45155 existing records. [2025-09-23T19:05:32.843160] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:05:32.922121] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:32.922498] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-23T19:05:32.922556] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-23T19:05:32.924008] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-23T19:05:32.924088] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-23T19:05:33.007405] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-23T19:05:33.319263] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:33.419391] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T19:05:33.802254] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-23T19:05:34.345806] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T19:05:34.602309] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-23T19:05:35.010805] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T19:05:35.402284] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-23T19:05:35.924124] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T19:05:36.202213] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-23T19:05:36.701936] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T19:05:37.002221] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-23T19:05:37.565405] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T19:05:37.802203] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-23T19:05:38.602223] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-23T19:05:38.683102] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:05:39.358954] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:05:39.402206] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-23T19:05:39.974336] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:05:39.986835] [INFO ] [REMOTE ] GMED: Full fetch complete (69093 records). [2025-09-23T19:05:39.987050] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-23T19:05:40.211896] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-23T19:05:40.407670] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-23T19:05:40.407774] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-23T19:05:40.408795] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-23T19:05:40.408863] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-23T19:05:40.410462] [DEBUG] [LOCAL ] GMED: Trimmed 69093 records to 48308 (keeping 200 days of data) [2025-09-23T19:05:40.689530] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T19:05:40.765215] [DEBUG] [LOCAL ] GMED: Primary data saved (48308 records). [2025-09-23T19:05:40.765379] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-23T19:05:40.765499] [INFO ] [MAIN ] Update Progress: 948/2372 symbols completed. GMED took 43.3s. Estimated remaining: 3h 8m 42s. Rate: 7.5 symbols/min [2025-09-23T19:05:40.940186] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:40.951704] [DEBUG] [LOCAL ] GNT: Loaded 7946 existing records from primary storage. [2025-09-23T19:05:40.951821] [INFO ] [MAIN ] GNT: Loaded 7946 existing records. [2025-09-23T19:05:41.014792] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-23T19:05:41.133432] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:41.133683] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-23T19:05:41.133768] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-23T19:05:41.134128] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-23T19:05:41.134197] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-23T19:05:41.508806] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:41.564999] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:05:41.802204] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-23T19:05:42.280189] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T19:05:42.401970] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T19:05:42.602192] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-23T19:05:43.402199] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-23T19:05:43.711432] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T19:05:44.202217] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-23T19:05:45.003714] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-23T19:05:45.006855] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:05:45.444715] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T19:05:45.487346] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T19:05:45.802194] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-23T19:05:46.602193] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-23T19:05:46.892431] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:05:47.402211] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-23T19:05:47.974597] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T19:05:48.202206] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-23T19:05:48.620081] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T19:05:49.002216] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-23T19:05:49.802164] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-23T19:05:49.837385] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:05:50.099362] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:05:50.458044] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T19:05:50.602197] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-23T19:05:51.402201] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-23T19:05:51.827754] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:05:52.202212] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-23T19:05:52.991217] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T19:05:53.002153] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-23T19:05:53.802236] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-23T19:05:53.872416] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T19:05:53.881700] [INFO ] [REMOTE ] GNK: Full fetch complete (56996 records). [2025-09-23T19:05:53.881839] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-23T19:05:54.303338] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-23T19:05:54.303484] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-23T19:05:54.304259] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-23T19:05:54.304322] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-23T19:05:54.305534] [DEBUG] [LOCAL ] GNK: Trimmed 56996 records to 40652 (keeping 200 days of data) [2025-09-23T19:05:54.569537] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T19:05:54.579965] [INFO ] [REMOTE ] GNL: Full fetch complete (68538 records). [2025-09-23T19:05:54.580581] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-23T19:05:54.612820] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-23T19:05:54.992022] [DEBUG] [LOCAL ] GNK: Primary data saved (40652 records). [2025-09-23T19:05:55.011581] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-23T19:05:55.015040] [INFO ] [MAIN ] Update Progress: 949/2372 symbols completed. GNK took 31.4s. Estimated remaining: 3h 8m 44s. Rate: 7.5 symbols/min [2025-09-23T19:05:55.015171] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-23T19:05:55.015246] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-23T19:05:55.016325] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-23T19:05:55.016502] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-23T19:05:55.117680] [DEBUG] [LOCAL ] GNL: Trimmed 68538 records to 47288 (keeping 200 days of data) [2025-09-23T19:05:55.250942] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:55.261075] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T19:05:55.327557] [DEBUG] [LOCAL ] GNTY: Loaded 7079 existing records from primary storage. [2025-09-23T19:05:55.328000] [INFO ] [MAIN ] GNTY: Loaded 7079 existing records. [2025-09-23T19:05:55.421458] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-23T19:05:55.630297] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:55.658853] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-23T19:05:55.661491] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-23T19:05:55.664639] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-23T19:05:55.665427] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-23T19:05:55.664588] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T19:05:55.958803] [DEBUG] [LOCAL ] GNL: Primary data saved (47288 records). [2025-09-23T19:05:55.959061] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-23T19:05:55.959181] [INFO ] [MAIN ] Update Progress: 950/2372 symbols completed. GNL took 29.6s. Estimated remaining: 3h 8m 25s. Rate: 7.5 symbols/min [2025-09-23T19:05:56.097300] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T19:05:56.212804] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-23T19:05:56.227582] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:56.278181] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:56.330639] [DEBUG] [LOCAL ] GNW: Loaded 51338 existing records from primary storage. [2025-09-23T19:05:56.330820] [INFO ] [MAIN ] GNW: Loaded 51338 existing records. [2025-09-23T19:05:56.510889] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:56.511151] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-23T19:05:56.511199] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-23T19:05:56.512258] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-23T19:05:56.512318] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-23T19:05:56.867627] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:57.002207] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-23T19:05:57.591249] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T19:05:57.802232] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-23T19:05:58.270339] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:05:58.491567] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:05:58.602206] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-23T19:05:59.402211] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-23T19:05:59.929883] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T19:06:00.202200] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-23T19:06:00.707460] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T19:06:01.002197] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-23T19:06:01.239000] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T19:06:01.246955] [INFO ] [REMOTE ] GNRC: Full fetch complete (65215 records). [2025-09-23T19:06:01.247103] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-23T19:06:01.602106] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T19:06:01.668877] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-23T19:06:01.668990] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-23T19:06:01.670296] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-23T19:06:01.670384] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-23T19:06:01.672325] [DEBUG] [LOCAL ] GNRC: Trimmed 65215 records to 45194 (keeping 200 days of data) [2025-09-23T19:06:01.803619] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-23T19:06:02.003108] [DEBUG] [LOCAL ] GNRC: Primary data saved (45194 records). [2025-09-23T19:06:02.003292] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-23T19:06:02.003451] [INFO ] [MAIN ] Update Progress: 951/2372 symbols completed. GNRC took 29.5s. Estimated remaining: 3h 8m 14s. Rate: 7.5 symbols/min [2025-09-23T19:06:02.194372] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:02.238084] [DEBUG] [LOCAL ] GOF: Loaded 42926 existing records from primary storage. [2025-09-23T19:06:02.238236] [INFO ] [MAIN ] GOF: Loaded 42926 existing records. [2025-09-23T19:06:02.437512] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:02.437850] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-23T19:06:02.437907] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-23T19:06:02.439074] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-23T19:06:02.439154] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-23T19:06:02.607507] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-23T19:06:02.837122] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:03.402205] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-23T19:06:04.202280] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-23T19:06:04.487909] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T19:06:04.734422] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (2.93 seconds). [2025-09-23T19:06:04.781041] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T19:06:04.851619] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:06:05.002201] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-23T19:06:05.802240] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-23T19:06:05.893405] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T19:06:05.896100] [INFO ] [REMOTE ] GNT: Full fetch complete (10546 records). [2025-09-23T19:06:05.896263] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-23T19:06:06.322517] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-23T19:06:06.322599] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-23T19:06:06.322908] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-23T19:06:06.322971] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-23T19:06:06.323448] [DEBUG] [LOCAL ] GNT: Trimmed 10546 records to 8021 (keeping 200 days of data) [2025-09-23T19:06:06.370992] [DEBUG] [LOCAL ] GNT: Primary data saved (8021 records). [2025-09-23T19:06:06.371140] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-23T19:06:06.371230] [INFO ] [MAIN ] Update Progress: 952/2372 symbols completed. GNT took 25.6s. Estimated remaining: 3h 8m 1s. Rate: 7.6 symbols/min [2025-09-23T19:06:06.561152] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:06.598208] [DEBUG] [LOCAL ] GOLF: Loaded 31784 existing records from primary storage. [2025-09-23T19:06:06.598363] [INFO ] [MAIN ] GOLF: Loaded 31784 existing records. [2025-09-23T19:06:06.612241] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-23T19:06:06.789570] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:06.789815] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-23T19:06:06.789865] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-23T19:06:06.790637] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-23T19:06:06.790726] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-23T19:06:07.148496] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:07.210183] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T19:06:07.402220] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-23T19:06:08.108117] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T19:06:08.202222] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-23T19:06:09.002190] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-23T19:06:09.130224] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:06:09.507127] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T19:06:09.567885] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T19:06:09.802268] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-23T19:06:10.177634] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T19:06:10.602216] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-23T19:06:11.402214] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-23T19:06:11.789790] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:06:12.202175] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-23T19:06:12.284079] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T19:06:13.002211] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-23T19:06:13.550873] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T19:06:13.802215] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-23T19:06:14.602201] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-23T19:06:14.975097] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T19:06:15.381088] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T19:06:15.402154] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-23T19:06:15.440687] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T19:06:16.202195] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-23T19:06:16.645319] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:06:17.002217] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-23T19:06:17.472355] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T19:06:17.802185] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-23T19:06:18.044749] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T19:06:18.602249] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-23T19:06:19.119587] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T19:06:19.402217] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-23T19:06:20.202216] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-23T19:06:20.431730] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T19:06:21.002254] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-23T19:06:21.072272] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:06:21.074764] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T19:06:21.802295] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-23T19:06:22.430792] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T19:06:22.439207] [INFO ] [REMOTE ] GNW: Full fetch complete (73423 records). [2025-09-23T19:06:22.439341] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-23T19:06:22.619479] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-23T19:06:22.840241] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-23T19:06:22.840364] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-23T19:06:22.841396] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-23T19:06:22.841464] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-23T19:06:22.843114] [DEBUG] [LOCAL ] GNW: Trimmed 73423 records to 51348 (keeping 200 days of data) [2025-09-23T19:06:23.127241] [DEBUG] [LOCAL ] GNW: Primary data saved (51348 records). [2025-09-23T19:06:23.127371] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-23T19:06:23.127467] [INFO ] [MAIN ] Update Progress: 953/2372 symbols completed. GNW took 27.2s. Estimated remaining: 3h 8m 6s. Rate: 7.5 symbols/min [2025-09-23T19:06:23.307049] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:23.315277] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T19:06:23.359973] [DEBUG] [LOCAL ] GOOS: Loaded 45674 existing records from primary storage. [2025-09-23T19:06:23.360110] [INFO ] [MAIN ] GOOS: Loaded 45674 existing records. [2025-09-23T19:06:23.413971] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-23T19:06:23.543069] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:23.543424] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-23T19:06:23.543506] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-23T19:06:23.552543] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-23T19:06:23.567356] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-23T19:06:23.643354] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T19:06:23.974832] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:23.982217] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T19:06:24.202203] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-23T19:06:25.002198] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-23T19:06:25.802175] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-23T19:06:25.839308] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T19:06:25.841237] [INFO ] [REMOTE ] GNTY: Full fetch complete (10259 records). [2025-09-23T19:06:25.841308] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-23T19:06:26.032672] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T19:06:26.242108] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-23T19:06:26.242183] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-23T19:06:26.242406] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-23T19:06:26.242443] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-23T19:06:26.242905] [DEBUG] [LOCAL ] GNTY: Trimmed 10259 records to 7173 (keeping 200 days of data) [2025-09-23T19:06:26.286792] [DEBUG] [LOCAL ] GNTY: Primary data saved (7173 records). [2025-09-23T19:06:26.286895] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-23T19:06:26.286975] [INFO ] [MAIN ] Update Progress: 954/2372 symbols completed. GNTY took 31.3s. Estimated remaining: 3h 7m 51s. Rate: 7.5 symbols/min [2025-09-23T19:06:26.459849] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:26.498168] [DEBUG] [LOCAL ] GOTU: Loaded 39180 existing records from primary storage. [2025-09-23T19:06:26.498306] [INFO ] [MAIN ] GOTU: Loaded 39180 existing records. [2025-09-23T19:06:26.604142] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-23T19:06:26.698966] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:26.699300] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-23T19:06:26.699368] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-23T19:06:26.705435] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-23T19:06:26.714747] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-23T19:06:26.715218] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:06:27.108174] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:27.402189] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-23T19:06:27.860380] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T19:06:28.202214] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-23T19:06:28.807893] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T19:06:29.002250] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-23T19:06:29.672291] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T19:06:29.679433] [INFO ] [REMOTE ] GOF: Full fetch complete (62264 records). [2025-09-23T19:06:29.679568] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-23T19:06:29.807321] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-23T19:06:30.098280] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-23T19:06:30.098472] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-23T19:06:30.099350] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-23T19:06:30.099540] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-23T19:06:30.101350] [DEBUG] [LOCAL ] GOF: Trimmed 62264 records to 42873 (keeping 200 days of data) [2025-09-23T19:06:30.211069] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T19:06:30.394205] [DEBUG] [LOCAL ] GOF: Primary data saved (42873 records). [2025-09-23T19:06:30.394353] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-23T19:06:30.394442] [INFO ] [MAIN ] Update Progress: 955/2372 symbols completed. GOF took 28.4s. Estimated remaining: 3h 7m 38s. Rate: 7.6 symbols/min [2025-09-23T19:06:30.564374] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:30.609847] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-23T19:06:30.612627] [DEBUG] [LOCAL ] GPC: Loaded 46710 existing records from primary storage. [2025-09-23T19:06:30.612795] [INFO ] [MAIN ] GPC: Loaded 46710 existing records. [2025-09-23T19:06:30.792848] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:30.793107] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-23T19:06:30.793191] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-23T19:06:30.794363] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-23T19:06:30.794424] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-23T19:06:31.150048] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:31.402206] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-23T19:06:31.465514] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:06:31.782130] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:06:32.202195] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-23T19:06:33.002243] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-23T19:06:33.080822] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T19:06:33.618691] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:06:33.802207] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-23T19:06:34.513465] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:06:34.602213] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-23T19:06:35.402223] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-23T19:06:35.573389] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T19:06:35.816966] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T19:06:36.202160] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-23T19:06:36.660863] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T19:06:37.002213] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-23T19:06:37.443053] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:06:37.802217] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-23T19:06:38.602161] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-23T19:06:38.642531] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:06:38.894774] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T19:06:39.402166] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-23T19:06:39.472180] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T19:06:40.202233] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-23T19:06:40.705540] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T19:06:41.002200] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-23T19:06:41.396920] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T19:06:41.802224] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-23T19:06:42.567622] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:06:42.602160] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-23T19:06:43.278464] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T19:06:43.402197] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-23T19:06:44.073234] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:06:44.202232] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-23T19:06:44.681775] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T19:06:45.002232] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-23T19:06:45.802184] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-23T19:06:45.840583] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:06:46.533731] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:06:46.602224] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-23T19:06:46.969622] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:06:47.402205] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-23T19:06:47.668969] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T19:06:48.202193] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-23T19:06:48.789594] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T19:06:49.002213] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-23T19:06:49.258774] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:06:49.802190] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-23T19:06:50.361761] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T19:06:50.366740] [INFO ] [REMOTE ] GOLF: Full fetch complete (44881 records). [2025-09-23T19:06:50.366876] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-23T19:06:50.607290] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-23T19:06:50.774211] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-23T19:06:50.774301] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-23T19:06:50.775088] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-23T19:06:50.775156] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-23T19:06:50.776332] [DEBUG] [LOCAL ] GOLF: Trimmed 44881 records to 31727 (keeping 200 days of data) [2025-09-23T19:06:50.982525] [DEBUG] [LOCAL ] GOLF: Primary data saved (31727 records). [2025-09-23T19:06:50.982705] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-23T19:06:50.982809] [INFO ] [MAIN ] Update Progress: 956/2372 symbols completed. GOLF took 44.6s. Estimated remaining: 3h 7m 48s. Rate: 7.5 symbols/min [2025-09-23T19:06:51.158974] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:51.176116] [DEBUG] [LOCAL ] GPI: Loaded 14915 existing records from primary storage. [2025-09-23T19:06:51.176252] [INFO ] [MAIN ] GPI: Loaded 14915 existing records. [2025-09-23T19:06:51.403450] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-23T19:06:51.403274] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:51.405079] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-23T19:06:51.405389] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-23T19:06:51.408989] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-23T19:06:51.408890] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T19:06:51.409191] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-23T19:06:51.784070] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:51.837976] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:06:52.202204] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-23T19:06:52.865626] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:06:53.002192] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-23T19:06:53.802173] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-23T19:06:54.010804] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T19:06:54.478954] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:06:54.602217] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-23T19:06:55.066736] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:06:55.169972] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T19:06:55.402196] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-23T19:06:56.202197] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-23T19:06:56.459883] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T19:06:56.466155] [INFO ] [REMOTE ] GOTU: Full fetch complete (59866 records). [2025-09-23T19:06:56.466285] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-23T19:06:56.843615] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-23T19:06:56.843770] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-23T19:06:56.844537] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-23T19:06:56.844579] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-23T19:06:56.845880] [DEBUG] [LOCAL ] GOTU: Trimmed 59866 records to 39025 (keeping 200 days of data) [2025-09-23T19:06:57.006508] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-23T19:06:57.067807] [DEBUG] [LOCAL ] GOTU: Primary data saved (39025 records). [2025-09-23T19:06:57.067941] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-23T19:06:57.068025] [INFO ] [MAIN ] Update Progress: 957/2372 symbols completed. GOTU took 30.8s. Estimated remaining: 3h 7m 38s. Rate: 7.5 symbols/min [2025-09-23T19:06:57.156955] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T19:06:57.802217] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-23T19:06:58.352505] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T19:06:58.608729] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-23T19:06:58.626631] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T19:06:58.635593] [INFO ] [REMOTE ] GPC: Full fetch complete (69156 records). [2025-09-23T19:06:58.635821] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-23T19:06:59.039407] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-23T19:06:59.039496] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-23T19:06:59.040455] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-23T19:06:59.040520] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-23T19:06:59.042075] [DEBUG] [LOCAL ] GPC: Trimmed 69156 records to 46703 (keeping 200 days of data) [2025-09-23T19:06:59.373184] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T19:06:59.381237] [DEBUG] [LOCAL ] GPC: Primary data saved (46703 records). [2025-09-23T19:06:59.381394] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-23T19:06:59.381486] [INFO ] [MAIN ] Update Progress: 958/2372 symbols completed. GPC took 29.0s. Estimated remaining: 3h 7m 21s. Rate: 7.5 symbols/min [2025-09-23T19:06:59.402173] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-23T19:07:00.165040] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T19:07:00.202149] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-23T19:07:00.829398] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T19:07:01.002277] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-23T19:07:01.116377] [DEBUG] [REMOTE ] GPI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-23T19:07:01.116769] [WARN ] [REMOTE ] GPI: No data returned for month 2025-06 [2025-09-23T19:07:01.802267] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-23T19:07:02.602263] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-23T19:07:03.156363] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T19:07:03.402219] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-23T19:07:03.834689] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:07:04.202250] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-23T19:07:04.863548] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:07:04.870731] [INFO ] [REMOTE ] GOOS: Full fetch complete (66041 records). [2025-09-23T19:07:04.870839] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-23T19:07:05.258603] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T19:07:05.282536] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-23T19:07:05.282342] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-23T19:07:05.283478] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-23T19:07:05.284454] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-23T19:07:05.284686] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-23T19:07:05.286208] [DEBUG] [LOCAL ] GOOS: Trimmed 66041 records to 45569 (keeping 200 days of data) [2025-09-23T19:07:05.557824] [DEBUG] [LOCAL ] GOOS: Primary data saved (45569 records). [2025-09-23T19:07:05.557975] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-23T19:07:05.558081] [INFO ] [MAIN ] Update Progress: 959/2372 symbols completed. GOOS took 42.4s. Estimated remaining: 3h 7m 11s. Rate: 7.5 symbols/min [2025-09-23T19:07:07.932766] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-23T19:07:07.935715] [INFO ] [REMOTE ] GPI: Full fetch complete (18643 records). [2025-09-23T19:07:07.935811] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-23T19:07:08.121467] [WARN ] [VALIDATOR ] GPI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:07:08.121803] [FATAL] [MAIN ] GPI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:07:08.121873] [WARN ] [MAIN ] GPI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:07:08.121943] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-23T19:07:08.122034] [DEBUG] [LOCAL ] GPI: No primary data file found to delete. [2025-09-23T19:07:08.122132] [INFO ] [LOCAL ] GPI: Starting deletion of derivative data. [2025-09-23T19:07:08.122798] [DEBUG] [LOCAL ] GPI: Deleted derivative data file. [2025-09-23T19:07:08.122924] [INFO ] [MAIN ] Update Progress: 960/2372 symbols completed. GPI took 17.1s. Estimated remaining: 3h 6m 55s. Rate: 7.6 symbols/min [2025-09-23T19:07:08.709914] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:08.810374] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:08.832376] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:08.814239] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:08.840347] [DEBUG] [LOCAL ] GPJA: Loaded 4078 existing records from primary storage. [2025-09-23T19:07:08.840589] [INFO ] [MAIN ] GPJA: Loaded 4078 existing records. [2025-09-23T19:07:09.009244] [DEBUG] [LOCAL ] GPMT: Loaded 26820 existing records from primary storage. [2025-09-23T19:07:09.053333] [INFO ] [MAIN ] GPMT: Loaded 26820 existing records. [2025-09-23T19:07:09.083164] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:09.095572] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-23T19:07:09.125710] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-23T19:07:09.175479] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-23T19:07:09.216197] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-23T19:07:09.217127] [DEBUG] [LOCAL ] GPK: Loaded 52695 existing records from primary storage. [2025-09-23T19:07:09.218399] [DEBUG] [LOCAL ] GPN: Loaded 52107 existing records from primary storage. [2025-09-23T19:07:09.221630] [INFO ] [MAIN ] GPK: Loaded 52695 existing records. [2025-09-23T19:07:09.243173] [INFO ] [MAIN ] GPN: Loaded 52107 existing records. [2025-09-23T19:07:09.567413] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:09.680436] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-23T19:07:09.790945] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-23T19:07:09.892625] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-23T19:07:09.906965] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:09.932807] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-23T19:07:10.027125] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-23T19:07:10.048083] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-23T19:07:10.047740] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:10.093552] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-23T19:07:10.093606] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-23T19:07:10.171222] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:10.188668] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-23T19:07:10.193024] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-23T19:07:10.188577] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-23T19:07:10.261793] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-23T19:07:10.283207] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-23T19:07:10.995806] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T19:07:10.992792] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:11.021082] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-23T19:07:10.997828] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-23T19:07:11.186300] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:11.210170] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-23T19:07:11.306313] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:11.307022] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-23T19:07:11.694556] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T19:07:11.697844] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-23T19:07:11.995056] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T19:07:12.001200] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-23T19:07:12.047420] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T19:07:12.048840] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-23T19:07:12.385377] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T19:07:12.387210] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-23T19:07:12.486233] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T19:07:12.716324] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:07:12.766772] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:07:12.839984] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T19:07:13.002186] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-23T19:07:13.802172] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-23T19:07:14.042961] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T19:07:14.602238] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-23T19:07:15.202842] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:07:15.402190] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-23T19:07:16.022782] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T19:07:16.202215] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-23T19:07:16.656812] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:07:17.002206] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-23T19:07:17.323315] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-23T19:07:17.410245] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:07:17.802209] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-23T19:07:18.227214] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T19:07:18.602199] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-23T19:07:19.402214] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-23T19:07:20.202193] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-23T19:07:21.002251] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-23T19:07:21.387400] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-23T19:07:21.720254] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T19:07:21.807321] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-23T19:07:21.819259] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T19:07:21.922044] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-23T19:07:22.602193] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-23T19:07:23.313936] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T19:07:23.402210] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-23T19:07:23.902883] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T19:07:24.202233] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-23T19:07:25.002207] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-23T19:07:25.439346] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T19:07:25.802170] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-23T19:07:25.971490] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T19:07:25.999941] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T19:07:26.602201] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-23T19:07:26.960995] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T19:07:27.336367] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:07:27.402155] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-23T19:07:28.202193] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-23T19:07:28.724421] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T19:07:28.725870] [INFO ] [REMOTE ] GPJA: Full fetch complete (7292 records). [2025-09-23T19:07:28.725940] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-23T19:07:29.014491] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-23T19:07:29.110171] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-23T19:07:29.110398] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-23T19:07:29.110695] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-23T19:07:29.110815] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-23T19:07:29.111384] [DEBUG] [LOCAL ] GPJA: Trimmed 7292 records to 4086 (keeping 200 days of data) [2025-09-23T19:07:29.139371] [DEBUG] [LOCAL ] GPJA: Primary data saved (4086 records). [2025-09-23T19:07:29.139575] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-23T19:07:29.139718] [INFO ] [MAIN ] Update Progress: 961/2372 symbols completed. GPJA took 21.0s. Estimated remaining: 3h 7m 6s. Rate: 7.5 symbols/min [2025-09-23T19:07:29.402860] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-23T19:07:29.408877] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:29.447722] [DEBUG] [LOCAL ] GPOR: Loaded 22934 existing records from primary storage. [2025-09-23T19:07:29.447877] [INFO ] [MAIN ] GPOR: Loaded 22934 existing records. [2025-09-23T19:07:29.634632] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:29.634901] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-23T19:07:29.634972] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-23T19:07:29.635914] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-23T19:07:29.635976] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-23T19:07:29.807307] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-23T19:07:29.989820] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:30.385708] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T19:07:30.602231] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-23T19:07:31.337897] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:07:31.402238] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-23T19:07:31.735409] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T19:07:32.202211] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-23T19:07:32.931622] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T19:07:32.940105] [INFO ] [REMOTE ] GPN: Full fetch complete (74803 records). [2025-09-23T19:07:32.940233] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-23T19:07:33.007440] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-23T19:07:33.342444] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-23T19:07:33.342561] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-23T19:07:33.343582] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-23T19:07:33.343695] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-23T19:07:33.345739] [DEBUG] [LOCAL ] GPN: Trimmed 74803 records to 52113 (keeping 200 days of data) [2025-09-23T19:07:33.452847] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T19:07:33.702483] [DEBUG] [LOCAL ] GPN: Primary data saved (52113 records). [2025-09-23T19:07:33.702697] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-23T19:07:33.702886] [INFO ] [MAIN ] Update Progress: 962/2372 symbols completed. GPN took 25.6s. Estimated remaining: 3h 6m 53s. Rate: 7.5 symbols/min [2025-09-23T19:07:33.809450] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-23T19:07:33.884421] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:33.922735] [DEBUG] [LOCAL ] GPRK: Loaded 39112 existing records from primary storage. [2025-09-23T19:07:33.922939] [INFO ] [MAIN ] GPRK: Loaded 39112 existing records. [2025-09-23T19:07:34.100455] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:34.100730] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-23T19:07:34.100785] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-23T19:07:34.102098] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-23T19:07:34.102160] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-23T19:07:34.473980] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:34.499412] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:07:34.602151] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-23T19:07:35.169176] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T19:07:35.330367] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T19:07:35.402163] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-23T19:07:36.095603] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T19:07:36.202168] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-23T19:07:37.002230] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-23T19:07:37.194962] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T19:07:37.714495] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:07:37.717796] [INFO ] [REMOTE ] GPMT: Full fetch complete (37877 records). [2025-09-23T19:07:37.717877] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-23T19:07:37.807402] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-23T19:07:38.091297] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-23T19:07:38.091378] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-23T19:07:38.091985] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-23T19:07:38.092064] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-23T19:07:38.093050] [DEBUG] [LOCAL ] GPMT: Trimmed 37877 records to 26759 (keeping 200 days of data) [2025-09-23T19:07:38.250538] [DEBUG] [LOCAL ] GPMT: Primary data saved (26759 records). [2025-09-23T19:07:38.250701] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-23T19:07:38.250799] [INFO ] [MAIN ] Update Progress: 963/2372 symbols completed. GPMT took 30.1s. Estimated remaining: 3h 6m 40s. Rate: 7.5 symbols/min [2025-09-23T19:07:38.426631] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:38.459150] [DEBUG] [LOCAL ] GRBK: Loaded 27108 existing records from primary storage. [2025-09-23T19:07:38.459282] [INFO ] [MAIN ] GRBK: Loaded 27108 existing records. [2025-09-23T19:07:38.607288] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-23T19:07:38.637150] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:38.639502] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-23T19:07:38.639667] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-23T19:07:38.640824] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-23T19:07:38.641025] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-23T19:07:38.930864] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T19:07:39.032078] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:39.402199] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-23T19:07:39.898083] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T19:07:40.202237] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-23T19:07:40.379364] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T19:07:41.002194] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-23T19:07:41.033771] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T19:07:41.802199] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-23T19:07:42.082734] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T19:07:42.602219] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-23T19:07:43.402199] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-23T19:07:43.672046] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T19:07:43.701815] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T19:07:44.202207] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-23T19:07:44.277525] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T19:07:45.002195] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-23T19:07:45.573881] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:07:45.810291] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-23T19:07:45.812535] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T19:07:46.602213] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-23T19:07:46.763064] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T19:07:47.402498] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-23T19:07:47.843708] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:07:48.202191] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-23T19:07:48.445064] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T19:07:49.002206] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-23T19:07:49.155283] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T19:07:49.802220] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-23T19:07:50.539357] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T19:07:50.602158] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-23T19:07:50.622759] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T19:07:51.402185] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-23T19:07:51.719870] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T19:07:52.202247] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-23T19:07:52.399160] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T19:07:53.002219] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-23T19:07:53.362592] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:07:53.802164] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-23T19:07:53.831067] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T19:07:54.602252] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-23T19:07:55.402280] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-23T19:07:55.481470] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T19:07:55.843925] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:07:56.202268] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-23T19:07:56.905574] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:07:56.914469] [INFO ] [REMOTE ] GPK: Full fetch complete (75409 records). [2025-09-23T19:07:56.914598] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-23T19:07:57.009668] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-23T19:07:57.342192] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-23T19:07:57.342367] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-23T19:07:57.343388] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-23T19:07:57.343585] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-23T19:07:57.369328] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T19:07:57.368209] [DEBUG] [LOCAL ] GPK: Trimmed 75409 records to 52678 (keeping 200 days of data) [2025-09-23T19:07:57.733874] [DEBUG] [LOCAL ] GPK: Primary data saved (52678 records). [2025-09-23T19:07:57.734019] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-23T19:07:57.734157] [INFO ] [MAIN ] Update Progress: 964/2372 symbols completed. GPK took 49.6s. Estimated remaining: 3h 6m 49s. Rate: 7.5 symbols/min [2025-09-23T19:07:57.808921] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-23T19:07:57.913178] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:57.924573] [DEBUG] [LOCAL ] GRC: Loaded 8788 existing records from primary storage. [2025-09-23T19:07:57.924727] [INFO ] [MAIN ] GRC: Loaded 8788 existing records. [2025-09-23T19:07:58.133458] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:58.133847] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-23T19:07:58.133983] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-23T19:07:58.134485] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-23T19:07:58.134562] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-23T19:07:58.448413] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:07:58.559924] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:58.602159] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-23T19:07:58.629419] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:07:59.402254] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-23T19:07:59.599060] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:07:59.603708] [INFO ] [REMOTE ] GRBK: Full fetch complete (40713 records). [2025-09-23T19:07:59.603847] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-23T19:07:59.992829] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-23T19:07:59.992913] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-23T19:07:59.993561] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-23T19:07:59.993623] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-23T19:07:59.994559] [DEBUG] [LOCAL ] GRBK: Trimmed 40713 records to 27075 (keeping 200 days of data) [2025-09-23T19:08:00.164418] [DEBUG] [LOCAL ] GRBK: Primary data saved (27075 records). [2025-09-23T19:08:00.164740] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-23T19:08:00.165035] [INFO ] [MAIN ] Update Progress: 965/2372 symbols completed. GRBK took 21.9s. Estimated remaining: 3h 6m 33s. Rate: 7.5 symbols/min [2025-09-23T19:08:00.211010] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-23T19:08:00.364574] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:00.397712] [DEBUG] [LOCAL ] GRDN: Loaded 19640 existing records from primary storage. [2025-09-23T19:08:00.397897] [INFO ] [MAIN ] GRDN: Loaded 19640 existing records. [2025-09-23T19:08:00.591679] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:00.592028] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-23T19:08:00.592090] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-23T19:08:00.593002] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-23T19:08:00.593092] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-23T19:08:00.908917] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T19:08:00.978181] [INFO ] [REMOTE ] GPOR: Full fetch complete (34985 records). [2025-09-23T19:08:01.025990] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:01.022177] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T19:08:01.021097] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-23T19:08:01.028083] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-23T19:08:01.464439] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-23T19:08:01.464523] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-23T19:08:01.465185] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-23T19:08:01.465248] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-23T19:08:01.466164] [DEBUG] [LOCAL ] GPOR: Trimmed 34985 records to 22959 (keeping 200 days of data) [2025-09-23T19:08:01.627462] [DEBUG] [LOCAL ] GPOR: Primary data saved (22959 records). [2025-09-23T19:08:01.627629] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-23T19:08:01.627833] [INFO ] [MAIN ] Update Progress: 966/2372 symbols completed. GPOR took 32.5s. Estimated remaining: 3h 6m 16s. Rate: 7.5 symbols/min [2025-09-23T19:08:01.811303] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:01.807318] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-23T19:08:01.870748] [DEBUG] [LOCAL ] GRMN: Loaded 41568 existing records from primary storage. [2025-09-23T19:08:01.870908] [INFO ] [MAIN ] GRMN: Loaded 41568 existing records. [2025-09-23T19:08:02.084174] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:02.084668] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-23T19:08:02.084777] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-23T19:08:02.086863] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-23T19:08:02.087013] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-23T19:08:02.275848] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T19:08:02.575684] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:02.602462] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T19:08:02.602542] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-23T19:08:03.402216] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-23T19:08:03.801669] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T19:08:04.202202] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-23T19:08:04.936798] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T19:08:04.943976] [INFO ] [REMOTE ] GPRK: Full fetch complete (57185 records). [2025-09-23T19:08:04.944108] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-23T19:08:05.009703] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-23T19:08:05.353408] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-23T19:08:05.353497] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-23T19:08:05.354338] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-23T19:08:05.354417] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-23T19:08:05.358346] [DEBUG] [LOCAL ] GPRK: Trimmed 57185 records to 39112 (keeping 200 days of data) [2025-09-23T19:08:05.627481] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T19:08:05.630426] [DEBUG] [LOCAL ] GPRK: Primary data saved (39112 records). [2025-09-23T19:08:05.639421] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-23T19:08:05.640063] [INFO ] [MAIN ] Update Progress: 967/2372 symbols completed. GPRK took 31.9s. Estimated remaining: 3h 6m 2s. Rate: 7.6 symbols/min [2025-09-23T19:08:05.723009] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T19:08:05.807301] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-23T19:08:05.835294] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:05.888486] [DEBUG] [LOCAL ] GRND: Loaded 50065 existing records from primary storage. [2025-09-23T19:08:05.888830] [INFO ] [MAIN ] GRND: Loaded 50065 existing records. [2025-09-23T19:08:06.071903] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:06.072232] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-23T19:08:06.072329] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-23T19:08:06.073855] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-23T19:08:06.073918] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-23T19:08:06.440275] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:06.463976] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-23T19:08:06.602224] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-23T19:08:07.101066] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T19:08:07.402274] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-23T19:08:07.870959] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T19:08:08.202209] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-23T19:08:08.808578] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:08:09.002263] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-23T19:08:09.471818] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T19:08:09.802220] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-23T19:08:10.311269] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T19:08:10.602220] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-23T19:08:11.386350] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T19:08:11.402146] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-23T19:08:11.909821] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T19:08:12.202213] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-23T19:08:12.753303] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T19:08:12.755590] [INFO ] [REMOTE ] GRC: Full fetch complete (13047 records). [2025-09-23T19:08:12.755689] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-23T19:08:13.007490] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-23T19:08:13.117118] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-23T19:08:13.117215] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-23T19:08:13.117613] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-23T19:08:13.117684] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-23T19:08:13.118194] [DEBUG] [LOCAL ] GRC: Trimmed 13047 records to 8886 (keeping 200 days of data) [2025-09-23T19:08:13.172389] [DEBUG] [LOCAL ] GRC: Primary data saved (8886 records). [2025-09-23T19:08:13.172536] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-23T19:08:13.172629] [INFO ] [MAIN ] Update Progress: 968/2372 symbols completed. GRC took 15.4s. Estimated remaining: 3h 5m 54s. Rate: 7.6 symbols/min [2025-09-23T19:08:13.338180] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:13.373270] [DEBUG] [LOCAL ] GRNT: Loaded 33861 existing records from primary storage. [2025-09-23T19:08:13.373419] [INFO ] [MAIN ] GRNT: Loaded 33861 existing records. [2025-09-23T19:08:13.556421] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:13.556738] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-23T19:08:13.556794] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-23T19:08:13.557888] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-23T19:08:13.557949] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-23T19:08:13.808966] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-23T19:08:13.913628] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:14.274993] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:08:14.602195] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-23T19:08:15.079293] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:08:15.402265] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-23T19:08:15.583576] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T19:08:16.202225] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-23T19:08:16.747209] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T19:08:17.002223] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-23T19:08:17.481535] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T19:08:17.618459] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T19:08:17.802258] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-23T19:08:18.424453] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:08:18.602222] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-23T19:08:19.214839] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:08:19.402225] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-23T19:08:20.202214] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-23T19:08:20.792391] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:08:21.002177] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-23T19:08:21.276356] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:08:21.802238] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-23T19:08:22.305090] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T19:08:22.487189] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T19:08:22.602200] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-23T19:08:23.402231] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-23T19:08:23.474895] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T19:08:24.116237] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T19:08:24.202219] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-23T19:08:25.002200] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-23T19:08:25.218261] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T19:08:25.802268] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-23T19:08:26.198875] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:08:26.602220] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-23T19:08:26.774819] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T19:08:26.781060] [INFO ] [REMOTE ] GRDN: Full fetch complete (25893 records). [2025-09-23T19:08:26.781272] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-23T19:08:27.179156] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-23T19:08:27.179253] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-23T19:08:27.179842] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-23T19:08:27.179906] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-23T19:08:27.180804] [DEBUG] [LOCAL ] GRDN: Trimmed 25893 records to 19693 (keeping 200 days of data) [2025-09-23T19:08:27.308010] [DEBUG] [LOCAL ] GRDN: Primary data saved (19693 records). [2025-09-23T19:08:27.308152] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-23T19:08:27.308238] [INFO ] [MAIN ] Update Progress: 969/2372 symbols completed. GRDN took 27.1s. Estimated remaining: 3h 5m 55s. Rate: 7.5 symbols/min [2025-09-23T19:08:27.409435] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-23T19:08:27.497950] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:27.509407] [DEBUG] [LOCAL ] GROV: Loaded 9089 existing records from primary storage. [2025-09-23T19:08:27.509527] [INFO ] [MAIN ] GROV: Loaded 9089 existing records. [2025-09-23T19:08:27.689479] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:27.689773] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-23T19:08:27.689847] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-23T19:08:27.690343] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-23T19:08:27.690404] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-23T19:08:28.089489] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:28.141135] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T19:08:28.202208] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-23T19:08:28.806569] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:08:29.002226] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-23T19:08:29.247507] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T19:08:29.802289] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-23T19:08:30.124118] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T19:08:30.602225] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-23T19:08:31.142513] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T19:08:31.402198] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-23T19:08:31.571058] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T19:08:32.202230] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-23T19:08:32.704333] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T19:08:33.007352] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-23T19:08:33.018794] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T19:08:33.659555] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T19:08:33.802215] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-23T19:08:34.410832] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T19:08:34.602229] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-23T19:08:35.402212] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-23T19:08:36.202200] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-23T19:08:36.268293] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T19:08:36.702526] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T19:08:36.859852] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:08:37.002159] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-23T19:08:37.802242] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-23T19:08:38.207924] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:08:38.361762] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T19:08:38.602259] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-23T19:08:39.402195] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-23T19:08:39.919585] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:08:40.202243] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-23T19:08:40.581686] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:08:40.588940] [INFO ] [REMOTE ] GRMN: Full fetch complete (60267 records). [2025-09-23T19:08:40.589142] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-23T19:08:40.990795] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-23T19:08:40.990940] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-23T19:08:40.991910] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-23T19:08:40.991984] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-23T19:08:40.993469] [DEBUG] [LOCAL ] GRMN: Trimmed 60267 records to 41489 (keeping 200 days of data) [2025-09-23T19:08:41.054112] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-23T19:08:41.264679] [DEBUG] [LOCAL ] GRMN: Primary data saved (41489 records). [2025-09-23T19:08:41.264827] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-23T19:08:41.264914] [INFO ] [MAIN ] Update Progress: 970/2372 symbols completed. GRMN took 39.6s. Estimated remaining: 3h 5m 55s. Rate: 7.5 symbols/min [2025-09-23T19:08:41.439552] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:41.446161] [DEBUG] [LOCAL ] GRX: Loaded 4423 existing records from primary storage. [2025-09-23T19:08:41.446273] [INFO ] [MAIN ] GRX: Loaded 4423 existing records. [2025-09-23T19:08:41.638340] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:41.638845] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-23T19:08:41.638920] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-23T19:08:41.639262] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-23T19:08:41.639328] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-23T19:08:41.850477] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T19:08:41.842248] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-23T19:08:41.901504] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T19:08:42.129761] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:42.602188] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-23T19:08:43.051483] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T19:08:43.402185] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-23T19:08:43.577633] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T19:08:44.202189] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-23T19:08:44.489975] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:08:45.002200] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-23T19:08:45.498125] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T19:08:45.802223] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-23T19:08:45.853638] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T19:08:45.862159] [INFO ] [REMOTE ] GRND: Full fetch complete (70230 records). [2025-09-23T19:08:45.862324] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-23T19:08:46.253062] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-23T19:08:46.253161] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-23T19:08:46.254057] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-23T19:08:46.254125] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-23T19:08:46.255606] [DEBUG] [LOCAL ] GRND: Trimmed 70230 records to 50047 (keeping 200 days of data) [2025-09-23T19:08:46.387749] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T19:08:46.564266] [DEBUG] [LOCAL ] GRND: Primary data saved (50047 records). [2025-09-23T19:08:46.564412] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-23T19:08:46.564499] [INFO ] [MAIN ] Update Progress: 971/2372 symbols completed. GRND took 40.9s. Estimated remaining: 3h 5m 44s. Rate: 7.5 symbols/min [2025-09-23T19:08:46.607363] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-23T19:08:46.743635] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:46.796289] [DEBUG] [LOCAL ] GS: Loaded 52088 existing records from primary storage. [2025-09-23T19:08:46.796432] [INFO ] [MAIN ] GS: Loaded 52088 existing records. [2025-09-23T19:08:46.973326] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:46.973597] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-23T19:08:46.973666] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-23T19:08:46.974993] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-23T19:08:46.975059] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-23T19:08:47.225149] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T19:08:47.341720] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:47.402143] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-23T19:08:48.202208] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-23T19:08:48.829476] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T19:08:49.002169] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-23T19:08:49.068228] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T19:08:49.520744] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T19:08:49.802191] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-23T19:08:50.602196] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-23T19:08:50.876208] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T19:08:51.402208] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-23T19:08:51.871686] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T19:08:51.873589] [INFO ] [REMOTE ] GROV: Full fetch complete (14615 records). [2025-09-23T19:08:51.873770] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-23T19:08:52.207330] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-23T19:08:52.265272] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-23T19:08:52.265465] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-23T19:08:52.266055] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-23T19:08:52.266217] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-23T19:08:52.267194] [DEBUG] [LOCAL ] GROV: Trimmed 14615 records to 9074 (keeping 200 days of data) [2025-09-23T19:08:52.321432] [DEBUG] [LOCAL ] GROV: Primary data saved (9074 records). [2025-09-23T19:08:52.321581] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-23T19:08:52.321705] [INFO ] [MAIN ] Update Progress: 972/2372 symbols completed. GROV took 25.0s. Estimated remaining: 3h 5m 32s. Rate: 7.5 symbols/min [2025-09-23T19:08:52.496450] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:52.525754] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T19:08:52.574803] [DEBUG] [LOCAL ] GSBD: Loaded 39134 existing records from primary storage. [2025-09-23T19:08:52.574971] [INFO ] [MAIN ] GSBD: Loaded 39134 existing records. [2025-09-23T19:08:52.679245] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T19:08:52.760499] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:52.760794] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-23T19:08:52.760847] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-23T19:08:52.761856] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-23T19:08:52.761917] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-23T19:08:53.007757] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-23T19:08:53.127162] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:53.802205] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-23T19:08:54.134258] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:08:54.140133] [INFO ] [REMOTE ] GRNT: Full fetch complete (48462 records). [2025-09-23T19:08:54.140238] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-23T19:08:54.422806] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:08:54.537313] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-23T19:08:54.537409] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-23T19:08:54.538102] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-23T19:08:54.538164] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-23T19:08:54.539252] [DEBUG] [LOCAL ] GRNT: Trimmed 48462 records to 33785 (keeping 200 days of data) [2025-09-23T19:08:54.620821] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-23T19:08:54.738619] [DEBUG] [LOCAL ] GRNT: Primary data saved (33785 records). [2025-09-23T19:08:54.738826] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-23T19:08:54.738960] [INFO ] [MAIN ] Update Progress: 973/2372 symbols completed. GRNT took 41.6s. Estimated remaining: 3h 5m 17s. Rate: 7.6 symbols/min [2025-09-23T19:08:54.917814] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:54.970340] [DEBUG] [LOCAL ] GSK: Loaded 53495 existing records from primary storage. [2025-09-23T19:08:54.970504] [INFO ] [MAIN ] GSK: Loaded 53495 existing records. [2025-09-23T19:08:55.150105] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:55.150405] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-23T19:08:55.150458] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-23T19:08:55.152070] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-23T19:08:55.152130] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-23T19:08:55.407364] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-23T19:08:55.520704] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:55.827614] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T19:08:56.202214] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-23T19:08:56.307269] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T19:08:57.002249] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-23T19:08:57.789858] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T19:08:57.805088] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-23T19:08:58.153970] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T19:08:58.602195] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-23T19:08:58.843717] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T19:08:59.402221] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-23T19:08:59.895283] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T19:09:00.202224] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-23T19:09:00.783233] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T19:09:01.002237] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-23T19:09:01.512713] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-23T19:09:01.802219] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-23T19:09:02.602290] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-23T19:09:02.730707] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T19:09:03.009513] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T19:09:03.402316] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-23T19:09:04.202235] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-23T19:09:05.002358] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-23T19:09:05.036191] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T19:09:05.140950] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T19:09:05.802277] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-23T19:09:06.059703] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-09-23T19:09:06.602299] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-23T19:09:06.890997] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T19:09:07.402199] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-23T19:09:07.451271] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T19:09:07.453219] [INFO ] [REMOTE ] GRX: Full fetch complete (6403 records). [2025-09-23T19:09:07.453399] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-23T19:09:07.661136] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T19:09:07.887244] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-23T19:09:07.887420] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-23T19:09:07.887715] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-23T19:09:07.887779] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-23T19:09:07.888181] [DEBUG] [LOCAL ] GRX: Trimmed 6403 records to 4444 (keeping 200 days of data) [2025-09-23T19:09:07.921349] [DEBUG] [LOCAL ] GRX: Primary data saved (4444 records). [2025-09-23T19:09:07.921504] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-23T19:09:07.921609] [INFO ] [MAIN ] Update Progress: 974/2372 symbols completed. GRX took 26.7s. Estimated remaining: 3h 5m 16s. Rate: 7.5 symbols/min [2025-09-23T19:09:08.099566] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:08.137508] [DEBUG] [LOCAL ] GSL: Loaded 33677 existing records from primary storage. [2025-09-23T19:09:08.137684] [INFO ] [MAIN ] GSL: Loaded 33677 existing records. [2025-09-23T19:09:08.211357] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-23T19:09:08.339901] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:08.340196] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-23T19:09:08.340248] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-23T19:09:08.341184] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-23T19:09:08.341247] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-23T19:09:08.710683] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:09.002210] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-23T19:09:09.127128] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T19:09:09.692570] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T19:09:09.802197] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-23T19:09:09.986139] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T19:09:10.602205] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-23T19:09:11.402229] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-23T19:09:11.434988] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:09:12.202220] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-23T19:09:12.587213] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T19:09:13.002215] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-23T19:09:13.220693] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T19:09:13.328933] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T19:09:13.802242] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-23T19:09:14.339397] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T19:09:14.602219] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-23T19:09:15.402241] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-23T19:09:15.696889] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T19:09:16.167980] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T19:09:16.202151] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-23T19:09:16.410745] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T19:09:17.002174] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-23T19:09:17.235005] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:09:17.802254] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-23T19:09:18.091365] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:09:18.602270] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-23T19:09:19.402225] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-23T19:09:19.509574] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T19:09:19.518703] [INFO ] [REMOTE ] GS: Full fetch complete (75845 records). [2025-09-23T19:09:19.518873] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-23T19:09:19.924275] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T19:09:19.955281] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-23T19:09:19.955721] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-23T19:09:19.956620] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-23T19:09:19.956706] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-23T19:09:19.958140] [DEBUG] [LOCAL ] GS: Trimmed 75845 records to 52068 (keeping 200 days of data) [2025-09-23T19:09:20.202275] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-23T19:09:20.290272] [DEBUG] [LOCAL ] GS: Primary data saved (52068 records). [2025-09-23T19:09:20.290404] [INFO ] [MAIN ] GS: Full history saved. [2025-09-23T19:09:20.290481] [INFO ] [MAIN ] Update Progress: 975/2372 symbols completed. GS took 33.7s. Estimated remaining: 3h 5m 14s. Rate: 7.5 symbols/min [2025-09-23T19:09:20.459199] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:20.511000] [DEBUG] [LOCAL ] GTES: Loaded 50703 existing records from primary storage. [2025-09-23T19:09:20.511154] [INFO ] [MAIN ] GTES: Loaded 50703 existing records. [2025-09-23T19:09:20.693768] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:20.694028] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-23T19:09:20.694078] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-23T19:09:20.695465] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-23T19:09:20.695525] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-23T19:09:21.005795] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-23T19:09:21.072632] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:21.162168] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T19:09:21.699935] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:09:21.802205] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-23T19:09:22.070205] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T19:09:22.602215] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-23T19:09:22.933763] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:09:22.940222] [INFO ] [REMOTE ] GSBD: Full fetch complete (58419 records). [2025-09-23T19:09:22.940320] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-23T19:09:23.336400] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-23T19:09:23.336479] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-23T19:09:23.337235] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-23T19:09:23.337297] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-23T19:09:23.338427] [DEBUG] [LOCAL ] GSBD: Trimmed 58419 records to 39136 (keeping 200 days of data) [2025-09-23T19:09:23.402485] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-23T19:09:23.580239] [DEBUG] [LOCAL ] GSBD: Primary data saved (39136 records). [2025-09-23T19:09:23.580390] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-23T19:09:23.580477] [INFO ] [MAIN ] Update Progress: 976/2372 symbols completed. GSBD took 31.3s. Estimated remaining: 3h 4m 60s. Rate: 7.5 symbols/min [2025-09-23T19:09:23.753550] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:23.798571] [DEBUG] [LOCAL ] GTLS: Loaded 43065 existing records from primary storage. [2025-09-23T19:09:23.798751] [INFO ] [MAIN ] GTLS: Loaded 43065 existing records. [2025-09-23T19:09:23.981161] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:23.981534] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-23T19:09:23.981612] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-23T19:09:23.982459] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-23T19:09:23.982519] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-23T19:09:24.170471] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T19:09:24.213708] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-23T19:09:24.385570] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:24.971458] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T19:09:25.002148] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-23T19:09:25.242587] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T19:09:25.802242] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-23T19:09:26.602255] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-23T19:09:27.402261] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-23T19:09:27.819208] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-23T19:09:28.202162] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-23T19:09:28.320385] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-23T19:09:28.321584] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:09:28.772469] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:09:29.002269] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-23T19:09:29.796922] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T19:09:29.807458] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-23T19:09:30.314507] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:09:30.602274] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-23T19:09:30.813903] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:09:31.402268] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-23T19:09:32.047102] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:09:32.202193] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-23T19:09:32.391918] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:09:32.398164] [INFO ] [REMOTE ] GSL: Full fetch complete (48022 records). [2025-09-23T19:09:32.398291] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-23T19:09:32.794368] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-23T19:09:32.794464] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-23T19:09:32.795292] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-23T19:09:32.795357] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-23T19:09:32.797107] [DEBUG] [LOCAL ] GSL: Trimmed 48022 records to 33536 (keeping 200 days of data) [2025-09-23T19:09:33.001100] [DEBUG] [LOCAL ] GSL: Primary data saved (33536 records). [2025-09-23T19:09:33.001242] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-23T19:09:33.001329] [INFO ] [MAIN ] Update Progress: 977/2372 symbols completed. GSL took 25.1s. Estimated remaining: 3h 4m 54s. Rate: 7.5 symbols/min [2025-09-23T19:09:33.013098] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-23T19:09:33.178990] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:33.222596] [DEBUG] [LOCAL ] GTN: Loaded 45674 existing records from primary storage. [2025-09-23T19:09:33.222798] [INFO ] [MAIN ] GTN: Loaded 45674 existing records. [2025-09-23T19:09:33.407864] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:33.408298] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-23T19:09:33.408372] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-23T19:09:33.409418] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-23T19:09:33.409480] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-23T19:09:33.656360] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T19:09:33.807314] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-23T19:09:33.860302] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:34.602156] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-23T19:09:34.815039] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T19:09:35.147442] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T19:09:35.402209] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-23T19:09:35.920419] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T19:09:36.202201] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-23T19:09:36.827197] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T19:09:36.836387] [INFO ] [REMOTE ] GSK: Full fetch complete (77472 records). [2025-09-23T19:09:36.836564] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-23T19:09:37.014885] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-23T19:09:37.238970] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-23T19:09:37.239081] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-23T19:09:37.240012] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-23T19:09:37.240077] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-23T19:09:37.242191] [DEBUG] [LOCAL ] GSK: Trimmed 77472 records to 53493 (keeping 200 days of data) [2025-09-23T19:09:37.490981] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:09:37.609432] [DEBUG] [LOCAL ] GSK: Primary data saved (53493 records). [2025-09-23T19:09:37.609581] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-23T19:09:37.609693] [INFO ] [MAIN ] Update Progress: 978/2372 symbols completed. GSK took 42.9s. Estimated remaining: 3h 4m 41s. Rate: 7.5 symbols/min [2025-09-23T19:09:37.779242] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:37.807477] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-23T19:09:37.810188] [DEBUG] [LOCAL ] GTY: Loaded 30384 existing records from primary storage. [2025-09-23T19:09:37.810350] [INFO ] [MAIN ] GTY: Loaded 30384 existing records. [2025-09-23T19:09:37.990242] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:37.990560] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-23T19:09:37.990613] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-23T19:09:37.991497] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-23T19:09:37.991560] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-23T19:09:38.351235] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:38.386880] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:09:38.602215] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-23T19:09:39.402184] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-23T19:09:39.452633] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:09:39.578006] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T19:09:40.202202] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-23T19:09:41.010484] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-23T19:09:41.031355] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:09:41.095476] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T19:09:41.802256] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-23T19:09:42.075553] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:09:42.602232] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-23T19:09:42.699071] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T19:09:43.402194] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-23T19:09:43.758310] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T19:09:44.202209] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-23T19:09:44.388513] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T19:09:45.002223] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-23T19:09:45.397256] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:09:45.802208] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-23T19:09:46.602222] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-23T19:09:46.660187] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:09:47.042396] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T19:09:47.402279] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-23T19:09:47.582088] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T19:09:48.202205] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-23T19:09:48.686617] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T19:09:49.002261] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-23T19:09:49.084846] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:09:49.802284] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-23T19:09:50.233123] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T19:09:50.602236] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-23T19:09:51.009947] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:09:51.402196] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-23T19:09:51.693167] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T19:09:52.202250] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-23T19:09:52.639737] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:09:53.002244] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-23T19:09:53.477990] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T19:09:53.802199] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-23T19:09:54.602194] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-23T19:09:54.657873] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:09:54.977050] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:09:55.402203] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-23T19:09:55.450566] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T19:09:56.202195] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-23T19:09:56.703179] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:09:57.002237] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-23T19:09:57.802213] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-23T19:09:58.147547] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-23T19:09:58.275787] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T19:09:58.288370] [INFO ] [REMOTE ] GTES: Full fetch complete (73991 records). [2025-09-23T19:09:58.288595] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-23T19:09:58.607547] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-23T19:09:58.791859] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-23T19:09:58.792004] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-23T19:09:58.793220] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-23T19:09:58.793357] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-23T19:09:58.795343] [DEBUG] [LOCAL ] GTES: Trimmed 73991 records to 50681 (keeping 200 days of data) [2025-09-23T19:09:58.912618] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T19:09:59.136976] [DEBUG] [LOCAL ] GTES: Primary data saved (50681 records). [2025-09-23T19:09:59.137175] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-23T19:09:59.137305] [INFO ] [MAIN ] Update Progress: 979/2372 symbols completed. GTES took 38.8s. Estimated remaining: 3h 4m 53s. Rate: 7.5 symbols/min [2025-09-23T19:09:59.345021] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:59.359498] [DEBUG] [LOCAL ] GUG: Loaded 12212 existing records from primary storage. [2025-09-23T19:09:59.359664] [INFO ] [MAIN ] GUG: Loaded 12212 existing records. [2025-09-23T19:09:59.407473] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-23T19:09:59.559749] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:59.560197] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-23T19:09:59.560250] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-23T19:09:59.560836] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-23T19:09:59.560902] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-23T19:09:59.942353] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:59.981947] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:09:59.990125] [INFO ] [REMOTE ] GTLS: Full fetch complete (61429 records). [2025-09-23T19:09:59.990287] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-23T19:10:00.210597] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-23T19:10:00.404210] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-23T19:10:00.404325] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-23T19:10:00.410930] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-23T19:10:00.421029] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-23T19:10:00.422697] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T19:10:00.431174] [DEBUG] [LOCAL ] GTLS: Trimmed 61429 records to 42996 (keeping 200 days of data) [2025-09-23T19:10:00.693018] [DEBUG] [LOCAL ] GTLS: Primary data saved (42996 records). [2025-09-23T19:10:00.693161] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-23T19:10:00.693248] [INFO ] [MAIN ] Update Progress: 980/2372 symbols completed. GTLS took 37.1s. Estimated remaining: 3h 4m 36s. Rate: 7.5 symbols/min [2025-09-23T19:10:00.881108] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:00.898962] [DEBUG] [LOCAL ] GUT: Loaded 15525 existing records from primary storage. [2025-09-23T19:10:00.899092] [INFO ] [MAIN ] GUT: Loaded 15525 existing records. [2025-09-23T19:10:01.006639] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-23T19:10:01.092154] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:01.092786] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-23T19:10:01.092864] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-23T19:10:01.093444] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-23T19:10:01.093506] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-23T19:10:01.450434] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:10:01.556372] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:01.802258] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-23T19:10:02.215911] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T19:10:02.220749] [INFO ] [REMOTE ] GTY: Full fetch complete (43164 records). [2025-09-23T19:10:02.220838] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-23T19:10:02.604348] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-23T19:10:02.628561] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-23T19:10:02.629229] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-23T19:10:02.629699] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T19:10:02.634476] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-23T19:10:02.635392] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-23T19:10:02.639783] [DEBUG] [LOCAL ] GTY: Trimmed 43164 records to 30403 (keeping 200 days of data) [2025-09-23T19:10:02.837898] [DEBUG] [LOCAL ] GTY: Primary data saved (30403 records). [2025-09-23T19:10:02.838060] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-23T19:10:02.838202] [INFO ] [MAIN ] Update Progress: 981/2372 symbols completed. GTY took 25.2s. Estimated remaining: 3h 4m 19s. Rate: 7.5 symbols/min [2025-09-23T19:10:03.016502] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:03.052842] [DEBUG] [LOCAL ] GVA: Loaded 33963 existing records from primary storage. [2025-09-23T19:10:03.052989] [INFO ] [MAIN ] GVA: Loaded 33963 existing records. [2025-09-23T19:10:03.243211] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:03.243855] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-23T19:10:03.243943] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-23T19:10:03.244994] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-23T19:10:03.245059] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-23T19:10:03.403442] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-23T19:10:03.447462] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T19:10:03.652216] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:04.177627] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:10:04.202159] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-23T19:10:04.847370] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T19:10:05.002252] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-23T19:10:05.802278] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-23T19:10:06.039792] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T19:10:06.432263] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T19:10:06.602265] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-23T19:10:07.402282] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-23T19:10:07.419696] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T19:10:08.101566] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T19:10:08.202245] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-23T19:10:09.002229] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-23T19:10:09.329965] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:10:09.339090] [INFO ] [REMOTE ] GTN: Full fetch complete (66399 records). [2025-09-23T19:10:09.339317] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-23T19:10:09.685731] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T19:10:09.791083] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-23T19:10:09.791179] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-23T19:10:09.792035] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-23T19:10:09.792144] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-23T19:10:09.796460] [DEBUG] [LOCAL ] GTN: Trimmed 66399 records to 45680 (keeping 200 days of data) [2025-09-23T19:10:09.802169] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-23T19:10:10.083552] [DEBUG] [LOCAL ] GTN: Primary data saved (45680 records). [2025-09-23T19:10:10.083736] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-23T19:10:10.083933] [INFO ] [MAIN ] Update Progress: 982/2372 symbols completed. GTN took 37.1s. Estimated remaining: 3h 4m 10s. Rate: 7.5 symbols/min [2025-09-23T19:10:10.264676] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:10.289286] [DEBUG] [LOCAL ] GWH: Loaded 15311 existing records from primary storage. [2025-09-23T19:10:10.289438] [INFO ] [MAIN ] GWH: Loaded 15311 existing records. [2025-09-23T19:10:10.483927] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:10.484522] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-23T19:10:10.484780] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-23T19:10:10.493461] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-23T19:10:10.495542] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-23T19:10:10.495862] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:10:10.604683] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-23T19:10:10.878251] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:11.402212] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-23T19:10:11.567039] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T19:10:11.900551] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T19:10:12.202210] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-23T19:10:12.838160] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T19:10:13.002195] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-23T19:10:13.802189] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-23T19:10:13.965050] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T19:10:14.333209] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T19:10:14.602200] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-23T19:10:15.236225] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T19:10:15.402221] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-23T19:10:16.202198] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-23T19:10:16.404634] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T19:10:16.767425] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T19:10:17.002202] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-23T19:10:17.802303] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-23T19:10:17.995486] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T19:10:18.497575] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T19:10:18.602188] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-23T19:10:19.219167] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T19:10:19.402252] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-23T19:10:19.926523] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T19:10:20.202250] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-23T19:10:21.002266] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-23T19:10:21.358284] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T19:10:21.802237] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-23T19:10:21.866166] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T19:10:21.869086] [INFO ] [REMOTE ] GUT: Full fetch complete (23035 records). [2025-09-23T19:10:21.869182] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-23T19:10:22.240785] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-23T19:10:22.240864] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-23T19:10:22.241339] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-23T19:10:22.241377] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-23T19:10:22.242044] [DEBUG] [LOCAL ] GUT: Trimmed 23035 records to 15489 (keeping 200 days of data) [2025-09-23T19:10:22.355676] [DEBUG] [LOCAL ] GUT: Primary data saved (15489 records). [2025-09-23T19:10:22.355835] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-23T19:10:22.355983] [INFO ] [MAIN ] Update Progress: 983/2372 symbols completed. GUT took 21.7s. Estimated remaining: 3h 4m 9s. Rate: 7.5 symbols/min [2025-09-23T19:10:22.538447] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:22.595882] [DEBUG] [LOCAL ] GWRE: Loaded 41190 existing records from primary storage. [2025-09-23T19:10:22.596028] [INFO ] [MAIN ] GWRE: Loaded 41190 existing records. [2025-09-23T19:10:22.607478] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-23T19:10:22.789634] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:22.790106] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-23T19:10:22.790164] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-23T19:10:22.791337] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-23T19:10:22.791399] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-23T19:10:22.952624] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T19:10:23.166050] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:23.402201] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-23T19:10:23.819178] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T19:10:24.202254] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-23T19:10:24.706133] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T19:10:24.771550] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T19:10:25.002196] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-23T19:10:25.802235] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-23T19:10:26.146865] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T19:10:26.602229] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-23T19:10:27.190362] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T19:10:27.213875] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T19:10:27.217466] [INFO ] [REMOTE ] GUG: Full fetch complete (20081 records). [2025-09-23T19:10:27.217579] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-23T19:10:27.466848] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-23T19:10:27.683680] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-23T19:10:27.684010] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-23T19:10:27.684542] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-23T19:10:27.684606] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-23T19:10:27.685379] [DEBUG] [LOCAL ] GUG: Trimmed 20081 records to 12019 (keeping 200 days of data) [2025-09-23T19:10:27.774853] [DEBUG] [LOCAL ] GUG: Primary data saved (12019 records). [2025-09-23T19:10:27.775042] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-23T19:10:27.775159] [INFO ] [MAIN ] Update Progress: 984/2372 symbols completed. GUG took 28.6s. Estimated remaining: 3h 3m 57s. Rate: 7.5 symbols/min [2025-09-23T19:10:27.957608] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:27.982048] [DEBUG] [LOCAL ] GWW: Loaded 19947 existing records from primary storage. [2025-09-23T19:10:27.982254] [INFO ] [MAIN ] GWW: Loaded 19947 existing records. [2025-09-23T19:10:28.164097] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T19:10:28.188098] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:28.188623] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-23T19:10:28.188717] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-23T19:10:28.189623] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-23T19:10:28.189717] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-23T19:10:28.210979] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-23T19:10:28.569687] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:29.002200] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-23T19:10:29.468863] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T19:10:29.802178] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-23T19:10:30.060678] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T19:10:30.538794] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:10:30.602148] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-23T19:10:31.355988] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:10:31.402159] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-23T19:10:32.202193] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-23T19:10:32.675894] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T19:10:33.002199] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-23T19:10:33.084330] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T19:10:33.802217] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-23T19:10:33.929883] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:10:34.602207] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-23T19:10:34.772226] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:10:35.402197] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-23T19:10:36.202172] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-23T19:10:36.380137] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T19:10:36.410887] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:10:36.972120] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:10:37.002198] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-23T19:10:37.663730] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T19:10:37.802156] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-23T19:10:38.599684] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T19:10:38.602403] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-23T19:10:38.603812] [INFO ] [REMOTE ] GWH: Full fetch complete (20695 records). [2025-09-23T19:10:38.603885] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-23T19:10:38.973625] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-23T19:10:38.973741] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-23T19:10:38.974194] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-23T19:10:38.974235] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-23T19:10:38.975010] [DEBUG] [LOCAL ] GWH: Trimmed 20695 records to 15438 (keeping 200 days of data) [2025-09-23T19:10:39.072725] [DEBUG] [LOCAL ] GWH: Primary data saved (15438 records). [2025-09-23T19:10:39.072879] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-23T19:10:39.072969] [INFO ] [MAIN ] Update Progress: 985/2372 symbols completed. GWH took 29.0s. Estimated remaining: 3h 3m 54s. Rate: 7.5 symbols/min [2025-09-23T19:10:39.254221] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:39.301677] [DEBUG] [LOCAL ] GXO: Loaded 47683 existing records from primary storage. [2025-09-23T19:10:39.301825] [INFO ] [MAIN ] GXO: Loaded 47683 existing records. [2025-09-23T19:10:39.402452] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-23T19:10:39.481777] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:39.482049] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-23T19:10:39.482097] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-23T19:10:39.483200] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-23T19:10:39.483261] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-23T19:10:39.856532] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:10:39.860205] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:39.867265] [INFO ] [REMOTE ] GVA: Full fetch complete (48849 records). [2025-09-23T19:10:39.867355] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-23T19:10:40.210399] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-23T19:10:40.252875] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-23T19:10:40.252955] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-23T19:10:40.253636] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-23T19:10:40.253726] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-23T19:10:40.254729] [DEBUG] [LOCAL ] GVA: Trimmed 48849 records to 33873 (keeping 200 days of data) [2025-09-23T19:10:40.465200] [DEBUG] [LOCAL ] GVA: Primary data saved (33873 records). [2025-09-23T19:10:40.465346] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-23T19:10:40.465442] [INFO ] [MAIN ] Update Progress: 986/2372 symbols completed. GVA took 37.6s. Estimated remaining: 3h 3m 37s. Rate: 7.5 symbols/min [2025-09-23T19:10:40.635453] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:40.638952] [DEBUG] [LOCAL ] GYLD: Loaded 1553 existing records from primary storage. [2025-09-23T19:10:40.639290] [INFO ] [MAIN ] GYLD: Loaded 1553 existing records. [2025-09-23T19:10:40.819685] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:40.820159] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-23T19:10:40.820232] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-23T19:10:40.820547] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-23T19:10:40.820611] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-23T19:10:41.008633] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-23T19:10:41.096696] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T19:10:41.246799] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:41.486535] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T19:10:41.802179] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-23T19:10:42.036339] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:10:42.095069] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-23T19:10:42.602208] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-23T19:10:43.402185] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-23T19:10:43.775502] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T19:10:44.202263] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-23T19:10:44.477765] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-23T19:10:44.673428] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T19:10:45.002198] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-23T19:10:45.276093] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-23T19:10:45.802194] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-23T19:10:46.602199] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-23T19:10:47.082116] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T19:10:47.297223] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T19:10:47.402237] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-23T19:10:48.202195] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-23T19:10:48.499156] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-23T19:10:48.686906] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T19:10:49.002208] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-23T19:10:49.362534] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T19:10:49.802198] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-23T19:10:50.543346] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:10:50.602205] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-23T19:10:51.402170] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-23T19:10:51.456612] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T19:10:51.693480] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-23T19:10:52.202258] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-23T19:10:53.002188] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-23T19:10:53.061622] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T19:10:53.802179] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-23T19:10:54.238134] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T19:10:54.349366] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T19:10:54.602218] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-23T19:10:55.385803] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T19:10:55.389510] [INFO ] [REMOTE ] GWW: Full fetch complete (29193 records). [2025-09-23T19:10:55.389597] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-23T19:10:55.411693] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-23T19:10:55.769942] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-23T19:10:55.770026] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-23T19:10:55.770552] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-23T19:10:55.770591] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-23T19:10:55.771312] [DEBUG] [LOCAL ] GWW: Trimmed 29193 records to 19907 (keeping 200 days of data) [2025-09-23T19:10:55.882083] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T19:10:55.925920] [DEBUG] [LOCAL ] GWW: Primary data saved (19907 records). [2025-09-23T19:10:55.926092] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-23T19:10:55.926198] [INFO ] [MAIN ] Update Progress: 987/2372 symbols completed. GWW took 28.2s. Estimated remaining: 3h 3m 39s. Rate: 7.5 symbols/min [2025-09-23T19:10:56.096690] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:56.145358] [DEBUG] [LOCAL ] H: Loaded 44926 existing records from primary storage. [2025-09-23T19:10:56.145496] [INFO ] [MAIN ] H: Loaded 44926 existing records. [2025-09-23T19:10:56.207438] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-23T19:10:56.325470] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:56.325759] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-23T19:10:56.325812] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-23T19:10:56.327799] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-23T19:10:56.327860] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-23T19:10:56.607023] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T19:10:56.683967] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:57.002242] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-23T19:10:57.402156] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T19:10:57.404266] [INFO ] [REMOTE ] GYLD: Full fetch complete (2041 records). [2025-09-23T19:10:57.404513] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-23T19:10:57.770403] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-23T19:10:57.770484] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-23T19:10:57.770582] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-23T19:10:57.770620] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-23T19:10:57.770980] [DEBUG] [LOCAL ] GYLD: Trimmed 2041 records to 1553 (keeping 200 days of data) [2025-09-23T19:10:57.781246] [DEBUG] [LOCAL ] GYLD: Primary data saved (1553 records). [2025-09-23T19:10:57.781311] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-23T19:10:57.781381] [INFO ] [MAIN ] Update Progress: 988/2372 symbols completed. GYLD took 17.3s. Estimated remaining: 3h 3m 23s. Rate: 7.5 symbols/min [2025-09-23T19:10:57.810554] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-23T19:10:57.952553] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:57.994558] [DEBUG] [LOCAL ] HAE: Loaded 39515 existing records from primary storage. [2025-09-23T19:10:57.994760] [INFO ] [MAIN ] HAE: Loaded 39515 existing records. [2025-09-23T19:10:58.178065] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:58.178334] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-23T19:10:58.178383] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-23T19:10:58.179502] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-23T19:10:58.179565] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-23T19:10:58.547035] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:58.602178] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-23T19:10:59.004413] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:10:59.402180] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-23T19:10:59.620183] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T19:11:00.202201] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-23T19:11:00.987786] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:11:01.002156] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-23T19:11:01.297825] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T19:11:01.802215] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-23T19:11:02.453027] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T19:11:02.602150] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-23T19:11:03.402398] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-23T19:11:03.402329] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T19:11:03.881450] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T19:11:04.202239] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-23T19:11:04.490264] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:11:05.002227] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-23T19:11:05.529127] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T19:11:05.802261] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-23T19:11:06.565199] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:11:06.602154] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-23T19:11:07.119662] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T19:11:07.402228] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-23T19:11:07.953864] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T19:11:08.202240] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-23T19:11:09.002182] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-23T19:11:09.043104] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:11:09.246553] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:11:09.802190] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-23T19:11:10.549618] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:11:10.602160] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-23T19:11:11.002083] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:11:11.402285] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-23T19:11:11.798158] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T19:11:12.202203] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-23T19:11:12.582324] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:11:12.591476] [INFO ] [REMOTE ] GXO: Full fetch complete (70125 records). [2025-09-23T19:11:12.591675] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-23T19:11:12.978322] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-23T19:11:12.978437] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-23T19:11:12.979297] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-23T19:11:12.979361] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-23T19:11:12.980852] [DEBUG] [LOCAL ] GXO: Trimmed 70125 records to 47612 (keeping 200 days of data) [2025-09-23T19:11:13.030420] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-23T19:11:13.257966] [DEBUG] [LOCAL ] GXO: Primary data saved (47612 records). [2025-09-23T19:11:13.258111] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-23T19:11:13.258210] [INFO ] [MAIN ] Update Progress: 989/2372 symbols completed. GXO took 34.2s. Estimated remaining: 3h 3m 25s. Rate: 7.5 symbols/min [2025-09-23T19:11:13.426343] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:13.467511] [DEBUG] [LOCAL ] HAFN: Loaded 43630 existing records from primary storage. [2025-09-23T19:11:13.467715] [INFO ] [MAIN ] HAFN: Loaded 43630 existing records. [2025-09-23T19:11:13.650676] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:13.651007] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-23T19:11:13.651060] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-23T19:11:13.651968] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-23T19:11:13.652028] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-23T19:11:13.825497] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-23T19:11:14.018540] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:14.051550] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T19:11:14.357850] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T19:11:14.364801] [INFO ] [REMOTE ] GWRE: Full fetch complete (61559 records). [2025-09-23T19:11:14.364955] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-23T19:11:14.608289] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-23T19:11:14.763039] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-23T19:11:14.763133] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-23T19:11:14.763935] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-23T19:11:14.764000] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-23T19:11:14.766042] [DEBUG] [LOCAL ] GWRE: Trimmed 61559 records to 41107 (keeping 200 days of data) [2025-09-23T19:11:15.025814] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:11:15.051733] [DEBUG] [LOCAL ] GWRE: Primary data saved (41107 records). [2025-09-23T19:11:15.051867] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-23T19:11:15.051949] [INFO ] [MAIN ] Update Progress: 990/2372 symbols completed. GWRE took 52.7s. Estimated remaining: 3h 3m 9s. Rate: 7.5 symbols/min [2025-09-23T19:11:15.235990] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:15.295711] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-23T19:11:15.295869] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-09-23T19:11:15.408796] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-23T19:11:15.499633] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:15.499918] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-23T19:11:15.499968] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-23T19:11:15.501259] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-23T19:11:15.501321] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-23T19:11:15.901515] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:16.202925] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-23T19:11:16.209379] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T19:11:16.827759] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:11:17.002201] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-23T19:11:17.802681] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-23T19:11:17.806049] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T19:11:18.162293] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T19:11:18.602194] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-23T19:11:18.825476] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:11:19.402237] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-23T19:11:20.199796] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T19:11:20.209718] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-23T19:11:20.846503] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T19:11:21.002228] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-23T19:11:21.221710] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T19:11:21.802191] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-23T19:11:22.466129] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T19:11:22.602170] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-23T19:11:22.998008] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:11:23.402202] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-23T19:11:24.107232] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T19:11:24.202164] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-23T19:11:24.751086] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:11:25.002201] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-23T19:11:25.802192] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-23T19:11:26.269717] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-23T19:11:26.492985] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T19:11:26.602214] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-23T19:11:27.057366] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:11:27.402214] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-23T19:11:27.920865] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T19:11:27.931464] [INFO ] [REMOTE ] HAE: Full fetch complete (57770 records). [2025-09-23T19:11:27.931677] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-23T19:11:28.208057] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-23T19:11:28.328492] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-23T19:11:28.328593] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-23T19:11:28.329371] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-23T19:11:28.329440] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-23T19:11:28.330834] [DEBUG] [LOCAL ] HAE: Trimmed 57770 records to 39544 (keeping 200 days of data) [2025-09-23T19:11:28.563855] [DEBUG] [LOCAL ] HAE: Primary data saved (39544 records). [2025-09-23T19:11:28.564098] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-23T19:11:28.564221] [INFO ] [MAIN ] Update Progress: 991/2372 symbols completed. HAE took 30.8s. Estimated remaining: 3h 3m 9s. Rate: 7.5 symbols/min [2025-09-23T19:11:28.737331] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:28.790185] [DEBUG] [LOCAL ] HASI: Loaded 47201 existing records from primary storage. [2025-09-23T19:11:28.803370] [INFO ] [MAIN ] HASI: Loaded 47201 existing records. [2025-09-23T19:11:28.890563] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T19:11:29.005849] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:29.005618] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-23T19:11:29.006886] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-23T19:11:29.006942] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-23T19:11:29.007955] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-23T19:11:29.008015] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-23T19:11:29.365852] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:29.802204] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-23T19:11:29.979283] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T19:11:30.356742] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T19:11:30.602199] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-23T19:11:30.937624] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T19:11:30.945815] [INFO ] [REMOTE ] H: Full fetch complete (61719 records). [2025-09-23T19:11:30.946083] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-23T19:11:31.373195] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-23T19:11:31.373282] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-23T19:11:31.374192] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-23T19:11:31.374262] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-23T19:11:31.375736] [DEBUG] [LOCAL ] H: Trimmed 61719 records to 44881 (keeping 200 days of data) [2025-09-23T19:11:31.442681] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-23T19:11:31.689046] [DEBUG] [LOCAL ] H: Primary data saved (44881 records). [2025-09-23T19:11:31.689202] [INFO ] [MAIN ] H: Full history saved. [2025-09-23T19:11:31.689314] [INFO ] [MAIN ] Update Progress: 992/2372 symbols completed. H took 35.8s. Estimated remaining: 3h 2m 54s. Rate: 7.5 symbols/min [2025-09-23T19:11:31.875869] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:31.929428] [DEBUG] [LOCAL ] HAYW: Loaded 48763 existing records from primary storage. [2025-09-23T19:11:31.929671] [INFO ] [MAIN ] HAYW: Loaded 48763 existing records. [2025-09-23T19:11:32.167316] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:32.169481] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T19:11:32.179238] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-23T19:11:32.179753] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-23T19:11:32.181073] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-23T19:11:32.181150] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-23T19:11:32.214315] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-23T19:11:32.587502] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:33.002217] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-23T19:11:33.135168] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:11:33.455536] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:11:33.802206] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-23T19:11:34.253994] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:11:34.602201] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-23T19:11:35.402164] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-23T19:11:35.740360] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T19:11:35.851704] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T19:11:36.202243] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-23T19:11:36.527146] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T19:11:37.002205] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-23T19:11:37.742673] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T19:11:37.802155] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-23T19:11:38.352143] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:11:38.602203] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-23T19:11:38.937140] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:11:39.402196] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-23T19:11:39.850345] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T19:11:40.202188] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-23T19:11:41.002162] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-23T19:11:41.057174] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T19:11:41.066137] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-23T19:11:41.066300] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-23T19:11:41.475497] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-23T19:11:41.475616] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-23T19:11:41.476545] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-23T19:11:41.476600] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-23T19:11:41.478102] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-09-23T19:11:41.810863] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-23T19:11:41.813935] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T19:11:41.823552] [INFO ] [REMOTE ] HAFN: Full fetch complete (66032 records). [2025-09-23T19:11:41.826723] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-23T19:11:42.296216] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-23T19:11:42.296607] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-23T19:11:42.296420] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-23T19:11:42.296811] [INFO ] [MAIN ] Update Progress: 993/2372 symbols completed. HAL took 27.2s. Estimated remaining: 3h 2m 50s. Rate: 7.5 symbols/min [2025-09-23T19:11:42.296872] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-23T19:11:42.303482] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-23T19:11:42.303591] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-23T19:11:42.392339] [DEBUG] [LOCAL ] HAFN: Trimmed 66032 records to 43614 (keeping 200 days of data) [2025-09-23T19:11:42.541489] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:42.598038] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:11:42.613108] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-23T19:11:42.616796] [DEBUG] [LOCAL ] HBB: Loaded 6937 existing records from primary storage. [2025-09-23T19:11:42.617700] [INFO ] [MAIN ] HBB: Loaded 6937 existing records. [2025-09-23T19:11:42.825529] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:42.827070] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-23T19:11:42.827723] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-23T19:11:42.829468] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-23T19:11:42.829821] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-23T19:11:43.329711] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:43.366846] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:11:43.404401] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-23T19:11:43.411725] [DEBUG] [LOCAL ] HAFN: Primary data saved (43614 records). [2025-09-23T19:11:43.411872] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-23T19:11:43.411961] [INFO ] [MAIN ] Update Progress: 994/2372 symbols completed. HAFN took 30.2s. Estimated remaining: 3h 2m 32s. Rate: 7.5 symbols/min [2025-09-23T19:11:43.590438] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:43.644781] [DEBUG] [LOCAL ] HBI: Loaded 53019 existing records from primary storage. [2025-09-23T19:11:43.645083] [INFO ] [MAIN ] HBI: Loaded 53019 existing records. [2025-09-23T19:11:43.833118] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:43.833427] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-23T19:11:43.833477] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-23T19:11:43.834493] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-23T19:11:43.834555] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-23T19:11:44.207818] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-23T19:11:44.213793] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:44.284393] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T19:11:44.626364] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T19:11:44.707802] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:11:45.002253] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-23T19:11:45.802286] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-23T19:11:46.315694] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T19:11:46.602207] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-23T19:11:47.050029] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T19:11:47.402221] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-23T19:11:47.870429] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T19:11:48.161265] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T19:11:48.202189] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-23T19:11:49.002224] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-23T19:11:49.380107] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T19:11:49.469667] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T19:11:49.802183] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-23T19:11:50.510667] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T19:11:50.602168] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-23T19:11:51.402234] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-23T19:11:51.862835] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T19:11:52.202239] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-23T19:11:52.678507] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T19:11:52.739142] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T19:11:53.002242] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-23T19:11:53.479615] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T19:11:53.802225] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-23T19:11:54.229461] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T19:11:54.602231] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-23T19:11:55.008508] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T19:11:55.402243] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-23T19:11:55.908269] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T19:11:56.202254] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-23T19:11:57.002208] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-23T19:11:57.473030] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:11:57.802232] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-23T19:11:58.198473] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:11:58.411771] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T19:11:58.413028] [INFO ] [REMOTE ] HBB: Full fetch complete (9992 records). [2025-09-23T19:11:58.413107] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-23T19:11:58.607277] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-23T19:11:58.819817] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-23T19:11:58.819903] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-23T19:11:58.820146] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-23T19:11:58.820182] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-23T19:11:58.820668] [DEBUG] [LOCAL ] HBB: Trimmed 9992 records to 6910 (keeping 200 days of data) [2025-09-23T19:11:58.863403] [DEBUG] [LOCAL ] HBB: Primary data saved (6910 records). [2025-09-23T19:11:58.863531] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-23T19:11:58.863615] [INFO ] [MAIN ] Update Progress: 995/2372 symbols completed. HBB took 16.6s. Estimated remaining: 3h 2m 35s. Rate: 7.5 symbols/min [2025-09-23T19:11:59.033136] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:59.090448] [DEBUG] [LOCAL ] HBM: Loaded 52908 existing records from primary storage. [2025-09-23T19:11:59.090594] [INFO ] [MAIN ] HBM: Loaded 52908 existing records. [2025-09-23T19:11:59.282082] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:59.282566] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-23T19:11:59.282688] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-23T19:11:59.283869] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-23T19:11:59.283930] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-23T19:11:59.407347] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-23T19:11:59.652991] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:59.918509] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:12:00.202246] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-23T19:12:00.869602] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:12:00.880490] [INFO ] [REMOTE ] HASI: Full fetch complete (67967 records). [2025-09-23T19:12:00.880663] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-23T19:12:01.007282] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-23T19:12:01.399923] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-23T19:12:01.400202] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-23T19:12:01.401548] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-23T19:12:01.401678] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-23T19:12:01.445690] [DEBUG] [LOCAL ] HASI: Trimmed 67967 records to 47221 (keeping 200 days of data) [2025-09-23T19:12:01.447906] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:12:01.763554] [DEBUG] [LOCAL ] HASI: Primary data saved (47221 records). [2025-09-23T19:12:01.763745] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-23T19:12:01.763897] [INFO ] [MAIN ] Update Progress: 996/2372 symbols completed. HASI took 33.2s. Estimated remaining: 3h 2m 20s. Rate: 7.5 symbols/min [2025-09-23T19:12:01.808558] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-23T19:12:01.945120] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:01.993534] [DEBUG] [LOCAL ] HCA: Loaded 47317 existing records from primary storage. [2025-09-23T19:12:01.993735] [INFO ] [MAIN ] HCA: Loaded 47317 existing records. [2025-09-23T19:12:02.206491] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:02.207097] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-23T19:12:02.207176] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-23T19:12:02.208519] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-23T19:12:02.208582] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-23T19:12:02.569248] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:02.602220] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-23T19:12:03.309851] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-23T19:12:03.402196] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-23T19:12:03.541421] [DEBUG] [REMOTE ] HAYW: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-23T19:12:03.541789] [WARN ] [REMOTE ] HAYW: No data returned for month 2025-07 [2025-09-23T19:12:04.202252] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-23T19:12:05.002247] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-23T19:12:05.358042] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-23T19:12:05.689504] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-23T19:12:05.783738] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:12:05.802166] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-23T19:12:06.173456] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:12:06.602248] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-23T19:12:07.275550] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T19:12:07.402204] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-23T19:12:07.887250] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:12:08.202208] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-23T19:12:08.795905] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:12:09.002191] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-23T19:12:09.802227] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-23T19:12:09.893151] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T19:12:10.582553] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:12:10.602162] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-23T19:12:11.182344] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:12:11.402219] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-23T19:12:12.140038] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T19:12:12.202203] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-23T19:12:12.758599] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:12:13.002252] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-23T19:12:13.626119] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:12:13.802212] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-23T19:12:14.602193] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-23T19:12:14.694113] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T19:12:14.703917] [INFO ] [REMOTE ] HAYW: Full fetch complete (63344 records). [2025-09-23T19:12:14.704082] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-23T19:12:14.914209] [WARN ] [VALIDATOR ] HAYW: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-23T19:12:14.914880] [FATAL] [MAIN ] HAYW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:12:14.914988] [WARN ] [MAIN ] HAYW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:12:14.915123] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-23T19:12:14.915219] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-09-23T19:12:14.915442] [INFO ] [LOCAL ] HAYW: Starting deletion of derivative data. [2025-09-23T19:12:14.915917] [DEBUG] [LOCAL ] HAYW: Deleted derivative data file. [2025-09-23T19:12:14.916058] [INFO ] [MAIN ] Update Progress: 997/2372 symbols completed. HAYW took 43.2s. Estimated remaining: 3h 2m 19s. Rate: 7.5 symbols/min [2025-09-23T19:12:15.402257] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-23T19:12:16.485155] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-23T19:12:16.497045] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-23T19:12:16.523256] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-23T19:12:17.002253] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-23T19:12:17.406666] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T19:12:17.802241] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-23T19:12:17.929131] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T19:12:18.602165] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-23T19:12:18.815943] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T19:12:19.330840] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:12:19.402251] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-23T19:12:20.062623] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T19:12:20.202217] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-23T19:12:21.002177] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-23T19:12:21.352449] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-23T19:12:21.551618] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:12:21.560726] [INFO ] [REMOTE ] HBI: Full fetch complete (76912 records). [2025-09-23T19:12:21.560918] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-23T19:12:21.807592] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-23T19:12:21.977691] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-23T19:12:21.977778] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-23T19:12:21.978767] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-23T19:12:21.978848] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-23T19:12:21.985447] [DEBUG] [LOCAL ] HBI: Trimmed 76912 records to 53017 (keeping 200 days of data) [2025-09-23T19:12:22.290165] [DEBUG] [LOCAL ] HBI: Primary data saved (53017 records). [2025-09-23T19:12:22.290347] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-23T19:12:22.290511] [INFO ] [MAIN ] Update Progress: 998/2372 symbols completed. HBI took 38.9s. Estimated remaining: 3h 2m 10s. Rate: 7.5 symbols/min [2025-09-23T19:12:22.354596] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T19:12:22.602206] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-23T19:12:23.154853] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T19:12:23.402257] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-23T19:12:24.020120] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T19:12:24.027967] [INFO ] [REMOTE ] HCA: Full fetch complete (69169 records). [2025-09-23T19:12:24.028126] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-23T19:12:24.414446] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-23T19:12:24.414529] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-23T19:12:24.415430] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-23T19:12:24.415495] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-23T19:12:24.416890] [DEBUG] [LOCAL ] HCA: Trimmed 69169 records to 47271 (keeping 200 days of data) [2025-09-23T19:12:24.744942] [DEBUG] [LOCAL ] HCA: Primary data saved (47271 records). [2025-09-23T19:12:24.745187] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-23T19:12:24.745322] [INFO ] [MAIN ] Update Progress: 999/2372 symbols completed. HCA took 23.0s. Estimated remaining: 3h 1m 55s. Rate: 7.5 symbols/min [2025-09-23T19:12:24.810624] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:12:24.822272] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-23T19:12:26.259386] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:12:26.272032] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-23T19:12:27.950952] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T19:12:27.962255] [INFO ] [REMOTE ] HBM: Full fetch complete (76056 records). [2025-09-23T19:12:27.962377] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-23T19:12:28.357449] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-23T19:12:28.357526] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-23T19:12:28.358406] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-23T19:12:28.358571] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-23T19:12:28.360728] [DEBUG] [LOCAL ] HBM: Trimmed 76056 records to 52903 (keeping 200 days of data) [2025-09-23T19:12:28.686686] [DEBUG] [LOCAL ] HBM: Primary data saved (52903 records). [2025-09-23T19:12:28.687358] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-23T19:12:28.687660] [INFO ] [MAIN ] Update Progress: 1000/2372 symbols completed. HBM took 29.8s. Estimated remaining: 3h 1m 41s. Rate: 7.6 symbols/min [2025-09-23T19:12:29.289083] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:29.336756] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:29.345775] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:29.404079] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:29.404323] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-23T19:12:29.404373] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-23T19:12:29.404685] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-23T19:12:29.404843] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-23T19:12:29.405037] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-23T19:12:29.405092] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-23T19:12:29.525286] [DEBUG] [LOCAL ] HCI: Loaded 13850 existing records from primary storage. [2025-09-23T19:12:29.541971] [INFO ] [MAIN ] HCI: Loaded 13850 existing records. [2025-09-23T19:12:29.906755] [DEBUG] [LOCAL ] HCC: Loaded 45340 existing records from primary storage. [2025-09-23T19:12:29.910937] [INFO ] [MAIN ] HCC: Loaded 45340 existing records. [2025-09-23T19:12:30.044749] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:30.068347] [DEBUG] [LOCAL ] HD: Loaded 53519 existing records from primary storage. [2025-09-23T19:12:30.136480] [INFO ] [MAIN ] HD: Loaded 53519 existing records. [2025-09-23T19:12:30.113840] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:30.140120] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-23T19:12:30.140529] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-23T19:12:30.140452] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-23T19:12:30.219534] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-23T19:12:30.219862] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-23T19:12:30.380167] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:30.404198] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-23T19:12:30.414549] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-23T19:12:30.438063] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-23T19:12:30.448559] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-23T19:12:30.647581] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-23T19:12:30.720442] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-23T19:12:30.714243] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:30.765717] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-23T19:12:30.777454] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-23T19:12:30.825978] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-23T19:12:30.831761] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-23T19:12:31.064567] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T19:12:31.146136] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-23T19:12:31.235307] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:31.324567] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-23T19:12:31.365145] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:31.403917] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-23T19:12:31.553528] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:31.553920] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-23T19:12:31.569664] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T19:12:31.570522] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-23T19:12:31.814263] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-23T19:12:31.815240] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-23T19:12:32.038159] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-23T19:12:32.094967] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T19:12:32.202164] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-23T19:12:32.508765] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-23T19:12:32.511048] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:12:33.002200] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-23T19:12:33.422037] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T19:12:33.802243] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-23T19:12:34.074513] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-23T19:12:34.232774] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:12:34.602204] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-23T19:12:34.859541] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-23T19:12:35.402198] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-23T19:12:36.202250] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-23T19:12:36.896020] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T19:12:36.934786] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T19:12:37.002162] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-23T19:12:37.802197] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-23T19:12:38.287632] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:12:38.602188] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-23T19:12:39.402217] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-23T19:12:39.587140] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T19:12:39.731878] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-23T19:12:39.732602] [INFO ] [REMOTE ] HCXY: Full fetch complete (606 records). [2025-09-23T19:12:39.732706] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-23T19:12:39.916281] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-23T19:12:39.916559] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:12:39.916698] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:12:39.917000] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-23T19:12:39.917221] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-23T19:12:39.917449] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-23T19:12:39.917620] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-23T19:12:39.917823] [INFO ] [MAIN ] Update Progress: 1001/2372 symbols completed. HCXY took 11.2s. Estimated remaining: 3h 1m 38s. Rate: 7.5 symbols/min [2025-09-23T19:12:40.093225] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:40.135166] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-23T19:12:40.200265] [DEBUG] [LOCAL ] HDB: Loaded 51938 existing records from primary storage. [2025-09-23T19:12:40.200448] [INFO ] [MAIN ] HDB: Loaded 51938 existing records. [2025-09-23T19:12:40.211631] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-23T19:12:40.388145] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:40.388381] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-23T19:12:40.388435] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-23T19:12:40.389990] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-23T19:12:40.390060] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-23T19:12:40.753805] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:40.806354] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T19:12:41.002185] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-23T19:12:41.802233] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-23T19:12:42.428910] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T19:12:42.602257] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-23T19:12:43.355053] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:12:43.402141] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-23T19:12:43.993532] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:12:44.202188] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-23T19:12:45.002226] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-23T19:12:45.449104] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T19:12:45.570377] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T19:12:45.802245] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-23T19:12:46.275383] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:12:46.418902] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:12:46.602261] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-23T19:12:47.402219] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-23T19:12:47.856799] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:12:48.202206] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-23T19:12:48.687184] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T19:12:49.002217] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-23T19:12:49.802235] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-23T19:12:50.022272] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T19:12:50.332248] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T19:12:50.508217] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T19:12:50.602206] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-23T19:12:51.402274] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-23T19:12:52.117634] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T19:12:52.202155] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-23T19:12:52.356389] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T19:12:53.002210] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-23T19:12:53.802241] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-23T19:12:54.075904] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T19:12:54.372348] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T19:12:54.514082] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T19:12:54.602149] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-23T19:12:55.259197] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T19:12:55.402209] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-23T19:12:56.202223] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-23T19:12:56.414575] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:12:57.002294] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-23T19:12:57.695084] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:12:57.802287] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-23T19:12:57.925633] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T19:12:57.928783] [INFO ] [REMOTE ] HCI: Full fetch complete (19389 records). [2025-09-23T19:12:57.928883] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-23T19:12:58.296631] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-23T19:12:58.296780] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-23T19:12:58.297219] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-23T19:12:58.297258] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-23T19:12:58.297866] [DEBUG] [LOCAL ] HCI: Trimmed 19389 records to 13926 (keeping 200 days of data) [2025-09-23T19:12:58.387390] [DEBUG] [LOCAL ] HCI: Primary data saved (13926 records). [2025-09-23T19:12:58.387529] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-23T19:12:58.387615] [INFO ] [MAIN ] Update Progress: 1002/2372 symbols completed. HCI took 29.7s. Estimated remaining: 3h 1m 44s. Rate: 7.5 symbols/min [2025-09-23T19:12:58.555324] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:58.602841] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-23T19:12:58.604721] [DEBUG] [LOCAL ] HE: Loaded 49245 existing records from primary storage. [2025-09-23T19:12:58.604968] [INFO ] [MAIN ] HE: Loaded 49245 existing records. [2025-09-23T19:12:58.786760] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:58.787017] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-23T19:12:58.787070] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-23T19:12:58.788075] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-23T19:12:58.788160] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-23T19:12:59.138194] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:59.199900] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:12:59.402206] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-23T19:13:00.202223] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-23T19:13:00.426370] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T19:13:00.938272] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T19:13:01.002165] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-23T19:13:01.506931] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:13:01.802200] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-23T19:13:02.490138] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:13:02.602207] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-23T19:13:03.029999] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T19:13:03.402202] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-23T19:13:03.995530] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:13:04.202204] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-23T19:13:05.002164] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-23T19:13:05.165703] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T19:13:05.432292] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:13:05.439507] [INFO ] [REMOTE ] HCC: Full fetch complete (64249 records). [2025-09-23T19:13:05.439612] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-23T19:13:05.804740] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-23T19:13:05.844787] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-23T19:13:05.844876] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-23T19:13:05.845717] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-23T19:13:05.845780] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-23T19:13:05.848041] [DEBUG] [LOCAL ] HCC: Trimmed 64249 records to 45383 (keeping 200 days of data) [2025-09-23T19:13:06.133669] [DEBUG] [LOCAL ] HCC: Primary data saved (45383 records). [2025-09-23T19:13:06.133830] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-23T19:13:06.133936] [INFO ] [MAIN ] Update Progress: 1003/2372 symbols completed. HCC took 37.4s. Estimated remaining: 3h 1m 36s. Rate: 7.5 symbols/min [2025-09-23T19:13:06.304783] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:06.341633] [DEBUG] [LOCAL ] HEI: Loaded 32667 existing records from primary storage. [2025-09-23T19:13:06.341799] [INFO ] [MAIN ] HEI: Loaded 32667 existing records. [2025-09-23T19:13:06.526626] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:06.527136] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-23T19:13:06.527238] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-23T19:13:06.528454] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-23T19:13:06.528518] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-23T19:13:06.607728] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-23T19:13:06.718603] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:13:06.816146] [INFO ] [REMOTE ] HDB: Full fetch complete (75232 records). [2025-09-23T19:13:06.838057] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-23T19:13:07.068602] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:07.342926] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-23T19:13:07.343042] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-23T19:13:07.344038] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-23T19:13:07.344121] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-23T19:13:07.346038] [DEBUG] [LOCAL ] HDB: Trimmed 75232 records to 51936 (keeping 200 days of data) [2025-09-23T19:13:07.375546] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:13:07.436902] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-23T19:13:07.700634] [DEBUG] [LOCAL ] HDB: Primary data saved (51936 records). [2025-09-23T19:13:07.700797] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-23T19:13:07.700883] [INFO ] [MAIN ] Update Progress: 1004/2372 symbols completed. HDB took 27.8s. Estimated remaining: 3h 1m 19s. Rate: 7.5 symbols/min [2025-09-23T19:13:07.868162] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:07.875499] [DEBUG] [LOCAL ] HEQ: Loaded 6186 existing records from primary storage. [2025-09-23T19:13:07.875590] [INFO ] [MAIN ] HEQ: Loaded 6186 existing records. [2025-09-23T19:13:08.056919] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:08.057171] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-23T19:13:08.057222] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-23T19:13:08.057532] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-23T19:13:08.057594] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-23T19:13:08.207345] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-23T19:13:08.421634] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:08.535737] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T19:13:08.696588] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T19:13:09.002230] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-23T19:13:09.666209] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T19:13:09.802214] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-23T19:13:10.109134] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T19:13:10.602258] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-23T19:13:11.070042] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T19:13:11.402215] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-23T19:13:11.706556] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T19:13:12.202282] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-23T19:13:13.002293] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-23T19:13:13.174874] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T19:13:13.454133] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:13:13.802259] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-23T19:13:14.297931] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T19:13:14.602281] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-23T19:13:15.110715] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T19:13:15.402227] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-23T19:13:15.815938] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T19:13:16.202253] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-23T19:13:16.583193] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T19:13:16.592205] [INFO ] [REMOTE ] HD: Full fetch complete (77445 records). [2025-09-23T19:13:16.592361] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-23T19:13:16.989676] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-23T19:13:16.989795] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-23T19:13:16.990740] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-23T19:13:16.990806] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-23T19:13:16.992341] [DEBUG] [LOCAL ] HD: Trimmed 77445 records to 53520 (keeping 200 days of data) [2025-09-23T19:13:17.052397] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-23T19:13:17.337061] [DEBUG] [LOCAL ] HD: Primary data saved (53520 records). [2025-09-23T19:13:17.337213] [INFO ] [MAIN ] HD: Full history saved. [2025-09-23T19:13:17.339124] [INFO ] [MAIN ] Update Progress: 1005/2372 symbols completed. HD took 48.6s. Estimated remaining: 3h 1m 14s. Rate: 7.5 symbols/min [2025-09-23T19:13:17.510158] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:17.582927] [DEBUG] [LOCAL ] HESM: Loaded 48154 existing records from primary storage. [2025-09-23T19:13:17.584713] [INFO ] [MAIN ] HESM: Loaded 48154 existing records. [2025-09-23T19:13:17.584478] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T19:13:17.787205] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:17.787578] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-23T19:13:17.787683] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-23T19:13:17.789145] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-23T19:13:17.789212] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-23T19:13:17.810162] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-23T19:13:18.186059] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:18.340329] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T19:13:18.602263] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-23T19:13:18.736975] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:13:19.402290] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-23T19:13:19.938946] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:13:19.947266] [INFO ] [REMOTE ] HE: Full fetch complete (72502 records). [2025-09-23T19:13:19.947421] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-23T19:13:20.207340] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-23T19:13:20.342804] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-23T19:13:20.343028] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-23T19:13:20.343983] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-23T19:13:20.344049] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-23T19:13:20.345624] [DEBUG] [LOCAL ] HE: Trimmed 72502 records to 49238 (keeping 200 days of data) [2025-09-23T19:13:20.664280] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T19:13:20.683287] [DEBUG] [LOCAL ] HE: Primary data saved (49238 records). [2025-09-23T19:13:20.683414] [INFO ] [MAIN ] HE: Full history saved. [2025-09-23T19:13:20.683493] [INFO ] [MAIN ] Update Progress: 1006/2372 symbols completed. HE took 22.3s. Estimated remaining: 3h 0m 59s. Rate: 7.5 symbols/min [2025-09-23T19:13:20.855109] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:20.855310] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-23T19:13:20.855364] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-23T19:13:20.855522] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-23T19:13:20.855564] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-23T19:13:20.855605] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-23T19:13:20.855637] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-23T19:13:21.007329] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-23T19:13:21.224876] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:21.450719] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:13:21.802183] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-23T19:13:22.048198] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T19:13:22.058410] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-23T19:13:22.602271] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-23T19:13:23.014904] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T19:13:23.402255] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-23T19:13:23.647191] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-23T19:13:24.202263] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-23T19:13:24.503611] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-23T19:13:25.002247] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-23T19:13:25.802199] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-23T19:13:26.060139] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-23T19:13:26.292720] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:13:26.602230] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-23T19:13:26.978510] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T19:13:27.402191] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-23T19:13:27.850338] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T19:13:28.202203] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-23T19:13:29.002225] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-23T19:13:29.315299] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:13:29.802178] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-23T19:13:30.120246] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T19:13:30.214907] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T19:13:30.602255] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-23T19:13:31.185169] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T19:13:31.402188] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-23T19:13:31.805879] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T19:13:32.202212] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-23T19:13:33.002205] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-23T19:13:33.267781] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-23T19:13:33.766252] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T19:13:33.771308] [INFO ] [REMOTE ] HEI: Full fetch complete (49169 records). [2025-09-23T19:13:33.771467] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-23T19:13:33.807263] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-23T19:13:34.164925] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-23T19:13:34.165020] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-23T19:13:34.165917] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-23T19:13:34.165982] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-23T19:13:34.167088] [DEBUG] [LOCAL ] HEI: Trimmed 49169 records to 32626 (keeping 200 days of data) [2025-09-23T19:13:34.370764] [DEBUG] [LOCAL ] HEI: Primary data saved (32626 records). [2025-09-23T19:13:34.370911] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-23T19:13:34.371001] [INFO ] [MAIN ] Update Progress: 1007/2372 symbols completed. HEI took 28.2s. Estimated remaining: 3h 0m 59s. Rate: 7.5 symbols/min [2025-09-23T19:13:34.553048] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:34.553224] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-23T19:13:34.553261] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-23T19:13:34.553412] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-23T19:13:34.553454] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-23T19:13:34.553496] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-23T19:13:34.553530] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-23T19:13:34.609466] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-23T19:13:34.918280] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:34.986588] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T19:13:35.059770] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:13:35.402194] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-23T19:13:35.667172] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T19:13:36.202211] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-23T19:13:37.002214] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-23T19:13:37.414450] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T19:13:37.589512] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T19:13:37.802195] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-23T19:13:38.602224] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-23T19:13:38.841544] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-23T19:13:39.102189] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T19:13:39.402270] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-23T19:13:39.727577] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-23T19:13:40.202251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-23T19:13:40.545038] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-23T19:13:40.545888] [INFO ] [REMOTE ] HF: Full fetch complete (507 records). [2025-09-23T19:13:40.545964] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-23T19:13:40.546370] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T19:13:40.546459] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:13:40.546502] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:13:40.546543] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-23T19:13:40.546614] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-23T19:13:40.546695] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-23T19:13:40.547112] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-23T19:13:40.547465] [INFO ] [MAIN ] Update Progress: 1008/2372 symbols completed. HF took 19.9s. Estimated remaining: 3h 0m 49s. Rate: 7.5 symbols/min [2025-09-23T19:13:40.729120] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:40.747999] [DEBUG] [LOCAL ] HFRO: Loaded 17449 existing records from primary storage. [2025-09-23T19:13:40.748154] [INFO ] [MAIN ] HFRO: Loaded 17449 existing records. [2025-09-23T19:13:40.938467] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:40.938785] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-23T19:13:40.938840] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-23T19:13:40.939431] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-23T19:13:40.939491] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-23T19:13:41.007424] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-23T19:13:41.308306] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:41.550247] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T19:13:41.802191] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-23T19:13:42.337838] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T19:13:42.339931] [INFO ] [REMOTE ] HEQ: Full fetch complete (9054 records). [2025-09-23T19:13:42.340000] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-23T19:13:42.607434] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-23T19:13:42.758448] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-23T19:13:42.758548] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-23T19:13:42.758924] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-23T19:13:42.758995] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-23T19:13:42.759574] [DEBUG] [LOCAL ] HEQ: Trimmed 9054 records to 6183 (keeping 200 days of data) [2025-09-23T19:13:42.796988] [DEBUG] [LOCAL ] HEQ: Primary data saved (6183 records). [2025-09-23T19:13:42.797096] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-23T19:13:42.797193] [INFO ] [MAIN ] Update Progress: 1009/2372 symbols completed. HEQ took 35.1s. Estimated remaining: 3h 0m 33s. Rate: 7.5 symbols/min [2025-09-23T19:13:42.978409] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:42.993236] [DEBUG] [LOCAL ] HGER: Loaded 12907 existing records from primary storage. [2025-09-23T19:13:42.993362] [INFO ] [MAIN ] HGER: Loaded 12907 existing records. [2025-09-23T19:13:43.186341] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:43.186625] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-23T19:13:43.186707] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-23T19:13:43.187255] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-23T19:13:43.187314] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-23T19:13:43.410293] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-23T19:13:43.557892] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:43.575525] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T19:13:43.770046] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-23T19:13:44.202248] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-23T19:13:44.688419] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T19:13:45.002240] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-23T19:13:45.422399] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T19:13:45.802190] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-23T19:13:46.220952] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T19:13:46.602201] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-23T19:13:47.337283] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T19:13:47.402203] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-23T19:13:47.783964] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T19:13:48.202204] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-23T19:13:49.002249] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-23T19:13:49.173034] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T19:13:49.462220] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T19:13:49.802275] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-23T19:13:50.088043] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-23T19:13:50.602213] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-23T19:13:51.140001] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T19:13:51.402231] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-23T19:13:51.910088] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T19:13:52.202203] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-23T19:13:52.627987] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T19:13:53.002200] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-23T19:13:53.276542] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-23T19:13:53.802214] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-23T19:13:54.081211] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-23T19:13:54.602257] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-23T19:13:55.380632] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T19:13:55.402136] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-23T19:13:56.202169] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-23T19:13:56.350664] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:13:57.002206] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-23T19:13:57.465238] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T19:13:57.546930] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T19:13:57.802209] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-23T19:13:58.594290] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T19:13:58.598075] [INFO ] [REMOTE ] HGER: Full fetch complete (16072 records). [2025-09-23T19:13:58.598161] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-23T19:13:58.609436] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-23T19:13:58.979507] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-23T19:13:58.979591] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-23T19:13:58.980009] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-23T19:13:58.980073] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-23T19:13:58.980707] [DEBUG] [LOCAL ] HGER: Trimmed 16072 records to 13005 (keeping 200 days of data) [2025-09-23T19:13:59.062145] [DEBUG] [LOCAL ] HGER: Primary data saved (13005 records). [2025-09-23T19:13:59.062293] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-23T19:13:59.062379] [INFO ] [MAIN ] Update Progress: 1010/2372 symbols completed. HGER took 16.3s. Estimated remaining: 3h 0m 36s. Rate: 7.5 symbols/min [2025-09-23T19:13:59.234987] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:59.245869] [DEBUG] [LOCAL ] HGLB: Loaded 9732 existing records from primary storage. [2025-09-23T19:13:59.246010] [INFO ] [MAIN ] HGLB: Loaded 9732 existing records. [2025-09-23T19:13:59.407957] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-23T19:13:59.435917] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:59.437218] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-23T19:13:59.437309] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-23T19:13:59.437911] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-23T19:13:59.437975] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-23T19:13:59.801007] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:00.008262] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:14:00.202323] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-23T19:14:00.306206] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T19:14:00.729079] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T19:14:01.002238] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-23T19:14:01.630856] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:14:01.802238] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-23T19:14:02.345480] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T19:14:02.602208] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-23T19:14:03.402189] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-23T19:14:03.876195] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T19:14:04.033210] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T19:14:04.202233] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-23T19:14:05.002193] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-23T19:14:05.280961] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-23T19:14:05.433509] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T19:14:05.802194] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-23T19:14:06.419901] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T19:14:06.602210] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-23T19:14:07.402198] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-23T19:14:08.076513] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T19:14:08.084983] [INFO ] [REMOTE ] HESM: Full fetch complete (68793 records). [2025-09-23T19:14:08.085205] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-23T19:14:08.204213] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-23T19:14:08.408829] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:14:08.506921] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-23T19:14:08.507034] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-23T19:14:08.508223] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-23T19:14:08.508292] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-23T19:14:08.509856] [DEBUG] [LOCAL ] HESM: Trimmed 68793 records to 48167 (keeping 200 days of data) [2025-09-23T19:14:08.819453] [DEBUG] [LOCAL ] HESM: Primary data saved (48167 records). [2025-09-23T19:14:08.819591] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-23T19:14:08.819699] [INFO ] [MAIN ] Update Progress: 1011/2372 symbols completed. HESM took 51.5s. Estimated remaining: 3h 0m 31s. Rate: 7.5 symbols/min [2025-09-23T19:14:08.995299] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:09.003316] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-23T19:14:09.010771] [DEBUG] [LOCAL ] HGTY: Loaded 13004 existing records from primary storage. [2025-09-23T19:14:09.010907] [INFO ] [MAIN ] HGTY: Loaded 13004 existing records. [2025-09-23T19:14:09.123116] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:14:09.208970] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:09.209239] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-23T19:14:09.209292] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-23T19:14:09.209861] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-23T19:14:09.209922] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-23T19:14:09.557171] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:09.701418] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T19:14:09.705117] [INFO ] [REMOTE ] HFRO: Full fetch complete (28725 records). [2025-09-23T19:14:09.705202] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-23T19:14:09.804790] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-23T19:14:10.077255] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-23T19:14:10.077420] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-23T19:14:10.077991] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-23T19:14:10.078053] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-23T19:14:10.078827] [DEBUG] [LOCAL ] HFRO: Trimmed 28725 records to 17383 (keeping 200 days of data) [2025-09-23T19:14:10.186381] [DEBUG] [LOCAL ] HFRO: Primary data saved (17383 records). [2025-09-23T19:14:10.186551] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-23T19:14:10.186676] [INFO ] [MAIN ] Update Progress: 1012/2372 symbols completed. HFRO took 29.6s. Estimated remaining: 3h 0m 14s. Rate: 7.5 symbols/min [2025-09-23T19:14:10.356385] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:10.403210] [DEBUG] [LOCAL ] HGV: Loaded 47015 existing records from primary storage. [2025-09-23T19:14:10.403382] [INFO ] [MAIN ] HGV: Loaded 47015 existing records. [2025-09-23T19:14:10.582825] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:10.583163] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-23T19:14:10.583218] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-23T19:14:10.584681] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-23T19:14:10.584742] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-23T19:14:10.607319] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-23T19:14:10.713761] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T19:14:10.968173] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:10.970903] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T19:14:11.402207] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-23T19:14:11.794013] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T19:14:11.795190] [INFO ] [REMOTE ] HFND: Full fetch complete (1782 records). [2025-09-23T19:14:11.795268] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-23T19:14:11.996213] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-23T19:14:11.996479] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:14:11.996547] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:14:11.996623] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-23T19:14:11.996737] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-23T19:14:11.996791] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-23T19:14:11.997080] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-23T19:14:11.997445] [INFO ] [MAIN ] Update Progress: 1013/2372 symbols completed. HFND took 37.6s. Estimated remaining: 2h 59m 58s. Rate: 7.6 symbols/min [2025-09-23T19:14:12.178533] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:12.211159] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-23T19:14:12.213997] [DEBUG] [LOCAL ] HHH: Loaded 32676 existing records from primary storage. [2025-09-23T19:14:12.214179] [INFO ] [MAIN ] HHH: Loaded 32676 existing records. [2025-09-23T19:14:12.421397] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:12.421697] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-23T19:14:12.421790] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-23T19:14:12.422855] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-23T19:14:12.422919] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-23T19:14:12.820533] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:12.930791] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T19:14:13.002218] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-23T19:14:13.802205] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-23T19:14:14.107598] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:14:14.431779] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:14:14.602202] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-23T19:14:15.402233] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-23T19:14:15.655788] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T19:14:16.182252] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T19:14:16.202139] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-23T19:14:16.778012] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T19:14:17.002229] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-23T19:14:17.802206] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-23T19:14:18.283753] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T19:14:18.436339] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T19:14:18.602200] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-23T19:14:19.052566] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T19:14:19.402209] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-23T19:14:20.202279] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-23T19:14:20.531469] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:14:21.002230] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-23T19:14:21.124153] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T19:14:21.802203] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-23T19:14:22.095049] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T19:14:22.602225] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-23T19:14:22.745158] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T19:14:23.109141] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T19:14:23.402210] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-23T19:14:24.202195] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-23T19:14:24.637525] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T19:14:25.002209] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-23T19:14:25.461350] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T19:14:25.592426] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:14:25.802217] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-23T19:14:26.602195] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-23T19:14:27.004825] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:14:27.402235] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-23T19:14:27.828579] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:14:28.168259] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T19:14:28.202219] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-23T19:14:29.002207] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-23T19:14:29.424354] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T19:14:29.802189] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-23T19:14:30.020141] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:14:30.602190] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-23T19:14:30.986328] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:14:31.168304] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T19:14:31.402191] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-23T19:14:31.953021] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T19:14:32.202192] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-23T19:14:32.767461] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T19:14:33.002190] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-23T19:14:33.802195] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-23T19:14:34.289881] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:14:34.602203] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-23T19:14:35.198275] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:14:35.220103] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T19:14:35.224110] [INFO ] [REMOTE ] HGLB: Full fetch complete (14301 records). [2025-09-23T19:14:35.224217] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-23T19:14:35.413828] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-23T19:14:35.600745] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-23T19:14:35.600826] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-23T19:14:35.601219] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-23T19:14:35.601316] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-23T19:14:35.601905] [DEBUG] [LOCAL ] HGLB: Trimmed 14301 records to 9713 (keeping 200 days of data) [2025-09-23T19:14:35.671419] [DEBUG] [LOCAL ] HGLB: Primary data saved (9713 records). [2025-09-23T19:14:35.671588] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-23T19:14:35.671806] [INFO ] [MAIN ] Update Progress: 1014/2372 symbols completed. HGLB took 36.6s. Estimated remaining: 3h 0m 11s. Rate: 7.5 symbols/min [2025-09-23T19:14:35.844145] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:35.886928] [DEBUG] [LOCAL ] HI: Loaded 35066 existing records from primary storage. [2025-09-23T19:14:35.887115] [INFO ] [MAIN ] HI: Loaded 35066 existing records. [2025-09-23T19:14:36.063354] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:36.063661] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-23T19:14:36.063735] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-23T19:14:36.064829] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-23T19:14:36.064944] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-23T19:14:36.207272] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-23T19:14:36.441071] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:36.710552] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:14:37.002200] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-23T19:14:37.457612] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T19:14:37.685368] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:14:37.802232] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-23T19:14:38.602205] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-23T19:14:38.962487] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T19:14:38.967991] [INFO ] [REMOTE ] HHH: Full fetch complete (45074 records). [2025-09-23T19:14:38.968078] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-23T19:14:39.381840] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-23T19:14:39.381925] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-23T19:14:39.382619] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-23T19:14:39.382696] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-23T19:14:39.383816] [DEBUG] [LOCAL ] HHH: Trimmed 45074 records to 32677 (keeping 200 days of data) [2025-09-23T19:14:39.441041] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-23T19:14:39.538676] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T19:14:39.628488] [DEBUG] [LOCAL ] HHH: Primary data saved (32677 records). [2025-09-23T19:14:39.628801] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-23T19:14:39.629044] [INFO ] [MAIN ] Update Progress: 1015/2372 symbols completed. HHH took 27.6s. Estimated remaining: 2h 59m 58s. Rate: 7.5 symbols/min [2025-09-23T19:14:39.806801] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:39.872827] [DEBUG] [LOCAL ] HIG: Loaded 51259 existing records from primary storage. [2025-09-23T19:14:39.872990] [INFO ] [MAIN ] HIG: Loaded 51259 existing records. [2025-09-23T19:14:40.054036] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:40.054280] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-23T19:14:40.054330] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-23T19:14:40.055906] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-23T19:14:40.055987] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-23T19:14:40.208768] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-23T19:14:40.435243] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:40.662257] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T19:14:40.671621] [INFO ] [REMOTE ] HGV: Full fetch complete (65688 records). [2025-09-23T19:14:40.671830] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-23T19:14:40.922710] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T19:14:41.007291] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-23T19:14:41.093287] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-23T19:14:41.093448] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-23T19:14:41.094409] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-23T19:14:41.094492] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-23T19:14:41.096152] [DEBUG] [LOCAL ] HGV: Trimmed 65688 records to 46971 (keeping 200 days of data) [2025-09-23T19:14:41.382311] [DEBUG] [LOCAL ] HGV: Primary data saved (46971 records). [2025-09-23T19:14:41.382477] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-23T19:14:41.382590] [INFO ] [MAIN ] Update Progress: 1016/2372 symbols completed. HGV took 31.2s. Estimated remaining: 2h 59m 41s. Rate: 7.5 symbols/min [2025-09-23T19:14:41.588216] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:41.633678] [DEBUG] [LOCAL ] HII: Loaded 35414 existing records from primary storage. [2025-09-23T19:14:41.633836] [INFO ] [MAIN ] HII: Loaded 35414 existing records. [2025-09-23T19:14:41.804634] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-23T19:14:41.955743] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:41.967684] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T19:14:41.967880] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-23T19:14:41.975916] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-23T19:14:41.977487] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-23T19:14:41.977587] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-23T19:14:42.498484] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:42.602262] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-23T19:14:42.723172] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:14:43.402203] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-23T19:14:44.202242] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-23T19:14:44.361686] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T19:14:45.002194] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-23T19:14:45.421399] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-09-23T19:14:45.425875] [INFO ] [REMOTE ] HGTY: Full fetch complete (17028 records). [2025-09-23T19:14:45.426071] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-23T19:14:45.426690] [FATAL] [VALIDATOR ] HGTY: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T19:14:45.426827] [FATAL] [MAIN ] HGTY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:14:45.426895] [WARN ] [MAIN ] HGTY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:14:45.426978] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-23T19:14:45.427074] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-09-23T19:14:45.427208] [INFO ] [LOCAL ] HGTY: Starting deletion of derivative data. [2025-09-23T19:14:45.427740] [DEBUG] [LOCAL ] HGTY: Deleted derivative data file. [2025-09-23T19:14:45.427932] [INFO ] [MAIN ] Update Progress: 1017/2372 symbols completed. HGTY took 36.6s. Estimated remaining: 2h 59m 28s. Rate: 7.5 symbols/min [2025-09-23T19:14:45.558956] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T19:14:45.639600] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:45.706872] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-23T19:14:45.707011] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-09-23T19:14:45.807945] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-23T19:14:45.896411] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:45.897074] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-23T19:14:45.897176] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-23T19:14:45.898955] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-23T19:14:45.899018] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-23T19:14:46.269103] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:46.290089] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:14:46.602249] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-23T19:14:47.067413] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T19:14:47.402228] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-23T19:14:48.202258] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-23T19:14:48.777859] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T19:14:48.856760] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T19:14:49.002185] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-23T19:14:49.352558] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T19:14:49.802173] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-23T19:14:50.243984] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:14:50.602200] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-23T19:14:50.895275] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T19:14:51.402212] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-23T19:14:52.031606] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T19:14:52.202173] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-23T19:14:53.002250] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-23T19:14:53.263548] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:14:53.410704] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-23T19:14:53.802256] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-23T19:14:54.172113] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T19:14:54.602261] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-23T19:14:55.402204] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-23T19:14:55.575795] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:14:55.980752] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-23T19:14:56.202184] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-23T19:14:57.002158] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-23T19:14:57.332521] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T19:14:57.802177] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-23T19:14:58.251546] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:14:58.465544] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-23T19:14:58.602213] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-23T19:14:58.934985] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:14:59.402199] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-23T19:15:00.202242] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-23T19:15:01.006003] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-23T19:15:01.008069] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T19:15:01.138854] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T19:15:01.144709] [INFO ] [REMOTE ] HI: Full fetch complete (49661 records). [2025-09-23T19:15:01.144816] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-23T19:15:01.548470] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-23T19:15:01.548833] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-23T19:15:01.550130] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-23T19:15:01.550266] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-23T19:15:01.551914] [DEBUG] [LOCAL ] HI: Trimmed 49661 records to 35121 (keeping 200 days of data) [2025-09-23T19:15:01.684786] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-09-23T19:15:01.807446] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-23T19:15:01.845126] [DEBUG] [LOCAL ] HI: Primary data saved (35121 records). [2025-09-23T19:15:01.845289] [INFO ] [MAIN ] HI: Full history saved. [2025-09-23T19:15:01.845394] [INFO ] [MAIN ] Update Progress: 1018/2372 symbols completed. HI took 26.2s. Estimated remaining: 2h 59m 32s. Rate: 7.5 symbols/min [2025-09-23T19:15:02.021864] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:02.045808] [DEBUG] [LOCAL ] HIO: Loaded 23761 existing records from primary storage. [2025-09-23T19:15:02.045956] [INFO ] [MAIN ] HIO: Loaded 23761 existing records. [2025-09-23T19:15:02.229483] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:02.229885] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-23T19:15:02.229944] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-23T19:15:02.231064] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-23T19:15:02.231128] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-23T19:15:02.596660] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:02.602227] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-23T19:15:03.207560] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-23T19:15:03.402330] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-23T19:15:04.202254] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-23T19:15:05.966870] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (3.36 seconds). [2025-09-23T19:15:05.972636] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-23T19:15:06.302081] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (4.49 seconds). [2025-09-23T19:15:06.312426] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-23T19:15:07.200262] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:15:07.206994] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-23T19:15:07.388550] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (3.99 seconds). [2025-09-23T19:15:07.402163] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-23T19:15:07.809887] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T19:15:07.989321] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T19:15:08.202241] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-23T19:15:08.565208] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:15:09.002244] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-23T19:15:09.193352] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (4.99 seconds). [2025-09-23T19:15:09.440637] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T19:15:09.802268] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-23T19:15:09.937835] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T19:15:10.602267] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-23T19:15:11.338110] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T19:15:11.348171] [INFO ] [REMOTE ] HIG: Full fetch complete (73260 records). [2025-09-23T19:15:11.348327] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-23T19:15:11.409522] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-23T19:15:11.791916] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-23T19:15:11.792022] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-23T19:15:11.792960] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-23T19:15:11.793027] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-23T19:15:11.794519] [DEBUG] [LOCAL ] HIG: Trimmed 73260 records to 51268 (keeping 200 days of data) [2025-09-23T19:15:12.119540] [DEBUG] [LOCAL ] HIG: Primary data saved (51268 records). [2025-09-23T19:15:12.119725] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-23T19:15:12.119824] [INFO ] [MAIN ] Update Progress: 1019/2372 symbols completed. HIG took 32.5s. Estimated remaining: 2h 59m 27s. Rate: 7.5 symbols/min [2025-09-23T19:15:12.210987] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-23T19:15:12.293212] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:12.315928] [DEBUG] [LOCAL ] HIPO: Loaded 22871 existing records from primary storage. [2025-09-23T19:15:12.316059] [INFO ] [MAIN ] HIPO: Loaded 22871 existing records. [2025-09-23T19:15:12.502254] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:12.502568] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-23T19:15:12.502622] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-23T19:15:12.503333] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-23T19:15:12.503395] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-23T19:15:12.642308] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:15:12.890880] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:12.979304] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-23T19:15:13.002151] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-23T19:15:13.407677] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T19:15:13.802184] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-23T19:15:14.602252] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-23T19:15:15.402179] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-23T19:15:15.745772] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-23T19:15:16.040281] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (3.04 seconds). [2025-09-23T19:15:16.111913] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T19:15:16.202201] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-23T19:15:16.702547] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T19:15:16.943120] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T19:15:17.002193] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-23T19:15:17.802185] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-23T19:15:18.602223] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-23T19:15:18.790420] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T19:15:19.332399] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T19:15:19.397256] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-23T19:15:19.407552] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-23T19:15:20.202204] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-23T19:15:20.483109] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T19:15:20.489671] [INFO ] [REMOTE ] HII: Full fetch complete (53364 records). [2025-09-23T19:15:20.489871] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-23T19:15:20.929100] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T19:15:20.936499] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-23T19:15:20.937163] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-23T19:15:20.937965] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-23T19:15:20.938388] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-23T19:15:20.939487] [DEBUG] [LOCAL ] HII: Trimmed 53364 records to 35268 (keeping 200 days of data) [2025-09-23T19:15:21.008155] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-23T19:15:21.168772] [DEBUG] [LOCAL ] HII: Primary data saved (35268 records). [2025-09-23T19:15:21.168925] [INFO ] [MAIN ] HII: Full history saved. [2025-09-23T19:15:21.169027] [INFO ] [MAIN ] Update Progress: 1020/2372 symbols completed. HII took 39.8s. Estimated remaining: 2h 59m 20s. Rate: 7.5 symbols/min [2025-09-23T19:15:21.341167] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:21.386897] [DEBUG] [LOCAL ] HIW: Loaded 44755 existing records from primary storage. [2025-09-23T19:15:21.387041] [INFO ] [MAIN ] HIW: Loaded 44755 existing records. [2025-09-23T19:15:21.562282] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:21.562516] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-23T19:15:21.562564] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-23T19:15:21.563735] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-23T19:15:21.563798] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-23T19:15:21.807445] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-23T19:15:21.920537] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:22.158027] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T19:15:22.602238] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-23T19:15:23.402242] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-23T19:15:23.817534] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T19:15:24.202164] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-23T19:15:24.230208] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-23T19:15:24.239765] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-23T19:15:24.239924] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-23T19:15:24.591260] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T19:15:24.690735] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-23T19:15:24.690832] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-23T19:15:24.691848] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-23T19:15:24.691917] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-23T19:15:24.693508] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-09-23T19:15:24.957920] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T19:15:25.006304] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-23T19:15:25.057744] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-23T19:15:25.057901] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-23T19:15:25.057991] [INFO ] [MAIN ] Update Progress: 1021/2372 symbols completed. HIMS took 39.6s. Estimated remaining: 2h 59m 7s. Rate: 7.5 symbols/min [2025-09-23T19:15:25.225494] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:25.245340] [DEBUG] [LOCAL ] HIX: Loaded 20268 existing records from primary storage. [2025-09-23T19:15:25.245479] [INFO ] [MAIN ] HIX: Loaded 20268 existing records. [2025-09-23T19:15:25.425302] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:25.425563] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-23T19:15:25.425613] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-23T19:15:25.426327] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-23T19:15:25.426389] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-23T19:15:25.805499] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:25.805563] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-23T19:15:26.398134] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T19:15:26.602200] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-23T19:15:27.402207] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-23T19:15:27.924510] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T19:15:28.202252] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-23T19:15:28.225710] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T19:15:28.413177] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T19:15:28.950373] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T19:15:29.002201] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-23T19:15:29.802182] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-23T19:15:30.553325] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T19:15:30.608007] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-23T19:15:30.612736] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:15:30.618350] [INFO ] [REMOTE ] HIO: Full fetch complete (36760 records). [2025-09-23T19:15:30.618457] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-23T19:15:31.042484] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-23T19:15:31.042838] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-23T19:15:31.043503] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-23T19:15:31.043548] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-23T19:15:31.044697] [DEBUG] [LOCAL ] HIO: Trimmed 36760 records to 23711 (keeping 200 days of data) [2025-09-23T19:15:31.186835] [DEBUG] [LOCAL ] HIO: Primary data saved (23711 records). [2025-09-23T19:15:31.187023] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-23T19:15:31.187129] [INFO ] [MAIN ] Update Progress: 1022/2372 symbols completed. HIO took 29.3s. Estimated remaining: 2h 58m 57s. Rate: 7.5 symbols/min [2025-09-23T19:15:31.361464] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:31.380701] [DEBUG] [LOCAL ] HKD: Loaded 18201 existing records from primary storage. [2025-09-23T19:15:31.380855] [INFO ] [MAIN ] HKD: Loaded 18201 existing records. [2025-09-23T19:15:31.412111] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-23T19:15:31.585505] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:31.585798] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-23T19:15:31.585851] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-23T19:15:31.586382] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-23T19:15:31.586443] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-23T19:15:31.860362] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T19:15:31.970761] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:32.202175] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-23T19:15:32.540573] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T19:15:33.002209] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-23T19:15:33.099768] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T19:15:33.802218] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-23T19:15:34.393168] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T19:15:34.602259] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-23T19:15:34.830442] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T19:15:35.402220] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-23T19:15:35.827802] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:15:36.202175] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-23T19:15:36.528698] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:15:37.008083] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-23T19:15:37.018351] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T19:15:37.023042] [INFO ] [REMOTE ] HIPO: Full fetch complete (31770 records). [2025-09-23T19:15:37.023138] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-23T19:15:37.459108] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-23T19:15:37.459231] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-23T19:15:37.459952] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-23T19:15:37.460039] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-23T19:15:37.461666] [DEBUG] [LOCAL ] HIPO: Trimmed 31770 records to 22692 (keeping 200 days of data) [2025-09-23T19:15:37.614634] [DEBUG] [LOCAL ] HIPO: Primary data saved (22692 records). [2025-09-23T19:15:37.614810] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-23T19:15:37.614944] [INFO ] [MAIN ] Update Progress: 1023/2372 symbols completed. HIPO took 25.5s. Estimated remaining: 2h 58m 47s. Rate: 7.5 symbols/min [2025-09-23T19:15:37.819385] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:37.815126] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-23T19:15:37.872610] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-23T19:15:37.872921] [INFO ] [MAIN ] HL: Loaded 53670 existing records. [2025-09-23T19:15:38.066189] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:38.066478] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-23T19:15:38.066529] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-23T19:15:38.067713] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-23T19:15:38.067796] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-23T19:15:38.437828] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:38.489455] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T19:15:38.602160] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-23T19:15:38.866534] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T19:15:39.402229] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-23T19:15:39.728560] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T19:15:40.064285] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T19:15:40.202229] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-23T19:15:41.002203] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-23T19:15:41.106991] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T19:15:41.802233] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-23T19:15:41.900156] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T19:15:42.602221] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-23T19:15:43.287035] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T19:15:43.402182] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-23T19:15:44.113444] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T19:15:44.202162] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-23T19:15:44.987109] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:15:45.002148] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-23T19:15:45.222249] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T19:15:45.802230] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-23T19:15:46.205702] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:15:46.213471] [INFO ] [REMOTE ] HIW: Full fetch complete (64705 records). [2025-09-23T19:15:46.213605] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-23T19:15:46.601139] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-23T19:15:46.601234] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-23T19:15:46.602125] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-23T19:15:46.602240] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-23T19:15:46.602407] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-23T19:15:46.604860] [DEBUG] [LOCAL ] HIW: Trimmed 64705 records to 44739 (keeping 200 days of data) [2025-09-23T19:15:46.876450] [DEBUG] [LOCAL ] HIW: Primary data saved (44739 records). [2025-09-23T19:15:46.876591] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-23T19:15:46.876704] [INFO ] [MAIN ] Update Progress: 1024/2372 symbols completed. HIW took 25.7s. Estimated remaining: 2h 58m 40s. Rate: 7.5 symbols/min [2025-09-23T19:15:47.049232] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:47.095626] [DEBUG] [LOCAL ] HLF: Loaded 48773 existing records from primary storage. [2025-09-23T19:15:47.095854] [INFO ] [MAIN ] HLF: Loaded 48773 existing records. [2025-09-23T19:15:47.289472] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:47.289759] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-23T19:15:47.289816] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-23T19:15:47.290920] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-23T19:15:47.290989] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-23T19:15:47.404366] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-23T19:15:47.598389] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T19:15:47.685851] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:47.747872] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T19:15:48.202238] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-23T19:15:48.218249] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T19:15:49.002232] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-23T19:15:49.688623] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:15:49.802182] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-23T19:15:50.145040] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T19:15:50.602203] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-23T19:15:51.255209] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T19:15:51.313116] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T19:15:51.402201] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-23T19:15:52.202199] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-23T19:15:52.443369] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T19:15:53.002245] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-23T19:15:53.099235] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T19:15:53.802246] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-23T19:15:54.183967] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T19:15:54.558511] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T19:15:54.602148] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-23T19:15:55.402233] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-23T19:15:55.424832] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T19:15:55.428206] [INFO ] [REMOTE ] HIX: Full fetch complete (30611 records). [2025-09-23T19:15:55.428292] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-23T19:15:55.802760] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-23T19:15:55.802867] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-23T19:15:55.803473] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-23T19:15:55.803517] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-23T19:15:55.804309] [DEBUG] [LOCAL ] HIX: Trimmed 30611 records to 20270 (keeping 200 days of data) [2025-09-23T19:15:55.925428] [DEBUG] [LOCAL ] HIX: Primary data saved (20270 records). [2025-09-23T19:15:55.925559] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-23T19:15:55.925670] [INFO ] [MAIN ] Update Progress: 1025/2372 symbols completed. HIX took 30.9s. Estimated remaining: 2h 58m 34s. Rate: 7.5 symbols/min [2025-09-23T19:15:56.105590] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:56.143042] [DEBUG] [LOCAL ] HLI: Loaded 31269 existing records from primary storage. [2025-09-23T19:15:56.143204] [INFO ] [MAIN ] HLI: Loaded 31269 existing records. [2025-09-23T19:15:56.208299] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-23T19:15:56.341019] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:56.341400] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-23T19:15:56.341452] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-23T19:15:56.343083] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-23T19:15:56.343146] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-23T19:15:56.678374] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T19:15:56.750080] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:57.002236] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-23T19:15:57.774045] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:15:57.802153] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-23T19:15:58.396734] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:15:58.602256] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-23T19:15:59.248286] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T19:15:59.402176] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-23T19:15:59.457367] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:16:00.202211] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-23T19:16:01.002252] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-23T19:16:01.044486] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T19:16:01.802246] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-23T19:16:01.911797] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:16:01.937629] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T19:16:01.942996] [INFO ] [REMOTE ] HKD: Full fetch complete (28723 records). [2025-09-23T19:16:01.943206] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-23T19:16:02.324365] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-23T19:16:02.324460] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-23T19:16:02.325121] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-23T19:16:02.325191] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-23T19:16:02.326272] [DEBUG] [LOCAL ] HKD: Trimmed 28723 records to 18303 (keeping 200 days of data) [2025-09-23T19:16:02.439333] [DEBUG] [LOCAL ] HKD: Primary data saved (18303 records). [2025-09-23T19:16:02.439510] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-23T19:16:02.439608] [INFO ] [MAIN ] Update Progress: 1026/2372 symbols completed. HKD took 31.3s. Estimated remaining: 2h 58m 24s. Rate: 7.5 symbols/min [2025-09-23T19:16:02.607363] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-23T19:16:02.635356] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:02.663590] [DEBUG] [LOCAL ] HLIO: Loaded 28176 existing records from primary storage. [2025-09-23T19:16:02.663781] [INFO ] [MAIN ] HLIO: Loaded 28176 existing records. [2025-09-23T19:16:02.842615] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:02.842879] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-23T19:16:02.842927] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-23T19:16:02.843578] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-23T19:16:02.843685] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-23T19:16:03.210311] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:03.267186] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T19:16:03.402191] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-23T19:16:03.651943] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T19:16:04.202215] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-23T19:16:04.673411] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T19:16:05.002218] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-23T19:16:05.276706] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:16:05.802218] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-23T19:16:06.282293] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T19:16:06.444725] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T19:16:06.602197] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-23T19:16:07.402194] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-23T19:16:08.119053] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T19:16:08.152717] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T19:16:08.202147] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-23T19:16:09.002234] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-23T19:16:09.802231] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-23T19:16:10.238571] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T19:16:10.463128] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T19:16:10.606638] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-23T19:16:10.613845] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T19:16:11.402226] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-23T19:16:11.589913] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T19:16:12.202204] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-23T19:16:12.928761] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:16:13.002208] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-23T19:16:13.232953] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T19:16:13.802226] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-23T19:16:14.093192] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:16:14.611227] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-23T19:16:14.619250] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:16:15.402210] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-23T19:16:16.202195] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-23T19:16:16.253149] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T19:16:16.322688] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T19:16:17.002278] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-23T19:16:17.802211] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-23T19:16:17.911771] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:16:18.580604] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:16:18.602151] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-23T19:16:18.830270] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T19:16:19.402215] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-23T19:16:20.202199] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-23T19:16:20.318837] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T19:16:20.353458] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:16:20.361703] [INFO ] [REMOTE ] HLF: Full fetch complete (71411 records). [2025-09-23T19:16:20.361869] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-23T19:16:20.751468] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-23T19:16:20.751553] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-23T19:16:20.752412] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-23T19:16:20.752481] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-23T19:16:20.753983] [DEBUG] [LOCAL ] HLF: Trimmed 71411 records to 48724 (keeping 200 days of data) [2025-09-23T19:16:21.010842] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-23T19:16:21.036930] [DEBUG] [LOCAL ] HLF: Primary data saved (48724 records). [2025-09-23T19:16:21.037038] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-23T19:16:21.037140] [INFO ] [MAIN ] Update Progress: 1027/2372 symbols completed. HLF took 34.2s. Estimated remaining: 2h 58m 30s. Rate: 7.5 symbols/min [2025-09-23T19:16:21.212239] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:21.231926] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T19:16:21.266864] [DEBUG] [LOCAL ] HLLY: Loaded 33370 existing records from primary storage. [2025-09-23T19:16:21.267001] [INFO ] [MAIN ] HLLY: Loaded 33370 existing records. [2025-09-23T19:16:21.442066] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:21.442357] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-23T19:16:21.442406] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-23T19:16:21.443231] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-23T19:16:21.443291] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-23T19:16:21.793785] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:21.802164] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-23T19:16:22.029524] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:16:22.602207] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-23T19:16:22.875340] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T19:16:23.402194] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-23T19:16:24.199934] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T19:16:24.205714] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-23T19:16:24.838438] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-23T19:16:24.847540] [INFO ] [REMOTE ] HL: Full fetch complete (77652 records). [2025-09-23T19:16:24.847727] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-23T19:16:25.023080] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-23T19:16:25.244558] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-23T19:16:25.244686] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-23T19:16:25.245707] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-23T19:16:25.245919] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-23T19:16:25.247821] [DEBUG] [LOCAL ] HL: Trimmed 77652 records to 53670 (keeping 200 days of data) [2025-09-23T19:16:25.349480] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T19:16:25.357107] [INFO ] [REMOTE ] HLI: Full fetch complete (45214 records). [2025-09-23T19:16:25.358050] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-23T19:16:25.777931] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-23T19:16:25.778606] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-23T19:16:25.779560] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-23T19:16:25.779981] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-23T19:16:25.783003] [DEBUG] [LOCAL ] HLI: Trimmed 45214 records to 31220 (keeping 200 days of data) [2025-09-23T19:16:25.844064] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-23T19:16:26.148568] [DEBUG] [LOCAL ] HLI: Primary data saved (31220 records). [2025-09-23T19:16:26.149229] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T19:16:26.152139] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-23T19:16:26.192432] [INFO ] [MAIN ] Update Progress: 1028/2372 symbols completed. HLI took 30.3s. Estimated remaining: 2h 58m 18s. Rate: 7.5 symbols/min [2025-09-23T19:16:26.383452] [DEBUG] [LOCAL ] HL: Primary data saved (53670 records). [2025-09-23T19:16:26.399848] [INFO ] [MAIN ] HL: Full history saved. [2025-09-23T19:16:26.412673] [INFO ] [MAIN ] Update Progress: 1029/2372 symbols completed. HL took 48.8s. Estimated remaining: 2h 58m 0s. Rate: 7.5 symbols/min [2025-09-23T19:16:26.432926] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:26.612158] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-23T19:16:26.650781] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:26.700397] [DEBUG] [LOCAL ] HLN: Loaded 53089 existing records from primary storage. [2025-09-23T19:16:26.713235] [INFO ] [MAIN ] HLN: Loaded 53089 existing records. [2025-09-23T19:16:26.730327] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T19:16:26.883468] [DEBUG] [LOCAL ] HLT: Loaded 50774 existing records from primary storage. [2025-09-23T19:16:26.884025] [INFO ] [MAIN ] HLT: Loaded 50774 existing records. [2025-09-23T19:16:27.083393] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:27.112126] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-23T19:16:27.133264] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-23T19:16:27.152949] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:27.153108] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-23T19:16:27.153151] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-23T19:16:27.154070] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-23T19:16:27.154158] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-23T19:16:27.185292] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-23T19:16:27.217467] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-23T19:16:27.406254] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-23T19:16:27.866139] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:27.924563] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:27.945670] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T19:16:28.202188] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-23T19:16:29.002189] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-23T19:16:29.105274] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T19:16:29.530221] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T19:16:29.765043] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T19:16:29.769680] [INFO ] [REMOTE ] HLIO: Full fetch complete (36143 records). [2025-09-23T19:16:29.769780] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-23T19:16:29.807303] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-23T19:16:30.160411] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-23T19:16:30.160515] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-23T19:16:30.161177] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-23T19:16:30.161240] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-23T19:16:30.162287] [DEBUG] [LOCAL ] HLIO: Trimmed 36143 records to 28199 (keeping 200 days of data) [2025-09-23T19:16:30.340176] [DEBUG] [LOCAL ] HLIO: Primary data saved (28199 records). [2025-09-23T19:16:30.340327] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-23T19:16:30.340417] [INFO ] [MAIN ] Update Progress: 1030/2372 symbols completed. HLIO took 27.9s. Estimated remaining: 2h 57m 47s. Rate: 7.5 symbols/min [2025-09-23T19:16:30.510522] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:30.558712] [DEBUG] [LOCAL ] HLX: Loaded 48084 existing records from primary storage. [2025-09-23T19:16:30.558852] [INFO ] [MAIN ] HLX: Loaded 48084 existing records. [2025-09-23T19:16:30.612710] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-23T19:16:30.737826] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:30.738082] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-23T19:16:30.738130] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-23T19:16:30.739218] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-23T19:16:30.739282] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-23T19:16:31.151133] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:31.153367] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T19:16:31.402191] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-23T19:16:32.115054] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T19:16:32.202222] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-23T19:16:33.002205] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-23T19:16:33.046040] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T19:16:33.473845] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:16:33.802274] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-23T19:16:34.451889] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T19:16:34.602234] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-23T19:16:35.108517] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T19:16:35.402196] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-23T19:16:35.982715] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:16:36.202203] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-23T19:16:36.363828] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T19:16:37.002216] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-23T19:16:37.719411] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T19:16:37.750051] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:16:37.802227] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-23T19:16:38.602232] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-23T19:16:39.341366] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T19:16:39.402171] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-23T19:16:39.809939] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T19:16:40.202238] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-23T19:16:41.007546] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-23T19:16:41.038210] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:16:41.614616] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:16:41.802203] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-23T19:16:42.192388] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T19:16:42.602262] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-23T19:16:43.260807] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:16:43.402181] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-23T19:16:43.627760] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T19:16:44.202203] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-23T19:16:44.642821] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T19:16:45.002206] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-23T19:16:45.600005] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:16:45.802205] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-23T19:16:46.602510] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-23T19:16:46.923794] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T19:16:47.290436] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T19:16:47.402254] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-23T19:16:47.966333] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T19:16:48.202224] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-23T19:16:48.900986] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:16:49.002253] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-23T19:16:49.459277] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T19:16:49.802307] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-23T19:16:50.320116] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T19:16:50.602237] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-23T19:16:50.870866] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T19:16:51.402230] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-23T19:16:51.915434] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T19:16:51.925057] [INFO ] [REMOTE ] HLT: Full fetch complete (73433 records). [2025-09-23T19:16:51.925486] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-23T19:16:52.215865] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-23T19:16:52.381159] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-23T19:16:52.381277] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-23T19:16:52.382836] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-23T19:16:52.382965] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-23T19:16:52.388007] [DEBUG] [LOCAL ] HLT: Trimmed 73433 records to 50736 (keeping 200 days of data) [2025-09-23T19:16:52.724051] [DEBUG] [LOCAL ] HLT: Primary data saved (50736 records). [2025-09-23T19:16:52.724193] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-23T19:16:52.724358] [INFO ] [MAIN ] Update Progress: 1031/2372 symbols completed. HLT took 26.3s. Estimated remaining: 2h 57m 58s. Rate: 7.5 symbols/min [2025-09-23T19:16:52.903927] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:52.951942] [DEBUG] [LOCAL ] HMC: Loaded 46929 existing records from primary storage. [2025-09-23T19:16:52.952090] [INFO ] [MAIN ] HMC: Loaded 46929 existing records. [2025-09-23T19:16:53.009010] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-23T19:16:53.148173] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:53.148447] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-23T19:16:53.148518] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-23T19:16:53.149555] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-23T19:16:53.149635] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-23T19:16:53.562632] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:53.571437] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-23T19:16:53.622326] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T19:16:53.802217] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-23T19:16:54.168386] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T19:16:54.179584] [INFO ] [REMOTE ] HLLY: Full fetch complete (46290 records). [2025-09-23T19:16:54.179814] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-23T19:16:54.597442] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-23T19:16:54.597584] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-23T19:16:54.598278] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-23T19:16:54.598352] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-23T19:16:54.601665] [DEBUG] [LOCAL ] HLLY: Trimmed 46290 records to 33384 (keeping 200 days of data) [2025-09-23T19:16:54.602180] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-23T19:16:54.810106] [DEBUG] [LOCAL ] HLLY: Primary data saved (33384 records). [2025-09-23T19:16:54.810252] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-23T19:16:54.810395] [INFO ] [MAIN ] Update Progress: 1032/2372 symbols completed. HLLY took 33.8s. Estimated remaining: 2h 57m 42s. Rate: 7.5 symbols/min [2025-09-23T19:16:55.008165] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:55.039133] [DEBUG] [LOCAL ] HMN: Loaded 23306 existing records from primary storage. [2025-09-23T19:16:55.039293] [INFO ] [MAIN ] HMN: Loaded 23306 existing records. [2025-09-23T19:16:55.261742] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:55.262130] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-23T19:16:55.262193] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-23T19:16:55.263139] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-23T19:16:55.263224] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-23T19:16:55.405687] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-23T19:16:55.683889] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:55.713677] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-23T19:16:55.960573] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T19:16:56.202215] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-23T19:16:57.002175] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-23T19:16:57.205895] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T19:16:57.236308] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T19:16:57.802198] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-23T19:16:58.602209] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-23T19:16:58.749927] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:16:58.763251] [INFO ] [REMOTE ] HLN: Full fetch complete (76768 records). [2025-09-23T19:16:58.763400] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-23T19:16:59.192421] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-23T19:16:59.192668] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-23T19:16:59.193867] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-23T19:16:59.193973] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-23T19:16:59.196337] [DEBUG] [LOCAL ] HLN: Trimmed 76768 records to 53090 (keeping 200 days of data) [2025-09-23T19:16:59.340753] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T19:16:59.381573] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T19:16:59.450957] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-23T19:16:59.601186] [DEBUG] [LOCAL ] HLN: Primary data saved (53090 records). [2025-09-23T19:16:59.601332] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-23T19:16:59.601418] [INFO ] [MAIN ] Update Progress: 1033/2372 symbols completed. HLN took 33.4s. Estimated remaining: 2h 57m 30s. Rate: 7.5 symbols/min [2025-09-23T19:16:59.768963] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:59.825635] [DEBUG] [LOCAL ] HMY: Loaded 53128 existing records from primary storage. [2025-09-23T19:16:59.825803] [INFO ] [MAIN ] HMY: Loaded 53128 existing records. [2025-09-23T19:17:00.009204] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:00.010736] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-23T19:17:00.010954] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-23T19:17:00.012610] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-23T19:17:00.012695] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-23T19:17:00.211503] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-23T19:17:00.379979] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T19:17:00.385152] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:01.002240] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-23T19:17:01.802259] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-23T19:17:02.007806] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T19:17:02.413860] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:17:02.597344] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T19:17:02.603285] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-23T19:17:03.402217] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-23T19:17:04.202158] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-23T19:17:04.272017] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T19:17:04.293958] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T19:17:05.002209] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-23T19:17:05.645509] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:17:05.802191] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-23T19:17:06.471525] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T19:17:06.602201] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-23T19:17:07.048190] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:17:07.058261] [INFO ] [REMOTE ] HLX: Full fetch complete (69176 records). [2025-09-23T19:17:07.058453] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-23T19:17:07.408236] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-23T19:17:07.459602] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-23T19:17:07.459733] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-23T19:17:07.460736] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-23T19:17:07.460823] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-23T19:17:07.465516] [DEBUG] [LOCAL ] HLX: Trimmed 69176 records to 48067 (keeping 200 days of data) [2025-09-23T19:17:07.743795] [DEBUG] [LOCAL ] HLX: Primary data saved (48067 records). [2025-09-23T19:17:07.743943] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-23T19:17:07.744043] [INFO ] [MAIN ] Update Progress: 1034/2372 symbols completed. HLX took 37.4s. Estimated remaining: 2h 57m 23s. Rate: 7.5 symbols/min [2025-09-23T19:17:07.918280] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:07.918685] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-23T19:17:07.918833] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-23T19:17:07.919041] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-23T19:17:07.919087] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-23T19:17:07.919130] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-23T19:17:07.919164] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-23T19:17:08.207296] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-23T19:17:08.318664] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:08.342334] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T19:17:08.424132] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T19:17:09.002201] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-23T19:17:09.802142] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-23T19:17:09.905959] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T19:17:10.535250] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:17:10.602148] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-23T19:17:11.039729] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T19:17:11.402204] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-23T19:17:12.202157] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-23T19:17:12.251443] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T19:17:12.774759] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T19:17:13.002189] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-23T19:17:13.198379] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:13.198824] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-23T19:17:13.508978] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T19:17:13.802199] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-23T19:17:14.003519] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:14.003912] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-23T19:17:14.602215] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-23T19:17:15.402218] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-23T19:17:16.202157] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-23T19:17:16.264291] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T19:17:16.535578] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:17:17.002199] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-23T19:17:17.802242] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-23T19:17:17.938428] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T19:17:18.011043] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T19:17:18.015062] [INFO ] [REMOTE ] HMN: Full fetch complete (31657 records). [2025-09-23T19:17:18.015143] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-23T19:17:18.058816] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:18.107041] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-23T19:17:18.448161] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-23T19:17:18.448253] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-23T19:17:18.448800] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-23T19:17:18.448864] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-23T19:17:18.449600] [DEBUG] [LOCAL ] HMN: Trimmed 31657 records to 23395 (keeping 200 days of data) [2025-09-23T19:17:18.593696] [DEBUG] [LOCAL ] HMN: Primary data saved (23395 records). [2025-09-23T19:17:18.593827] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-23T19:17:18.593910] [INFO ] [MAIN ] Update Progress: 1035/2372 symbols completed. HMN took 23.8s. Estimated remaining: 2h 57m 18s. Rate: 7.5 symbols/min [2025-09-23T19:17:18.607305] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-23T19:17:18.775189] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:18.804673] [DEBUG] [LOCAL ] HNI: Loaded 28782 existing records from primary storage. [2025-09-23T19:17:18.804815] [INFO ] [MAIN ] HNI: Loaded 28782 existing records. [2025-09-23T19:17:18.983069] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:18.983297] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-23T19:17:18.983343] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-23T19:17:18.984044] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-23T19:17:18.984105] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-23T19:17:19.347115] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:19.402181] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-23T19:17:20.072034] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:17:20.202204] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-23T19:17:20.418676] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:20.419011] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-23T19:17:20.752275] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T19:17:21.002196] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-23T19:17:21.802209] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-23T19:17:22.602199] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-23T19:17:22.840273] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:22.840583] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-23T19:17:22.977943] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T19:17:23.032414] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:17:23.402203] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-23T19:17:24.202212] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-23T19:17:25.002162] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-23T19:17:25.448253] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T19:17:25.552736] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T19:17:25.643447] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T19:17:25.802193] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-23T19:17:26.602199] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-23T19:17:27.404345] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-23T19:17:27.407357] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T19:17:27.849840] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:17:28.202186] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-23T19:17:28.737801] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T19:17:28.745994] [INFO ] [REMOTE ] HMC: Full fetch complete (69603 records). [2025-09-23T19:17:28.746116] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-23T19:17:29.007381] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-23T19:17:29.156780] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-23T19:17:29.156887] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-23T19:17:29.157833] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-23T19:17:29.157904] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-23T19:17:29.159733] [DEBUG] [LOCAL ] HMC: Trimmed 69603 records to 46861 (keeping 200 days of data) [2025-09-23T19:17:29.445366] [DEBUG] [LOCAL ] HMC: Primary data saved (46861 records). [2025-09-23T19:17:29.445514] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-23T19:17:29.445606] [INFO ] [MAIN ] Update Progress: 1036/2372 symbols completed. HMC took 36.7s. Estimated remaining: 2h 57m 14s. Rate: 7.5 symbols/min [2025-09-23T19:17:29.624351] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:29.650174] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T19:17:29.707962] [DEBUG] [LOCAL ] HOG: Loaded 51269 existing records from primary storage. [2025-09-23T19:17:29.708129] [INFO ] [MAIN ] HOG: Loaded 51269 existing records. [2025-09-23T19:17:29.807315] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-23T19:17:29.892615] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:29.893068] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-23T19:17:29.893160] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-23T19:17:29.894500] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-23T19:17:29.894566] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-23T19:17:30.212710] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:17:30.300950] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:30.602246] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-23T19:17:31.402195] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-23T19:17:31.524300] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T19:17:31.865385] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T19:17:31.874230] [INFO ] [REMOTE ] HMY: Full fetch complete (76651 records). [2025-09-23T19:17:31.874373] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-23T19:17:32.210893] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-23T19:17:32.271199] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-23T19:17:32.271287] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-23T19:17:32.272214] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-23T19:17:32.272279] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-23T19:17:32.273950] [DEBUG] [LOCAL ] HMY: Trimmed 76651 records to 53136 (keeping 200 days of data) [2025-09-23T19:17:32.588278] [DEBUG] [LOCAL ] HMY: Primary data saved (53136 records). [2025-09-23T19:17:32.588439] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-23T19:17:32.588538] [INFO ] [MAIN ] Update Progress: 1037/2372 symbols completed. HMY took 33.0s. Estimated remaining: 2h 56m 60s. Rate: 7.5 symbols/min [2025-09-23T19:17:32.734418] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T19:17:33.002205] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-23T19:17:33.161114] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T19:17:33.802217] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-23T19:17:34.232823] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T19:17:34.605913] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-23T19:17:34.607918] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T19:17:35.402277] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-23T19:17:35.953154] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T19:17:36.202191] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-23T19:17:36.693350] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T19:17:36.700753] [INFO ] [REMOTE ] HNGE: Full fetch complete (26095 records). [2025-09-23T19:17:36.700835] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-23T19:17:36.888447] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 85 unique days, need 200 days [2025-09-23T19:17:36.888869] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:17:36.888947] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:17:36.888995] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-23T19:17:36.889052] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-23T19:17:36.889094] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-23T19:17:36.889150] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-23T19:17:36.889235] [INFO ] [MAIN ] Update Progress: 1038/2372 symbols completed. HNGE took 29.1s. Estimated remaining: 2h 56m 47s. Rate: 7.5 symbols/min [2025-09-23T19:17:37.002179] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-23T19:17:37.579265] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:17:37.802158] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-23T19:17:38.182201] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:17:38.602261] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-23T19:17:39.290541] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T19:17:39.402274] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-23T19:17:39.483880] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T19:17:40.202249] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-23T19:17:40.958620] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T19:17:41.002219] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-23T19:17:41.304776] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:17:41.802194] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-23T19:17:42.404265] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T19:17:42.602273] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-23T19:17:43.150688] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:17:43.157194] [INFO ] [REMOTE ] HNI: Full fetch complete (41011 records). [2025-09-23T19:17:43.157307] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-23T19:17:43.531317] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-23T19:17:43.531438] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-23T19:17:43.532158] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-23T19:17:43.532221] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-23T19:17:43.533210] [DEBUG] [LOCAL ] HNI: Trimmed 41011 records to 28779 (keeping 200 days of data) [2025-09-23T19:17:43.710274] [DEBUG] [LOCAL ] HNI: Primary data saved (28779 records). [2025-09-23T19:17:43.710413] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-23T19:17:43.710505] [INFO ] [MAIN ] Update Progress: 1039/2372 symbols completed. HNI took 25.1s. Estimated remaining: 2h 56m 38s. Rate: 7.5 symbols/min [2025-09-23T19:17:43.792026] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T19:17:43.802405] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-23T19:17:45.177461] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T19:17:45.188899] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-23T19:17:46.486013] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:17:46.500436] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-23T19:17:48.227370] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:17:48.235886] [INFO ] [REMOTE ] HOG: Full fetch complete (74254 records). [2025-09-23T19:17:48.236015] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-23T19:17:48.632374] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-23T19:17:48.632524] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-23T19:17:48.633425] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-23T19:17:48.633492] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-23T19:17:48.635027] [DEBUG] [LOCAL ] HOG: Trimmed 74254 records to 51251 (keeping 200 days of data) [2025-09-23T19:17:48.945475] [DEBUG] [LOCAL ] HOG: Primary data saved (51251 records). [2025-09-23T19:17:48.945611] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-23T19:17:48.945723] [INFO ] [MAIN ] Update Progress: 1040/2372 symbols completed. HOG took 19.5s. Estimated remaining: 2h 56m 26s. Rate: 7.5 symbols/min [2025-09-23T19:17:49.563240] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:49.587167] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:49.625970] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:49.663826] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:49.680910] [DEBUG] [LOCAL ] HOV: Loaded 13753 existing records from primary storage. [2025-09-23T19:17:49.681242] [INFO ] [MAIN ] HOV: Loaded 13753 existing records. [2025-09-23T19:17:49.967404] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:49.969013] [DEBUG] [LOCAL ] HP: Loaded 51601 existing records from primary storage. [2025-09-23T19:17:49.970441] [DEBUG] [LOCAL ] HOMB: Loaded 43641 existing records from primary storage. [2025-09-23T19:17:49.968317] [DEBUG] [LOCAL ] HOUS: Loaded 44037 existing records from primary storage. [2025-09-23T19:17:49.970927] [INFO ] [MAIN ] HOMB: Loaded 43641 existing records. [2025-09-23T19:17:49.970582] [INFO ] [MAIN ] HOUS: Loaded 44037 existing records. [2025-09-23T19:17:49.970832] [INFO ] [MAIN ] HP: Loaded 51601 existing records. [2025-09-23T19:17:49.970748] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-23T19:17:50.007375] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-23T19:17:50.123873] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-23T19:17:50.154617] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-23T19:17:50.602581] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:50.681622] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-23T19:17:50.647915] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:50.707918] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-23T19:17:50.693460] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:50.717108] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-23T19:17:50.710201] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-23T19:17:50.733719] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-23T19:17:50.742716] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-23T19:17:50.742896] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-23T19:17:50.742951] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-23T19:17:50.753900] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-23T19:17:50.748265] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-23T19:17:50.788845] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-23T19:17:50.774728] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-23T19:17:51.656400] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:51.731816] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-23T19:17:52.028724] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:51.990617] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:52.033305] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-23T19:17:52.032874] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:52.033884] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-23T19:17:52.034164] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-23T19:17:52.430384] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-23T19:17:52.433969] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-23T19:17:53.074813] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T19:17:53.082943] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-23T19:17:53.189235] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:17:53.197827] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-23T19:17:53.544886] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T19:17:53.547855] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-23T19:17:53.686227] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T19:17:53.696120] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-23T19:17:54.117004] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T19:17:54.125820] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-23T19:17:54.142823] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T19:17:54.145692] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-23T19:17:54.377955] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T19:17:54.602225] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-23T19:17:54.881479] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T19:17:54.962933] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:17:55.126930] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T19:17:55.402217] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-23T19:17:55.753499] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T19:17:56.202332] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-23T19:17:56.535177] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T19:17:56.814436] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:17:57.002183] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-23T19:17:57.802255] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-23T19:17:58.269459] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T19:17:58.307747] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T19:17:58.602255] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-23T19:17:59.402222] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-23T19:17:59.723157] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T19:18:00.202248] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-23T19:18:00.527892] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T19:18:00.930230] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T19:18:01.002250] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-23T19:18:01.802407] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-23T19:18:02.156759] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T19:18:02.602204] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-23T19:18:03.402158] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-23T19:18:03.830782] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:18:03.890030] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-23T19:18:04.052733] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T19:18:04.202270] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-23T19:18:05.002224] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-23T19:18:05.378368] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:18:05.382556] [INFO ] [REMOTE ] HOV: Full fetch complete (19491 records). [2025-09-23T19:18:05.382774] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-23T19:18:05.761843] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-23T19:18:05.761920] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-23T19:18:05.762322] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-23T19:18:05.762361] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-23T19:18:05.762969] [DEBUG] [LOCAL ] HOV: Trimmed 19491 records to 13783 (keeping 200 days of data) [2025-09-23T19:18:05.804332] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-23T19:18:05.848624] [DEBUG] [LOCAL ] HOV: Primary data saved (13783 records). [2025-09-23T19:18:05.848764] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-23T19:18:05.848887] [INFO ] [MAIN ] Update Progress: 1041/2372 symbols completed. HOV took 16.9s. Estimated remaining: 2h 56m 30s. Rate: 7.5 symbols/min [2025-09-23T19:18:06.023532] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:06.078702] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-23T19:18:06.078936] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-09-23T19:18:06.259355] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:06.259853] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-23T19:18:06.259942] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-23T19:18:06.261420] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-23T19:18:06.261483] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-23T19:18:06.433533] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T19:18:06.607277] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-23T19:18:06.677863] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:07.233047] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:18:07.402189] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-23T19:18:07.646171] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-23T19:18:08.202192] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-23T19:18:08.779465] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T19:18:09.002202] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-23T19:18:09.412113] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:18:09.802231] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-23T19:18:10.461292] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T19:18:10.602234] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-23T19:18:11.381708] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:18:11.402170] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-23T19:18:12.179688] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:18:12.202148] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-23T19:18:13.002229] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-23T19:18:13.058577] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T19:18:13.544426] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:18:13.552380] [INFO ] [REMOTE ] HOUS: Full fetch complete (62698 records). [2025-09-23T19:18:13.552507] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-23T19:18:13.808210] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-23T19:18:13.953282] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-23T19:18:13.953376] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-23T19:18:13.954273] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-23T19:18:13.954336] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-23T19:18:13.955784] [DEBUG] [LOCAL ] HOUS: Trimmed 62698 records to 44099 (keeping 200 days of data) [2025-09-23T19:18:14.211387] [DEBUG] [LOCAL ] HOUS: Primary data saved (44099 records). [2025-09-23T19:18:14.211521] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-23T19:18:14.211607] [INFO ] [MAIN ] Update Progress: 1042/2372 symbols completed. HOUS took 25.3s. Estimated remaining: 2h 56m 23s. Rate: 7.5 symbols/min [2025-09-23T19:18:14.397797] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:14.407243] [DEBUG] [LOCAL ] HPF: Loaded 7280 existing records from primary storage. [2025-09-23T19:18:14.407365] [INFO ] [MAIN ] HPF: Loaded 7280 existing records. [2025-09-23T19:18:14.605380] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-23T19:18:14.599023] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T19:18:14.628491] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:14.639593] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-23T19:18:14.639743] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-23T19:18:14.640468] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-23T19:18:14.640533] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-23T19:18:14.997841] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:15.402140] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-23T19:18:15.517410] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:18:16.062357] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:18:16.202188] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-23T19:18:16.566487] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T19:18:17.002251] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-23T19:18:17.804931] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-23T19:18:17.816830] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T19:18:17.816545] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T19:18:18.602198] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-23T19:18:19.402202] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-23T19:18:19.519861] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T19:18:19.527510] [INFO ] [REMOTE ] HOMB: Full fetch complete (63692 records). [2025-09-23T19:18:19.527681] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-23T19:18:19.929452] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-23T19:18:19.929544] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-23T19:18:19.930369] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-23T19:18:19.930435] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-23T19:18:19.931747] [DEBUG] [LOCAL ] HOMB: Trimmed 63692 records to 43632 (keeping 200 days of data) [2025-09-23T19:18:20.197179] [DEBUG] [LOCAL ] HOMB: Primary data saved (43632 records). [2025-09-23T19:18:20.197405] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-23T19:18:20.197578] [INFO ] [MAIN ] Update Progress: 1043/2372 symbols completed. HOMB took 31.3s. Estimated remaining: 2h 56m 12s. Rate: 7.5 symbols/min [2025-09-23T19:18:20.209595] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-23T19:18:20.412263] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T19:18:20.416113] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:20.439922] [DEBUG] [LOCAL ] HPI: Loaded 10105 existing records from primary storage. [2025-09-23T19:18:20.440046] [INFO ] [MAIN ] HPI: Loaded 10105 existing records. [2025-09-23T19:18:20.632172] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:20.632503] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-23T19:18:20.632556] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-23T19:18:20.633004] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-23T19:18:20.633066] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-23T19:18:20.995702] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:21.002143] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-23T19:18:21.475249] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:18:21.802192] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-23T19:18:21.964402] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T19:18:22.118725] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-23T19:18:22.439629] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T19:18:22.602194] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-23T19:18:22.976215] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T19:18:23.402198] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-23T19:18:24.168553] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T19:18:24.202199] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-23T19:18:25.002203] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-23T19:18:25.689272] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:18:25.802177] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-23T19:18:26.206441] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-23T19:18:26.602196] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-23T19:18:27.216869] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T19:18:27.402151] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-23T19:18:27.537100] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:18:28.202256] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-23T19:18:28.632818] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T19:18:28.744676] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:18:28.754255] [INFO ] [REMOTE ] HP: Full fetch complete (73913 records). [2025-09-23T19:18:28.754519] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-23T19:18:29.009725] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-23T19:18:29.199960] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-23T19:18:29.200082] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-23T19:18:29.201268] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-23T19:18:29.201344] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-23T19:18:29.203536] [DEBUG] [LOCAL ] HP: Trimmed 73913 records to 51614 (keeping 200 days of data) [2025-09-23T19:18:29.558147] [DEBUG] [LOCAL ] HP: Primary data saved (51614 records). [2025-09-23T19:18:29.558298] [INFO ] [MAIN ] HP: Full history saved. [2025-09-23T19:18:29.558386] [INFO ] [MAIN ] Update Progress: 1044/2372 symbols completed. HP took 40.6s. Estimated remaining: 2h 56m 6s. Rate: 7.5 symbols/min [2025-09-23T19:18:29.732397] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:29.781816] [DEBUG] [LOCAL ] HPP: Loaded 50793 existing records from primary storage. [2025-09-23T19:18:29.782002] [INFO ] [MAIN ] HPP: Loaded 50793 existing records. [2025-09-23T19:18:29.812713] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-23T19:18:29.965173] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:29.965501] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-23T19:18:29.965560] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-23T19:18:29.966917] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-23T19:18:29.966981] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-23T19:18:30.343494] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:30.579724] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:18:30.602165] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-23T19:18:31.114329] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T19:18:31.136374] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T19:18:31.402269] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-23T19:18:32.202200] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-23T19:18:32.739693] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T19:18:33.002208] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-23T19:18:33.802206] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-23T19:18:34.589188] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (3.19 seconds). [2025-09-23T19:18:34.602073] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-23T19:18:34.760276] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T19:18:34.762554] [INFO ] [REMOTE ] HPF: Full fetch complete (10818 records). [2025-09-23T19:18:34.762634] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-23T19:18:34.985505] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T19:18:35.177140] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-23T19:18:35.177223] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-23T19:18:35.177539] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-23T19:18:35.177580] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-23T19:18:35.178075] [DEBUG] [LOCAL ] HPF: Trimmed 10818 records to 7292 (keeping 200 days of data) [2025-09-23T19:18:35.222544] [DEBUG] [LOCAL ] HPF: Primary data saved (7292 records). [2025-09-23T19:18:35.222756] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-23T19:18:35.222876] [INFO ] [MAIN ] Update Progress: 1045/2372 symbols completed. HPF took 21.0s. Estimated remaining: 2h 55m 55s. Rate: 7.5 symbols/min [2025-09-23T19:18:35.413255] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-23T19:18:35.417220] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:35.476697] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-23T19:18:35.476883] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-09-23T19:18:35.658128] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:35.658410] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-23T19:18:35.658458] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-23T19:18:35.659913] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-23T19:18:35.659976] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-23T19:18:36.016490] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:36.024205] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:18:36.202209] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-23T19:18:36.645800] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T19:18:37.002253] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-23T19:18:37.802198] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-23T19:18:37.963044] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T19:18:37.969088] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T19:18:38.602224] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-23T19:18:39.377422] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:18:39.402151] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-23T19:18:40.202168] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-23T19:18:40.250026] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T19:18:40.658023] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T19:18:41.002227] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-23T19:18:41.136886] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:18:41.145989] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-23T19:18:41.146151] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-23T19:18:41.554548] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-23T19:18:41.554670] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-23T19:18:41.555614] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-23T19:18:41.555704] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-23T19:18:41.557257] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-09-23T19:18:41.679509] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T19:18:41.802315] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-23T19:18:41.912206] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-23T19:18:41.912346] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-23T19:18:41.912429] [INFO ] [MAIN ] Update Progress: 1046/2372 symbols completed. HPE took 36.1s. Estimated remaining: 2h 55m 45s. Rate: 7.5 symbols/min [2025-09-23T19:18:42.093573] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:42.109003] [DEBUG] [LOCAL ] HPS: Loaded 10262 existing records from primary storage. [2025-09-23T19:18:42.109128] [INFO ] [MAIN ] HPS: Loaded 10262 existing records. [2025-09-23T19:18:42.285900] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:42.286213] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-23T19:18:42.286286] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-23T19:18:42.286747] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-23T19:18:42.286816] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-23T19:18:42.607304] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-23T19:18:42.647108] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:42.697682] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T19:18:43.402206] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-23T19:18:44.112509] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T19:18:44.151834] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T19:18:44.155248] [INFO ] [REMOTE ] HPI: Full fetch complete (13448 records). [2025-09-23T19:18:44.155332] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-23T19:18:44.210068] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-23T19:18:44.526074] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-23T19:18:44.526155] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-23T19:18:44.526517] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-23T19:18:44.526588] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-23T19:18:44.527205] [DEBUG] [LOCAL ] HPI: Trimmed 13448 records to 10123 (keeping 200 days of data) [2025-09-23T19:18:44.595360] [DEBUG] [LOCAL ] HPI: Primary data saved (10123 records). [2025-09-23T19:18:44.595496] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-23T19:18:44.595593] [INFO ] [MAIN ] Update Progress: 1047/2372 symbols completed. HPI took 24.4s. Estimated remaining: 2h 55m 31s. Rate: 7.5 symbols/min [2025-09-23T19:18:44.764477] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:44.792621] [DEBUG] [LOCAL ] HQH: Loaded 24877 existing records from primary storage. [2025-09-23T19:18:44.792787] [INFO ] [MAIN ] HQH: Loaded 24877 existing records. [2025-09-23T19:18:44.967599] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:44.967873] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-23T19:18:44.967921] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-23T19:18:44.968745] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-23T19:18:44.968812] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-23T19:18:45.010540] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-23T19:18:45.338036] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:45.590380] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T19:18:45.751275] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T19:18:45.802163] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-23T19:18:46.602230] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-23T19:18:47.082791] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:18:47.402203] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-23T19:18:48.067336] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T19:18:48.202193] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-23T19:18:48.220495] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T19:18:49.002190] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-23T19:18:49.802179] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-23T19:18:49.876207] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T19:18:49.913703] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T19:18:50.602248] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-23T19:18:51.192589] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:18:51.402174] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-23T19:18:51.464466] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T19:18:52.202212] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-23T19:18:52.925085] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T19:18:53.002210] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-23T19:18:53.423490] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T19:18:53.802204] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-23T19:18:54.241716] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T19:18:54.401477] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T19:18:54.602199] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-23T19:18:55.137064] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T19:18:55.402216] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-23T19:18:56.138010] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:18:56.202219] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-23T19:18:57.002204] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-23T19:18:57.729870] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:18:57.802248] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-23T19:18:58.541869] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:18:58.610810] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-23T19:18:58.630589] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:18:59.402163] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-23T19:18:59.708284] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T19:19:00.202228] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-23T19:19:00.350268] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:19:01.002206] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-23T19:19:01.802254] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-23T19:19:01.953616] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T19:19:02.147544] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T19:19:02.602285] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-23T19:19:03.402201] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-23T19:19:03.769558] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:19:03.892517] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T19:19:04.028933] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-23T19:19:04.202232] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-23T19:19:05.002236] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-23T19:19:05.083839] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:19:05.802214] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-23T19:19:06.437786] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:19:06.587270] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T19:19:06.602160] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-23T19:19:07.402193] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-23T19:19:07.555627] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:19:08.202232] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-23T19:19:09.002165] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-23T19:19:09.128999] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T19:19:09.154253] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T19:19:09.156719] [INFO ] [REMOTE ] HPS: Full fetch complete (15168 records). [2025-09-23T19:19:09.156904] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-23T19:19:09.552771] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-23T19:19:09.552906] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-23T19:19:09.553424] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-23T19:19:09.553560] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-23T19:19:09.554671] [DEBUG] [LOCAL ] HPS: Trimmed 15168 records to 10223 (keeping 200 days of data) [2025-09-23T19:19:09.626246] [DEBUG] [LOCAL ] HPS: Primary data saved (10223 records). [2025-09-23T19:19:09.626448] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-23T19:19:09.626658] [INFO ] [MAIN ] Update Progress: 1048/2372 symbols completed. HPS took 27.7s. Estimated remaining: 2h 55m 45s. Rate: 7.5 symbols/min [2025-09-23T19:19:09.807385] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-23T19:19:09.810237] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:09.841508] [DEBUG] [LOCAL ] HQL: Loaded 15995 existing records from primary storage. [2025-09-23T19:19:09.841749] [INFO ] [MAIN ] HQL: Loaded 15995 existing records. [2025-09-23T19:19:10.055134] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:10.055555] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-23T19:19:10.055678] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-23T19:19:10.056483] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-23T19:19:10.056568] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-23T19:19:10.467291] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:10.602247] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-23T19:19:11.028111] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T19:19:11.115708] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T19:19:11.198094] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T19:19:11.402269] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-23T19:19:12.202264] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-23T19:19:12.240043] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T19:19:12.245325] [INFO ] [REMOTE ] HQH: Full fetch complete (37199 records). [2025-09-23T19:19:12.245486] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-23T19:19:12.670920] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-23T19:19:12.671128] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-23T19:19:12.672134] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-23T19:19:12.672203] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-23T19:19:12.673473] [DEBUG] [LOCAL ] HQH: Trimmed 37199 records to 24832 (keeping 200 days of data) [2025-09-23T19:19:12.850180] [DEBUG] [LOCAL ] HQH: Primary data saved (24832 records). [2025-09-23T19:19:12.850392] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-23T19:19:12.850585] [INFO ] [MAIN ] Update Progress: 1049/2372 symbols completed. HQH took 28.3s. Estimated remaining: 2h 55m 31s. Rate: 7.5 symbols/min [2025-09-23T19:19:13.009375] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-23T19:19:13.037123] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:13.103065] [DEBUG] [LOCAL ] HR: Loaded 51967 existing records from primary storage. [2025-09-23T19:19:13.103275] [INFO ] [MAIN ] HR: Loaded 51967 existing records. [2025-09-23T19:19:13.390039] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:13.390434] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-23T19:19:13.390487] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-23T19:19:13.392478] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-23T19:19:13.392543] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-23T19:19:13.778895] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:13.802253] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-23T19:19:13.874027] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T19:19:14.030349] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T19:19:14.602199] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-23T19:19:15.120677] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T19:19:15.402235] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-23T19:19:16.175734] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:19:16.202225] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-23T19:19:16.573899] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T19:19:16.592098] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-23T19:19:16.592950] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-23T19:19:17.009915] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-23T19:19:17.011790] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-23T19:19:17.011885] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-23T19:19:17.013020] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-23T19:19:17.013099] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-23T19:19:17.015163] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 53668 (keeping 200 days of data) [2025-09-23T19:19:17.363683] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-09-23T19:19:17.363826] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-23T19:19:17.363925] [INFO ] [MAIN ] Update Progress: 1050/2372 symbols completed. HPQ took 42.1s. Estimated remaining: 2h 55m 18s. Rate: 7.5 symbols/min [2025-09-23T19:19:17.537603] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:17.562815] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T19:19:17.572038] [INFO ] [REMOTE ] HPP: Full fetch complete (73367 records). [2025-09-23T19:19:17.572228] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-23T19:19:17.803680] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-23T19:19:17.818474] [DEBUG] [LOCAL ] HRB: Loaded 48621 existing records from primary storage. [2025-09-23T19:19:17.837883] [INFO ] [MAIN ] HRB: Loaded 48621 existing records. [2025-09-23T19:19:18.209572] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:18.216055] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T19:19:18.238034] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-23T19:19:18.238154] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-23T19:19:18.238509] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-23T19:19:18.238629] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-23T19:19:18.239618] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-23T19:19:18.239708] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-23T19:19:18.239989] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-23T19:19:18.240055] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-23T19:19:18.335447] [DEBUG] [LOCAL ] HPP: Trimmed 73367 records to 50822 (keeping 200 days of data) [2025-09-23T19:19:18.602259] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-23T19:19:18.720142] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:18.912601] [DEBUG] [LOCAL ] HPP: Primary data saved (50822 records). [2025-09-23T19:19:18.912768] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-23T19:19:18.912858] [INFO ] [MAIN ] Update Progress: 1051/2372 symbols completed. HPP took 49.4s. Estimated remaining: 2h 55m 2s. Rate: 7.5 symbols/min [2025-09-23T19:19:19.082735] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:19.124320] [DEBUG] [LOCAL ] HRI: Loaded 33152 existing records from primary storage. [2025-09-23T19:19:19.124464] [INFO ] [MAIN ] HRI: Loaded 33152 existing records. [2025-09-23T19:19:19.313871] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:19.314101] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-23T19:19:19.314148] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-23T19:19:19.315042] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-23T19:19:19.315102] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-23T19:19:19.415178] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-23T19:19:19.614129] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T19:19:19.701740] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T19:19:19.738425] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:20.202201] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-23T19:19:20.666962] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T19:19:21.002198] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-23T19:19:21.331970] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T19:19:21.802159] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-23T19:19:22.015740] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T19:19:22.602196] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-23T19:19:23.402169] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-23T19:19:23.439263] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T19:19:23.481291] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:19:24.202244] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-23T19:19:24.826726] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T19:19:24.955092] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:19:25.002200] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-23T19:19:25.802200] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-23T19:19:26.223942] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T19:19:26.602179] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-23T19:19:27.216821] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:19:27.402168] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-23T19:19:27.452788] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T19:19:28.202224] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-23T19:19:29.003484] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-23T19:19:29.019068] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:19:29.022032] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T19:19:29.802216] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-23T19:19:30.307023] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T19:19:30.602280] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-23T19:19:30.701538] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T19:19:30.704490] [INFO ] [REMOTE ] HQL: Full fetch complete (24032 records). [2025-09-23T19:19:30.704585] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-23T19:19:31.111753] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-23T19:19:31.111858] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-23T19:19:31.112447] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-23T19:19:31.112517] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-23T19:19:31.113800] [DEBUG] [LOCAL ] HQL: Trimmed 24032 records to 15826 (keeping 200 days of data) [2025-09-23T19:19:31.221874] [DEBUG] [LOCAL ] HQL: Primary data saved (15826 records). [2025-09-23T19:19:31.222046] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-23T19:19:31.222161] [INFO ] [MAIN ] Update Progress: 1052/2372 symbols completed. HQL took 21.6s. Estimated remaining: 2h 54m 60s. Rate: 7.5 symbols/min [2025-09-23T19:19:31.413117] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-23T19:19:31.417990] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:31.480411] [DEBUG] [LOCAL ] HRL: Loaded 53077 existing records from primary storage. [2025-09-23T19:19:31.480577] [INFO ] [MAIN ] HRL: Loaded 53077 existing records. [2025-09-23T19:19:31.668981] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:31.669323] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-23T19:19:31.669457] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-23T19:19:31.670966] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-23T19:19:31.671035] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-23T19:19:31.795536] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T19:19:32.052688] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:32.202194] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-23T19:19:32.821552] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T19:19:33.002255] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-23T19:19:33.628613] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T19:19:33.802208] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-23T19:19:34.329908] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T19:19:34.602237] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-23T19:19:34.989580] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T19:19:35.402259] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-23T19:19:36.202192] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-23T19:19:36.444228] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T19:19:36.515624] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T19:19:37.002244] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-23T19:19:37.802222] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-23T19:19:37.945228] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T19:19:38.015941] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T19:19:38.602258] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-23T19:19:39.171468] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T19:19:39.402207] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-23T19:19:40.202167] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-23T19:19:40.393945] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T19:19:40.826525] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T19:19:41.002200] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-23T19:19:41.802231] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-23T19:19:41.862556] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:19:42.377904] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T19:19:42.602212] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-23T19:19:43.402166] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-23T19:19:43.560568] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:19:44.128165] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:19:44.202159] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-23T19:19:45.002204] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-23T19:19:45.070732] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T19:19:45.806867] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-23T19:19:45.819136] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T19:19:46.524599] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T19:19:46.537374] [INFO ] [REMOTE ] HR: Full fetch complete (74789 records). [2025-09-23T19:19:46.537521] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-23T19:19:46.607272] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-23T19:19:46.946065] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-23T19:19:46.946160] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-23T19:19:46.947073] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-23T19:19:46.947138] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-23T19:19:46.948602] [DEBUG] [LOCAL ] HR: Trimmed 74789 records to 51956 (keeping 200 days of data) [2025-09-23T19:19:47.303539] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:19:47.327709] [DEBUG] [LOCAL ] HR: Primary data saved (51956 records). [2025-09-23T19:19:47.327869] [INFO ] [MAIN ] HR: Full history saved. [2025-09-23T19:19:47.328014] [INFO ] [MAIN ] Update Progress: 1053/2372 symbols completed. HR took 34.5s. Estimated remaining: 2h 55m 2s. Rate: 7.5 symbols/min [2025-09-23T19:19:47.407399] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-23T19:19:47.498934] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:47.531404] [DEBUG] [LOCAL ] HRTG: Loaded 32764 existing records from primary storage. [2025-09-23T19:19:47.531540] [INFO ] [MAIN ] HRTG: Loaded 32764 existing records. [2025-09-23T19:19:47.715381] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:47.715799] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-23T19:19:47.715874] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-23T19:19:47.722299] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-23T19:19:47.732384] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-23T19:19:47.805397] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:19:48.096622] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:48.202144] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-23T19:19:49.007618] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-23T19:19:49.027989] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T19:19:49.359857] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:19:49.802203] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-23T19:19:50.195774] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T19:19:50.202228] [INFO ] [REMOTE ] HRI: Full fetch complete (45966 records). [2025-09-23T19:19:50.202455] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-23T19:19:50.610833] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-23T19:19:50.615202] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-23T19:19:50.616360] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-23T19:19:50.617270] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-23T19:19:50.617487] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-23T19:19:50.619064] [DEBUG] [LOCAL ] HRI: Trimmed 45966 records to 33171 (keeping 200 days of data) [2025-09-23T19:19:50.837571] [DEBUG] [LOCAL ] HRI: Primary data saved (33171 records). [2025-09-23T19:19:50.837754] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-23T19:19:50.837873] [INFO ] [MAIN ] Update Progress: 1054/2372 symbols completed. HRI took 31.9s. Estimated remaining: 2h 54m 48s. Rate: 7.5 symbols/min [2025-09-23T19:19:51.016300] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:51.016726] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-09-23T19:19:51.016804] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-09-23T19:19:51.017141] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-23T19:19:51.017230] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-23T19:19:51.017329] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-09-23T19:19:51.017399] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-23T19:19:51.416071] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:51.407554] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-23T19:19:51.420286] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T19:19:52.106991] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T19:19:52.202162] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-23T19:19:52.471737] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T19:19:53.002198] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-23T19:19:53.802161] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-23T19:19:53.889178] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T19:19:53.897627] [INFO ] [REMOTE ] HRB: Full fetch complete (69794 records). [2025-09-23T19:19:53.897784] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-23T19:19:54.314780] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-23T19:19:54.314911] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-23T19:19:54.315922] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-23T19:19:54.315993] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-23T19:19:54.317451] [DEBUG] [LOCAL ] HRB: Trimmed 69794 records to 48618 (keeping 200 days of data) [2025-09-23T19:19:54.604039] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-23T19:19:54.614615] [DEBUG] [LOCAL ] HRB: Primary data saved (48618 records). [2025-09-23T19:19:54.614725] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-23T19:19:54.614834] [INFO ] [MAIN ] Update Progress: 1055/2372 symbols completed. HRB took 37.3s. Estimated remaining: 2h 54m 35s. Rate: 7.5 symbols/min [2025-09-23T19:19:54.792608] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:54.821146] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T19:19:54.841783] [DEBUG] [LOCAL ] HSHP: Loaded 15572 existing records from primary storage. [2025-09-23T19:19:54.841892] [INFO ] [MAIN ] HSHP: Loaded 15572 existing records. [2025-09-23T19:19:55.031540] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:55.031848] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-23T19:19:55.031900] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-23T19:19:55.032385] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-23T19:19:55.032445] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-23T19:19:55.398145] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:55.409955] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-23T19:19:55.411781] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T19:19:55.701768] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T19:19:56.202205] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-23T19:19:56.891142] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:19:57.002190] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-23T19:19:57.802177] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-23T19:19:58.076203] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:19:58.602157] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-23T19:19:58.620744] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:19:58.837820] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T19:19:59.402194] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-23T19:20:00.202234] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-23T19:20:00.257820] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T19:20:00.267060] [INFO ] [REMOTE ] HRL: Full fetch complete (76687 records). [2025-09-23T19:20:00.267251] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-23T19:20:00.590081] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:20:00.727740] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-23T19:20:00.727834] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-23T19:20:00.728916] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-23T19:20:00.728980] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-23T19:20:00.730497] [DEBUG] [LOCAL ] HRL: Trimmed 76687 records to 53088 (keeping 200 days of data) [2025-09-23T19:20:01.008521] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-23T19:20:01.055665] [DEBUG] [LOCAL ] HRL: Primary data saved (53088 records). [2025-09-23T19:20:01.055819] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-23T19:20:01.055910] [INFO ] [MAIN ] Update Progress: 1056/2372 symbols completed. HRL took 29.8s. Estimated remaining: 2h 54m 25s. Rate: 7.5 symbols/min [2025-09-23T19:20:01.232194] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:01.292071] [DEBUG] [LOCAL ] HSY: Loaded 50458 existing records from primary storage. [2025-09-23T19:20:01.292243] [INFO ] [MAIN ] HSY: Loaded 50458 existing records. [2025-09-23T19:20:01.473560] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:01.474007] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-23T19:20:01.492401] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-23T19:20:01.493855] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:20:01.493988] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-23T19:20:01.500923] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-23T19:20:01.805159] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-23T19:20:01.875229] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:01.878765] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T19:20:02.602226] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-23T19:20:03.402228] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-23T19:20:03.481682] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T19:20:04.202227] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-23T19:20:04.635926] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-23T19:20:05.002247] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-23T19:20:05.062154] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:20:05.199788] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T19:20:05.802204] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-23T19:20:06.602159] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-23T19:20:06.873875] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T19:20:07.021508] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T19:20:07.402200] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-23T19:20:08.202224] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-23T19:20:08.782912] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-23T19:20:08.818901] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T19:20:09.002228] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-23T19:20:09.802198] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-23T19:20:10.064940] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T19:20:10.070582] [INFO ] [REMOTE ] HRTG: Full fetch complete (42093 records). [2025-09-23T19:20:10.070689] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-23T19:20:10.457884] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-23T19:20:10.520048] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-23T19:20:10.520147] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-23T19:20:10.520862] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-23T19:20:10.520958] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-23T19:20:10.522204] [DEBUG] [LOCAL ] HRTG: Trimmed 42093 records to 32918 (keeping 200 days of data) [2025-09-23T19:20:10.606239] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-23T19:20:10.716872] [DEBUG] [LOCAL ] HRTG: Primary data saved (32918 records). [2025-09-23T19:20:10.717031] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-23T19:20:10.717120] [INFO ] [MAIN ] Update Progress: 1057/2372 symbols completed. HRTG took 23.4s. Estimated remaining: 2h 54m 20s. Rate: 7.5 symbols/min [2025-09-23T19:20:10.898176] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:10.898361] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-23T19:20:10.898398] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-23T19:20:10.898541] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-23T19:20:10.898582] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-23T19:20:10.898624] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-23T19:20:10.898690] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-23T19:20:11.285882] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:11.351303] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T19:20:11.402174] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-23T19:20:11.623347] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:20:11.623630] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-23T19:20:12.202166] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-23T19:20:12.486901] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T19:20:13.002200] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-23T19:20:13.197250] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:20:13.197483] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-23T19:20:13.809819] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-23T19:20:13.828162] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:20:14.059521] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-23T19:20:14.602185] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-23T19:20:15.066494] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T19:20:15.402196] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-23T19:20:16.202189] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-23T19:20:17.002174] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-23T19:20:17.500919] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T19:20:17.701083] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T19:20:17.802170] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-23T19:20:17.887097] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:20:18.602192] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-23T19:20:18.813992] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T19:20:19.402203] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-23T19:20:20.145202] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:20:20.202150] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-23T19:20:20.440372] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T19:20:21.002211] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-23T19:20:21.268936] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:20:21.802203] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-23T19:20:22.512773] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T19:20:22.602184] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-23T19:20:23.402193] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-23T19:20:23.556942] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:20:23.565227] [INFO ] [REMOTE ] HSBC: Full fetch complete (73599 records). [2025-09-23T19:20:23.565356] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-23T19:20:23.967815] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-23T19:20:23.967902] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-23T19:20:23.968850] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-23T19:20:23.968919] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-23T19:20:23.970389] [DEBUG] [LOCAL ] HSBC: Trimmed 73599 records to 51156 (keeping 200 days of data) [2025-09-23T19:20:24.204922] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-23T19:20:24.342723] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T19:20:24.372177] [DEBUG] [LOCAL ] HSBC: Primary data saved (51156 records). [2025-09-23T19:20:24.372343] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-23T19:20:24.372435] [INFO ] [MAIN ] Update Progress: 1058/2372 symbols completed. HSBC took 33.5s. Estimated remaining: 2h 54m 19s. Rate: 7.5 symbols/min [2025-09-23T19:20:24.559412] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T19:20:24.598462] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:24.617359] [DEBUG] [LOCAL ] HTD: Loaded 13500 existing records from primary storage. [2025-09-23T19:20:24.617501] [INFO ] [MAIN ] HTD: Loaded 13500 existing records. [2025-09-23T19:20:24.779843] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T19:20:24.820904] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:24.821166] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-23T19:20:24.821218] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-23T19:20:24.821852] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-23T19:20:24.821916] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-23T19:20:25.007694] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-23T19:20:25.198784] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:25.698196] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:20:25.802183] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-23T19:20:26.602202] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-23T19:20:26.765201] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T19:20:27.056377] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T19:20:27.402204] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-23T19:20:28.202189] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-23T19:20:28.964096] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T19:20:29.002190] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-23T19:20:29.178788] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T19:20:29.802224] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-23T19:20:30.504671] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T19:20:30.602191] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-23T19:20:30.757947] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:20:31.216930] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T19:20:31.402227] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-23T19:20:32.202205] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-23T19:20:32.711475] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T19:20:33.002202] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-23T19:20:33.252089] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T19:20:33.264714] [INFO ] [REMOTE ] HSY: Full fetch complete (73835 records). [2025-09-23T19:20:33.264973] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-23T19:20:33.718868] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-23T19:20:33.718994] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-23T19:20:33.720353] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-23T19:20:33.720545] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-23T19:20:33.729385] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T19:20:33.732553] [INFO ] [REMOTE ] HTB: Full fetch complete (7547 records). [2025-09-23T19:20:33.732891] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-23T19:20:33.738927] [DEBUG] [LOCAL ] HSY: Trimmed 73835 records to 50459 (keeping 200 days of data) [2025-09-23T19:20:33.803593] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-23T19:20:34.148410] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-09-23T19:20:34.150097] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:20:34.150943] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:20:34.151040] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-23T19:20:34.151196] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-23T19:20:34.151259] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-23T19:20:34.151335] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-23T19:20:34.151437] [INFO ] [MAIN ] Update Progress: 1059/2372 symbols completed. HTB took 23.4s. Estimated remaining: 2h 54m 13s. Rate: 7.5 symbols/min [2025-09-23T19:20:34.482861] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:34.493428] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-23T19:20:34.493879] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-23T19:20:34.494134] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-23T19:20:34.494212] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-23T19:20:34.494415] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-23T19:20:34.494467] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-23T19:20:34.603455] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-23T19:20:35.007352] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:20:35.034629] [INFO ] [REMOTE ] HSHP: Full fetch complete (23615 records). [2025-09-23T19:20:35.057479] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-23T19:20:35.225986] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:35.409498] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-23T19:20:35.554248] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-23T19:20:35.554927] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-23T19:20:35.556095] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-23T19:20:35.556446] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-23T19:20:35.561911] [DEBUG] [LOCAL ] HSHP: Trimmed 23615 records to 15671 (keeping 200 days of data) [2025-09-23T19:20:35.700221] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T19:20:35.726385] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-23T19:20:35.743080] [DEBUG] [LOCAL ] HSY: Primary data saved (50459 records). [2025-09-23T19:20:35.743192] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-23T19:20:35.743922] [INFO ] [MAIN ] Update Progress: 1060/2372 symbols completed. HSY took 34.7s. Estimated remaining: 2h 53m 57s. Rate: 7.5 symbols/min [2025-09-23T19:20:35.902605] [DEBUG] [LOCAL ] HSHP: Primary data saved (15671 records). [2025-09-23T19:20:35.910527] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-23T19:20:35.911488] [INFO ] [MAIN ] Update Progress: 1061/2372 symbols completed. HSHP took 41.3s. Estimated remaining: 2h 53m 40s. Rate: 7.5 symbols/min [2025-09-23T19:20:35.928417] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:36.102586] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:36.146248] [DEBUG] [LOCAL ] HTGC: Loaded 47623 existing records from primary storage. [2025-09-23T19:20:36.146442] [INFO ] [MAIN ] HTGC: Loaded 47623 existing records. [2025-09-23T19:20:36.211752] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-23T19:20:36.265316] [DEBUG] [LOCAL ] HTH: Loaded 32579 existing records from primary storage. [2025-09-23T19:20:36.265506] [INFO ] [MAIN ] HTH: Loaded 32579 existing records. [2025-09-23T19:20:36.502731] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:36.529939] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-23T19:20:36.530170] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-23T19:20:36.530038] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:36.530405] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-23T19:20:36.530459] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-23T19:20:36.531622] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-23T19:20:36.531709] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-23T19:20:36.531760] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-23T19:20:36.575359] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-23T19:20:37.021069] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-23T19:20:37.142772] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T19:20:37.241217] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:37.308106] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:37.543684] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T19:20:37.802251] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-23T19:20:38.288749] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T19:20:38.602240] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-23T19:20:39.173878] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T19:20:39.402207] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-23T19:20:40.202198] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-23T19:20:40.367934] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T19:20:40.587333] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:20:41.002195] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-23T19:20:41.592223] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T19:20:41.802206] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-23T19:20:42.223163] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T19:20:42.602239] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-23T19:20:43.402200] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-23T19:20:43.730588] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T19:20:44.202243] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-23T19:20:44.240882] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T19:20:44.795009] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T19:20:45.002192] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-23T19:20:45.317793] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-23T19:20:45.802247] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-23T19:20:46.602160] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-23T19:20:46.756386] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:20:47.402164] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-23T19:20:47.498567] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T19:20:48.202203] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-23T19:20:48.511558] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:20:49.002225] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-23T19:20:49.247616] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-23T19:20:49.363445] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T19:20:49.802202] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-23T19:20:50.602208] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-23T19:20:50.880850] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-23T19:20:51.109585] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:20:51.402175] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-23T19:20:52.202310] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-23T19:20:52.393037] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:20:52.396865] [INFO ] [REMOTE ] HTD: Full fetch complete (18833 records). [2025-09-23T19:20:52.396945] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-23T19:20:52.789040] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-23T19:20:52.789171] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-23T19:20:52.789680] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-23T19:20:52.789761] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-23T19:20:52.790406] [DEBUG] [LOCAL ] HTD: Trimmed 18833 records to 13506 (keeping 200 days of data) [2025-09-23T19:20:52.882015] [DEBUG] [LOCAL ] HTD: Primary data saved (13506 records). [2025-09-23T19:20:52.882146] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-23T19:20:52.882343] [INFO ] [MAIN ] Update Progress: 1062/2372 symbols completed. HTD took 28.5s. Estimated remaining: 2h 53m 43s. Rate: 7.5 symbols/min [2025-09-23T19:20:53.007419] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-23T19:20:53.066143] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:53.109153] [DEBUG] [LOCAL ] HUBB: Loaded 37308 existing records from primary storage. [2025-09-23T19:20:53.109295] [INFO ] [MAIN ] HUBB: Loaded 37308 existing records. [2025-09-23T19:20:53.297613] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:53.298084] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-23T19:20:53.298286] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-23T19:20:53.306406] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-23T19:20:53.320487] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-23T19:20:53.356113] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T19:20:53.425436] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T19:20:53.451765] [INFO ] [REMOTE ] HTFC: Full fetch complete (853 records). [2025-09-23T19:20:53.451940] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-23T19:20:53.458255] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T19:20:53.463515] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:20:53.478963] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:20:53.479052] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-23T19:20:53.479397] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-23T19:20:53.505080] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-23T19:20:53.515949] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-23T19:20:53.530809] [INFO ] [MAIN ] Update Progress: 1063/2372 symbols completed. HTFC took 19.4s. Estimated remaining: 2h 53m 26s. Rate: 7.5 symbols/min [2025-09-23T19:20:53.803359] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-23T19:20:53.869797] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:53.937253] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:53.977948] [DEBUG] [LOCAL ] HUBS: Loaded 39661 existing records from primary storage. [2025-09-23T19:20:53.978099] [INFO ] [MAIN ] HUBS: Loaded 39661 existing records. [2025-09-23T19:20:54.158689] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:54.158955] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-23T19:20:54.159004] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-23T19:20:54.160026] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-23T19:20:54.160103] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-23T19:20:54.521883] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:54.602185] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-23T19:20:55.402173] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-23T19:20:55.522921] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T19:20:55.842233] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:20:56.202249] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-23T19:20:56.478948] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T19:20:57.002206] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-23T19:20:57.726803] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:20:57.802175] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-23T19:20:58.478227] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:20:58.602181] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-23T19:20:59.067502] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:20:59.402257] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-23T19:21:00.092521] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:21:00.202247] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-23T19:21:01.002240] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-23T19:21:01.481079] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T19:21:01.753949] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:21:01.802195] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-23T19:21:02.602254] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-23T19:21:03.015944] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T19:21:03.402205] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-23T19:21:04.202171] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-23T19:21:04.372305] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-23T19:21:05.002164] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-23T19:21:05.173847] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T19:21:05.201196] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T19:21:05.392006] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-23T19:21:05.802195] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-23T19:21:06.181281] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T19:21:06.602193] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-23T19:21:07.288911] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T19:21:07.402174] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-23T19:21:07.929102] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T19:21:08.202211] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-23T19:21:08.508971] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T19:21:09.002196] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-23T19:21:09.178854] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T19:21:09.802204] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-23T19:21:10.419240] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:21:10.602251] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-23T19:21:11.402175] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-23T19:21:11.517908] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T19:21:11.976767] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:21:12.202188] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-23T19:21:12.374001] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T19:21:13.002191] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-23T19:21:13.603849] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T19:21:13.613998] [INFO ] [REMOTE ] HUBB: Full fetch complete (53581 records). [2025-09-23T19:21:13.614202] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-23T19:21:13.809093] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-23T19:21:14.008586] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-23T19:21:14.008702] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-23T19:21:14.009511] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-23T19:21:14.009557] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-23T19:21:14.012748] [DEBUG] [LOCAL ] HUBB: Trimmed 53581 records to 37249 (keeping 200 days of data) [2025-09-23T19:21:14.256088] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:21:14.294717] [DEBUG] [LOCAL ] HUBB: Primary data saved (37249 records). [2025-09-23T19:21:14.294916] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-23T19:21:14.295044] [INFO ] [MAIN ] Update Progress: 1064/2372 symbols completed. HUBB took 21.4s. Estimated remaining: 2h 53m 34s. Rate: 7.5 symbols/min [2025-09-23T19:21:14.469931] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:14.521907] [DEBUG] [LOCAL ] HUM: Loaded 48899 existing records from primary storage. [2025-09-23T19:21:14.522106] [INFO ] [MAIN ] HUM: Loaded 48899 existing records. [2025-09-23T19:21:14.607422] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-23T19:21:14.708347] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:14.708701] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-23T19:21:14.708854] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-23T19:21:14.710181] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-23T19:21:14.710245] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-23T19:21:15.102811] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:15.136639] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T19:21:15.402212] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-23T19:21:16.202206] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-23T19:21:16.258251] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T19:21:16.608463] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T19:21:17.002190] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-23T19:21:17.636630] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T19:21:17.802195] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-23T19:21:18.602168] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-23T19:21:18.717173] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:21:19.402236] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-23T19:21:19.536495] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T19:21:19.923561] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T19:21:20.202247] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-23T19:21:20.821976] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:21:21.002204] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-23T19:21:21.802231] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-23T19:21:21.969894] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T19:21:22.602196] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-23T19:21:23.141746] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T19:21:23.149755] [INFO ] [REMOTE ] HTGC: Full fetch complete (68100 records). [2025-09-23T19:21:23.149911] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-23T19:21:23.414593] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-23T19:21:23.546573] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-23T19:21:23.546687] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-23T19:21:23.547551] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-23T19:21:23.547596] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-23T19:21:23.548953] [DEBUG] [LOCAL ] HTGC: Trimmed 68100 records to 47566 (keeping 200 days of data) [2025-09-23T19:21:23.813467] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T19:21:23.891683] [DEBUG] [LOCAL ] HTGC: Primary data saved (47566 records). [2025-09-23T19:21:23.891835] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-23T19:21:23.891946] [INFO ] [MAIN ] Update Progress: 1065/2372 symbols completed. HTGC took 48.1s. Estimated remaining: 2h 53m 28s. Rate: 7.5 symbols/min [2025-09-23T19:21:24.060329] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:24.119761] [DEBUG] [LOCAL ] HUN: Loaded 53203 existing records from primary storage. [2025-09-23T19:21:24.119910] [INFO ] [MAIN ] HUN: Loaded 53203 existing records. [2025-09-23T19:21:24.211712] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-23T19:21:24.306893] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:24.307253] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-23T19:21:24.307309] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-23T19:21:24.308575] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-23T19:21:24.308639] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-23T19:21:24.668134] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:24.781141] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-23T19:21:24.791060] [INFO ] [REMOTE ] HTH: Full fetch complete (46556 records). [2025-09-23T19:21:24.791286] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-23T19:21:25.043296] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-23T19:21:25.203287] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-23T19:21:25.203417] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-23T19:21:25.204372] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-23T19:21:25.204462] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-23T19:21:25.206018] [DEBUG] [LOCAL ] HTH: Trimmed 46556 records to 32495 (keeping 200 days of data) [2025-09-23T19:21:25.300504] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T19:21:25.445914] [DEBUG] [LOCAL ] HTH: Primary data saved (32495 records). [2025-09-23T19:21:25.446063] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-23T19:21:25.446168] [INFO ] [MAIN ] Update Progress: 1066/2372 symbols completed. HTH took 49.5s. Estimated remaining: 2h 53m 12s. Rate: 7.5 symbols/min [2025-09-23T19:21:25.615719] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:25.662332] [DEBUG] [LOCAL ] HUYA: Loaded 44445 existing records from primary storage. [2025-09-23T19:21:25.662468] [INFO ] [MAIN ] HUYA: Loaded 44445 existing records. [2025-09-23T19:21:25.812549] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-23T19:21:25.843814] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:25.844105] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-23T19:21:25.844174] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-23T19:21:25.845519] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-23T19:21:25.845740] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-23T19:21:26.040212] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T19:21:26.135972] [INFO ] [REMOTE ] HUBS: Full fetch complete (55456 records). [2025-09-23T19:21:26.158304] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-23T19:21:26.323481] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:26.605457] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-23T19:21:26.726293] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-23T19:21:26.726549] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-23T19:21:26.728121] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-23T19:21:26.728255] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-23T19:21:26.730200] [DEBUG] [LOCAL ] HUBS: Trimmed 55456 records to 39541 (keeping 200 days of data) [2025-09-23T19:21:26.875887] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T19:21:27.188095] [DEBUG] [LOCAL ] HUBS: Primary data saved (39541 records). [2025-09-23T19:21:27.188342] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-23T19:21:27.188518] [INFO ] [MAIN ] Update Progress: 1067/2372 symbols completed. HUBS took 33.6s. Estimated remaining: 2h 52m 56s. Rate: 7.5 symbols/min [2025-09-23T19:21:27.417803] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-23T19:21:27.460921] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:27.490112] [DEBUG] [LOCAL ] HVT: Loaded 16157 existing records from primary storage. [2025-09-23T19:21:27.490460] [INFO ] [MAIN ] HVT: Loaded 16157 existing records. [2025-09-23T19:21:27.781067] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:27.781768] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-23T19:21:27.781881] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-23T19:21:27.782627] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-23T19:21:27.782845] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-23T19:21:28.028069] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-23T19:21:28.209787] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-23T19:21:28.240268] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:28.267393] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:21:28.770995] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T19:21:29.002209] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-23T19:21:29.802217] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-23T19:21:30.260973] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-23T19:21:30.463713] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:21:30.542926] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T19:21:30.602192] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-23T19:21:31.402255] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-23T19:21:32.122102] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T19:21:32.202164] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-23T19:21:33.011791] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-23T19:21:33.018332] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T19:21:33.802185] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-23T19:21:33.880317] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T19:21:34.602179] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-23T19:21:34.701212] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:21:35.158022] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T19:21:35.402160] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-23T19:21:35.558058] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T19:21:36.202207] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-23T19:21:37.002222] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-23T19:21:37.088282] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T19:21:37.270760] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T19:21:37.802214] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-23T19:21:38.518417] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T19:21:38.602234] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-23T19:21:39.402242] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-23T19:21:39.470481] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T19:21:39.934043] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T19:21:40.202223] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-23T19:21:40.452144] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T19:21:41.002239] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-23T19:21:41.589481] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:21:41.802158] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-23T19:21:42.081854] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T19:21:42.602468] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-23T19:21:43.379229] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:21:43.402158] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-23T19:21:44.207357] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-23T19:21:44.225431] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T19:21:44.470402] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T19:21:44.980534] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:21:45.002179] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-23T19:21:45.802212] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-23T19:21:46.602201] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-23T19:21:46.829992] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T19:21:46.852696] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T19:21:47.402257] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-23T19:21:48.202222] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-23T19:21:48.877690] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-23T19:21:48.887922] [INFO ] [REMOTE ] HUM: Full fetch complete (70991 records). [2025-09-23T19:21:48.888121] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-23T19:21:49.007368] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-23T19:21:49.283810] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-23T19:21:49.283895] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-23T19:21:49.284814] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-23T19:21:49.284880] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-23T19:21:49.286295] [DEBUG] [LOCAL ] HUM: Trimmed 70991 records to 48892 (keeping 200 days of data) [2025-09-23T19:21:49.638622] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:21:49.650512] [DEBUG] [LOCAL ] HUM: Primary data saved (48892 records). [2025-09-23T19:21:49.651175] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-23T19:21:49.651452] [INFO ] [MAIN ] Update Progress: 1068/2372 symbols completed. HUM took 35.4s. Estimated remaining: 2h 53m 6s. Rate: 7.5 symbols/min [2025-09-23T19:21:49.801572] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T19:21:49.806828] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-23T19:21:49.863740] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:49.923800] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-23T19:21:49.950629] [DEBUG] [LOCAL ] HWM: Loaded 53021 existing records from primary storage. [2025-09-23T19:21:49.950814] [INFO ] [MAIN ] HWM: Loaded 53021 existing records. [2025-09-23T19:21:50.126711] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:50.126972] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-23T19:21:50.127020] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-23T19:21:50.128459] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-23T19:21:50.128521] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-23T19:21:50.509722] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:50.602161] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-23T19:21:51.402216] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-23T19:21:51.687753] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T19:21:51.696572] [INFO ] [REMOTE ] HUN: Full fetch complete (76605 records). [2025-09-23T19:21:51.696750] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-23T19:21:52.098268] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-23T19:21:52.098553] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-23T19:21:52.099557] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-23T19:21:52.099622] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-23T19:21:52.101239] [DEBUG] [LOCAL ] HUN: Trimmed 76605 records to 53203 (keeping 200 days of data) [2025-09-23T19:21:52.202238] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-23T19:21:52.371448] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T19:21:52.402182] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T19:21:52.494673] [DEBUG] [LOCAL ] HUN: Primary data saved (53203 records). [2025-09-23T19:21:52.494828] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-23T19:21:52.494959] [INFO ] [MAIN ] Update Progress: 1069/2372 symbols completed. HUN took 28.6s. Estimated remaining: 2h 52m 52s. Rate: 7.5 symbols/min [2025-09-23T19:21:52.664461] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:52.709187] [DEBUG] [LOCAL ] HXL: Loaded 46127 existing records from primary storage. [2025-09-23T19:21:52.709348] [INFO ] [MAIN ] HXL: Loaded 46127 existing records. [2025-09-23T19:21:52.892812] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:52.893088] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-23T19:21:52.893134] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-23T19:21:52.894541] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-23T19:21:52.894603] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-23T19:21:53.007391] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-23T19:21:53.310231] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:53.470294] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:21:53.802195] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-23T19:21:54.602210] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-23T19:21:54.750350] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T19:21:55.141471] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:21:55.149356] [INFO ] [REMOTE ] HUYA: Full fetch complete (63855 records). [2025-09-23T19:21:55.149469] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-23T19:21:55.407292] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-23T19:21:55.469533] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T19:21:55.505914] [INFO ] [REMOTE ] HVT: Full fetch complete (23750 records). [2025-09-23T19:21:55.520402] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-23T19:21:55.602069] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-23T19:21:55.628323] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-23T19:21:55.635481] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-23T19:21:55.640723] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-23T19:21:55.690009] [DEBUG] [LOCAL ] HUYA: Trimmed 63855 records to 44441 (keeping 200 days of data) [2025-09-23T19:21:56.027232] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-23T19:21:56.027878] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-23T19:21:56.028726] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-23T19:21:56.028804] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-23T19:21:56.030826] [DEBUG] [LOCAL ] HVT: Trimmed 23750 records to 16034 (keeping 200 days of data) [2025-09-23T19:21:56.203854] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-23T19:21:56.239457] [DEBUG] [LOCAL ] HVT: Primary data saved (16034 records). [2025-09-23T19:21:56.240158] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-23T19:21:56.240513] [INFO ] [MAIN ] Update Progress: 1070/2372 symbols completed. HVT took 29.1s. Estimated remaining: 2h 52m 39s. Rate: 7.5 symbols/min [2025-09-23T19:21:56.426936] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:56.444096] [DEBUG] [LOCAL ] HY: Loaded 10144 existing records from primary storage. [2025-09-23T19:21:56.446927] [INFO ] [MAIN ] HY: Loaded 10144 existing records. [2025-09-23T19:21:56.647253] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:56.649902] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-23T19:21:56.651474] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-23T19:21:56.673462] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-23T19:21:56.678262] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-23T19:21:56.846980] [DEBUG] [LOCAL ] HUYA: Primary data saved (44441 records). [2025-09-23T19:21:56.863492] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-23T19:21:56.874704] [INFO ] [MAIN ] Update Progress: 1071/2372 symbols completed. HUYA took 31.4s. Estimated remaining: 2h 52m 22s. Rate: 7.5 symbols/min [2025-09-23T19:21:56.891968] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T19:21:57.049026] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-23T19:21:57.274268] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:57.299147] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-23T19:21:57.304976] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-23T19:21:57.323242] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-23T19:21:57.331142] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-23T19:21:57.333574] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-23T19:21:57.333715] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-23T19:21:57.342720] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:57.691220] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:57.802169] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-23T19:21:57.867056] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:21:58.306296] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:21:58.352902] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T19:21:58.602200] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-23T19:21:59.367483] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:21:59.402230] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-23T19:21:59.986501] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T19:22:00.202235] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-23T19:22:01.002242] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-23T19:22:01.689248] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:22:01.802207] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-23T19:22:02.607479] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-23T19:22:02.613817] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T19:22:03.149204] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T19:22:03.402210] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-23T19:22:03.510228] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T19:22:04.202211] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-23T19:22:05.002249] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-23T19:22:05.061914] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:22:05.494124] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T19:22:05.802212] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-23T19:22:06.113838] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T19:22:06.602217] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-23T19:22:07.207083] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T19:22:07.402200] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-23T19:22:07.495068] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T19:22:08.202202] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-23T19:22:08.543340] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T19:22:09.002183] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-23T19:22:09.186432] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T19:22:09.340260] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T19:22:09.802210] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-23T19:22:10.602196] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-23T19:22:11.318407] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:22:11.402237] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-23T19:22:12.202202] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-23T19:22:12.235078] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:22:12.960258] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T19:22:13.002201] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-23T19:22:13.077770] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T19:22:13.742693] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:22:13.802170] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-23T19:22:14.602205] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-23T19:22:15.346165] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T19:22:15.402192] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-23T19:22:15.603321] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T19:22:15.624253] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-23T19:22:16.202199] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-23T19:22:17.002227] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-23T19:22:17.254222] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-23T19:22:17.802165] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-23T19:22:17.971324] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T19:22:18.043100] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-23T19:22:18.602202] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-23T19:22:18.914378] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-23T19:22:19.402249] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-23T19:22:20.202207] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-23T19:22:21.002199] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-23T19:22:21.430454] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T19:22:21.439588] [INFO ] [REMOTE ] HWM: Full fetch complete (76642 records). [2025-09-23T19:22:21.439778] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-23T19:22:21.746746] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T19:22:21.804801] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-23T19:22:21.900264] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-23T19:22:21.909258] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-23T19:22:21.915920] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-23T19:22:21.925414] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-23T19:22:21.927977] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T19:22:21.938497] [DEBUG] [LOCAL ] HWM: Trimmed 76642 records to 53013 (keeping 200 days of data) [2025-09-23T19:22:22.043798] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-23T19:22:22.305595] [DEBUG] [LOCAL ] HWM: Primary data saved (53013 records). [2025-09-23T19:22:22.305784] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-23T19:22:22.305885] [INFO ] [MAIN ] Update Progress: 1072/2372 symbols completed. HWM took 32.7s. Estimated remaining: 2h 52m 35s. Rate: 7.5 symbols/min [2025-09-23T19:22:22.495703] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:22.495898] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-23T19:22:22.495951] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-23T19:22:22.496100] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-23T19:22:22.496142] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-23T19:22:22.496206] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-23T19:22:22.496239] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-23T19:22:22.607459] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-23T19:22:22.880458] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:22.956091] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-23T19:22:22.957110] [INFO ] [REMOTE ] HYAC: Full fetch complete (869 records). [2025-09-23T19:22:22.957207] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-23T19:22:23.159534] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-23T19:22:23.159769] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:22:23.159840] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:22:23.159918] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-23T19:22:23.159984] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-23T19:22:23.160025] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-23T19:22:23.160081] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-23T19:22:23.160162] [INFO ] [MAIN ] Update Progress: 1073/2372 symbols completed. HYAC took 26.3s. Estimated remaining: 2h 52m 19s. Rate: 7.5 symbols/min [2025-09-23T19:22:23.334628] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:23.345255] [DEBUG] [LOCAL ] HYI: Loaded 8846 existing records from primary storage. [2025-09-23T19:22:23.345385] [INFO ] [MAIN ] HYI: Loaded 8846 existing records. [2025-09-23T19:22:23.411139] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-23T19:22:23.540037] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:22:23.540316] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-23T19:22:23.540373] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-23T19:22:23.540756] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-23T19:22:23.540815] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-23T19:22:23.928275] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:24.202192] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-23T19:22:24.343684] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T19:22:24.625991] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T19:22:25.002237] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-23T19:22:25.342617] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T19:22:25.802199] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-23T19:22:26.602205] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-23T19:22:26.793613] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:22:26.797457] [INFO ] [REMOTE ] HY: Full fetch complete (15264 records). [2025-09-23T19:22:26.797581] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-23T19:22:26.888568] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-23T19:22:27.172880] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-23T19:22:27.172969] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-23T19:22:27.173382] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-23T19:22:27.173440] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-23T19:22:27.174182] [DEBUG] [LOCAL ] HY: Trimmed 15264 records to 10134 (keeping 200 days of data) [2025-09-23T19:22:27.241085] [DEBUG] [LOCAL ] HY: Primary data saved (10134 records). [2025-09-23T19:22:27.241241] [INFO ] [MAIN ] HY: Full history saved. [2025-09-23T19:22:27.241351] [INFO ] [MAIN ] Update Progress: 1074/2372 symbols completed. HY took 31.0s. Estimated remaining: 2h 52m 6s. Rate: 7.5 symbols/min [2025-09-23T19:22:27.406232] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-23T19:22:27.427502] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:27.465303] [DEBUG] [LOCAL ] HYT: Loaded 33218 existing records from primary storage. [2025-09-23T19:22:27.465457] [INFO ] [MAIN ] HYT: Loaded 33218 existing records. [2025-09-23T19:22:27.653992] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:22:27.654278] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-23T19:22:27.654328] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-23T19:22:27.655218] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-23T19:22:27.655279] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-23T19:22:28.043469] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:28.202256] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-23T19:22:28.444432] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-23T19:22:29.002206] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-23T19:22:29.032499] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T19:22:29.040291] [INFO ] [REMOTE ] HXL: Full fetch complete (66161 records). [2025-09-23T19:22:29.040422] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-23T19:22:29.442187] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-23T19:22:29.442275] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-23T19:22:29.443192] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-23T19:22:29.443257] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-23T19:22:29.444902] [DEBUG] [LOCAL ] HXL: Trimmed 66161 records to 46079 (keeping 200 days of data) [2025-09-23T19:22:29.751935] [DEBUG] [LOCAL ] HXL: Primary data saved (46079 records). [2025-09-23T19:22:29.752106] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-23T19:22:29.752210] [INFO ] [MAIN ] Update Progress: 1075/2372 symbols completed. HXL took 37.3s. Estimated remaining: 2h 51m 51s. Rate: 7.5 symbols/min [2025-09-23T19:22:29.811677] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-23T19:22:29.954796] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:29.960733] [DEBUG] [LOCAL ] HYTR: Loaded 3174 existing records from primary storage. [2025-09-23T19:22:29.960845] [INFO ] [MAIN ] HYTR: Loaded 3174 existing records. [2025-09-23T19:22:30.150475] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:22:30.150839] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-23T19:22:30.150896] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-23T19:22:30.157286] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-23T19:22:30.167313] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-23T19:22:30.167844] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T19:22:30.470262] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:22:30.593246] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:30.602228] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-23T19:22:31.023020] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T19:22:31.402264] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-23T19:22:32.095786] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T19:22:32.202246] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-23T19:22:32.519753] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-23T19:22:33.002206] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-23T19:22:33.802218] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-23T19:22:34.567374] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T19:22:34.568398] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:22:34.602138] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-23T19:22:35.402206] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-23T19:22:35.754076] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T19:22:35.844418] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:22:36.202229] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-23T19:22:36.766898] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T19:22:37.002205] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-23T19:22:37.332331] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T19:22:37.802231] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-23T19:22:38.357384] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T19:22:38.602208] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-23T19:22:39.406282] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-23T19:22:39.408910] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T19:22:39.733467] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T19:22:40.202212] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-23T19:22:40.939327] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:22:41.002235] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-23T19:22:41.611488] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:22:41.802195] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-23T19:22:42.602196] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-23T19:22:42.786244] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T19:22:42.961793] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-23T19:22:43.402213] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-23T19:22:44.143004] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:22:44.202224] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-23T19:22:45.002213] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-23T19:22:45.156193] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:22:45.564247] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T19:22:45.802189] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-23T19:22:46.602258] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-23T19:22:46.631460] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T19:22:47.402188] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-23T19:22:48.114032] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T19:22:48.112502] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:22:48.123980] [INFO ] [REMOTE ] HYI: Full fetch complete (12786 records). [2025-09-23T19:22:48.124327] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-23T19:22:48.207318] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-23T19:22:48.508215] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-23T19:22:48.508318] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-23T19:22:48.508763] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-23T19:22:48.508845] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-23T19:22:48.509559] [DEBUG] [LOCAL ] HYI: Trimmed 12786 records to 8893 (keeping 200 days of data) [2025-09-23T19:22:48.569074] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T19:22:48.577182] [DEBUG] [LOCAL ] HYI: Primary data saved (8893 records). [2025-09-23T19:22:48.577359] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-23T19:22:48.577474] [INFO ] [MAIN ] Update Progress: 1076/2372 symbols completed. HYI took 25.4s. Estimated remaining: 2h 51m 57s. Rate: 7.5 symbols/min [2025-09-23T19:22:48.768051] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:48.802922] [DEBUG] [LOCAL ] HZO: Loaded 29378 existing records from primary storage. [2025-09-23T19:22:48.803071] [INFO ] [MAIN ] HZO: Loaded 29378 existing records. [2025-09-23T19:22:48.983639] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:22:48.983996] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-23T19:22:48.984078] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-23T19:22:48.984843] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-23T19:22:48.984931] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-23T19:22:49.007434] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-23T19:22:49.342825] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:49.802208] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-23T19:22:50.509301] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:22:50.531196] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T19:22:50.602153] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-23T19:22:51.402153] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-23T19:22:51.731172] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:22:52.202197] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-23T19:22:53.002268] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-23T19:22:53.802239] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-23T19:23:04.639711] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (13.24 seconds). [2025-09-23T19:23:04.640744] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-23T19:23:05.475281] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (13.27 seconds). [2025-09-23T19:23:05.477070] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-23T19:23:06.000331] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (13.00 seconds). [2025-09-23T19:23:06.005845] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-23T19:23:06.055690] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (12.25 seconds). [2025-09-23T19:23:06.063368] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-23T19:23:06.411377] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T19:23:06.412903] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-23T19:23:06.935994] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T19:23:06.937282] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-23T19:23:07.148830] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-23T19:23:07.149564] [INFO ] [REMOTE ] HYBX: Full fetch complete (817 records). [2025-09-23T19:23:07.149636] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-23T19:23:07.360363] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T19:23:07.399837] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:23:07.400831] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:23:07.405621] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-23T19:23:07.405519] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T19:23:07.410208] [INFO ] [REMOTE ] HYTR: Full fetch complete (4432 records). [2025-09-23T19:23:07.408253] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:23:07.417418] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-23T19:23:07.419788] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-23T19:23:07.419531] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T19:23:07.449454] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-23T19:23:07.449546] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-23T19:23:07.474975] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-23T19:23:07.475295] [INFO ] [MAIN ] Update Progress: 1077/2372 symbols completed. HYBX took 45.2s. Estimated remaining: 2h 52m 2s. Rate: 7.5 symbols/min [2025-09-23T19:23:07.500152] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-23T19:23:07.828034] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-23T19:23:07.828215] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-23T19:23:07.828415] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-23T19:23:07.828495] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-23T19:23:07.829117] [DEBUG] [LOCAL ] HYTR: Trimmed 4432 records to 3182 (keeping 200 days of data) [2025-09-23T19:23:07.852599] [DEBUG] [LOCAL ] HYTR: Primary data saved (3182 records). [2025-09-23T19:23:07.852713] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-23T19:23:07.852882] [INFO ] [MAIN ] Update Progress: 1078/2372 symbols completed. HYTR took 38.1s. Estimated remaining: 2h 51m 45s. Rate: 7.5 symbols/min [2025-09-23T19:23:08.979756] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:23:08.993399] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-23T19:23:09.029886] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:23:09.038783] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-23T19:23:10.246474] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T19:23:10.253016] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-23T19:23:10.457582] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T19:23:10.463054] [INFO ] [REMOTE ] HYT: Full fetch complete (46846 records). [2025-09-23T19:23:10.463205] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-23T19:23:10.886988] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-23T19:23:10.887162] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-23T19:23:10.887956] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-23T19:23:10.888044] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-23T19:23:10.892340] [DEBUG] [LOCAL ] HYT: Trimmed 46846 records to 33213 (keeping 200 days of data) [2025-09-23T19:23:11.102691] [DEBUG] [LOCAL ] HYT: Primary data saved (33213 records). [2025-09-23T19:23:11.102846] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-23T19:23:11.103062] [INFO ] [MAIN ] Update Progress: 1079/2372 symbols completed. HYT took 43.9s. Estimated remaining: 2h 51m 31s. Rate: 7.5 symbols/min [2025-09-23T19:23:11.455722] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T19:23:11.463897] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-23T19:23:12.725185] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:23:12.735202] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-23T19:23:13.864176] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:23:13.871909] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-23T19:23:15.106126] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:23:15.112201] [INFO ] [REMOTE ] HZO: Full fetch complete (40652 records). [2025-09-23T19:23:15.112401] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-23T19:23:15.505793] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-23T19:23:15.505869] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-23T19:23:15.506505] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-23T19:23:15.506604] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-23T19:23:15.507547] [DEBUG] [LOCAL ] HZO: Trimmed 40652 records to 29357 (keeping 200 days of data) [2025-09-23T19:23:15.688603] [DEBUG] [LOCAL ] HZO: Primary data saved (29357 records). [2025-09-23T19:23:15.688750] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-23T19:23:15.688902] [INFO ] [MAIN ] Update Progress: 1080/2372 symbols completed. HZO took 27.1s. Estimated remaining: 2h 51m 19s. Rate: 7.5 symbols/min [2025-09-23T19:23:16.285534] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:16.460726] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:16.433606] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:16.483149] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:16.507929] [DEBUG] [LOCAL ] IAE: Loaded 5843 existing records from primary storage. [2025-09-23T19:23:16.508045] [INFO ] [MAIN ] IAE: Loaded 5843 existing records. [2025-09-23T19:23:16.752292] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:16.768552] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-23T19:23:16.768835] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-23T19:23:16.785451] [DEBUG] [LOCAL ] IBN: Loaded 52896 existing records from primary storage. [2025-09-23T19:23:16.785757] [INFO ] [MAIN ] IBN: Loaded 52896 existing records. [2025-09-23T19:23:16.786428] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-23T19:23:16.786600] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-23T19:23:16.792583] [DEBUG] [LOCAL ] IBM: Loaded 53638 existing records from primary storage. [2025-09-23T19:23:16.823910] [INFO ] [MAIN ] IBM: Loaded 53638 existing records. [2025-09-23T19:23:17.034703] [DEBUG] [LOCAL ] IAG: Loaded 53442 existing records from primary storage. [2025-09-23T19:23:17.104966] [INFO ] [MAIN ] IAG: Loaded 53442 existing records. [2025-09-23T19:23:17.435217] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:17.474941] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-23T19:23:17.553026] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:17.567433] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-23T19:23:17.567553] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-23T19:23:17.583805] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-23T19:23:17.572868] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-23T19:23:17.589779] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-23T19:23:17.677533] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-23T19:23:17.762185] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-23T19:23:17.796089] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:17.838891] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:17.869164] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-23T19:23:17.876047] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-23T19:23:17.907382] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-23T19:23:17.949832] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-23T19:23:17.950001] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-23T19:23:18.821918] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T19:23:18.851399] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:18.898411] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:18.892513] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-23T19:23:18.894631] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-23T19:23:18.898977] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-23T19:23:18.982742] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:18.983034] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-23T19:23:19.397569] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T19:23:19.399333] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-23T19:23:20.049951] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T19:23:20.051978] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-23T19:23:20.753488] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T19:23:20.755696] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-23T19:23:20.859701] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T19:23:20.870346] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-23T19:23:20.914557] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T19:23:20.926131] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-23T19:23:21.093544] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T19:23:21.105611] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-23T19:23:21.111064] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T19:23:21.113183] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-23T19:23:21.794516] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T19:23:21.796706] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-23T19:23:22.242400] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:23:22.252763] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-23T19:23:22.270830] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T19:23:22.272838] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-23T19:23:22.751730] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T19:23:22.763234] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-23T19:23:22.946810] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T19:23:22.949002] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-23T19:23:23.243199] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T19:23:23.253927] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-23T19:23:23.456086] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:23:23.466479] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-23T19:23:23.612003] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T19:23:23.613953] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-23T19:23:24.466338] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T19:23:24.468416] [INFO ] [REMOTE ] IAE: Full fetch complete (8573 records). [2025-09-23T19:23:24.468492] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-23T19:23:24.846963] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-23T19:23:24.847130] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-23T19:23:24.847512] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-23T19:23:24.847758] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-23T19:23:24.876245] [DEBUG] [LOCAL ] IAE: Trimmed 8573 records to 5892 (keeping 200 days of data) [2025-09-23T19:23:24.878745] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-23T19:23:24.906335] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-23T19:23:24.926133] [DEBUG] [LOCAL ] IAE: Primary data saved (5892 records). [2025-09-23T19:23:24.926250] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-23T19:23:24.926334] [INFO ] [MAIN ] Update Progress: 1081/2372 symbols completed. IAE took 9.2s. Estimated remaining: 2h 51m 13s. Rate: 7.5 symbols/min [2025-09-23T19:23:25.110004] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:25.175000] [DEBUG] [LOCAL ] IBP: Loaded 29382 existing records from primary storage. [2025-09-23T19:23:25.178182] [INFO ] [MAIN ] IBP: Loaded 29382 existing records. [2025-09-23T19:23:25.178013] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T19:23:25.250170] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-23T19:23:25.392989] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:25.393356] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-23T19:23:25.393431] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-23T19:23:25.394557] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-23T19:23:25.394623] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-23T19:23:25.724150] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-23T19:23:25.777219] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-23T19:23:25.824933] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:25.825309] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-23T19:23:26.621350] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T19:23:26.634208] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-23T19:23:26.705737] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T19:23:26.711233] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-23T19:23:27.123009] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T19:23:27.134161] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-23T19:23:27.619691] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:23:27.625304] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-23T19:23:27.658553] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T19:23:28.211616] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-23T19:23:28.232327] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T19:23:28.497489] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T19:23:28.905938] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T19:23:29.002198] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-23T19:23:29.802254] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-23T19:23:30.117271] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T19:23:30.316035] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T19:23:30.602230] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-23T19:23:30.712737] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T19:23:31.402195] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-23T19:23:32.202215] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-23T19:23:32.284848] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T19:23:32.695945] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:23:33.002183] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-23T19:23:33.802165] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-23T19:23:34.020778] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T19:23:34.602219] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-23T19:23:34.758773] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:23:35.402210] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-23T19:23:35.490044] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T19:23:35.939916] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-23T19:23:36.202227] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-23T19:23:36.854214] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:23:37.002231] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-23T19:23:37.802216] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-23T19:23:38.038129] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T19:23:38.602197] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-23T19:23:39.038512] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T19:23:39.170247] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:23:39.178985] [INFO ] [REMOTE ] IBN: Full fetch complete (76259 records). [2025-09-23T19:23:39.179122] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-23T19:23:39.412114] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-23T19:23:39.580176] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-23T19:23:39.580280] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-23T19:23:39.581270] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-23T19:23:39.581338] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-23T19:23:39.583058] [DEBUG] [LOCAL ] IBN: Trimmed 76259 records to 52892 (keeping 200 days of data) [2025-09-23T19:23:39.923960] [DEBUG] [LOCAL ] IBN: Primary data saved (52892 records). [2025-09-23T19:23:39.924097] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-23T19:23:39.924192] [INFO ] [MAIN ] Update Progress: 1082/2372 symbols completed. IBN took 24.2s. Estimated remaining: 2h 51m 13s. Rate: 7.5 symbols/min [2025-09-23T19:23:40.114574] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:40.152945] [DEBUG] [LOCAL ] IBTA: Loaded 38115 existing records from primary storage. [2025-09-23T19:23:40.153102] [INFO ] [MAIN ] IBTA: Loaded 38115 existing records. [2025-09-23T19:23:40.217963] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-23T19:23:40.339952] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:40.340229] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-23T19:23:40.340280] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-23T19:23:40.341456] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-23T19:23:40.341519] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-23T19:23:40.718007] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:40.752991] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T19:23:40.927537] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T19:23:41.002239] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-23T19:23:41.158857] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T19:23:41.802239] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-23T19:23:42.602192] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-23T19:23:42.943268] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T19:23:42.952348] [INFO ] [REMOTE ] IAG: Full fetch complete (77207 records). [2025-09-23T19:23:42.952503] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-23T19:23:43.343452] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-23T19:23:43.343533] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-23T19:23:43.344509] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-23T19:23:43.344574] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-23T19:23:43.348554] [DEBUG] [LOCAL ] IAG: Trimmed 77207 records to 53442 (keeping 200 days of data) [2025-09-23T19:23:43.407763] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-23T19:23:43.685455] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T19:23:43.716998] [DEBUG] [LOCAL ] IAG: Primary data saved (53442 records). [2025-09-23T19:23:43.717162] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-23T19:23:43.717256] [INFO ] [MAIN ] Update Progress: 1083/2372 symbols completed. IAG took 28.0s. Estimated remaining: 2h 51m 0s. Rate: 7.5 symbols/min [2025-09-23T19:23:43.888865] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:43.943724] [DEBUG] [LOCAL ] ICE: Loaded 53023 existing records from primary storage. [2025-09-23T19:23:43.943904] [INFO ] [MAIN ] ICE: Loaded 53023 existing records. [2025-09-23T19:23:44.149301] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:44.149720] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-23T19:23:44.149853] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-23T19:23:44.151364] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-23T19:23:44.151428] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-23T19:23:44.214336] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-23T19:23:44.316382] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-23T19:23:44.595214] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:23:44.600965] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:45.002246] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-23T19:23:45.624267] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:23:45.802271] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-23T19:23:46.602168] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-23T19:23:46.775767] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T19:23:46.963975] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T19:23:47.402187] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-23T19:23:48.140069] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T19:23:48.145192] [INFO ] [REMOTE ] IBP: Full fetch complete (41108 records). [2025-09-23T19:23:48.145309] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-23T19:23:48.210448] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-23T19:23:48.575242] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-23T19:23:48.575570] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-23T19:23:48.576328] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-23T19:23:48.576416] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-23T19:23:48.577413] [DEBUG] [LOCAL ] IBP: Trimmed 41108 records to 29338 (keeping 200 days of data) [2025-09-23T19:23:48.701209] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T19:23:48.809368] [DEBUG] [LOCAL ] IBP: Primary data saved (29338 records). [2025-09-23T19:23:48.809507] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-23T19:23:48.809594] [INFO ] [MAIN ] Update Progress: 1084/2372 symbols completed. IBP took 23.9s. Estimated remaining: 2h 50m 49s. Rate: 7.5 symbols/min [2025-09-23T19:23:48.980961] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:49.006846] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-23T19:23:49.023870] [DEBUG] [LOCAL ] ICL: Loaded 38776 existing records from primary storage. [2025-09-23T19:23:49.024026] [INFO ] [MAIN ] ICL: Loaded 38776 existing records. [2025-09-23T19:23:49.197719] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:49.197939] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-23T19:23:49.197987] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-23T19:23:49.199014] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-23T19:23:49.199075] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-23T19:23:49.548912] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:49.796549] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T19:23:49.807168] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-23T19:23:50.602194] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-23T19:23:50.683757] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T19:23:51.402256] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-23T19:23:52.063681] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T19:23:52.097133] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-23T19:23:52.106298] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-09-23T19:23:52.106448] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-23T19:23:52.207394] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-23T19:23:52.514737] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-23T19:23:52.515037] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-23T19:23:52.516048] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-23T19:23:52.516134] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-23T19:23:52.518156] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 53639 (keeping 200 days of data) [2025-09-23T19:23:52.670693] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T19:23:52.930312] [DEBUG] [LOCAL ] IBM: Primary data saved (53639 records). [2025-09-23T19:23:52.930464] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-23T19:23:52.930551] [INFO ] [MAIN ] Update Progress: 1085/2372 symbols completed. IBM took 37.2s. Estimated remaining: 2h 50m 36s. Rate: 7.5 symbols/min [2025-09-23T19:23:53.008746] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-23T19:23:53.111236] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:53.150185] [DEBUG] [LOCAL ] IDA: Loaded 31959 existing records from primary storage. [2025-09-23T19:23:53.150329] [INFO ] [MAIN ] IDA: Loaded 31959 existing records. [2025-09-23T19:23:53.334620] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:53.334967] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-23T19:23:53.335121] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-23T19:23:53.348703] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-23T19:23:53.348783] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-23T19:23:53.456349] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T19:23:53.757772] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:53.802155] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-23T19:23:54.440738] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:23:54.602244] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-23T19:23:55.117039] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T19:23:55.402225] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-23T19:23:56.202233] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-23T19:23:56.434452] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T19:23:56.481417] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:23:57.002247] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-23T19:23:57.626583] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:23:57.802226] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-23T19:23:58.079016] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T19:23:58.602246] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-23T19:23:59.402193] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-23T19:23:59.536131] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:23:59.934630] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T19:24:00.202201] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-23T19:24:00.393543] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T19:24:01.002252] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-23T19:24:01.802225] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-23T19:24:02.602187] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-23T19:24:02.746877] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-23T19:24:03.188733] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-23T19:24:03.402278] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-23T19:24:04.202220] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-23T19:24:04.445586] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-23T19:24:04.923297] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-23T19:24:05.002189] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-23T19:24:05.052830] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T19:24:05.762734] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T19:24:05.802164] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-23T19:24:06.578611] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:24:06.602181] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-23T19:24:07.281119] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T19:24:07.402240] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-23T19:24:07.753030] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T19:24:07.760325] [INFO ] [REMOTE ] IBTA: Full fetch complete (50581 records). [2025-09-23T19:24:07.760431] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-23T19:24:08.151299] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-23T19:24:08.151420] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-23T19:24:08.152351] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-23T19:24:08.152415] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-23T19:24:08.153534] [DEBUG] [LOCAL ] IBTA: Trimmed 50581 records to 38052 (keeping 200 days of data) [2025-09-23T19:24:08.209896] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-23T19:24:08.375998] [DEBUG] [LOCAL ] IBTA: Primary data saved (38052 records). [2025-09-23T19:24:08.376580] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-23T19:24:08.376710] [INFO ] [MAIN ] Update Progress: 1086/2372 symbols completed. IBTA took 28.5s. Estimated remaining: 2h 50m 37s. Rate: 7.5 symbols/min [2025-09-23T19:24:08.549782] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:08.559767] [DEBUG] [LOCAL ] IDE: Loaded 8405 existing records from primary storage. [2025-09-23T19:24:08.559914] [INFO ] [MAIN ] IDE: Loaded 8405 existing records. [2025-09-23T19:24:08.744865] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:08.745220] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-23T19:24:08.745273] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-23T19:24:08.745845] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-23T19:24:08.745967] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-23T19:24:09.021678] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-23T19:24:09.042441] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:24:09.152153] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:09.802277] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-23T19:24:10.039792] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T19:24:10.088356] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:24:10.602206] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-23T19:24:11.277476] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:24:11.402186] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-23T19:24:11.954178] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T19:24:12.202211] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-23T19:24:12.956188] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T19:24:12.962538] [INFO ] [REMOTE ] ICL: Full fetch complete (56375 records). [2025-09-23T19:24:12.962736] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-23T19:24:13.007298] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-23T19:24:13.091281] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T19:24:13.370315] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-23T19:24:13.370394] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-23T19:24:13.371197] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-23T19:24:13.371261] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-23T19:24:13.372428] [DEBUG] [LOCAL ] ICL: Trimmed 56375 records to 38666 (keeping 200 days of data) [2025-09-23T19:24:13.593562] [DEBUG] [LOCAL ] ICL: Primary data saved (38666 records). [2025-09-23T19:24:13.593729] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-23T19:24:13.593825] [INFO ] [MAIN ] Update Progress: 1087/2372 symbols completed. ICL took 24.8s. Estimated remaining: 2h 50m 26s. Rate: 7.5 symbols/min [2025-09-23T19:24:13.769803] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:13.788430] [DEBUG] [LOCAL ] IDT: Loaded 17600 existing records from primary storage. [2025-09-23T19:24:13.788578] [INFO ] [MAIN ] IDT: Loaded 17600 existing records. [2025-09-23T19:24:13.810063] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-23T19:24:13.975281] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:13.975542] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-23T19:24:13.975590] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-23T19:24:13.976156] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-23T19:24:13.976218] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-23T19:24:14.336452] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:14.602156] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-23T19:24:14.796606] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T19:24:15.402169] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-23T19:24:15.599894] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-23T19:24:16.091429] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T19:24:16.202179] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-23T19:24:17.002239] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-23T19:24:17.292804] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:24:17.474921] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T19:24:17.706858] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T19:24:17.802150] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-23T19:24:18.602238] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-23T19:24:19.200614] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T19:24:19.221915] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T19:24:19.402211] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-23T19:24:20.107942] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T19:24:20.202172] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-23T19:24:20.947417] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T19:24:21.002213] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-23T19:24:21.802217] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-23T19:24:22.439339] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T19:24:22.602205] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-23T19:24:23.051339] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:24:23.312629] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T19:24:23.322737] [INFO ] [REMOTE ] ICE: Full fetch complete (76765 records). [2025-09-23T19:24:23.322932] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-23T19:24:23.409507] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-23T19:24:23.981469] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-23T19:24:23.981607] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-23T19:24:23.983451] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-23T19:24:23.983539] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-23T19:24:23.985719] [DEBUG] [LOCAL ] ICE: Trimmed 76765 records to 53019 (keeping 200 days of data) [2025-09-23T19:24:24.247368] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-23T19:24:24.313318] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T19:24:24.477089] [DEBUG] [LOCAL ] ICE: Primary data saved (53019 records). [2025-09-23T19:24:24.477259] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-23T19:24:24.477371] [INFO ] [MAIN ] Update Progress: 1088/2372 symbols completed. ICE took 40.8s. Estimated remaining: 2h 50m 22s. Rate: 7.5 symbols/min [2025-09-23T19:24:24.686274] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:24.728509] [DEBUG] [LOCAL ] IEX: Loaded 38423 existing records from primary storage. [2025-09-23T19:24:24.728711] [INFO ] [MAIN ] IEX: Loaded 38423 existing records. [2025-09-23T19:24:24.921230] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:24.921517] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-23T19:24:24.921572] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-23T19:24:24.922544] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-23T19:24:24.922606] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-23T19:24:25.007298] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-23T19:24:25.318738] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:25.351399] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:24:25.802194] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-23T19:24:26.097479] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T19:24:26.488519] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:24:26.602195] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-23T19:24:27.402180] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-23T19:24:27.626868] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T19:24:28.202204] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-23T19:24:28.919587] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T19:24:29.002150] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-23T19:24:29.435116] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:24:29.802170] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-23T19:24:30.602197] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-23T19:24:31.257380] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:24:31.310757] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-23T19:24:31.352757] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T19:24:31.402141] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-23T19:24:32.202194] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-23T19:24:32.835625] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:24:32.839636] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T19:24:33.002210] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-23T19:24:33.802243] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-23T19:24:33.852579] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T19:24:33.854767] [INFO ] [REMOTE ] IDE: Full fetch complete (12805 records). [2025-09-23T19:24:33.854860] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-23T19:24:34.265911] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-23T19:24:34.266007] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-23T19:24:34.266357] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-23T19:24:34.266398] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-23T19:24:34.266919] [DEBUG] [LOCAL ] IDE: Trimmed 12805 records to 8535 (keeping 200 days of data) [2025-09-23T19:24:34.322069] [DEBUG] [LOCAL ] IDE: Primary data saved (8535 records). [2025-09-23T19:24:34.322242] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-23T19:24:34.322353] [INFO ] [MAIN ] Update Progress: 1089/2372 symbols completed. IDE took 25.9s. Estimated remaining: 2h 50m 16s. Rate: 7.5 symbols/min [2025-09-23T19:24:34.500086] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:34.552388] [DEBUG] [LOCAL ] IFF: Loaded 50956 existing records from primary storage. [2025-09-23T19:24:34.552538] [INFO ] [MAIN ] IFF: Loaded 50956 existing records. [2025-09-23T19:24:34.614636] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-23T19:24:34.671670] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T19:24:34.747627] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:34.747887] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-23T19:24:34.747935] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-23T19:24:34.749035] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-23T19:24:34.749095] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-23T19:24:35.103945] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:35.402205] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-23T19:24:35.843349] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:24:35.848050] [INFO ] [REMOTE ] IDA: Full fetch complete (44564 records). [2025-09-23T19:24:35.848152] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-23T19:24:36.216779] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-23T19:24:36.234005] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-23T19:24:36.234090] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-23T19:24:36.234827] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-23T19:24:36.234923] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-23T19:24:36.236163] [DEBUG] [LOCAL ] IDA: Trimmed 44564 records to 32000 (keeping 200 days of data) [2025-09-23T19:24:36.445530] [DEBUG] [LOCAL ] IDA: Primary data saved (32000 records). [2025-09-23T19:24:36.445697] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-23T19:24:36.445796] [INFO ] [MAIN ] Update Progress: 1090/2372 symbols completed. IDA took 43.5s. Estimated remaining: 2h 50m 1s. Rate: 7.5 symbols/min [2025-09-23T19:24:36.619943] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:36.638934] [DEBUG] [LOCAL ] IFN: Loaded 18150 existing records from primary storage. [2025-09-23T19:24:36.639070] [INFO ] [MAIN ] IFN: Loaded 18150 existing records. [2025-09-23T19:24:36.831401] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:36.832045] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-23T19:24:36.832119] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-23T19:24:36.832918] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-23T19:24:36.832982] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-23T19:24:37.003998] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-23T19:24:37.007006] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:24:37.261199] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:37.392042] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:24:37.395988] [INFO ] [REMOTE ] IDT: Full fetch complete (22509 records). [2025-09-23T19:24:37.396124] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-23T19:24:37.760332] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-23T19:24:37.760440] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-23T19:24:37.761191] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-23T19:24:37.761259] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-23T19:24:37.762344] [DEBUG] [LOCAL ] IDT: Trimmed 22509 records to 17675 (keeping 200 days of data) [2025-09-23T19:24:37.807724] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-23T19:24:37.871009] [DEBUG] [LOCAL ] IDT: Primary data saved (17675 records). [2025-09-23T19:24:37.871135] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-23T19:24:37.871218] [INFO ] [MAIN ] Update Progress: 1091/2372 symbols completed. IDT took 24.3s. Estimated remaining: 2h 49m 45s. Rate: 7.5 symbols/min [2025-09-23T19:24:38.044281] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:38.066998] [DEBUG] [LOCAL ] IFS: Loaded 23060 existing records from primary storage. [2025-09-23T19:24:38.067137] [INFO ] [MAIN ] IFS: Loaded 23060 existing records. [2025-09-23T19:24:38.242628] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:38.242902] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-23T19:24:38.242950] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-23T19:24:38.243610] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-23T19:24:38.243705] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-23T19:24:38.601512] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:38.602135] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-23T19:24:38.671522] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T19:24:38.850355] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T19:24:39.145722] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T19:24:39.402232] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-23T19:24:40.202156] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-23T19:24:40.671460] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:24:41.002189] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-23T19:24:41.807288] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-23T19:24:41.820504] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T19:24:42.311223] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T19:24:42.402812] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T19:24:42.602201] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-23T19:24:43.402198] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-23T19:24:44.161720] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:24:44.202150] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-23T19:24:44.218359] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T19:24:45.002185] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-23T19:24:45.802208] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-23T19:24:46.056977] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T19:24:46.099152] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:24:46.602164] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-23T19:24:47.003091] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:24:47.402258] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-23T19:24:47.726420] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T19:24:48.202248] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-23T19:24:49.002191] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-23T19:24:49.080168] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:24:49.802183] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-23T19:24:49.889381] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:24:50.104054] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:24:50.602169] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-23T19:24:50.866183] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T19:24:51.402159] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-23T19:24:51.426068] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T19:24:52.202250] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-23T19:24:53.002174] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-23T19:24:53.145582] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T19:24:53.213903] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T19:24:53.802258] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-23T19:24:54.269534] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T19:24:54.602208] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-23T19:24:54.646435] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T19:24:55.402203] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-23T19:24:56.135766] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:24:56.202148] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-23T19:24:56.510219] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:24:57.002184] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-23T19:24:57.637943] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T19:24:57.802162] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-23T19:24:58.127728] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T19:24:58.602425] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-23T19:24:59.342006] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T19:24:59.402200] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-23T19:24:59.754720] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T19:24:59.761500] [INFO ] [REMOTE ] IEX: Full fetch complete (53312 records). [2025-09-23T19:24:59.761607] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-23T19:25:00.149229] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-23T19:25:00.149320] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-23T19:25:00.150084] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-23T19:25:00.150147] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-23T19:25:00.153476] [DEBUG] [LOCAL ] IEX: Trimmed 53312 records to 38405 (keeping 200 days of data) [2025-09-23T19:25:00.213790] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-23T19:25:00.403120] [DEBUG] [LOCAL ] IEX: Primary data saved (38405 records). [2025-09-23T19:25:00.403272] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-23T19:25:00.403359] [INFO ] [MAIN ] Update Progress: 1092/2372 symbols completed. IEX took 35.9s. Estimated remaining: 2h 49m 54s. Rate: 7.5 symbols/min [2025-09-23T19:25:00.573205] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:00.585597] [DEBUG] [LOCAL ] IGA: Loaded 9666 existing records from primary storage. [2025-09-23T19:25:00.585774] [INFO ] [MAIN ] IGA: Loaded 9666 existing records. [2025-09-23T19:25:00.781061] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:00.781535] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-23T19:25:00.781691] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-23T19:25:00.782169] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-23T19:25:00.782233] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-23T19:25:01.013351] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-23T19:25:01.139610] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:25:01.192773] [INFO ] [REMOTE ] IFF: Full fetch complete (72794 records). [2025-09-23T19:25:01.212393] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:01.212827] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-23T19:25:01.506968] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:25:01.661072] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-23T19:25:01.661177] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-23T19:25:01.662152] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-23T19:25:01.662230] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-23T19:25:01.663964] [DEBUG] [LOCAL ] IFF: Trimmed 72794 records to 50969 (keeping 200 days of data) [2025-09-23T19:25:01.802966] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-23T19:25:02.007765] [DEBUG] [LOCAL ] IFF: Primary data saved (50969 records). [2025-09-23T19:25:02.007922] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-23T19:25:02.008011] [INFO ] [MAIN ] Update Progress: 1093/2372 symbols completed. IFF took 27.7s. Estimated remaining: 2h 49m 39s. Rate: 7.5 symbols/min [2025-09-23T19:25:02.205887] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:02.225597] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:25:02.258752] [DEBUG] [LOCAL ] IGD: Loaded 18971 existing records from primary storage. [2025-09-23T19:25:02.259084] [INFO ] [MAIN ] IGD: Loaded 18971 existing records. [2025-09-23T19:25:02.460096] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:02.460489] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-23T19:25:02.460566] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-23T19:25:02.461357] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-23T19:25:02.461420] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-23T19:25:02.606678] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-23T19:25:02.812286] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:25:02.859538] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:03.338384] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T19:25:03.402288] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-23T19:25:04.202218] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-23T19:25:04.519158] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T19:25:04.522622] [INFO ] [REMOTE ] IFN: Full fetch complete (29060 records). [2025-09-23T19:25:04.522760] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-23T19:25:04.920874] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-23T19:25:04.921087] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-23T19:25:04.921704] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-23T19:25:04.921775] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-23T19:25:04.923150] [DEBUG] [LOCAL ] IFN: Trimmed 29060 records to 18212 (keeping 200 days of data) [2025-09-23T19:25:05.011896] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-23T19:25:05.025113] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T19:25:05.059288] [DEBUG] [LOCAL ] IFN: Primary data saved (18212 records). [2025-09-23T19:25:05.059443] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-23T19:25:05.059600] [INFO ] [MAIN ] Update Progress: 1094/2372 symbols completed. IFN took 28.6s. Estimated remaining: 2h 49m 25s. Rate: 7.5 symbols/min [2025-09-23T19:25:05.229311] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:05.237947] [DEBUG] [LOCAL ] IGI: Loaded 3702 existing records from primary storage. [2025-09-23T19:25:05.238055] [INFO ] [MAIN ] IGI: Loaded 3702 existing records. [2025-09-23T19:25:05.418572] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:05.418871] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-23T19:25:05.418918] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-23T19:25:05.419190] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-23T19:25:05.419253] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-23T19:25:05.806721] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-23T19:25:05.806556] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:06.087542] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T19:25:06.602194] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-23T19:25:06.804823] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T19:25:07.412176] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-23T19:25:07.414365] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T19:25:07.987946] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T19:25:08.202247] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-23T19:25:09.002214] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-23T19:25:09.430820] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:25:09.802220] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-23T19:25:10.212668] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T19:25:10.217299] [INFO ] [REMOTE ] IFS: Full fetch complete (31460 records). [2025-09-23T19:25:10.217388] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-23T19:25:10.557254] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T19:25:10.602540] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-23T19:25:10.632974] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-23T19:25:10.633081] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-23T19:25:10.633744] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-23T19:25:10.633869] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-23T19:25:10.637907] [DEBUG] [LOCAL ] IFS: Trimmed 31460 records to 23131 (keeping 200 days of data) [2025-09-23T19:25:10.790792] [DEBUG] [LOCAL ] IFS: Primary data saved (23131 records). [2025-09-23T19:25:10.790940] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-23T19:25:10.791119] [INFO ] [MAIN ] Update Progress: 1095/2372 symbols completed. IFS took 32.9s. Estimated remaining: 2h 49m 15s. Rate: 7.5 symbols/min [2025-09-23T19:25:10.966128] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:11.005532] [DEBUG] [LOCAL ] IGR: Loaded 30584 existing records from primary storage. [2025-09-23T19:25:11.005739] [INFO ] [MAIN ] IGR: Loaded 30584 existing records. [2025-09-23T19:25:11.193591] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T19:25:11.199004] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:11.200490] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-23T19:25:11.200540] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-23T19:25:11.201458] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-23T19:25:11.201537] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-23T19:25:11.409505] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-23T19:25:11.576040] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:12.202198] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-23T19:25:12.484080] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T19:25:13.002204] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-23T19:25:13.359385] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:25:13.802209] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-23T19:25:13.966318] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T19:25:14.602206] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-23T19:25:15.204502] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:25:15.220697] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:25:15.402200] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-23T19:25:15.859154] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T19:25:16.202210] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-23T19:25:17.002252] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-23T19:25:17.517886] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T19:25:17.628522] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:25:17.802192] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-23T19:25:18.495468] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:25:18.602142] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-23T19:25:19.245632] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T19:25:19.402222] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-23T19:25:19.977382] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T19:25:20.202201] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-23T19:25:21.002170] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-23T19:25:21.360534] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T19:25:21.616319] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:25:21.802203] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-23T19:25:22.259820] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T19:25:22.602261] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-23T19:25:23.166399] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T19:25:23.402213] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-23T19:25:24.202191] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-23T19:25:24.566118] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T19:25:24.786681] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T19:25:25.002220] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-23T19:25:25.619274] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T19:25:25.802232] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-23T19:25:26.561212] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T19:25:26.562864] [INFO ] [REMOTE ] IGI: Full fetch complete (5220 records). [2025-09-23T19:25:26.562962] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-23T19:25:26.607305] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-23T19:25:26.949760] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-23T19:25:26.949867] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-23T19:25:26.950027] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-23T19:25:26.950066] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-23T19:25:26.950425] [DEBUG] [LOCAL ] IGI: Trimmed 5220 records to 3685 (keeping 200 days of data) [2025-09-23T19:25:26.976126] [DEBUG] [LOCAL ] IGI: Primary data saved (3685 records). [2025-09-23T19:25:26.976195] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-23T19:25:26.976336] [INFO ] [MAIN ] Update Progress: 1096/2372 symbols completed. IGI took 21.9s. Estimated remaining: 2h 49m 16s. Rate: 7.5 symbols/min [2025-09-23T19:25:27.145429] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:27.153903] [DEBUG] [LOCAL ] IH: Loaded 3545 existing records from primary storage. [2025-09-23T19:25:27.153994] [INFO ] [MAIN ] IH: Loaded 3545 existing records. [2025-09-23T19:25:27.329988] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:27.330258] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-23T19:25:27.330355] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-23T19:25:27.330631] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-23T19:25:27.330722] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-23T19:25:27.407303] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-23T19:25:27.703740] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:27.743249] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T19:25:28.202281] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-23T19:25:28.384283] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T19:25:29.000759] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:25:29.003585] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-23T19:25:29.802168] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-23T19:25:30.258330] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T19:25:30.602219] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-23T19:25:30.618496] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:25:31.047148] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T19:25:31.402215] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-23T19:25:32.202168] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-23T19:25:32.493756] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T19:25:32.630192] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T19:25:33.002234] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-23T19:25:33.620381] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T19:25:33.622701] [INFO ] [REMOTE ] IGA: Full fetch complete (13576 records). [2025-09-23T19:25:33.622772] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-23T19:25:33.807397] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-23T19:25:33.999059] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-23T19:25:33.999202] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-23T19:25:33.999519] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-23T19:25:33.999559] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-23T19:25:34.000088] [DEBUG] [LOCAL ] IGA: Trimmed 13576 records to 9692 (keeping 200 days of data) [2025-09-23T19:25:34.067560] [DEBUG] [LOCAL ] IGA: Primary data saved (9692 records). [2025-09-23T19:25:34.067741] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-23T19:25:34.067912] [INFO ] [MAIN ] Update Progress: 1097/2372 symbols completed. IGA took 33.7s. Estimated remaining: 2h 49m 8s. Rate: 7.5 symbols/min [2025-09-23T19:25:34.238031] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:34.251784] [DEBUG] [LOCAL ] IHD: Loaded 7246 existing records from primary storage. [2025-09-23T19:25:34.251917] [INFO ] [MAIN ] IHD: Loaded 7246 existing records. [2025-09-23T19:25:34.430512] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:34.430838] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-23T19:25:34.430888] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-23T19:25:34.431276] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-23T19:25:34.431338] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-23T19:25:34.607304] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-23T19:25:34.795914] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:34.994592] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T19:25:35.402233] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-23T19:25:35.769507] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T19:25:36.202157] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-23T19:25:36.265812] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T19:25:37.002218] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-23T19:25:37.245801] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:25:37.802212] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-23T19:25:38.385801] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T19:25:38.533082] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T19:25:38.602164] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-23T19:25:39.292353] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T19:25:39.402216] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-23T19:25:40.197128] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T19:25:40.201208] [INFO ] [REMOTE ] IGD: Full fetch complete (29283 records). [2025-09-23T19:25:40.201312] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-23T19:25:40.207394] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-23T19:25:40.575888] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-23T19:25:40.575991] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-23T19:25:40.576722] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-23T19:25:40.576789] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-23T19:25:40.577566] [DEBUG] [LOCAL ] IGD: Trimmed 29283 records to 18878 (keeping 200 days of data) [2025-09-23T19:25:40.695738] [DEBUG] [LOCAL ] IGD: Primary data saved (18878 records). [2025-09-23T19:25:40.695889] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-23T19:25:40.696009] [INFO ] [MAIN ] Update Progress: 1098/2372 symbols completed. IGD took 38.7s. Estimated remaining: 2h 48m 58s. Rate: 7.5 symbols/min [2025-09-23T19:25:40.875065] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:40.904521] [DEBUG] [LOCAL ] IHG: Loaded 24753 existing records from primary storage. [2025-09-23T19:25:40.904700] [INFO ] [MAIN ] IHG: Loaded 24753 existing records. [2025-09-23T19:25:41.007441] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-23T19:25:41.134132] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:41.134391] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-23T19:25:41.134441] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-23T19:25:41.135443] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-23T19:25:41.135509] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-23T19:25:41.517959] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:41.611544] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T19:25:41.625131] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:25:41.802200] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-23T19:25:42.602199] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-23T19:25:43.075092] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T19:25:43.080246] [INFO ] [REMOTE ] IGR: Full fetch complete (45777 records). [2025-09-23T19:25:43.080340] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-23T19:25:43.195695] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T19:25:43.405834] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-23T19:25:43.507004] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-23T19:25:43.507116] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-23T19:25:43.507883] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-23T19:25:43.507956] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-23T19:25:43.509310] [DEBUG] [LOCAL ] IGR: Trimmed 45777 records to 30548 (keeping 200 days of data) [2025-09-23T19:25:43.698561] [DEBUG] [LOCAL ] IGR: Primary data saved (30548 records). [2025-09-23T19:25:43.698750] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-23T19:25:43.698881] [INFO ] [MAIN ] Update Progress: 1099/2372 symbols completed. IGR took 32.9s. Estimated remaining: 2h 48m 44s. Rate: 7.5 symbols/min [2025-09-23T19:25:43.873711] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:43.912830] [DEBUG] [LOCAL ] IHS: Loaded 38999 existing records from primary storage. [2025-09-23T19:25:43.913000] [INFO ] [MAIN ] IHS: Loaded 38999 existing records. [2025-09-23T19:25:44.099306] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:44.099617] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-23T19:25:44.099695] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-23T19:25:44.101025] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-23T19:25:44.101087] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-23T19:25:44.204465] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-23T19:25:44.260094] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T19:25:44.474100] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:45.002213] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-23T19:25:45.110554] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T19:25:45.422821] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T19:25:45.802204] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-23T19:25:46.237092] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T19:25:46.602235] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-23T19:25:47.281748] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T19:25:47.402209] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-23T19:25:47.949610] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T19:25:48.202243] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-23T19:25:49.002254] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-23T19:25:49.165220] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T19:25:49.802209] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-23T19:25:50.346166] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T19:25:50.560034] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T19:25:50.602231] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-23T19:25:51.266313] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T19:25:51.402278] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-23T19:25:51.979078] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T19:25:51.980266] [INFO ] [REMOTE ] IH: Full fetch complete (4938 records). [2025-09-23T19:25:51.980345] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-23T19:25:52.207415] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-23T19:25:52.348893] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-23T19:25:52.348976] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-23T19:25:52.349119] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-23T19:25:52.349156] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-23T19:25:52.349518] [DEBUG] [LOCAL ] IH: Trimmed 4938 records to 3505 (keeping 200 days of data) [2025-09-23T19:25:52.369629] [DEBUG] [LOCAL ] IH: Primary data saved (3505 records). [2025-09-23T19:25:52.369718] [INFO ] [MAIN ] IH: Full history saved. [2025-09-23T19:25:52.369804] [INFO ] [MAIN ] Update Progress: 1100/2372 symbols completed. IH took 25.4s. Estimated remaining: 2h 48m 37s. Rate: 7.5 symbols/min [2025-09-23T19:25:52.535211] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:52.545402] [DEBUG] [LOCAL ] IIF: Loaded 5789 existing records from primary storage. [2025-09-23T19:25:52.545519] [INFO ] [MAIN ] IIF: Loaded 5789 existing records. [2025-09-23T19:25:52.720101] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:52.720312] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-23T19:25:52.720357] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-23T19:25:52.722033] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-23T19:25:52.722094] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-23T19:25:53.009425] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-23T19:25:53.085605] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:25:53.085210] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:53.802206] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-23T19:25:54.246356] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T19:25:54.602213] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-23T19:25:54.667677] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T19:25:55.402261] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-23T19:25:55.595440] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T19:25:56.202297] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-23T19:25:56.614335] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T19:25:56.671837] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T19:25:57.002257] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-23T19:25:57.720403] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T19:25:57.802198] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-23T19:25:58.602207] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-23T19:25:59.284554] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T19:25:59.352610] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T19:25:59.402169] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-23T19:26:00.202197] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-23T19:26:00.836439] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T19:26:01.002219] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-23T19:26:01.430851] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T19:26:01.601711] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:26:01.802201] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-23T19:26:02.495035] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T19:26:02.602231] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-23T19:26:02.988296] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:26:03.402209] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-23T19:26:04.192190] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:26:04.202142] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-23T19:26:04.926511] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T19:26:05.002190] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-23T19:26:05.623865] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T19:26:05.802204] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-23T19:26:06.504983] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T19:26:06.602223] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-23T19:26:07.402214] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-23T19:26:07.782663] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T19:26:08.202251] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-23T19:26:08.794554] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T19:26:09.002236] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-23T19:26:09.182279] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T19:26:09.714410] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T19:26:09.802261] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-23T19:26:10.262090] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T19:26:10.264033] [INFO ] [REMOTE ] IIF: Full fetch complete (9645 records). [2025-09-23T19:26:10.264190] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-23T19:26:10.611776] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-23T19:26:10.726982] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-23T19:26:10.727208] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-23T19:26:10.727560] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-23T19:26:10.727606] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-23T19:26:10.728206] [DEBUG] [LOCAL ] IIF: Trimmed 9645 records to 5769 (keeping 200 days of data) [2025-09-23T19:26:10.765300] [DEBUG] [LOCAL ] IIF: Primary data saved (5769 records). [2025-09-23T19:26:10.765464] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-23T19:26:10.765563] [INFO ] [MAIN ] Update Progress: 1101/2372 symbols completed. IIF took 18.4s. Estimated remaining: 2h 48m 41s. Rate: 7.5 symbols/min [2025-09-23T19:26:10.933749] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:10.952915] [DEBUG] [LOCAL ] IIIN: Loaded 16813 existing records from primary storage. [2025-09-23T19:26:10.953124] [INFO ] [MAIN ] IIIN: Loaded 16813 existing records. [2025-09-23T19:26:11.130081] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:11.130370] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-23T19:26:11.130419] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-23T19:26:11.131059] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-23T19:26:11.131121] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-23T19:26:11.409504] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-23T19:26:11.496121] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:11.911697] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T19:26:12.202193] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-23T19:26:12.927168] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:26:13.002207] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-23T19:26:13.196524] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T19:26:13.802198] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-23T19:26:14.006769] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T19:26:14.602174] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-23T19:26:14.877833] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T19:26:15.402155] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-23T19:26:15.795551] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T19:26:16.193255] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T19:26:16.195938] [INFO ] [REMOTE ] IHD: Full fetch complete (11909 records). [2025-09-23T19:26:16.196073] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-23T19:26:16.208841] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-23T19:26:16.581499] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-23T19:26:16.581603] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-23T19:26:16.581951] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-23T19:26:16.582014] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-23T19:26:16.582793] [DEBUG] [LOCAL ] IHD: Trimmed 11909 records to 7247 (keeping 200 days of data) [2025-09-23T19:26:16.629035] [DEBUG] [LOCAL ] IHD: Primary data saved (7247 records). [2025-09-23T19:26:16.629191] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-23T19:26:16.629280] [INFO ] [MAIN ] Update Progress: 1102/2372 symbols completed. IHD took 42.6s. Estimated remaining: 2h 48m 31s. Rate: 7.5 symbols/min [2025-09-23T19:26:16.820500] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:16.840148] [DEBUG] [LOCAL ] IIM: Loaded 15903 existing records from primary storage. [2025-09-23T19:26:16.840302] [INFO ] [MAIN ] IIM: Loaded 15903 existing records. [2025-09-23T19:26:17.002287] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-23T19:26:17.026954] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:17.028328] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-23T19:26:17.028382] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-23T19:26:17.029178] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-23T19:26:17.029337] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-23T19:26:17.399098] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:17.421781] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T19:26:17.802183] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-23T19:26:17.945389] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T19:26:18.602190] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-23T19:26:19.210552] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:26:19.216212] [INFO ] [REMOTE ] IHS: Full fetch complete (52488 records). [2025-09-23T19:26:19.216316] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-23T19:26:19.407472] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-23T19:26:19.613277] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-23T19:26:19.613427] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-23T19:26:19.614283] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-23T19:26:19.614351] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-23T19:26:19.615794] [DEBUG] [LOCAL ] IHS: Trimmed 52488 records to 39033 (keeping 200 days of data) [2025-09-23T19:26:19.715444] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T19:26:19.858035] [DEBUG] [LOCAL ] IHS: Primary data saved (39033 records). [2025-09-23T19:26:19.858187] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-23T19:26:19.858272] [INFO ] [MAIN ] Update Progress: 1103/2372 symbols completed. IHS took 36.2s. Estimated remaining: 2h 48m 18s. Rate: 7.5 symbols/min [2025-09-23T19:26:20.027499] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:20.058110] [DEBUG] [LOCAL ] IIPR: Loaded 29620 existing records from primary storage. [2025-09-23T19:26:20.058292] [INFO ] [MAIN ] IIPR: Loaded 29620 existing records. [2025-09-23T19:26:20.202711] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-23T19:26:20.247318] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:20.247741] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-23T19:26:20.247888] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-23T19:26:20.254080] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-23T19:26:20.262404] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-23T19:26:20.286576] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T19:26:20.641411] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:21.005841] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-23T19:26:21.008204] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T19:26:21.802192] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-23T19:26:22.097419] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T19:26:22.602206] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-23T19:26:23.243757] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T19:26:23.407992] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-23T19:26:23.412526] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:26:23.417460] [INFO ] [REMOTE ] IHG: Full fetch complete (33478 records). [2025-09-23T19:26:23.417583] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-23T19:26:23.794425] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-23T19:26:23.794511] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-23T19:26:23.795228] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-23T19:26:23.795292] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-23T19:26:23.796112] [DEBUG] [LOCAL ] IHG: Trimmed 33478 records to 24663 (keeping 200 days of data) [2025-09-23T19:26:23.954415] [DEBUG] [LOCAL ] IHG: Primary data saved (24663 records). [2025-09-23T19:26:23.954579] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-23T19:26:23.954693] [INFO ] [MAIN ] Update Progress: 1104/2372 symbols completed. IHG took 43.3s. Estimated remaining: 2h 48m 5s. Rate: 7.5 symbols/min [2025-09-23T19:26:24.139416] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:24.185608] [DEBUG] [LOCAL ] IMAX: Loaded 42779 existing records from primary storage. [2025-09-23T19:26:24.185931] [INFO ] [MAIN ] IMAX: Loaded 42779 existing records. [2025-09-23T19:26:24.207299] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-23T19:26:24.382588] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:24.382873] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-23T19:26:24.382924] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-23T19:26:24.384601] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-23T19:26:24.384724] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-23T19:26:24.505324] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T19:26:24.769700] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:25.002197] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-23T19:26:25.565865] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T19:26:25.802185] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-23T19:26:26.029572] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T19:26:26.602197] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-23T19:26:27.110256] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T19:26:27.402200] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-23T19:26:27.922439] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T19:26:28.202260] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-23T19:26:28.611900] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T19:26:29.002234] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-23T19:26:29.603486] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:26:29.802175] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-23T19:26:29.909390] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T19:26:30.602195] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-23T19:26:31.227398] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:26:31.402212] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-23T19:26:31.675935] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T19:26:32.202199] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-23T19:26:32.807979] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:26:32.987603] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T19:26:33.002155] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-23T19:26:33.802237] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-23T19:26:33.971269] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T19:26:33.975201] [INFO ] [REMOTE ] IIIN: Full fetch complete (25182 records). [2025-09-23T19:26:33.975293] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-23T19:26:34.343500] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-23T19:26:34.343590] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-23T19:26:34.344210] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-23T19:26:34.344276] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-23T19:26:34.345051] [DEBUG] [LOCAL ] IIIN: Trimmed 25182 records to 16764 (keeping 200 days of data) [2025-09-23T19:26:34.457771] [DEBUG] [LOCAL ] IIIN: Primary data saved (16764 records). [2025-09-23T19:26:34.457929] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-23T19:26:34.458033] [INFO ] [MAIN ] Update Progress: 1105/2372 symbols completed. IIIN took 23.7s. Estimated remaining: 2h 48m 0s. Rate: 7.5 symbols/min [2025-09-23T19:26:34.603741] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-23T19:26:34.637740] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:34.655879] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T19:26:34.720220] [DEBUG] [LOCAL ] INFA: Loaded 50099 existing records from primary storage. [2025-09-23T19:26:34.720409] [INFO ] [MAIN ] INFA: Loaded 50099 existing records. [2025-09-23T19:26:34.904541] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:34.904860] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-23T19:26:34.904943] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-23T19:26:34.906257] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-23T19:26:34.906318] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-23T19:26:35.278424] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:35.402211] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-23T19:26:35.925186] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T19:26:36.202177] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-23T19:26:36.626555] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T19:26:37.002188] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-23T19:26:37.063343] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T19:26:37.802273] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-23T19:26:38.602175] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-23T19:26:38.687457] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T19:26:38.761207] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T19:26:39.220525] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T19:26:39.402242] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-23T19:26:39.941313] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T19:26:40.202207] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-23T19:26:41.002215] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-23T19:26:41.719213] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T19:26:41.802258] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-23T19:26:42.171339] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T19:26:42.602271] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-23T19:26:43.402208] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-23T19:26:43.484320] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:26:44.202221] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-23T19:26:44.368114] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T19:26:44.437840] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T19:26:45.002185] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-23T19:26:45.579917] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T19:26:45.609186] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T19:26:45.802196] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-23T19:26:46.602221] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-23T19:26:47.177342] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T19:26:47.234740] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T19:26:47.402219] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-23T19:26:48.202217] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-23T19:26:48.405731] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:26:48.409109] [INFO ] [REMOTE ] IIM: Full fetch complete (25360 records). [2025-09-23T19:26:48.409183] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-23T19:26:48.772385] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-23T19:26:48.772481] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-23T19:26:48.773121] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-23T19:26:48.773188] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-23T19:26:48.775049] [DEBUG] [LOCAL ] IIM: Trimmed 25360 records to 15910 (keeping 200 days of data) [2025-09-23T19:26:48.875120] [DEBUG] [LOCAL ] IIM: Primary data saved (15910 records). [2025-09-23T19:26:48.875270] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-23T19:26:48.875936] [INFO ] [MAIN ] Update Progress: 1106/2372 symbols completed. IIM took 32.2s. Estimated remaining: 2h 47m 60s. Rate: 7.5 symbols/min [2025-09-23T19:26:49.007524] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-23T19:26:49.065679] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:49.127546] [DEBUG] [LOCAL ] INFY: Loaded 53601 existing records from primary storage. [2025-09-23T19:26:49.127749] [INFO ] [MAIN ] INFY: Loaded 53601 existing records. [2025-09-23T19:26:49.323030] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:49.323288] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-23T19:26:49.323338] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-23T19:26:49.325069] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-23T19:26:49.325131] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-23T19:26:49.707456] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:49.733993] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:26:49.802201] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-23T19:26:50.408084] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:26:50.602230] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-23T19:26:51.402173] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-23T19:26:51.819398] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T19:26:51.990925] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T19:26:51.996558] [INFO ] [REMOTE ] IIPR: Full fetch complete (44093 records). [2025-09-23T19:26:51.996699] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-23T19:26:52.210288] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-23T19:26:52.422451] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-23T19:26:52.422633] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-23T19:26:52.423973] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-23T19:26:52.424043] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-23T19:26:52.425796] [DEBUG] [LOCAL ] IIPR: Trimmed 44093 records to 29629 (keeping 200 days of data) [2025-09-23T19:26:52.607084] [DEBUG] [LOCAL ] IIPR: Primary data saved (29629 records). [2025-09-23T19:26:52.607236] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-23T19:26:52.607324] [INFO ] [MAIN ] Update Progress: 1107/2372 symbols completed. IIPR took 32.7s. Estimated remaining: 2h 47m 47s. Rate: 7.5 symbols/min [2025-09-23T19:26:52.787328] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:52.838441] [DEBUG] [LOCAL ] ING: Loaded 50823 existing records from primary storage. [2025-09-23T19:26:52.838603] [INFO ] [MAIN ] ING: Loaded 50823 existing records. [2025-09-23T19:26:53.002475] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-23T19:26:53.035980] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:26:53.086978] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:53.087288] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-23T19:26:53.087343] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-23T19:26:53.089030] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-23T19:26:53.089101] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-23T19:26:53.460878] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:53.802226] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-23T19:26:53.932954] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:26:54.472304] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T19:26:54.602165] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-23T19:26:55.141503] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T19:26:55.402200] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-23T19:26:56.202197] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-23T19:26:56.267506] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T19:26:57.002169] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-23T19:26:57.106358] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T19:26:57.315795] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:26:57.802260] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-23T19:26:58.602172] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-23T19:26:58.895787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T19:26:58.932894] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:26:58.941096] [INFO ] [REMOTE ] IMAX: Full fetch complete (59448 records). [2025-09-23T19:26:58.941364] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-23T19:26:59.361103] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-23T19:26:59.361253] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-23T19:26:59.362125] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-23T19:26:59.362190] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-23T19:26:59.363609] [DEBUG] [LOCAL ] IMAX: Trimmed 59448 records to 42766 (keeping 200 days of data) [2025-09-23T19:26:59.416290] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-23T19:26:59.617914] [DEBUG] [LOCAL ] IMAX: Primary data saved (42766 records). [2025-09-23T19:26:59.618061] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-23T19:26:59.618145] [INFO ] [MAIN ] Update Progress: 1108/2372 symbols completed. IMAX took 35.7s. Estimated remaining: 2h 47m 38s. Rate: 7.5 symbols/min [2025-09-23T19:26:59.788503] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:59.821154] [DEBUG] [LOCAL ] INGM: Loaded 28926 existing records from primary storage. [2025-09-23T19:26:59.821315] [INFO ] [MAIN ] INGM: Loaded 28926 existing records. [2025-09-23T19:27:00.037262] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:00.037761] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-23T19:27:00.037818] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-23T19:27:00.038886] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-23T19:27:00.038948] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-23T19:27:00.203995] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-23T19:27:00.395829] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T19:27:00.490725] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:01.002289] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-23T19:27:01.265526] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T19:27:01.802294] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-23T19:27:02.079945] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-23T19:27:02.602277] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-23T19:27:02.891874] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T19:27:03.402197] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-23T19:27:04.202227] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-23T19:27:05.169289] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T19:27:05.175688] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-23T19:27:05.774323] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (3.97 seconds). [2025-09-23T19:27:05.807237] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-23T19:27:05.821171] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-09-23T19:27:05.864999] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:27:05.942970] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:27:06.602204] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-23T19:27:07.127199] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T19:27:07.402210] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-23T19:27:07.997968] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:27:08.202207] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-23T19:27:08.792399] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T19:27:09.002204] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-23T19:27:09.585985] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:27:09.802215] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-23T19:27:10.602177] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-23T19:27:10.755493] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T19:27:11.174274] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:27:11.402164] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-23T19:27:11.446858] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T19:27:12.202202] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-23T19:27:13.002198] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-23T19:27:13.298438] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T19:27:13.543872] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:27:13.553765] [INFO ] [REMOTE ] INFA: Full fetch complete (71864 records). [2025-09-23T19:27:13.553916] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-23T19:27:13.808914] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-23T19:27:13.962422] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-23T19:27:13.962531] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-23T19:27:13.963553] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-23T19:27:13.963617] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-23T19:27:13.967234] [DEBUG] [LOCAL ] INFA: Trimmed 71864 records to 50032 (keeping 200 days of data) [2025-09-23T19:27:14.261803] [DEBUG] [LOCAL ] INFA: Primary data saved (50032 records). [2025-09-23T19:27:14.261952] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-23T19:27:14.262038] [INFO ] [MAIN ] Update Progress: 1109/2372 symbols completed. INFA took 39.8s. Estimated remaining: 2h 47m 37s. Rate: 7.5 symbols/min [2025-09-23T19:27:14.433474] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:14.473520] [DEBUG] [LOCAL ] INGR: Loaded 33393 existing records from primary storage. [2025-09-23T19:27:14.473720] [INFO ] [MAIN ] INGR: Loaded 33393 existing records. [2025-09-23T19:27:14.615711] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-23T19:27:14.658143] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:14.658408] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-23T19:27:14.658455] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-23T19:27:14.659346] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-23T19:27:14.659407] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-23T19:27:14.940063] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T19:27:15.087904] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:15.402203] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-23T19:27:16.202211] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-23T19:27:16.619326] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T19:27:16.762831] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-23T19:27:17.002183] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-23T19:27:17.126567] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-23T19:27:17.188446] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T19:27:17.802206] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-23T19:27:18.602267] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-23T19:27:18.668494] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:27:19.199166] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:27:19.402182] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-23T19:27:19.715793] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:27:20.202226] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-23T19:27:20.667516] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:27:21.002230] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-23T19:27:21.806895] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-23T19:27:21.820438] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T19:27:22.602184] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-23T19:27:22.859789] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T19:27:22.870207] [INFO ] [REMOTE ] INFY: Full fetch complete (77535 records). [2025-09-23T19:27:22.870429] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-23T19:27:23.301379] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-23T19:27:23.301767] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-23T19:27:23.302933] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-23T19:27:23.303035] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-23T19:27:23.305216] [DEBUG] [LOCAL ] INFY: Trimmed 77535 records to 53600 (keeping 200 days of data) [2025-09-23T19:27:23.407094] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-23T19:27:23.467198] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:27:23.596964] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:27:23.606252] [INFO ] [REMOTE ] INGM: Full fetch complete (42150 records). [2025-09-23T19:27:23.606944] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-23T19:27:24.086211] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-23T19:27:24.086993] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-23T19:27:24.087846] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-23T19:27:24.088194] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-23T19:27:24.091771] [DEBUG] [LOCAL ] INGM: Trimmed 42150 records to 28874 (keeping 200 days of data) [2025-09-23T19:27:24.203119] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-23T19:27:24.215563] [DEBUG] [LOCAL ] INFY: Primary data saved (53600 records). [2025-09-23T19:27:24.216728] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-23T19:27:24.217162] [INFO ] [MAIN ] Update Progress: 1110/2372 symbols completed. INFY took 35.3s. Estimated remaining: 2h 47m 32s. Rate: 7.5 symbols/min [2025-09-23T19:27:24.413058] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:24.501147] [DEBUG] [LOCAL ] INN: Loaded 41951 existing records from primary storage. [2025-09-23T19:27:24.502240] [INFO ] [MAIN ] INN: Loaded 41951 existing records. [2025-09-23T19:27:24.635403] [DEBUG] [LOCAL ] INGM: Primary data saved (28874 records). [2025-09-23T19:27:24.641718] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-23T19:27:24.647087] [INFO ] [MAIN ] Update Progress: 1111/2372 symbols completed. INGM took 25.0s. Estimated remaining: 2h 47m 15s. Rate: 7.5 symbols/min [2025-09-23T19:27:24.836615] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:24.852769] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-23T19:27:24.868349] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-23T19:27:24.919176] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:24.917387] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-23T19:27:24.919425] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-23T19:27:24.919518] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-23T19:27:24.924799] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-23T19:27:25.008111] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-23T19:27:25.043239] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-23T19:27:25.053505] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-23T19:27:25.069382] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-23T19:27:25.636660] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:25.681940] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-23T19:27:25.786485] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-23T19:27:25.784417] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:25.806783] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-23T19:27:25.820605] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T19:27:26.013218] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:27:26.013594] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-23T19:27:26.602187] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-23T19:27:27.329196] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T19:27:27.402143] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-23T19:27:28.048404] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T19:27:28.202183] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-23T19:27:28.671894] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:27:29.002256] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-23T19:27:29.802221] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-23T19:27:30.148393] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-23T19:27:30.158299] [INFO ] [REMOTE ] ING: Full fetch complete (73628 records). [2025-09-23T19:27:30.158452] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-23T19:27:30.493834] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:27:30.594351] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-23T19:27:30.594464] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-23T19:27:30.596806] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-23T19:27:30.596871] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-23T19:27:30.601095] [DEBUG] [LOCAL ] ING: Trimmed 73628 records to 50806 (keeping 200 days of data) [2025-09-23T19:27:30.602170] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-23T19:27:30.926230] [DEBUG] [LOCAL ] ING: Primary data saved (50806 records). [2025-09-23T19:27:30.926381] [INFO ] [MAIN ] ING: Full history saved. [2025-09-23T19:27:30.926503] [INFO ] [MAIN ] Update Progress: 1112/2372 symbols completed. ING took 38.3s. Estimated remaining: 2h 47m 5s. Rate: 7.5 symbols/min [2025-09-23T19:27:31.101495] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:31.143146] [DEBUG] [LOCAL ] INSP: Loaded 36812 existing records from primary storage. [2025-09-23T19:27:31.143516] [INFO ] [MAIN ] INSP: Loaded 36812 existing records. [2025-09-23T19:27:31.265350] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:27:31.354975] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:31.355273] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-23T19:27:31.355344] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-23T19:27:31.356204] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-23T19:27:31.356264] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-23T19:27:31.410544] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-23T19:27:31.720994] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:32.202249] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-23T19:27:32.895324] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:27:32.935676] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-23T19:27:33.002167] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-23T19:27:33.802223] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-23T19:27:33.922382] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T19:27:33.993148] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T19:27:34.602221] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-23T19:27:35.057808] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:27:35.402217] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-23T19:27:35.829993] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:27:36.202192] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-23T19:27:36.726385] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T19:27:37.002194] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-23T19:27:37.453109] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T19:27:37.802228] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-23T19:27:38.145548] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T19:27:38.602233] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-23T19:27:39.176929] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:27:39.402242] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-23T19:27:39.700491] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T19:27:40.202292] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-23T19:27:40.523335] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T19:27:41.002258] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-23T19:27:41.622893] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T19:27:41.802199] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-23T19:27:42.285176] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:27:42.602235] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-23T19:27:43.296255] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T19:27:43.305904] [INFO ] [REMOTE ] INGR: Full fetch complete (49760 records). [2025-09-23T19:27:43.306117] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-23T19:27:43.402394] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-23T19:27:43.701384] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-23T19:27:43.701539] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-23T19:27:43.702509] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-23T19:27:43.702579] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-23T19:27:43.703770] [DEBUG] [LOCAL ] INGR: Trimmed 49760 records to 33372 (keeping 200 days of data) [2025-09-23T19:27:43.858384] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T19:27:43.972152] [DEBUG] [LOCAL ] INGR: Primary data saved (33372 records). [2025-09-23T19:27:43.972302] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-23T19:27:43.972410] [INFO ] [MAIN ] Update Progress: 1113/2372 symbols completed. INGR took 29.7s. Estimated remaining: 2h 47m 3s. Rate: 7.5 symbols/min [2025-09-23T19:27:44.205828] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:44.204694] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-23T19:27:44.227030] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:27:44.271886] [DEBUG] [LOCAL ] INSW: Loaded 40407 existing records from primary storage. [2025-09-23T19:27:44.272056] [INFO ] [MAIN ] INSW: Loaded 40407 existing records. [2025-09-23T19:27:44.447185] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:44.447511] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-23T19:27:44.447560] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-23T19:27:44.448721] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-23T19:27:44.448790] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-23T19:27:44.807023] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:45.002232] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-23T19:27:45.656238] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T19:27:45.802178] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-23T19:27:46.562337] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T19:27:46.602188] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-23T19:27:46.863513] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T19:27:47.402221] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-23T19:27:48.203841] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-23T19:27:48.209251] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T19:27:48.860863] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:27:49.002181] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-23T19:27:49.027780] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T19:27:49.802207] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-23T19:27:50.598091] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T19:27:50.604127] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-23T19:27:50.624479] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T19:27:51.402196] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-23T19:27:52.202212] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-23T19:27:52.261676] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:27:52.367619] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T19:27:52.372590] [INFO ] [REMOTE ] INR: Full fetch complete (32917 records). [2025-09-23T19:27:52.372708] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-23T19:27:52.577184] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-09-23T19:27:52.577691] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:27:52.577779] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:27:52.577868] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-23T19:27:52.577957] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-23T19:27:52.578056] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-23T19:27:52.578164] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-23T19:27:52.578276] [INFO ] [MAIN ] Update Progress: 1114/2372 symbols completed. INR took 27.9s. Estimated remaining: 2h 46m 56s. Rate: 7.5 symbols/min [2025-09-23T19:27:52.757823] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:52.814546] [DEBUG] [LOCAL ] INVH: Loaded 53139 existing records from primary storage. [2025-09-23T19:27:52.814869] [INFO ] [MAIN ] INVH: Loaded 53139 existing records. [2025-09-23T19:27:53.003400] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-23T19:27:53.003561] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:53.004044] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-23T19:27:53.004744] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-23T19:27:53.006087] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-23T19:27:53.006148] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-23T19:27:53.400945] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:53.423490] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T19:27:53.802192] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-23T19:27:54.452422] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:27:54.602194] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-23T19:27:55.069421] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:27:55.402191] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-23T19:27:56.141083] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T19:27:56.202167] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-23T19:27:57.002179] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-23T19:27:57.234660] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T19:27:57.650073] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T19:27:57.802196] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-23T19:27:58.232585] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T19:27:58.602221] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-23T19:27:59.402251] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-23T19:27:59.608770] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T19:27:59.964775] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T19:27:59.973199] [INFO ] [REMOTE ] INN: Full fetch complete (57765 records). [2025-09-23T19:27:59.973345] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-23T19:28:00.207502] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-23T19:28:00.366543] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-23T19:28:00.366666] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-23T19:28:00.367526] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-23T19:28:00.367570] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-23T19:28:00.368815] [DEBUG] [LOCAL ] INN: Trimmed 57765 records to 41945 (keeping 200 days of data) [2025-09-23T19:28:00.635300] [DEBUG] [LOCAL ] INN: Primary data saved (41945 records). [2025-09-23T19:28:00.635445] [INFO ] [MAIN ] INN: Full history saved. [2025-09-23T19:28:00.635555] [INFO ] [MAIN ] Update Progress: 1115/2372 symbols completed. INN took 36.4s. Estimated remaining: 2h 46m 48s. Rate: 7.5 symbols/min [2025-09-23T19:28:00.835327] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:00.836963] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T19:28:00.876036] [DEBUG] [LOCAL ] INVX: Loaded 28990 existing records from primary storage. [2025-09-23T19:28:00.876205] [INFO ] [MAIN ] INVX: Loaded 28990 existing records. [2025-09-23T19:28:01.015483] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-23T19:28:01.057810] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:01.058077] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-23T19:28:01.058127] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-23T19:28:01.058884] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-23T19:28:01.058946] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-23T19:28:01.418750] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:01.802193] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-23T19:28:02.063966] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T19:28:02.071445] [INFO ] [REMOTE ] INSP: Full fetch complete (52304 records). [2025-09-23T19:28:02.071556] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-23T19:28:02.458756] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-23T19:28:02.458907] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-23T19:28:02.459779] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-23T19:28:02.459941] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-23T19:28:02.461125] [DEBUG] [LOCAL ] INSP: Trimmed 52304 records to 36869 (keeping 200 days of data) [2025-09-23T19:28:02.623527] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-23T19:28:02.685959] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T19:28:02.714390] [DEBUG] [LOCAL ] INSP: Primary data saved (36869 records). [2025-09-23T19:28:02.714513] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-23T19:28:02.714590] [INFO ] [MAIN ] Update Progress: 1116/2372 symbols completed. INSP took 31.8s. Estimated remaining: 2h 46m 33s. Rate: 7.5 symbols/min [2025-09-23T19:28:02.883702] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:02.940171] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-23T19:28:02.940341] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-09-23T19:28:03.125583] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:03.126303] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-23T19:28:03.126479] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-23T19:28:03.127970] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-23T19:28:03.128033] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-23T19:28:03.375586] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T19:28:03.407981] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-23T19:28:03.538968] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:03.796298] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T19:28:04.202196] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-23T19:28:04.562772] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T19:28:05.002195] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-23T19:28:05.178779] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T19:28:05.802208] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-23T19:28:06.602197] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-23T19:28:07.402168] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-23T19:28:07.643217] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T19:28:07.837854] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-23T19:28:07.865893] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T19:28:08.202194] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-23T19:28:08.495726] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T19:28:08.502438] [INFO ] [REMOTE ] INSW: Full fetch complete (60900 records). [2025-09-23T19:28:08.502575] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-23T19:28:08.882594] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-23T19:28:08.882713] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-23T19:28:08.883525] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-23T19:28:08.883568] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-23T19:28:08.884835] [DEBUG] [LOCAL ] INSW: Trimmed 60900 records to 40407 (keeping 200 days of data) [2025-09-23T19:28:09.003742] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-23T19:28:09.134808] [DEBUG] [LOCAL ] INSW: Primary data saved (40407 records). [2025-09-23T19:28:09.134983] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-23T19:28:09.135071] [INFO ] [MAIN ] Update Progress: 1117/2372 symbols completed. INSW took 25.2s. Estimated remaining: 2h 46m 24s. Rate: 7.5 symbols/min [2025-09-23T19:28:09.802269] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-23T19:28:10.009197] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T19:28:10.602216] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-23T19:28:10.666864] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T19:28:11.402188] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-23T19:28:11.698969] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-23T19:28:12.202235] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-23T19:28:12.456574] [DEBUG] [REMOTE ] IONQ: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-23T19:28:12.457356] [WARN ] [REMOTE ] IONQ: No data returned for month 2025-02 [2025-09-23T19:28:12.501328] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T19:28:12.585164] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T19:28:13.002228] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-23T19:28:13.802187] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-23T19:28:14.602254] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-23T19:28:15.236748] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T19:28:15.402307] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-23T19:28:15.841639] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:28:15.942793] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-09-23T19:28:16.202239] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-23T19:28:17.002163] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-23T19:28:17.041361] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T19:28:17.160843] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T19:28:17.802274] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-23T19:28:18.602263] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-23T19:28:19.375543] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T19:28:19.402144] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-23T19:28:19.500325] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-23T19:28:19.899393] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T19:28:20.202202] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-23T19:28:21.007258] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-23T19:28:21.023917] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T19:28:21.033961] [INFO ] [REMOTE ] INVH: Full fetch complete (76681 records). [2025-09-23T19:28:21.034159] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-23T19:28:21.458595] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-23T19:28:21.458766] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-23T19:28:21.459794] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-23T19:28:21.459982] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-23T19:28:21.461719] [DEBUG] [LOCAL ] INVH: Trimmed 76681 records to 53139 (keeping 200 days of data) [2025-09-23T19:28:21.571976] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:28:21.806574] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-23T19:28:21.833406] [DEBUG] [LOCAL ] INVH: Primary data saved (53139 records). [2025-09-23T19:28:21.833566] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-23T19:28:21.833673] [INFO ] [MAIN ] Update Progress: 1118/2372 symbols completed. INVH took 29.3s. Estimated remaining: 2h 46m 21s. Rate: 7.5 symbols/min [2025-09-23T19:28:22.721826] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T19:28:22.726330] [INFO ] [REMOTE ] INVX: Full fetch complete (44425 records). [2025-09-23T19:28:22.726428] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-23T19:28:23.109630] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-23T19:28:23.109819] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-23T19:28:23.110701] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-23T19:28:23.110764] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-23T19:28:23.111834] [DEBUG] [LOCAL ] INVX: Trimmed 44425 records to 28970 (keeping 200 days of data) [2025-09-23T19:28:23.286505] [DEBUG] [LOCAL ] INVX: Primary data saved (28970 records). [2025-09-23T19:28:23.286681] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-23T19:28:23.286826] [INFO ] [MAIN ] Update Progress: 1119/2372 symbols completed. INVX took 22.7s. Estimated remaining: 2h 46m 6s. Rate: 7.5 symbols/min [2025-09-23T19:28:23.719460] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-23T19:28:23.732924] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-23T19:28:26.376323] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-23T19:28:26.387499] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-23T19:28:28.856822] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-23T19:28:28.869309] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-23T19:28:31.265108] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-23T19:28:31.277595] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-23T19:28:33.869742] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-23T19:28:33.878733] [INFO ] [REMOTE ] IONQ: Full fetch complete (70558 records). [2025-09-23T19:28:33.878866] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-23T19:28:34.072099] [WARN ] [VALIDATOR ] IONQ: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T19:28:34.072880] [FATAL] [MAIN ] IONQ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:28:34.072954] [WARN ] [MAIN ] IONQ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:28:34.073026] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-23T19:28:34.073098] [DEBUG] [LOCAL ] IONQ: No primary data file found to delete. [2025-09-23T19:28:34.073135] [INFO ] [LOCAL ] IONQ: Starting deletion of derivative data. [2025-09-23T19:28:34.073557] [DEBUG] [LOCAL ] IONQ: Deleted derivative data file. [2025-09-23T19:28:34.073690] [INFO ] [MAIN ] Update Progress: 1120/2372 symbols completed. IONQ took 31.4s. Estimated remaining: 2h 46m 1s. Rate: 7.5 symbols/min [2025-09-23T19:28:34.715719] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:34.716611] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:34.671976] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:34.794497] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:34.823204] [DEBUG] [LOCAL ] IPI: Loaded 21232 existing records from primary storage. [2025-09-23T19:28:34.836699] [INFO ] [MAIN ] IPI: Loaded 21232 existing records. [2025-09-23T19:28:35.015212] [DEBUG] [LOCAL ] IOT: Loaded 53472 existing records from primary storage. [2025-09-23T19:28:35.059624] [INFO ] [MAIN ] IOT: Loaded 53472 existing records. [2025-09-23T19:28:35.176701] [DEBUG] [LOCAL ] IP: Loaded 53326 existing records from primary storage. [2025-09-23T19:28:35.176832] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:35.211942] [INFO ] [MAIN ] IP: Loaded 53326 existing records. [2025-09-23T19:28:35.217799] [DEBUG] [LOCAL ] IPG: Loaded 53332 existing records from primary storage. [2025-09-23T19:28:35.239623] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-23T19:28:35.228774] [INFO ] [MAIN ] IPG: Loaded 53332 existing records. [2025-09-23T19:28:35.270253] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-23T19:28:35.441807] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-23T19:28:35.449738] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:35.455189] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-23T19:28:35.529024] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-23T19:28:35.532704] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-23T19:28:35.644506] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-23T19:28:35.688044] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-23T19:28:35.784480] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:35.855804] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-23T19:28:35.898968] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-23T19:28:35.898894] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:35.943516] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-23T19:28:35.964064] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-23T19:28:35.958766] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-23T19:28:36.001574] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-23T19:28:36.065958] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-23T19:28:36.154979] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-23T19:28:36.671449] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:36.775378] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-23T19:28:36.881623] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:36.955088] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-23T19:28:37.205733] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:37.208276] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-23T19:28:37.230117] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:37.230392] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-23T19:28:37.886368] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:28:37.890676] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-23T19:28:38.505723] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T19:28:38.509914] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-23T19:28:38.618667] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:28:38.630724] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-23T19:28:38.662682] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T19:28:38.673955] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-23T19:28:38.727313] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T19:28:38.737924] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-23T19:28:39.109319] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T19:28:39.113554] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-23T19:28:40.200337] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:28:40.206415] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-23T19:28:40.324862] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T19:28:40.336421] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-23T19:28:40.370366] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:28:40.381034] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-23T19:28:40.438203] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T19:28:40.449474] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-23T19:28:40.946454] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T19:28:40.953945] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-23T19:28:41.599662] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T19:28:41.610018] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-23T19:28:41.764294] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T19:28:41.804974] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-23T19:28:41.809492] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:28:41.821971] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-23T19:28:41.924266] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T19:28:41.934727] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-23T19:28:42.856518] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T19:28:42.861865] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-23T19:28:43.047745] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T19:28:43.059534] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-23T19:28:43.562610] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T19:28:43.567364] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-23T19:28:43.759983] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T19:28:43.772043] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-23T19:28:43.849898] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T19:28:44.202241] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-23T19:28:44.563442] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T19:28:44.635799] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T19:28:45.002235] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-23T19:28:45.173436] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:28:45.802210] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-23T19:28:46.191353] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T19:28:46.359836] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:28:46.602185] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-23T19:28:46.922666] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T19:28:46.926759] [INFO ] [REMOTE ] IPI: Full fetch complete (28929 records). [2025-09-23T19:28:46.926849] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-23T19:28:47.301143] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-23T19:28:47.301230] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-23T19:28:47.301887] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-23T19:28:47.301950] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-23T19:28:47.302740] [DEBUG] [LOCAL ] IPI: Trimmed 28929 records to 21223 (keeping 200 days of data) [2025-09-23T19:28:47.402334] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-23T19:28:47.427126] [DEBUG] [LOCAL ] IPI: Primary data saved (21223 records). [2025-09-23T19:28:47.427262] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-23T19:28:47.427376] [INFO ] [MAIN ] Update Progress: 1121/2372 symbols completed. IPI took 13.3s. Estimated remaining: 2h 45m 59s. Rate: 7.5 symbols/min [2025-09-23T19:28:47.601486] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:47.601706] [DEBUG] [LOCAL ] IQI: No existing data file found in primary storage. [2025-09-23T19:28:47.601756] [WARN ] [MAIN ] IQI: No existing data found, performing full refresh instead. [2025-09-23T19:28:47.601898] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-23T19:28:47.601940] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-23T19:28:47.601980] [DEBUG] [LOCAL ] IQI: No primary data file found to delete. [2025-09-23T19:28:47.602011] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-23T19:28:47.957674] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:48.212681] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-23T19:28:48.219182] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T19:28:49.002255] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-23T19:28:49.219570] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T19:28:49.280305] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T19:28:49.802193] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-23T19:28:50.463436] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:28:50.602201] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-23T19:28:51.247138] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:28:51.402236] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-23T19:28:52.202211] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-23T19:28:52.707012] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T19:28:53.002195] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-23T19:28:53.147171] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T19:28:53.802177] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-23T19:28:54.136725] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T19:28:54.602240] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-23T19:28:55.034711] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-23T19:28:55.402208] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-23T19:28:55.659092] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T19:28:55.884624] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T19:28:56.202231] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-23T19:28:56.411144] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T19:28:57.002227] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-23T19:28:57.802163] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-23T19:28:57.978277] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T19:28:57.989344] [INFO ] [REMOTE ] IP: Full fetch complete (77058 records). [2025-09-23T19:28:57.989680] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-23T19:28:58.409049] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-23T19:28:58.409276] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-23T19:28:58.410782] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-23T19:28:58.410874] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-23T19:28:58.413502] [DEBUG] [LOCAL ] IP: Trimmed 77058 records to 53323 (keeping 200 days of data) [2025-09-23T19:28:58.608450] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-23T19:28:58.802327] [DEBUG] [LOCAL ] IP: Primary data saved (53323 records). [2025-09-23T19:28:58.802518] [INFO ] [MAIN ] IP: Full history saved. [2025-09-23T19:28:58.802892] [INFO ] [MAIN ] Update Progress: 1122/2372 symbols completed. IP took 24.7s. Estimated remaining: 2h 45m 55s. Rate: 7.5 symbols/min [2025-09-23T19:28:58.804672] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T19:28:58.991219] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:59.041208] [DEBUG] [LOCAL ] IQV: Loaded 50377 existing records from primary storage. [2025-09-23T19:28:59.041386] [INFO ] [MAIN ] IQV: Loaded 50377 existing records. [2025-09-23T19:28:59.156884] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:28:59.242984] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:59.243292] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-23T19:28:59.243341] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-23T19:28:59.244790] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-23T19:28:59.244853] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-23T19:28:59.402442] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-23T19:28:59.604454] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:00.202226] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-23T19:29:00.636322] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T19:29:00.645283] [INFO ] [REMOTE ] IOT: Full fetch complete (77381 records). [2025-09-23T19:29:00.645439] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-23T19:29:01.018542] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-23T19:29:01.061034] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-23T19:29:01.061230] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-23T19:29:01.062327] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-23T19:29:01.062398] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-23T19:29:01.064104] [DEBUG] [LOCAL ] IOT: Trimmed 77381 records to 53471 (keeping 200 days of data) [2025-09-23T19:29:01.420393] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-23T19:29:01.433546] [INFO ] [REMOTE ] IPG: Full fetch complete (77249 records). [2025-09-23T19:29:01.434720] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-23T19:29:01.523548] [DEBUG] [LOCAL ] IOT: Primary data saved (53471 records). [2025-09-23T19:29:01.529173] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-23T19:29:01.529515] [INFO ] [MAIN ] Update Progress: 1123/2372 symbols completed. IOT took 27.5s. Estimated remaining: 2h 45m 41s. Rate: 7.5 symbols/min [2025-09-23T19:29:01.944806] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:02.175154] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T19:29:02.179081] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-23T19:29:02.191958] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-23T19:29:02.192679] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-23T19:29:02.195599] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-23T19:29:02.197258] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T19:29:02.197448] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-23T19:29:02.219728] [DEBUG] [LOCAL ] IPG: Trimmed 77249 records to 53332 (keeping 200 days of data) [2025-09-23T19:29:02.330849] [DEBUG] [LOCAL ] IR: Loaded 52696 existing records from primary storage. [2025-09-23T19:29:02.331762] [INFO ] [MAIN ] IR: Loaded 52696 existing records. [2025-09-23T19:29:02.552804] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:02.554737] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-23T19:29:02.555100] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-23T19:29:02.558020] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-23T19:29:02.558380] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-23T19:29:02.604428] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-23T19:29:02.982036] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:03.209072] [DEBUG] [LOCAL ] IPG: Primary data saved (53332 records). [2025-09-23T19:29:03.209298] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-23T19:29:03.209424] [INFO ] [MAIN ] Update Progress: 1124/2372 symbols completed. IPG took 29.1s. Estimated remaining: 2h 45m 26s. Rate: 7.5 symbols/min [2025-09-23T19:29:03.387042] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:03.402195] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-23T19:29:03.439736] [DEBUG] [LOCAL ] IRM: Loaded 49510 existing records from primary storage. [2025-09-23T19:29:03.439941] [INFO ] [MAIN ] IRM: Loaded 49510 existing records. [2025-09-23T19:29:03.649762] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:03.650250] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-23T19:29:03.650314] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-23T19:29:03.651892] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-23T19:29:03.651962] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-23T19:29:04.059029] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:04.089637] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T19:29:04.101169] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:29:04.202189] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-23T19:29:05.002200] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-23T19:29:05.188817] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T19:29:05.346020] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T19:29:05.802318] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-23T19:29:06.470416] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T19:29:06.602252] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-23T19:29:07.402221] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-23T19:29:07.511888] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T19:29:07.573315] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T19:29:08.202197] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-23T19:29:08.991914] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:29:09.002156] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-23T19:29:09.594363] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:29:09.802197] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-23T19:29:10.602192] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-23T19:29:10.755198] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T19:29:11.058602] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T19:29:11.402190] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-23T19:29:12.202205] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-23T19:29:12.437701] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T19:29:12.819848] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T19:29:13.002198] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-23T19:29:13.133384] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T19:29:13.802208] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-23T19:29:14.602205] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-23T19:29:14.713680] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:29:15.402229] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-23T19:29:15.571086] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:29:15.606888] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T19:29:16.202195] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-23T19:29:17.002798] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-23T19:29:17.009300] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T19:29:17.802225] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-23T19:29:17.982491] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T19:29:18.407023] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:29:18.602193] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-23T19:29:18.898940] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:29:19.402222] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-23T19:29:20.202172] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-23T19:29:20.365495] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T19:29:20.405452] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:29:20.408815] [INFO ] [REMOTE ] IQI: Full fetch complete (27268 records). [2025-09-23T19:29:20.408898] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-23T19:29:20.778840] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-23T19:29:20.778931] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-23T19:29:20.779486] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-23T19:29:20.779539] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-23T19:29:20.780322] [DEBUG] [LOCAL ] IQI: Trimmed 27268 records to 18001 (keeping 200 days of data) [2025-09-23T19:29:20.891345] [DEBUG] [LOCAL ] IQI: Primary data saved (18001 records). [2025-09-23T19:29:20.891508] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-23T19:29:20.891585] [INFO ] [MAIN ] Update Progress: 1125/2372 symbols completed. IQI took 33.5s. Estimated remaining: 2h 45m 29s. Rate: 7.5 symbols/min [2025-09-23T19:29:21.007258] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-23T19:29:21.067759] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:21.090840] [DEBUG] [LOCAL ] IRS: Loaded 21606 existing records from primary storage. [2025-09-23T19:29:21.091000] [INFO ] [MAIN ] IRS: Loaded 21606 existing records. [2025-09-23T19:29:21.272923] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:21.273303] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-23T19:29:21.273371] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-23T19:29:21.274169] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-23T19:29:21.274235] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-23T19:29:21.634943] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:21.802174] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-23T19:29:22.061531] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T19:29:22.602179] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-23T19:29:22.820216] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T19:29:22.911877] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:29:23.402192] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-23T19:29:23.996609] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T19:29:24.202202] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-23T19:29:24.622604] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T19:29:25.002198] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-23T19:29:25.597002] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T19:29:25.758828] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T19:29:25.802196] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-23T19:29:26.602202] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-23T19:29:27.402162] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-23T19:29:27.463634] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T19:29:27.594206] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T19:29:28.202229] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-23T19:29:29.002194] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-23T19:29:29.064144] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T19:29:29.108086] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T19:29:29.802250] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-23T19:29:30.476131] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T19:29:30.484397] [INFO ] [REMOTE ] IRM: Full fetch complete (72270 records). [2025-09-23T19:29:30.484529] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-23T19:29:30.604381] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-23T19:29:30.900018] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T19:29:30.925550] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-23T19:29:30.926092] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-23T19:29:30.929318] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-23T19:29:30.929387] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-23T19:29:30.931224] [DEBUG] [LOCAL ] IRM: Trimmed 72270 records to 49478 (keeping 200 days of data) [2025-09-23T19:29:31.242839] [DEBUG] [LOCAL ] IRM: Primary data saved (49478 records). [2025-09-23T19:29:31.242989] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-23T19:29:31.243071] [INFO ] [MAIN ] Update Progress: 1126/2372 symbols completed. IRM took 28.0s. Estimated remaining: 2h 45m 24s. Rate: 7.5 symbols/min [2025-09-23T19:29:31.416597] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:31.413056] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-23T19:29:31.468935] [DEBUG] [LOCAL ] IRT: Loaded 50393 existing records from primary storage. [2025-09-23T19:29:31.469104] [INFO ] [MAIN ] IRT: Loaded 50393 existing records. [2025-09-23T19:29:31.646054] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:31.646343] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-23T19:29:31.646408] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-23T19:29:31.647932] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-23T19:29:31.647994] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-23T19:29:32.010503] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:32.202181] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-23T19:29:32.342288] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:29:32.351794] [INFO ] [REMOTE ] IQV: Full fetch complete (72386 records). [2025-09-23T19:29:32.351933] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-23T19:29:32.526499] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T19:29:32.823959] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-23T19:29:32.824047] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-23T19:29:32.825086] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-23T19:29:32.825173] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-23T19:29:32.830760] [DEBUG] [LOCAL ] IQV: Trimmed 72386 records to 50310 (keeping 200 days of data) [2025-09-23T19:29:33.011174] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-23T19:29:33.149481] [DEBUG] [LOCAL ] IQV: Primary data saved (50310 records). [2025-09-23T19:29:33.149629] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-23T19:29:33.149792] [INFO ] [MAIN ] Update Progress: 1127/2372 symbols completed. IQV took 34.3s. Estimated remaining: 2h 45m 9s. Rate: 7.5 symbols/min [2025-09-23T19:29:33.329065] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:33.348407] [DEBUG] [LOCAL ] ISD: Loaded 15668 existing records from primary storage. [2025-09-23T19:29:33.348546] [INFO ] [MAIN ] ISD: Loaded 15668 existing records. [2025-09-23T19:29:33.530912] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:33.531475] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-23T19:29:33.531698] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-23T19:29:33.532290] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-23T19:29:33.532382] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-23T19:29:33.805032] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-23T19:29:33.913291] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:33.950682] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T19:29:34.085170] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T19:29:34.602227] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-23T19:29:35.402242] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-23T19:29:35.606163] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T19:29:36.203404] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-23T19:29:36.226094] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T19:29:36.362453] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T19:29:37.002194] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-23T19:29:37.334767] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T19:29:37.802222] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-23T19:29:38.377152] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:29:38.390381] [INFO ] [REMOTE ] IR: Full fetch complete (76116 records). [2025-09-23T19:29:38.390559] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-23T19:29:38.607460] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-23T19:29:38.837599] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-23T19:29:38.837745] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-23T19:29:38.840223] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-23T19:29:38.840298] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-23T19:29:38.844689] [DEBUG] [LOCAL ] IR: Trimmed 76116 records to 52696 (keeping 200 days of data) [2025-09-23T19:29:38.975698] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T19:29:39.221991] [DEBUG] [LOCAL ] IR: Primary data saved (52696 records). [2025-09-23T19:29:39.222149] [INFO ] [MAIN ] IR: Full history saved. [2025-09-23T19:29:39.222273] [INFO ] [MAIN ] Update Progress: 1128/2372 symbols completed. IR took 37.7s. Estimated remaining: 2h 44m 59s. Rate: 7.5 symbols/min [2025-09-23T19:29:39.396276] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:39.402248] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-23T19:29:39.446994] [DEBUG] [LOCAL ] IT: Loaded 41446 existing records from primary storage. [2025-09-23T19:29:39.447232] [INFO ] [MAIN ] IT: Loaded 41446 existing records. [2025-09-23T19:29:39.625703] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:39.625989] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-23T19:29:39.626049] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-23T19:29:39.627156] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-23T19:29:39.627217] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-23T19:29:39.991460] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:40.115003] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:29:40.202160] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-23T19:29:40.372528] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T19:29:41.002225] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-23T19:29:41.492092] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T19:29:41.802198] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-23T19:29:41.934483] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T19:29:42.602280] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-23T19:29:42.872861] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T19:29:43.232397] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:29:43.402207] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-23T19:29:44.202204] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-23T19:29:44.414569] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T19:29:45.002180] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-23T19:29:45.064441] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T19:29:45.802236] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-23T19:29:46.191492] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T19:29:46.602236] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-23T19:29:47.342012] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T19:29:47.402169] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-23T19:29:47.904770] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T19:29:47.910551] [INFO ] [REMOTE ] IRS: Full fetch complete (32174 records). [2025-09-23T19:29:47.910679] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-23T19:29:48.207774] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-23T19:29:48.308071] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-23T19:29:48.308160] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-23T19:29:48.308807] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-23T19:29:48.308869] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-23T19:29:48.310931] [DEBUG] [LOCAL ] IRS: Trimmed 32174 records to 21668 (keeping 200 days of data) [2025-09-23T19:29:48.449290] [DEBUG] [LOCAL ] IRS: Primary data saved (21668 records). [2025-09-23T19:29:48.449427] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-23T19:29:48.449535] [INFO ] [MAIN ] Update Progress: 1129/2372 symbols completed. IRS took 27.6s. Estimated remaining: 2h 44m 53s. Rate: 7.5 symbols/min [2025-09-23T19:29:48.631278] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:48.677475] [DEBUG] [LOCAL ] ITGR: Loaded 31574 existing records from primary storage. [2025-09-23T19:29:48.699453] [INFO ] [MAIN ] ITGR: Loaded 31574 existing records. [2025-09-23T19:29:48.783504] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:29:48.905850] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:48.906193] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-23T19:29:48.906242] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-23T19:29:48.907295] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-23T19:29:48.907362] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-23T19:29:49.007418] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-23T19:29:49.303631] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:49.762671] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T19:29:49.802849] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-23T19:29:49.804850] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T19:29:50.602229] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-23T19:29:51.306893] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:29:51.402180] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-23T19:29:51.657697] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T19:29:52.202195] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-23T19:29:52.892086] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T19:29:53.002200] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-23T19:29:53.135890] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T19:29:53.802197] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-23T19:29:54.282624] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T19:29:54.602199] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-23T19:29:54.634521] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T19:29:55.402200] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-23T19:29:55.785664] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:29:56.163161] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T19:29:56.202155] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-23T19:29:57.002206] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-23T19:29:57.369284] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T19:29:57.802250] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-23T19:29:58.436989] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T19:29:58.602269] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-23T19:29:58.835761] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:29:59.402223] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-23T19:30:00.178556] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T19:30:00.202268] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-23T19:30:00.653940] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T19:30:01.002205] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-23T19:30:01.505300] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T19:30:01.802299] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-23T19:30:02.602202] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-23T19:30:03.297368] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-23T19:30:03.402210] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-23T19:30:04.202196] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-23T19:30:04.379370] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-23T19:30:04.382191] [INFO ] [REMOTE ] ISD: Full fetch complete (23802 records). [2025-09-23T19:30:04.382270] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-23T19:30:04.775976] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-23T19:30:04.776070] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-23T19:30:04.776579] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-23T19:30:04.776620] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-23T19:30:04.777276] [DEBUG] [LOCAL ] ISD: Trimmed 23802 records to 15567 (keeping 200 days of data) [2025-09-23T19:30:04.872506] [DEBUG] [LOCAL ] ISD: Primary data saved (15567 records). [2025-09-23T19:30:04.872698] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-23T19:30:04.872816] [INFO ] [MAIN ] Update Progress: 1130/2372 symbols completed. ISD took 31.7s. Estimated remaining: 2h 44m 54s. Rate: 7.5 symbols/min [2025-09-23T19:30:05.048375] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:05.089017] [DEBUG] [LOCAL ] ITT: Loaded 33181 existing records from primary storage. [2025-09-23T19:30:05.089178] [INFO ] [MAIN ] ITT: Loaded 33181 existing records. [2025-09-23T19:30:05.275166] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:05.275426] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-23T19:30:05.275475] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-23T19:30:05.276586] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-23T19:30:05.276683] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-23T19:30:05.655395] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:05.655842] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-23T19:30:05.905926] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-23T19:30:05.938797] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-23T19:30:05.939913] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (3.34 seconds). [2025-09-23T19:30:06.565318] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-23T19:30:06.573372] [INFO ] [REMOTE ] IT: Full fetch complete (55195 records). [2025-09-23T19:30:06.573549] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-23T19:30:06.607293] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-23T19:30:06.997347] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-23T19:30:06.997582] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-23T19:30:06.998714] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-23T19:30:06.998800] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-23T19:30:07.000572] [DEBUG] [LOCAL ] IT: Trimmed 55195 records to 41528 (keeping 200 days of data) [2025-09-23T19:30:07.123111] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T19:30:07.293819] [DEBUG] [LOCAL ] IT: Primary data saved (41528 records). [2025-09-23T19:30:07.294001] [INFO ] [MAIN ] IT: Full history saved. [2025-09-23T19:30:07.294130] [INFO ] [MAIN ] Update Progress: 1131/2372 symbols completed. IT took 28.1s. Estimated remaining: 2h 44m 40s. Rate: 7.5 symbols/min [2025-09-23T19:30:07.407428] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-23T19:30:07.502595] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:07.541130] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T19:30:07.581432] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T19:30:07.633594] [DEBUG] [LOCAL ] ITUB: Loaded 53299 existing records from primary storage. [2025-09-23T19:30:07.633817] [INFO ] [MAIN ] ITUB: Loaded 53299 existing records. [2025-09-23T19:30:07.816338] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:07.816638] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-23T19:30:07.816732] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-23T19:30:07.817963] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-23T19:30:07.818025] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-23T19:30:08.207334] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-23T19:30:08.211312] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:08.407335] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T19:30:09.002209] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-23T19:30:09.210416] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T19:30:09.802244] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-23T19:30:10.430034] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T19:30:10.439176] [INFO ] [REMOTE ] IRT: Full fetch complete (72354 records). [2025-09-23T19:30:10.439374] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-23T19:30:10.611003] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-23T19:30:10.876669] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-23T19:30:10.876785] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-23T19:30:10.877737] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-23T19:30:10.877811] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-23T19:30:10.879402] [DEBUG] [LOCAL ] IRT: Trimmed 72354 records to 50392 (keeping 200 days of data) [2025-09-23T19:30:11.209746] [DEBUG] [LOCAL ] IRT: Primary data saved (50392 records). [2025-09-23T19:30:11.209932] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-23T19:30:11.210054] [INFO ] [MAIN ] Update Progress: 1132/2372 symbols completed. IRT took 40.0s. Estimated remaining: 2h 44m 27s. Rate: 7.5 symbols/min [2025-09-23T19:30:11.391088] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:11.402194] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-23T19:30:11.440945] [DEBUG] [LOCAL ] ITW: Loaded 46386 existing records from primary storage. [2025-09-23T19:30:11.441144] [INFO ] [MAIN ] ITW: Loaded 46386 existing records. [2025-09-23T19:30:11.638960] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:11.639376] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-23T19:30:11.639465] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-23T19:30:11.641216] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-23T19:30:11.641282] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-23T19:30:11.853697] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T19:30:11.878446] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:30:12.121947] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:12.202225] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-23T19:30:12.839618] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:30:13.002189] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-23T19:30:13.480253] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T19:30:13.802198] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-23T19:30:13.904270] [DEBUG] [REMOTE ] ITT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-23T19:30:13.904584] [WARN ] [REMOTE ] ITT: No data returned for month 2025-03 [2025-09-23T19:30:14.602195] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-23T19:30:14.781063] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:30:15.402204] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-23T19:30:16.014343] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:30:16.019921] [INFO ] [REMOTE ] ITGR: Full fetch complete (41221 records). [2025-09-23T19:30:16.020090] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-23T19:30:16.207358] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-23T19:30:16.398828] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-23T19:30:16.398923] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-23T19:30:16.399593] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-23T19:30:16.399634] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-23T19:30:16.400538] [DEBUG] [LOCAL ] ITGR: Trimmed 41221 records to 31561 (keeping 200 days of data) [2025-09-23T19:30:16.588085] [DEBUG] [LOCAL ] ITGR: Primary data saved (31561 records). [2025-09-23T19:30:16.588230] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-23T19:30:16.588315] [INFO ] [MAIN ] Update Progress: 1133/2372 symbols completed. ITGR took 28.1s. Estimated remaining: 2h 44m 17s. Rate: 7.5 symbols/min [2025-09-23T19:30:16.754600] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:16.799401] [DEBUG] [LOCAL ] IVR: Loaded 47819 existing records from primary storage. [2025-09-23T19:30:16.799563] [INFO ] [MAIN ] IVR: Loaded 47819 existing records. [2025-09-23T19:30:16.976392] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:16.976714] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-23T19:30:16.976774] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-23T19:30:16.977848] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-23T19:30:16.977909] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-23T19:30:17.011015] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-23T19:30:17.356503] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:17.802170] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-23T19:30:17.992131] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-23T19:30:18.602184] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-23T19:30:18.737138] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-23T19:30:19.402204] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-23T19:30:19.484972] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-23T19:30:19.658954] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T19:30:20.080697] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T19:30:20.202244] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-23T19:30:20.952971] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:30:21.002206] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-23T19:30:21.802244] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-23T19:30:22.083687] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T19:30:22.349990] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T19:30:22.602216] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-23T19:30:23.402172] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-23T19:30:23.430140] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:30:23.732355] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T19:30:24.202230] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-23T19:30:25.002181] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-23T19:30:25.366541] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T19:30:25.802201] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-23T19:30:26.103539] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T19:30:26.598745] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T19:30:26.607267] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-23T19:30:27.147016] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T19:30:27.402208] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-23T19:30:28.123107] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:30:28.202204] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-23T19:30:29.002218] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-23T19:30:29.099389] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T19:30:29.620452] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:30:29.802229] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-23T19:30:30.602219] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-23T19:30:30.695420] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T19:30:31.402207] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-23T19:30:32.202311] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-23T19:30:32.799882] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-09-23T19:30:32.882315] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-23T19:30:33.002218] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-23T19:30:33.088528] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:30:33.230358] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T19:30:33.802233] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-23T19:30:34.581635] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:30:34.602179] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-23T19:30:34.695188] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T19:30:34.700498] [INFO ] [REMOTE ] ITT: Full fetch complete (41377 records). [2025-09-23T19:30:34.700693] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-23T19:30:34.908141] [WARN ] [VALIDATOR ] ITT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T19:30:34.908719] [FATAL] [MAIN ] ITT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:30:34.908806] [WARN ] [MAIN ] ITT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:30:34.908884] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-23T19:30:34.908959] [DEBUG] [LOCAL ] ITT: No primary data file found to delete. [2025-09-23T19:30:34.909011] [INFO ] [LOCAL ] ITT: Starting deletion of derivative data. [2025-09-23T19:30:34.909516] [DEBUG] [LOCAL ] ITT: Deleted derivative data file. [2025-09-23T19:30:34.909635] [INFO ] [MAIN ] Update Progress: 1134/2372 symbols completed. ITT took 30.0s. Estimated remaining: 2h 44m 20s. Rate: 7.5 symbols/min [2025-09-23T19:30:35.096882] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:35.136558] [DEBUG] [LOCAL ] IVT: Loaded 30914 existing records from primary storage. [2025-09-23T19:30:35.136822] [INFO ] [MAIN ] IVT: Loaded 30914 existing records. [2025-09-23T19:30:35.320511] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:35.320879] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-23T19:30:35.320930] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-23T19:30:35.321773] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-23T19:30:35.321833] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-23T19:30:35.407403] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-23T19:30:35.688693] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:35.879661] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T19:30:36.202275] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-23T19:30:37.002216] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-23T19:30:37.158799] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T19:30:37.802256] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-23T19:30:37.864548] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:30:38.602174] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-23T19:30:39.068278] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T19:30:39.193176] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:30:39.402209] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-23T19:30:40.120033] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T19:30:40.129157] [INFO ] [REMOTE ] ITUB: Full fetch complete (77160 records). [2025-09-23T19:30:40.129331] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-23T19:30:40.207282] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-23T19:30:40.554468] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T19:30:40.554732] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-23T19:30:40.561120] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-23T19:30:40.562602] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-23T19:30:40.562714] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-23T19:30:40.564385] [DEBUG] [LOCAL ] ITUB: Trimmed 77160 records to 53304 (keeping 200 days of data) [2025-09-23T19:30:40.881606] [DEBUG] [LOCAL ] ITUB: Primary data saved (53304 records). [2025-09-23T19:30:40.881792] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-23T19:30:40.881919] [INFO ] [MAIN ] Update Progress: 1135/2372 symbols completed. ITUB took 33.6s. Estimated remaining: 2h 44m 10s. Rate: 7.5 symbols/min [2025-09-23T19:30:41.007261] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-23T19:30:41.059227] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:41.113050] [DEBUG] [LOCAL ] IVZ: Loaded 53143 existing records from primary storage. [2025-09-23T19:30:41.113233] [INFO ] [MAIN ] IVZ: Loaded 53143 existing records. [2025-09-23T19:30:41.295027] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:41.295309] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-23T19:30:41.295358] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-23T19:30:41.296608] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-23T19:30:41.296692] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-23T19:30:41.675513] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:41.802174] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-23T19:30:41.911498] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T19:30:42.602267] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-23T19:30:42.766587] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:30:42.835022] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:30:43.402244] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-23T19:30:43.936470] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T19:30:43.945003] [INFO ] [REMOTE ] ITW: Full fetch complete (66562 records). [2025-09-23T19:30:43.945228] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-23T19:30:44.211298] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-23T19:30:44.359228] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-23T19:30:44.359340] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-23T19:30:44.360585] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-23T19:30:44.360674] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-23T19:30:44.362559] [DEBUG] [LOCAL ] ITW: Trimmed 66562 records to 46324 (keeping 200 days of data) [2025-09-23T19:30:44.693746] [DEBUG] [LOCAL ] ITW: Primary data saved (46324 records). [2025-09-23T19:30:44.694005] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-23T19:30:44.694142] [INFO ] [MAIN ] Update Progress: 1136/2372 symbols completed. ITW took 33.5s. Estimated remaining: 2h 43m 57s. Rate: 7.5 symbols/min [2025-09-23T19:30:44.887428] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:44.911019] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T19:30:44.919589] [INFO ] [REMOTE ] IVR: Full fetch complete (68932 records). [2025-09-23T19:30:44.919847] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-23T19:30:45.013351] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-23T19:30:45.195520] [DEBUG] [LOCAL ] IX: Loaded 22628 existing records from primary storage. [2025-09-23T19:30:45.247341] [INFO ] [MAIN ] IX: Loaded 22628 existing records. [2025-09-23T19:30:45.534146] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-23T19:30:45.539745] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-23T19:30:45.569087] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-23T19:30:45.572855] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-23T19:30:45.573022] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:45.573534] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-23T19:30:45.573584] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-23T19:30:45.574300] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-23T19:30:45.574367] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-23T19:30:45.619492] [DEBUG] [LOCAL ] IVR: Trimmed 68932 records to 47868 (keeping 200 days of data) [2025-09-23T19:30:46.044837] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:46.047092] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-23T19:30:46.098202] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T19:30:46.271658] [DEBUG] [LOCAL ] IVR: Primary data saved (47868 records). [2025-09-23T19:30:46.271815] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-23T19:30:46.271907] [INFO ] [MAIN ] Update Progress: 1137/2372 symbols completed. IVR took 29.7s. Estimated remaining: 2h 43m 42s. Rate: 7.5 symbols/min [2025-09-23T19:30:46.453107] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:46.471940] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T19:30:46.520938] [DEBUG] [LOCAL ] J: Loaded 40502 existing records from primary storage. [2025-09-23T19:30:46.521136] [INFO ] [MAIN ] J: Loaded 40502 existing records. [2025-09-23T19:30:46.612050] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-23T19:30:46.705190] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:46.705623] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-23T19:30:46.705708] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-23T19:30:46.707184] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-23T19:30:46.707246] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-23T19:30:46.871238] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T19:30:47.081089] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:47.402260] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-23T19:30:48.202160] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-23T19:30:48.243420] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:30:48.986612] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:30:49.002140] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-23T19:30:49.611710] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:30:49.802203] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-23T19:30:50.591147] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T19:30:50.602134] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-23T19:30:51.402168] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-23T19:30:51.503486] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T19:30:51.863453] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T19:30:52.186470] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T19:30:52.202140] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-23T19:30:53.002275] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-23T19:30:53.496059] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T19:30:53.776860] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:30:53.802262] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-23T19:30:54.602262] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-23T19:30:54.765273] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T19:30:55.402209] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-23T19:30:55.597554] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T19:30:56.202205] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-23T19:30:56.226154] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:30:57.002276] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-23T19:30:57.802218] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-23T19:30:58.065025] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T19:30:58.504215] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:30:58.602247] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-23T19:30:58.761400] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T19:30:59.402209] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-23T19:31:00.202267] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-23T19:31:00.376351] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T19:31:00.549165] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T19:31:01.002239] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-23T19:31:01.802161] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-23T19:31:01.943758] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T19:31:02.209604] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T19:31:02.602197] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-23T19:31:03.008839] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:31:03.402219] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-23T19:31:04.202169] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-23T19:31:04.285932] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T19:31:04.695950] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T19:31:05.002164] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-23T19:31:05.340072] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T19:31:05.802215] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-23T19:31:06.602175] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-23T19:31:06.698712] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T19:31:06.852200] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T19:31:06.857678] [INFO ] [REMOTE ] IVT: Full fetch complete (45647 records). [2025-09-23T19:31:06.857868] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-23T19:31:07.241662] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-23T19:31:07.241762] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-23T19:31:07.242474] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-23T19:31:07.242537] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-23T19:31:07.243639] [DEBUG] [LOCAL ] IVT: Trimmed 45647 records to 30966 (keeping 200 days of data) [2025-09-23T19:31:07.363596] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T19:31:07.423443] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-23T19:31:07.466798] [DEBUG] [LOCAL ] IVT: Primary data saved (30966 records). [2025-09-23T19:31:07.466974] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-23T19:31:07.467073] [INFO ] [MAIN ] Update Progress: 1138/2372 symbols completed. IVT took 32.6s. Estimated remaining: 2h 43m 49s. Rate: 7.5 symbols/min [2025-09-23T19:31:07.644445] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:07.686424] [DEBUG] [LOCAL ] JBGS: Loaded 42420 existing records from primary storage. [2025-09-23T19:31:07.686588] [INFO ] [MAIN ] JBGS: Loaded 42420 existing records. [2025-09-23T19:31:07.863944] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:07.864200] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-23T19:31:07.864250] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-23T19:31:07.865442] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-23T19:31:07.865515] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-23T19:31:08.207337] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-23T19:31:08.245223] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:09.002197] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-23T19:31:09.216699] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:31:09.293395] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T19:31:09.802194] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-23T19:31:10.193570] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:31:10.602208] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-23T19:31:11.001105] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T19:31:11.402204] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-23T19:31:12.202162] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-23T19:31:12.285480] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T19:31:12.877153] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T19:31:13.002190] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-23T19:31:13.221346] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T19:31:13.225062] [INFO ] [REMOTE ] IX: Full fetch complete (26764 records). [2025-09-23T19:31:13.225197] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-23T19:31:13.612066] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-23T19:31:13.612165] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-23T19:31:13.612821] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-23T19:31:13.612886] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-23T19:31:13.613797] [DEBUG] [LOCAL ] IX: Trimmed 26764 records to 22600 (keeping 200 days of data) [2025-09-23T19:31:13.748192] [DEBUG] [LOCAL ] IX: Primary data saved (22600 records). [2025-09-23T19:31:13.748367] [INFO ] [MAIN ] IX: Full history saved. [2025-09-23T19:31:13.748517] [INFO ] [MAIN ] Update Progress: 1139/2372 symbols completed. IX took 29.1s. Estimated remaining: 2h 43m 39s. Rate: 7.5 symbols/min [2025-09-23T19:31:13.808988] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-23T19:31:13.950891] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:13.994583] [DEBUG] [LOCAL ] JBI: Loaded 44019 existing records from primary storage. [2025-09-23T19:31:13.994783] [INFO ] [MAIN ] JBI: Loaded 44019 existing records. [2025-09-23T19:31:14.181737] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:14.182054] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-23T19:31:14.182104] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-23T19:31:14.183041] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-23T19:31:14.183103] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-23T19:31:14.579549] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T19:31:14.602714] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-23T19:31:14.621628] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:15.402216] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-23T19:31:15.621222] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T19:31:15.630128] [INFO ] [REMOTE ] IVZ: Full fetch complete (76741 records). [2025-09-23T19:31:15.630295] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-23T19:31:16.079018] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-23T19:31:16.078874] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:31:16.085674] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-23T19:31:16.087706] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-23T19:31:16.087928] [INFO ] [REMOTE ] J: Full fetch complete (59187 records). [2025-09-23T19:31:16.088045] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-23T19:31:16.088167] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-23T19:31:16.199340] [DEBUG] [LOCAL ] IVZ: Trimmed 76741 records to 53139 (keeping 200 days of data) [2025-09-23T19:31:16.205192] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-23T19:31:16.604888] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-23T19:31:16.606247] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-23T19:31:16.607360] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-23T19:31:16.608241] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-23T19:31:16.625137] [DEBUG] [LOCAL ] J: Trimmed 59187 records to 40439 (keeping 200 days of data) [2025-09-23T19:31:16.649437] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:31:17.007207] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-23T19:31:17.142845] [DEBUG] [LOCAL ] IVZ: Primary data saved (53139 records). [2025-09-23T19:31:17.147721] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-23T19:31:17.148086] [INFO ] [MAIN ] Update Progress: 1140/2372 symbols completed. IVZ took 36.3s. Estimated remaining: 2h 43m 26s. Rate: 7.5 symbols/min [2025-09-23T19:31:17.148601] [DEBUG] [LOCAL ] J: Primary data saved (40439 records). [2025-09-23T19:31:17.154275] [INFO ] [MAIN ] J: Full history saved. [2025-09-23T19:31:17.199132] [INFO ] [MAIN ] Update Progress: 1141/2372 symbols completed. J took 30.9s. Estimated remaining: 2h 43m 10s. Rate: 7.5 symbols/min [2025-09-23T19:31:17.508431] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:17.511397] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:17.541146] [DEBUG] [LOCAL ] JBND: Loaded 25326 existing records from primary storage. [2025-09-23T19:31:17.541315] [INFO ] [MAIN ] JBND: Loaded 25326 existing records. [2025-09-23T19:31:17.751792] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:17.769537] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-23T19:31:17.769701] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-23T19:31:17.771040] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-23T19:31:17.771302] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-23T19:31:17.771195] [DEBUG] [LOCAL ] JBL: Loaded 48357 existing records from primary storage. [2025-09-23T19:31:17.805755] [INFO ] [MAIN ] JBL: Loaded 48357 existing records. [2025-09-23T19:31:18.256535] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:18.270293] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-23T19:31:18.270726] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-23T19:31:18.302662] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-23T19:31:18.320321] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-23T19:31:18.370095] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-23T19:31:18.445269] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:18.465769] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-23T19:31:18.603062] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-23T19:31:18.729483] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T19:31:18.821279] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:19.402236] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-23T19:31:19.696096] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T19:31:19.881145] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T19:31:20.202231] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-23T19:31:21.002183] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-23T19:31:21.042950] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:31:21.475495] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:31:21.802333] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-23T19:31:21.943571] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T19:31:22.602247] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-23T19:31:23.181155] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T19:31:23.402250] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-23T19:31:24.202255] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-23T19:31:24.272347] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T19:31:24.834086] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T19:31:25.002167] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-23T19:31:25.769246] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T19:31:25.802143] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-23T19:31:26.602187] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-23T19:31:26.676797] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T19:31:26.888765] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:31:27.139107] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T19:31:27.402191] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-23T19:31:28.202211] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-23T19:31:28.844070] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:31:29.002192] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-23T19:31:29.147404] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T19:31:29.802227] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-23T19:31:30.602239] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-23T19:31:30.991529] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T19:31:31.237178] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T19:31:31.245103] [INFO ] [REMOTE ] JBGS: Full fetch complete (58949 records). [2025-09-23T19:31:31.245290] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-23T19:31:31.406830] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-23T19:31:31.680119] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-23T19:31:31.680316] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-23T19:31:31.681313] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-23T19:31:31.681449] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-23T19:31:31.698388] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:31:31.703383] [DEBUG] [LOCAL ] JBGS: Trimmed 58949 records to 42430 (keeping 200 days of data) [2025-09-23T19:31:31.982314] [DEBUG] [LOCAL ] JBGS: Primary data saved (42430 records). [2025-09-23T19:31:31.982456] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-23T19:31:31.982581] [INFO ] [MAIN ] Update Progress: 1142/2372 symbols completed. JBGS took 24.5s. Estimated remaining: 2h 43m 9s. Rate: 7.5 symbols/min [2025-09-23T19:31:32.168879] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:32.169294] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-23T19:31:32.169351] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-23T19:31:32.169632] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-23T19:31:32.169729] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-23T19:31:32.169798] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-23T19:31:32.169835] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-23T19:31:32.207348] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-23T19:31:32.546263] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:32.879578] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:31:33.002157] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-23T19:31:33.399185] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T19:31:33.802239] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-23T19:31:34.042367] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:34.042741] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-23T19:31:34.576160] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T19:31:34.602197] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-23T19:31:35.402253] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-23T19:31:36.152294] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T19:31:36.202177] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-23T19:31:36.655183] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T19:31:37.002189] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-23T19:31:37.626713] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:31:37.802218] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-23T19:31:38.161879] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:31:38.518697] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T19:31:38.602212] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-23T19:31:38.803182] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:38.803471] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-23T19:31:39.402227] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-23T19:31:39.608136] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:39.608518] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-23T19:31:40.202242] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-23T19:31:40.861099] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T19:31:41.002210] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-23T19:31:41.802193] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-23T19:31:42.602255] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-23T19:31:42.724666] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T19:31:43.042141] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:31:43.402225] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-23T19:31:44.065292] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:31:44.202257] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-23T19:31:44.410456] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:44.410810] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-23T19:31:44.550577] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T19:31:45.002175] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-23T19:31:45.201793] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:45.202122] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-23T19:31:45.802227] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-23T19:31:46.602201] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-23T19:31:46.806621] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:46.807134] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-23T19:31:47.402335] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-23T19:31:47.691163] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T19:31:47.700091] [INFO ] [REMOTE ] JBL: Full fetch complete (69915 records). [2025-09-23T19:31:47.700239] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-23T19:31:48.133970] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-23T19:31:48.134096] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-23T19:31:48.135517] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-23T19:31:48.135637] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-23T19:31:48.138119] [DEBUG] [LOCAL ] JBL: Trimmed 69915 records to 48368 (keeping 200 days of data) [2025-09-23T19:31:48.207740] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-23T19:31:48.402445] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:31:48.410400] [INFO ] [REMOTE ] JBND: Full fetch complete (33224 records). [2025-09-23T19:31:48.411075] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-23T19:31:48.841552] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-23T19:31:48.842411] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-23T19:31:48.843452] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-23T19:31:48.843792] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-23T19:31:48.848055] [DEBUG] [LOCAL ] JBND: Trimmed 33224 records to 25406 (keeping 200 days of data) [2025-09-23T19:31:49.003188] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-23T19:31:49.008852] [DEBUG] [LOCAL ] JBL: Primary data saved (48368 records). [2025-09-23T19:31:49.009450] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-23T19:31:49.009882] [INFO ] [MAIN ] Update Progress: 1143/2372 symbols completed. JBL took 31.9s. Estimated remaining: 2h 43m 11s. Rate: 7.5 symbols/min [2025-09-23T19:31:49.210221] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:49.211790] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-23T19:31:49.212502] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-23T19:31:49.214300] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-23T19:31:49.214615] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-23T19:31:49.215247] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-23T19:31:49.216169] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-23T19:31:49.666606] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:49.666749] [DEBUG] [LOCAL ] JBND: Primary data saved (25406 records). [2025-09-23T19:31:49.667094] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-23T19:31:49.667674] [INFO ] [MAIN ] Update Progress: 1144/2372 symbols completed. JBND took 32.4s. Estimated remaining: 2h 42m 55s. Rate: 7.5 symbols/min [2025-09-23T19:31:49.804486] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-23T19:31:49.867148] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:31:49.889472] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:49.937966] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T19:31:49.947772] [DEBUG] [LOCAL ] JCE: Loaded 6457 existing records from primary storage. [2025-09-23T19:31:49.947921] [INFO ] [MAIN ] JCE: Loaded 6457 existing records. [2025-09-23T19:31:50.138858] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:50.139767] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:50.139902] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-23T19:31:50.140136] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-23T19:31:50.140215] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-23T19:31:50.140919] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-23T19:31:50.140980] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-23T19:31:50.495191] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:50.602150] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-23T19:31:51.246321] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T19:31:51.402219] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-23T19:31:52.202249] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-23T19:31:52.330499] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:31:53.002247] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-23T19:31:53.598707] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T19:31:53.802202] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-23T19:31:54.602169] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-23T19:31:54.735826] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:31:55.009097] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T19:31:55.142560] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:31:55.152109] [INFO ] [REMOTE ] JBI: Full fetch complete (64631 records). [2025-09-23T19:31:55.152263] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-23T19:31:55.412028] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-23T19:31:55.565431] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-23T19:31:55.565518] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-23T19:31:55.566386] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-23T19:31:55.566453] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-23T19:31:55.567826] [DEBUG] [LOCAL ] JBI: Trimmed 64631 records to 44004 (keeping 200 days of data) [2025-09-23T19:31:55.839221] [DEBUG] [LOCAL ] JBI: Primary data saved (44004 records). [2025-09-23T19:31:55.839364] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-23T19:31:55.839469] [INFO ] [MAIN ] Update Progress: 1145/2372 symbols completed. JBI took 42.1s. Estimated remaining: 2h 42m 45s. Rate: 7.5 symbols/min [2025-09-23T19:31:56.032927] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:56.093189] [DEBUG] [LOCAL ] JCI: Loaded 53548 existing records from primary storage. [2025-09-23T19:31:56.093582] [INFO ] [MAIN ] JCI: Loaded 53548 existing records. [2025-09-23T19:31:56.202331] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-23T19:31:56.208913] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T19:31:56.289342] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:56.289700] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-23T19:31:56.289757] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-23T19:31:56.291401] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-23T19:31:56.291463] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-23T19:31:56.650212] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:57.002182] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-23T19:31:57.609566] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T19:31:57.802193] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-23T19:31:58.051170] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T19:31:58.602228] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-23T19:31:58.705545] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T19:31:59.402213] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-23T19:32:00.088253] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:32:00.202232] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-23T19:32:00.506376] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T19:32:00.517455] [INFO ] [REMOTE ] JBS: Full fetch complete (26371 records). [2025-09-23T19:32:00.517765] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-23T19:32:00.810489] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-23T19:32:00.811124] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:32:00.811300] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:32:00.811382] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-23T19:32:00.811489] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-23T19:32:00.811553] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-23T19:32:00.811805] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-23T19:32:00.812034] [INFO ] [MAIN ] Update Progress: 1146/2372 symbols completed. JBS took 28.8s. Estimated remaining: 2h 42m 34s. Rate: 7.5 symbols/min [2025-09-23T19:32:01.004493] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-23T19:32:01.092209] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:01.092624] [DEBUG] [LOCAL ] JEF: No existing data file found in primary storage. [2025-09-23T19:32:01.092773] [WARN ] [MAIN ] JEF: No existing data found, performing full refresh instead. [2025-09-23T19:32:01.093129] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-23T19:32:01.093254] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-23T19:32:01.093342] [DEBUG] [LOCAL ] JEF: No primary data file found to delete. [2025-09-23T19:32:01.093696] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-23T19:32:01.483810] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:32:01.558298] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:01.660007] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T19:32:01.802200] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-23T19:32:02.602270] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-23T19:32:03.416002] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T19:32:03.415149] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-23T19:32:03.429667] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:32:04.202313] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-23T19:32:04.789463] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T19:32:05.002225] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-23T19:32:05.075745] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T19:32:05.802247] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-23T19:32:06.414428] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T19:32:06.603770] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-23T19:32:06.609928] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T19:32:07.402241] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-23T19:32:07.459961] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T19:32:07.462918] [INFO ] [REMOTE ] JCE: Full fetch complete (9046 records). [2025-09-23T19:32:07.463034] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-23T19:32:07.872680] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-23T19:32:07.873025] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-23T19:32:07.873464] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-23T19:32:07.873511] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-23T19:32:07.874206] [DEBUG] [LOCAL ] JCE: Trimmed 9046 records to 6442 (keeping 200 days of data) [2025-09-23T19:32:07.920077] [DEBUG] [LOCAL ] JCE: Primary data saved (6442 records). [2025-09-23T19:32:07.920267] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-23T19:32:07.920401] [INFO ] [MAIN ] Update Progress: 1147/2372 symbols completed. JCE took 18.3s. Estimated remaining: 2h 42m 25s. Rate: 7.5 symbols/min [2025-09-23T19:32:08.103569] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:08.159384] [DEBUG] [LOCAL ] JELD: Loaded 46169 existing records from primary storage. [2025-09-23T19:32:08.159621] [INFO ] [MAIN ] JELD: Loaded 46169 existing records. [2025-09-23T19:32:08.207398] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-23T19:32:08.353616] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:08.354040] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-23T19:32:08.354096] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-23T19:32:08.355956] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-23T19:32:08.356020] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-23T19:32:08.789191] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:08.871351] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:32:09.002215] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-23T19:32:09.607625] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:32:09.802277] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-23T19:32:10.116846] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T19:32:10.602256] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-23T19:32:11.043983] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:32:11.402231] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-23T19:32:12.178099] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:32:12.202139] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-23T19:32:12.829051] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T19:32:13.002299] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-23T19:32:13.453769] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T19:32:13.802367] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-23T19:32:13.945725] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T19:32:14.614023] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-23T19:32:14.617394] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:32:14.725204] [DEBUG] [REMOTE ] JELD: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-23T19:32:14.725542] [WARN ] [REMOTE ] JELD: No data returned for month 2025-02 [2025-09-23T19:32:15.402240] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-23T19:32:16.202245] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-23T19:32:17.002219] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-23T19:32:17.037813] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:32:17.492796] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:32:17.802218] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-23T19:32:18.602228] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-23T19:32:18.713232] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:32:19.402243] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-23T19:32:19.469822] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:32:19.548725] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T19:32:20.202243] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-23T19:32:21.002274] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-23T19:32:21.094721] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T19:32:21.448965] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:32:21.455108] [INFO ] [REMOTE ] JBTM: Full fetch complete (41795 records). [2025-09-23T19:32:21.455284] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-23T19:32:21.654574] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:32:21.655216] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:32:21.655296] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:32:21.655378] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-23T19:32:21.655452] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-23T19:32:21.655492] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-23T19:32:21.655532] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-23T19:32:21.655628] [INFO ] [MAIN ] Update Progress: 1148/2372 symbols completed. JBTM took 32.6s. Estimated remaining: 2h 42m 23s. Rate: 7.5 symbols/min [2025-09-23T19:32:21.825489] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-23T19:32:21.829452] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:21.842385] [DEBUG] [LOCAL ] JEQ: Loaded 9079 existing records from primary storage. [2025-09-23T19:32:21.842502] [INFO ] [MAIN ] JEQ: Loaded 9079 existing records. [2025-09-23T19:32:22.027079] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:22.027354] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-23T19:32:22.027409] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-23T19:32:22.027865] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-23T19:32:22.027926] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-23T19:32:22.423257] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:22.456530] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:32:22.602200] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-23T19:32:23.204628] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:32:23.227298] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T19:32:23.402268] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-23T19:32:24.202282] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-23T19:32:24.903363] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:32:25.002165] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-23T19:32:25.802210] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-23T19:32:25.956861] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T19:32:26.207850] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T19:32:26.289940] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T19:32:26.602236] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-23T19:32:27.402264] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-23T19:32:28.202239] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-23T19:32:28.334471] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:32:28.900052] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T19:32:28.926144] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:32:29.002147] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-23T19:32:29.802233] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-23T19:32:30.234884] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:32:30.602259] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-23T19:32:31.283751] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T19:32:31.402195] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-23T19:32:31.573788] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:32:32.202203] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-23T19:32:33.002218] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-23T19:32:33.063874] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T19:32:33.572077] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:32:33.802210] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-23T19:32:34.602221] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-23T19:32:34.855954] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T19:32:35.001942] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:32:35.010424] [INFO ] [REMOTE ] JEF: Full fetch complete (72812 records). [2025-09-23T19:32:35.010595] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-23T19:32:35.410410] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-23T19:32:35.434736] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-23T19:32:35.434818] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-23T19:32:35.435770] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-23T19:32:35.435929] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-23T19:32:35.437441] [DEBUG] [LOCAL ] JEF: Trimmed 72812 records to 50003 (keeping 200 days of data) [2025-09-23T19:32:35.760070] [DEBUG] [LOCAL ] JEF: Primary data saved (50003 records). [2025-09-23T19:32:35.760240] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-23T19:32:35.760325] [INFO ] [MAIN ] Update Progress: 1149/2372 symbols completed. JEF took 34.9s. Estimated remaining: 2h 42m 22s. Rate: 7.5 symbols/min [2025-09-23T19:32:35.934079] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:35.963953] [DEBUG] [LOCAL ] JFR: Loaded 30377 existing records from primary storage. [2025-09-23T19:32:35.964103] [INFO ] [MAIN ] JFR: Loaded 30377 existing records. [2025-09-23T19:32:36.165006] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:36.165483] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-23T19:32:36.165552] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-23T19:32:36.166953] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-23T19:32:36.167018] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-23T19:32:36.210028] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-23T19:32:36.323883] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:32:36.377360] [INFO ] [REMOTE ] JELD: Full fetch complete (57769 records). [2025-09-23T19:32:36.395966] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-23T19:32:36.789594] [WARN ] [VALIDATOR ] JELD: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T19:32:36.814266] [FATAL] [MAIN ] JELD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:32:36.812530] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:36.814976] [WARN ] [MAIN ] JELD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:32:36.815228] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-23T19:32:36.815685] [DEBUG] [LOCAL ] JELD: No primary data file found to delete. [2025-09-23T19:32:36.815765] [INFO ] [LOCAL ] JELD: Starting deletion of derivative data. [2025-09-23T19:32:36.824693] [DEBUG] [LOCAL ] JELD: Deleted derivative data file. [2025-09-23T19:32:36.824907] [INFO ] [MAIN ] Update Progress: 1150/2372 symbols completed. JELD took 28.9s. Estimated remaining: 2h 42m 7s. Rate: 7.5 symbols/min [2025-09-23T19:32:36.859042] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T19:32:37.008396] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:37.008509] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-23T19:32:37.052007] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T19:32:37.057356] [DEBUG] [LOCAL ] JGH: Loaded 10943 existing records from primary storage. [2025-09-23T19:32:37.068984] [INFO ] [MAIN ] JGH: Loaded 10943 existing records. [2025-09-23T19:32:37.256988] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:37.257283] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-23T19:32:37.257410] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-23T19:32:37.257915] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-23T19:32:37.257977] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-23T19:32:37.622220] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:37.776924] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:32:37.802191] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-23T19:32:38.400038] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T19:32:38.602203] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-23T19:32:39.402201] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-23T19:32:40.024067] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T19:32:40.105005] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:32:40.113897] [INFO ] [REMOTE ] JCI: Full fetch complete (77409 records). [2025-09-23T19:32:40.114072] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-23T19:32:40.207349] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-23T19:32:40.521759] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-23T19:32:40.521867] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-23T19:32:40.522910] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-23T19:32:40.522979] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-23T19:32:40.524621] [DEBUG] [LOCAL ] JCI: Trimmed 77409 records to 53548 (keeping 200 days of data) [2025-09-23T19:32:40.885797] [DEBUG] [LOCAL ] JCI: Primary data saved (53548 records). [2025-09-23T19:32:40.885995] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-23T19:32:40.886093] [INFO ] [MAIN ] Update Progress: 1151/2372 symbols completed. JCI took 45.0s. Estimated remaining: 2h 41m 55s. Rate: 7.5 symbols/min [2025-09-23T19:32:41.007353] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-23T19:32:41.078459] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:41.086574] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T19:32:41.136119] [DEBUG] [LOCAL ] JHG: Loaded 48043 existing records from primary storage. [2025-09-23T19:32:41.136323] [INFO ] [MAIN ] JHG: Loaded 48043 existing records. [2025-09-23T19:32:41.330780] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:41.331062] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-23T19:32:41.331112] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-23T19:32:41.333242] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-23T19:32:41.333318] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-23T19:32:41.723307] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:41.802174] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-23T19:32:41.993268] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T19:32:42.602260] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-23T19:32:43.393785] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T19:32:43.403345] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-23T19:32:44.096101] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T19:32:44.205590] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-23T19:32:44.208766] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T19:32:45.002192] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-23T19:32:45.684979] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:32:45.802197] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-23T19:32:46.042440] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T19:32:46.515475] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:32:46.517467] [INFO ] [REMOTE ] JEQ: Full fetch complete (11379 records). [2025-09-23T19:32:46.517557] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-23T19:32:46.607519] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-23T19:32:46.919599] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-23T19:32:46.919711] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-23T19:32:46.920027] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-23T19:32:46.920068] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-23T19:32:46.920541] [DEBUG] [LOCAL ] JEQ: Trimmed 11379 records to 9100 (keeping 200 days of data) [2025-09-23T19:32:46.976359] [DEBUG] [LOCAL ] JEQ: Primary data saved (9100 records). [2025-09-23T19:32:46.976526] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-23T19:32:46.976618] [INFO ] [MAIN ] Update Progress: 1152/2372 symbols completed. JEQ took 25.3s. Estimated remaining: 2h 41m 45s. Rate: 7.5 symbols/min [2025-09-23T19:32:47.158006] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:47.164299] [DEBUG] [LOCAL ] JHI: Loaded 3589 existing records from primary storage. [2025-09-23T19:32:47.164418] [INFO ] [MAIN ] JHI: Loaded 3589 existing records. [2025-09-23T19:32:47.343572] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:47.343885] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-23T19:32:47.343932] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-23T19:32:47.344226] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-23T19:32:47.344287] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-23T19:32:47.407298] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-23T19:32:47.738283] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:48.046948] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:32:48.086057] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T19:32:48.202189] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-23T19:32:49.002196] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-23T19:32:49.807463] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-23T19:32:49.822267] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T19:32:50.071204] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T19:32:50.384806] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T19:32:50.602200] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-23T19:32:51.402212] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-23T19:32:51.795778] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T19:32:51.935631] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T19:32:52.202241] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-23T19:32:52.704275] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T19:32:53.002226] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-23T19:32:53.802221] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-23T19:32:54.572181] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T19:32:54.597610] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T19:32:54.602135] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-23T19:32:55.394501] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:32:55.402131] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-23T19:32:55.957009] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T19:32:56.202399] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-23T19:32:57.002227] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-23T19:32:57.637393] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T19:32:57.802200] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-23T19:32:58.602163] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-23T19:32:58.707071] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T19:32:58.919498] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T19:32:59.345203] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:32:59.402195] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-23T19:33:00.188417] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T19:33:00.202214] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-23T19:33:01.002240] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-23T19:33:01.048392] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T19:33:01.387296] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:33:01.802224] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-23T19:33:02.602204] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-23T19:33:03.402260] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-23T19:33:04.202246] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-23T19:33:04.995149] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (3.19 seconds). [2025-09-23T19:33:04.998536] [INFO ] [REMOTE ] JGH: Full fetch complete (14763 records). [2025-09-23T19:33:04.998698] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-23T19:33:05.118116] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T19:33:05.154790] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-23T19:33:05.391921] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-23T19:33:05.392080] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-23T19:33:05.392494] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-23T19:33:05.392557] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-23T19:33:05.393112] [DEBUG] [LOCAL ] JGH: Trimmed 14763 records to 10944 (keeping 200 days of data) [2025-09-23T19:33:05.462960] [DEBUG] [LOCAL ] JGH: Primary data saved (10944 records). [2025-09-23T19:33:05.463169] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-23T19:33:05.463293] [INFO ] [MAIN ] Update Progress: 1153/2372 symbols completed. JGH took 28.6s. Estimated remaining: 2h 41m 48s. Rate: 7.5 symbols/min [2025-09-23T19:33:05.585576] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-09-23T19:33:05.662857] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:05.668549] [DEBUG] [LOCAL ] JHS: Loaded 2890 existing records from primary storage. [2025-09-23T19:33:05.668689] [INFO ] [MAIN ] JHS: Loaded 2890 existing records. [2025-09-23T19:33:05.818595] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-23T19:33:05.850161] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:05.851535] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-23T19:33:05.851613] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-23T19:33:05.851954] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-23T19:33:05.852046] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-23T19:33:05.892757] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:33:05.991267] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-23T19:33:06.259452] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:06.602220] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-23T19:33:07.047328] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T19:33:07.159624] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T19:33:07.402226] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-23T19:33:08.202218] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-23T19:33:08.984441] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T19:33:09.002147] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-23T19:33:09.085059] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T19:33:09.802204] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-23T19:33:10.244306] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T19:33:10.359707] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T19:33:10.602225] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-23T19:33:11.402215] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-23T19:33:11.887018] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T19:33:11.939592] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:33:11.945568] [INFO ] [REMOTE ] JFR: Full fetch complete (47937 records). [2025-09-23T19:33:11.945792] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-23T19:33:12.207338] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-23T19:33:12.334511] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-23T19:33:12.334613] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-23T19:33:12.335414] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-23T19:33:12.335519] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-23T19:33:12.336770] [DEBUG] [LOCAL ] JFR: Trimmed 47937 records to 30403 (keeping 200 days of data) [2025-09-23T19:33:12.524295] [DEBUG] [LOCAL ] JFR: Primary data saved (30403 records). [2025-09-23T19:33:12.524469] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-23T19:33:12.524574] [INFO ] [MAIN ] Update Progress: 1154/2372 symbols completed. JFR took 36.8s. Estimated remaining: 2h 41m 39s. Rate: 7.5 symbols/min [2025-09-23T19:33:12.695955] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:12.744095] [DEBUG] [LOCAL ] JHX: Loaded 49815 existing records from primary storage. [2025-09-23T19:33:12.744268] [INFO ] [MAIN ] JHX: Loaded 49815 existing records. [2025-09-23T19:33:12.915153] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T19:33:12.938888] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:12.939812] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-23T19:33:12.939865] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-23T19:33:12.940959] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-23T19:33:12.941022] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-23T19:33:13.007486] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-23T19:33:13.302126] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:13.802232] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-23T19:33:14.236908] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T19:33:14.602215] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-23T19:33:14.749709] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:33:14.757614] [INFO ] [REMOTE ] JHG: Full fetch complete (68493 records). [2025-09-23T19:33:14.757842] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-23T19:33:15.158504] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-23T19:33:15.158590] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-23T19:33:15.159458] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-23T19:33:15.159520] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-23T19:33:15.160925] [DEBUG] [LOCAL ] JHG: Trimmed 68493 records to 47972 (keeping 200 days of data) [2025-09-23T19:33:15.289326] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T19:33:15.402240] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-23T19:33:15.480875] [DEBUG] [LOCAL ] JHG: Primary data saved (47972 records). [2025-09-23T19:33:15.481044] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-23T19:33:15.481136] [INFO ] [MAIN ] Update Progress: 1155/2372 symbols completed. JHG took 34.6s. Estimated remaining: 2h 41m 26s. Rate: 7.5 symbols/min [2025-09-23T19:33:15.655489] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:15.673499] [DEBUG] [LOCAL ] JILL: Loaded 16727 existing records from primary storage. [2025-09-23T19:33:15.673675] [INFO ] [MAIN ] JILL: Loaded 16727 existing records. [2025-09-23T19:33:15.855298] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:15.855624] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-23T19:33:15.855701] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-23T19:33:15.856199] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-23T19:33:15.856258] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-23T19:33:16.220547] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:16.214503] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-23T19:33:16.320045] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:33:16.703213] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T19:33:17.002212] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-23T19:33:17.620831] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T19:33:17.802236] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-23T19:33:18.602193] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-23T19:33:18.648002] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T19:33:19.402165] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-23T19:33:19.485769] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T19:33:20.173478] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T19:33:20.175081] [INFO ] [REMOTE ] JHI: Full fetch complete (5274 records). [2025-09-23T19:33:20.175156] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-23T19:33:20.207407] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-23T19:33:20.537263] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-23T19:33:20.537376] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-23T19:33:20.537557] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-23T19:33:20.537598] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-23T19:33:20.537997] [DEBUG] [LOCAL ] JHI: Trimmed 5274 records to 3572 (keeping 200 days of data) [2025-09-23T19:33:20.559993] [DEBUG] [LOCAL ] JHI: Primary data saved (3572 records). [2025-09-23T19:33:20.560063] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-23T19:33:20.560132] [INFO ] [MAIN ] Update Progress: 1156/2372 symbols completed. JHI took 33.6s. Estimated remaining: 2h 41m 15s. Rate: 7.5 symbols/min [2025-09-23T19:33:20.726992] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:20.766555] [DEBUG] [LOCAL ] JKS: Loaded 40152 existing records from primary storage. [2025-09-23T19:33:20.766740] [INFO ] [MAIN ] JKS: Loaded 40152 existing records. [2025-09-23T19:33:20.943248] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:20.943468] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-23T19:33:20.943519] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-23T19:33:20.944591] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-23T19:33:20.944680] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-23T19:33:21.007367] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-23T19:33:21.313449] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:21.314711] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:33:21.603684] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T19:33:21.802201] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-23T19:33:22.602171] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-23T19:33:22.684026] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T19:33:23.402194] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-23T19:33:23.826107] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T19:33:24.202195] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-23T19:33:25.002165] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-23T19:33:25.299029] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T19:33:25.628206] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T19:33:25.802185] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-23T19:33:25.846762] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:33:26.601545] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T19:33:26.604440] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-23T19:33:27.139414] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T19:33:27.402193] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-23T19:33:28.202237] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-23T19:33:28.427793] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:33:29.002253] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-23T19:33:29.513733] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:33:29.712786] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T19:33:29.802146] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-23T19:33:30.602259] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-23T19:33:30.635300] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T19:33:31.402204] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-23T19:33:31.929965] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T19:33:31.961058] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T19:33:32.202205] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-23T19:33:32.973940] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T19:33:32.975609] [INFO ] [REMOTE ] JHS: Full fetch complete (4444 records). [2025-09-23T19:33:32.975725] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-23T19:33:33.007493] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-23T19:33:33.355505] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-23T19:33:33.355592] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-23T19:33:33.355763] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-23T19:33:33.355829] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-23T19:33:33.356184] [DEBUG] [LOCAL ] JHS: Trimmed 4444 records to 2865 (keeping 200 days of data) [2025-09-23T19:33:33.373784] [DEBUG] [LOCAL ] JHS: Primary data saved (2865 records). [2025-09-23T19:33:33.373849] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-23T19:33:33.373918] [INFO ] [MAIN ] Update Progress: 1157/2372 symbols completed. JHS took 27.9s. Estimated remaining: 2h 41m 12s. Rate: 7.5 symbols/min [2025-09-23T19:33:33.802198] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-23T19:33:34.602204] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-23T19:33:35.507816] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-23T19:33:35.518932] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-23T19:33:36.052296] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:33:36.153268] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-23T19:33:36.202166] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-23T19:33:36.654639] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T19:33:37.002233] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-23T19:33:37.543745] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T19:33:37.802218] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-23T19:33:38.602200] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-23T19:33:38.637399] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T19:33:38.802876] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T19:33:39.402254] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-23T19:33:39.838410] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:33:40.202262] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-23T19:33:41.002185] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-23T19:33:41.161619] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T19:33:41.233817] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T19:33:41.802286] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-23T19:33:42.392550] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T19:33:42.602195] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-23T19:33:43.402157] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-23T19:33:43.731256] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:33:43.740274] [INFO ] [REMOTE ] JHX: Full fetch complete (56695 records). [2025-09-23T19:33:43.740436] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-23T19:33:44.155064] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-23T19:33:44.155574] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-23T19:33:44.156799] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-23T19:33:44.156983] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-23T19:33:44.168758] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T19:33:44.173220] [INFO ] [REMOTE ] JILL: Full fetch complete (23104 records). [2025-09-23T19:33:44.173484] [DEBUG] [LOCAL ] JHX: Trimmed 56695 records to 50123 (keeping 200 days of data) [2025-09-23T19:33:44.173810] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-23T19:33:44.208536] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T19:33:44.394496] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-23T19:33:44.844820] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-23T19:33:44.845532] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-23T19:33:44.846851] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-23T19:33:44.847798] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-23T19:33:44.853001] [DEBUG] [LOCAL ] JILL: Trimmed 23104 records to 16755 (keeping 200 days of data) [2025-09-23T19:33:45.020357] [DEBUG] [LOCAL ] JILL: Primary data saved (16755 records). [2025-09-23T19:33:45.021048] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-23T19:33:45.021445] [INFO ] [MAIN ] Update Progress: 1158/2372 symbols completed. JILL took 29.5s. Estimated remaining: 2h 41m 8s. Rate: 7.5 symbols/min [2025-09-23T19:33:45.035001] [DEBUG] [LOCAL ] JHX: Primary data saved (50123 records). [2025-09-23T19:33:45.035156] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-23T19:33:45.035263] [INFO ] [MAIN ] Update Progress: 1159/2372 symbols completed. JHX took 32.5s. Estimated remaining: 2h 40m 51s. Rate: 7.5 symbols/min [2025-09-23T19:33:46.233701] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T19:33:46.243001] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-23T19:33:47.867883] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T19:33:47.874532] [INFO ] [REMOTE ] JKS: Full fetch complete (59489 records). [2025-09-23T19:33:47.874701] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-23T19:33:48.271774] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-23T19:33:48.271933] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-23T19:33:48.272823] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-23T19:33:48.272916] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-23T19:33:48.277082] [DEBUG] [LOCAL ] JKS: Trimmed 59489 records to 40129 (keeping 200 days of data) [2025-09-23T19:33:48.529738] [DEBUG] [LOCAL ] JKS: Primary data saved (40129 records). [2025-09-23T19:33:48.529876] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-23T19:33:48.530105] [INFO ] [MAIN ] Update Progress: 1160/2372 symbols completed. JKS took 28.0s. Estimated remaining: 2h 40m 39s. Rate: 7.5 symbols/min [2025-09-23T19:33:49.403308] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:49.396758] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:49.428781] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:49.474027] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:49.474620] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-23T19:33:49.474733] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-23T19:33:49.475212] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-23T19:33:49.478093] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-23T19:33:49.484237] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-23T19:33:49.483911] [DEBUG] [LOCAL ] JLS: Loaded 4074 existing records from primary storage. [2025-09-23T19:33:49.484418] [INFO ] [MAIN ] JLS: Loaded 4074 existing records. [2025-09-23T19:33:49.484537] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-23T19:33:49.879935] [DEBUG] [LOCAL ] JLL: Loaded 32228 existing records from primary storage. [2025-09-23T19:33:49.938356] [INFO ] [MAIN ] JLL: Loaded 32228 existing records. [2025-09-23T19:33:49.938193] [DEBUG] [LOCAL ] JMIA: Loaded 50473 existing records from primary storage. [2025-09-23T19:33:50.003049] [INFO ] [MAIN ] JMIA: Loaded 50473 existing records. [2025-09-23T19:33:50.201569] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:50.348490] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-23T19:33:50.422191] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-23T19:33:50.509268] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-23T19:33:50.509419] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-23T19:33:50.498852] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:50.639761] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-23T19:33:50.639316] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:50.703025] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-23T19:33:50.708405] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-23T19:33:50.708245] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:50.726463] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-23T19:33:50.726970] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-23T19:33:50.774152] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-23T19:33:50.795466] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-23T19:33:50.834681] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-23T19:33:50.856795] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-23T19:33:51.424021] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T19:33:51.433560] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-23T19:33:51.696607] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:51.738062] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:51.752166] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-23T19:33:51.743602] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-23T19:33:51.898279] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:51.898717] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-23T19:33:52.005869] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T19:33:52.007001] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-23T19:33:52.441912] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T19:33:52.443011] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-23T19:33:52.576696] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T19:33:52.578237] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-23T19:33:52.706049] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-23T19:33:52.707151] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-23T19:33:53.137997] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T19:33:53.139375] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-23T19:33:53.146045] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T19:33:53.383322] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T19:33:53.619625] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T19:33:53.802185] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-23T19:33:53.940972] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T19:33:54.253346] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:33:54.602202] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-23T19:33:55.402203] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-23T19:33:55.869120] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T19:33:55.887625] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T19:33:56.202196] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-23T19:33:57.002180] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-23T19:33:57.440446] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T19:33:57.440296] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:33:57.802185] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-23T19:33:58.243552] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T19:33:58.602196] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-23T19:33:59.402189] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-23T19:33:59.978335] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T19:34:00.202166] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-23T19:34:00.244717] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T19:34:01.002201] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-23T19:34:01.575536] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T19:34:01.802204] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-23T19:34:02.266632] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T19:34:02.602232] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-23T19:34:02.900019] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T19:34:03.402208] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-23T19:34:04.094747] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T19:34:04.202230] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-23T19:34:05.002217] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-23T19:34:05.140995] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T19:34:05.176306] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T19:34:05.350628] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T19:34:05.802288] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-23T19:34:06.602255] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-23T19:34:06.953142] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T19:34:07.142893] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T19:34:07.402214] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-23T19:34:08.202209] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-23T19:34:08.628477] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:34:08.797323] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T19:34:09.002229] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-23T19:34:09.802202] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-23T19:34:10.364765] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-23T19:34:10.602172] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-23T19:34:10.892681] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T19:34:11.043163] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T19:34:11.044081] [INFO ] [REMOTE ] JMM: Full fetch complete (2287 records). [2025-09-23T19:34:11.044168] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-23T19:34:11.227994] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-23T19:34:11.228523] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:34:11.228610] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:34:11.228702] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-23T19:34:11.228793] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-23T19:34:11.228853] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-23T19:34:11.228911] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-23T19:34:11.229046] [INFO ] [MAIN ] Update Progress: 1161/2372 symbols completed. JMM took 22.7s. Estimated remaining: 2h 40m 46s. Rate: 7.5 symbols/min [2025-09-23T19:34:11.398349] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:11.402168] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-23T19:34:11.474607] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-23T19:34:11.474815] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-09-23T19:34:11.651925] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:11.652178] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-23T19:34:11.652226] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-23T19:34:11.654012] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-23T19:34:11.654073] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-23T19:34:12.025210] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:12.061600] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T19:34:12.063306] [INFO ] [REMOTE ] JLS: Full fetch complete (5781 records). [2025-09-23T19:34:12.063417] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-23T19:34:12.207311] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-23T19:34:12.428876] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-23T19:34:12.428974] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-23T19:34:12.429163] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-23T19:34:12.429201] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-23T19:34:12.429877] [DEBUG] [LOCAL ] JLS: Trimmed 5781 records to 4092 (keeping 200 days of data) [2025-09-23T19:34:12.456825] [DEBUG] [LOCAL ] JLS: Primary data saved (4092 records). [2025-09-23T19:34:12.456979] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-23T19:34:12.457114] [INFO ] [MAIN ] Update Progress: 1162/2372 symbols completed. JLS took 23.9s. Estimated remaining: 2h 40m 31s. Rate: 7.5 symbols/min [2025-09-23T19:34:12.627082] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:12.697794] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-23T19:34:12.697981] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-09-23T19:34:12.874578] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:12.874894] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-23T19:34:12.874960] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-23T19:34:12.876485] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-23T19:34:12.876546] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-23T19:34:13.014015] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-23T19:34:13.238590] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:13.802205] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-23T19:34:14.602187] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-23T19:34:14.733900] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-23T19:34:14.787991] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:34:15.402263] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-23T19:34:16.016995] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:34:16.180550] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-23T19:34:16.202140] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-23T19:34:16.749250] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T19:34:17.002171] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-23T19:34:17.802189] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-23T19:34:18.442358] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-23T19:34:18.552036] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T19:34:18.602149] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-23T19:34:19.402195] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-23T19:34:20.202183] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-23T19:34:20.325200] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-23T19:34:20.514276] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T19:34:20.523994] [INFO ] [REMOTE ] JMIA: Full fetch complete (73261 records). [2025-09-23T19:34:20.524201] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-23T19:34:20.939169] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-23T19:34:20.939318] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-23T19:34:20.940611] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-23T19:34:20.940712] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-23T19:34:20.942400] [DEBUG] [LOCAL ] JMIA: Trimmed 73261 records to 50490 (keeping 200 days of data) [2025-09-23T19:34:21.003993] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-23T19:34:21.262981] [DEBUG] [LOCAL ] JMIA: Primary data saved (50490 records). [2025-09-23T19:34:21.263156] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-23T19:34:21.263268] [INFO ] [MAIN ] Update Progress: 1163/2372 symbols completed. JMIA took 32.7s. Estimated remaining: 2h 40m 24s. Rate: 7.5 symbols/min [2025-09-23T19:34:21.442415] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:21.467595] [DEBUG] [LOCAL ] JOE: Loaded 24699 existing records from primary storage. [2025-09-23T19:34:21.467818] [INFO ] [MAIN ] JOE: Loaded 24699 existing records. [2025-09-23T19:34:21.670432] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:21.670992] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-23T19:34:21.671165] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-23T19:34:21.680884] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-23T19:34:21.695105] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-23T19:34:21.784497] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-23T19:34:21.829734] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-23T19:34:22.083744] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:22.354836] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:34:22.360696] [INFO ] [REMOTE ] JLL: Full fetch complete (44795 records). [2025-09-23T19:34:22.360818] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-23T19:34:22.607503] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-23T19:34:22.806614] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-23T19:34:22.806930] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-23T19:34:22.808248] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-23T19:34:22.809517] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-23T19:34:22.809421] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-09-23T19:34:22.821130] [DEBUG] [LOCAL ] JLL: Trimmed 44795 records to 32090 (keeping 200 days of data) [2025-09-23T19:34:23.020282] [DEBUG] [LOCAL ] JLL: Primary data saved (32090 records). [2025-09-23T19:34:23.020432] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-23T19:34:23.020533] [INFO ] [MAIN ] Update Progress: 1164/2372 symbols completed. JLL took 34.5s. Estimated remaining: 2h 40m 10s. Rate: 7.5 symbols/min [2025-09-23T19:34:23.189270] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:23.198125] [DEBUG] [LOCAL ] JOF: Loaded 7137 existing records from primary storage. [2025-09-23T19:34:23.198243] [INFO ] [MAIN ] JOF: Loaded 7137 existing records. [2025-09-23T19:34:23.390619] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:23.390902] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-23T19:34:23.390951] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-23T19:34:23.391508] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-23T19:34:23.391569] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-23T19:34:23.424520] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-23T19:34:23.792697] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:23.918911] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-23T19:34:23.979923] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T19:34:24.202261] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-23T19:34:25.002192] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-23T19:34:25.046368] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T19:34:25.449613] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T19:34:25.802393] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-23T19:34:26.040581] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T19:34:26.121353] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-23T19:34:26.602245] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-23T19:34:27.180686] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T19:34:27.402196] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-23T19:34:28.202167] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-23T19:34:28.483112] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:34:29.002240] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-23T19:34:29.802219] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-23T19:34:30.076042] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:34:30.411031] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-23T19:34:30.602209] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-23T19:34:31.402212] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-23T19:34:31.421849] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:34:31.820825] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T19:34:32.202194] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-23T19:34:33.002196] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-23T19:34:33.435165] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:34:33.801418] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-23T19:34:33.811733] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-23T19:34:34.602183] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-23T19:34:34.639160] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T19:34:35.402160] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-23T19:34:35.529855] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-23T19:34:36.183304] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T19:34:36.202148] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-23T19:34:36.480011] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T19:34:37.002226] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-23T19:34:37.296941] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T19:34:37.802236] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-23T19:34:38.448372] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T19:34:38.602167] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-23T19:34:39.402173] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-23T19:34:39.462957] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-23T19:34:39.783420] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T19:34:40.202154] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-23T19:34:40.373979] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:34:40.705021] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T19:34:41.002205] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-23T19:34:41.811207] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-23T19:34:41.818094] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T19:34:42.580894] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T19:34:42.602243] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-23T19:34:43.402171] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-23T19:34:43.776300] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:34:44.202247] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-23T19:34:44.363360] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T19:34:44.365591] [INFO ] [REMOTE ] JOF: Full fetch complete (9525 records). [2025-09-23T19:34:44.365753] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-23T19:34:44.743985] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-23T19:34:44.744076] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-23T19:34:44.744299] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-23T19:34:44.744337] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-23T19:34:44.744823] [DEBUG] [LOCAL ] JOF: Trimmed 9525 records to 7131 (keeping 200 days of data) [2025-09-23T19:34:44.788217] [DEBUG] [LOCAL ] JOF: Primary data saved (7131 records). [2025-09-23T19:34:44.788344] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-23T19:34:44.788425] [INFO ] [MAIN ] Update Progress: 1165/2372 symbols completed. JOF took 21.8s. Estimated remaining: 2h 40m 16s. Rate: 7.5 symbols/min [2025-09-23T19:34:44.956563] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:44.995040] [DEBUG] [LOCAL ] JPC: Loaded 37152 existing records from primary storage. [2025-09-23T19:34:44.995200] [INFO ] [MAIN ] JPC: Loaded 37152 existing records. [2025-09-23T19:34:45.007983] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-23T19:34:45.178865] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:45.179137] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-23T19:34:45.179194] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-23T19:34:45.180270] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-23T19:34:45.180331] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-23T19:34:45.533215] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:45.802202] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-23T19:34:46.602247] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-23T19:34:47.101746] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T19:34:47.106245] [INFO ] [REMOTE ] JOE: Full fetch complete (36396 records). [2025-09-23T19:34:47.106338] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-23T19:34:47.522265] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-23T19:34:47.523089] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-23T19:34:47.525108] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-23T19:34:47.524373] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-09-23T19:34:47.525233] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-23T19:34:47.538661] [DEBUG] [LOCAL ] JOE: Trimmed 36396 records to 24662 (keeping 200 days of data) [2025-09-23T19:34:47.538526] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-23T19:34:47.665554] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-23T19:34:47.743373] [DEBUG] [LOCAL ] JOE: Primary data saved (24662 records). [2025-09-23T19:34:47.743526] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-23T19:34:47.743614] [INFO ] [MAIN ] Update Progress: 1166/2372 symbols completed. JOE took 26.5s. Estimated remaining: 2h 40m 3s. Rate: 7.5 symbols/min [2025-09-23T19:34:47.909402] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:47.966169] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-23T19:34:47.966326] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-09-23T19:34:48.144197] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:48.144464] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-23T19:34:48.144512] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-23T19:34:48.146365] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-23T19:34:48.146426] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-23T19:34:48.213906] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-23T19:34:48.511043] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:48.551105] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T19:34:49.002216] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-23T19:34:49.802274] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-23T19:34:50.008979] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-23T19:34:50.095764] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T19:34:50.602197] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-23T19:34:50.919843] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T19:34:51.334233] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-23T19:34:51.402143] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-23T19:34:52.202281] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-23T19:34:53.002203] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-23T19:34:53.190877] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-23T19:34:53.200443] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-23T19:34:53.200624] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-23T19:34:53.414558] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:34:53.664543] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-23T19:34:53.664845] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-23T19:34:53.665916] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-23T19:34:53.665981] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-23T19:34:53.708193] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-09-23T19:34:53.729292] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-23T19:34:53.819118] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-23T19:34:54.060420] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-09-23T19:34:54.060587] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-23T19:34:54.060701] [INFO ] [MAIN ] Update Progress: 1167/2372 symbols completed. JOBY took 41.6s. Estimated remaining: 2h 39m 53s. Rate: 7.5 symbols/min [2025-09-23T19:34:54.233465] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:54.269401] [DEBUG] [LOCAL ] JQC: Loaded 33859 existing records from primary storage. [2025-09-23T19:34:54.269605] [INFO ] [MAIN ] JQC: Loaded 33859 existing records. [2025-09-23T19:34:54.470986] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:54.471325] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-23T19:34:54.471383] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-23T19:34:54.473074] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-23T19:34:54.473149] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-23T19:34:54.607335] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-23T19:34:54.846531] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:55.260546] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-23T19:34:55.273380] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-23T19:34:55.273686] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-23T19:34:55.407273] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-23T19:34:55.726407] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-23T19:34:55.726768] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-23T19:34:55.728775] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-23T19:34:55.729069] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-23T19:34:55.732829] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-09-23T19:34:55.855973] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T19:34:55.907213] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-23T19:34:56.196325] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-23T19:34:56.196536] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-23T19:34:56.198300] [INFO ] [MAIN ] Update Progress: 1168/2372 symbols completed. JNJ took 45.0s. Estimated remaining: 2h 39m 39s. Rate: 7.5 symbols/min [2025-09-23T19:34:56.209979] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-23T19:34:56.379682] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:56.402069] [DEBUG] [LOCAL ] JRI: Loaded 15004 existing records from primary storage. [2025-09-23T19:34:56.402287] [INFO ] [MAIN ] JRI: Loaded 15004 existing records. [2025-09-23T19:34:56.598308] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:56.599128] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-23T19:34:56.599276] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-23T19:34:56.606207] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-23T19:34:56.616604] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-23T19:34:56.623293] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T19:34:57.006228] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-23T19:34:57.011142] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:57.802203] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-23T19:34:58.486765] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T19:34:58.602188] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-23T19:34:58.747501] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-23T19:34:58.783693] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T19:34:59.402194] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-23T19:35:00.090961] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T19:35:00.202217] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-23T19:35:01.002301] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-23T19:35:01.577438] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T19:35:01.773901] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-23T19:35:01.802318] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-23T19:35:01.903007] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T19:35:02.602219] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-23T19:35:03.402181] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-23T19:35:04.001595] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:35:04.140499] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-23T19:35:04.152409] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T19:35:04.202192] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-23T19:35:05.002163] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-23T19:35:05.238421] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T19:35:05.802215] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-23T19:35:06.212252] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T19:35:06.602202] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-23T19:35:07.324589] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T19:35:07.402226] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-23T19:35:08.202215] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-23T19:35:08.837064] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-23T19:35:09.002184] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-23T19:35:09.156287] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T19:35:09.254196] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T19:35:09.261177] [INFO ] [REMOTE ] JPC: Full fetch complete (55736 records). [2025-09-23T19:35:09.261372] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-23T19:35:09.660822] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-23T19:35:09.660916] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-23T19:35:09.661712] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-23T19:35:09.661777] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-23T19:35:09.663058] [DEBUG] [LOCAL ] JPC: Trimmed 55736 records to 37051 (keeping 200 days of data) [2025-09-23T19:35:09.823279] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-23T19:35:09.885751] [DEBUG] [LOCAL ] JPC: Primary data saved (37051 records). [2025-09-23T19:35:09.885935] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-23T19:35:09.886036] [INFO ] [MAIN ] Update Progress: 1169/2372 symbols completed. JPC took 25.1s. Estimated remaining: 2h 39m 37s. Rate: 7.5 symbols/min [2025-09-23T19:35:10.088547] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:10.100698] [DEBUG] [LOCAL ] JRS: Loaded 11083 existing records from primary storage. [2025-09-23T19:35:10.100846] [INFO ] [MAIN ] JRS: Loaded 11083 existing records. [2025-09-23T19:35:10.289535] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:10.290177] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-23T19:35:10.290288] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-23T19:35:10.290909] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-23T19:35:10.290975] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-23T19:35:10.468421] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T19:35:10.604423] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-23T19:35:10.709874] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:10.810548] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T19:35:11.402205] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-23T19:35:12.202260] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-23T19:35:12.889888] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T19:35:13.002213] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-23T19:35:13.203610] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-23T19:35:13.227988] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T19:35:13.802171] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-23T19:35:13.914675] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T19:35:14.355699] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T19:35:14.602202] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-23T19:35:15.376851] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:35:15.402207] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-23T19:35:16.202199] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-23T19:35:16.240295] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T19:35:17.002204] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-23T19:35:17.802249] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-23T19:35:18.301733] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T19:35:18.434784] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-23T19:35:18.572368] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T19:35:18.602178] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-23T19:35:19.402232] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-23T19:35:20.202186] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-23T19:35:20.443270] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:35:20.686135] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T19:35:20.696256] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-23T19:35:20.696440] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-23T19:35:21.004040] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-23T19:35:21.107240] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-23T19:35:21.107345] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-23T19:35:21.108451] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-23T19:35:21.108544] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-23T19:35:21.110235] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-09-23T19:35:21.484835] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-23T19:35:21.485576] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-23T19:35:21.486579] [INFO ] [MAIN ] Update Progress: 1170/2372 symbols completed. JPM took 33.7s. Estimated remaining: 2h 39m 33s. Rate: 7.5 symbols/min [2025-09-23T19:35:21.486392] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T19:35:21.683778] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T19:35:21.685778] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:21.735692] [DEBUG] [LOCAL ] JXN: Loaded 46037 existing records from primary storage. [2025-09-23T19:35:21.735868] [INFO ] [MAIN ] JXN: Loaded 46037 existing records. [2025-09-23T19:35:21.807399] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-23T19:35:21.933057] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:21.933323] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-23T19:35:21.933374] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-23T19:35:21.934855] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-23T19:35:21.934961] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-23T19:35:22.315995] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:22.602219] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-23T19:35:22.979766] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T19:35:22.983525] [INFO ] [REMOTE ] JRI: Full fetch complete (23155 records). [2025-09-23T19:35:22.983665] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-23T19:35:23.382765] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-23T19:35:23.382856] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-23T19:35:23.383398] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-23T19:35:23.383440] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-23T19:35:23.384270] [DEBUG] [LOCAL ] JRI: Trimmed 23155 records to 14888 (keeping 200 days of data) [2025-09-23T19:35:23.436049] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-23T19:35:23.492691] [DEBUG] [LOCAL ] JRI: Primary data saved (14888 records). [2025-09-23T19:35:23.492865] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-23T19:35:23.492957] [INFO ] [MAIN ] Update Progress: 1171/2372 symbols completed. JRI took 27.3s. Estimated remaining: 2h 39m 19s. Rate: 7.5 symbols/min [2025-09-23T19:35:23.666516] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:23.714345] [DEBUG] [LOCAL ] K: Loaded 49811 existing records from primary storage. [2025-09-23T19:35:23.714497] [INFO ] [MAIN ] K: Loaded 49811 existing records. [2025-09-23T19:35:23.926999] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:23.927424] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-23T19:35:23.927505] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-23T19:35:23.929115] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-23T19:35:23.929201] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-23T19:35:24.205697] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-23T19:35:24.318816] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:24.348058] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T19:35:24.349399] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T19:35:25.002211] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-23T19:35:25.525443] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:35:25.796986] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T19:35:25.802144] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-23T19:35:26.599635] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T19:35:26.602592] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-23T19:35:27.402215] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-23T19:35:28.004990] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T19:35:28.202248] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-23T19:35:28.969402] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T19:35:29.003639] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-23T19:35:29.006569] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:35:29.802258] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-23T19:35:30.602218] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-23T19:35:30.912804] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T19:35:31.005638] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:35:31.402163] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-23T19:35:31.441714] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T19:35:32.202229] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-23T19:35:33.002165] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-23T19:35:33.165812] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T19:35:33.183472] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T19:35:33.185991] [INFO ] [REMOTE ] JRS: Full fetch complete (16074 records). [2025-09-23T19:35:33.186075] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-23T19:35:33.550443] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-23T19:35:33.550540] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-23T19:35:33.550918] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-23T19:35:33.550980] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-23T19:35:33.551522] [DEBUG] [LOCAL ] JRS: Trimmed 16074 records to 11097 (keeping 200 days of data) [2025-09-23T19:35:33.617093] [DEBUG] [LOCAL ] JRS: Primary data saved (11097 records). [2025-09-23T19:35:33.617243] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-23T19:35:33.617331] [INFO ] [MAIN ] Update Progress: 1172/2372 symbols completed. JRS took 23.7s. Estimated remaining: 2h 39m 13s. Rate: 7.5 symbols/min [2025-09-23T19:35:33.785891] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:33.800716] [DEBUG] [LOCAL ] KAI: Loaded 13617 existing records from primary storage. [2025-09-23T19:35:33.800845] [INFO ] [MAIN ] KAI: Loaded 13617 existing records. [2025-09-23T19:35:33.812121] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-23T19:35:33.982813] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:33.983275] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-23T19:35:33.983330] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-23T19:35:33.983970] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-23T19:35:33.984032] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-23T19:35:34.353214] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:34.370578] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:35:34.377599] [INFO ] [REMOTE ] JQC: Full fetch complete (48482 records). [2025-09-23T19:35:34.377831] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-23T19:35:34.610939] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-23T19:35:34.769568] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-23T19:35:34.769683] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-23T19:35:34.770404] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-23T19:35:34.770448] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-23T19:35:34.771514] [DEBUG] [LOCAL ] JQC: Trimmed 48482 records to 33665 (keeping 200 days of data) [2025-09-23T19:35:34.975414] [DEBUG] [LOCAL ] JQC: Primary data saved (33665 records). [2025-09-23T19:35:34.975565] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-23T19:35:34.975672] [INFO ] [MAIN ] Update Progress: 1173/2372 symbols completed. JQC took 40.9s. Estimated remaining: 2h 38m 59s. Rate: 7.5 symbols/min [2025-09-23T19:35:35.148945] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:35.188685] [DEBUG] [LOCAL ] KAR: Loaded 39949 existing records from primary storage. [2025-09-23T19:35:35.188836] [INFO ] [MAIN ] KAR: Loaded 39949 existing records. [2025-09-23T19:35:35.372677] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:35.397089] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-23T19:35:35.397196] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-23T19:35:35.402063] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T19:35:35.402255] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-23T19:35:35.402141] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-23T19:35:35.402702] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-23T19:35:35.767435] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:36.077674] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:35:36.202220] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-23T19:35:36.232196] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T19:35:37.002197] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-23T19:35:37.802175] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-23T19:35:37.846364] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:35:38.124954] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T19:35:38.602233] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-23T19:35:38.644710] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T19:35:39.402206] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-23T19:35:40.108013] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T19:35:40.202195] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-23T19:35:40.746064] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T19:35:41.002225] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-23T19:35:41.731384] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T19:35:41.775524] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:35:41.802177] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-23T19:35:42.602233] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-23T19:35:42.796394] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T19:35:43.402215] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-23T19:35:44.202167] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-23T19:35:44.292401] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T19:35:44.347467] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T19:35:45.002222] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-23T19:35:45.730994] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:35:45.772918] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:35:45.802150] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-23T19:35:46.602247] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-23T19:35:47.402216] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-23T19:35:47.535274] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:35:47.548312] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T19:35:48.202195] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-23T19:35:48.904241] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:35:48.912514] [INFO ] [REMOTE ] JXN: Full fetch complete (65342 records). [2025-09-23T19:35:48.912716] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-23T19:35:49.007269] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-23T19:35:49.316109] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-23T19:35:49.316254] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-23T19:35:49.317226] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-23T19:35:49.317300] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-23T19:35:49.318927] [DEBUG] [LOCAL ] JXN: Trimmed 65342 records to 46012 (keeping 200 days of data) [2025-09-23T19:35:49.612158] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T19:35:49.669519] [DEBUG] [LOCAL ] JXN: Primary data saved (46012 records). [2025-09-23T19:35:49.669687] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-23T19:35:49.669787] [INFO ] [MAIN ] Update Progress: 1174/2372 symbols completed. JXN took 28.2s. Estimated remaining: 2h 38m 58s. Rate: 7.5 symbols/min [2025-09-23T19:35:49.811858] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-23T19:35:49.845888] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:49.869201] [DEBUG] [LOCAL ] KB: Loaded 24236 existing records from primary storage. [2025-09-23T19:35:49.869363] [INFO ] [MAIN ] KB: Loaded 24236 existing records. [2025-09-23T19:35:50.073261] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:50.073879] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-23T19:35:50.073968] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-23T19:35:50.074668] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-23T19:35:50.074731] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-23T19:35:50.445893] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:50.466847] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T19:35:50.602198] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-23T19:35:51.404771] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-23T19:35:51.410866] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T19:35:51.457154] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T19:35:52.202241] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-23T19:35:52.826152] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T19:35:53.002195] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-23T19:35:53.245999] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:35:53.802275] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-23T19:35:54.396519] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:35:54.602181] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-23T19:35:54.644283] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T19:35:54.646798] [INFO ] [REMOTE ] KAI: Full fetch complete (18789 records). [2025-09-23T19:35:54.646880] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-23T19:35:55.059331] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-23T19:35:55.059441] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-23T19:35:55.059863] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-23T19:35:55.059924] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-23T19:35:55.060471] [DEBUG] [LOCAL ] KAI: Trimmed 18789 records to 13631 (keeping 200 days of data) [2025-09-23T19:35:55.147236] [DEBUG] [LOCAL ] KAI: Primary data saved (13631 records). [2025-09-23T19:35:55.147395] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-23T19:35:55.147482] [INFO ] [MAIN ] Update Progress: 1175/2372 symbols completed. KAI took 21.5s. Estimated remaining: 2h 38m 47s. Rate: 7.5 symbols/min [2025-09-23T19:35:55.319678] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:55.345227] [DEBUG] [LOCAL ] KBDC: Loaded 20592 existing records from primary storage. [2025-09-23T19:35:55.345394] [INFO ] [MAIN ] KBDC: Loaded 20592 existing records. [2025-09-23T19:35:55.410487] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-23T19:35:55.529355] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:55.529627] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-23T19:35:55.529711] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-23T19:35:55.530424] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-23T19:35:55.530487] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-23T19:35:55.910048] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:56.044193] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T19:35:56.179964] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:35:56.202172] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-23T19:35:57.002191] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-23T19:35:57.802197] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-23T19:35:58.046442] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T19:35:58.082287] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:35:58.602243] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-23T19:35:58.902782] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T19:35:59.334909] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T19:35:59.402225] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-23T19:36:00.202230] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-23T19:36:00.834701] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T19:36:01.002204] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-23T19:36:01.802198] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-23T19:36:02.602232] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-23T19:36:02.897445] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T19:36:02.907522] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-23T19:36:03.402191] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-23T19:36:03.883847] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T19:36:04.202248] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-23T19:36:05.002568] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-23T19:36:05.056060] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (3.25 seconds). [2025-09-23T19:36:05.700392] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-23T19:36:05.725145] [INFO ] [REMOTE ] K: Full fetch complete (71833 records). [2025-09-23T19:36:05.725553] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-23T19:36:05.809034] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-23T19:36:06.059975] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T19:36:06.137452] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T19:36:06.214193] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-23T19:36:06.214280] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-23T19:36:06.215217] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-23T19:36:06.215343] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-23T19:36:06.217238] [DEBUG] [LOCAL ] K: Trimmed 71833 records to 49850 (keeping 200 days of data) [2025-09-23T19:36:06.555131] [DEBUG] [LOCAL ] K: Primary data saved (49850 records). [2025-09-23T19:36:06.555360] [INFO ] [MAIN ] K: Full history saved. [2025-09-23T19:36:06.555793] [INFO ] [MAIN ] Update Progress: 1176/2372 symbols completed. K took 43.1s. Estimated remaining: 2h 38m 43s. Rate: 7.5 symbols/min [2025-09-23T19:36:06.613710] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-23T19:36:06.736179] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:06.792408] [DEBUG] [LOCAL ] KBH: Loaded 48917 existing records from primary storage. [2025-09-23T19:36:06.792581] [INFO ] [MAIN ] KBH: Loaded 48917 existing records. [2025-09-23T19:36:06.978705] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:06.979315] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-23T19:36:06.979373] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-23T19:36:06.981424] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-23T19:36:06.981506] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-23T19:36:07.167134] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:36:07.375158] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:07.402158] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-23T19:36:08.147547] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T19:36:08.202188] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-23T19:36:08.686515] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T19:36:09.002249] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-23T19:36:09.702879] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:36:09.802183] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-23T19:36:10.105441] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:36:10.602192] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-23T19:36:11.029778] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:36:11.036819] [INFO ] [REMOTE ] KAR: Full fetch complete (56648 records). [2025-09-23T19:36:11.036952] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-23T19:36:11.403877] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-23T19:36:11.422469] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-23T19:36:11.422636] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-23T19:36:11.423520] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-23T19:36:11.423791] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-23T19:36:11.425348] [DEBUG] [LOCAL ] KAR: Trimmed 56648 records to 39918 (keeping 200 days of data) [2025-09-23T19:36:11.539162] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T19:36:11.694812] [DEBUG] [LOCAL ] KAR: Primary data saved (39918 records). [2025-09-23T19:36:11.695008] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-23T19:36:11.695122] [INFO ] [MAIN ] Update Progress: 1177/2372 symbols completed. KAR took 36.7s. Estimated remaining: 2h 38m 32s. Rate: 7.5 symbols/min [2025-09-23T19:36:11.866251] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:11.913103] [DEBUG] [LOCAL ] KBR: Loaded 48204 existing records from primary storage. [2025-09-23T19:36:11.913282] [INFO ] [MAIN ] KBR: Loaded 48204 existing records. [2025-09-23T19:36:12.086622] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:12.086971] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-23T19:36:12.087031] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-23T19:36:12.088324] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-23T19:36:12.088384] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-23T19:36:12.207285] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-23T19:36:12.452024] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:13.002164] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-23T19:36:13.184384] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:36:13.246028] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:36:13.802198] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-23T19:36:14.602274] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-23T19:36:14.732709] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T19:36:14.826515] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T19:36:15.402255] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-23T19:36:15.764166] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T19:36:16.175051] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:36:16.202165] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-23T19:36:16.939330] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:36:17.002212] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-23T19:36:17.802240] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-23T19:36:18.602202] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-23T19:36:19.402190] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-23T19:36:19.533872] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-23T19:36:20.062557] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-23T19:36:20.098413] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T19:36:20.202700] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T19:36:20.202170] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-23T19:36:20.207356] [INFO ] [REMOTE ] KB: Full fetch complete (34700 records). [2025-09-23T19:36:20.207489] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-23T19:36:20.587990] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-23T19:36:20.588109] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-23T19:36:20.588758] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-23T19:36:20.588824] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-23T19:36:20.589934] [DEBUG] [LOCAL ] KB: Trimmed 34700 records to 24164 (keeping 200 days of data) [2025-09-23T19:36:20.748820] [DEBUG] [LOCAL ] KB: Primary data saved (24164 records). [2025-09-23T19:36:20.748978] [INFO ] [MAIN ] KB: Full history saved. [2025-09-23T19:36:20.749083] [INFO ] [MAIN ] Update Progress: 1178/2372 symbols completed. KB took 31.1s. Estimated remaining: 2h 38m 25s. Rate: 7.5 symbols/min [2025-09-23T19:36:20.918667] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:20.980417] [DEBUG] [LOCAL ] KD: Loaded 52291 existing records from primary storage. [2025-09-23T19:36:20.980712] [INFO ] [MAIN ] KD: Loaded 52291 existing records. [2025-09-23T19:36:21.013782] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-23T19:36:21.174678] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:21.175016] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-23T19:36:21.175074] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-23T19:36:21.176200] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-23T19:36:21.176265] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-23T19:36:21.538713] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:21.802267] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-23T19:36:21.923283] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T19:36:22.610884] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-23T19:36:22.617461] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T19:36:23.402211] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-23T19:36:23.463028] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:36:23.592622] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T19:36:24.202264] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-23T19:36:24.857600] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T19:36:25.002165] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-23T19:36:25.495778] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:36:25.802208] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-23T19:36:26.095219] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T19:36:26.602205] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-23T19:36:27.266247] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T19:36:27.402210] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-23T19:36:28.202191] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-23T19:36:28.384294] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:36:28.435895] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T19:36:28.441020] [INFO ] [REMOTE ] KBDC: Full fetch complete (27791 records). [2025-09-23T19:36:28.441131] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-23T19:36:28.832455] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-23T19:36:28.832540] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-23T19:36:28.833274] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-23T19:36:28.833338] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-23T19:36:28.834085] [DEBUG] [LOCAL ] KBDC: Trimmed 27791 records to 20649 (keeping 200 days of data) [2025-09-23T19:36:28.969388] [DEBUG] [LOCAL ] KBDC: Primary data saved (20649 records). [2025-09-23T19:36:28.969516] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-23T19:36:28.969611] [INFO ] [MAIN ] Update Progress: 1179/2372 symbols completed. KBDC took 33.8s. Estimated remaining: 2h 38m 17s. Rate: 7.5 symbols/min [2025-09-23T19:36:29.007286] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-23T19:36:29.144378] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:29.150780] [DEBUG] [LOCAL ] KEN: Loaded 4763 existing records from primary storage. [2025-09-23T19:36:29.150878] [INFO ] [MAIN ] KEN: Loaded 4763 existing records. [2025-09-23T19:36:29.331056] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:29.331322] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-23T19:36:29.331369] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-23T19:36:29.331768] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-23T19:36:29.331828] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-23T19:36:29.706990] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:29.751511] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T19:36:29.802190] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-23T19:36:30.602266] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-23T19:36:30.872992] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T19:36:31.098606] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:36:31.268506] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T19:36:31.402262] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-23T19:36:31.929791] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T19:36:32.202279] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-23T19:36:33.002268] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-23T19:36:33.790720] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T19:36:33.802132] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-23T19:36:34.602250] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-23T19:36:34.863372] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-23T19:36:35.030738] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T19:36:35.402224] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-23T19:36:36.202219] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-23T19:36:36.557169] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T19:36:36.917697] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T19:36:37.002154] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-23T19:36:37.802163] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-23T19:36:37.931104] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T19:36:38.424839] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T19:36:38.602207] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-23T19:36:39.402190] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-23T19:36:39.535775] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:36:40.005035] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T19:36:40.154146] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T19:36:40.202201] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-23T19:36:41.002214] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-23T19:36:41.802225] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-23T19:36:41.959497] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T19:36:42.220699] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T19:36:42.229002] [INFO ] [REMOTE ] KBR: Full fetch complete (69825 records). [2025-09-23T19:36:42.229146] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-23T19:36:42.355836] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T19:36:42.607407] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-23T19:36:42.666453] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-23T19:36:42.666539] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-23T19:36:42.667421] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-23T19:36:42.667486] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-23T19:36:42.668831] [DEBUG] [LOCAL ] KBR: Trimmed 69825 records to 48140 (keeping 200 days of data) [2025-09-23T19:36:42.969268] [DEBUG] [LOCAL ] KBR: Primary data saved (48140 records). [2025-09-23T19:36:42.969409] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-23T19:36:42.969495] [INFO ] [MAIN ] Update Progress: 1180/2372 symbols completed. KBR took 31.3s. Estimated remaining: 2h 38m 15s. Rate: 7.5 symbols/min [2025-09-23T19:36:43.141837] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:43.174711] [DEBUG] [LOCAL ] KEP: Loaded 30456 existing records from primary storage. [2025-09-23T19:36:43.174875] [INFO ] [MAIN ] KEP: Loaded 30456 existing records. [2025-09-23T19:36:43.353311] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:43.353555] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-23T19:36:43.353604] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-23T19:36:43.354383] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-23T19:36:43.354452] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-23T19:36:43.409295] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-23T19:36:43.714254] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:44.110004] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:36:44.202200] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-23T19:36:45.002205] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-23T19:36:45.408979] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-23T19:36:45.445477] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T19:36:45.453766] [INFO ] [REMOTE ] KBH: Full fetch complete (70575 records). [2025-09-23T19:36:45.453916] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-23T19:36:45.803938] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-23T19:36:45.926065] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-23T19:36:45.926257] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-23T19:36:45.927721] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-23T19:36:45.927860] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-23T19:36:45.930179] [DEBUG] [LOCAL ] KBH: Trimmed 70575 records to 48899 (keeping 200 days of data) [2025-09-23T19:36:45.952327] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T19:36:46.423209] [DEBUG] [LOCAL ] KBH: Primary data saved (48899 records). [2025-09-23T19:36:46.423425] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-23T19:36:46.423561] [INFO ] [MAIN ] Update Progress: 1181/2372 symbols completed. KBH took 39.9s. Estimated remaining: 2h 38m 3s. Rate: 7.5 symbols/min [2025-09-23T19:36:46.548938] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:36:46.607415] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-23T19:36:46.677224] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:46.722412] [DEBUG] [LOCAL ] KEX: Loaded 37878 existing records from primary storage. [2025-09-23T19:36:46.722576] [INFO ] [MAIN ] KEX: Loaded 37878 existing records. [2025-09-23T19:36:46.962036] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:46.962345] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-23T19:36:46.962404] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-23T19:36:46.963340] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-23T19:36:46.963401] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-23T19:36:47.325542] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:47.402150] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-23T19:36:48.202196] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-23T19:36:48.530709] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T19:36:49.002165] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-23T19:36:49.152624] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T19:36:49.646272] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T19:36:49.802224] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-23T19:36:50.602196] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-23T19:36:50.868231] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T19:36:50.877782] [INFO ] [REMOTE ] KD: Full fetch complete (75579 records). [2025-09-23T19:36:50.877979] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-23T19:36:51.327358] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-23T19:36:51.327535] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-23T19:36:51.329016] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-23T19:36:51.329313] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-23T19:36:51.356010] [DEBUG] [LOCAL ] KD: Trimmed 75579 records to 52293 (keeping 200 days of data) [2025-09-23T19:36:51.358444] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:36:51.425719] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-23T19:36:51.516705] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T19:36:51.736107] [DEBUG] [LOCAL ] KD: Primary data saved (52293 records). [2025-09-23T19:36:51.736330] [INFO ] [MAIN ] KD: Full history saved. [2025-09-23T19:36:51.736445] [INFO ] [MAIN ] Update Progress: 1182/2372 symbols completed. KD took 31.0s. Estimated remaining: 2h 37m 52s. Rate: 7.5 symbols/min [2025-09-23T19:36:51.912700] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:51.913074] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-23T19:36:51.913138] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-23T19:36:51.913372] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-23T19:36:51.913427] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-23T19:36:51.913534] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-23T19:36:51.913578] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-23T19:36:52.207386] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-23T19:36:52.276566] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:52.818564] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:36:52.955932] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T19:36:53.002152] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-23T19:36:53.622072] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T19:36:53.802211] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-23T19:36:54.602200] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-23T19:36:55.268974] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T19:36:55.364599] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T19:36:55.402142] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-23T19:36:56.202199] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-23T19:36:56.688046] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:36:57.002239] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-23T19:36:57.610318] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T19:36:57.611596] [INFO ] [REMOTE ] KEN: Full fetch complete (5962 records). [2025-09-23T19:36:57.611717] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-23T19:36:57.803757] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-23T19:36:57.973674] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T19:36:58.042167] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-23T19:36:58.042273] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-23T19:36:58.042535] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-23T19:36:58.042608] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-23T19:36:58.043098] [DEBUG] [LOCAL ] KEN: Trimmed 5962 records to 4759 (keeping 200 days of data) [2025-09-23T19:36:58.072286] [DEBUG] [LOCAL ] KEN: Primary data saved (4759 records). [2025-09-23T19:36:58.072364] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-23T19:36:58.072448] [INFO ] [MAIN ] Update Progress: 1183/2372 symbols completed. KEN took 29.1s. Estimated remaining: 2h 37m 43s. Rate: 7.5 symbols/min [2025-09-23T19:36:58.249795] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:58.300589] [DEBUG] [LOCAL ] KEYS: Loaded 43401 existing records from primary storage. [2025-09-23T19:36:58.300841] [INFO ] [MAIN ] KEYS: Loaded 43401 existing records. [2025-09-23T19:36:58.509141] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:58.509509] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-23T19:36:58.509565] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-23T19:36:58.510563] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-23T19:36:58.510623] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-23T19:36:58.611201] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-23T19:36:58.887601] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:59.161395] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:36:59.402203] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-23T19:37:00.202177] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-23T19:37:00.466410] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T19:37:01.002256] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-23T19:37:01.087383] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T19:37:01.675143] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T19:37:01.802219] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-23T19:37:02.222927] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T19:37:02.602196] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-23T19:37:03.000944] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T19:37:03.402256] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-23T19:37:04.163208] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T19:37:04.202150] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-23T19:37:04.771590] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T19:37:05.002224] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-23T19:37:05.564997] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T19:37:05.802235] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-23T19:37:06.602272] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-23T19:37:06.840592] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T19:37:06.915398] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:37:07.402206] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-23T19:37:07.967235] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T19:37:07.972067] [INFO ] [REMOTE ] KEP: Full fetch complete (41571 records). [2025-09-23T19:37:07.972153] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-23T19:37:08.211996] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-23T19:37:08.352209] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-23T19:37:08.352306] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-23T19:37:08.353067] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-23T19:37:08.353132] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-23T19:37:08.354194] [DEBUG] [LOCAL ] KEP: Trimmed 41571 records to 30525 (keeping 200 days of data) [2025-09-23T19:37:08.534281] [DEBUG] [LOCAL ] KEP: Primary data saved (30525 records). [2025-09-23T19:37:08.534423] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-23T19:37:08.534511] [INFO ] [MAIN ] Update Progress: 1184/2372 symbols completed. KEP took 25.6s. Estimated remaining: 2h 37m 37s. Rate: 7.5 symbols/min [2025-09-23T19:37:08.712161] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:08.717344] [DEBUG] [LOCAL ] KF: Loaded 2480 existing records from primary storage. [2025-09-23T19:37:08.717470] [INFO ] [MAIN ] KF: Loaded 2480 existing records. [2025-09-23T19:37:08.947259] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:08.949958] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:37:08.947966] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-23T19:37:08.960273] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-23T19:37:08.961534] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-23T19:37:08.961609] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-23T19:37:09.008675] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-23T19:37:09.361767] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:09.810737] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-23T19:37:09.813752] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T19:37:09.821885] [INFO ] [REMOTE ] KEX: Full fetch complete (55346 records). [2025-09-23T19:37:09.822047] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-23T19:37:10.205844] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-23T19:37:10.205926] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-23T19:37:10.206695] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-23T19:37:10.206756] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-23T19:37:10.207912] [DEBUG] [LOCAL ] KEX: Trimmed 55346 records to 37961 (keeping 200 days of data) [2025-09-23T19:37:10.432808] [DEBUG] [LOCAL ] KEX: Primary data saved (37961 records). [2025-09-23T19:37:10.432967] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-23T19:37:10.433066] [INFO ] [MAIN ] Update Progress: 1185/2372 symbols completed. KEX took 24.0s. Estimated remaining: 2h 37m 23s. Rate: 7.5 symbols/min [2025-09-23T19:37:10.603538] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-23T19:37:10.606201] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:10.627777] [DEBUG] [LOCAL ] KFRC: Loaded 19257 existing records from primary storage. [2025-09-23T19:37:10.627914] [INFO ] [MAIN ] KFRC: Loaded 19257 existing records. [2025-09-23T19:37:10.810541] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:10.811005] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-23T19:37:10.811195] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-23T19:37:10.824092] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-23T19:37:10.829322] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-23T19:37:10.952328] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-23T19:37:11.224906] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:11.251669] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T19:37:11.402220] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-23T19:37:11.508976] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T19:37:12.202209] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-23T19:37:12.544739] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T19:37:12.649035] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T19:37:13.002234] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-23T19:37:13.802193] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-23T19:37:14.233671] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T19:37:14.602212] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-23T19:37:14.950716] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T19:37:15.152951] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T19:37:15.402258] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-23T19:37:16.202224] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-23T19:37:16.651467] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T19:37:17.002173] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-23T19:37:17.115209] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:37:17.335480] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T19:37:17.802246] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-23T19:37:18.602258] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-23T19:37:19.355357] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:37:19.388951] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:37:19.402133] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-23T19:37:20.202205] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-23T19:37:21.005417] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-23T19:37:21.008773] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T19:37:21.107482] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T19:37:21.802233] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-23T19:37:22.602167] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-23T19:37:22.839206] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T19:37:23.041830] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T19:37:23.361378] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T19:37:23.402234] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-23T19:37:24.202280] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-23T19:37:24.433715] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:37:25.002245] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-23T19:37:25.351289] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T19:37:25.601706] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T19:37:25.802232] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-23T19:37:26.602194] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-23T19:37:27.303611] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T19:37:27.402267] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-23T19:37:27.750770] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T19:37:27.834485] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T19:37:28.202220] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-23T19:37:29.002251] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-23T19:37:29.518014] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T19:37:29.519086] [INFO ] [REMOTE ] KF: Full fetch complete (3783 records). [2025-09-23T19:37:29.519155] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-23T19:37:29.806524] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-23T19:37:29.893965] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-23T19:37:29.894183] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-23T19:37:29.894452] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-23T19:37:29.894534] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-23T19:37:29.895221] [DEBUG] [LOCAL ] KF: Trimmed 3783 records to 2471 (keeping 200 days of data) [2025-09-23T19:37:29.951525] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T19:37:29.952168] [DEBUG] [LOCAL ] KF: Primary data saved (2471 records). [2025-09-23T19:37:29.952436] [INFO ] [MAIN ] KF: Full history saved. [2025-09-23T19:37:29.963610] [INFO ] [MAIN ] Update Progress: 1186/2372 symbols completed. KF took 21.4s. Estimated remaining: 2h 37m 27s. Rate: 7.5 symbols/min [2025-09-23T19:37:30.136074] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:30.146463] [DEBUG] [LOCAL ] KFS: Loaded 8242 existing records from primary storage. [2025-09-23T19:37:30.146588] [INFO ] [MAIN ] KFS: Loaded 8242 existing records. [2025-09-23T19:37:30.326727] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:30.327012] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-23T19:37:30.327061] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-23T19:37:30.327424] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-23T19:37:30.327497] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-23T19:37:30.605193] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-23T19:37:30.690044] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:30.777902] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T19:37:31.402286] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-23T19:37:31.883447] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T19:37:32.202229] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-23T19:37:32.520617] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T19:37:32.820064] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T19:37:33.002232] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-23T19:37:33.562531] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T19:37:33.802219] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-23T19:37:34.400229] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T19:37:34.602224] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-23T19:37:35.323683] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T19:37:35.402240] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-23T19:37:36.202201] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-23T19:37:36.973910] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T19:37:37.002165] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-23T19:37:37.802248] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-23T19:37:38.047983] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T19:37:38.079246] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T19:37:38.602276] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-23T19:37:39.402242] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-23T19:37:39.552100] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:37:39.564687] [INFO ] [REMOTE ] KEYS: Full fetch complete (62941 records). [2025-09-23T19:37:39.565177] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-23T19:37:39.746088] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T19:37:40.003857] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-23T19:37:40.003964] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-23T19:37:40.005199] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-23T19:37:40.005269] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-23T19:37:40.007022] [DEBUG] [LOCAL ] KEYS: Trimmed 62941 records to 43332 (keeping 200 days of data) [2025-09-23T19:37:40.203891] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-23T19:37:40.294969] [DEBUG] [LOCAL ] KEYS: Primary data saved (43332 records). [2025-09-23T19:37:40.295186] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-23T19:37:40.295302] [INFO ] [MAIN ] Update Progress: 1187/2372 symbols completed. KEYS took 42.2s. Estimated remaining: 2h 37m 21s. Rate: 7.5 symbols/min [2025-09-23T19:37:40.472875] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:40.509097] [DEBUG] [LOCAL ] KFY: Loaded 30690 existing records from primary storage. [2025-09-23T19:37:40.509292] [INFO ] [MAIN ] KFY: Loaded 30690 existing records. [2025-09-23T19:37:40.699331] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:40.700062] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-23T19:37:40.700246] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-23T19:37:40.701410] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-23T19:37:40.701477] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-23T19:37:41.022379] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-23T19:37:41.024875] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T19:37:41.099732] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T19:37:41.163324] [INFO ] [REMOTE ] KEY: Full fetch complete (77253 records). [2025-09-23T19:37:41.167867] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:41.168241] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-23T19:37:41.363704] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:37:41.364492] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:37:41.364566] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:37:41.364665] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-23T19:37:41.364768] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-23T19:37:41.364826] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-23T19:37:41.364884] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-23T19:37:41.364990] [INFO ] [MAIN ] Update Progress: 1188/2372 symbols completed. KEY took 49.6s. Estimated remaining: 2h 37m 6s. Rate: 7.5 symbols/min [2025-09-23T19:37:41.531349] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:41.589631] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-23T19:37:41.589831] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-09-23T19:37:41.771246] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:41.771519] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-23T19:37:41.771566] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-23T19:37:41.773043] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-23T19:37:41.773104] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-23T19:37:41.807497] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-23T19:37:42.138561] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:42.155843] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:37:42.602245] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-23T19:37:43.011618] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T19:37:43.402228] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-23T19:37:43.611608] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T19:37:44.202148] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-23T19:37:44.606368] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T19:37:44.722570] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T19:37:45.002217] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-23T19:37:45.802158] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-23T19:37:46.201374] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:37:46.206035] [INFO ] [REMOTE ] KFRC: Full fetch complete (25224 records). [2025-09-23T19:37:46.206152] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-23T19:37:46.574686] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-23T19:37:46.574781] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-23T19:37:46.575373] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-23T19:37:46.575432] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-23T19:37:46.576128] [DEBUG] [LOCAL ] KFRC: Trimmed 25224 records to 19348 (keeping 200 days of data) [2025-09-23T19:37:46.626065] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-23T19:37:46.699824] [DEBUG] [LOCAL ] KFRC: Primary data saved (19348 records). [2025-09-23T19:37:46.699989] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-23T19:37:46.700119] [INFO ] [MAIN ] Update Progress: 1189/2372 symbols completed. KFRC took 36.3s. Estimated remaining: 2h 36m 56s. Rate: 7.5 symbols/min [2025-09-23T19:37:46.873460] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:46.917053] [DEBUG] [LOCAL ] KGS: Loaded 45789 existing records from primary storage. [2025-09-23T19:37:46.917215] [INFO ] [MAIN ] KGS: Loaded 45789 existing records. [2025-09-23T19:37:47.134459] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:47.134897] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-23T19:37:47.134987] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-23T19:37:47.141449] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-23T19:37:47.151467] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-23T19:37:47.185635] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:37:47.405719] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-23T19:37:47.444615] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:37:47.541209] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:48.202187] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-23T19:37:49.002232] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-23T19:37:49.090195] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T19:37:49.092480] [INFO ] [REMOTE ] KFS: Full fetch complete (10452 records). [2025-09-23T19:37:49.092567] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-23T19:37:49.493937] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-23T19:37:49.494082] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-23T19:37:49.494390] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-23T19:37:49.494472] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-23T19:37:49.495430] [DEBUG] [LOCAL ] KFS: Trimmed 10452 records to 8312 (keeping 200 days of data) [2025-09-23T19:37:49.564035] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-23T19:37:49.589370] [DEBUG] [LOCAL ] KFS: Primary data saved (8312 records). [2025-09-23T19:37:49.589537] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-23T19:37:49.589636] [INFO ] [MAIN ] Update Progress: 1190/2372 symbols completed. KFS took 19.6s. Estimated remaining: 2h 36m 43s. Rate: 7.5 symbols/min [2025-09-23T19:37:49.777378] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:49.802225] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-23T19:37:49.841039] [DEBUG] [LOCAL ] KIM: Loaded 53071 existing records from primary storage. [2025-09-23T19:37:49.841234] [INFO ] [MAIN ] KIM: Loaded 53071 existing records. [2025-09-23T19:37:50.022360] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:50.022701] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-23T19:37:50.022761] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-23T19:37:50.024066] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-23T19:37:50.024130] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-23T19:37:50.400430] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:50.560971] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T19:37:50.602162] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-23T19:37:51.402277] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-23T19:37:51.656941] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T19:37:52.187606] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T19:37:52.202164] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-23T19:37:52.331599] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T19:37:53.002244] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-23T19:37:53.366413] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T19:37:53.802214] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-23T19:37:54.602190] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-23T19:37:54.716735] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T19:37:55.287460] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:37:55.402234] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-23T19:37:55.633629] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T19:37:56.202232] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-23T19:37:57.002244] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-23T19:37:57.091320] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T19:37:57.548929] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T19:37:57.802267] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-23T19:37:58.275261] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T19:37:58.602190] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-23T19:37:59.402172] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-23T19:37:59.432094] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T19:38:00.202261] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-23T19:38:01.002154] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-23T19:38:01.055171] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T19:38:01.152207] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-23T19:38:01.802265] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-23T19:38:02.096542] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T19:38:02.180994] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:38:02.602233] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-23T19:38:03.402155] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-23T19:38:03.661632] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T19:38:03.703036] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T19:38:04.202207] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-23T19:38:05.002187] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-23T19:38:05.264705] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T19:38:05.802223] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-23T19:38:06.236946] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T19:38:06.602194] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-23T19:38:06.875614] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T19:38:07.393987] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T19:38:07.402505] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-23T19:38:08.202253] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-23T19:38:08.567901] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:38:08.649722] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T19:38:09.002264] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-23T19:38:09.375936] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T19:38:09.802271] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-23T19:38:10.503685] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:38:10.514216] [INFO ] [REMOTE ] KFY: Full fetch complete (43792 records). [2025-09-23T19:38:10.514389] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-23T19:38:10.611221] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-23T19:38:10.974333] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-23T19:38:10.974523] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-23T19:38:10.975473] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-23T19:38:10.975597] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-23T19:38:10.976933] [DEBUG] [LOCAL ] KFY: Trimmed 43792 records to 30672 (keeping 200 days of data) [2025-09-23T19:38:11.190055] [DEBUG] [LOCAL ] KFY: Primary data saved (30672 records). [2025-09-23T19:38:11.190245] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-23T19:38:11.190496] [INFO ] [MAIN ] Update Progress: 1191/2372 symbols completed. KFY took 30.9s. Estimated remaining: 2h 36m 48s. Rate: 7.5 symbols/min [2025-09-23T19:38:11.370317] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:11.394203] [DEBUG] [LOCAL ] KIO: Loaded 21326 existing records from primary storage. [2025-09-23T19:38:11.394456] [INFO ] [MAIN ] KIO: Loaded 21326 existing records. [2025-09-23T19:38:11.407398] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-23T19:38:11.596732] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:38:11.611636] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-23T19:38:11.611790] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-23T19:38:11.615827] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-23T19:38:11.617329] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-23T19:38:11.617244] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T19:38:12.004489] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:12.202268] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-23T19:38:12.314491] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T19:38:12.910204] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:38:12.985480] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T19:38:13.002195] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-23T19:38:13.802274] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-23T19:38:14.602190] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-23T19:38:14.706532] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T19:38:15.404020] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T19:38:15.404209] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-23T19:38:15.765102] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T19:38:16.202254] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-23T19:38:17.002286] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-23T19:38:17.373992] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T19:38:17.541467] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T19:38:17.550743] [INFO ] [REMOTE ] KGC: Full fetch complete (77690 records). [2025-09-23T19:38:17.550959] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-23T19:38:17.813801] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-23T19:38:17.955389] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-23T19:38:17.955502] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-23T19:38:17.956563] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-23T19:38:17.956694] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-23T19:38:17.959015] [DEBUG] [LOCAL ] KGC: Trimmed 77690 records to 53699 (keeping 200 days of data) [2025-09-23T19:38:18.323231] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-23T19:38:18.323449] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-23T19:38:18.323686] [INFO ] [MAIN ] Update Progress: 1192/2372 symbols completed. KGC took 37.0s. Estimated remaining: 2h 36m 40s. Rate: 7.5 symbols/min [2025-09-23T19:38:18.518900] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:18.546423] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T19:38:18.555973] [INFO ] [REMOTE ] KGS: Full fetch complete (65836 records). [2025-09-23T19:38:18.556147] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-23T19:38:18.603577] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-23T19:38:18.902403] [DEBUG] [LOCAL ] KKR: Loaded 53505 existing records from primary storage. [2025-09-23T19:38:18.918273] [INFO ] [MAIN ] KKR: Loaded 53505 existing records. [2025-09-23T19:38:19.113628] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-23T19:38:19.129150] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-23T19:38:19.149065] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-23T19:38:19.161274] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-23T19:38:19.185853] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:38:19.186162] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-23T19:38:19.186206] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-23T19:38:19.187349] [DEBUG] [LOCAL ] KGS: Trimmed 65836 records to 45785 (keeping 200 days of data) [2025-09-23T19:38:19.188824] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-23T19:38:19.188905] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-23T19:38:19.685035] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:19.690138] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-23T19:38:19.806954] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T19:38:19.852871] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T19:38:19.927850] [DEBUG] [LOCAL ] KGS: Primary data saved (45785 records). [2025-09-23T19:38:19.928004] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-23T19:38:19.928132] [INFO ] [MAIN ] Update Progress: 1193/2372 symbols completed. KGS took 33.2s. Estimated remaining: 2h 36m 25s. Rate: 7.5 symbols/min [2025-09-23T19:38:20.115742] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:20.126558] [DEBUG] [LOCAL ] KKRS: Loaded 5760 existing records from primary storage. [2025-09-23T19:38:20.126713] [INFO ] [MAIN ] KKRS: Loaded 5760 existing records. [2025-09-23T19:38:20.207324] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-23T19:38:20.310585] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:38:20.310868] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-23T19:38:20.310931] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-23T19:38:20.311252] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-23T19:38:20.311311] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-23T19:38:20.695247] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:21.002190] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-23T19:38:21.651960] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-23T19:38:21.802173] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-23T19:38:21.921365] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:38:21.966133] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T19:38:22.602193] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-23T19:38:23.357515] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:38:23.386449] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T19:38:23.402142] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-23T19:38:24.202178] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-23T19:38:24.350847] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T19:38:25.002222] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-23T19:38:25.723672] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T19:38:25.802166] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-23T19:38:26.056135] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T19:38:26.065253] [INFO ] [REMOTE ] KIM: Full fetch complete (76816 records). [2025-09-23T19:38:26.065453] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-23T19:38:26.372344] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T19:38:26.468743] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-23T19:38:26.468833] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-23T19:38:26.469767] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-23T19:38:26.469829] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-23T19:38:26.474165] [DEBUG] [LOCAL ] KIM: Trimmed 76816 records to 53067 (keeping 200 days of data) [2025-09-23T19:38:26.604497] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-23T19:38:26.814316] [DEBUG] [LOCAL ] KIM: Primary data saved (53067 records). [2025-09-23T19:38:26.814463] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-23T19:38:26.814549] [INFO ] [MAIN ] Update Progress: 1194/2372 symbols completed. KIM took 37.2s. Estimated remaining: 2h 36m 16s. Rate: 7.5 symbols/min [2025-09-23T19:38:26.980491] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:26.980671] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-23T19:38:26.980725] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-23T19:38:26.980934] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-23T19:38:26.980976] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-23T19:38:26.981067] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-23T19:38:26.981107] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-23T19:38:27.335022] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:27.402143] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-23T19:38:27.601954] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:27.602199] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-23T19:38:27.851395] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T19:38:28.202193] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-23T19:38:29.002195] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-23T19:38:29.802185] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-23T19:38:29.958737] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T19:38:29.998473] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T19:38:30.167382] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T19:38:30.602267] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-23T19:38:31.229612] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T19:38:31.402258] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-23T19:38:31.603394] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:31.603790] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-23T19:38:32.202212] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-23T19:38:33.002217] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-23T19:38:33.297147] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T19:38:33.303097] [INFO ] [REMOTE ] KIO: Full fetch complete (30882 records). [2025-09-23T19:38:33.303250] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-23T19:38:33.693097] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-23T19:38:33.693440] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-23T19:38:33.694077] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-23T19:38:33.694140] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-23T19:38:33.696107] [DEBUG] [LOCAL ] KIO: Trimmed 30882 records to 21283 (keeping 200 days of data) [2025-09-23T19:38:33.791318] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:38:33.803301] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-23T19:38:33.838973] [DEBUG] [LOCAL ] KIO: Primary data saved (21283 records). [2025-09-23T19:38:33.839114] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-23T19:38:33.839225] [INFO ] [MAIN ] Update Progress: 1195/2372 symbols completed. KIO took 22.6s. Estimated remaining: 2h 36m 7s. Rate: 7.5 symbols/min [2025-09-23T19:38:34.009728] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:34.009946] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-23T19:38:34.010001] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-23T19:38:34.010184] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-23T19:38:34.010227] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-23T19:38:34.010269] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-23T19:38:34.010301] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-23T19:38:34.054788] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:34.092728] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-23T19:38:34.380603] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:34.602199] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-23T19:38:35.328099] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T19:38:35.402196] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-23T19:38:36.202198] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-23T19:38:36.732436] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T19:38:37.002205] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-23T19:38:37.594000] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T19:38:37.595621] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-23T19:38:37.802222] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-23T19:38:37.991373] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:37.991738] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-23T19:38:38.602203] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-23T19:38:39.402215] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-23T19:38:39.601412] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:39.601810] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-23T19:38:40.202158] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-23T19:38:40.397037] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:40.397361] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-23T19:38:40.635367] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T19:38:41.002201] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-23T19:38:41.241280] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:41.241601] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-23T19:38:41.802193] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-23T19:38:42.240449] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T19:38:42.602195] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-23T19:38:42.789279] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:42.789671] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-23T19:38:43.402205] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-23T19:38:44.202189] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-23T19:38:44.392815] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:44.393151] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-23T19:38:45.002164] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-23T19:38:45.413349] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T19:38:45.472138] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T19:38:45.802216] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-23T19:38:46.602196] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-23T19:38:46.878492] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T19:38:47.402188] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-23T19:38:47.596434] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:47.596795] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-23T19:38:48.202157] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-23T19:38:48.291382] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:38:48.900037] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T19:38:48.901356] [INFO ] [REMOTE ] KKRS: Full fetch complete (8046 records). [2025-09-23T19:38:48.901429] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-23T19:38:49.005413] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-23T19:38:49.255674] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:49.282053] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-23T19:38:49.290333] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-23T19:38:49.290668] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-23T19:38:49.290907] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-23T19:38:49.290950] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-23T19:38:49.291391] [DEBUG] [LOCAL ] KKRS: Trimmed 8046 records to 5751 (keeping 200 days of data) [2025-09-23T19:38:49.327320] [DEBUG] [LOCAL ] KKRS: Primary data saved (5751 records). [2025-09-23T19:38:49.327468] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-23T19:38:49.327578] [INFO ] [MAIN ] Update Progress: 1196/2372 symbols completed. KKRS took 29.4s. Estimated remaining: 2h 36m 7s. Rate: 7.5 symbols/min [2025-09-23T19:38:49.507757] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:49.547922] [DEBUG] [LOCAL ] KLC: Loaded 36380 existing records from primary storage. [2025-09-23T19:38:49.548065] [INFO ] [MAIN ] KLC: Loaded 36380 existing records. [2025-09-23T19:38:49.722250] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:38:49.722506] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-23T19:38:49.722555] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-23T19:38:49.723513] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-23T19:38:49.723576] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-23T19:38:49.807374] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-23T19:38:50.076700] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:50.602240] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-23T19:38:51.402239] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-23T19:38:51.783199] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T19:38:52.206388] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-23T19:38:52.197963] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:38:52.231323] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:38:52.442577] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:52.443028] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-23T19:38:53.002186] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-23T19:38:53.802266] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-23T19:38:53.816357] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T19:38:54.602256] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-23T19:38:55.402222] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-23T19:38:55.596806] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:55.597366] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-23T19:38:55.672857] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:38:55.725369] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T19:38:56.202247] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-23T19:38:56.395889] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:56.396220] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-23T19:38:57.002215] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-23T19:38:57.802172] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-23T19:38:57.913578] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T19:38:57.915947] [INFO ] [REMOTE ] KKRT: Full fetch complete (8461 records). [2025-09-23T19:38:57.916019] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-23T19:38:58.104797] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 80 unique days, need 200 days [2025-09-23T19:38:58.108373] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:38:58.108471] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:38:58.108545] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-23T19:38:58.108612] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-23T19:38:58.108686] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-23T19:38:58.108767] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-23T19:38:58.108848] [INFO ] [MAIN ] Update Progress: 1197/2372 symbols completed. KKRT took 31.3s. Estimated remaining: 2h 35m 60s. Rate: 7.5 symbols/min [2025-09-23T19:38:58.602222] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-23T19:38:59.402205] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-23T19:38:59.680482] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:38:59.745085] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T19:38:59.754018] [INFO ] [REMOTE ] KKR: Full fetch complete (77440 records). [2025-09-23T19:38:59.754146] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-23T19:39:00.162827] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-23T19:39:00.162924] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-23T19:39:00.164082] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-23T19:39:00.164149] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-23T19:39:00.165824] [DEBUG] [LOCAL ] KKR: Trimmed 77440 records to 53502 (keeping 200 days of data) [2025-09-23T19:39:00.226383] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-23T19:39:00.508749] [DEBUG] [LOCAL ] KKR: Primary data saved (53502 records). [2025-09-23T19:39:00.508929] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-23T19:39:00.509033] [INFO ] [MAIN ] Update Progress: 1198/2372 symbols completed. KKR took 42.2s. Estimated remaining: 2h 35m 46s. Rate: 7.5 symbols/min [2025-09-23T19:39:00.810579] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:39:00.816383] [INFO ] [REMOTE ] KLAR: Full fetch complete (3679 records). [2025-09-23T19:39:00.816495] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-23T19:39:01.016771] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 10 unique days, need 200 days [2025-09-23T19:39:01.017085] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:39:01.017160] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:39:01.017240] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-23T19:39:01.017318] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-23T19:39:01.017358] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-23T19:39:01.017443] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-23T19:39:01.017541] [INFO ] [MAIN ] Update Progress: 1199/2372 symbols completed. KLAR took 27.2s. Estimated remaining: 2h 35m 31s. Rate: 7.5 symbols/min [2025-09-23T19:39:01.790285] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T19:39:01.798578] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-23T19:39:04.559223] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-23T19:39:04.567763] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-23T19:39:05.974360] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T19:39:05.982380] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-23T19:39:07.348173] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T19:39:07.355497] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-23T19:39:08.677856] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:39:08.686228] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-23T19:39:10.123435] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:39:10.131869] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-23T19:39:11.581977] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T19:39:11.588402] [INFO ] [REMOTE ] KLC: Full fetch complete (50794 records). [2025-09-23T19:39:11.588543] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-23T19:39:11.978696] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-23T19:39:11.978788] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-23T19:39:11.979522] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-23T19:39:11.979562] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-23T19:39:11.980589] [DEBUG] [LOCAL ] KLC: Trimmed 50794 records to 36503 (keeping 200 days of data) [2025-09-23T19:39:12.186005] [DEBUG] [LOCAL ] KLC: Primary data saved (36503 records). [2025-09-23T19:39:12.186154] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-23T19:39:12.186239] [INFO ] [MAIN ] Update Progress: 1200/2372 symbols completed. KLC took 22.9s. Estimated remaining: 2h 35m 26s. Rate: 7.5 symbols/min [2025-09-23T19:39:12.828248] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:12.825347] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:12.880363] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:12.899570] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:12.904314] [DEBUG] [LOCAL ] KMPB: Loaded 3581 existing records from primary storage. [2025-09-23T19:39:12.905176] [INFO ] [MAIN ] KMPB: Loaded 3581 existing records. [2025-09-23T19:39:13.130115] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:13.130494] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-23T19:39:13.130544] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-23T19:39:13.130861] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-23T19:39:13.130921] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-23T19:39:13.273820] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-23T19:39:13.275534] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-09-23T19:39:13.275286] [DEBUG] [LOCAL ] KLG: Loaded 41901 existing records from primary storage. [2025-09-23T19:39:13.281694] [DEBUG] [LOCAL ] KMPR: Loaded 38145 existing records from primary storage. [2025-09-23T19:39:13.316155] [INFO ] [MAIN ] KMPR: Loaded 38145 existing records. [2025-09-23T19:39:13.302202] [INFO ] [MAIN ] KLG: Loaded 41901 existing records. [2025-09-23T19:39:13.936749] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:14.048305] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:14.048531] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-23T19:39:14.056856] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-23T19:39:14.053967] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-23T19:39:14.060259] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:14.056949] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-23T19:39:14.060618] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-23T19:39:14.060720] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-23T19:39:14.061576] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-23T19:39:14.061672] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-23T19:39:14.061732] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-23T19:39:14.067370] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-23T19:39:14.062156] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-23T19:39:14.094348] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-23T19:39:14.400050] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:14.470336] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-23T19:39:15.035010] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:15.116110] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-23T19:39:15.190407] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:15.220309] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-23T19:39:15.261290] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:15.261664] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-23T19:39:15.857796] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:39:15.859257] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-23T19:39:16.442834] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T19:39:16.444077] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-23T19:39:16.792363] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T19:39:16.793677] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-23T19:39:17.036664] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T19:39:17.042266] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-23T19:39:17.163199] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T19:39:17.164927] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-23T19:39:17.769618] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-23T19:39:17.780034] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-23T19:39:17.810937] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T19:39:17.812319] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-23T19:39:17.869910] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-23T19:39:17.882122] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-23T19:39:18.009789] [DEBUG] [REMOTE ] KMI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-23T19:39:18.010140] [WARN ] [REMOTE ] KMI: No data returned for month 2025-01 [2025-09-23T19:39:18.010605] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-23T19:39:18.277192] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:39:18.283515] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-23T19:39:18.437633] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T19:39:18.439202] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-23T19:39:19.013689] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T19:39:19.015496] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-23T19:39:19.303104] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:39:19.312481] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-23T19:39:19.359359] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:39:19.402173] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-23T19:39:19.489215] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T19:39:19.866495] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T19:39:20.202281] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-23T19:39:20.561855] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:39:20.576865] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T19:39:20.782016] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T19:39:21.002234] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-23T19:39:21.802234] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-23T19:39:22.602199] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-23T19:39:23.006436] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T19:39:23.025469] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T19:39:23.026639] [INFO ] [REMOTE ] KMPB: Full fetch complete (4877 records). [2025-09-23T19:39:23.026743] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-23T19:39:23.407639] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-23T19:39:23.436525] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-23T19:39:23.436918] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-23T19:39:23.437639] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-23T19:39:23.439543] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-23T19:39:23.439409] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T19:39:23.449532] [DEBUG] [LOCAL ] KMPB: Trimmed 4877 records to 3582 (keeping 200 days of data) [2025-09-23T19:39:23.474299] [DEBUG] [LOCAL ] KMPB: Primary data saved (3582 records). [2025-09-23T19:39:23.474437] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-23T19:39:23.474531] [INFO ] [MAIN ] Update Progress: 1201/2372 symbols completed. KMPB took 11.3s. Estimated remaining: 2h 35m 21s. Rate: 7.5 symbols/min [2025-09-23T19:39:23.650755] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:23.695254] [DEBUG] [LOCAL ] KMT: Loaded 43079 existing records from primary storage. [2025-09-23T19:39:23.695437] [INFO ] [MAIN ] KMT: Loaded 43079 existing records. [2025-09-23T19:39:23.886947] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:23.887298] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-23T19:39:23.887364] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-23T19:39:23.888685] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-23T19:39:23.888763] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-23T19:39:24.207280] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-23T19:39:24.263062] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:25.002244] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-23T19:39:25.517080] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-23T19:39:25.589962] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:39:25.802205] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-23T19:39:26.059380] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T19:39:26.602218] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-23T19:39:27.114672] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T19:39:27.402216] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-23T19:39:28.202213] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-23T19:39:28.975009] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-23T19:39:29.002277] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-23T19:39:29.412483] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T19:39:29.802233] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-23T19:39:29.861578] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T19:39:30.607309] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-23T19:39:30.628305] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T19:39:31.402169] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-23T19:39:31.631725] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T19:39:32.202190] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-23T19:39:32.233550] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T19:39:32.580712] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:39:33.002196] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-23T19:39:33.802194] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-23T19:39:34.317908] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-23T19:39:34.443412] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:39:34.602204] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-23T19:39:35.251407] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T19:39:35.402187] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-23T19:39:35.844225] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T19:39:35.852954] [INFO ] [REMOTE ] KMPR: Full fetch complete (50402 records). [2025-09-23T19:39:35.853256] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-23T19:39:36.206527] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-23T19:39:36.242467] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-23T19:39:36.242557] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-23T19:39:36.243361] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-23T19:39:36.243424] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-23T19:39:36.244740] [DEBUG] [LOCAL ] KMPR: Trimmed 50402 records to 38267 (keeping 200 days of data) [2025-09-23T19:39:36.476474] [DEBUG] [LOCAL ] KMPR: Primary data saved (38267 records). [2025-09-23T19:39:36.476673] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-23T19:39:36.476787] [INFO ] [MAIN ] Update Progress: 1202/2372 symbols completed. KMPR took 24.3s. Estimated remaining: 2h 35m 18s. Rate: 7.5 symbols/min [2025-09-23T19:39:36.656388] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:36.707554] [DEBUG] [LOCAL ] KMX: Loaded 53109 existing records from primary storage. [2025-09-23T19:39:36.707746] [INFO ] [MAIN ] KMX: Loaded 53109 existing records. [2025-09-23T19:39:36.898914] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:36.911794] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-23T19:39:36.912107] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-23T19:39:36.913463] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T19:39:36.916496] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-23T19:39:36.921629] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-23T19:39:37.007425] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-23T19:39:37.289417] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:37.802211] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-23T19:39:38.374289] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-23T19:39:38.428411] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T19:39:38.602162] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-23T19:39:39.365165] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T19:39:39.372197] [INFO ] [REMOTE ] KLG: Full fetch complete (61825 records). [2025-09-23T19:39:39.372438] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-23T19:39:39.407325] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-23T19:39:39.766869] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-23T19:39:39.766991] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-23T19:39:39.767946] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-23T19:39:39.768086] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-23T19:39:39.769767] [DEBUG] [LOCAL ] KLG: Trimmed 61825 records to 41973 (keeping 200 days of data) [2025-09-23T19:39:39.882358] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T19:39:40.057043] [DEBUG] [LOCAL ] KLG: Primary data saved (41973 records). [2025-09-23T19:39:40.057183] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-23T19:39:40.057274] [INFO ] [MAIN ] Update Progress: 1203/2372 symbols completed. KLG took 27.9s. Estimated remaining: 2h 35m 6s. Rate: 7.5 symbols/min [2025-09-23T19:39:40.205240] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-23T19:39:40.228163] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:40.270219] [DEBUG] [LOCAL ] KN: Loaded 38942 existing records from primary storage. [2025-09-23T19:39:40.270369] [INFO ] [MAIN ] KN: Loaded 38942 existing records. [2025-09-23T19:39:40.452232] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:40.452509] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-23T19:39:40.452558] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-23T19:39:40.453543] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-23T19:39:40.453608] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-23T19:39:40.841880] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:40.873394] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T19:39:41.002191] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-23T19:39:41.395917] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T19:39:41.802274] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-23T19:39:42.602172] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-23T19:39:42.752874] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T19:39:43.402237] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-23T19:39:43.601349] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T19:39:43.680443] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T19:39:43.690708] [INFO ] [REMOTE ] KMI: Full fetch complete (69964 records). [2025-09-23T19:39:43.690851] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-23T19:39:43.890483] [WARN ] [VALIDATOR ] KMI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:39:43.891213] [FATAL] [MAIN ] KMI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:39:43.891285] [WARN ] [MAIN ] KMI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:39:43.891359] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-23T19:39:43.891445] [DEBUG] [LOCAL ] KMI: No primary data file found to delete. [2025-09-23T19:39:43.891501] [INFO ] [LOCAL ] KMI: Starting deletion of derivative data. [2025-09-23T19:39:43.891944] [DEBUG] [LOCAL ] KMI: Deleted derivative data file. [2025-09-23T19:39:43.892059] [INFO ] [MAIN ] Update Progress: 1204/2372 symbols completed. KMI took 31.7s. Estimated remaining: 2h 34m 54s. Rate: 7.5 symbols/min [2025-09-23T19:39:44.062135] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:44.097002] [DEBUG] [LOCAL ] KNF: Loaded 35762 existing records from primary storage. [2025-09-23T19:39:44.097141] [INFO ] [MAIN ] KNF: Loaded 35762 existing records. [2025-09-23T19:39:44.207295] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-23T19:39:44.293342] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:44.293664] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-23T19:39:44.293727] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-23T19:39:44.294606] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-23T19:39:44.294710] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-23T19:39:44.674702] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:44.814173] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:39:45.002222] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-23T19:39:45.621145] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T19:39:45.802187] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-23T19:39:46.542607] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T19:39:46.602190] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-23T19:39:46.807406] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T19:39:47.402199] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-23T19:39:47.829388] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T19:39:48.202237] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-23T19:39:48.596382] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T19:39:49.002253] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-23T19:39:49.668927] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T19:39:49.802270] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-23T19:39:50.412718] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:39:50.602212] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-23T19:39:51.029802] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:39:51.402303] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-23T19:39:52.091535] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:39:52.202238] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-23T19:39:53.007305] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-23T19:39:53.028814] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T19:39:53.540762] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T19:39:53.802237] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-23T19:39:54.602211] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-23T19:39:54.823053] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T19:39:55.410457] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-23T19:39:55.416366] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T19:39:55.424559] [INFO ] [REMOTE ] KMT: Full fetch complete (61983 records). [2025-09-23T19:39:55.424813] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-23T19:39:55.862414] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-23T19:39:55.862524] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-23T19:39:55.863445] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-23T19:39:55.863527] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-23T19:39:55.886593] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:39:55.894479] [DEBUG] [LOCAL ] KMT: Trimmed 61983 records to 43103 (keeping 200 days of data) [2025-09-23T19:39:56.159849] [DEBUG] [LOCAL ] KMT: Primary data saved (43103 records). [2025-09-23T19:39:56.159990] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-23T19:39:56.160077] [INFO ] [MAIN ] Update Progress: 1205/2372 symbols completed. KMT took 32.7s. Estimated remaining: 2h 34m 50s. Rate: 7.5 symbols/min [2025-09-23T19:39:56.214135] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-23T19:39:56.334980] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:56.345727] [DEBUG] [LOCAL ] KNOP: Loaded 9908 existing records from primary storage. [2025-09-23T19:39:56.345891] [INFO ] [MAIN ] KNOP: Loaded 9908 existing records. [2025-09-23T19:39:56.521099] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:56.521398] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-23T19:39:56.521453] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-23T19:39:56.521991] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-23T19:39:56.522051] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-23T19:39:56.883536] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:56.995268] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:39:57.006003] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-23T19:39:57.724415] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T19:39:57.802160] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-23T19:39:58.399825] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:39:58.602250] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-23T19:39:59.402193] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-23T19:39:59.774045] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T19:39:59.959578] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:40:00.202197] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-23T19:40:00.799268] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:40:01.002287] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-23T19:40:01.581070] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T19:40:01.662500] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:40:01.802247] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-23T19:40:02.602250] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-23T19:40:02.651842] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T19:40:03.402209] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-23T19:40:04.202199] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-23T19:40:04.410416] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T19:40:04.646364] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T19:40:04.997391] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T19:40:05.006216] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-23T19:40:05.802213] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-23T19:40:06.467232] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:40:06.602170] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-23T19:40:07.209568] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:40:07.402215] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-23T19:40:08.110036] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T19:40:08.202211] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-23T19:40:08.577379] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:40:08.586020] [INFO ] [REMOTE ] KNF: Full fetch complete (50308 records). [2025-09-23T19:40:08.586264] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-23T19:40:09.011670] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-23T19:40:09.015329] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-23T19:40:09.015388] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-23T19:40:09.016159] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-23T19:40:09.016223] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-23T19:40:09.017429] [DEBUG] [LOCAL ] KNF: Trimmed 50308 records to 35846 (keeping 200 days of data) [2025-09-23T19:40:09.230911] [DEBUG] [LOCAL ] KNF: Primary data saved (35846 records). [2025-09-23T19:40:09.231832] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-23T19:40:09.232135] [INFO ] [MAIN ] Update Progress: 1206/2372 symbols completed. KNF took 25.3s. Estimated remaining: 2h 34m 47s. Rate: 7.5 symbols/min [2025-09-23T19:40:09.407453] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:09.427710] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:40:09.435600] [INFO ] [REMOTE ] KN: Full fetch complete (56386 records). [2025-09-23T19:40:09.435788] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-23T19:40:09.569540] [DEBUG] [LOCAL ] KNSL: Loaded 18127 existing records from primary storage. [2025-09-23T19:40:09.580000] [INFO ] [MAIN ] KNSL: Loaded 18127 existing records. [2025-09-23T19:40:09.803675] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-23T19:40:09.969487] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:09.995154] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-23T19:40:10.010737] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-23T19:40:10.062558] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-23T19:40:10.084362] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-23T19:40:10.084113] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-23T19:40:10.084504] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-23T19:40:10.090603] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-23T19:40:10.129691] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-23T19:40:10.204209] [DEBUG] [LOCAL ] KN: Trimmed 56386 records to 38940 (keeping 200 days of data) [2025-09-23T19:40:10.664468] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:10.665374] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-23T19:40:10.728034] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T19:40:10.794952] [DEBUG] [LOCAL ] KN: Primary data saved (38940 records). [2025-09-23T19:40:10.795140] [INFO ] [MAIN ] KN: Full history saved. [2025-09-23T19:40:10.795252] [INFO ] [MAIN ] Update Progress: 1207/2372 symbols completed. KN took 30.7s. Estimated remaining: 2h 34m 33s. Rate: 7.5 symbols/min [2025-09-23T19:40:10.968188] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:10.997767] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-23T19:40:11.049886] [DEBUG] [LOCAL ] KNTK: Loaded 46086 existing records from primary storage. [2025-09-23T19:40:11.050065] [INFO ] [MAIN ] KNTK: Loaded 46086 existing records. [2025-09-23T19:40:11.228483] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:11.228797] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-23T19:40:11.228855] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-23T19:40:11.230240] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-23T19:40:11.230302] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-23T19:40:11.405069] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-23T19:40:11.590659] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:11.752778] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T19:40:12.202239] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-23T19:40:12.457866] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T19:40:13.002216] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-23T19:40:13.385564] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T19:40:13.741296] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T19:40:13.802152] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-23T19:40:14.602209] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-23T19:40:14.901774] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T19:40:15.402206] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-23T19:40:16.202185] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-23T19:40:16.625545] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T19:40:16.732863] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T19:40:16.774621] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T19:40:17.002261] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-23T19:40:17.516296] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T19:40:17.802222] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-23T19:40:18.602168] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-23T19:40:18.913074] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T19:40:19.402301] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-23T19:40:19.415289] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T19:40:20.202189] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-23T19:40:20.777751] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T19:40:20.897731] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T19:40:21.002153] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-23T19:40:21.802289] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-23T19:40:21.885108] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T19:40:21.887729] [INFO ] [REMOTE ] KNOP: Full fetch complete (14618 records). [2025-09-23T19:40:21.887859] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-23T19:40:22.266488] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-23T19:40:22.266597] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-23T19:40:22.267053] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-23T19:40:22.267116] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-23T19:40:22.267777] [DEBUG] [LOCAL ] KNOP: Trimmed 14618 records to 9921 (keeping 200 days of data) [2025-09-23T19:40:22.325614] [DEBUG] [LOCAL ] KNOP: Primary data saved (9921 records). [2025-09-23T19:40:22.325782] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-23T19:40:22.325890] [INFO ] [MAIN ] Update Progress: 1208/2372 symbols completed. KNOP took 26.2s. Estimated remaining: 2h 34m 29s. Rate: 7.5 symbols/min [2025-09-23T19:40:22.503332] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:22.554030] [DEBUG] [LOCAL ] KNX: Loaded 52594 existing records from primary storage. [2025-09-23T19:40:22.554204] [INFO ] [MAIN ] KNX: Loaded 52594 existing records. [2025-09-23T19:40:22.612270] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-23T19:40:22.762292] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:22.762639] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-23T19:40:22.762736] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-23T19:40:22.764557] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-23T19:40:22.764624] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-23T19:40:23.138336] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:23.402228] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-23T19:40:23.577109] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T19:40:23.612417] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T19:40:24.202234] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-23T19:40:25.004499] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-23T19:40:25.008967] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T19:40:25.802186] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-23T19:40:25.869151] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T19:40:25.878295] [INFO ] [REMOTE ] KMX: Full fetch complete (75921 records). [2025-09-23T19:40:25.878499] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-23T19:40:26.199142] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T19:40:26.334614] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-23T19:40:26.334742] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-23T19:40:26.335896] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-23T19:40:26.335977] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-23T19:40:26.340476] [DEBUG] [LOCAL ] KMX: Trimmed 75921 records to 53112 (keeping 200 days of data) [2025-09-23T19:40:26.620723] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-23T19:40:26.673138] [DEBUG] [LOCAL ] KMX: Primary data saved (53112 records). [2025-09-23T19:40:26.673313] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-23T19:40:26.673453] [INFO ] [MAIN ] Update Progress: 1209/2372 symbols completed. KMX took 50.2s. Estimated remaining: 2h 34m 17s. Rate: 7.5 symbols/min [2025-09-23T19:40:26.842449] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:26.842676] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-23T19:40:26.842733] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-23T19:40:26.842889] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-23T19:40:26.842943] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-23T19:40:26.843010] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-23T19:40:26.843045] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-23T19:40:27.227701] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:27.264230] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T19:40:27.402244] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-23T19:40:28.202234] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-23T19:40:29.002153] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-23T19:40:29.217303] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:40:29.802240] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-23T19:40:30.093446] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-23T19:40:30.178941] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (3.56 seconds). [2025-09-23T19:40:30.602168] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-23T19:40:30.644835] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:40:30.914508] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T19:40:31.402247] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-23T19:40:32.202211] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-23T19:40:32.247698] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:40:33.002185] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-23T19:40:33.226958] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T19:40:33.802190] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-23T19:40:34.392631] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T19:40:34.430403] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-23T19:40:34.602388] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-23T19:40:35.122422] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T19:40:35.402183] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-23T19:40:35.893947] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T19:40:35.897453] [INFO ] [REMOTE ] KNSL: Full fetch complete (26745 records). [2025-09-23T19:40:35.897705] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-23T19:40:36.207287] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-23T19:40:36.279764] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-23T19:40:36.279849] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-23T19:40:36.280437] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-23T19:40:36.280557] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-23T19:40:36.281426] [DEBUG] [LOCAL ] KNSL: Trimmed 26745 records to 18092 (keeping 200 days of data) [2025-09-23T19:40:36.419413] [DEBUG] [LOCAL ] KNSL: Primary data saved (18092 records). [2025-09-23T19:40:36.419577] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-23T19:40:36.419738] [INFO ] [MAIN ] Update Progress: 1210/2372 symbols completed. KNSL took 27.2s. Estimated remaining: 2h 34m 11s. Rate: 7.5 symbols/min [2025-09-23T19:40:36.600715] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:36.649977] [DEBUG] [LOCAL ] KODK: Loaded 43420 existing records from primary storage. [2025-09-23T19:40:36.650138] [INFO ] [MAIN ] KODK: Loaded 43420 existing records. [2025-09-23T19:40:36.830761] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:36.831032] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-23T19:40:36.831083] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-23T19:40:36.832169] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-23T19:40:36.832252] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-23T19:40:37.007349] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-23T19:40:37.247000] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:37.768810] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-23T19:40:37.802201] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-23T19:40:37.852675] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:40:38.602176] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-23T19:40:38.786998] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T19:40:39.402202] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-23T19:40:40.055521] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:40:40.202202] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-23T19:40:40.503751] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-23T19:40:40.628084] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:40:41.002201] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-23T19:40:41.512210] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:40:41.802215] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-23T19:40:42.602197] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-23T19:40:42.671319] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T19:40:43.402209] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-23T19:40:44.134673] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T19:40:44.208764] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-23T19:40:44.214832] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-23T19:40:44.880177] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T19:40:45.002230] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-23T19:40:45.812471] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-23T19:40:45.840477] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T19:40:46.562990] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T19:40:46.602157] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-23T19:40:47.402209] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-23T19:40:48.202234] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-23T19:40:48.312745] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-23T19:40:48.378583] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T19:40:48.386744] [INFO ] [REMOTE ] KNTK: Full fetch complete (63963 records). [2025-09-23T19:40:48.386941] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-23T19:40:48.797954] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-23T19:40:48.798096] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-23T19:40:48.799057] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-23T19:40:48.799123] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-23T19:40:48.800635] [DEBUG] [LOCAL ] KNTK: Trimmed 63963 records to 46111 (keeping 200 days of data) [2025-09-23T19:40:49.022017] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-23T19:40:49.101872] [DEBUG] [LOCAL ] KNTK: Primary data saved (46111 records). [2025-09-23T19:40:49.102022] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-23T19:40:49.102119] [INFO ] [MAIN ] Update Progress: 1211/2372 symbols completed. KNTK took 38.3s. Estimated remaining: 2h 34m 8s. Rate: 7.5 symbols/min [2025-09-23T19:40:49.273949] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:49.301359] [DEBUG] [LOCAL ] KOF: Loaded 25911 existing records from primary storage. [2025-09-23T19:40:49.301515] [INFO ] [MAIN ] KOF: Loaded 25911 existing records. [2025-09-23T19:40:49.484084] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:49.484442] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-23T19:40:49.484504] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-23T19:40:49.485423] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-23T19:40:49.485484] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-23T19:40:49.878552] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:40:49.925536] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:49.926575] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-23T19:40:50.006540] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-23T19:40:50.380885] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T19:40:50.602278] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-23T19:40:50.654271] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T19:40:51.402261] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-23T19:40:52.202548] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-23T19:40:52.324460] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:40:52.334160] [INFO ] [REMOTE ] KNX: Full fetch complete (75692 records). [2025-09-23T19:40:52.334373] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-23T19:40:52.739464] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-23T19:40:52.739659] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-23T19:40:52.740608] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-23T19:40:52.740754] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-23T19:40:52.742222] [DEBUG] [LOCAL ] KNX: Trimmed 75692 records to 52600 (keeping 200 days of data) [2025-09-23T19:40:53.032560] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-23T19:40:53.080706] [DEBUG] [LOCAL ] KNX: Primary data saved (52600 records). [2025-09-23T19:40:53.080857] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-23T19:40:53.080955] [INFO ] [MAIN ] Update Progress: 1212/2372 symbols completed. KNX took 30.8s. Estimated remaining: 2h 33m 56s. Rate: 7.5 symbols/min [2025-09-23T19:40:53.261628] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T19:40:53.288948] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:53.318174] [DEBUG] [LOCAL ] KOP: Loaded 17960 existing records from primary storage. [2025-09-23T19:40:53.318311] [INFO ] [MAIN ] KOP: Loaded 17960 existing records. [2025-09-23T19:40:53.501039] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:53.516627] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-23T19:40:53.517285] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-23T19:40:53.517982] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T19:40:53.523503] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-23T19:40:53.524331] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-23T19:40:53.807462] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-23T19:40:53.873666] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:54.602200] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-23T19:40:55.016078] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:40:55.252701] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T19:40:55.402217] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-23T19:40:55.527815] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-23T19:40:56.202159] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-23T19:40:56.426300] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T19:40:57.002212] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-23T19:40:57.334145] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T19:40:57.802195] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-23T19:40:58.490367] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:40:58.602221] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-23T19:40:59.274088] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:40:59.402215] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-23T19:41:00.202187] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-23T19:41:00.494233] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T19:41:01.002219] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-23T19:41:01.628923] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-09-23T19:41:01.802242] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-23T19:41:01.906003] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T19:41:02.330679] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T19:41:02.602215] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-23T19:41:02.884193] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T19:41:03.402235] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-23T19:41:03.901911] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T19:41:04.202213] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-23T19:41:04.567386] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:41:05.002238] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-23T19:41:05.803207] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-23T19:41:05.809510] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T19:41:06.034412] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T19:41:06.602212] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-23T19:41:07.015173] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T19:41:07.402243] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-23T19:41:08.085605] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:41:08.092749] [INFO ] [REMOTE ] KODK: Full fetch complete (63610 records). [2025-09-23T19:41:08.092905] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-23T19:41:08.207290] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-23T19:41:08.491660] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-23T19:41:08.491754] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-23T19:41:08.492685] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-23T19:41:08.492749] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-23T19:41:08.494023] [DEBUG] [LOCAL ] KODK: Trimmed 63610 records to 43429 (keeping 200 days of data) [2025-09-23T19:41:08.758399] [DEBUG] [LOCAL ] KODK: Primary data saved (43429 records). [2025-09-23T19:41:08.758529] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-23T19:41:08.758626] [INFO ] [MAIN ] Update Progress: 1213/2372 symbols completed. KODK took 32.3s. Estimated remaining: 2h 33m 55s. Rate: 7.5 symbols/min [2025-09-23T19:41:08.946094] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:08.951191] [DEBUG] [LOCAL ] KORE: Loaded 1940 existing records from primary storage. [2025-09-23T19:41:08.951309] [INFO ] [MAIN ] KORE: Loaded 1940 existing records. [2025-09-23T19:41:09.012949] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-23T19:41:09.138485] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:09.138804] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-23T19:41:09.138856] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-23T19:41:09.139159] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-23T19:41:09.139244] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-23T19:41:09.359703] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T19:41:09.558004] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:09.667014] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-23T19:41:09.796268] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T19:41:09.802131] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-23T19:41:10.602196] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-23T19:41:11.104189] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T19:41:11.109818] [INFO ] [REMOTE ] KOF: Full fetch complete (36932 records). [2025-09-23T19:41:11.109994] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-23T19:41:11.407301] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-23T19:41:11.513278] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-23T19:41:11.513373] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-23T19:41:11.514042] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-23T19:41:11.514107] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-23T19:41:11.515185] [DEBUG] [LOCAL ] KOF: Trimmed 36932 records to 25835 (keeping 200 days of data) [2025-09-23T19:41:11.681769] [DEBUG] [LOCAL ] KOF: Primary data saved (25835 records). [2025-09-23T19:41:11.681931] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-23T19:41:11.682074] [INFO ] [MAIN ] Update Progress: 1214/2372 symbols completed. KOF took 22.6s. Estimated remaining: 2h 33m 42s. Rate: 7.5 symbols/min [2025-09-23T19:41:11.876057] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:11.927045] [DEBUG] [LOCAL ] KOS: Loaded 53066 existing records from primary storage. [2025-09-23T19:41:11.927196] [INFO ] [MAIN ] KOS: Loaded 53066 existing records. [2025-09-23T19:41:12.108157] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:12.108420] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-23T19:41:12.108469] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-23T19:41:12.110753] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-23T19:41:12.110821] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-23T19:41:12.204499] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-23T19:41:12.479481] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T19:41:12.515339] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:12.924672] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-23T19:41:12.943614] [INFO ] [REMOTE ] KO: Full fetch complete (77604 records). [2025-09-23T19:41:12.944471] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T19:41:12.944597] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-23T19:41:13.009328] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-23T19:41:13.144773] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:41:13.145546] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:41:13.145631] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:41:13.145726] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-23T19:41:13.145797] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-23T19:41:13.145844] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-23T19:41:13.145924] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-23T19:41:13.146022] [INFO ] [MAIN ] Update Progress: 1215/2372 symbols completed. KO took 46.5s. Estimated remaining: 2h 33m 28s. Rate: 7.5 symbols/min [2025-09-23T19:41:13.314210] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:13.379091] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-23T19:41:13.379270] [INFO ] [MAIN ] KR: Loaded 53682 existing records. [2025-09-23T19:41:13.619991] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:13.620260] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-23T19:41:13.620334] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-23T19:41:13.621831] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-23T19:41:13.621893] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-23T19:41:13.802343] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-23T19:41:14.027282] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:14.070929] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T19:41:14.602201] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-23T19:41:15.402180] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-23T19:41:15.571778] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T19:41:15.923065] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T19:41:16.202196] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-23T19:41:16.481049] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T19:41:17.002223] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-23T19:41:17.802216] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-23T19:41:18.026966] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T19:41:18.570137] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T19:41:18.602198] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-23T19:41:18.656023] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T19:41:18.662488] [INFO ] [REMOTE ] KOP: Full fetch complete (25444 records). [2025-09-23T19:41:18.662711] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-23T19:41:19.029990] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-23T19:41:19.030080] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-23T19:41:19.030593] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-23T19:41:19.030633] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-23T19:41:19.031305] [DEBUG] [LOCAL ] KOP: Trimmed 25444 records to 17936 (keeping 200 days of data) [2025-09-23T19:41:19.143263] [DEBUG] [LOCAL ] KOP: Primary data saved (17936 records). [2025-09-23T19:41:19.143424] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-23T19:41:19.143547] [INFO ] [MAIN ] Update Progress: 1216/2372 symbols completed. KOP took 26.1s. Estimated remaining: 2h 33m 18s. Rate: 7.5 symbols/min [2025-09-23T19:41:19.314660] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:19.362296] [DEBUG] [LOCAL ] KRC: Loaded 48433 existing records from primary storage. [2025-09-23T19:41:19.362455] [INFO ] [MAIN ] KRC: Loaded 48433 existing records. [2025-09-23T19:41:19.407480] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-23T19:41:19.560523] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:19.560853] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-23T19:41:19.560913] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-23T19:41:19.562794] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-23T19:41:19.562859] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-23T19:41:19.892990] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T19:41:19.989825] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:20.182551] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T19:41:20.202166] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-23T19:41:21.002240] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-23T19:41:21.802255] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-23T19:41:22.002270] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T19:41:22.602211] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-23T19:41:22.683004] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T19:41:23.021740] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T19:41:23.367384] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T19:41:23.402143] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-23T19:41:24.202195] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-23T19:41:25.002273] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-23T19:41:25.584356] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-23T19:41:25.690017] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:41:25.726335] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:41:25.802197] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-23T19:41:26.170424] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T19:41:26.602265] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-23T19:41:27.402253] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-23T19:41:28.194367] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T19:41:28.203501] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-23T19:41:28.696460] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T19:41:29.002184] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-23T19:41:29.431717] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T19:41:29.504039] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T19:41:29.802201] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-23T19:41:30.602196] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-23T19:41:31.045116] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T19:41:31.402172] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-23T19:41:31.646031] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T19:41:32.202213] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-23T19:41:33.002190] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-23T19:41:33.481573] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T19:41:33.482752] [INFO ] [REMOTE ] KORE: Full fetch complete (6091 records). [2025-09-23T19:41:33.482823] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-23T19:41:33.619628] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-23T19:41:33.807395] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-23T19:41:33.903271] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-23T19:41:33.903350] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-23T19:41:33.903528] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-23T19:41:33.903566] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-23T19:41:33.903966] [DEBUG] [LOCAL ] KORE: Trimmed 6091 records to 1946 (keeping 200 days of data) [2025-09-23T19:41:33.914912] [DEBUG] [LOCAL ] KORE: Primary data saved (1946 records). [2025-09-23T19:41:33.915033] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-23T19:41:33.915156] [INFO ] [MAIN ] Update Progress: 1217/2372 symbols completed. KORE took 25.2s. Estimated remaining: 2h 33m 17s. Rate: 7.5 symbols/min [2025-09-23T19:41:34.091785] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:34.123710] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T19:41:34.163330] [DEBUG] [LOCAL ] KREF: Loaded 37002 existing records from primary storage. [2025-09-23T19:41:34.163477] [INFO ] [MAIN ] KREF: Loaded 37002 existing records. [2025-09-23T19:41:34.341192] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:34.341432] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-23T19:41:34.341479] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-23T19:41:34.342378] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-23T19:41:34.342438] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-23T19:41:34.607270] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-23T19:41:34.709771] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:35.286490] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T19:41:35.402189] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-23T19:41:36.058027] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:41:36.202194] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-23T19:41:36.690472] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:41:37.002191] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-23T19:41:37.802209] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-23T19:41:38.062900] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T19:41:38.602229] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-23T19:41:38.851491] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T19:41:39.018184] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T19:41:39.402208] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-23T19:41:40.009491] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T19:41:40.202206] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-23T19:41:40.927292] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:41:41.002151] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-23T19:41:41.431157] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:41:41.802194] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-23T19:41:42.526541] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:41:42.602228] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-23T19:41:43.334009] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T19:41:43.402169] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-23T19:41:43.871957] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:41:44.202258] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-23T19:41:44.986815] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T19:41:45.002156] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-23T19:41:45.802177] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-23T19:41:46.059925] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T19:41:46.536769] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:41:46.602172] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-23T19:41:46.885244] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T19:41:47.402213] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-23T19:41:48.202161] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-23T19:41:48.311522] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T19:41:48.319755] [INFO ] [REMOTE ] KRC: Full fetch complete (69573 records). [2025-09-23T19:41:48.319896] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-23T19:41:48.735978] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-23T19:41:48.736090] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-23T19:41:48.737245] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-23T19:41:48.737336] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-23T19:41:48.760409] [DEBUG] [LOCAL ] KRC: Trimmed 69573 records to 48420 (keeping 200 days of data) [2025-09-23T19:41:48.762341] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T19:41:49.002958] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-23T19:41:49.085709] [DEBUG] [LOCAL ] KRC: Primary data saved (48420 records). [2025-09-23T19:41:49.085862] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-23T19:41:49.085965] [INFO ] [MAIN ] Update Progress: 1218/2372 symbols completed. KRC took 29.9s. Estimated remaining: 2h 33m 16s. Rate: 7.5 symbols/min [2025-09-23T19:41:49.261582] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:49.307778] [DEBUG] [LOCAL ] KRG: Loaded 49118 existing records from primary storage. [2025-09-23T19:41:49.307954] [INFO ] [MAIN ] KRG: Loaded 49118 existing records. [2025-09-23T19:41:49.484814] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:49.485122] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-23T19:41:49.485173] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-23T19:41:49.486390] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-23T19:41:49.486454] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-23T19:41:49.807007] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-23T19:41:49.903317] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:49.919230] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:41:49.928859] [INFO ] [REMOTE ] KOS: Full fetch complete (76840 records). [2025-09-23T19:41:49.929045] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-23T19:41:50.328561] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-23T19:41:50.328673] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-23T19:41:50.329628] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-23T19:41:50.329717] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-23T19:41:50.331182] [DEBUG] [LOCAL ] KOS: Trimmed 76840 records to 53066 (keeping 200 days of data) [2025-09-23T19:41:50.609603] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-23T19:41:50.632458] [DEBUG] [LOCAL ] KOS: Primary data saved (53066 records). [2025-09-23T19:41:50.632552] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-23T19:41:50.632661] [INFO ] [MAIN ] Update Progress: 1219/2372 symbols completed. KOS took 39.0s. Estimated remaining: 2h 33m 2s. Rate: 7.5 symbols/min [2025-09-23T19:41:50.808808] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:50.808992] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-23T19:41:50.809045] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-23T19:41:50.809189] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-23T19:41:50.809232] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-23T19:41:50.809272] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-23T19:41:50.809304] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-23T19:41:51.181674] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:51.205241] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-23T19:41:51.214152] [INFO ] [REMOTE ] KR: Full fetch complete (77679 records). [2025-09-23T19:41:51.214362] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-23T19:41:51.416045] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-23T19:41:51.544024] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T19:41:51.654172] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-23T19:41:51.654269] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-23T19:41:51.655446] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-23T19:41:51.655758] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-23T19:41:51.658610] [DEBUG] [LOCAL ] KR: Trimmed 77679 records to 53682 (keeping 200 days of data) [2025-09-23T19:41:52.007221] [DEBUG] [LOCAL ] KR: Primary data saved (53682 records). [2025-09-23T19:41:52.007385] [INFO ] [MAIN ] KR: Full history saved. [2025-09-23T19:41:52.007479] [INFO ] [MAIN ] Update Progress: 1220/2372 symbols completed. KR took 38.9s. Estimated remaining: 2h 32m 48s. Rate: 7.5 symbols/min [2025-09-23T19:41:52.109705] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:41:52.123466] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-23T19:41:52.209943] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:52.204614] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-23T19:41:52.241911] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:41:52.273103] [DEBUG] [LOCAL ] KRO: Loaded 25937 existing records from primary storage. [2025-09-23T19:41:52.273255] [INFO ] [MAIN ] KRO: Loaded 25937 existing records. [2025-09-23T19:41:52.452989] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:52.453275] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-23T19:41:52.453329] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-23T19:41:52.454099] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-23T19:41:52.454160] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-23T19:41:52.812786] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:53.002250] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-23T19:41:53.194356] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:41:53.194841] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-23T19:41:53.617362] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T19:41:53.802217] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-23T19:41:54.602251] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-23T19:41:55.224721] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:41:55.402187] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-23T19:41:56.170862] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T19:41:56.202141] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-23T19:41:56.233556] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T19:41:57.002242] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-23T19:41:57.689419] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:41:57.784847] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T19:41:57.802132] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-23T19:41:58.602210] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-23T19:41:59.375440] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:41:59.402172] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-23T19:42:00.202183] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-23T19:42:00.337002] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T19:42:01.002208] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-23T19:42:01.122762] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T19:42:01.320846] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T19:42:01.802230] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-23T19:42:02.602210] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-23T19:42:03.402240] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-23T19:42:03.697766] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-23T19:42:04.202244] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-23T19:42:04.515507] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-23T19:42:04.521768] [INFO ] [REMOTE ] KREF: Full fetch complete (51713 records). [2025-09-23T19:42:04.521894] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-23T19:42:04.924934] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-23T19:42:04.934919] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-23T19:42:04.935880] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-23T19:42:04.935968] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-23T19:42:04.937807] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T19:42:04.945542] [DEBUG] [LOCAL ] KREF: Trimmed 51713 records to 37022 (keeping 200 days of data) [2025-09-23T19:42:05.008432] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-23T19:42:05.169780] [DEBUG] [LOCAL ] KREF: Primary data saved (37022 records). [2025-09-23T19:42:05.169929] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-23T19:42:05.170033] [INFO ] [MAIN ] Update Progress: 1221/2372 symbols completed. KREF took 31.3s. Estimated remaining: 2h 32m 45s. Rate: 7.5 symbols/min [2025-09-23T19:42:05.377246] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-23T19:42:05.379397] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:05.425457] [DEBUG] [LOCAL ] KRP: Loaded 37738 existing records from primary storage. [2025-09-23T19:42:05.425667] [INFO ] [MAIN ] KRP: Loaded 37738 existing records. [2025-09-23T19:42:05.612079] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:05.612827] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-23T19:42:05.612948] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-23T19:42:05.614138] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-23T19:42:05.614222] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-23T19:42:05.764545] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T19:42:05.804229] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-23T19:42:06.037883] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:06.053866] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T19:42:06.602215] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-23T19:42:07.402194] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-23T19:42:07.487146] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T19:42:07.554170] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T19:42:08.102728] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T19:42:08.202213] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-23T19:42:09.002213] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-23T19:42:09.802220] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-23T19:42:10.111754] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T19:42:10.602161] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-23T19:42:10.628263] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:42:11.096212] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:42:11.402191] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-23T19:42:12.081418] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:42:12.202243] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-23T19:42:12.838349] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:42:13.002205] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-23T19:42:13.802221] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-23T19:42:13.928268] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:42:13.936453] [INFO ] [REMOTE ] KRMN: Full fetch complete (49561 records). [2025-09-23T19:42:13.936570] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-23T19:42:14.133904] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 153 unique days, need 200 days [2025-09-23T19:42:14.134693] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:42:14.134786] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:42:14.134887] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-23T19:42:14.135011] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-23T19:42:14.135068] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-23T19:42:14.135129] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-23T19:42:14.135261] [INFO ] [MAIN ] Update Progress: 1222/2372 symbols completed. KRMN took 23.5s. Estimated remaining: 2h 32m 38s. Rate: 7.5 symbols/min [2025-09-23T19:42:14.312704] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:14.368159] [DEBUG] [LOCAL ] KSS: Loaded 53610 existing records from primary storage. [2025-09-23T19:42:14.368373] [INFO ] [MAIN ] KSS: Loaded 53610 existing records. [2025-09-23T19:42:14.595253] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:14.595613] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-23T19:42:14.595708] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-23T19:42:14.597377] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-23T19:42:14.597458] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-23T19:42:14.618863] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-23T19:42:14.974273] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:15.402156] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-23T19:42:15.823848] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-23T19:42:15.925693] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-23T19:42:16.202225] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-23T19:42:16.936388] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-23T19:42:17.002186] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-23T19:42:17.361942] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T19:42:17.690730] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-23T19:42:17.802232] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-23T19:42:18.305704] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T19:42:18.602258] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-23T19:42:18.713685] [DEBUG] [REMOTE ] KRO: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-23T19:42:18.714162] [WARN ] [REMOTE ] KRO: No data returned for month 2025-06 [2025-09-23T19:42:19.402275] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-23T19:42:19.661179] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T19:42:20.193419] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T19:42:20.202167] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-23T19:42:21.002223] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-23T19:42:21.561012] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T19:42:21.802223] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-23T19:42:22.106316] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T19:42:22.602220] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-23T19:42:23.402219] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-23T19:42:23.446378] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:42:24.180295] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:42:24.202152] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-23T19:42:24.536977] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:42:24.541863] [INFO ] [REMOTE ] KRO: Full fetch complete (31146 records). [2025-09-23T19:42:24.541947] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-23T19:42:24.726218] [WARN ] [VALIDATOR ] KRO: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:42:24.726756] [FATAL] [MAIN ] KRO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:42:24.726841] [WARN ] [MAIN ] KRO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:42:24.726923] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-23T19:42:24.727034] [DEBUG] [LOCAL ] KRO: No primary data file found to delete. [2025-09-23T19:42:24.727108] [INFO ] [LOCAL ] KRO: Starting deletion of derivative data. [2025-09-23T19:42:24.727638] [DEBUG] [LOCAL ] KRO: Deleted derivative data file. [2025-09-23T19:42:24.727781] [INFO ] [MAIN ] Update Progress: 1223/2372 symbols completed. KRO took 32.7s. Estimated remaining: 2h 32m 32s. Rate: 7.5 symbols/min [2025-09-23T19:42:24.895261] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:24.943516] [DEBUG] [LOCAL ] KT: Loaded 45662 existing records from primary storage. [2025-09-23T19:42:24.943690] [INFO ] [MAIN ] KT: Loaded 45662 existing records. [2025-09-23T19:42:25.009257] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-23T19:42:25.136348] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:25.136696] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-23T19:42:25.136777] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-23T19:42:25.137933] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-23T19:42:25.137996] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-23T19:42:25.546554] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:25.686551] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:42:25.698084] [INFO ] [REMOTE ] KRG: Full fetch complete (70955 records). [2025-09-23T19:42:25.698268] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-23T19:42:25.807292] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-23T19:42:26.123954] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-23T19:42:26.124053] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-23T19:42:26.124964] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-23T19:42:26.125053] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-23T19:42:26.126609] [DEBUG] [LOCAL ] KRG: Trimmed 70955 records to 49153 (keeping 200 days of data) [2025-09-23T19:42:26.479664] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T19:42:26.505195] [DEBUG] [LOCAL ] KRG: Primary data saved (49153 records). [2025-09-23T19:42:26.505395] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-23T19:42:26.505690] [INFO ] [MAIN ] Update Progress: 1224/2372 symbols completed. KRG took 37.4s. Estimated remaining: 2h 32m 18s. Rate: 7.5 symbols/min [2025-09-23T19:42:26.607533] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-23T19:42:26.684434] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:26.730219] [DEBUG] [LOCAL ] KTB: Loaded 41193 existing records from primary storage. [2025-09-23T19:42:26.730395] [INFO ] [MAIN ] KTB: Loaded 41193 existing records. [2025-09-23T19:42:26.918174] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:26.918451] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-23T19:42:26.918595] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-23T19:42:26.919696] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-23T19:42:26.919758] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-23T19:42:27.306263] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:27.402225] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-23T19:42:27.462614] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:42:28.202295] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-23T19:42:29.002349] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-23T19:42:29.428975] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-23T19:42:29.735799] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (3.13 seconds). [2025-09-23T19:42:29.802229] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-23T19:42:30.177532] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T19:42:30.250683] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-23T19:42:30.602191] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-23T19:42:30.796118] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T19:42:31.402216] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-23T19:42:32.072046] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T19:42:32.202142] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-23T19:42:32.695690] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T19:42:33.002193] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-23T19:42:33.793505] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:42:33.803089] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-23T19:42:34.486249] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T19:42:34.602221] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-23T19:42:35.358857] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T19:42:35.402250] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-23T19:42:36.202199] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-23T19:42:36.643393] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T19:42:37.002179] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-23T19:42:37.039847] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:42:37.802201] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-23T19:42:37.848874] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:42:38.408033] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:42:38.414006] [INFO ] [REMOTE ] KRP: Full fetch complete (54899 records). [2025-09-23T19:42:38.414172] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-23T19:42:38.603671] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-23T19:42:38.813160] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-23T19:42:38.813257] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-23T19:42:38.814109] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-23T19:42:38.814246] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-23T19:42:38.818759] [DEBUG] [LOCAL ] KRP: Trimmed 54899 records to 37613 (keeping 200 days of data) [2025-09-23T19:42:39.079165] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T19:42:39.110139] [DEBUG] [LOCAL ] KRP: Primary data saved (37613 records). [2025-09-23T19:42:39.110312] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-23T19:42:39.110576] [INFO ] [MAIN ] Update Progress: 1225/2372 symbols completed. KRP took 33.9s. Estimated remaining: 2h 32m 15s. Rate: 7.5 symbols/min [2025-09-23T19:42:39.290869] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:39.306994] [DEBUG] [LOCAL ] KTF: Loaded 13028 existing records from primary storage. [2025-09-23T19:42:39.307177] [INFO ] [MAIN ] KTF: Loaded 13028 existing records. [2025-09-23T19:42:39.410085] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-23T19:42:39.494370] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:39.494669] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-23T19:42:39.494730] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-23T19:42:39.495219] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-23T19:42:39.495299] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-23T19:42:39.868764] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:40.202192] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-23T19:42:40.561482] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-23T19:42:40.847447] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:42:41.002205] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-23T19:42:41.802244] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-23T19:42:42.125562] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T19:42:42.602173] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-23T19:42:42.723326] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:42:42.759028] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T19:42:43.402221] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-23T19:42:43.982164] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T19:42:44.202179] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-23T19:42:44.239358] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T19:42:45.002250] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-23T19:42:45.801798] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T19:42:45.810319] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-23T19:42:46.199112] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:42:46.602203] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-23T19:42:47.402200] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-23T19:42:47.715864] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T19:42:48.086821] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:42:48.093273] [INFO ] [REMOTE ] KTB: Full fetch complete (57393 records). [2025-09-23T19:42:48.093387] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-23T19:42:48.207344] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-23T19:42:48.489149] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-23T19:42:48.489261] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-23T19:42:48.490199] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-23T19:42:48.490268] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-23T19:42:48.491603] [DEBUG] [LOCAL ] KTB: Trimmed 57393 records to 41133 (keeping 200 days of data) [2025-09-23T19:42:48.786384] [DEBUG] [LOCAL ] KTB: Primary data saved (41133 records). [2025-09-23T19:42:48.786994] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-23T19:42:48.788935] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T19:42:48.787897] [INFO ] [MAIN ] Update Progress: 1226/2372 symbols completed. KTB took 22.3s. Estimated remaining: 2h 32m 8s. Rate: 7.5 symbols/min [2025-09-23T19:42:48.971830] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:48.972026] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-23T19:42:48.972063] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-23T19:42:48.972216] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-23T19:42:48.972271] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-23T19:42:48.972339] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-23T19:42:48.972375] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-23T19:42:49.007358] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-23T19:42:49.373744] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:49.711436] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T19:42:49.802196] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-23T19:42:50.075401] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:42:50.468879] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-23T19:42:50.602181] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-23T19:42:51.402178] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-23T19:42:51.623738] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T19:42:52.202243] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-23T19:42:53.002228] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-23T19:42:53.627828] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-23T19:42:53.636770] [INFO ] [REMOTE ] KSS: Full fetch complete (77640 records). [2025-09-23T19:42:53.636911] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-23T19:42:53.802354] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-23T19:42:53.874411] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T19:42:53.996582] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T19:42:54.115440] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-23T19:42:54.115577] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-23T19:42:54.116697] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-23T19:42:54.116765] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-23T19:42:54.121368] [DEBUG] [LOCAL ] KSS: Trimmed 77640 records to 53608 (keeping 200 days of data) [2025-09-23T19:42:54.476725] [DEBUG] [LOCAL ] KSS: Primary data saved (53608 records). [2025-09-23T19:42:54.476868] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-23T19:42:54.477049] [INFO ] [MAIN ] Update Progress: 1227/2372 symbols completed. KSS took 40.3s. Estimated remaining: 2h 31m 58s. Rate: 7.5 symbols/min [2025-09-23T19:42:54.603991] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-23T19:42:54.656961] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:54.682724] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:42:54.726703] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-23T19:42:54.726890] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-09-23T19:42:54.911848] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:54.913167] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-23T19:42:54.913224] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-23T19:42:54.914969] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-23T19:42:54.915061] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-23T19:42:55.275102] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:55.402145] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-23T19:42:55.487112] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T19:42:56.202189] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-23T19:42:57.002168] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-23T19:42:57.247994] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T19:42:57.452110] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:42:57.549736] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:42:57.558617] [INFO ] [REMOTE ] KT: Full fetch complete (66827 records). [2025-09-23T19:42:57.558755] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-23T19:42:57.807374] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-23T19:42:57.957406] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-23T19:42:57.957500] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-23T19:42:57.958575] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-23T19:42:57.958659] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-23T19:42:57.960149] [DEBUG] [LOCAL ] KT: Trimmed 66827 records to 45670 (keeping 200 days of data) [2025-09-23T19:42:58.245093] [DEBUG] [LOCAL ] KT: Primary data saved (45670 records). [2025-09-23T19:42:58.245268] [INFO ] [MAIN ] KT: Full history saved. [2025-09-23T19:42:58.245395] [INFO ] [MAIN ] Update Progress: 1228/2372 symbols completed. KT took 33.5s. Estimated remaining: 2h 31m 46s. Rate: 7.5 symbols/min [2025-09-23T19:42:58.416622] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:58.466426] [DEBUG] [LOCAL ] KVYO: Loaded 49852 existing records from primary storage. [2025-09-23T19:42:58.466607] [INFO ] [MAIN ] KVYO: Loaded 49852 existing records. [2025-09-23T19:42:58.608315] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-23T19:42:58.650234] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:58.650527] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-23T19:42:58.650573] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-23T19:42:58.651796] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-23T19:42:58.651856] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-23T19:42:58.928348] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T19:42:59.044145] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:59.402194] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-23T19:42:59.566971] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T19:43:00.202237] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-23T19:43:00.783380] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T19:43:01.002253] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-23T19:43:01.165056] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T19:43:01.796427] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T19:43:01.802171] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-23T19:43:02.602201] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-23T19:43:03.273263] [DEBUG] [REMOTE ] KVUE: Error fetching primary data for 2025-01: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-09-23T19:43:03.273443] [WARN ] [REMOTE ] KVUE: No data returned for month 2025-01 [2025-09-23T19:43:03.402208] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-23T19:43:03.425008] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:43:04.202239] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-23T19:43:05.007276] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-23T19:43:05.018451] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T19:43:05.277309] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T19:43:05.279384] [INFO ] [REMOTE ] KTF: Full fetch complete (18298 records). [2025-09-23T19:43:05.279454] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-23T19:43:05.399857] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-23T19:43:05.684556] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-23T19:43:05.684640] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-23T19:43:05.685152] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-23T19:43:05.685215] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-23T19:43:05.686453] [DEBUG] [LOCAL ] KTF: Trimmed 18298 records to 13055 (keeping 200 days of data) [2025-09-23T19:43:05.763125] [DEBUG] [LOCAL ] KTF: Primary data saved (13055 records). [2025-09-23T19:43:05.763258] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-23T19:43:05.763342] [INFO ] [MAIN ] Update Progress: 1229/2372 symbols completed. KTF took 26.7s. Estimated remaining: 2h 31m 38s. Rate: 7.5 symbols/min [2025-09-23T19:43:05.807399] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-23T19:43:05.938772] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:05.983264] [DEBUG] [LOCAL ] KW: Loaded 40648 existing records from primary storage. [2025-09-23T19:43:05.983409] [INFO ] [MAIN ] KW: Loaded 40648 existing records. [2025-09-23T19:43:06.166236] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:06.166521] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-23T19:43:06.166570] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-23T19:43:06.167452] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-23T19:43:06.167512] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-23T19:43:06.325291] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T19:43:06.530138] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:06.602212] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-23T19:43:07.027760] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T19:43:07.402199] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-23T19:43:08.202223] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-23T19:43:08.993156] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T19:43:09.002153] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-23T19:43:09.534897] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T19:43:09.628912] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T19:43:09.802236] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-23T19:43:10.539845] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T19:43:10.541223] [INFO ] [REMOTE ] KUKE: Full fetch complete (7852 records). [2025-09-23T19:43:10.541292] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-23T19:43:10.607401] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-23T19:43:10.726489] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:43:10.726770] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:43:10.726855] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:43:10.726928] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-23T19:43:10.726992] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-23T19:43:10.727044] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-23T19:43:10.727110] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-23T19:43:10.727192] [INFO ] [MAIN ] Update Progress: 1230/2372 symbols completed. KUKE took 21.9s. Estimated remaining: 2h 31m 27s. Rate: 7.5 symbols/min [2025-09-23T19:43:10.903939] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:10.922561] [DEBUG] [LOCAL ] KWR: Loaded 16817 existing records from primary storage. [2025-09-23T19:43:10.922735] [INFO ] [MAIN ] KWR: Loaded 16817 existing records. [2025-09-23T19:43:11.103011] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:11.103248] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-23T19:43:11.103295] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-23T19:43:11.103848] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-23T19:43:11.103907] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-23T19:43:11.407335] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-23T19:43:11.474515] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:12.113102] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:43:12.202190] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-23T19:43:13.002162] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-23T19:43:13.219313] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T19:43:13.396196] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-23T19:43:13.802196] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-23T19:43:14.454024] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:43:14.602225] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-23T19:43:15.251205] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T19:43:15.402206] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-23T19:43:16.202169] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-23T19:43:16.326506] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T19:43:16.576532] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T19:43:17.002230] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-23T19:43:17.802228] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-23T19:43:18.077799] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T19:43:18.602188] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-23T19:43:18.839157] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T19:43:18.960255] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-23T19:43:19.402213] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-23T19:43:19.997190] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:43:20.202237] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-23T19:43:21.004338] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-23T19:43:21.011490] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T19:43:21.801207] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T19:43:21.810461] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-23T19:43:22.372026] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T19:43:22.451880] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T19:43:22.602197] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-23T19:43:23.402225] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-23T19:43:23.515191] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T19:43:24.202193] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-23T19:43:24.932922] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:43:25.002225] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-23T19:43:25.802226] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-23T19:43:25.990150] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T19:43:26.359343] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T19:43:26.602197] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-23T19:43:27.218511] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:43:27.402203] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-23T19:43:28.017023] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:43:28.202192] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-23T19:43:29.002265] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-23T19:43:29.087576] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T19:43:29.678123] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:43:29.690138] [INFO ] [REMOTE ] KW: Full fetch complete (56838 records). [2025-09-23T19:43:29.690450] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-23T19:43:29.808723] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-23T19:43:30.285661] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-23T19:43:30.285818] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-23T19:43:30.286739] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-23T19:43:30.286802] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-23T19:43:30.288226] [DEBUG] [LOCAL ] KW: Trimmed 56838 records to 40660 (keeping 200 days of data) [2025-09-23T19:43:30.537915] [DEBUG] [LOCAL ] KW: Primary data saved (40660 records). [2025-09-23T19:43:30.538095] [INFO ] [MAIN ] KW: Full history saved. [2025-09-23T19:43:30.538194] [INFO ] [MAIN ] Update Progress: 1231/2372 symbols completed. KW took 24.8s. Estimated remaining: 2h 31m 30s. Rate: 7.5 symbols/min [2025-09-23T19:43:30.607357] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-23T19:43:30.726024] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:30.775811] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:43:30.803875] [DEBUG] [LOCAL ] KYN: Loaded 30236 existing records from primary storage. [2025-09-23T19:43:30.804268] [INFO ] [MAIN ] KYN: Loaded 30236 existing records. [2025-09-23T19:43:31.000342] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:31.000741] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-23T19:43:31.000818] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-23T19:43:31.001919] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-23T19:43:31.001999] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-23T19:43:31.371895] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:31.402190] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-23T19:43:31.505063] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T19:43:31.514489] [INFO ] [REMOTE ] KVYO: Full fetch complete (71365 records). [2025-09-23T19:43:31.514732] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-23T19:43:31.684282] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T19:43:31.964527] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-23T19:43:31.964632] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-23T19:43:31.965926] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-23T19:43:31.965991] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-23T19:43:31.967413] [DEBUG] [LOCAL ] KVYO: Trimmed 71365 records to 49905 (keeping 200 days of data) [2025-09-23T19:43:32.224775] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-23T19:43:32.260816] [DEBUG] [LOCAL ] KVYO: Primary data saved (49905 records). [2025-09-23T19:43:32.260959] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-23T19:43:32.261059] [INFO ] [MAIN ] Update Progress: 1232/2372 symbols completed. KVYO took 34.0s. Estimated remaining: 2h 31m 17s. Rate: 7.5 symbols/min [2025-09-23T19:43:32.434759] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:32.477307] [DEBUG] [LOCAL ] L: Loaded 40967 existing records from primary storage. [2025-09-23T19:43:32.477480] [INFO ] [MAIN ] L: Loaded 40967 existing records. [2025-09-23T19:43:32.662713] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:32.663013] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-23T19:43:32.663062] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-23T19:43:32.664111] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-23T19:43:32.664172] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-23T19:43:33.004588] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-23T19:43:33.063396] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:43:33.089359] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:33.239047] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T19:43:33.802193] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-23T19:43:34.602203] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-23T19:43:34.778738] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T19:43:34.954765] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T19:43:35.402230] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-23T19:43:36.128575] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T19:43:36.202223] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-23T19:43:36.788751] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T19:43:37.002200] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-23T19:43:37.627432] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T19:43:37.802204] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-23T19:43:38.379095] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T19:43:38.602222] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-23T19:43:38.967756] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T19:43:39.402268] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-23T19:43:40.202242] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-23T19:43:40.530019] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:43:40.539105] [INFO ] [REMOTE ] KVUE: Full fetch complete (69875 records). [2025-09-23T19:43:40.539261] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-23T19:43:40.733913] [WARN ] [VALIDATOR ] KVUE: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:43:40.734835] [FATAL] [MAIN ] KVUE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:43:40.734953] [WARN ] [MAIN ] KVUE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:43:40.735060] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-23T19:43:40.735200] [DEBUG] [LOCAL ] KVUE: No primary data file found to delete. [2025-09-23T19:43:40.735256] [INFO ] [LOCAL ] KVUE: Starting deletion of derivative data. [2025-09-23T19:43:40.735710] [DEBUG] [LOCAL ] KVUE: Deleted derivative data file. [2025-09-23T19:43:40.735816] [INFO ] [MAIN ] Update Progress: 1233/2372 symbols completed. KVUE took 46.3s. Estimated remaining: 2h 31m 9s. Rate: 7.5 symbols/min [2025-09-23T19:43:40.925701] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:40.939687] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T19:43:40.994708] [DEBUG] [LOCAL ] LAC: Loaded 52302 existing records from primary storage. [2025-09-23T19:43:40.994870] [INFO ] [MAIN ] LAC: Loaded 52302 existing records. [2025-09-23T19:43:41.007798] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-23T19:43:41.176919] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T19:43:41.216396] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:41.216880] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-23T19:43:41.216938] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-23T19:43:41.218016] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-23T19:43:41.218078] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-23T19:43:41.589775] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:41.802275] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-23T19:43:42.091504] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T19:43:42.602227] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-23T19:43:43.402177] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-23T19:43:43.756637] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T19:43:43.802554] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:43:44.202240] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-23T19:43:44.312793] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T19:43:44.316518] [INFO ] [REMOTE ] KWR: Full fetch complete (24011 records). [2025-09-23T19:43:44.316684] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-23T19:43:44.693279] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-23T19:43:44.693366] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-23T19:43:44.693899] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-23T19:43:44.693959] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-23T19:43:44.694634] [DEBUG] [LOCAL ] KWR: Trimmed 24011 records to 16787 (keeping 200 days of data) [2025-09-23T19:43:44.805277] [DEBUG] [LOCAL ] KWR: Primary data saved (16787 records). [2025-09-23T19:43:44.805433] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-23T19:43:44.805520] [INFO ] [MAIN ] Update Progress: 1234/2372 symbols completed. KWR took 34.1s. Estimated remaining: 2h 30m 58s. Rate: 7.5 symbols/min [2025-09-23T19:43:44.975900] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:44.999389] [DEBUG] [LOCAL ] LAD: Loaded 23764 existing records from primary storage. [2025-09-23T19:43:44.999523] [INFO ] [MAIN ] LAD: Loaded 23764 existing records. [2025-09-23T19:43:45.010584] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-23T19:43:45.182818] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:45.183058] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-23T19:43:45.183106] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-23T19:43:45.183816] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-23T19:43:45.183878] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-23T19:43:45.544280] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:45.802217] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-23T19:43:45.849032] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:43:46.433543] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T19:43:46.602222] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-23T19:43:47.059959] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T19:43:47.402206] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-23T19:43:48.072617] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T19:43:48.202194] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-23T19:43:48.849779] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T19:43:49.002201] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-23T19:43:49.408150] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:43:49.802263] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-23T19:43:50.317287] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T19:43:50.602210] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-23T19:43:51.206070] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:43:51.402215] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-23T19:43:51.533921] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:43:52.202181] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-23T19:43:52.656346] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:43:53.002245] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-23T19:43:53.439833] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T19:43:53.802244] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-23T19:43:54.602205] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-23T19:43:54.851788] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T19:43:54.904350] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T19:43:55.402237] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-23T19:43:55.727917] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:43:55.734929] [INFO ] [REMOTE ] L: Full fetch complete (59551 records). [2025-09-23T19:43:55.735076] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-23T19:43:56.116204] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-23T19:43:56.116291] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-23T19:43:56.117181] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-23T19:43:56.117245] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-23T19:43:56.118480] [DEBUG] [LOCAL ] L: Trimmed 59551 records to 40938 (keeping 200 days of data) [2025-09-23T19:43:56.211359] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-23T19:43:56.379045] [DEBUG] [LOCAL ] L: Primary data saved (40938 records). [2025-09-23T19:43:56.379184] [INFO ] [MAIN ] L: Full history saved. [2025-09-23T19:43:56.379271] [INFO ] [MAIN ] Update Progress: 1235/2372 symbols completed. L took 24.1s. Estimated remaining: 2h 30m 53s. Rate: 7.5 symbols/min [2025-09-23T19:43:56.562619] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:56.582321] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T19:43:56.624147] [DEBUG] [LOCAL ] LADR: Loaded 38703 existing records from primary storage. [2025-09-23T19:43:56.624307] [INFO ] [MAIN ] LADR: Loaded 38703 existing records. [2025-09-23T19:43:56.811991] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:56.812255] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-23T19:43:56.812304] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-23T19:43:56.813238] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-23T19:43:56.813301] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-23T19:43:57.002196] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-23T19:43:57.198276] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:57.442490] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T19:43:57.802286] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-23T19:43:58.602274] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-23T19:43:58.901567] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T19:43:58.955064] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T19:43:58.960339] [INFO ] [REMOTE ] KYN: Full fetch complete (44940 records). [2025-09-23T19:43:58.960519] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-23T19:43:59.336155] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-23T19:43:59.336235] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-23T19:43:59.336913] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-23T19:43:59.336975] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-23T19:43:59.337953] [DEBUG] [LOCAL ] KYN: Trimmed 44940 records to 30159 (keeping 200 days of data) [2025-09-23T19:43:59.425873] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-23T19:43:59.531002] [DEBUG] [LOCAL ] KYN: Primary data saved (30159 records). [2025-09-23T19:43:59.531234] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-23T19:43:59.531443] [INFO ] [MAIN ] Update Progress: 1236/2372 symbols completed. KYN took 29.0s. Estimated remaining: 2h 30m 40s. Rate: 7.5 symbols/min [2025-09-23T19:43:59.709376] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:59.727043] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T19:43:59.737343] [DEBUG] [LOCAL ] LANV: Loaded 2697 existing records from primary storage. [2025-09-23T19:43:59.737450] [INFO ] [MAIN ] LANV: Loaded 2697 existing records. [2025-09-23T19:43:59.910844] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:59.911161] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-23T19:43:59.911217] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-23T19:43:59.911445] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-23T19:43:59.911546] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-23T19:44:00.207296] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-23T19:44:00.272426] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:00.967998] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T19:44:01.002165] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-23T19:44:01.271304] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T19:44:01.802250] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-23T19:44:02.357500] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T19:44:02.390371] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T19:44:02.602241] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-23T19:44:03.402229] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-23T19:44:03.908113] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T19:44:04.106991] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T19:44:04.202213] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-23T19:44:05.002205] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-23T19:44:05.558596] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T19:44:05.802189] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-23T19:44:05.904406] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T19:44:06.602871] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-23T19:44:06.605882] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T19:44:07.402233] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-23T19:44:08.004094] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:44:08.202191] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-23T19:44:08.535133] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T19:44:09.007392] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-23T19:44:09.033546] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:44:09.802237] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-23T19:44:10.287571] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-23T19:44:10.371611] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T19:44:10.602260] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-23T19:44:11.034405] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T19:44:11.402259] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-23T19:44:11.680085] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-23T19:44:12.202249] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-23T19:44:12.569746] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-23T19:44:13.002298] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-23T19:44:13.589994] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T19:44:13.802252] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-23T19:44:14.602272] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-23T19:44:14.955142] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T19:44:15.402212] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-23T19:44:16.187428] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T19:44:16.202148] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-23T19:44:16.315863] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T19:44:16.319737] [INFO ] [REMOTE ] LAD: Full fetch complete (35212 records). [2025-09-23T19:44:16.319845] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-23T19:44:16.728893] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-23T19:44:16.729017] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-23T19:44:16.729681] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-23T19:44:16.729743] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-23T19:44:16.730598] [DEBUG] [LOCAL ] LAD: Trimmed 35212 records to 23712 (keeping 200 days of data) [2025-09-23T19:44:16.889590] [DEBUG] [LOCAL ] LAD: Primary data saved (23712 records). [2025-09-23T19:44:16.889756] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-23T19:44:16.889854] [INFO ] [MAIN ] Update Progress: 1237/2372 symbols completed. LAD took 32.1s. Estimated remaining: 2h 30m 41s. Rate: 7.5 symbols/min [2025-09-23T19:44:17.002201] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-23T19:44:17.215209] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T19:44:17.802211] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-23T19:44:18.602279] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-23T19:44:18.743592] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T19:44:18.792036] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T19:44:19.142535] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T19:44:19.402253] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-23T19:44:20.202240] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-23T19:44:20.962851] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T19:44:20.964287] [INFO ] [REMOTE ] LANV: Full fetch complete (4392 records). [2025-09-23T19:44:20.964358] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-23T19:44:21.007708] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-23T19:44:21.344934] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-23T19:44:21.345141] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-23T19:44:21.345502] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-23T19:44:21.358231] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-23T19:44:21.380874] [DEBUG] [LOCAL ] LANV: Trimmed 4392 records to 2730 (keeping 200 days of data) [2025-09-23T19:44:21.384147] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T19:44:21.420776] [DEBUG] [LOCAL ] LANV: Primary data saved (2730 records). [2025-09-23T19:44:21.420961] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-23T19:44:21.421088] [INFO ] [MAIN ] Update Progress: 1238/2372 symbols completed. LANV took 21.9s. Estimated remaining: 2h 30m 30s. Rate: 7.5 symbols/min [2025-09-23T19:44:21.802390] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-23T19:44:22.867816] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T19:44:22.877399] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-23T19:44:23.780518] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T19:44:23.792549] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-23T19:44:23.896483] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T19:44:24.202236] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-23T19:44:25.794919] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T19:44:25.802056] [INFO ] [REMOTE ] LADR: Full fetch complete (54987 records). [2025-09-23T19:44:25.802211] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-23T19:44:26.216863] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-23T19:44:26.240821] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-23T19:44:26.240899] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-23T19:44:26.242247] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-23T19:44:26.242330] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-23T19:44:26.243606] [DEBUG] [LOCAL ] LADR: Trimmed 54987 records to 38692 (keeping 200 days of data) [2025-09-23T19:44:26.244604] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-23T19:44:26.489636] [DEBUG] [LOCAL ] LADR: Primary data saved (38692 records). [2025-09-23T19:44:26.489814] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-23T19:44:26.489900] [INFO ] [MAIN ] Update Progress: 1239/2372 symbols completed. LADR took 30.1s. Estimated remaining: 2h 30m 19s. Rate: 7.5 symbols/min [2025-09-23T19:44:28.290874] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-23T19:44:28.300607] [INFO ] [REMOTE ] LAC: Full fetch complete (75968 records). [2025-09-23T19:44:28.300788] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-23T19:44:28.692676] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-23T19:44:28.692776] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-23T19:44:28.693739] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-23T19:44:28.693803] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-23T19:44:28.695323] [DEBUG] [LOCAL ] LAC: Trimmed 75968 records to 52304 (keeping 200 days of data) [2025-09-23T19:44:29.004756] [DEBUG] [LOCAL ] LAC: Primary data saved (52304 records). [2025-09-23T19:44:29.004926] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-23T19:44:29.005060] [INFO ] [MAIN ] Update Progress: 1240/2372 symbols completed. LAC took 48.3s. Estimated remaining: 2h 30m 7s. Rate: 7.5 symbols/min [2025-09-23T19:44:29.557570] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:29.599022] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:29.759871] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:29.741831] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:29.767886] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-23T19:44:29.768931] [DEBUG] [LOCAL ] LAW: Loaded 13887 existing records from primary storage. [2025-09-23T19:44:29.769270] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-23T19:44:29.769184] [INFO ] [MAIN ] LAW: Loaded 13887 existing records. [2025-09-23T19:44:29.781908] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-23T19:44:29.782000] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-23T19:44:29.803921] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-23T19:44:29.820806] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-23T19:44:30.128404] [DEBUG] [LOCAL ] LAZ: Loaded 45362 existing records from primary storage. [2025-09-23T19:44:30.157063] [INFO ] [MAIN ] LAZ: Loaded 45362 existing records. [2025-09-23T19:44:30.156957] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:30.239216] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-23T19:44:30.202722] [DEBUG] [LOCAL ] LB: Loaded 37682 existing records from primary storage. [2025-09-23T19:44:30.261579] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-23T19:44:30.261700] [INFO ] [MAIN ] LB: Loaded 37682 existing records. [2025-09-23T19:44:30.373720] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-23T19:44:30.539749] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-23T19:44:30.800671] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:30.902945] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:30.899737] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:30.903440] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-23T19:44:30.904198] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-23T19:44:30.904335] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-23T19:44:30.914866] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-23T19:44:30.917023] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-23T19:44:30.928048] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-23T19:44:30.947256] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-23T19:44:30.947182] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-23T19:44:31.067334] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-23T19:44:31.149048] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:44:31.205795] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-23T19:44:31.273884] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-23T19:44:31.530699] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:31.554521] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-23T19:44:31.854378] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:31.888258] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-23T19:44:31.909939] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:31.910293] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-23T19:44:32.366772] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:44:32.370259] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-23T19:44:32.574482] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T19:44:32.578940] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-23T19:44:33.084287] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T19:44:33.094361] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-23T19:44:33.124011] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T19:44:33.127795] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-23T19:44:33.469633] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:44:33.478477] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-23T19:44:33.932399] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:44:33.947334] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-23T19:44:33.956166] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T19:44:34.602221] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-23T19:44:34.924393] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T19:44:34.985997] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:44:35.402178] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-23T19:44:35.455181] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T19:44:35.545298] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:44:36.202223] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-23T19:44:36.885451] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T19:44:37.002226] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-23T19:44:37.290285] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T19:44:37.802206] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-23T19:44:38.554427] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:44:38.575413] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:44:38.602157] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-23T19:44:39.402302] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-23T19:44:40.158830] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T19:44:40.202163] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-23T19:44:41.000134] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T19:44:41.003753] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-23T19:44:41.684737] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T19:44:41.689430] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T19:44:41.802248] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-23T19:44:42.602182] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-23T19:44:42.762324] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T19:44:43.402259] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-23T19:44:43.891583] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T19:44:44.202216] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-23T19:44:44.904724] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:44:45.002205] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-23T19:44:45.235722] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T19:44:45.802239] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-23T19:44:46.506794] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T19:44:46.602212] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-23T19:44:47.373771] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T19:44:47.402156] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-23T19:44:48.202197] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-23T19:44:48.368901] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T19:44:48.814744] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:44:48.872015] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T19:44:49.002243] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-23T19:44:49.802248] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-23T19:44:49.940687] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T19:44:49.943683] [INFO ] [REMOTE ] LAW: Full fetch complete (20759 records). [2025-09-23T19:44:49.943813] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-23T19:44:50.319504] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-23T19:44:50.319610] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-23T19:44:50.320155] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-23T19:44:50.320271] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-23T19:44:50.321200] [DEBUG] [LOCAL ] LAW: Trimmed 20759 records to 13871 (keeping 200 days of data) [2025-09-23T19:44:50.407249] [DEBUG] [LOCAL ] LAW: Primary data saved (13871 records). [2025-09-23T19:44:50.407433] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-23T19:44:50.407628] [INFO ] [MAIN ] Update Progress: 1241/2372 symbols completed. LAW took 21.4s. Estimated remaining: 2h 30m 11s. Rate: 7.5 symbols/min [2025-09-23T19:44:50.581831] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:50.602282] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-23T19:44:50.649897] [DEBUG] [LOCAL ] LBRT: Loaded 52920 existing records from primary storage. [2025-09-23T19:44:50.650052] [INFO ] [MAIN ] LBRT: Loaded 52920 existing records. [2025-09-23T19:44:50.835611] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:50.835925] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-23T19:44:50.835991] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-23T19:44:50.838254] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-23T19:44:50.838334] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-23T19:44:51.206885] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:51.402256] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-23T19:44:51.640206] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T19:44:51.924015] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T19:44:51.934169] [INFO ] [REMOTE ] LB: Full fetch complete (56151 records). [2025-09-23T19:44:51.934347] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-23T19:44:52.211062] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-23T19:44:52.357323] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-23T19:44:52.357412] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-23T19:44:52.358449] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-23T19:44:52.358522] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-23T19:44:52.359848] [DEBUG] [LOCAL ] LB: Trimmed 56151 records to 37675 (keeping 200 days of data) [2025-09-23T19:44:52.614795] [DEBUG] [LOCAL ] LB: Primary data saved (37675 records). [2025-09-23T19:44:52.614950] [INFO ] [MAIN ] LB: Full history saved. [2025-09-23T19:44:52.615133] [INFO ] [MAIN ] Update Progress: 1242/2372 symbols completed. LB took 23.6s. Estimated remaining: 2h 29m 58s. Rate: 7.5 symbols/min [2025-09-23T19:44:52.797779] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:52.850692] [DEBUG] [LOCAL ] LC: Loaded 47959 existing records from primary storage. [2025-09-23T19:44:52.850876] [INFO ] [MAIN ] LC: Loaded 47959 existing records. [2025-09-23T19:44:53.008781] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-23T19:44:53.042362] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:53.042849] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-23T19:44:53.053048] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-23T19:44:53.072523] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-23T19:44:53.072793] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-23T19:44:53.127474] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T19:44:53.466868] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:53.795808] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:44:53.805479] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-23T19:44:54.602261] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-23T19:44:54.906760] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T19:44:54.915069] [INFO ] [REMOTE ] LAR: Full fetch complete (54384 records). [2025-09-23T19:44:54.915254] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-23T19:44:55.117440] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-23T19:44:55.118441] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:44:55.118559] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:44:55.118702] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-23T19:44:55.118820] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-23T19:44:55.118923] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-23T19:44:55.119036] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-23T19:44:55.119163] [INFO ] [MAIN ] Update Progress: 1243/2372 symbols completed. LAR took 26.1s. Estimated remaining: 2h 29m 45s. Rate: 7.5 symbols/min [2025-09-23T19:44:55.297133] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:55.338540] [DEBUG] [LOCAL ] LCII: Loaded 28723 existing records from primary storage. [2025-09-23T19:44:55.338718] [INFO ] [MAIN ] LCII: Loaded 28723 existing records. [2025-09-23T19:44:55.403911] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-23T19:44:55.525152] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:55.525636] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-23T19:44:55.525800] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-23T19:44:55.538617] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-23T19:44:55.553721] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-23T19:44:55.650687] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T19:44:55.949532] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:55.982242] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:44:56.202182] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-23T19:44:56.966441] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:44:57.002213] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-23T19:44:57.479496] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T19:44:57.802235] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-23T19:44:58.274941] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:44:58.602209] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-23T19:44:59.384379] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T19:44:59.402149] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-23T19:44:59.438029] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T19:45:00.202252] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-23T19:45:01.002192] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-23T19:45:01.118818] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:45:01.379005] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T19:45:01.802253] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-23T19:45:02.602215] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-23T19:45:03.300806] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-23T19:45:03.402184] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-23T19:45:04.202228] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-23T19:45:05.595108] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (3.79 seconds). [2025-09-23T19:45:05.606540] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-23T19:45:06.420566] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (3.82 seconds). [2025-09-23T19:45:06.432011] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-23T19:45:06.933035] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (3.53 seconds). [2025-09-23T19:45:06.942855] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-23T19:45:07.004484] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-23T19:45:07.402194] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-23T19:45:07.738935] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T19:45:08.193878] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T19:45:08.201603] [INFO ] [REMOTE ] LAZ: Full fetch complete (65830 records). [2025-09-23T19:45:08.201789] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-23T19:45:08.202218] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-23T19:45:08.624527] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-23T19:45:08.624800] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-23T19:45:08.625827] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-23T19:45:08.625937] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-23T19:45:08.642959] [DEBUG] [LOCAL ] LAZ: Trimmed 65830 records to 45286 (keeping 200 days of data) [2025-09-23T19:45:08.658403] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T19:45:08.935811] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T19:45:08.983885] [DEBUG] [LOCAL ] LAZ: Primary data saved (45286 records). [2025-09-23T19:45:08.984020] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-23T19:45:08.984120] [INFO ] [MAIN ] Update Progress: 1244/2372 symbols completed. LAZ took 40.0s. Estimated remaining: 2h 29m 42s. Rate: 7.5 symbols/min [2025-09-23T19:45:09.007331] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-23T19:45:09.162458] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:09.208721] [DEBUG] [LOCAL ] LDI: Loaded 43700 existing records from primary storage. [2025-09-23T19:45:09.208869] [INFO ] [MAIN ] LDI: Loaded 43700 existing records. [2025-09-23T19:45:09.386858] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:09.387124] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-23T19:45:09.387172] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-23T19:45:09.388292] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-23T19:45:09.388353] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-23T19:45:09.746759] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:09.802180] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-23T19:45:10.085415] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T19:45:10.269978] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T19:45:10.602246] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-23T19:45:11.402196] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-23T19:45:11.467041] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:45:12.202302] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-23T19:45:12.350402] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T19:45:12.673104] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T19:45:13.002240] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-23T19:45:13.583469] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T19:45:13.802212] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-23T19:45:14.491353] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T19:45:14.602155] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-23T19:45:14.713379] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:45:15.402273] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-23T19:45:16.202246] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-23T19:45:16.687539] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-23T19:45:17.002201] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-23T19:45:17.393412] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-23T19:45:17.802232] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-23T19:45:18.602224] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-23T19:45:18.727428] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T19:45:19.112678] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-23T19:45:19.317935] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T19:45:19.402155] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-23T19:45:19.831924] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T19:45:20.202207] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-23T19:45:20.871995] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T19:45:21.002223] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-23T19:45:21.776714] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T19:45:21.802275] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-23T19:45:21.867920] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T19:45:22.602245] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-23T19:45:23.402267] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-23T19:45:23.668226] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:45:23.852546] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:45:23.860539] [INFO ] [REMOTE ] LC: Full fetch complete (70305 records). [2025-09-23T19:45:23.860727] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-23T19:45:24.207639] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-23T19:45:24.324941] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-23T19:45:24.325096] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-23T19:45:24.326217] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-23T19:45:24.326288] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-23T19:45:24.327861] [DEBUG] [LOCAL ] LC: Trimmed 70305 records to 47948 (keeping 200 days of data) [2025-09-23T19:45:24.646508] [DEBUG] [LOCAL ] LC: Primary data saved (47948 records). [2025-09-23T19:45:24.646758] [INFO ] [MAIN ] LC: Full history saved. [2025-09-23T19:45:24.646923] [INFO ] [MAIN ] Update Progress: 1245/2372 symbols completed. LC took 32.0s. Estimated remaining: 2h 29m 41s. Rate: 7.5 symbols/min [2025-09-23T19:45:24.854830] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:24.899052] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:45:24.965307] [DEBUG] [LOCAL ] LDOS: Loaded 45918 existing records from primary storage. [2025-09-23T19:45:24.965531] [INFO ] [MAIN ] LDOS: Loaded 45918 existing records. [2025-09-23T19:45:25.007401] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-23T19:45:25.165674] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:25.166041] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-23T19:45:25.166096] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-23T19:45:25.167764] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-23T19:45:25.167829] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-23T19:45:25.567587] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:25.802221] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-23T19:45:25.935583] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:45:25.949509] [INFO ] [REMOTE ] LBRT: Full fetch complete (76511 records). [2025-09-23T19:45:25.949862] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-23T19:45:26.421451] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T19:45:26.452518] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-23T19:45:26.452817] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-23T19:45:26.454142] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-23T19:45:26.454676] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-23T19:45:26.456959] [DEBUG] [LOCAL ] LBRT: Trimmed 76511 records to 52920 (keeping 200 days of data) [2025-09-23T19:45:26.603082] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-23T19:45:26.737421] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T19:45:26.878614] [DEBUG] [LOCAL ] LBRT: Primary data saved (52920 records). [2025-09-23T19:45:26.878886] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-23T19:45:26.879024] [INFO ] [MAIN ] Update Progress: 1246/2372 symbols completed. LBRT took 36.5s. Estimated remaining: 2h 29m 28s. Rate: 7.5 symbols/min [2025-09-23T19:45:27.069364] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:27.087123] [DEBUG] [LOCAL ] LDP: Loaded 13072 existing records from primary storage. [2025-09-23T19:45:27.087319] [INFO ] [MAIN ] LDP: Loaded 13072 existing records. [2025-09-23T19:45:27.270686] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:27.270992] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-23T19:45:27.271046] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-23T19:45:27.271612] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-23T19:45:27.271705] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-23T19:45:27.411167] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-23T19:45:27.638484] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:28.202195] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-23T19:45:28.243094] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:45:28.830146] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T19:45:28.834512] [INFO ] [REMOTE ] LCII: Full fetch complete (38979 records). [2025-09-23T19:45:28.834609] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-23T19:45:29.013178] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-23T19:45:29.249975] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-23T19:45:29.250108] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-23T19:45:29.251133] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-23T19:45:29.251202] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-23T19:45:29.252442] [DEBUG] [LOCAL ] LCII: Trimmed 38979 records to 28651 (keeping 200 days of data) [2025-09-23T19:45:29.444924] [DEBUG] [LOCAL ] LCII: Primary data saved (28651 records). [2025-09-23T19:45:29.445130] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-23T19:45:29.445233] [INFO ] [MAIN ] Update Progress: 1247/2372 symbols completed. LCII took 34.3s. Estimated remaining: 2h 29m 15s. Rate: 7.5 symbols/min [2025-09-23T19:45:29.623113] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:29.664971] [DEBUG] [LOCAL ] LEA: Loaded 41859 existing records from primary storage. [2025-09-23T19:45:29.665212] [INFO ] [MAIN ] LEA: Loaded 41859 existing records. [2025-09-23T19:45:29.807810] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-23T19:45:29.856730] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:29.857033] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-23T19:45:29.857089] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-23T19:45:29.858470] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-23T19:45:29.858536] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-23T19:45:30.231444] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:30.382349] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T19:45:30.602215] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-23T19:45:31.249028] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-23T19:45:31.362370] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T19:45:31.402145] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-23T19:45:31.502938] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T19:45:32.202231] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-23T19:45:33.002250] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-23T19:45:33.516193] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-23T19:45:33.525096] [INFO ] [REMOTE ] LDI: Full fetch complete (60086 records). [2025-09-23T19:45:33.525223] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-23T19:45:33.807440] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-23T19:45:33.930593] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T19:45:34.008524] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-23T19:45:34.008604] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-23T19:45:34.009411] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-23T19:45:34.009473] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-23T19:45:34.010679] [DEBUG] [LOCAL ] LDI: Trimmed 60086 records to 43871 (keeping 200 days of data) [2025-09-23T19:45:34.283519] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T19:45:34.296765] [DEBUG] [LOCAL ] LDI: Primary data saved (43871 records). [2025-09-23T19:45:34.296844] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-23T19:45:34.296916] [INFO ] [MAIN ] Update Progress: 1248/2372 symbols completed. LDI took 25.3s. Estimated remaining: 2h 29m 4s. Rate: 7.5 symbols/min [2025-09-23T19:45:34.472631] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:34.519504] [DEBUG] [LOCAL ] LEG: Loaded 50389 existing records from primary storage. [2025-09-23T19:45:34.519668] [INFO ] [MAIN ] LEG: Loaded 50389 existing records. [2025-09-23T19:45:34.607471] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-23T19:45:34.705061] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:34.712564] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T19:45:34.712725] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-23T19:45:34.715806] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-23T19:45:34.717183] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-23T19:45:34.717245] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-23T19:45:35.072000] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:35.402165] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-23T19:45:36.119165] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:45:36.202213] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-23T19:45:37.002181] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-23T19:45:37.172389] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T19:45:37.491064] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T19:45:37.802181] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-23T19:45:37.902949] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T19:45:38.602293] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-23T19:45:39.400120] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T19:45:39.409444] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-23T19:45:40.202186] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-23T19:45:40.367879] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T19:45:40.410923] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T19:45:41.002208] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-23T19:45:41.717389] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T19:45:41.802390] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-23T19:45:42.602215] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-23T19:45:42.795227] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T19:45:43.212756] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T19:45:43.402187] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-23T19:45:43.922788] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T19:45:44.202207] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-23T19:45:45.002178] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-23T19:45:45.081113] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T19:45:45.139857] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T19:45:45.802202] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-23T19:45:46.589542] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:45:46.602153] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-23T19:45:47.402170] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-23T19:45:47.516523] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T19:45:48.202169] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-23T19:45:48.390232] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T19:45:48.417315] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:45:49.002198] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-23T19:45:49.802168] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-23T19:45:49.846310] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:45:50.263432] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T19:45:50.445149] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T19:45:50.602207] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-23T19:45:51.402203] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-23T19:45:52.202179] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-23T19:45:52.280169] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T19:45:53.002231] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-23T19:45:53.726066] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-23T19:45:53.802174] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-23T19:45:53.870067] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T19:45:53.897964] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T19:45:54.602199] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-23T19:45:55.403371] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-23T19:45:55.409729] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T19:45:56.130447] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T19:45:56.202156] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-23T19:45:56.359326] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T19:45:56.361755] [INFO ] [REMOTE ] LDP: Full fetch complete (19432 records). [2025-09-23T19:45:56.361831] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-23T19:45:56.730467] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-23T19:45:56.730553] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-23T19:45:56.731000] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-23T19:45:56.731062] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-23T19:45:56.731685] [DEBUG] [LOCAL ] LDP: Trimmed 19432 records to 12995 (keeping 200 days of data) [2025-09-23T19:45:56.813789] [DEBUG] [LOCAL ] LDP: Primary data saved (12995 records). [2025-09-23T19:45:56.813950] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-23T19:45:56.814041] [INFO ] [MAIN ] Update Progress: 1249/2372 symbols completed. LDP took 29.9s. Estimated remaining: 2h 29m 9s. Rate: 7.5 symbols/min [2025-09-23T19:45:56.986446] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:57.002186] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-23T19:45:57.045428] [DEBUG] [LOCAL ] LEN: Loaded 53191 existing records from primary storage. [2025-09-23T19:45:57.045593] [INFO ] [MAIN ] LEN: Loaded 53191 existing records. [2025-09-23T19:45:57.229855] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:57.230107] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-23T19:45:57.230155] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-23T19:45:57.231844] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-23T19:45:57.231906] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-23T19:45:57.604351] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:57.638577] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:45:57.802180] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-23T19:45:58.602184] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-23T19:45:58.869755] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:45:59.402208] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-23T19:45:59.432667] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T19:45:59.439843] [INFO ] [REMOTE ] LDOS: Full fetch complete (67758 records). [2025-09-23T19:45:59.439968] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-23T19:45:59.831105] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-23T19:45:59.831299] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-23T19:45:59.832209] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-23T19:45:59.832272] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-23T19:45:59.833558] [DEBUG] [LOCAL ] LDOS: Trimmed 67758 records to 45814 (keeping 200 days of data) [2025-09-23T19:46:00.127903] [DEBUG] [LOCAL ] LDOS: Primary data saved (45814 records). [2025-09-23T19:46:00.128057] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-23T19:46:00.130998] [INFO ] [MAIN ] Update Progress: 1250/2372 symbols completed. LDOS took 35.5s. Estimated remaining: 2h 28m 57s. Rate: 7.5 symbols/min [2025-09-23T19:46:00.204725] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-23T19:46:00.351947] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:00.353952] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T19:46:00.382935] [DEBUG] [LOCAL ] LEO: Loaded 17610 existing records from primary storage. [2025-09-23T19:46:00.383085] [INFO ] [MAIN ] LEO: Loaded 17610 existing records. [2025-09-23T19:46:00.561938] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:00.562200] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-23T19:46:00.562247] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-23T19:46:00.562802] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-23T19:46:00.562861] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-23T19:46:00.922066] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:01.002166] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-23T19:46:01.087458] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T19:46:01.775142] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T19:46:01.802149] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-23T19:46:02.092707] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T19:46:02.101260] [INFO ] [REMOTE ] LEG: Full fetch complete (73218 records). [2025-09-23T19:46:02.101418] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-23T19:46:02.491074] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-23T19:46:02.491160] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-23T19:46:02.492077] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-23T19:46:02.492138] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-23T19:46:02.493532] [DEBUG] [LOCAL ] LEG: Trimmed 73218 records to 50396 (keeping 200 days of data) [2025-09-23T19:46:02.603352] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-23T19:46:02.811347] [DEBUG] [LOCAL ] LEG: Primary data saved (50396 records). [2025-09-23T19:46:02.811613] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-23T19:46:02.811742] [INFO ] [MAIN ] Update Progress: 1251/2372 symbols completed. LEG took 28.5s. Estimated remaining: 2h 28m 45s. Rate: 7.5 symbols/min [2025-09-23T19:46:02.943479] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T19:46:03.001404] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:03.055601] [DEBUG] [LOCAL ] LEVI: Loaded 51526 existing records from primary storage. [2025-09-23T19:46:03.055817] [INFO ] [MAIN ] LEVI: Loaded 51526 existing records. [2025-09-23T19:46:03.232826] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:03.233119] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-23T19:46:03.233166] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-23T19:46:03.234630] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-23T19:46:03.234713] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-23T19:46:03.407545] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-23T19:46:03.616507] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:04.202200] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-23T19:46:04.316454] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:46:05.002163] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-23T19:46:05.147323] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T19:46:05.392695] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T19:46:05.802252] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-23T19:46:06.375569] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:46:06.383435] [INFO ] [REMOTE ] LEA: Full fetch complete (60974 records). [2025-09-23T19:46:06.383599] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-23T19:46:06.607262] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-23T19:46:06.789146] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-23T19:46:06.789263] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-23T19:46:06.790248] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-23T19:46:06.790316] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-23T19:46:06.791770] [DEBUG] [LOCAL ] LEA: Trimmed 60974 records to 41822 (keeping 200 days of data) [2025-09-23T19:46:06.899358] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:46:07.077270] [DEBUG] [LOCAL ] LEA: Primary data saved (41822 records). [2025-09-23T19:46:07.077410] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-23T19:46:07.077496] [INFO ] [MAIN ] Update Progress: 1252/2372 symbols completed. LEA took 37.6s. Estimated remaining: 2h 28m 33s. Rate: 7.5 symbols/min [2025-09-23T19:46:07.251421] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:07.270383] [DEBUG] [LOCAL ] LFT: Loaded 17970 existing records from primary storage. [2025-09-23T19:46:07.270525] [INFO ] [MAIN ] LFT: Loaded 17970 existing records. [2025-09-23T19:46:07.407412] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-23T19:46:07.487608] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:07.487899] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-23T19:46:07.487951] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-23T19:46:07.488581] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-23T19:46:07.488669] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-23T19:46:08.025158] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:08.202196] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-23T19:46:08.415286] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T19:46:08.633418] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:46:08.857007] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T19:46:09.002243] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-23T19:46:09.802214] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-23T19:46:09.920249] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:46:10.602208] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-23T19:46:11.305572] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T19:46:11.402196] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-23T19:46:12.202277] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-23T19:46:12.350508] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T19:46:13.002179] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-23T19:46:13.060388] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T19:46:13.144427] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T19:46:13.802200] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-23T19:46:14.090892] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T19:46:14.602247] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-23T19:46:15.402166] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-23T19:46:15.577179] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T19:46:15.653991] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T19:46:16.202188] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-23T19:46:17.002174] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-23T19:46:17.089222] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T19:46:17.565962] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T19:46:17.802207] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-23T19:46:17.860392] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T19:46:18.602181] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-23T19:46:18.743738] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T19:46:19.402206] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-23T19:46:20.202155] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-23T19:46:20.401896] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T19:46:20.570303] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T19:46:21.002228] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-23T19:46:21.188493] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:46:21.191581] [INFO ] [REMOTE ] LEO: Full fetch complete (27157 records). [2025-09-23T19:46:21.191683] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-23T19:46:21.559872] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-23T19:46:21.559974] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-23T19:46:21.560536] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-23T19:46:21.560596] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-23T19:46:21.562744] [DEBUG] [LOCAL ] LEO: Trimmed 27157 records to 17672 (keeping 200 days of data) [2025-09-23T19:46:21.669682] [DEBUG] [LOCAL ] LEO: Primary data saved (17672 records). [2025-09-23T19:46:21.669829] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-23T19:46:21.669918] [INFO ] [MAIN ] Update Progress: 1253/2372 symbols completed. LEO took 21.5s. Estimated remaining: 2h 28m 31s. Rate: 7.5 symbols/min [2025-09-23T19:46:21.807841] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-23T19:46:21.841070] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:21.853919] [DEBUG] [LOCAL ] LGI: Loaded 10075 existing records from primary storage. [2025-09-23T19:46:21.854054] [INFO ] [MAIN ] LGI: Loaded 10075 existing records. [2025-09-23T19:46:22.037199] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:22.037507] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-23T19:46:22.037565] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-23T19:46:22.038049] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-23T19:46:22.038110] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-23T19:46:22.419747] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:22.602181] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-23T19:46:22.909202] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T19:46:23.017098] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T19:46:23.402192] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-23T19:46:23.704964] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T19:46:24.202198] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-23T19:46:25.002175] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-23T19:46:25.115506] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:46:25.241849] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T19:46:25.802192] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-23T19:46:26.602172] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-23T19:46:26.956695] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T19:46:27.402241] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-23T19:46:27.468700] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T19:46:27.470426] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:46:28.202196] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-23T19:46:28.919893] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T19:46:29.002154] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-23T19:46:29.366359] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T19:46:29.802196] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-23T19:46:30.602179] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-23T19:46:30.834011] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T19:46:31.077937] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T19:46:31.402222] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-23T19:46:31.808869] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-23T19:46:31.823048] [INFO ] [REMOTE ] LEN: Full fetch complete (76992 records). [2025-09-23T19:46:31.823221] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-23T19:46:32.219769] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-23T19:46:32.223551] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-23T19:46:32.223639] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-23T19:46:32.231342] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-23T19:46:32.231937] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-23T19:46:32.239247] [DEBUG] [LOCAL ] LEN: Trimmed 76992 records to 53191 (keeping 200 days of data) [2025-09-23T19:46:32.602380] [DEBUG] [LOCAL ] LEN: Primary data saved (53191 records). [2025-09-23T19:46:32.602582] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-23T19:46:32.602802] [INFO ] [MAIN ] Update Progress: 1254/2372 symbols completed. LEN took 35.8s. Estimated remaining: 2h 28m 26s. Rate: 7.5 symbols/min [2025-09-23T19:46:32.796923] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:32.839420] [DEBUG] [LOCAL ] LH: Loaded 38477 existing records from primary storage. [2025-09-23T19:46:32.839604] [INFO ] [MAIN ] LH: Loaded 38477 existing records. [2025-09-23T19:46:33.027719] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-23T19:46:33.034481] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:33.036588] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-23T19:46:33.036715] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-23T19:46:33.049514] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-23T19:46:33.069035] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-23T19:46:33.097307] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T19:46:33.204333] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T19:46:33.463260] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:33.802159] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-23T19:46:34.111068] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T19:46:34.602207] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-23T19:46:35.250378] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:46:35.385791] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T19:46:35.402152] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-23T19:46:36.202287] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-23T19:46:36.272241] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T19:46:36.969763] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:46:37.002150] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-23T19:46:37.802215] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-23T19:46:38.468493] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T19:46:38.602206] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-23T19:46:39.367504] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T19:46:39.402242] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-23T19:46:39.548870] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:46:39.561791] [INFO ] [REMOTE ] LEVI: Full fetch complete (74440 records). [2025-09-23T19:46:39.561953] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-23T19:46:39.971631] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-23T19:46:39.971768] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-23T19:46:39.972903] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-23T19:46:39.973019] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-23T19:46:39.977982] [DEBUG] [LOCAL ] LEVI: Trimmed 74440 records to 51546 (keeping 200 days of data) [2025-09-23T19:46:40.210843] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-23T19:46:40.318875] [DEBUG] [LOCAL ] LEVI: Primary data saved (51546 records). [2025-09-23T19:46:40.319066] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-23T19:46:40.319270] [INFO ] [MAIN ] Update Progress: 1255/2372 symbols completed. LEVI took 37.5s. Estimated remaining: 2h 28m 18s. Rate: 7.5 symbols/min [2025-09-23T19:46:40.534799] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:40.536445] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:46:40.593444] [DEBUG] [LOCAL ] LHX: Loaded 48812 existing records from primary storage. [2025-09-23T19:46:40.593617] [INFO ] [MAIN ] LHX: Loaded 48812 existing records. [2025-09-23T19:46:40.774248] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:40.774512] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-23T19:46:40.774568] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-23T19:46:40.775817] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-23T19:46:40.775894] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-23T19:46:41.007282] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-23T19:46:41.053392] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T19:46:41.184003] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:41.802206] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-23T19:46:42.602236] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-23T19:46:42.712420] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:46:42.777275] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T19:46:42.781622] [INFO ] [REMOTE ] LFT: Full fetch complete (23937 records). [2025-09-23T19:46:42.781789] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-23T19:46:43.151009] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-23T19:46:43.151103] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-23T19:46:43.151599] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-23T19:46:43.151662] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-23T19:46:43.152581] [DEBUG] [LOCAL ] LFT: Trimmed 23937 records to 18057 (keeping 200 days of data) [2025-09-23T19:46:43.263514] [DEBUG] [LOCAL ] LFT: Primary data saved (18057 records). [2025-09-23T19:46:43.263689] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-23T19:46:43.263831] [INFO ] [MAIN ] Update Progress: 1256/2372 symbols completed. LFT took 36.2s. Estimated remaining: 2h 28m 5s. Rate: 7.5 symbols/min [2025-09-23T19:46:43.407388] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-23T19:46:43.441429] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:43.477623] [DEBUG] [LOCAL ] LII: Loaded 28510 existing records from primary storage. [2025-09-23T19:46:43.477796] [INFO ] [MAIN ] LII: Loaded 28510 existing records. [2025-09-23T19:46:43.655146] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:43.655572] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-23T19:46:43.655664] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-23T19:46:43.656551] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-23T19:46:43.656612] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-23T19:46:44.018724] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:44.202185] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-23T19:46:44.233924] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:46:44.551826] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T19:46:45.002164] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-23T19:46:45.135024] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T19:46:45.802259] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-23T19:46:46.602249] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-23T19:46:46.766394] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T19:46:47.402190] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-23T19:46:47.532602] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:46:47.655829] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T19:46:48.202184] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-23T19:46:48.958036] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:46:49.002175] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-23T19:46:49.757120] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T19:46:49.802187] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-23T19:46:50.556195] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T19:46:50.558450] [INFO ] [REMOTE ] LGI: Full fetch complete (14274 records). [2025-09-23T19:46:50.558595] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-23T19:46:50.607362] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-23T19:46:50.882627] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T19:46:50.974233] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-23T19:46:50.974327] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-23T19:46:50.974660] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-23T19:46:50.974721] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-23T19:46:50.975844] [DEBUG] [LOCAL ] LGI: Trimmed 14274 records to 10013 (keeping 200 days of data) [2025-09-23T19:46:51.045681] [DEBUG] [LOCAL ] LGI: Primary data saved (10013 records). [2025-09-23T19:46:51.045863] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-23T19:46:51.045989] [INFO ] [MAIN ] Update Progress: 1257/2372 symbols completed. LGI took 29.4s. Estimated remaining: 2h 27m 57s. Rate: 7.5 symbols/min [2025-09-23T19:46:51.233041] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:51.292902] [DEBUG] [LOCAL ] LION: Loaded 42858 existing records from primary storage. [2025-09-23T19:46:51.293079] [INFO ] [MAIN ] LION: Loaded 42858 existing records. [2025-09-23T19:46:51.407335] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-23T19:46:51.481073] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:51.481444] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-23T19:46:51.481521] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-23T19:46:51.483105] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-23T19:46:51.483185] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-23T19:46:51.854681] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:52.134952] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:46:52.202162] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-23T19:46:52.945826] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T19:46:53.002180] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-23T19:46:53.207789] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T19:46:53.802196] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-23T19:46:54.425221] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T19:46:54.602313] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-23T19:46:55.087506] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:46:55.402216] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-23T19:46:55.657983] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T19:46:56.202197] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-23T19:46:56.481864] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T19:46:57.002204] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-23T19:46:57.563981] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T19:46:57.802192] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-23T19:46:58.031920] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:46:58.602254] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-23T19:46:59.402223] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-23T19:46:59.669549] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T19:46:59.693792] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:47:00.202181] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-23T19:47:00.400073] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:47:00.405397] [INFO ] [REMOTE ] LH: Full fetch complete (54824 records). [2025-09-23T19:47:00.405521] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-23T19:47:00.788395] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-23T19:47:00.788480] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-23T19:47:00.789536] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-23T19:47:00.789602] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-23T19:47:00.792885] [DEBUG] [LOCAL ] LH: Trimmed 54824 records to 38380 (keeping 200 days of data) [2025-09-23T19:47:01.012148] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-23T19:47:01.051320] [DEBUG] [LOCAL ] LH: Primary data saved (38380 records). [2025-09-23T19:47:01.051490] [INFO ] [MAIN ] LH: Full history saved. [2025-09-23T19:47:01.051629] [INFO ] [MAIN ] Update Progress: 1258/2372 symbols completed. LH took 28.4s. Estimated remaining: 2h 27m 51s. Rate: 7.5 symbols/min [2025-09-23T19:47:01.231609] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:01.239347] [DEBUG] [LOCAL ] LITB: Loaded 4300 existing records from primary storage. [2025-09-23T19:47:01.239491] [INFO ] [MAIN ] LITB: Loaded 4300 existing records. [2025-09-23T19:47:01.421783] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:01.422052] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-23T19:47:01.422101] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-23T19:47:01.422431] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-23T19:47:01.422492] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-23T19:47:01.803613] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:01.803766] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-23T19:47:02.029485] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T19:47:02.602176] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-23T19:47:02.658544] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:47:02.727591] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T19:47:03.067552] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-23T19:47:03.402196] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-23T19:47:04.202188] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-23T19:47:04.747360] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T19:47:05.002214] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-23T19:47:05.663974] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:47:05.802199] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-23T19:47:06.222241] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T19:47:06.340581] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T19:47:06.602227] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-23T19:47:07.055074] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:47:07.402207] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-23T19:47:08.035572] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T19:47:08.202174] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-23T19:47:08.754150] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T19:47:09.002224] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-23T19:47:09.802198] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-23T19:47:10.414918] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:47:10.602213] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-23T19:47:10.954160] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T19:47:11.084527] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T19:47:11.402187] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-23T19:47:12.202210] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-23T19:47:13.002173] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-23T19:47:13.287795] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-23T19:47:13.301830] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-23T19:47:13.534869] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T19:47:13.802213] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-23T19:47:14.602212] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-23T19:47:15.402207] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-23T19:47:15.440279] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T19:47:15.501687] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T19:47:15.866892] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T19:47:16.202209] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-23T19:47:17.002195] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-23T19:47:17.436572] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T19:47:17.665102] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:47:17.673262] [INFO ] [REMOTE ] LION: Full fetch complete (53823 records). [2025-09-23T19:47:17.673400] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-23T19:47:17.807333] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-23T19:47:18.079202] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-23T19:47:18.079309] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-23T19:47:18.080192] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-23T19:47:18.080253] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-23T19:47:18.081621] [DEBUG] [LOCAL ] LION: Trimmed 53823 records to 43086 (keeping 200 days of data) [2025-09-23T19:47:18.326346] [DEBUG] [LOCAL ] LION: Primary data saved (43086 records). [2025-09-23T19:47:18.326482] [INFO ] [MAIN ] LION: Full history saved. [2025-09-23T19:47:18.326566] [INFO ] [MAIN ] Update Progress: 1259/2372 symbols completed. LION took 27.3s. Estimated remaining: 2h 27m 51s. Rate: 7.5 symbols/min [2025-09-23T19:47:18.513101] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:18.588546] [DEBUG] [LOCAL ] LLY: Loaded 53294 existing records from primary storage. [2025-09-23T19:47:18.588834] [INFO ] [MAIN ] LLY: Loaded 53294 existing records. [2025-09-23T19:47:18.608844] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-23T19:47:18.682107] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T19:47:18.749836] [INFO ] [REMOTE ] LITB: Full fetch complete (5566 records). [2025-09-23T19:47:18.760720] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-23T19:47:18.915554] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:18.960049] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-23T19:47:18.960288] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-23T19:47:18.970077] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-23T19:47:19.002497] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-23T19:47:19.428924] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-23T19:47:19.918235] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:19.965051] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-23T19:47:19.965200] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-23T19:47:19.965455] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-23T19:47:19.965560] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-23T19:47:19.966327] [DEBUG] [LOCAL ] LITB: Trimmed 5566 records to 4327 (keeping 200 days of data) [2025-09-23T19:47:19.992401] [DEBUG] [LOCAL ] LITB: Primary data saved (4327 records). [2025-09-23T19:47:20.007167] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-23T19:47:20.008486] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T19:47:20.008675] [INFO ] [MAIN ] Update Progress: 1260/2372 symbols completed. LITB took 19.0s. Estimated remaining: 2h 27m 38s. Rate: 7.5 symbols/min [2025-09-23T19:47:20.078821] [INFO ] [REMOTE ] LII: Full fetch complete (41241 records). [2025-09-23T19:47:20.106305] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-23T19:47:20.203765] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-23T19:47:20.346106] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:20.611526] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-23T19:47:20.611611] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-23T19:47:20.612394] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-23T19:47:20.612455] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-23T19:47:20.613580] [DEBUG] [LOCAL ] LII: Trimmed 41241 records to 28428 (keeping 200 days of data) [2025-09-23T19:47:20.697878] [DEBUG] [LOCAL ] LMND: Loaded 51870 existing records from primary storage. [2025-09-23T19:47:20.728824] [INFO ] [MAIN ] LMND: Loaded 51870 existing records. [2025-09-23T19:47:20.989181] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:21.002307] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-23T19:47:21.002734] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-23T19:47:21.004799] [DEBUG] [LOCAL ] LII: Primary data saved (28428 records). [2025-09-23T19:47:21.005019] [INFO ] [MAIN ] LII: Full history saved. [2025-09-23T19:47:21.005140] [INFO ] [MAIN ] Update Progress: 1261/2372 symbols completed. LII took 37.7s. Estimated remaining: 2h 27m 24s. Rate: 7.5 symbols/min [2025-09-23T19:47:21.037520] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-23T19:47:21.061427] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-23T19:47:21.315889] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:21.559825] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:21.560341] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-23T19:47:21.606466] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-23T19:47:21.638775] [DEBUG] [LOCAL ] LMT: Loaded 49955 existing records from primary storage. [2025-09-23T19:47:21.638928] [INFO ] [MAIN ] LMT: Loaded 49955 existing records. [2025-09-23T19:47:21.808837] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-23T19:47:21.822571] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:21.822795] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-23T19:47:21.822843] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-23T19:47:21.824034] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-23T19:47:21.824095] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-23T19:47:22.179131] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:22.328159] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T19:47:22.602207] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-23T19:47:23.171908] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T19:47:23.241519] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T19:47:23.402203] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-23T19:47:24.202186] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-23T19:47:24.762309] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-23T19:47:25.002196] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-23T19:47:25.212199] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T19:47:25.220090] [INFO ] [REMOTE ] LHX: Full fetch complete (70826 records). [2025-09-23T19:47:25.220255] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-23T19:47:25.608850] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-23T19:47:25.608935] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-23T19:47:25.609854] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-23T19:47:25.609919] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-23T19:47:25.611474] [DEBUG] [LOCAL ] LHX: Trimmed 70826 records to 48750 (keeping 200 days of data) [2025-09-23T19:47:25.807503] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-23T19:47:25.929083] [DEBUG] [LOCAL ] LHX: Primary data saved (48750 records). [2025-09-23T19:47:25.929492] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-23T19:47:25.929733] [INFO ] [MAIN ] Update Progress: 1262/2372 symbols completed. LHX took 45.6s. Estimated remaining: 2h 27m 13s. Rate: 7.5 symbols/min [2025-09-23T19:47:26.104186] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:26.167415] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T19:47:26.192562] [DEBUG] [LOCAL ] LNC: Loaded 51637 existing records from primary storage. [2025-09-23T19:47:26.192707] [INFO ] [MAIN ] LNC: Loaded 51637 existing records. [2025-09-23T19:47:26.367879] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:26.368132] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-23T19:47:26.368188] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-23T19:47:26.369281] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-23T19:47:26.369345] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-23T19:47:26.610206] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-23T19:47:26.725155] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:27.223304] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-23T19:47:27.327555] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:47:27.402144] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-23T19:47:28.202236] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-23T19:47:28.472071] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T19:47:28.844576] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:47:29.002158] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-23T19:47:29.802199] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-23T19:47:30.549003] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-23T19:47:30.602154] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-23T19:47:30.931285] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T19:47:31.408327] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-23T19:47:31.426187] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T19:47:32.202214] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-23T19:47:32.900906] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-23T19:47:32.964547] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T19:47:33.002182] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-23T19:47:33.802280] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-23T19:47:33.881745] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T19:47:34.575414] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T19:47:34.602153] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-23T19:47:35.402195] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-23T19:47:36.202227] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-23T19:47:36.651680] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-23T19:47:36.799191] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T19:47:37.002242] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-23T19:47:37.056590] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T19:47:37.802245] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-23T19:47:37.862894] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:47:38.602238] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-23T19:47:39.115718] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-23T19:47:39.402192] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-23T19:47:40.028551] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-23T19:47:40.202201] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-23T19:47:40.911043] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-23T19:47:41.002533] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-23T19:47:41.524029] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-23T19:47:41.802228] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-23T19:47:42.206102] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T19:47:42.602222] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-23T19:47:43.402195] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-23T19:47:43.749563] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-23T19:47:43.944424] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T19:47:43.953245] [INFO ] [REMOTE ] LMND: Full fetch complete (75269 records). [2025-09-23T19:47:43.953373] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-23T19:47:44.211544] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-23T19:47:44.364271] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-23T19:47:44.364378] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-23T19:47:44.365451] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-23T19:47:44.365531] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-23T19:47:44.367338] [DEBUG] [LOCAL ] LMND: Trimmed 75269 records to 51875 (keeping 200 days of data) [2025-09-23T19:47:44.490409] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T19:47:44.709127] [DEBUG] [LOCAL ] LMND: Primary data saved (51875 records). [2025-09-23T19:47:44.709267] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-23T19:47:44.709353] [INFO ] [MAIN ] Update Progress: 1263/2372 symbols completed. LMND took 24.7s. Estimated remaining: 2h 27m 15s. Rate: 7.5 symbols/min [2025-09-23T19:47:44.879756] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:44.886478] [DEBUG] [LOCAL ] LND: Loaded 5026 existing records from primary storage. [2025-09-23T19:47:44.886594] [INFO ] [MAIN ] LND: Loaded 5026 existing records. [2025-09-23T19:47:45.007324] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-23T19:47:45.067866] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:45.068282] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-23T19:47:45.068361] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-23T19:47:45.068850] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-23T19:47:45.068911] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-23T19:47:45.435941] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:45.465978] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-23T19:47:45.802194] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-23T19:47:46.569389] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T19:47:46.602146] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-23T19:47:47.119007] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-23T19:47:47.402213] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-23T19:47:47.862809] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-23T19:47:47.903895] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:47:48.202180] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-23T19:47:48.235801] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:47:48.687615] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T19:47:49.002221] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-23T19:47:49.802212] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-23T19:47:50.602198] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-23T19:47:50.762325] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T19:47:51.402327] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-23T19:47:51.848753] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-23T19:47:52.202195] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-23T19:47:52.891916] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T19:47:53.002194] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-23T19:47:53.142710] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T19:47:53.188483] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-23T19:47:53.197555] [INFO ] [REMOTE ] LLY: Full fetch complete (77256 records). [2025-09-23T19:47:53.197752] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-23T19:47:53.614824] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-23T19:47:53.614910] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-23T19:47:53.615929] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-23T19:47:53.615994] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-23T19:47:53.617458] [DEBUG] [LOCAL ] LLY: Trimmed 77256 records to 53293 (keeping 200 days of data) [2025-09-23T19:47:53.804364] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-23T19:47:53.962275] [DEBUG] [LOCAL ] LLY: Primary data saved (53293 records). [2025-09-23T19:47:53.962418] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-23T19:47:53.963636] [INFO ] [MAIN ] Update Progress: 1264/2372 symbols completed. LLY took 35.6s. Estimated remaining: 2h 27m 8s. Rate: 7.5 symbols/min [2025-09-23T19:47:54.133506] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:54.192041] [DEBUG] [LOCAL ] LNG: Loaded 51517 existing records from primary storage. [2025-09-23T19:47:54.192188] [INFO ] [MAIN ] LNG: Loaded 51517 existing records. [2025-09-23T19:47:54.369578] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:54.369835] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-23T19:47:54.369884] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-23T19:47:54.371107] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-23T19:47:54.371168] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-23T19:47:54.611848] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-23T19:47:54.657354] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T19:47:54.742858] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:55.248546] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-23T19:47:55.402210] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-23T19:47:56.117753] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T19:47:56.202160] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-23T19:47:56.306447] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T19:47:56.315176] [INFO ] [REMOTE ] LNC: Full fetch complete (74007 records). [2025-09-23T19:47:56.315311] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-23T19:47:56.702766] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-23T19:47:56.702847] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-23T19:47:56.703795] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-23T19:47:56.703858] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-23T19:47:56.705255] [DEBUG] [LOCAL ] LNC: Trimmed 74007 records to 51637 (keeping 200 days of data) [2025-09-23T19:47:57.002986] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-23T19:47:57.024339] [DEBUG] [LOCAL ] LNC: Primary data saved (51637 records). [2025-09-23T19:47:57.024490] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-23T19:47:57.024586] [INFO ] [MAIN ] Update Progress: 1265/2372 symbols completed. LNC took 31.1s. Estimated remaining: 2h 26m 56s. Rate: 7.5 symbols/min [2025-09-23T19:47:57.190509] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:57.203554] [DEBUG] [LOCAL ] LNN: Loaded 11247 existing records from primary storage. [2025-09-23T19:47:57.203701] [INFO ] [MAIN ] LNN: Loaded 11247 existing records. [2025-09-23T19:47:57.378918] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:57.379216] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-23T19:47:57.379274] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-23T19:47:57.380008] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-23T19:47:57.380069] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-23T19:47:57.733840] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:57.802144] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-23T19:47:58.354578] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-23T19:47:58.454622] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:47:58.602154] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-23T19:47:58.744673] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T19:47:59.402215] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-23T19:48:00.044672] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T19:48:00.202166] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-23T19:48:00.385816] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:48:00.823691] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T19:48:01.002227] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-23T19:48:01.802264] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-23T19:48:02.602232] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-23T19:48:03.131893] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T19:48:03.402162] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-23T19:48:03.579974] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-23T19:48:03.588300] [INFO ] [REMOTE ] LMT: Full fetch complete (72543 records). [2025-09-23T19:48:03.588422] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-23T19:48:03.986679] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-23T19:48:03.986849] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-23T19:48:03.987844] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-23T19:48:03.987911] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-23T19:48:03.989389] [DEBUG] [LOCAL ] LMT: Trimmed 72543 records to 49926 (keeping 200 days of data) [2025-09-23T19:48:04.213093] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-23T19:48:04.323554] [DEBUG] [LOCAL ] LMT: Primary data saved (49926 records). [2025-09-23T19:48:04.323748] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-23T19:48:04.323849] [INFO ] [MAIN ] Update Progress: 1266/2372 symbols completed. LMT took 43.3s. Estimated remaining: 2h 26m 47s. Rate: 7.5 symbols/min [2025-09-23T19:48:04.447511] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T19:48:04.508441] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:04.548825] [DEBUG] [LOCAL ] LOAR: Loaded 41710 existing records from primary storage. [2025-09-23T19:48:04.548979] [INFO ] [MAIN ] LOAR: Loaded 41710 existing records. [2025-09-23T19:48:04.723699] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:04.723983] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-23T19:48:04.724031] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-23T19:48:04.725753] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-23T19:48:04.725815] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-23T19:48:05.004852] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-23T19:48:05.073787] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T19:48:05.095561] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:05.407857] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T19:48:05.802190] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-23T19:48:06.149999] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (3.55 seconds). [2025-09-23T19:48:06.596444] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T19:48:06.602154] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-23T19:48:07.402188] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-23T19:48:07.791292] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:48:08.202234] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-23T19:48:08.207760] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:48:08.208994] [INFO ] [REMOTE ] LND: Full fetch complete (8804 records). [2025-09-23T19:48:08.209062] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-23T19:48:08.572335] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-23T19:48:08.572425] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-23T19:48:08.572667] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-23T19:48:08.572729] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-23T19:48:08.573195] [DEBUG] [LOCAL ] LND: Trimmed 8804 records to 4996 (keeping 200 days of data) [2025-09-23T19:48:08.605804] [DEBUG] [LOCAL ] LND: Primary data saved (4996 records). [2025-09-23T19:48:08.605959] [INFO ] [MAIN ] LND: Full history saved. [2025-09-23T19:48:08.606048] [INFO ] [MAIN ] Update Progress: 1267/2372 symbols completed. LND took 23.9s. Estimated remaining: 2h 26m 36s. Rate: 7.5 symbols/min [2025-09-23T19:48:08.777157] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:08.804826] [DEBUG] [LOCAL ] LOB: Loaded 27551 existing records from primary storage. [2025-09-23T19:48:08.804970] [INFO ] [MAIN ] LOB: Loaded 27551 existing records. [2025-09-23T19:48:08.981212] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:08.981470] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-23T19:48:08.981517] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-23T19:48:08.982422] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-23T19:48:08.982510] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-23T19:48:09.011347] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-23T19:48:09.329386] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T19:48:09.374446] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:09.802193] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-23T19:48:10.317140] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:48:10.602249] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-23T19:48:10.695196] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T19:48:11.402276] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-23T19:48:11.843623] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:48:12.202223] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-23T19:48:13.002212] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-23T19:48:13.229672] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T19:48:13.259774] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:48:13.802207] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-23T19:48:14.223516] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T19:48:14.602182] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-23T19:48:14.738941] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T19:48:15.402202] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-23T19:48:15.762219] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:48:16.202193] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-23T19:48:17.002213] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-23T19:48:17.647173] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:48:17.802243] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-23T19:48:18.052345] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-23T19:48:18.095661] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:48:18.602175] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-23T19:48:18.663082] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T19:48:18.665713] [INFO ] [REMOTE ] LNN: Full fetch complete (15543 records). [2025-09-23T19:48:18.665836] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-23T19:48:19.045128] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-23T19:48:19.045317] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-23T19:48:19.046183] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-23T19:48:19.046259] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-23T19:48:19.047218] [DEBUG] [LOCAL ] LNN: Trimmed 15543 records to 11243 (keeping 200 days of data) [2025-09-23T19:48:19.131620] [DEBUG] [LOCAL ] LNN: Primary data saved (11243 records). [2025-09-23T19:48:19.131797] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-23T19:48:19.131905] [INFO ] [MAIN ] Update Progress: 1268/2372 symbols completed. LNN took 22.1s. Estimated remaining: 2h 26m 30s. Rate: 7.5 symbols/min [2025-09-23T19:48:19.313717] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:19.320130] [DEBUG] [LOCAL ] LOCL: Loaded 3572 existing records from primary storage. [2025-09-23T19:48:19.320252] [INFO ] [MAIN ] LOCL: Loaded 3572 existing records. [2025-09-23T19:48:19.409086] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-23T19:48:19.515676] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:19.516059] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-23T19:48:19.516136] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-23T19:48:19.531307] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-23T19:48:19.532036] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-23T19:48:19.531968] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T19:48:19.906229] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:20.202191] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-23T19:48:21.002179] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-23T19:48:21.092786] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:48:21.704081] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:48:21.802229] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-23T19:48:22.428857] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T19:48:22.580035] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:48:22.602157] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-23T19:48:23.035310] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T19:48:23.402194] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-23T19:48:24.202183] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-23T19:48:24.819697] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T19:48:25.002223] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-23T19:48:25.802186] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-23T19:48:26.113262] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-23T19:48:26.141485] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T19:48:26.602197] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-23T19:48:27.246824] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T19:48:27.318792] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T19:48:27.402197] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-23T19:48:28.202179] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-23T19:48:29.002182] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-23T19:48:29.076071] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:48:29.140048] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T19:48:29.356410] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T19:48:29.802195] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-23T19:48:30.602411] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-23T19:48:31.402199] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-23T19:48:32.017247] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T19:48:32.202246] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-23T19:48:32.435783] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:48:32.936179] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-23T19:48:33.002174] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-23T19:48:33.802160] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-23T19:48:33.991383] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T19:48:34.033789] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T19:48:34.038717] [INFO ] [REMOTE ] LOB: Full fetch complete (37589 records). [2025-09-23T19:48:34.038859] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-23T19:48:34.411822] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:48:34.428586] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-23T19:48:34.428638] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-23T19:48:34.429334] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-23T19:48:34.429461] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-23T19:48:34.430344] [DEBUG] [LOCAL ] LOB: Trimmed 37589 records to 27535 (keeping 200 days of data) [2025-09-23T19:48:34.603048] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-23T19:48:34.610901] [DEBUG] [LOCAL ] LOB: Primary data saved (27535 records). [2025-09-23T19:48:34.610984] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-23T19:48:34.611116] [INFO ] [MAIN ] Update Progress: 1269/2372 symbols completed. LOB took 26.0s. Estimated remaining: 2h 26m 29s. Rate: 7.5 symbols/min [2025-09-23T19:48:34.794244] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:34.834033] [DEBUG] [LOCAL ] LOMA: Loaded 31689 existing records from primary storage. [2025-09-23T19:48:34.834171] [INFO ] [MAIN ] LOMA: Loaded 31689 existing records. [2025-09-23T19:48:35.012504] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:35.012872] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-23T19:48:35.012939] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-23T19:48:35.013805] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-23T19:48:35.013883] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-23T19:48:35.366229] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:35.402140] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-23T19:48:36.202206] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-23T19:48:36.500581] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T19:48:36.887001] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T19:48:37.002152] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-23T19:48:37.354399] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T19:48:37.802224] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-23T19:48:38.424259] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T19:48:38.450118] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T19:48:38.602203] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-23T19:48:39.402204] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-23T19:48:40.202171] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-23T19:48:40.643536] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:48:40.713346] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-23T19:48:40.722134] [INFO ] [REMOTE ] LNG: Full fetch complete (74690 records). [2025-09-23T19:48:40.722324] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-23T19:48:41.007321] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-23T19:48:41.132540] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-23T19:48:41.132635] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-23T19:48:41.133611] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-23T19:48:41.133692] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-23T19:48:41.135278] [DEBUG] [LOCAL ] LNG: Trimmed 74690 records to 51508 (keeping 200 days of data) [2025-09-23T19:48:41.487103] [DEBUG] [LOCAL ] LNG: Primary data saved (51508 records). [2025-09-23T19:48:41.487376] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-23T19:48:41.489742] [INFO ] [MAIN ] Update Progress: 1270/2372 symbols completed. LNG took 47.5s. Estimated remaining: 2h 26m 20s. Rate: 7.5 symbols/min [2025-09-23T19:48:41.567233] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T19:48:41.675596] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:41.734112] [DEBUG] [LOCAL ] LOW: Loaded 52956 existing records from primary storage. [2025-09-23T19:48:41.734268] [INFO ] [MAIN ] LOW: Loaded 52956 existing records. [2025-09-23T19:48:41.807252] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-23T19:48:41.937820] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:48:41.941814] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:41.949600] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-23T19:48:41.949723] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-23T19:48:41.949911] [INFO ] [REMOTE ] LOAR: Full fetch complete (56365 records). [2025-09-23T19:48:41.949992] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-23T19:48:41.985333] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-23T19:48:42.031101] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-23T19:48:42.625265] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-23T19:48:42.720134] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-23T19:48:42.720286] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-23T19:48:42.746318] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-23T19:48:42.752311] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:42.752407] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-23T19:48:42.755426] [DEBUG] [LOCAL ] LOAR: Trimmed 56365 records to 41777 (keeping 200 days of data) [2025-09-23T19:48:43.027638] [DEBUG] [LOCAL ] LOAR: Primary data saved (41777 records). [2025-09-23T19:48:43.028123] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-23T19:48:43.028367] [INFO ] [MAIN ] Update Progress: 1271/2372 symbols completed. LOAR took 38.7s. Estimated remaining: 2h 26m 6s. Rate: 7.5 symbols/min [2025-09-23T19:48:43.212616] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T19:48:43.216007] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:43.237032] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T19:48:43.279673] [DEBUG] [LOCAL ] LPG: Loaded 40243 existing records from primary storage. [2025-09-23T19:48:43.279825] [INFO ] [MAIN ] LPG: Loaded 40243 existing records. [2025-09-23T19:48:43.417208] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-23T19:48:43.459227] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:43.459705] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-23T19:48:43.459786] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-23T19:48:43.461242] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-23T19:48:43.461309] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-23T19:48:43.832015] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:44.202184] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-23T19:48:45.002175] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-23T19:48:45.291756] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T19:48:45.504403] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T19:48:45.802202] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-23T19:48:46.561892] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T19:48:46.602179] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-23T19:48:47.402183] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-23T19:48:47.689635] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T19:48:47.710905] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T19:48:48.135894] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T19:48:48.202138] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-23T19:48:49.002227] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-23T19:48:49.802206] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-23T19:48:49.948835] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T19:48:50.268492] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T19:48:50.602245] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-23T19:48:51.314424] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:48:51.319172] [INFO ] [REMOTE ] LOCL: Full fetch complete (4829 records). [2025-09-23T19:48:51.319049] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T19:48:51.328764] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-23T19:48:51.407272] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-23T19:48:51.753038] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-23T19:48:51.753127] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-23T19:48:51.753265] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-23T19:48:51.753301] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-23T19:48:51.753711] [DEBUG] [LOCAL ] LOCL: Trimmed 4829 records to 3584 (keeping 200 days of data) [2025-09-23T19:48:51.777773] [DEBUG] [LOCAL ] LOCL: Primary data saved (3584 records). [2025-09-23T19:48:51.777867] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-23T19:48:51.777964] [INFO ] [MAIN ] Update Progress: 1272/2372 symbols completed. LOCL took 32.6s. Estimated remaining: 2h 25m 59s. Rate: 7.5 symbols/min [2025-09-23T19:48:51.961688] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:51.996251] [DEBUG] [LOCAL ] LPL: Loaded 25401 existing records from primary storage. [2025-09-23T19:48:51.996395] [INFO ] [MAIN ] LPL: Loaded 25401 existing records. [2025-09-23T19:48:52.178438] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:52.178771] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-23T19:48:52.178827] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-23T19:48:52.179678] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-23T19:48:52.179741] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-23T19:48:52.210628] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-23T19:48:52.544348] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:53.002172] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-23T19:48:53.335678] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T19:48:53.439001] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T19:48:53.802269] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-23T19:48:54.235631] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:48:54.602215] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-23T19:48:55.402251] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-23T19:48:55.697603] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T19:48:55.804029] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T19:48:56.199959] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T19:48:56.205369] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-23T19:48:57.002198] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-23T19:48:57.245499] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T19:48:57.802199] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-23T19:48:57.988064] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T19:48:58.602211] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-23T19:48:59.402200] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-23T19:48:59.740240] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T19:49:00.085493] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:49:00.092776] [INFO ] [REMOTE ] LOMA: Full fetch complete (48080 records). [2025-09-23T19:49:00.092918] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-23T19:49:00.207271] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-23T19:49:00.481031] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-23T19:49:00.481120] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-23T19:49:00.481975] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-23T19:49:00.482042] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-23T19:49:00.483198] [DEBUG] [LOCAL ] LOMA: Trimmed 48080 records to 31837 (keeping 200 days of data) [2025-09-23T19:49:00.667976] [DEBUG] [LOCAL ] LOMA: Primary data saved (31837 records). [2025-09-23T19:49:00.668122] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-23T19:49:00.668222] [INFO ] [MAIN ] Update Progress: 1273/2372 symbols completed. LOMA took 26.1s. Estimated remaining: 2h 25m 52s. Rate: 7.5 symbols/min [2025-09-23T19:49:00.846292] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:00.888274] [DEBUG] [LOCAL ] LPX: Loaded 39748 existing records from primary storage. [2025-09-23T19:49:00.888447] [INFO ] [MAIN ] LPX: Loaded 39748 existing records. [2025-09-23T19:49:01.002741] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-23T19:49:01.075514] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:01.075901] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-23T19:49:01.076063] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-23T19:49:01.085107] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-23T19:49:01.100581] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-23T19:49:01.153854] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T19:49:01.506718] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:01.802295] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-23T19:49:02.190928] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T19:49:02.215212] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:49:02.602246] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-23T19:49:03.402225] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-23T19:49:03.467718] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T19:49:04.207520] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-23T19:49:04.219622] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:49:04.754109] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T19:49:05.002320] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-23T19:49:05.718117] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T19:49:05.802228] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-23T19:49:06.004981] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T19:49:06.602238] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-23T19:49:07.402216] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-23T19:49:07.662972] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T19:49:07.664971] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T19:49:08.202233] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-23T19:49:08.565144] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T19:49:08.845075] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T19:49:09.002212] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-23T19:49:09.802339] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-23T19:49:10.218168] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T19:49:10.602222] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-23T19:49:11.043301] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:49:11.402210] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-23T19:49:11.837752] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:49:12.202204] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-23T19:49:12.913060] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T19:49:13.002256] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-23T19:49:13.730164] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T19:49:13.802169] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-23T19:49:14.562438] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T19:49:14.602173] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-23T19:49:15.245672] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T19:49:15.402198] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-23T19:49:16.071477] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T19:49:16.078137] [INFO ] [REMOTE ] LPL: Full fetch complete (34464 records). [2025-09-23T19:49:16.078237] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-23T19:49:16.207269] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-23T19:49:16.464539] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-23T19:49:16.464666] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-23T19:49:16.465425] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-23T19:49:16.465488] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-23T19:49:16.466420] [DEBUG] [LOCAL ] LPL: Trimmed 34464 records to 25591 (keeping 200 days of data) [2025-09-23T19:49:16.620301] [DEBUG] [LOCAL ] LPL: Primary data saved (25591 records). [2025-09-23T19:49:16.620449] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-23T19:49:16.620540] [INFO ] [MAIN ] Update Progress: 1274/2372 symbols completed. LPL took 24.8s. Estimated remaining: 2h 25m 51s. Rate: 7.5 symbols/min [2025-09-23T19:49:16.792069] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:16.838063] [DEBUG] [LOCAL ] LRN: Loaded 40065 existing records from primary storage. [2025-09-23T19:49:16.838293] [INFO ] [MAIN ] LRN: Loaded 40065 existing records. [2025-09-23T19:49:17.002982] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-23T19:49:17.056992] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:17.057392] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-23T19:49:17.057777] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-23T19:49:17.061638] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T19:49:17.062067] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-23T19:49:17.071879] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-23T19:49:17.425130] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:17.802230] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-23T19:49:18.216900] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T19:49:18.607560] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-23T19:49:18.619977] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T19:49:18.627004] [INFO ] [REMOTE ] LPG: Full fetch complete (59993 records). [2025-09-23T19:49:18.627109] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-23T19:49:19.022135] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-23T19:49:19.022321] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-23T19:49:19.023319] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-23T19:49:19.023438] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-23T19:49:19.041757] [DEBUG] [LOCAL ] LPG: Trimmed 59993 records to 40171 (keeping 200 days of data) [2025-09-23T19:49:19.046524] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:49:19.306167] [DEBUG] [LOCAL ] LPG: Primary data saved (40171 records). [2025-09-23T19:49:19.306305] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-23T19:49:19.306387] [INFO ] [MAIN ] Update Progress: 1275/2372 symbols completed. LPG took 36.3s. Estimated remaining: 2h 25m 38s. Rate: 7.5 symbols/min [2025-09-23T19:49:19.406002] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-23T19:49:19.477906] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:19.522036] [DEBUG] [LOCAL ] LSPD: Loaded 43453 existing records from primary storage. [2025-09-23T19:49:19.522265] [INFO ] [MAIN ] LSPD: Loaded 43453 existing records. [2025-09-23T19:49:19.700953] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:19.701208] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-23T19:49:19.701257] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-23T19:49:19.702281] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-23T19:49:19.702344] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-23T19:49:20.057932] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:20.202247] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-23T19:49:20.350816] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:49:20.359559] [INFO ] [REMOTE ] LOW: Full fetch complete (76476 records). [2025-09-23T19:49:20.359733] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-23T19:49:20.752038] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-23T19:49:20.752146] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-23T19:49:20.753182] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-23T19:49:20.753288] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-23T19:49:20.755062] [DEBUG] [LOCAL ] LOW: Trimmed 76476 records to 52961 (keeping 200 days of data) [2025-09-23T19:49:20.886742] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T19:49:21.023136] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-23T19:49:21.144748] [DEBUG] [LOCAL ] LOW: Primary data saved (52961 records). [2025-09-23T19:49:21.144924] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-23T19:49:21.145050] [INFO ] [MAIN ] Update Progress: 1276/2372 symbols completed. LOW took 39.7s. Estimated remaining: 2h 25m 25s. Rate: 7.5 symbols/min [2025-09-23T19:49:21.311833] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:21.342636] [DEBUG] [LOCAL ] LTC: Loaded 29864 existing records from primary storage. [2025-09-23T19:49:21.342824] [INFO ] [MAIN ] LTC: Loaded 29864 existing records. [2025-09-23T19:49:21.531140] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:21.531503] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-23T19:49:21.531585] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-23T19:49:21.532480] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-23T19:49:21.532549] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-23T19:49:21.812517] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-23T19:49:21.859425] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T19:49:21.951977] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:22.163502] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T19:49:22.602213] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-23T19:49:23.311332] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T19:49:23.402185] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-23T19:49:24.104247] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T19:49:24.202191] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-23T19:49:24.818444] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T19:49:25.002185] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-23T19:49:25.769325] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:49:25.802145] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-23T19:49:26.209851] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:49:26.602196] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-23T19:49:27.076792] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T19:49:27.402228] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-23T19:49:28.202263] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-23T19:49:28.261635] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:49:29.002221] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-23T19:49:29.039394] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:49:29.542240] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T19:49:29.802245] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-23T19:49:30.602202] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-23T19:49:31.402202] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-23T19:49:31.479859] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T19:49:32.202209] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-23T19:49:33.636066] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T19:49:33.645899] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-23T19:49:34.208707] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (5.21 seconds). [2025-09-23T19:49:34.219422] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-23T19:49:35.188734] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T19:49:35.198151] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-23T19:49:36.090861] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (5.49 seconds). [2025-09-23T19:49:36.100728] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-23T19:49:37.056386] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (5.65 seconds). [2025-09-23T19:49:37.064180] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-23T19:49:37.619079] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T19:49:37.626759] [INFO ] [REMOTE ] LPX: Full fetch complete (58399 records). [2025-09-23T19:49:37.626978] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-23T19:49:38.054155] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-23T19:49:38.054462] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-23T19:49:38.055948] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-23T19:49:38.056048] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-23T19:49:38.087567] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (3.87 seconds). [2025-09-23T19:49:38.097234] [DEBUG] [LOCAL ] LPX: Trimmed 58399 records to 39673 (keeping 200 days of data) [2025-09-23T19:49:38.098958] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-23T19:49:38.379212] [DEBUG] [LOCAL ] LPX: Primary data saved (39673 records). [2025-09-23T19:49:38.379474] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-23T19:49:38.379596] [INFO ] [MAIN ] Update Progress: 1277/2372 symbols completed. LPX took 37.7s. Estimated remaining: 2h 25m 25s. Rate: 7.5 symbols/min [2025-09-23T19:49:38.542185] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-23T19:49:38.551185] [INFO ] [REMOTE ] LRN: Full fetch complete (58396 records). [2025-09-23T19:49:38.551391] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-23T19:49:38.988980] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-23T19:49:38.988771] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-23T19:49:38.995100] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-23T19:49:38.996017] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-23T19:49:38.996104] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-23T19:49:38.996580] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-23T19:49:38.998291] [DEBUG] [LOCAL ] LRN: Trimmed 58396 records to 40031 (keeping 200 days of data) [2025-09-23T19:49:39.253077] [DEBUG] [LOCAL ] LRN: Primary data saved (40031 records). [2025-09-23T19:49:39.253214] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-23T19:49:39.253298] [INFO ] [MAIN ] Update Progress: 1278/2372 symbols completed. LRN took 22.6s. Estimated remaining: 2h 25m 11s. Rate: 7.5 symbols/min [2025-09-23T19:49:39.643182] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T19:49:39.652684] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-23T19:49:40.241113] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T19:49:40.247852] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-23T19:49:41.579290] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T19:49:41.586919] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-23T19:49:41.736705] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T19:49:41.746120] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-23T19:49:42.937037] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T19:49:42.944210] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-23T19:49:43.019193] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:49:43.028003] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-23T19:49:44.337465] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T19:49:44.343691] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-23T19:49:44.461425] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T19:49:44.468622] [INFO ] [REMOTE ] LSPD: Full fetch complete (61559 records). [2025-09-23T19:49:44.468792] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-23T19:49:44.866335] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-23T19:49:44.866446] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-23T19:49:44.867485] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-23T19:49:44.867552] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-23T19:49:44.868972] [DEBUG] [LOCAL ] LSPD: Trimmed 61559 records to 43334 (keeping 200 days of data) [2025-09-23T19:49:45.126995] [DEBUG] [LOCAL ] LSPD: Primary data saved (43334 records). [2025-09-23T19:49:45.127148] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-23T19:49:45.127239] [INFO ] [MAIN ] Update Progress: 1279/2372 symbols completed. LSPD took 25.8s. Estimated remaining: 2h 25m 1s. Rate: 7.5 symbols/min [2025-09-23T19:49:45.584181] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:49:45.592190] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-23T19:49:46.689048] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:49:46.695982] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-23T19:49:48.066932] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:49:48.071864] [INFO ] [REMOTE ] LTC: Full fetch complete (42858 records). [2025-09-23T19:49:48.071967] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-23T19:49:48.446694] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-23T19:49:48.446781] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-23T19:49:48.447463] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-23T19:49:48.447505] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-23T19:49:48.448448] [DEBUG] [LOCAL ] LTC: Trimmed 42858 records to 29903 (keeping 200 days of data) [2025-09-23T19:49:48.636687] [DEBUG] [LOCAL ] LTC: Primary data saved (29903 records). [2025-09-23T19:49:48.636828] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-23T19:49:48.636914] [INFO ] [MAIN ] Update Progress: 1280/2372 symbols completed. LTC took 27.5s. Estimated remaining: 2h 24m 49s. Rate: 7.5 symbols/min [2025-09-23T19:49:49.187240] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:49.289274] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:49.359831] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:49.342473] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:49.360284] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-23T19:49:49.360610] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-23T19:49:49.360776] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-23T19:49:49.360819] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-23T19:49:49.360859] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-23T19:49:49.360893] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-23T19:49:49.684799] [DEBUG] [LOCAL ] LTM: Loaded 36009 existing records from primary storage. [2025-09-23T19:49:49.698365] [INFO ] [MAIN ] LTM: Loaded 36009 existing records. [2025-09-23T19:49:49.719767] [DEBUG] [LOCAL ] LU: Loaded 48994 existing records from primary storage. [2025-09-23T19:49:49.785085] [INFO ] [MAIN ] LU: Loaded 48994 existing records. [2025-09-23T19:49:49.844608] [DEBUG] [LOCAL ] LTH: Loaded 51890 existing records from primary storage. [2025-09-23T19:49:49.864086] [INFO ] [MAIN ] LTH: Loaded 51890 existing records. [2025-09-23T19:49:50.018069] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:50.043986] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-23T19:49:50.302244] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:50.302107] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:50.302952] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-23T19:49:50.303059] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-23T19:49:50.324163] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-23T19:49:50.302894] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-23T19:49:50.343550] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-23T19:49:50.428077] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-23T19:49:50.420803] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:50.478919] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-23T19:49:50.469404] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-23T19:49:50.489124] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-23T19:49:50.494486] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-23T19:49:50.599883] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-23T19:49:50.629161] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-23T19:49:51.422552] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:51.453591] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-23T19:49:51.519626] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:51.599807] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-23T19:49:51.599496] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:51.600126] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-23T19:49:51.622030] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:49:51.627247] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-23T19:49:52.732004] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T19:49:52.736853] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-23T19:49:52.890843] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T19:49:52.899801] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-23T19:49:52.951089] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T19:49:52.961713] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-23T19:49:53.142046] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T19:49:53.151380] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-23T19:49:53.830181] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:49:53.835673] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-23T19:49:53.916324] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T19:49:53.923810] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-23T19:49:54.564401] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T19:49:54.602141] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-23T19:49:54.684698] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T19:49:54.712541] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T19:49:54.778636] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T19:49:55.402185] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-23T19:49:56.159008] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:49:56.202246] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-23T19:49:56.513531] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T19:49:57.002387] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-23T19:49:57.213318] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T19:49:57.802195] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-23T19:49:58.454488] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:49:58.602155] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-23T19:49:58.997504] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:49:59.402290] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-23T19:50:00.202181] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-23T19:50:00.421261] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T19:50:00.513282] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T19:50:01.002227] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-23T19:50:01.802295] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-23T19:50:02.010589] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T19:50:02.074419] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T19:50:02.602303] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-23T19:50:02.759061] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T19:50:03.402234] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-23T19:50:04.091905] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T19:50:04.202290] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-23T19:50:05.002258] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-23T19:50:05.157574] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T19:50:05.359620] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:50:05.802178] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-23T19:50:06.032035] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T19:50:06.602222] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-23T19:50:07.298700] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T19:50:07.402193] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-23T19:50:07.700101] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T19:50:07.705027] [INFO ] [REMOTE ] LUCK: Full fetch complete (40159 records). [2025-09-23T19:50:07.705156] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-23T19:50:07.910831] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-23T19:50:07.911412] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:50:07.911485] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:50:07.911559] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-23T19:50:07.911669] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-23T19:50:07.911732] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-23T19:50:07.911793] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-23T19:50:07.911890] [INFO ] [MAIN ] Update Progress: 1281/2372 symbols completed. LUCK took 19.3s. Estimated remaining: 2h 24m 51s. Rate: 7.5 symbols/min [2025-09-23T19:50:08.088321] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:08.144033] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-23T19:50:08.144204] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-09-23T19:50:08.208563] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-23T19:50:08.329110] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:08.329347] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-23T19:50:08.329397] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-23T19:50:08.331143] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-23T19:50:08.331207] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-23T19:50:08.691615] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:09.002216] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-23T19:50:09.089582] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T19:50:09.393849] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T19:50:09.802204] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-23T19:50:10.511508] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T19:50:10.602204] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-23T19:50:11.402223] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-23T19:50:11.759398] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-23T19:50:12.202260] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-23T19:50:12.239522] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:50:12.456476] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T19:50:13.002213] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-23T19:50:13.703759] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T19:50:13.802196] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-23T19:50:14.270256] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:50:14.602222] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-23T19:50:15.083030] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T19:50:15.402229] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-23T19:50:16.202198] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-23T19:50:17.002270] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-23T19:50:17.059700] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T19:50:17.276011] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-23T19:50:17.284885] [INFO ] [REMOTE ] LU: Full fetch complete (70397 records). [2025-09-23T19:50:17.285067] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-23T19:50:17.694031] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-23T19:50:17.694208] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-23T19:50:17.695425] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-23T19:50:17.695538] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-23T19:50:17.697237] [DEBUG] [LOCAL ] LU: Trimmed 70397 records to 48961 (keeping 200 days of data) [2025-09-23T19:50:17.805816] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-23T19:50:17.823855] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T19:50:18.031077] [DEBUG] [LOCAL ] LU: Primary data saved (48961 records). [2025-09-23T19:50:18.031278] [INFO ] [MAIN ] LU: Full history saved. [2025-09-23T19:50:18.031453] [INFO ] [MAIN ] Update Progress: 1282/2372 symbols completed. LU took 29.4s. Estimated remaining: 2h 24m 45s. Rate: 7.5 symbols/min [2025-09-23T19:50:18.214293] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:18.272875] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-23T19:50:18.273146] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-09-23T19:50:18.457994] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:18.458519] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-23T19:50:18.458582] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-23T19:50:18.471751] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-23T19:50:18.488854] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-23T19:50:18.569513] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T19:50:18.604126] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-23T19:50:18.880232] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:19.402205] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-23T19:50:19.582972] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T19:50:19.591210] [INFO ] [REMOTE ] LTM: Full fetch complete (46918 records). [2025-09-23T19:50:19.591342] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-23T19:50:19.983918] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-23T19:50:19.984042] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-23T19:50:19.984867] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-23T19:50:19.984958] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-23T19:50:19.986708] [DEBUG] [LOCAL ] LTM: Trimmed 46918 records to 36133 (keeping 200 days of data) [2025-09-23T19:50:20.202317] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-23T19:50:20.220214] [DEBUG] [LOCAL ] LTM: Primary data saved (36133 records). [2025-09-23T19:50:20.220887] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-23T19:50:20.221031] [INFO ] [MAIN ] Update Progress: 1283/2372 symbols completed. LTM took 31.6s. Estimated remaining: 2h 24m 32s. Rate: 7.5 symbols/min [2025-09-23T19:50:20.398001] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:20.398224] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-23T19:50:20.398291] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-23T19:50:20.398677] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-23T19:50:20.398747] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-23T19:50:20.398816] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-23T19:50:20.398853] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-23T19:50:20.824466] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:20.828706] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-23T19:50:21.002246] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-23T19:50:21.088256] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T19:50:21.211707] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:21.212045] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-23T19:50:21.802154] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-23T19:50:22.123805] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T19:50:22.158208] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:22.158533] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-23T19:50:22.602187] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-23T19:50:23.402203] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-23T19:50:23.595127] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:23.595509] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-23T19:50:24.202198] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-23T19:50:24.351468] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:50:24.360140] [INFO ] [REMOTE ] LTH: Full fetch complete (73884 records). [2025-09-23T19:50:24.360274] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-23T19:50:24.436206] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:24.460545] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-23T19:50:24.764672] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-23T19:50:24.764829] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-23T19:50:24.766053] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-23T19:50:24.766188] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-23T19:50:24.768230] [DEBUG] [LOCAL ] LTH: Trimmed 73884 records to 51874 (keeping 200 days of data) [2025-09-23T19:50:25.009598] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-23T19:50:25.089129] [DEBUG] [LOCAL ] LTH: Primary data saved (51874 records). [2025-09-23T19:50:25.089261] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-23T19:50:25.089441] [INFO ] [MAIN ] Update Progress: 1284/2372 symbols completed. LTH took 36.5s. Estimated remaining: 2h 24m 22s. Rate: 7.5 symbols/min [2025-09-23T19:50:25.257214] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:25.312277] [DEBUG] [LOCAL ] LVS: Loaded 53567 existing records from primary storage. [2025-09-23T19:50:25.312419] [INFO ] [MAIN ] LVS: Loaded 53567 existing records. [2025-09-23T19:50:25.487969] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:25.488218] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-23T19:50:25.488271] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-23T19:50:25.489753] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-23T19:50:25.489833] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-23T19:50:25.807265] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-23T19:50:25.845221] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:26.602231] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-23T19:50:27.030927] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T19:50:27.402248] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-23T19:50:27.591343] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:27.591732] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-23T19:50:27.730685] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T19:50:28.202227] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-23T19:50:29.002239] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-23T19:50:29.802181] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-23T19:50:30.117998] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-23T19:50:30.531734] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T19:50:30.602218] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-23T19:50:30.700941] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T19:50:31.402224] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-23T19:50:31.606589] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (5.00 seconds). [2025-09-23T19:50:32.202172] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-23T19:50:32.300270] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T19:50:32.748688] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-23T19:50:33.002250] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-23T19:50:33.802175] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-23T19:50:34.039860] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:50:34.168024] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T19:50:34.602201] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-23T19:50:35.402204] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-23T19:50:35.947371] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T19:50:36.033214] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:50:36.202188] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-23T19:50:37.002246] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-23T19:50:37.414440] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-23T19:50:37.802187] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-23T19:50:37.975749] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T19:50:38.168085] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T19:50:38.602191] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-23T19:50:39.402222] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-23T19:50:39.435929] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T19:50:40.118500] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T19:50:40.204090] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-23T19:50:40.206055] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T19:50:40.210679] [INFO ] [REMOTE ] LUXE: Full fetch complete (13177 records). [2025-09-23T19:50:40.210766] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-23T19:50:40.394634] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 100 unique days, need 200 days [2025-09-23T19:50:40.394927] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:50:40.395005] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:50:40.395124] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-23T19:50:40.395199] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-23T19:50:40.395248] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-23T19:50:40.395314] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-23T19:50:40.395400] [INFO ] [MAIN ] Update Progress: 1285/2372 symbols completed. LUXE took 20.2s. Estimated remaining: 2h 24m 20s. Rate: 7.5 symbols/min [2025-09-23T19:50:40.572755] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:40.597112] [DEBUG] [LOCAL ] LVWR: Loaded 17418 existing records from primary storage. [2025-09-23T19:50:40.597275] [INFO ] [MAIN ] LVWR: Loaded 17418 existing records. [2025-09-23T19:50:40.777058] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:40.777310] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-23T19:50:40.777373] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-23T19:50:40.778138] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-23T19:50:40.778201] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-23T19:50:41.010350] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-23T19:50:41.172339] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:41.802230] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-23T19:50:42.245735] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T19:50:42.602242] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-23T19:50:43.137610] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T19:50:43.133998] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T19:50:43.308210] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T19:50:43.402240] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-23T19:50:44.011233] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T19:50:44.202214] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-23T19:50:45.002210] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-23T19:50:45.802278] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-23T19:50:46.301722] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T19:50:46.386214] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T19:50:46.602174] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-23T19:50:46.816260] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T19:50:47.402268] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-23T19:50:47.816113] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T19:50:48.202178] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-23T19:50:48.347025] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T19:50:49.002223] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-23T19:50:49.802195] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-23T19:50:50.230980] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T19:50:50.240868] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-23T19:50:50.241061] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-23T19:50:50.611876] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-23T19:50:50.664048] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-23T19:50:50.664221] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-23T19:50:50.665737] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-23T19:50:50.665808] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-23T19:50:50.670887] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 53634 (keeping 200 days of data) [2025-09-23T19:50:51.056535] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T19:50:51.073880] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T19:50:51.101398] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-09-23T19:50:51.101609] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-23T19:50:51.101778] [INFO ] [MAIN ] Update Progress: 1286/2372 symbols completed. LUMN took 43.2s. Estimated remaining: 2h 24m 14s. Rate: 7.5 symbols/min [2025-09-23T19:50:51.279762] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:51.342943] [DEBUG] [LOCAL ] LW: Loaded 51236 existing records from primary storage. [2025-09-23T19:50:51.343197] [INFO ] [MAIN ] LW: Loaded 51236 existing records. [2025-09-23T19:50:51.412359] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-23T19:50:51.547971] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:51.548605] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-23T19:50:51.548842] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-23T19:50:51.550737] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-23T19:50:51.550805] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-23T19:50:51.904489] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T19:50:52.009036] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:52.202250] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-23T19:50:52.571851] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:50:53.002231] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-23T19:50:53.802222] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-23T19:50:54.172191] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T19:50:54.186126] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-23T19:50:54.186289] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-23T19:50:54.495468] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:50:54.610271] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-23T19:50:54.630168] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-23T19:50:54.630243] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-23T19:50:54.631279] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-23T19:50:54.631349] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-23T19:50:54.633065] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 53689 (keeping 200 days of data) [2025-09-23T19:50:54.979978] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-09-23T19:50:54.980132] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-23T19:50:54.980236] [INFO ] [MAIN ] Update Progress: 1287/2372 symbols completed. LUV took 36.9s. Estimated remaining: 2h 24m 3s. Rate: 7.5 symbols/min [2025-09-23T19:50:55.150329] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:55.171331] [DEBUG] [LOCAL ] LXFR: Loaded 17038 existing records from primary storage. [2025-09-23T19:50:55.171449] [INFO ] [MAIN ] LXFR: Loaded 17038 existing records. [2025-09-23T19:50:55.359695] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:55.360004] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-23T19:50:55.360060] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-23T19:50:55.360852] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-23T19:50:55.360915] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-23T19:50:55.405875] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-23T19:50:55.756359] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:55.772154] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T19:50:56.202187] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-23T19:50:56.389882] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T19:50:56.426501] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T19:50:57.002226] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-23T19:50:57.802173] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-23T19:50:57.878400] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T19:50:58.602195] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-23T19:50:59.402184] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-23T19:50:59.728123] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:50:59.737043] [INFO ] [REMOTE ] LVS: Full fetch complete (77515 records). [2025-09-23T19:50:59.737178] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-23T19:51:00.135629] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-23T19:51:00.135767] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-23T19:51:00.136792] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-23T19:51:00.136878] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-23T19:51:00.138375] [DEBUG] [LOCAL ] LVS: Trimmed 77515 records to 53568 (keeping 200 days of data) [2025-09-23T19:51:00.429750] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T19:51:00.438489] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (4.24 seconds). [2025-09-23T19:51:00.444083] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-23T19:51:00.444529] [INFO ] [REMOTE ] LVWR: Full fetch complete (19804 records). [2025-09-23T19:51:00.447633] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-23T19:51:00.446413] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T19:51:00.887418] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-23T19:51:00.888132] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-23T19:51:00.889302] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-23T19:51:00.889626] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-23T19:51:00.892537] [DEBUG] [LOCAL ] LVWR: Trimmed 19804 records to 17514 (keeping 200 days of data) [2025-09-23T19:51:01.006520] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-23T19:51:01.076833] [DEBUG] [LOCAL ] LVS: Primary data saved (53568 records). [2025-09-23T19:51:01.077612] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-23T19:51:01.077988] [INFO ] [MAIN ] Update Progress: 1288/2372 symbols completed. LVS took 36.0s. Estimated remaining: 2h 23m 53s. Rate: 7.5 symbols/min [2025-09-23T19:51:01.187898] [DEBUG] [LOCAL ] LVWR: Primary data saved (17514 records). [2025-09-23T19:51:01.188115] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-23T19:51:01.193896] [INFO ] [MAIN ] Update Progress: 1289/2372 symbols completed. LVWR took 20.8s. Estimated remaining: 2h 23m 39s. Rate: 7.5 symbols/min [2025-09-23T19:51:01.352131] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:01.457240] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:01.520037] [DEBUG] [LOCAL ] LXU: Loaded 32066 existing records from primary storage. [2025-09-23T19:51:01.522017] [INFO ] [MAIN ] LXU: Loaded 32066 existing records. [2025-09-23T19:51:01.528438] [DEBUG] [LOCAL ] LXP: Loaded 50627 existing records from primary storage. [2025-09-23T19:51:01.570784] [INFO ] [MAIN ] LXP: Loaded 50627 existing records. [2025-09-23T19:51:01.865464] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:01.926422] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:01.922117] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-23T19:51:01.926934] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-23T19:51:01.941626] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-23T19:51:01.944615] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-23T19:51:01.945747] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T19:51:01.950252] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-23T19:51:01.945883] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-23T19:51:01.951169] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-23T19:51:01.964906] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-23T19:51:01.971058] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-23T19:51:02.764728] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:02.769318] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-23T19:51:02.797464] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:03.402266] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-23T19:51:03.769817] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-23T19:51:04.202202] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-23T19:51:04.834811] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-09-23T19:51:05.002192] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-23T19:51:05.026107] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-23T19:51:05.802179] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-23T19:51:06.078577] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T19:51:06.140741] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-23T19:51:06.376749] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T19:51:06.602218] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-23T19:51:06.758135] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T19:51:07.402214] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-23T19:51:08.148531] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T19:51:08.188591] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:51:08.202148] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-23T19:51:09.002222] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-23T19:51:09.802272] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-23T19:51:09.966460] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T19:51:10.005537] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T19:51:10.602310] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-23T19:51:10.793193] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T19:51:11.402265] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-23T19:51:11.616007] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T19:51:12.202210] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-23T19:51:12.251628] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T19:51:13.002262] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-23T19:51:13.802188] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-23T19:51:13.863245] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:51:14.082113] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T19:51:14.602232] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-23T19:51:15.402199] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-23T19:51:15.431442] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:51:15.690300] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T19:51:16.202195] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-23T19:51:17.002196] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-23T19:51:17.109547] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T19:51:17.324750] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T19:51:17.327903] [INFO ] [REMOTE ] LXFR: Full fetch complete (25163 records). [2025-09-23T19:51:17.327982] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-23T19:51:17.695210] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-23T19:51:17.695301] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-23T19:51:17.695897] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-23T19:51:17.695959] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-23T19:51:17.696606] [DEBUG] [LOCAL ] LXFR: Trimmed 25163 records to 17121 (keeping 200 days of data) [2025-09-23T19:51:17.802300] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-23T19:51:17.808365] [DEBUG] [LOCAL ] LXFR: Primary data saved (17121 records). [2025-09-23T19:51:17.808543] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-23T19:51:17.808636] [INFO ] [MAIN ] Update Progress: 1290/2372 symbols completed. LXFR took 22.8s. Estimated remaining: 2h 23m 38s. Rate: 7.5 symbols/min [2025-09-23T19:51:17.982254] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:18.035471] [DEBUG] [LOCAL ] LYB: Loaded 53598 existing records from primary storage. [2025-09-23T19:51:18.035630] [INFO ] [MAIN ] LYB: Loaded 53598 existing records. [2025-09-23T19:51:18.242551] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:18.242831] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-23T19:51:18.242908] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-23T19:51:18.244313] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-23T19:51:18.244375] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-23T19:51:18.621208] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:18.621275] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-23T19:51:18.639599] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:51:19.402204] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-23T19:51:20.202330] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-23T19:51:20.840203] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T19:51:20.891248] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (3.09 seconds). [2025-09-23T19:51:21.002185] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-23T19:51:21.417542] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T19:51:21.458260] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T19:51:21.802204] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-23T19:51:22.593938] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T19:51:22.604557] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-23T19:51:23.402177] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-23T19:51:23.574121] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T19:51:23.923013] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:51:24.202204] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-23T19:51:25.002240] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-23T19:51:25.108993] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T19:51:25.117487] [INFO ] [REMOTE ] LW: Full fetch complete (74602 records). [2025-09-23T19:51:25.117701] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-23T19:51:25.519460] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-23T19:51:25.519600] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-23T19:51:25.520730] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-23T19:51:25.520821] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-23T19:51:25.544980] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T19:51:25.552113] [DEBUG] [LOCAL ] LW: Trimmed 74602 records to 51202 (keeping 200 days of data) [2025-09-23T19:51:25.802298] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-23T19:51:25.873970] [DEBUG] [LOCAL ] LW: Primary data saved (51202 records). [2025-09-23T19:51:25.874135] [INFO ] [MAIN ] LW: Full history saved. [2025-09-23T19:51:25.874230] [INFO ] [MAIN ] Update Progress: 1291/2372 symbols completed. LW took 34.8s. Estimated remaining: 2h 23m 30s. Rate: 7.5 symbols/min [2025-09-23T19:51:26.052729] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:26.111714] [DEBUG] [LOCAL ] LYG: Loaded 52882 existing records from primary storage. [2025-09-23T19:51:26.111882] [INFO ] [MAIN ] LYG: Loaded 52882 existing records. [2025-09-23T19:51:26.318176] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:26.318478] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-23T19:51:26.318534] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-23T19:51:26.320023] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-23T19:51:26.320152] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-23T19:51:26.619825] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-23T19:51:26.709190] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:26.726886] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T19:51:26.732724] [INFO ] [REMOTE ] LXU: Full fetch complete (44926 records). [2025-09-23T19:51:26.733044] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-23T19:51:26.880485] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T19:51:27.203201] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-23T19:51:27.203312] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-23T19:51:27.204166] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-23T19:51:27.204235] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-23T19:51:27.205565] [DEBUG] [LOCAL ] LXU: Trimmed 44926 records to 32069 (keeping 200 days of data) [2025-09-23T19:51:27.403482] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-23T19:51:27.403671] [DEBUG] [LOCAL ] LXU: Primary data saved (32069 records). [2025-09-23T19:51:27.405011] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-23T19:51:27.405290] [INFO ] [MAIN ] Update Progress: 1292/2372 symbols completed. LXU took 26.2s. Estimated remaining: 2h 23m 17s. Rate: 7.5 symbols/min [2025-09-23T19:51:27.617367] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:27.678452] [DEBUG] [LOCAL ] LYV: Loaded 51216 existing records from primary storage. [2025-09-23T19:51:27.678630] [INFO ] [MAIN ] LYV: Loaded 51216 existing records. [2025-09-23T19:51:27.876424] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:27.876729] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-23T19:51:27.876785] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-23T19:51:27.878353] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-23T19:51:27.878416] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-23T19:51:28.202246] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-23T19:51:28.287400] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:28.348584] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T19:51:29.002172] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-23T19:51:29.256030] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T19:51:29.802200] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-23T19:51:29.948696] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T19:51:30.602218] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-23T19:51:30.641920] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:51:31.088947] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T19:51:31.402234] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-23T19:51:32.189932] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T19:51:32.202149] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-23T19:51:33.002199] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-23T19:51:33.066978] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:51:33.802265] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-23T19:51:33.940506] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T19:51:34.602192] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-23T19:51:34.654621] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T19:51:35.402221] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-23T19:51:35.450921] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T19:51:36.202224] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-23T19:51:37.002217] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-23T19:51:37.149473] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-23T19:51:37.537605] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-23T19:51:37.801121] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T19:51:37.810563] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-23T19:51:38.498834] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:51:38.602160] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-23T19:51:39.402260] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-23T19:51:39.499214] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T19:51:40.202233] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-23T19:51:40.344944] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T19:51:40.738325] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T19:51:41.002229] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-23T19:51:41.641425] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T19:51:41.802215] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-23T19:51:42.602171] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-23T19:51:42.636943] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T19:51:43.234789] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T19:51:43.402240] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-23T19:51:44.202206] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-23T19:51:44.374227] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:51:45.010353] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-23T19:51:45.012206] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T19:51:45.021523] [INFO ] [REMOTE ] LXP: Full fetch complete (72425 records). [2025-09-23T19:51:45.021682] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-23T19:51:45.448220] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-23T19:51:45.448304] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-23T19:51:45.449232] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-23T19:51:45.449297] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-23T19:51:45.451012] [DEBUG] [LOCAL ] LXP: Trimmed 72425 records to 50647 (keeping 200 days of data) [2025-09-23T19:51:45.766733] [DEBUG] [LOCAL ] LXP: Primary data saved (50647 records). [2025-09-23T19:51:45.766889] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-23T19:51:45.766979] [INFO ] [MAIN ] Update Progress: 1293/2372 symbols completed. LXP took 44.7s. Estimated remaining: 2h 23m 17s. Rate: 7.5 symbols/min [2025-09-23T19:51:45.807386] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-23T19:51:45.951424] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:45.981967] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T19:51:46.023591] [DEBUG] [LOCAL ] LZB: Loaded 35557 existing records from primary storage. [2025-09-23T19:51:46.023781] [INFO ] [MAIN ] LZB: Loaded 35557 existing records. [2025-09-23T19:51:46.205482] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:46.205775] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-23T19:51:46.205832] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-23T19:51:46.206814] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-23T19:51:46.206876] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-23T19:51:46.597327] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:46.602153] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-23T19:51:46.639310] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T19:51:47.402248] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-23T19:51:47.520781] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:51:47.573486] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T19:51:48.202217] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-23T19:51:49.002214] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-23T19:51:49.358799] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T19:51:49.802244] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-23T19:51:49.930559] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:51:50.373263] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:51:50.602198] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-23T19:51:51.402254] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-23T19:51:51.610077] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T19:51:51.619042] [INFO ] [REMOTE ] LYB: Full fetch complete (77456 records). [2025-09-23T19:51:51.619184] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-23T19:51:52.028149] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-23T19:51:52.028329] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-23T19:51:52.029386] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-23T19:51:52.029496] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-23T19:51:52.031194] [DEBUG] [LOCAL ] LYB: Trimmed 77456 records to 53599 (keeping 200 days of data) [2025-09-23T19:51:52.215930] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-23T19:51:52.291258] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:51:52.423429] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T19:51:52.442153] [DEBUG] [LOCAL ] LYB: Primary data saved (53599 records). [2025-09-23T19:51:52.442269] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-23T19:51:52.442346] [INFO ] [MAIN ] Update Progress: 1294/2372 symbols completed. LYB took 34.6s. Estimated remaining: 2h 23m 8s. Rate: 7.5 symbols/min [2025-09-23T19:51:52.614623] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:52.628722] [DEBUG] [LOCAL ] LZM: Loaded 13402 existing records from primary storage. [2025-09-23T19:51:52.628842] [INFO ] [MAIN ] LZM: Loaded 13402 existing records. [2025-09-23T19:51:52.812295] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:52.812587] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-23T19:51:52.812636] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-23T19:51:52.813336] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-23T19:51:52.813398] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-23T19:51:53.007428] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-23T19:51:53.196538] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:53.802188] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-23T19:51:54.093281] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T19:51:54.583507] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:51:54.598359] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T19:51:54.602132] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-23T19:51:55.402223] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-23T19:51:55.984688] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:51:56.202246] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-23T19:51:57.002195] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-23T19:51:57.197724] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T19:51:57.206744] [INFO ] [REMOTE ] LYG: Full fetch complete (76050 records). [2025-09-23T19:51:57.206888] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-23T19:51:57.623358] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-23T19:51:57.623556] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-23T19:51:57.624708] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-23T19:51:57.624792] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-23T19:51:57.626839] [DEBUG] [LOCAL ] LYG: Trimmed 76050 records to 52873 (keeping 200 days of data) [2025-09-23T19:51:57.743631] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T19:51:57.837798] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-23T19:51:57.982872] [DEBUG] [LOCAL ] LYG: Primary data saved (52873 records). [2025-09-23T19:51:57.983050] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-23T19:51:57.983189] [INFO ] [MAIN ] Update Progress: 1295/2372 symbols completed. LYG took 32.1s. Estimated remaining: 2h 22m 58s. Rate: 7.5 symbols/min [2025-09-23T19:51:58.166239] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:58.232493] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-23T19:51:58.232735] [INFO ] [MAIN ] M: Loaded 53536 existing records. [2025-09-23T19:51:58.421543] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:58.422008] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-23T19:51:58.422148] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-23T19:51:58.429283] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-23T19:51:58.439326] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-23T19:51:58.521213] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T19:51:58.607294] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-23T19:51:58.817898] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:59.402203] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-23T19:51:59.479368] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T19:51:59.588999] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T19:52:00.202245] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-23T19:52:01.002223] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-23T19:52:01.417915] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T19:52:01.476977] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T19:52:01.802215] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-23T19:52:02.131477] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:52:02.141509] [INFO ] [REMOTE ] LYV: Full fetch complete (73651 records). [2025-09-23T19:52:02.141705] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-23T19:52:02.574060] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-23T19:52:02.574150] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-23T19:52:02.575108] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-23T19:52:02.575173] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-23T19:52:02.576601] [DEBUG] [LOCAL ] LYV: Trimmed 73651 records to 51188 (keeping 200 days of data) [2025-09-23T19:52:02.630297] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-23T19:52:02.807788] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T19:52:02.940638] [DEBUG] [LOCAL ] LYV: Primary data saved (51188 records). [2025-09-23T19:52:02.940838] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-23T19:52:02.940936] [INFO ] [MAIN ] Update Progress: 1296/2372 symbols completed. LYV took 35.5s. Estimated remaining: 2h 22m 48s. Rate: 7.5 symbols/min [2025-09-23T19:52:03.136413] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:03.209860] [DEBUG] [LOCAL ] MA: Loaded 52581 existing records from primary storage. [2025-09-23T19:52:03.210089] [INFO ] [MAIN ] MA: Loaded 52581 existing records. [2025-09-23T19:52:03.412762] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-23T19:52:03.505967] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:03.506351] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-23T19:52:03.506426] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-23T19:52:03.508219] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-23T19:52:03.508303] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-23T19:52:04.070402] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:52:04.099444] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T19:52:04.202276] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-23T19:52:04.650151] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T19:52:05.002203] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-23T19:52:05.802165] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-23T19:52:05.881275] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:52:06.144814] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-23T19:52:06.602221] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-23T19:52:07.402171] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-23T19:52:07.565845] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T19:52:08.158228] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T19:52:08.202267] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-23T19:52:08.584629] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-23T19:52:09.002306] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-23T19:52:09.259055] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T19:52:09.802274] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-23T19:52:10.563988] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:52:10.602234] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-23T19:52:11.303902] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:52:11.324037] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T19:52:11.402194] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-23T19:52:12.180762] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T19:52:12.202189] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-23T19:52:13.002220] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-23T19:52:13.802182] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-23T19:52:14.178515] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-23T19:52:14.501942] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:52:14.508466] [INFO ] [REMOTE ] LZB: Full fetch complete (50158 records). [2025-09-23T19:52:14.508597] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-23T19:52:14.608387] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-23T19:52:14.906637] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-23T19:52:14.906774] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-23T19:52:14.908318] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-23T19:52:14.908383] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-23T19:52:14.912471] [DEBUG] [LOCAL ] LZB: Trimmed 50158 records to 35589 (keeping 200 days of data) [2025-09-23T19:52:15.148248] [DEBUG] [LOCAL ] LZB: Primary data saved (35589 records). [2025-09-23T19:52:15.148397] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-23T19:52:15.148516] [INFO ] [MAIN ] Update Progress: 1297/2372 symbols completed. LZB took 29.4s. Estimated remaining: 2h 22m 43s. Rate: 7.5 symbols/min [2025-09-23T19:52:15.322410] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:15.352927] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:52:15.404203] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-23T19:52:15.406430] [DEBUG] [LOCAL ] MAA: Loaded 42917 existing records from primary storage. [2025-09-23T19:52:15.406701] [INFO ] [MAIN ] MAA: Loaded 42917 existing records. [2025-09-23T19:52:15.606611] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:15.608686] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:52:15.612035] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-23T19:52:15.612109] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-23T19:52:15.612492] [INFO ] [REMOTE ] LZM: Full fetch complete (17843 records). [2025-09-23T19:52:15.612564] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-23T19:52:15.644313] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-23T19:52:15.676748] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-23T19:52:16.203447] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-23T19:52:16.335160] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-23T19:52:16.353181] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-23T19:52:16.360193] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-23T19:52:16.360297] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-23T19:52:16.359630] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:52:16.361158] [DEBUG] [LOCAL ] LZM: Trimmed 17843 records to 13552 (keeping 200 days of data) [2025-09-23T19:52:16.443473] [DEBUG] [LOCAL ] LZM: Primary data saved (13552 records). [2025-09-23T19:52:16.443630] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-23T19:52:16.443796] [INFO ] [MAIN ] Update Progress: 1298/2372 symbols completed. LZM took 24.0s. Estimated remaining: 2h 22m 30s. Rate: 7.5 symbols/min [2025-09-23T19:52:16.611131] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:16.663355] [DEBUG] [LOCAL ] MAC: Loaded 49726 existing records from primary storage. [2025-09-23T19:52:16.663505] [INFO ] [MAIN ] MAC: Loaded 49726 existing records. [2025-09-23T19:52:16.854028] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:16.854520] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-23T19:52:16.854589] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-23T19:52:16.855958] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-23T19:52:16.856029] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-23T19:52:17.012154] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-23T19:52:17.234720] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:52:17.401515] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T19:52:17.802205] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-23T19:52:18.409142] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-23T19:52:18.491117] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T19:52:18.602210] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-23T19:52:19.402211] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-23T19:52:19.712832] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T19:52:20.185810] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:52:20.202147] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-23T19:52:20.902018] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T19:52:21.002182] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-23T19:52:21.802224] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-23T19:52:21.879548] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T19:52:22.227887] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:52:22.602230] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-23T19:52:23.402204] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-23T19:52:23.744918] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T19:52:23.883445] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T19:52:24.202210] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-23T19:52:24.774348] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T19:52:25.002229] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-23T19:52:25.802195] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-23T19:52:25.959361] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T19:52:26.602204] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-23T19:52:26.829372] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T19:52:27.402241] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-23T19:52:27.436937] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T19:52:28.167133] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:52:28.202154] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-23T19:52:29.002205] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-23T19:52:29.301665] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T19:52:29.802164] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-23T19:52:29.918893] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T19:52:30.235274] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T19:52:30.602288] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-23T19:52:31.402238] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-23T19:52:31.449808] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T19:52:31.459937] [INFO ] [REMOTE ] MA: Full fetch complete (76267 records). [2025-09-23T19:52:31.460071] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-23T19:52:31.878989] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-23T19:52:31.879115] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-23T19:52:31.880269] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-23T19:52:31.880356] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-23T19:52:31.904553] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T19:52:31.912833] [DEBUG] [LOCAL ] MA: Trimmed 76267 records to 52574 (keeping 200 days of data) [2025-09-23T19:52:32.219929] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-23T19:52:32.272219] [DEBUG] [LOCAL ] MA: Primary data saved (52574 records). [2025-09-23T19:52:32.272366] [INFO ] [MAIN ] MA: Full history saved. [2025-09-23T19:52:32.273552] [INFO ] [MAIN ] Update Progress: 1299/2372 symbols completed. MA took 29.3s. Estimated remaining: 2h 22m 29s. Rate: 7.5 symbols/min [2025-09-23T19:52:32.445610] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:32.492772] [DEBUG] [LOCAL ] MAGN: Loaded 34950 existing records from primary storage. [2025-09-23T19:52:32.492915] [INFO ] [MAIN ] MAGN: Loaded 34950 existing records. [2025-09-23T19:52:32.686992] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:32.687759] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-23T19:52:32.687945] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-23T19:52:32.689267] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-23T19:52:32.689332] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-23T19:52:32.975895] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T19:52:33.014978] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-23T19:52:33.100222] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:52:33.805164] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-23T19:52:33.811009] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T19:52:34.602180] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-23T19:52:35.156214] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T19:52:35.402216] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-23T19:52:35.500162] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T19:52:36.039254] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T19:52:36.202197] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-23T19:52:36.976376] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T19:52:37.002215] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-23T19:52:37.463526] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T19:52:37.802274] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-23T19:52:38.602255] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-23T19:52:38.947960] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-23T19:52:38.959325] [INFO ] [REMOTE ] M: Full fetch complete (77489 records). [2025-09-23T19:52:38.959552] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-23T19:52:39.319047] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:52:39.409695] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-23T19:52:39.430441] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-23T19:52:39.430535] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-23T19:52:39.431587] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-23T19:52:39.431675] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-23T19:52:39.436451] [DEBUG] [LOCAL ] M: Trimmed 77489 records to 53536 (keeping 200 days of data) [2025-09-23T19:52:39.783363] [DEBUG] [LOCAL ] M: Primary data saved (53536 records). [2025-09-23T19:52:39.783519] [INFO ] [MAIN ] M: Full history saved. [2025-09-23T19:52:39.783660] [INFO ] [MAIN ] Update Progress: 1300/2372 symbols completed. M took 41.8s. Estimated remaining: 2h 22m 20s. Rate: 7.5 symbols/min [2025-09-23T19:52:39.965346] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:40.012135] [DEBUG] [LOCAL ] MAIN: Loaded 41410 existing records from primary storage. [2025-09-23T19:52:40.012297] [INFO ] [MAIN ] MAIN: Loaded 41410 existing records. [2025-09-23T19:52:40.197353] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:40.197871] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-23T19:52:40.197941] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-23T19:52:40.207438] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-23T19:52:40.207376] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-23T19:52:40.225899] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T19:52:40.224547] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-23T19:52:40.601222] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:52:40.789019] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:52:41.002150] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-23T19:52:41.802179] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-23T19:52:41.924982] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:52:42.323432] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T19:52:42.602284] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-23T19:52:43.149434] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T19:52:43.402225] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-23T19:52:44.202196] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-23T19:52:44.361753] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:52:45.002220] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-23T19:52:45.154050] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:52:45.161325] [INFO ] [REMOTE ] MAA: Full fetch complete (61030 records). [2025-09-23T19:52:45.161435] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-23T19:52:45.551513] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-23T19:52:45.551680] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-23T19:52:45.552793] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-23T19:52:45.552859] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-23T19:52:45.554144] [DEBUG] [LOCAL ] MAA: Trimmed 61030 records to 42875 (keeping 200 days of data) [2025-09-23T19:52:45.675869] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T19:52:45.807334] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-23T19:52:45.865999] [DEBUG] [LOCAL ] MAA: Primary data saved (42875 records). [2025-09-23T19:52:45.866123] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-23T19:52:45.866214] [INFO ] [MAIN ] Update Progress: 1301/2372 symbols completed. MAA took 30.7s. Estimated remaining: 2h 22m 11s. Rate: 7.5 symbols/min [2025-09-23T19:52:46.039389] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:46.081566] [DEBUG] [LOCAL ] MAN: Loaded 43595 existing records from primary storage. [2025-09-23T19:52:46.081884] [INFO ] [MAIN ] MAN: Loaded 43595 existing records. [2025-09-23T19:52:46.294197] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:52:46.298710] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:46.306660] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-23T19:52:46.307088] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-23T19:52:46.308248] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-23T19:52:46.308311] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-23T19:52:46.607372] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-23T19:52:46.668902] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:52:47.402169] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-23T19:52:47.541734] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T19:52:47.866053] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T19:52:47.874458] [INFO ] [REMOTE ] MAC: Full fetch complete (71460 records). [2025-09-23T19:52:47.874582] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-23T19:52:48.207326] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-23T19:52:48.287778] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-23T19:52:48.287956] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-23T19:52:48.288953] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-23T19:52:48.289019] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-23T19:52:48.290403] [DEBUG] [LOCAL ] MAC: Trimmed 71460 records to 49711 (keeping 200 days of data) [2025-09-23T19:52:48.542613] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T19:52:48.643921] [DEBUG] [LOCAL ] MAC: Primary data saved (49711 records). [2025-09-23T19:52:48.644064] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-23T19:52:48.644146] [INFO ] [MAIN ] Update Progress: 1302/2372 symbols completed. MAC took 32.2s. Estimated remaining: 2h 21m 58s. Rate: 7.5 symbols/min [2025-09-23T19:52:48.819712] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:48.850117] [DEBUG] [LOCAL ] MANU: Loaded 27184 existing records from primary storage. [2025-09-23T19:52:48.850268] [INFO ] [MAIN ] MANU: Loaded 27184 existing records. [2025-09-23T19:52:49.004679] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-23T19:52:49.033462] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:49.033734] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-23T19:52:49.033805] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-23T19:52:49.034717] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-23T19:52:49.034779] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-23T19:52:49.401614] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:52:49.614028] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T19:52:49.802214] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-23T19:52:50.461622] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:52:50.602226] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-23T19:52:50.911784] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:52:51.357152] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T19:52:51.402156] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-23T19:52:52.202166] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-23T19:52:52.555210] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T19:52:53.002205] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-23T19:52:53.802206] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-23T19:52:53.959755] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T19:52:54.090981] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:52:54.602218] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-23T19:52:55.307410] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:52:55.402177] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-23T19:52:56.202327] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-23T19:52:56.336011] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:52:56.558087] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T19:52:57.002212] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-23T19:52:57.327501] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T19:52:57.802206] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-23T19:52:58.602170] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-23T19:52:58.787272] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T19:52:58.894537] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:52:59.402224] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-23T19:53:00.053349] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:53:00.202197] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-23T19:53:00.531339] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T19:53:01.002202] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-23T19:53:01.567389] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T19:53:01.802226] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-23T19:53:02.391253] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T19:53:02.602214] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-23T19:53:03.402198] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-23T19:53:03.729802] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T19:53:03.951675] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:53:03.958005] [INFO ] [REMOTE ] MAGN: Full fetch complete (51175 records). [2025-09-23T19:53:03.958161] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-23T19:53:04.208573] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-23T19:53:04.382331] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-23T19:53:04.382430] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-23T19:53:04.383220] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-23T19:53:04.383286] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-23T19:53:04.384534] [DEBUG] [LOCAL ] MAGN: Trimmed 51175 records to 34981 (keeping 200 days of data) [2025-09-23T19:53:04.601383] [DEBUG] [LOCAL ] MAGN: Primary data saved (34981 records). [2025-09-23T19:53:04.601567] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-23T19:53:04.601701] [INFO ] [MAIN ] Update Progress: 1303/2372 symbols completed. MAGN took 32.3s. Estimated remaining: 2h 21m 57s. Rate: 7.5 symbols/min [2025-09-23T19:53:04.784552] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:53:04.822888] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T19:53:04.878945] [DEBUG] [LOCAL ] MAS: Loaded 52354 existing records from primary storage. [2025-09-23T19:53:04.879150] [INFO ] [MAIN ] MAS: Loaded 52354 existing records. [2025-09-23T19:53:05.007423] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-23T19:53:05.064260] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:53:05.065284] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-23T19:53:05.065376] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-23T19:53:05.066857] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-23T19:53:05.066928] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-23T19:53:05.337760] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T19:53:05.467927] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:53:05.802197] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-23T19:53:06.602254] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-23T19:53:06.633469] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T19:53:07.198184] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:53:07.402222] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-23T19:53:08.202190] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-23T19:53:08.298829] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T19:53:09.006194] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-23T19:53:09.012299] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T19:53:09.172409] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:53:09.802244] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-23T19:53:10.602210] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-23T19:53:10.830328] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T19:53:10.838340] [INFO ] [REMOTE ] MAIN: Full fetch complete (59657 records). [2025-09-23T19:53:10.838612] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-23T19:53:11.047918] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:53:11.261987] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-23T19:53:11.262069] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-23T19:53:11.262899] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-23T19:53:11.262961] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-23T19:53:11.264167] [DEBUG] [LOCAL ] MAIN: Trimmed 59657 records to 41357 (keeping 200 days of data) [2025-09-23T19:53:11.396390] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T19:53:11.402945] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-23T19:53:11.545010] [DEBUG] [LOCAL ] MAIN: Primary data saved (41357 records). [2025-09-23T19:53:11.545167] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-23T19:53:11.545273] [INFO ] [MAIN ] Update Progress: 1304/2372 symbols completed. MAIN took 31.8s. Estimated remaining: 2h 21m 48s. Rate: 7.5 symbols/min [2025-09-23T19:53:11.712171] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:53:11.748816] [DEBUG] [LOCAL ] MATV: Loaded 37736 existing records from primary storage. [2025-09-23T19:53:11.748986] [INFO ] [MAIN ] MATV: Loaded 37736 existing records. [2025-09-23T19:53:11.928299] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:53:11.928595] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-23T19:53:11.928668] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-23T19:53:11.929555] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-23T19:53:11.929615] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-23T19:53:12.202823] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-23T19:53:12.282479] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:53:13.002186] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-23T19:53:13.147366] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T19:53:13.769863] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T19:53:13.775409] [INFO ] [REMOTE ] MANU: Full fetch complete (38270 records). [2025-09-23T19:53:13.775509] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-23T19:53:13.807462] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-23T19:53:14.192441] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-23T19:53:14.192528] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-23T19:53:14.193462] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-23T19:53:14.193529] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-23T19:53:14.194561] [DEBUG] [LOCAL ] MANU: Trimmed 38270 records to 27166 (keeping 200 days of data) [2025-09-23T19:53:14.357890] [DEBUG] [LOCAL ] MANU: Primary data saved (27166 records). [2025-09-23T19:53:14.358034] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-23T19:53:14.358124] [INFO ] [MAIN ] Update Progress: 1305/2372 symbols completed. MANU took 25.7s. Estimated remaining: 2h 21m 36s. Rate: 7.5 symbols/min [2025-09-23T19:53:14.534103] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:53:14.570834] [DEBUG] [LOCAL ] MATX: Loaded 31663 existing records from primary storage. [2025-09-23T19:53:14.571125] [INFO ] [MAIN ] MATX: Loaded 31663 existing records. [2025-09-23T19:53:14.602842] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-23T19:53:14.757222] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:53:14.757718] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-23T19:53:14.757795] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-23T19:53:14.769526] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-23T19:53:14.784101] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-23T19:53:14.872572] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T19:53:15.165547] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:53:15.289529] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T19:53:15.402192] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-23T19:53:16.202173] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-23T19:53:16.238297] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:53:16.896193] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:53:17.002177] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-23T19:53:17.275854] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T19:53:17.802198] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-23T19:53:18.273434] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:53:18.574487] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:53:18.602147] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-23T19:53:19.402213] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-23T19:53:19.847963] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:53:20.202197] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-23T19:53:20.944812] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T19:53:21.002234] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-23T19:53:21.735164] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T19:53:21.802169] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-23T19:53:22.267889] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T19:53:22.275476] [INFO ] [REMOTE ] MAN: Full fetch complete (61812 records). [2025-09-23T19:53:22.275597] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-23T19:53:22.608356] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-23T19:53:22.664134] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-23T19:53:22.664214] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-23T19:53:22.665081] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-23T19:53:22.665144] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-23T19:53:22.666491] [DEBUG] [LOCAL ] MAN: Trimmed 61812 records to 43562 (keeping 200 days of data) [2025-09-23T19:53:22.933153] [DEBUG] [LOCAL ] MAN: Primary data saved (43562 records). [2025-09-23T19:53:22.933298] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-23T19:53:22.933415] [INFO ] [MAIN ] Update Progress: 1306/2372 symbols completed. MAN took 37.1s. Estimated remaining: 2h 21m 29s. Rate: 7.5 symbols/min [2025-09-23T19:53:23.110058] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:53:23.141099] [DEBUG] [LOCAL ] MAX: Loaded 30950 existing records from primary storage. [2025-09-23T19:53:23.141294] [INFO ] [MAIN ] MAX: Loaded 30950 existing records. [2025-09-23T19:53:23.332117] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:53:23.332446] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-23T19:53:23.332521] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-23T19:53:23.341625] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-23T19:53:23.353610] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-23T19:53:23.412987] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-23T19:53:23.429462] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:53:23.740447] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:53:24.062218] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:53:24.202211] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-23T19:53:24.702484] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:53:25.002206] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-23T19:53:25.259415] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T19:53:25.802291] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-23T19:53:26.371946] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T19:53:26.602202] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-23T19:53:27.169321] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T19:53:27.402195] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-23T19:53:27.935051] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T19:53:28.202197] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-23T19:53:28.802568] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:53:29.002207] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-23T19:53:29.505266] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T19:53:29.802214] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-23T19:53:30.525235] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T19:53:30.602220] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-23T19:53:31.402181] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-23T19:53:31.514472] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T19:53:32.202168] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-23T19:53:32.426853] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T19:53:32.464136] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T19:53:33.002267] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-23T19:53:33.567119] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:53:33.802246] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-23T19:53:34.499976] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:53:34.602220] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-23T19:53:35.152226] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:53:35.160497] [INFO ] [REMOTE ] MATV: Full fetch complete (52406 records). [2025-09-23T19:53:35.160726] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-23T19:53:35.407357] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-23T19:53:35.559920] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-23T19:53:35.559997] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-23T19:53:35.560912] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-23T19:53:35.560989] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-23T19:53:35.562179] [DEBUG] [LOCAL ] MATV: Trimmed 52406 records to 37655 (keeping 200 days of data) [2025-09-23T19:53:35.784471] [DEBUG] [LOCAL ] MATV: Primary data saved (37655 records). [2025-09-23T19:53:35.784604] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-23T19:53:35.784712] [INFO ] [MAIN ] Update Progress: 1307/2372 symbols completed. MATV took 24.2s. Estimated remaining: 2h 21m 25s. Rate: 7.5 symbols/min [2025-09-23T19:53:35.974462] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:53:35.971517] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T19:53:36.020087] [DEBUG] [LOCAL ] MBC: Loaded 43106 existing records from primary storage. [2025-09-23T19:53:36.020228] [INFO ] [MAIN ] MBC: Loaded 43106 existing records. [2025-09-23T19:53:36.195895] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:53:36.196131] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-23T19:53:36.196179] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-23T19:53:36.197720] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-23T19:53:36.197783] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-23T19:53:36.208838] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-23T19:53:36.560615] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:53:36.748950] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T19:53:37.002143] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-23T19:53:37.659477] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:53:37.802152] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-23T19:53:37.917324] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T19:53:38.602255] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-23T19:53:39.194020] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T19:53:39.402255] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-23T19:53:39.665829] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:53:40.202244] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-23T19:53:40.923108] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T19:53:41.002232] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-23T19:53:41.175950] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:53:41.802219] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-23T19:53:42.312674] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T19:53:42.602270] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-23T19:53:43.175365] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:53:43.402238] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-23T19:53:43.867522] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:53:44.202233] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-23T19:53:44.808807] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:53:44.815227] [INFO ] [REMOTE ] MAX: Full fetch complete (45644 records). [2025-09-23T19:53:44.815372] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-23T19:53:45.007891] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-23T19:53:45.216554] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-23T19:53:45.216950] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-23T19:53:45.218331] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-23T19:53:45.218399] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-23T19:53:45.219945] [DEBUG] [LOCAL ] MAX: Trimmed 45644 records to 30963 (keeping 200 days of data) [2025-09-23T19:53:45.412768] [DEBUG] [LOCAL ] MAX: Primary data saved (30963 records). [2025-09-23T19:53:45.413165] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-23T19:53:45.413302] [INFO ] [MAIN ] Update Progress: 1308/2372 symbols completed. MAX took 22.5s. Estimated remaining: 2h 21m 18s. Rate: 7.5 symbols/min [2025-09-23T19:53:45.595493] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:53:45.620024] [DEBUG] [LOCAL ] MBI: Loaded 24778 existing records from primary storage. [2025-09-23T19:53:45.620194] [INFO ] [MAIN ] MBI: Loaded 24778 existing records. [2025-09-23T19:53:45.803193] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-23T19:53:45.810719] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:53:45.811077] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-23T19:53:45.811135] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-23T19:53:45.811763] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-23T19:53:45.811940] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-23T19:53:45.941949] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T19:53:46.188638] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:53:46.237120] [INFO ] [REMOTE ] MATX: Full fetch complete (42503 records). [2025-09-23T19:53:46.258620] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-23T19:53:46.258463] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:53:46.604034] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-23T19:53:46.654171] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-23T19:53:46.654745] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-23T19:53:46.655613] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-23T19:53:46.655704] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-23T19:53:46.656741] [DEBUG] [LOCAL ] MATX: Trimmed 42503 records to 31629 (keeping 200 days of data) [2025-09-23T19:53:46.859460] [DEBUG] [LOCAL ] MATX: Primary data saved (31629 records). [2025-09-23T19:53:46.859607] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-23T19:53:46.859717] [INFO ] [MAIN ] Update Progress: 1309/2372 symbols completed. MATX took 32.5s. Estimated remaining: 2h 21m 5s. Rate: 7.5 symbols/min [2025-09-23T19:53:47.045700] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:53:47.088967] [DEBUG] [LOCAL ] MC: Loaded 44356 existing records from primary storage. [2025-09-23T19:53:47.089176] [INFO ] [MAIN ] MC: Loaded 44356 existing records. [2025-09-23T19:53:47.267609] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:53:47.267852] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-23T19:53:47.267900] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-23T19:53:47.268862] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-23T19:53:47.268922] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-23T19:53:47.407834] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-23T19:53:47.641417] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:53:47.673841] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T19:53:47.684022] [INFO ] [REMOTE ] MAS: Full fetch complete (74725 records). [2025-09-23T19:53:47.684257] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-23T19:53:48.106352] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-23T19:53:48.115140] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-23T19:53:48.121444] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-23T19:53:48.130337] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-23T19:53:48.132287] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T19:53:48.142327] [DEBUG] [LOCAL ] MAS: Trimmed 74725 records to 52341 (keeping 200 days of data) [2025-09-23T19:53:48.207262] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-23T19:53:48.400432] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T19:53:48.538045] [DEBUG] [LOCAL ] MAS: Primary data saved (52341 records). [2025-09-23T19:53:48.538225] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-23T19:53:48.538370] [INFO ] [MAIN ] Update Progress: 1310/2372 symbols completed. MAS took 43.9s. Estimated remaining: 2h 20m 52s. Rate: 7.5 symbols/min [2025-09-23T19:53:48.756983] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:53:48.774004] [DEBUG] [LOCAL ] MCB: Loaded 11758 existing records from primary storage. [2025-09-23T19:53:48.774163] [INFO ] [MAIN ] MCB: Loaded 11758 existing records. [2025-09-23T19:53:49.008363] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-23T19:53:49.033491] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:53:49.034086] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-23T19:53:49.034148] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-23T19:53:49.034550] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-23T19:53:49.034697] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-23T19:53:49.586957] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:53:49.620723] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:53:49.802241] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-23T19:53:49.869878] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T19:53:50.602235] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-23T19:53:51.208953] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T19:53:51.354898] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T19:53:51.402188] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-23T19:53:52.202194] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-23T19:53:52.303875] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T19:53:53.002204] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-23T19:53:53.283698] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:53:53.802206] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-23T19:53:54.279937] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:53:54.285868] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T19:53:54.602203] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-23T19:53:55.402213] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-23T19:53:55.521305] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T19:53:56.202271] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-23T19:53:56.867595] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:53:57.002315] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-23T19:53:57.581593] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T19:53:57.802204] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-23T19:53:58.500572] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:53:58.602184] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-23T19:53:58.971511] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T19:53:59.402200] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-23T19:53:59.774557] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T19:54:00.202290] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-23T19:54:00.677982] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T19:54:01.002193] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-23T19:54:01.400033] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T19:54:01.802267] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-23T19:54:02.597260] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T19:54:02.602285] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-23T19:54:03.402190] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-23T19:54:04.202158] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-23T19:54:04.472556] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T19:54:04.513502] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-23T19:54:04.590775] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-23T19:54:05.002252] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-23T19:54:05.497927] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T19:54:05.802252] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-23T19:54:06.609150] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-23T19:54:06.630897] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T19:54:07.010962] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T19:54:07.168270] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T19:54:07.402194] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-23T19:54:08.140604] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T19:54:08.202194] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-23T19:54:09.002214] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-23T19:54:09.478100] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T19:54:09.802269] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-23T19:54:09.932249] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T19:54:10.602196] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-23T19:54:11.314144] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T19:54:11.402192] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-23T19:54:12.185501] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T19:54:12.193489] [INFO ] [REMOTE ] MBC: Full fetch complete (62486 records). [2025-09-23T19:54:12.193614] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-23T19:54:12.208350] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-23T19:54:12.589267] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-23T19:54:12.589366] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-23T19:54:12.590488] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-23T19:54:12.590553] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-23T19:54:12.592388] [DEBUG] [LOCAL ] MBC: Trimmed 62486 records to 43093 (keeping 200 days of data) [2025-09-23T19:54:12.875715] [DEBUG] [LOCAL ] MBC: Primary data saved (43093 records). [2025-09-23T19:54:12.875987] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-23T19:54:12.876189] [INFO ] [MAIN ] Update Progress: 1311/2372 symbols completed. MBC took 37.1s. Estimated remaining: 2h 20m 57s. Rate: 7.5 symbols/min [2025-09-23T19:54:13.007111] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-23T19:54:13.044773] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T19:54:13.065579] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:54:13.068670] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-23T19:54:13.068780] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-23T19:54:13.069109] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-23T19:54:13.069192] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-23T19:54:13.069375] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-23T19:54:13.069434] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-23T19:54:13.211301] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T19:54:13.490850] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:54:13.802250] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-23T19:54:14.218549] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T19:54:14.223740] [INFO ] [REMOTE ] MBI: Full fetch complete (36780 records). [2025-09-23T19:54:14.223849] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-23T19:54:14.610147] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-23T19:54:14.612406] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-23T19:54:14.612709] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-23T19:54:14.614375] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-23T19:54:14.614528] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-23T19:54:14.616869] [DEBUG] [LOCAL ] MBI: Trimmed 36780 records to 24755 (keeping 200 days of data) [2025-09-23T19:54:14.721719] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T19:54:14.727417] [INFO ] [REMOTE ] MCB: Full fetch complete (16315 records). [2025-09-23T19:54:14.728184] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-23T19:54:15.154270] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-23T19:54:15.154967] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-23T19:54:15.155443] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-23T19:54:15.156456] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-23T19:54:15.161500] [DEBUG] [LOCAL ] MCB: Trimmed 16315 records to 11735 (keeping 200 days of data) [2025-09-23T19:54:15.250346] [DEBUG] [LOCAL ] MBI: Primary data saved (24755 records). [2025-09-23T19:54:15.251577] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-23T19:54:15.252044] [INFO ] [MAIN ] Update Progress: 1312/2372 symbols completed. MBI took 29.8s. Estimated remaining: 2h 20m 44s. Rate: 7.5 symbols/min [2025-09-23T19:54:15.414798] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-23T19:54:15.441467] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:54:15.455467] [DEBUG] [LOCAL ] MCI: Loaded 6370 existing records from primary storage. [2025-09-23T19:54:15.457756] [INFO ] [MAIN ] MCI: Loaded 6370 existing records. [2025-09-23T19:54:15.459460] [DEBUG] [LOCAL ] MCB: Primary data saved (11735 records). [2025-09-23T19:54:15.507554] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-23T19:54:15.529451] [INFO ] [MAIN ] Update Progress: 1313/2372 symbols completed. MCB took 27.0s. Estimated remaining: 2h 20m 30s. Rate: 7.5 symbols/min [2025-09-23T19:54:15.835855] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:54:15.854914] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-23T19:54:15.855080] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-23T19:54:15.854686] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:54:15.855699] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-23T19:54:15.855800] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-23T19:54:16.243025] [DEBUG] [LOCAL ] MCK: Loaded 39352 existing records from primary storage. [2025-09-23T19:54:16.249384] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:54:16.249632] [INFO ] [MAIN ] MCK: Loaded 39352 existing records. [2025-09-23T19:54:16.281778] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-23T19:54:16.433827] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:54:16.434106] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-23T19:54:16.434209] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-23T19:54:16.435275] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-23T19:54:16.435337] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-23T19:54:16.796620] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:54:17.002210] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-23T19:54:17.930929] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (3.32 seconds). [2025-09-23T19:54:17.942981] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-23T19:54:17.976957] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-23T19:54:18.039631] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T19:54:18.602200] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-23T19:54:19.199995] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T19:54:19.402171] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-23T19:54:19.436967] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-23T19:54:20.103621] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-23T19:54:20.140521] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T19:54:20.202193] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-23T19:54:20.924327] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T19:54:21.002204] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-23T19:54:21.609551] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:54:21.802256] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-23T19:54:22.602251] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-23T19:54:23.382309] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T19:54:23.404349] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-23T19:54:23.417870] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T19:54:24.131947] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T19:54:24.202246] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-23T19:54:25.002245] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-23T19:54:25.802184] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-23T19:54:26.210213] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-23T19:54:26.491595] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:54:26.602290] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-23T19:54:27.254207] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T19:54:27.402162] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-23T19:54:27.613501] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T19:54:28.202243] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-23T19:54:29.002159] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-23T19:54:29.506699] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-23T19:54:29.621935] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T19:54:29.802249] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-23T19:54:30.581041] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:54:30.602165] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-23T19:54:31.402199] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-23T19:54:31.881363] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T19:54:31.889239] [INFO ] [REMOTE ] MC: Full fetch complete (62246 records). [2025-09-23T19:54:31.889431] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-23T19:54:32.084009] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T19:54:32.207508] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-23T19:54:32.335541] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-23T19:54:32.335739] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-23T19:54:32.336673] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-23T19:54:32.336738] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-23T19:54:32.340697] [DEBUG] [LOCAL ] MC: Trimmed 62246 records to 44325 (keeping 200 days of data) [2025-09-23T19:54:32.629254] [DEBUG] [LOCAL ] MC: Primary data saved (44325 records). [2025-09-23T19:54:32.629413] [INFO ] [MAIN ] MC: Full history saved. [2025-09-23T19:54:32.629611] [INFO ] [MAIN ] Update Progress: 1314/2372 symbols completed. MC took 45.8s. Estimated remaining: 2h 20m 30s. Rate: 7.5 symbols/min [2025-09-23T19:54:32.804368] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:54:32.815835] [DEBUG] [LOCAL ] MCN: Loaded 8119 existing records from primary storage. [2025-09-23T19:54:32.815987] [INFO ] [MAIN ] MCN: Loaded 8119 existing records. [2025-09-23T19:54:33.009197] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-23T19:54:33.076346] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:54:33.077723] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-23T19:54:33.077804] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-23T19:54:33.078339] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-23T19:54:33.078481] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-23T19:54:33.387696] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-23T19:54:33.477480] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:54:33.802168] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-23T19:54:34.011063] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:54:34.012827] [INFO ] [REMOTE ] MCI: Full fetch complete (9897 records). [2025-09-23T19:54:34.012897] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-23T19:54:34.385597] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-23T19:54:34.385943] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-23T19:54:34.386302] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-23T19:54:34.386387] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-23T19:54:34.387170] [DEBUG] [LOCAL ] MCI: Trimmed 9897 records to 6399 (keeping 200 days of data) [2025-09-23T19:54:34.454888] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-23T19:54:34.475575] [DEBUG] [LOCAL ] MCI: Primary data saved (6399 records). [2025-09-23T19:54:34.475733] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-23T19:54:34.475855] [INFO ] [MAIN ] Update Progress: 1315/2372 symbols completed. MCI took 19.2s. Estimated remaining: 2h 20m 17s. Rate: 7.5 symbols/min [2025-09-23T19:54:34.613025] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-23T19:54:34.644762] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:54:34.690228] [DEBUG] [LOCAL ] MCO: Loaded 39615 existing records from primary storage. [2025-09-23T19:54:34.690394] [INFO ] [MAIN ] MCO: Loaded 39615 existing records. [2025-09-23T19:54:34.867925] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:54:34.868248] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-23T19:54:34.868297] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-23T19:54:34.869494] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-23T19:54:34.869555] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-23T19:54:35.230980] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:54:35.264396] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:54:35.402170] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-23T19:54:36.202257] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-23T19:54:36.837376] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-23T19:54:36.852429] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:54:36.882859] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-23T19:54:37.002158] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-23T19:54:37.802207] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-23T19:54:38.469613] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T19:54:38.490776] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:54:38.602147] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-23T19:54:39.402196] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-23T19:54:40.127780] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T19:54:40.202156] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-23T19:54:40.893829] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:54:41.002158] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-23T19:54:41.802224] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-23T19:54:41.993132] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T19:54:42.041976] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:54:42.506028] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T19:54:42.602199] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-23T19:54:43.402181] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-23T19:54:44.202172] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-23T19:54:44.262092] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:54:44.965884] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T19:54:45.002227] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-23T19:54:45.349217] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T19:54:45.802220] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-23T19:54:46.536881] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T19:54:46.602204] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-23T19:54:47.402247] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-23T19:54:47.424811] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T19:54:48.163262] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-23T19:54:48.202174] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-23T19:54:48.751546] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T19:54:49.002267] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-23T19:54:49.802160] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-23T19:54:50.308468] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-23T19:54:50.414567] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:54:50.416255] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T19:54:50.602230] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-23T19:54:51.402208] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-23T19:54:52.038596] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:54:52.202256] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-23T19:54:52.614453] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T19:54:52.881118] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T19:54:53.002288] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-23T19:54:53.802287] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-23T19:54:54.390114] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T19:54:54.448471] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T19:54:54.455406] [INFO ] [REMOTE ] MCK: Full fetch complete (57485 records). [2025-09-23T19:54:54.455594] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-23T19:54:54.609974] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-23T19:54:54.850750] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-23T19:54:54.850836] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-23T19:54:54.851711] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-23T19:54:54.851773] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-23T19:54:54.852976] [DEBUG] [LOCAL ] MCK: Trimmed 57485 records to 39356 (keeping 200 days of data) [2025-09-23T19:54:55.116997] [DEBUG] [LOCAL ] MCK: Primary data saved (39356 records). [2025-09-23T19:54:55.117162] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-23T19:54:55.117254] [INFO ] [MAIN ] Update Progress: 1316/2372 symbols completed. MCK took 39.6s. Estimated remaining: 2h 20m 19s. Rate: 7.5 symbols/min [2025-09-23T19:54:55.285972] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:54:55.296633] [DEBUG] [LOCAL ] MCR: Loaded 8813 existing records from primary storage. [2025-09-23T19:54:55.296829] [INFO ] [MAIN ] MCR: Loaded 8813 existing records. [2025-09-23T19:54:55.407264] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-23T19:54:55.477483] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:54:55.477743] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-23T19:54:55.477798] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-23T19:54:55.478177] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-23T19:54:55.478237] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-23T19:54:55.838062] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:54:56.210575] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-23T19:54:56.213049] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T19:54:56.220340] [INFO ] [REMOTE ] MCO: Full fetch complete (56537 records). [2025-09-23T19:54:56.220479] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-23T19:54:56.603685] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-23T19:54:56.603777] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-23T19:54:56.604569] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-23T19:54:56.604618] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-23T19:54:56.605957] [DEBUG] [LOCAL ] MCO: Trimmed 56537 records to 39575 (keeping 200 days of data) [2025-09-23T19:54:56.730868] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T19:54:56.872780] [DEBUG] [LOCAL ] MCO: Primary data saved (39575 records). [2025-09-23T19:54:56.872927] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-23T19:54:56.873011] [INFO ] [MAIN ] Update Progress: 1317/2372 symbols completed. MCO took 22.4s. Estimated remaining: 2h 20m 6s. Rate: 7.5 symbols/min [2025-09-23T19:54:57.002192] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-23T19:54:57.282010] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T19:54:57.291417] [INFO ] [REMOTE ] MCD: Full fetch complete (77026 records). [2025-09-23T19:54:57.291603] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-23T19:54:57.506590] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:54:57.507393] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:54:57.507469] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:54:57.507543] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-23T19:54:57.507610] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-23T19:54:57.507708] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-23T19:54:57.507776] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-23T19:54:57.507866] [INFO ] [MAIN ] Update Progress: 1318/2372 symbols completed. MCD took 44.6s. Estimated remaining: 2h 19m 52s. Rate: 7.5 symbols/min [2025-09-23T19:54:57.721435] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T19:54:57.723221] [INFO ] [REMOTE ] MCN: Full fetch complete (11524 records). [2025-09-23T19:54:57.723295] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-23T19:54:57.807267] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-23T19:54:58.088006] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-23T19:54:58.088085] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-23T19:54:58.088331] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-23T19:54:58.088370] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-23T19:54:58.088923] [DEBUG] [LOCAL ] MCN: Trimmed 11524 records to 8126 (keeping 200 days of data) [2025-09-23T19:54:58.136536] [DEBUG] [LOCAL ] MCN: Primary data saved (8126 records). [2025-09-23T19:54:58.136693] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-23T19:54:58.136788] [INFO ] [MAIN ] Update Progress: 1319/2372 symbols completed. MCN took 25.5s. Estimated remaining: 2h 19m 38s. Rate: 7.5 symbols/min [2025-09-23T19:54:58.698470] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T19:54:58.701703] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-23T19:54:59.651894] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T19:54:59.655448] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-23T19:55:00.543786] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T19:55:00.546511] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-23T19:55:01.403775] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T19:55:01.409619] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-23T19:55:02.256394] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T19:55:02.259485] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-23T19:55:03.012028] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T19:55:03.014639] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-23T19:55:03.751174] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:55:03.754141] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-23T19:55:04.472743] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T19:55:04.476192] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-23T19:55:05.313105] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T19:55:05.317094] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-23T19:55:06.027123] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:55:06.029052] [INFO ] [REMOTE ] MCR: Full fetch complete (14212 records). [2025-09-23T19:55:06.029131] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-23T19:55:06.435860] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-23T19:55:06.435985] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-23T19:55:06.436507] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-23T19:55:06.436554] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-23T19:55:06.437591] [DEBUG] [LOCAL ] MCR: Trimmed 14212 records to 8801 (keeping 200 days of data) [2025-09-23T19:55:06.510935] [DEBUG] [LOCAL ] MCR: Primary data saved (8801 records). [2025-09-23T19:55:06.511122] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-23T19:55:06.511224] [INFO ] [MAIN ] Update Progress: 1320/2372 symbols completed. MCR took 11.4s. Estimated remaining: 2h 19m 31s. Rate: 7.5 symbols/min [2025-09-23T19:55:07.160347] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:07.253803] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:07.229258] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:07.297532] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:07.316819] [DEBUG] [LOCAL ] MDST: Loaded 5476 existing records from primary storage. [2025-09-23T19:55:07.317013] [INFO ] [MAIN ] MDST: Loaded 5476 existing records. [2025-09-23T19:55:07.349888] [DEBUG] [LOCAL ] MCS: Loaded 21239 existing records from primary storage. [2025-09-23T19:55:07.386321] [INFO ] [MAIN ] MCS: Loaded 21239 existing records. [2025-09-23T19:55:07.546580] [DEBUG] [LOCAL ] MCY: Loaded 25232 existing records from primary storage. [2025-09-23T19:55:07.609691] [INFO ] [MAIN ] MCY: Loaded 25232 existing records. [2025-09-23T19:55:07.593547] [DEBUG] [LOCAL ] MD: Loaded 38643 existing records from primary storage. [2025-09-23T19:55:07.645814] [INFO ] [MAIN ] MD: Loaded 38643 existing records. [2025-09-23T19:55:07.965418] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:55:08.041095] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:55:08.057129] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-23T19:55:08.087972] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-23T19:55:08.087814] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-23T19:55:08.120170] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-23T19:55:08.196389] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:55:08.138125] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-23T19:55:08.232764] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-23T19:55:08.237374] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:55:08.237795] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-23T19:55:08.233844] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-23T19:55:08.248571] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-23T19:55:08.248810] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-23T19:55:08.248873] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-23T19:55:08.271349] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-23T19:55:08.265176] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-23T19:55:08.276760] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-23T19:55:08.276933] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-23T19:55:08.276712] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-23T19:55:09.683931] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:55:09.764201] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:55:09.783711] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-23T19:55:09.813795] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:55:09.806795] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-23T19:55:09.815012] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-23T19:55:09.901610] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:55:09.901984] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-23T19:55:10.599595] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-23T19:55:10.601684] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-23T19:55:10.853198] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T19:55:10.859314] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-23T19:55:10.982826] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T19:55:10.984927] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-23T19:55:11.040530] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T19:55:11.195923] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:55:11.402228] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-23T19:55:11.597633] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T19:55:12.042626] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T19:55:12.202193] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-23T19:55:12.497067] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:55:12.879923] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T19:55:13.002215] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-23T19:55:13.802237] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-23T19:55:14.004024] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T19:55:14.410728] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T19:55:14.602231] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-23T19:55:15.402210] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-23T19:55:15.779285] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T19:55:16.202217] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-23T19:55:16.280602] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T19:55:16.778707] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T19:55:17.002217] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-23T19:55:17.802266] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-23T19:55:18.126143] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T19:55:18.378323] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T19:55:18.602294] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-23T19:55:19.177220] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T19:55:19.402198] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-23T19:55:20.202193] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-23T19:55:20.792835] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:55:20.808205] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T19:55:21.002194] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-23T19:55:21.802262] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-23T19:55:22.528468] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T19:55:22.602171] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-23T19:55:22.833160] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T19:55:23.402209] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-23T19:55:24.004592] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:55:24.077060] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T19:55:24.202223] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-23T19:55:25.002246] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-23T19:55:25.713743] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T19:55:25.802192] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-23T19:55:25.967456] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T19:55:26.602236] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-23T19:55:26.847457] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T19:55:27.307357] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T19:55:27.402243] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-23T19:55:28.202196] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-23T19:55:28.697532] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:55:28.818024] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T19:55:29.002220] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-23T19:55:29.791274] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T19:55:29.793215] [INFO ] [REMOTE ] MDST: Full fetch complete (8401 records). [2025-09-23T19:55:29.793284] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-23T19:55:29.807411] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-23T19:55:30.200170] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-23T19:55:30.200253] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-23T19:55:30.200506] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-23T19:55:30.200566] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-23T19:55:30.201015] [DEBUG] [LOCAL ] MDST: Trimmed 8401 records to 5492 (keeping 200 days of data) [2025-09-23T19:55:30.236484] [DEBUG] [LOCAL ] MDST: Primary data saved (5492 records). [2025-09-23T19:55:30.236638] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-23T19:55:30.236775] [INFO ] [MAIN ] Update Progress: 1321/2372 symbols completed. MDST took 23.7s. Estimated remaining: 2h 19m 35s. Rate: 7.5 symbols/min [2025-09-23T19:55:30.428744] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:30.483262] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-23T19:55:30.483521] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-09-23T19:55:30.607344] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-23T19:55:30.673696] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:55:30.673949] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-23T19:55:30.673998] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-23T19:55:30.675611] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-23T19:55:30.675697] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-23T19:55:31.061034] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:55:31.359483] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T19:55:31.402168] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-23T19:55:31.441845] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T19:55:31.446189] [INFO ] [REMOTE ] MCS: Full fetch complete (30264 records). [2025-09-23T19:55:31.446281] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-23T19:55:31.823202] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-23T19:55:31.823316] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-23T19:55:31.823970] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-23T19:55:31.824034] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-23T19:55:31.825018] [DEBUG] [LOCAL ] MCS: Trimmed 30264 records to 21238 (keeping 200 days of data) [2025-09-23T19:55:31.956432] [DEBUG] [LOCAL ] MCS: Primary data saved (21238 records). [2025-09-23T19:55:31.956563] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-23T19:55:31.956669] [INFO ] [MAIN ] Update Progress: 1322/2372 symbols completed. MCS took 25.4s. Estimated remaining: 2h 19m 22s. Rate: 7.5 symbols/min [2025-09-23T19:55:32.125968] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:32.171345] [DEBUG] [LOCAL ] MDU: Loaded 47873 existing records from primary storage. [2025-09-23T19:55:32.171496] [INFO ] [MAIN ] MDU: Loaded 47873 existing records. [2025-09-23T19:55:32.207392] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-23T19:55:32.352147] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:55:32.352364] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-23T19:55:32.352410] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-23T19:55:32.353718] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-23T19:55:32.353779] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-23T19:55:32.714757] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:55:32.975120] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T19:55:33.002139] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-23T19:55:33.534985] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T19:55:33.802258] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-23T19:55:34.459331] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:55:34.465748] [INFO ] [REMOTE ] MD: Full fetch complete (55271 records). [2025-09-23T19:55:34.465878] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-23T19:55:34.607350] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-23T19:55:34.862043] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-23T19:55:34.862125] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-23T19:55:34.862977] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-23T19:55:34.863041] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-23T19:55:34.864208] [DEBUG] [LOCAL ] MD: Trimmed 55271 records to 38662 (keeping 200 days of data) [2025-09-23T19:55:35.097837] [DEBUG] [LOCAL ] MD: Primary data saved (38662 records). [2025-09-23T19:55:35.097986] [INFO ] [MAIN ] MD: Full history saved. [2025-09-23T19:55:35.098072] [INFO ] [MAIN ] Update Progress: 1323/2372 symbols completed. MD took 28.6s. Estimated remaining: 2h 19m 11s. Rate: 7.5 symbols/min [2025-09-23T19:55:35.275789] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:35.286839] [DEBUG] [LOCAL ] MDV: Loaded 8806 existing records from primary storage. [2025-09-23T19:55:35.286963] [INFO ] [MAIN ] MDV: Loaded 8806 existing records. [2025-09-23T19:55:35.407498] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-23T19:55:35.474429] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:55:35.475352] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-23T19:55:35.475519] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-23T19:55:35.476036] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-23T19:55:35.476115] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-23T19:55:35.875505] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:55:35.908572] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-23T19:55:35.937321] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T19:55:36.202189] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-23T19:55:36.615907] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T19:55:37.002210] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-23T19:55:37.085243] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T19:55:37.393119] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T19:55:37.802229] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-23T19:55:38.602203] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-23T19:55:39.402160] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-23T19:55:39.652326] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T19:55:39.677240] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T19:55:40.202218] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-23T19:55:40.568475] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T19:55:41.002233] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-23T19:55:41.802161] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-23T19:55:42.030556] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T19:55:42.601118] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T19:55:42.610315] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-23T19:55:42.635947] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T19:55:43.402193] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-23T19:55:43.836434] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:55:44.202211] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-23T19:55:45.002170] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-23T19:55:45.150923] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T19:55:45.404335] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:55:45.802234] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-23T19:55:46.602228] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-23T19:55:46.658696] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:55:47.147822] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T19:55:47.402204] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-23T19:55:47.868043] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T19:55:47.871859] [INFO ] [REMOTE ] MCY: Full fetch complete (41782 records). [2025-09-23T19:55:47.871949] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-23T19:55:48.215573] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-23T19:55:48.247933] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-23T19:55:48.248024] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-23T19:55:48.248860] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-23T19:55:48.248953] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-23T19:55:48.250608] [DEBUG] [LOCAL ] MCY: Trimmed 41782 records to 25182 (keeping 200 days of data) [2025-09-23T19:55:48.421115] [DEBUG] [LOCAL ] MCY: Primary data saved (25182 records). [2025-09-23T19:55:48.421366] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-23T19:55:48.421468] [INFO ] [MAIN ] Update Progress: 1324/2372 symbols completed. MCY took 41.9s. Estimated remaining: 2h 19m 7s. Rate: 7.5 symbols/min [2025-09-23T19:55:48.595166] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:48.614812] [DEBUG] [LOCAL ] MEC: Loaded 16481 existing records from primary storage. [2025-09-23T19:55:48.614949] [INFO ] [MAIN ] MEC: Loaded 16481 existing records. [2025-09-23T19:55:48.808105] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:55:48.808603] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-23T19:55:48.808828] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-23T19:55:48.809521] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-23T19:55:48.809750] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-23T19:55:48.949733] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T19:55:49.006638] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-23T19:55:49.166348] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T19:55:49.250085] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:55:49.802197] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-23T19:55:50.564361] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T19:55:50.602171] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-23T19:55:50.633492] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:55:51.363695] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T19:55:51.402150] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-23T19:55:52.202161] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-23T19:55:52.215700] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T19:55:53.002254] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-23T19:55:53.802258] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-23T19:55:53.896899] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T19:55:54.617086] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-23T19:55:54.656400] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:55:54.756543] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T19:55:55.402279] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-23T19:55:55.588639] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:55:56.202222] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-23T19:55:56.274415] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T19:55:57.002204] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-23T19:55:57.747752] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T19:55:57.802169] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-23T19:55:57.992077] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T19:55:58.602206] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-23T19:55:59.261924] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T19:55:59.290197] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T19:55:59.292437] [INFO ] [REMOTE ] MDV: Full fetch complete (11597 records). [2025-09-23T19:55:59.292615] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-23T19:55:59.404545] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-23T19:55:59.678931] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-23T19:55:59.679025] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-23T19:55:59.679343] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-23T19:55:59.679382] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-23T19:55:59.679939] [DEBUG] [LOCAL ] MDV: Trimmed 11597 records to 8749 (keeping 200 days of data) [2025-09-23T19:55:59.736883] [DEBUG] [LOCAL ] MDV: Primary data saved (8749 records). [2025-09-23T19:55:59.737026] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-23T19:55:59.737113] [INFO ] [MAIN ] Update Progress: 1325/2372 symbols completed. MDV took 24.6s. Estimated remaining: 2h 19m 2s. Rate: 7.5 symbols/min [2025-09-23T19:55:59.922617] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:55:59.946551] [DEBUG] [LOCAL ] MED: Loaded 21844 existing records from primary storage. [2025-09-23T19:55:59.946728] [INFO ] [MAIN ] MED: Loaded 21844 existing records. [2025-09-23T19:56:00.133020] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:56:00.133313] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-23T19:56:00.133364] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-23T19:56:00.134224] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-23T19:56:00.134291] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-23T19:56:00.211174] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-23T19:56:00.505452] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:56:01.002206] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-23T19:56:01.469998] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-23T19:56:01.481817] [INFO ] [REMOTE ] MDU: Full fetch complete (70246 records). [2025-09-23T19:56:01.482002] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-23T19:56:01.802481] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-23T19:56:01.836440] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T19:56:01.935200] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-23T19:56:01.935344] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-23T19:56:01.936608] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-23T19:56:01.936776] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-23T19:56:01.938677] [DEBUG] [LOCAL ] MDU: Trimmed 70246 records to 47881 (keeping 200 days of data) [2025-09-23T19:56:02.081384] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-23T19:56:02.305107] [DEBUG] [LOCAL ] MDU: Primary data saved (47881 records). [2025-09-23T19:56:02.305270] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-23T19:56:02.305363] [INFO ] [MAIN ] Update Progress: 1326/2372 symbols completed. MDU took 30.3s. Estimated remaining: 2h 18m 49s. Rate: 7.5 symbols/min [2025-09-23T19:56:02.486134] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:56:02.518772] [DEBUG] [LOCAL ] MEG: Loaded 31952 existing records from primary storage. [2025-09-23T19:56:02.518955] [INFO ] [MAIN ] MEG: Loaded 31952 existing records. [2025-09-23T19:56:02.607295] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-23T19:56:02.713981] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:56:02.714428] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-23T19:56:02.714611] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-23T19:56:02.717715] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-23T19:56:02.717780] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-23T19:56:02.933538] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T19:56:03.133873] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:56:03.325155] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T19:56:03.402185] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-23T19:56:04.202167] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-23T19:56:04.369470] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T19:56:05.002209] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-23T19:56:05.671899] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T19:56:05.732260] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T19:56:05.802204] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-23T19:56:06.602199] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-23T19:56:07.402169] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-23T19:56:07.746044] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T19:56:07.785963] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T19:56:08.012562] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T19:56:08.202198] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-23T19:56:09.002207] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-23T19:56:09.108792] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-23T19:56:09.802200] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-23T19:56:10.602211] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-23T19:56:10.971262] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T19:56:11.024526] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T19:56:11.402171] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-23T19:56:11.611635] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:56:12.202190] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-23T19:56:12.543816] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T19:56:13.002163] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-23T19:56:13.210939] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T19:56:13.214090] [INFO ] [REMOTE ] MEC: Full fetch complete (22654 records). [2025-09-23T19:56:13.214176] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-23T19:56:13.607181] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-23T19:56:13.607305] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-23T19:56:13.607833] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-23T19:56:13.607897] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-23T19:56:13.608634] [DEBUG] [LOCAL ] MEC: Trimmed 22654 records to 16443 (keeping 200 days of data) [2025-09-23T19:56:13.713971] [DEBUG] [LOCAL ] MEC: Primary data saved (16443 records). [2025-09-23T19:56:13.714114] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-23T19:56:13.714221] [INFO ] [MAIN ] Update Progress: 1327/2372 symbols completed. MEC took 25.3s. Estimated remaining: 2h 18m 44s. Rate: 7.5 symbols/min [2025-09-23T19:56:13.810597] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-23T19:56:13.883055] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:56:13.904975] [DEBUG] [LOCAL ] MEGI: Loaded 20533 existing records from primary storage. [2025-09-23T19:56:13.905127] [INFO ] [MAIN ] MEGI: Loaded 20533 existing records. [2025-09-23T19:56:14.092540] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:56:14.093149] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-23T19:56:14.093232] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-23T19:56:14.093848] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-23T19:56:14.093910] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-23T19:56:14.449722] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:56:14.602229] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-23T19:56:14.898009] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T19:56:14.908269] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-23T19:56:14.908432] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-23T19:56:15.066999] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T19:56:15.376986] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-23T19:56:15.377109] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-23T19:56:15.378141] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-23T19:56:15.378221] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-23T19:56:15.382065] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-09-23T19:56:15.452504] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-23T19:56:15.684790] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T19:56:15.777899] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-09-23T19:56:15.778053] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-23T19:56:15.778164] [INFO ] [MAIN ] Update Progress: 1328/2372 symbols completed. MDT took 45.5s. Estimated remaining: 2h 18m 32s. Rate: 7.5 symbols/min [2025-09-23T19:56:15.973356] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:56:16.017262] [DEBUG] [LOCAL ] MEI: Loaded 32712 existing records from primary storage. [2025-09-23T19:56:16.017450] [INFO ] [MAIN ] MEI: Loaded 32712 existing records. [2025-09-23T19:56:16.201489] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:56:16.201933] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-23T19:56:16.202005] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-23T19:56:16.202199] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-23T19:56:16.203888] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-23T19:56:16.203951] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-23T19:56:16.588221] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:56:16.611524] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:56:17.002226] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-23T19:56:17.359575] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T19:56:17.643040] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T19:56:17.802213] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-23T19:56:18.602205] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-23T19:56:18.800722] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T19:56:19.402209] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-23T19:56:19.895770] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T19:56:20.202232] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-23T19:56:20.533925] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T19:56:21.002212] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-23T19:56:21.183748] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T19:56:21.802445] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-23T19:56:22.326804] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T19:56:22.544243] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-23T19:56:22.602291] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-23T19:56:23.402216] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-23T19:56:23.652706] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T19:56:24.202237] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-23T19:56:24.283914] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T19:56:24.810178] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T19:56:25.002246] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-23T19:56:25.802253] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-23T19:56:26.448003] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T19:56:26.602295] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-23T19:56:26.985493] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T19:56:27.402265] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-23T19:56:27.514355] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:56:28.202204] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-23T19:56:28.243187] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T19:56:29.002204] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-23T19:56:29.450046] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:56:29.456888] [INFO ] [REMOTE ] MEG: Full fetch complete (48216 records). [2025-09-23T19:56:29.457054] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-23T19:56:29.805102] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-23T19:56:29.850219] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-23T19:56:29.850280] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-23T19:56:29.851055] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-23T19:56:29.851184] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-23T19:56:29.852288] [DEBUG] [LOCAL ] MEG: Trimmed 48216 records to 31984 (keeping 200 days of data) [2025-09-23T19:56:30.049028] [DEBUG] [LOCAL ] MEG: Primary data saved (31984 records). [2025-09-23T19:56:30.049177] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-23T19:56:30.049324] [INFO ] [MAIN ] Update Progress: 1329/2372 symbols completed. MEG took 27.7s. Estimated remaining: 2h 18m 29s. Rate: 7.5 symbols/min [2025-09-23T19:56:30.230952] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T19:56:30.251348] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:56:30.313555] [DEBUG] [LOCAL ] MET: Loaded 53315 existing records from primary storage. [2025-09-23T19:56:30.313759] [INFO ] [MAIN ] MET: Loaded 53315 existing records. [2025-09-23T19:56:30.496958] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:56:30.497539] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-23T19:56:30.497672] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-23T19:56:30.499702] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-23T19:56:30.499800] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-23T19:56:30.611178] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-23T19:56:30.878114] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:56:30.898379] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T19:56:31.402213] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-23T19:56:31.853890] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T19:56:32.202165] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-23T19:56:32.522885] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T19:56:33.002257] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-23T19:56:33.527922] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T19:56:33.718799] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T19:56:33.802210] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-23T19:56:34.602235] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-23T19:56:35.402174] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-23T19:56:35.607618] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T19:56:35.629775] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T19:56:35.633607] [INFO ] [REMOTE ] MEGI: Full fetch complete (30661 records). [2025-09-23T19:56:35.633727] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-23T19:56:36.022988] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-23T19:56:36.023290] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-23T19:56:36.023931] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-23T19:56:36.023992] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-23T19:56:36.025082] [DEBUG] [LOCAL ] MEGI: Trimmed 30661 records to 20457 (keeping 200 days of data) [2025-09-23T19:56:36.182428] [DEBUG] [LOCAL ] MEGI: Primary data saved (20457 records). [2025-09-23T19:56:36.183177] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T19:56:36.189029] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-23T19:56:36.189393] [INFO ] [MAIN ] Update Progress: 1330/2372 symbols completed. MEGI took 22.5s. Estimated remaining: 2h 18m 19s. Rate: 7.5 symbols/min [2025-09-23T19:56:36.210754] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-23T19:56:36.363961] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:56:36.419038] [DEBUG] [LOCAL ] MFA: Loaded 45255 existing records from primary storage. [2025-09-23T19:56:36.419219] [INFO ] [MAIN ] MFA: Loaded 45255 existing records. [2025-09-23T19:56:36.598819] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:56:36.599133] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-23T19:56:36.599181] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-23T19:56:36.600469] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-23T19:56:36.600530] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-23T19:56:36.959311] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:56:37.002156] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-23T19:56:37.802166] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-23T19:56:37.988465] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:56:38.602155] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-23T19:56:38.635789] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:56:38.696331] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T19:56:39.402191] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-23T19:56:40.202154] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-23T19:56:40.249249] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T19:56:40.311198] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T19:56:41.002207] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-23T19:56:41.350775] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T19:56:41.802248] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-23T19:56:42.602158] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-23T19:56:42.838067] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T19:56:43.247627] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T19:56:43.404679] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-23T19:56:43.409756] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T19:56:44.202198] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-23T19:56:45.002182] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-23T19:56:45.267269] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T19:56:45.652060] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T19:56:45.802236] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-23T19:56:46.068154] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T19:56:46.075829] [INFO ] [REMOTE ] MED: Full fetch complete (33068 records). [2025-09-23T19:56:46.076030] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-23T19:56:46.507300] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-23T19:56:46.507438] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-23T19:56:46.508781] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-23T19:56:46.508871] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-23T19:56:46.510271] [DEBUG] [LOCAL ] MED: Trimmed 33068 records to 21843 (keeping 200 days of data) [2025-09-23T19:56:46.612463] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-23T19:56:46.729197] [DEBUG] [LOCAL ] MED: Primary data saved (21843 records). [2025-09-23T19:56:46.729412] [INFO ] [MAIN ] MED: Full history saved. [2025-09-23T19:56:46.729634] [INFO ] [MAIN ] Update Progress: 1331/2372 symbols completed. MED took 47.0s. Estimated remaining: 2h 18m 13s. Rate: 7.5 symbols/min [2025-09-23T19:56:47.017536] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:56:47.026678] [DEBUG] [LOCAL ] MFAN: Loaded 4283 existing records from primary storage. [2025-09-23T19:56:47.026864] [INFO ] [MAIN ] MFAN: Loaded 4283 existing records. [2025-09-23T19:56:47.265015] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:56:47.265561] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-23T19:56:47.265796] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-23T19:56:47.266258] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-23T19:56:47.266388] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-23T19:56:47.404275] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-23T19:56:47.410815] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T19:56:47.720342] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:56:48.202228] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-23T19:56:48.446701] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T19:56:48.968481] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T19:56:49.002154] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-23T19:56:49.579438] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:56:49.802225] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-23T19:56:49.895539] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T19:56:50.602259] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-23T19:56:51.402272] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-23T19:56:51.451974] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T19:56:51.987587] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T19:56:52.202188] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-23T19:56:52.375849] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:56:52.733675] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T19:56:53.002221] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-23T19:56:53.802205] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-23T19:56:54.259442] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T19:56:54.602246] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-23T19:56:54.784924] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T19:56:55.402228] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-23T19:56:55.828485] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:56:55.969847] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T19:56:56.202287] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-23T19:56:57.002241] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-23T19:56:57.720925] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T19:56:57.730034] [INFO ] [REMOTE ] MEI: Full fetch complete (45773 records). [2025-09-23T19:56:57.730194] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-23T19:56:57.809896] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-23T19:56:58.115391] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-23T19:56:58.115470] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-23T19:56:58.116199] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-23T19:56:58.116262] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-23T19:56:58.117306] [DEBUG] [LOCAL ] MEI: Trimmed 45773 records to 32587 (keeping 200 days of data) [2025-09-23T19:56:58.309854] [DEBUG] [LOCAL ] MEI: Primary data saved (32587 records). [2025-09-23T19:56:58.309974] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-23T19:56:58.310066] [INFO ] [MAIN ] Update Progress: 1332/2372 symbols completed. MEI took 42.5s. Estimated remaining: 2h 18m 8s. Rate: 7.5 symbols/min [2025-09-23T19:56:58.482778] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:56:58.490985] [DEBUG] [LOCAL ] MFAO: Loaded 3825 existing records from primary storage. [2025-09-23T19:56:58.491155] [INFO ] [MAIN ] MFAO: Loaded 3825 existing records. [2025-09-23T19:56:58.597761] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:56:58.602707] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-23T19:56:58.684413] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:56:58.684891] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-23T19:56:58.685160] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-23T19:56:58.685460] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-23T19:56:58.685525] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-23T19:56:59.013451] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T19:56:59.088553] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:56:59.402226] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-23T19:56:59.989180] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T19:57:00.202222] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-23T19:57:00.314813] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T19:57:01.002200] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-23T19:57:01.753233] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:57:01.802223] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-23T19:57:02.129564] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:57:02.138682] [INFO ] [REMOTE ] MET: Full fetch complete (77101 records). [2025-09-23T19:57:02.138842] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-23T19:57:02.602505] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-23T19:57:02.603066] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-23T19:57:02.604299] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-23T19:57:02.605440] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-23T19:57:02.605619] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-23T19:57:02.607394] [DEBUG] [LOCAL ] MET: Trimmed 77101 records to 53316 (keeping 200 days of data) [2025-09-23T19:57:02.955177] [DEBUG] [LOCAL ] MET: Primary data saved (53316 records). [2025-09-23T19:57:02.955327] [INFO ] [MAIN ] MET: Full history saved. [2025-09-23T19:57:02.955416] [INFO ] [MAIN ] Update Progress: 1333/2372 symbols completed. MET took 32.9s. Estimated remaining: 2h 17m 57s. Rate: 7.5 symbols/min [2025-09-23T19:57:03.135263] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:57:03.135456] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T19:57:03.186076] [DEBUG] [LOCAL ] MFC: Loaded 51327 existing records from primary storage. [2025-09-23T19:57:03.186224] [INFO ] [MAIN ] MFC: Loaded 51327 existing records. [2025-09-23T19:57:03.362047] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:57:03.362335] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-23T19:57:03.362390] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-23T19:57:03.363554] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-23T19:57:03.363617] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-23T19:57:03.407261] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-23T19:57:03.740753] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:57:04.202243] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-23T19:57:04.204393] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:57:04.544361] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-23T19:57:05.002207] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-23T19:57:05.802257] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-23T19:57:06.117678] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T19:57:06.133841] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-23T19:57:06.243310] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T19:57:06.251420] [INFO ] [REMOTE ] MFA: Full fetch complete (64751 records). [2025-09-23T19:57:06.251576] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-23T19:57:06.616844] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-23T19:57:06.649787] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-23T19:57:06.649879] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-23T19:57:06.650942] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-23T19:57:06.651009] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-23T19:57:06.652599] [DEBUG] [LOCAL ] MFA: Trimmed 64751 records to 45274 (keeping 200 days of data) [2025-09-23T19:57:06.941773] [DEBUG] [LOCAL ] MFA: Primary data saved (45274 records). [2025-09-23T19:57:06.941911] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-23T19:57:06.942007] [INFO ] [MAIN ] Update Progress: 1334/2372 symbols completed. MFA took 30.8s. Estimated remaining: 2h 17m 46s. Rate: 7.5 symbols/min [2025-09-23T19:57:07.115971] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:57:07.160808] [DEBUG] [LOCAL ] MFG: Loaded 49048 existing records from primary storage. [2025-09-23T19:57:07.160961] [INFO ] [MAIN ] MFG: Loaded 49048 existing records. [2025-09-23T19:57:07.354834] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:57:07.355137] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-23T19:57:07.355192] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-23T19:57:07.356201] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-23T19:57:07.356262] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-23T19:57:07.410117] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-23T19:57:07.735586] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:57:08.202149] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-23T19:57:08.242854] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:57:08.268489] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T19:57:09.002186] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-23T19:57:09.792778] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T19:57:09.802146] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-23T19:57:10.512811] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:57:10.514550] [INFO ] [REMOTE ] MFAN: Full fetch complete (5543 records). [2025-09-23T19:57:10.514717] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-23T19:57:10.604824] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-23T19:57:10.916097] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-23T19:57:11.043316] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-23T19:57:11.043456] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-23T19:57:11.043780] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-23T19:57:11.043846] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-23T19:57:11.044514] [DEBUG] [LOCAL ] MFAN: Trimmed 5543 records to 4253 (keeping 200 days of data) [2025-09-23T19:57:11.079995] [DEBUG] [LOCAL ] MFAN: Primary data saved (4253 records). [2025-09-23T19:57:11.080227] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-23T19:57:11.080353] [INFO ] [MAIN ] Update Progress: 1335/2372 symbols completed. MFAN took 24.4s. Estimated remaining: 2h 17m 35s. Rate: 7.5 symbols/min [2025-09-23T19:57:11.324339] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:57:11.349249] [DEBUG] [LOCAL ] MFM: Loaded 14268 existing records from primary storage. [2025-09-23T19:57:11.350376] [INFO ] [MAIN ] MFM: Loaded 14268 existing records. [2025-09-23T19:57:11.350261] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T19:57:11.408117] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-23T19:57:11.541681] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:57:11.542013] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-23T19:57:11.542063] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-23T19:57:11.542605] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-23T19:57:11.542699] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-23T19:57:11.929486] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:57:12.202216] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-23T19:57:12.641031] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T19:57:13.002280] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-23T19:57:13.052227] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T19:57:13.802214] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-23T19:57:14.393374] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T19:57:14.602167] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-23T19:57:14.774938] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T19:57:15.402192] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-23T19:57:16.202273] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-23T19:57:17.002179] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-23T19:57:17.069186] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-23T19:57:17.342412] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T19:57:17.665029] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:57:17.692031] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-23T19:57:17.802231] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-23T19:57:18.602246] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-23T19:57:19.402171] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-23T19:57:19.509194] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T19:57:19.513376] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:57:20.202214] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-23T19:57:20.739773] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-23T19:57:21.002349] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:57:21.002478] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-23T19:57:21.734521] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T19:57:21.802234] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-23T19:57:22.199883] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T19:57:22.602199] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-23T19:57:23.402244] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-23T19:57:24.202187] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-23T19:57:24.278946] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T19:57:25.002249] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-23T19:57:25.008638] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:57:25.010619] [INFO ] [REMOTE ] MFAO: Full fetch complete (5220 records). [2025-09-23T19:57:25.010824] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-23T19:57:25.394500] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-23T19:57:25.394635] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-23T19:57:25.394953] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-23T19:57:25.395015] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-23T19:57:25.395452] [DEBUG] [LOCAL ] MFAO: Trimmed 5220 records to 3817 (keeping 200 days of data) [2025-09-23T19:57:25.418814] [DEBUG] [LOCAL ] MFAO: Primary data saved (3817 records). [2025-09-23T19:57:25.418892] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-23T19:57:25.418970] [INFO ] [MAIN ] Update Progress: 1336/2372 symbols completed. MFAO took 27.1s. Estimated remaining: 2h 17m 32s. Rate: 7.5 symbols/min [2025-09-23T19:57:25.601567] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:57:25.601832] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-23T19:57:25.601879] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-23T19:57:25.602026] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-23T19:57:25.602070] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-23T19:57:25.602112] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-23T19:57:25.602147] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-23T19:57:25.819465] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-23T19:57:25.934345] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T19:57:26.021748] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:57:26.602173] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-23T19:57:26.696370] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T19:57:26.820965] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T19:57:27.402229] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-23T19:57:28.085119] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T19:57:28.202206] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-23T19:57:28.278826] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T19:57:29.002234] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-23T19:57:29.497615] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:57:29.541981] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T19:57:29.802242] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-23T19:57:30.602247] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-23T19:57:30.837883] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-23T19:57:31.402184] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-23T19:57:31.532449] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:57:32.202210] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-23T19:57:32.991610] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T19:57:33.002253] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-23T19:57:33.245265] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-23T19:57:33.802171] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-23T19:57:33.910246] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:57:34.602213] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-23T19:57:35.402186] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-23T19:57:35.472392] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T19:57:35.480988] [INFO ] [REMOTE ] MFC: Full fetch complete (74288 records). [2025-09-23T19:57:35.481145] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-23T19:57:35.888914] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-23T19:57:35.889028] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-23T19:57:35.890098] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-23T19:57:35.890163] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-23T19:57:35.891681] [DEBUG] [LOCAL ] MFC: Trimmed 74288 records to 51316 (keeping 200 days of data) [2025-09-23T19:57:36.202453] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-23T19:57:36.220528] [DEBUG] [LOCAL ] MFC: Primary data saved (51316 records). [2025-09-23T19:57:36.220716] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-23T19:57:36.220825] [INFO ] [MAIN ] Update Progress: 1337/2372 symbols completed. MFC took 33.3s. Estimated remaining: 2h 17m 27s. Rate: 7.5 symbols/min [2025-09-23T19:57:36.399606] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:57:36.400104] [DEBUG] [LOCAL ] MFSG: No existing data file found in primary storage. [2025-09-23T19:57:36.400375] [WARN ] [MAIN ] MFSG: No existing data found, performing full refresh instead. [2025-09-23T19:57:36.400797] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-23T19:57:36.400928] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-23T19:57:36.424845] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-23T19:57:36.425022] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-23T19:57:36.477717] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-23T19:57:36.524038] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-23T19:57:36.577572] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T19:57:36.588537] [INFO ] [REMOTE ] MFG: Full fetch complete (68508 records). [2025-09-23T19:57:36.588880] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-23T19:57:37.031710] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-23T19:57:37.084967] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:57:37.284323] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-23T19:57:37.284437] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-23T19:57:37.285509] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-23T19:57:37.285591] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-23T19:57:37.287322] [DEBUG] [LOCAL ] MFG: Trimmed 68508 records to 49036 (keeping 200 days of data) [2025-09-23T19:57:37.572491] [DEBUG] [LOCAL ] MFG: Primary data saved (49036 records). [2025-09-23T19:57:37.572628] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-23T19:57:37.572764] [INFO ] [MAIN ] Update Progress: 1338/2372 symbols completed. MFG took 30.6s. Estimated remaining: 2h 17m 14s. Rate: 7.5 symbols/min [2025-09-23T19:57:37.752404] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:57:37.752689] [DEBUG] [LOCAL ] MFSI: No existing data file found in primary storage. [2025-09-23T19:57:37.752758] [WARN ] [MAIN ] MFSI: No existing data found, performing full refresh instead. [2025-09-23T19:57:37.752938] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-23T19:57:37.752984] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-23T19:57:37.753027] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-23T19:57:37.753061] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-23T19:57:37.809547] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-23T19:57:38.078086] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T19:57:38.152880] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:57:38.155977] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T19:57:38.602257] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-23T19:57:39.142162] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T19:57:39.402294] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-23T19:57:39.971490] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T19:57:40.202220] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-23T19:57:40.504531] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-23T19:57:41.002249] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-23T19:57:41.340727] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-23T19:57:41.802232] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-23T19:57:42.127354] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T19:57:42.602194] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-23T19:57:43.018354] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T19:57:43.402190] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-23T19:57:43.740077] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-23T19:57:44.202259] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-23T19:57:44.660749] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T19:57:45.002264] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-23T19:57:45.802212] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-23T19:57:45.990114] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T19:57:46.340957] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T19:57:46.602190] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-23T19:57:47.279513] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T19:57:47.402215] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-23T19:57:48.087823] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:57:48.202200] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-23T19:57:48.993196] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T19:57:49.002201] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-23T19:57:49.780442] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T19:57:49.802156] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-23T19:57:50.602216] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-23T19:57:50.700322] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T19:57:51.010102] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-23T19:57:51.011300] [INFO ] [REMOTE ] MFSB: Full fetch complete (1551 records). [2025-09-23T19:57:51.011372] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-23T19:57:51.204271] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T19:57:51.204489] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:57:51.204559] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:57:51.204629] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-23T19:57:51.204736] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-23T19:57:51.204779] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-23T19:57:51.204838] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-23T19:57:51.204936] [INFO ] [MAIN ] Update Progress: 1339/2372 symbols completed. MFSB took 25.8s. Estimated remaining: 2h 17m 10s. Rate: 7.5 symbols/min [2025-09-23T19:57:51.381350] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:57:51.381514] [DEBUG] [LOCAL ] MFSV: No existing data file found in primary storage. [2025-09-23T19:57:51.381553] [WARN ] [MAIN ] MFSV: No existing data found, performing full refresh instead. [2025-09-23T19:57:51.381729] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-23T19:57:51.381785] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-23T19:57:51.381829] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-23T19:57:51.381863] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-23T19:57:51.407372] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-23T19:57:51.767507] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:57:52.202194] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-23T19:57:52.444974] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:57:53.002196] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-23T19:57:53.164973] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T19:57:53.802213] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-23T19:57:54.055797] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T19:57:54.059041] [INFO ] [REMOTE ] MFSI: Full fetch complete (13133 records). [2025-09-23T19:57:54.059112] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-23T19:57:54.249268] [WARN ] [VALIDATOR ] MFSI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:57:54.249545] [FATAL] [MAIN ] MFSI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:57:54.249616] [WARN ] [MAIN ] MFSI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:57:54.249713] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-23T19:57:54.249798] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-23T19:57:54.249854] [INFO ] [LOCAL ] MFSI: Starting deletion of derivative data. [2025-09-23T19:57:54.249913] [DEBUG] [LOCAL ] MFSI: No derivative data file found to delete. [2025-09-23T19:57:54.249996] [INFO ] [MAIN ] Update Progress: 1340/2372 symbols completed. MFSI took 16.7s. Estimated remaining: 2h 16m 58s. Rate: 7.5 symbols/min [2025-09-23T19:57:54.430595] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:57:54.448308] [DEBUG] [LOCAL ] MG: Loaded 16813 existing records from primary storage. [2025-09-23T19:57:54.448434] [INFO ] [MAIN ] MG: Loaded 16813 existing records. [2025-09-23T19:57:54.603607] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-23T19:57:54.604150] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T19:57:54.657821] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:57:54.658071] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-23T19:57:54.658122] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-23T19:57:54.658796] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-23T19:57:54.658861] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-23T19:57:55.026550] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:57:55.047584] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T19:57:55.402202] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-23T19:57:56.202208] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-23T19:57:56.471426] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T19:57:56.475704] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-23T19:57:57.002192] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-23T19:57:57.802195] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-23T19:57:57.872740] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T19:57:58.213068] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T19:57:58.602197] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-23T19:57:59.401760] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T19:57:59.404337] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-23T19:58:00.202220] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-23T19:58:00.310703] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T19:58:00.313290] [INFO ] [REMOTE ] MFM: Full fetch complete (19114 records). [2025-09-23T19:58:00.313361] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-23T19:58:00.595293] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T19:58:00.688476] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-23T19:58:00.688573] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-23T19:58:00.689053] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-23T19:58:00.689114] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-23T19:58:00.689735] [DEBUG] [LOCAL ] MFM: Trimmed 19114 records to 14237 (keeping 200 days of data) [2025-09-23T19:58:00.775444] [DEBUG] [LOCAL ] MFM: Primary data saved (14237 records). [2025-09-23T19:58:00.775586] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-23T19:58:00.775711] [INFO ] [MAIN ] Update Progress: 1341/2372 symbols completed. MFM took 49.7s. Estimated remaining: 2h 16m 49s. Rate: 7.5 symbols/min [2025-09-23T19:58:00.946936] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:58:01.000049] [DEBUG] [LOCAL ] MGA: Loaded 50661 existing records from primary storage. [2025-09-23T19:58:01.000252] [INFO ] [MAIN ] MGA: Loaded 50661 existing records. [2025-09-23T19:58:01.011547] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-23T19:58:01.190417] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:58:01.190743] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-23T19:58:01.190802] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-23T19:58:01.192394] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-23T19:58:01.192456] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-23T19:58:01.547767] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:58:01.802168] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-23T19:58:02.188435] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T19:58:02.229767] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T19:58:02.602221] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-23T19:58:03.171742] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T19:58:03.402192] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-23T19:58:04.012580] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T19:58:04.202209] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-23T19:58:04.795835] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T19:58:05.002217] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-23T19:58:05.436333] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T19:58:05.802244] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-23T19:58:06.257467] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T19:58:06.602191] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-23T19:58:07.402178] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-23T19:58:07.811731] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T19:58:08.202177] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-23T19:58:08.349287] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T19:58:08.857557] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T19:58:09.002194] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-23T19:58:09.441094] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T19:58:09.802224] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-23T19:58:10.602223] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-23T19:58:10.617210] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T19:58:11.046574] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T19:58:11.402183] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-23T19:58:12.202203] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-23T19:58:12.374513] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T19:58:13.002222] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-23T19:58:13.802161] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-23T19:58:13.871834] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T19:58:14.071853] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:58:14.141473] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-23T19:58:14.602210] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-23T19:58:15.402285] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-23T19:58:16.148893] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T19:58:16.150755] [INFO ] [REMOTE ] MFSG: Full fetch complete (5789 records). [2025-09-23T19:58:16.150826] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-23T19:58:16.209359] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-23T19:58:16.347000] [WARN ] [VALIDATOR ] MFSG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:58:16.347302] [FATAL] [MAIN ] MFSG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:58:16.347467] [WARN ] [MAIN ] MFSG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:58:16.347541] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-23T19:58:16.347638] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-23T19:58:16.347747] [INFO ] [LOCAL ] MFSG: Starting deletion of derivative data. [2025-09-23T19:58:16.347802] [DEBUG] [LOCAL ] MFSG: No derivative data file found to delete. [2025-09-23T19:58:16.347866] [INFO ] [MAIN ] Update Progress: 1342/2372 symbols completed. MFSG took 40.1s. Estimated remaining: 2h 16m 47s. Rate: 7.5 symbols/min [2025-09-23T19:58:16.523182] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:58:16.532047] [DEBUG] [LOCAL ] MGF: Loaded 4108 existing records from primary storage. [2025-09-23T19:58:16.532166] [INFO ] [MAIN ] MGF: Loaded 4108 existing records. [2025-09-23T19:58:16.712039] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-23T19:58:16.746082] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:58:16.756408] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-23T19:58:16.756481] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-23T19:58:16.756769] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-23T19:58:16.756831] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-23T19:58:17.005337] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-23T19:58:17.139473] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T19:58:17.181588] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:58:17.740967] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T19:58:17.742515] [INFO ] [REMOTE ] MFSV: Full fetch complete (3002 records). [2025-09-23T19:58:17.742592] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-23T19:58:17.808466] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-23T19:58:17.954844] [WARN ] [VALIDATOR ] MFSV: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:58:17.955115] [FATAL] [MAIN ] MFSV: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:58:17.955193] [WARN ] [MAIN ] MFSV: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:58:17.955294] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-23T19:58:17.955433] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-23T19:58:17.955502] [INFO ] [LOCAL ] MFSV: Starting deletion of derivative data. [2025-09-23T19:58:17.955607] [DEBUG] [LOCAL ] MFSV: No derivative data file found to delete. [2025-09-23T19:58:17.955749] [INFO ] [MAIN ] Update Progress: 1343/2372 symbols completed. MFSV took 26.8s. Estimated remaining: 2h 16m 34s. Rate: 7.5 symbols/min [2025-09-23T19:58:18.137102] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:58:18.198423] [DEBUG] [LOCAL ] MGM: Loaded 53609 existing records from primary storage. [2025-09-23T19:58:18.198578] [INFO ] [MAIN ] MGM: Loaded 53609 existing records. [2025-09-23T19:58:18.388713] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:58:18.388956] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-23T19:58:18.389004] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-23T19:58:18.390836] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-23T19:58:18.390900] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-23T19:58:18.607854] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-23T19:58:18.782842] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:58:19.315411] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T19:58:19.402174] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-23T19:58:19.623067] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T19:58:19.727689] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T19:58:20.202235] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-23T19:58:20.886975] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T19:58:21.002240] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-23T19:58:21.802206] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-23T19:58:22.602181] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-23T19:58:22.725035] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T19:58:22.745972] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T19:58:22.985194] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T19:58:23.402261] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-23T19:58:24.053106] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T19:58:24.202223] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-23T19:58:25.002207] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-23T19:58:25.802178] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-23T19:58:26.038786] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T19:58:26.452716] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T19:58:26.602223] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-23T19:58:26.706031] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T19:58:26.710242] [INFO ] [REMOTE ] MG: Full fetch complete (24083 records). [2025-09-23T19:58:26.710357] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-23T19:58:27.092582] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-23T19:58:27.092687] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-23T19:58:27.093207] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-23T19:58:27.093303] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-23T19:58:27.094450] [DEBUG] [LOCAL ] MG: Trimmed 24083 records to 16730 (keeping 200 days of data) [2025-09-23T19:58:27.209043] [DEBUG] [LOCAL ] MG: Primary data saved (16730 records). [2025-09-23T19:58:27.209311] [INFO ] [MAIN ] MG: Full history saved. [2025-09-23T19:58:27.209550] [INFO ] [MAIN ] Update Progress: 1344/2372 symbols completed. MG took 33.0s. Estimated remaining: 2h 16m 27s. Rate: 7.5 symbols/min [2025-09-23T19:58:27.390461] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:58:27.402273] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-23T19:58:27.402171] [DEBUG] [LOCAL ] MGR: Loaded 5660 existing records from primary storage. [2025-09-23T19:58:27.402477] [INFO ] [MAIN ] MGR: Loaded 5660 existing records. [2025-09-23T19:58:27.588177] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:58:27.588464] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-23T19:58:27.588530] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-23T19:58:27.588838] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-23T19:58:27.588924] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-23T19:58:27.972166] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:58:28.134463] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T19:58:28.202158] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-23T19:58:28.403526] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T19:58:28.774442] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T19:58:29.002234] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-23T19:58:29.802201] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-23T19:58:30.602261] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-23T19:58:30.968354] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T19:58:31.049156] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T19:58:31.402230] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-23T19:58:31.548285] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T19:58:32.202204] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-23T19:58:32.587491] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T19:58:33.002167] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-23T19:58:33.060085] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:58:33.337337] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-23T19:58:33.802214] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-23T19:58:34.602197] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-23T19:58:35.184698] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T19:58:35.402215] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-23T19:58:35.516328] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:58:35.968817] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T19:58:36.202200] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-23T19:58:36.808244] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T19:58:36.809550] [INFO ] [REMOTE ] MGF: Full fetch complete (5861 records). [2025-09-23T19:58:36.809668] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-23T19:58:37.007374] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-23T19:58:37.185560] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-23T19:58:37.185684] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-23T19:58:37.185865] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-23T19:58:37.185906] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-23T19:58:37.186336] [DEBUG] [LOCAL ] MGF: Trimmed 5861 records to 4103 (keeping 200 days of data) [2025-09-23T19:58:37.212040] [DEBUG] [LOCAL ] MGF: Primary data saved (4103 records). [2025-09-23T19:58:37.212127] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-23T19:58:37.212292] [INFO ] [MAIN ] Update Progress: 1345/2372 symbols completed. MGF took 20.9s. Estimated remaining: 2h 16m 21s. Rate: 7.5 symbols/min [2025-09-23T19:58:37.378509] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:58:37.389117] [DEBUG] [LOCAL ] MGRB: Loaded 4092 existing records from primary storage. [2025-09-23T19:58:37.389226] [INFO ] [MAIN ] MGRB: Loaded 4092 existing records. [2025-09-23T19:58:37.565436] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:58:37.565721] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-23T19:58:37.565794] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-23T19:58:37.566113] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-23T19:58:37.566172] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-23T19:58:37.807423] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-23T19:58:37.924836] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:58:38.602182] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-23T19:58:39.111183] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T19:58:39.321199] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T19:58:39.402206] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-23T19:58:39.798557] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-23T19:58:39.836956] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T19:58:40.202195] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-23T19:58:41.002204] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-23T19:58:41.499323] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T19:58:41.802165] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-23T19:58:41.849105] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T19:58:42.461336] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T19:58:42.602210] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-23T19:58:43.402199] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-23T19:58:44.202164] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-23T19:58:44.415133] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T19:58:44.647459] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T19:58:44.662123] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T19:58:45.002193] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-23T19:58:45.559439] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T19:58:45.802198] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-23T19:58:46.602202] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-23T19:58:46.992861] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:58:47.402177] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-23T19:58:47.575897] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T19:58:47.585032] [INFO ] [REMOTE ] MGM: Full fetch complete (77596 records). [2025-09-23T19:58:47.585228] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-23T19:58:47.906746] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T19:58:48.008100] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-23T19:58:48.008191] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-23T19:58:48.009166] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-23T19:58:48.009229] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-23T19:58:48.010931] [DEBUG] [LOCAL ] MGM: Trimmed 77596 records to 53609 (keeping 200 days of data) [2025-09-23T19:58:48.204585] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-23T19:58:48.349422] [DEBUG] [LOCAL ] MGM: Primary data saved (53609 records). [2025-09-23T19:58:48.349555] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-23T19:58:48.349693] [INFO ] [MAIN ] Update Progress: 1346/2372 symbols completed. MGM took 30.4s. Estimated remaining: 2h 16m 15s. Rate: 7.5 symbols/min [2025-09-23T19:58:48.523820] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:58:48.528520] [DEBUG] [LOCAL ] MGRD: Loaded 2208 existing records from primary storage. [2025-09-23T19:58:48.528612] [INFO ] [MAIN ] MGRD: Loaded 2208 existing records. [2025-09-23T19:58:48.710547] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:58:48.710903] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-23T19:58:48.710960] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-23T19:58:48.711216] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-23T19:58:48.711274] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-23T19:58:48.957009] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:58:49.007304] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-23T19:58:49.096490] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:58:49.802244] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-23T19:58:49.843778] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T19:58:50.432219] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:58:50.602217] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-23T19:58:51.273783] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T19:58:51.402180] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-23T19:58:51.962688] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T19:58:52.202201] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-23T19:58:52.737926] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-23T19:58:53.002199] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-23T19:58:53.726347] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T19:58:53.802197] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-23T19:58:54.258361] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T19:58:54.602197] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-23T19:58:55.201210] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T19:58:55.402210] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-23T19:58:55.990387] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T19:58:56.202208] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-23T19:58:57.002208] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-23T19:58:57.427695] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T19:58:57.799296] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T19:58:57.808747] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-23T19:58:58.309670] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T19:58:58.602200] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-23T19:58:59.326609] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T19:58:59.328281] [INFO ] [REMOTE ] MGR: Full fetch complete (8346 records). [2025-09-23T19:58:59.328375] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-23T19:58:59.407325] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-23T19:58:59.718235] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-23T19:58:59.718548] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-23T19:58:59.718846] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-23T19:58:59.718909] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-23T19:58:59.719343] [DEBUG] [LOCAL ] MGR: Trimmed 8346 records to 5653 (keeping 200 days of data) [2025-09-23T19:58:59.757391] [DEBUG] [LOCAL ] MGR: Primary data saved (5653 records). [2025-09-23T19:58:59.757509] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-23T19:58:59.757630] [INFO ] [MAIN ] Update Progress: 1347/2372 symbols completed. MGR took 32.5s. Estimated remaining: 2h 16m 10s. Rate: 7.5 symbols/min [2025-09-23T19:58:59.931336] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:58:59.935900] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T19:58:59.949407] [DEBUG] [LOCAL ] MGRE: Loaded 6610 existing records from primary storage. [2025-09-23T19:58:59.949602] [INFO ] [MAIN ] MGRE: Loaded 6610 existing records. [2025-09-23T19:59:00.144443] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:59:00.144783] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-23T19:59:00.144837] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-23T19:59:00.145438] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-23T19:59:00.145499] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-23T19:59:00.208513] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-23T19:59:00.527081] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:00.779988] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T19:59:01.002220] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-23T19:59:01.557263] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T19:59:01.558343] [INFO ] [REMOTE ] MGRB: Full fetch complete (6337 records). [2025-09-23T19:59:01.558429] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-23T19:59:01.812786] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-23T19:59:01.935963] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-23T19:59:01.936051] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-23T19:59:01.936231] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-23T19:59:01.936270] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-23T19:59:01.936865] [DEBUG] [LOCAL ] MGRB: Trimmed 6337 records to 4083 (keeping 200 days of data) [2025-09-23T19:59:01.962535] [DEBUG] [LOCAL ] MGRB: Primary data saved (4083 records). [2025-09-23T19:59:01.962734] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-23T19:59:01.962838] [INFO ] [MAIN ] Update Progress: 1348/2372 symbols completed. MGRB took 24.8s. Estimated remaining: 2h 15m 58s. Rate: 7.5 symbols/min [2025-09-23T19:59:02.147977] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:02.214340] [DEBUG] [LOCAL ] MGY: Loaded 52428 existing records from primary storage. [2025-09-23T19:59:02.214506] [INFO ] [MAIN ] MGY: Loaded 52428 existing records. [2025-09-23T19:59:02.392313] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:59:02.392552] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-23T19:59:02.392599] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-23T19:59:02.394093] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-23T19:59:02.394155] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-23T19:59:02.574584] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T19:59:02.608877] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-23T19:59:02.763128] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:03.200766] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T19:59:03.402212] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-23T19:59:04.202199] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-23T19:59:05.002165] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-23T19:59:05.100054] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T19:59:05.108765] [INFO ] [REMOTE ] MGA: Full fetch complete (73693 records). [2025-09-23T19:59:05.108924] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-23T19:59:05.496997] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-23T19:59:05.497079] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-23T19:59:05.498067] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-23T19:59:05.498133] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-23T19:59:05.499559] [DEBUG] [LOCAL ] MGA: Trimmed 73693 records to 50649 (keeping 200 days of data) [2025-09-23T19:59:05.724076] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:59:05.811298] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-23T19:59:05.832874] [DEBUG] [LOCAL ] MGA: Primary data saved (50649 records). [2025-09-23T19:59:05.832980] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-23T19:59:05.833108] [INFO ] [MAIN ] Update Progress: 1349/2372 symbols completed. MGA took 1m 5s. Estimated remaining: 2h 15m 47s. Rate: 7.5 symbols/min [2025-09-23T19:59:06.002277] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:06.002450] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-23T19:59:06.002505] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-23T19:59:06.002675] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-23T19:59:06.002729] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-23T19:59:06.002772] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-23T19:59:06.002805] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-23T19:59:06.355875] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:06.496596] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T19:59:06.602157] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-23T19:59:06.754941] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T19:59:06.791330] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:59:06.791625] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-23T19:59:07.402174] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-23T19:59:08.202148] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-23T19:59:08.777492] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T19:59:08.895102] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:59:09.002154] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-23T19:59:09.207895] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:59:09.208231] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-23T19:59:09.802203] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-23T19:59:10.561548] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T19:59:10.602149] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-23T19:59:11.203424] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T19:59:11.402256] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-23T19:59:11.600244] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:59:11.600576] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-23T19:59:12.202249] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-23T19:59:12.639572] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T19:59:13.002255] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-23T19:59:13.435890] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T19:59:13.802201] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-23T19:59:14.250462] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T19:59:14.251390] [INFO ] [REMOTE ] MGRD: Full fetch complete (3503 records). [2025-09-23T19:59:14.251462] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-23T19:59:14.623932] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-23T19:59:14.632169] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-23T19:59:14.632247] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-23T19:59:14.633228] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-23T19:59:14.633290] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-23T19:59:14.633715] [DEBUG] [LOCAL ] MGRD: Trimmed 3503 records to 2211 (keeping 200 days of data) [2025-09-23T19:59:14.648148] [DEBUG] [LOCAL ] MGRD: Primary data saved (2211 records). [2025-09-23T19:59:14.648217] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-23T19:59:14.648306] [INFO ] [MAIN ] Update Progress: 1350/2372 symbols completed. MGRD took 26.3s. Estimated remaining: 2h 15m 39s. Rate: 7.5 symbols/min [2025-09-23T19:59:14.827896] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:14.843462] [DEBUG] [LOCAL ] MHD: Loaded 12106 existing records from primary storage. [2025-09-23T19:59:14.843597] [INFO ] [MAIN ] MHD: Loaded 12106 existing records. [2025-09-23T19:59:15.026956] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:59:15.027252] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-23T19:59:15.027303] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-23T19:59:15.027836] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-23T19:59:15.027898] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-23T19:59:15.377612] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:59:15.411349] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:15.405016] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-23T19:59:16.202250] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-23T19:59:16.415913] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:59:16.416262] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-23T19:59:17.011161] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-23T19:59:17.031209] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T19:59:17.802206] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-23T19:59:18.021411] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T19:59:18.602218] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-23T19:59:19.402172] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-23T19:59:19.528295] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:59:19.567552] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T19:59:20.067767] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T19:59:20.202191] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-23T19:59:21.002231] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-23T19:59:21.678036] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T19:59:21.802218] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-23T19:59:21.867238] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T19:59:22.005481] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:59:22.005876] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-23T19:59:22.602212] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-23T19:59:23.402187] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-23T19:59:23.602748] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:59:23.603078] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-23T19:59:24.202193] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-23T19:59:24.348514] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T19:59:24.399352] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:59:24.399703] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-23T19:59:25.002276] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-23T19:59:25.711009] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:59:25.712809] [INFO ] [REMOTE ] MGRE: Full fetch complete (9406 records). [2025-09-23T19:59:25.712909] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-23T19:59:25.807367] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-23T19:59:26.080874] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-23T19:59:26.080952] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-23T19:59:26.081174] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-23T19:59:26.081212] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-23T19:59:26.081666] [DEBUG] [LOCAL ] MGRE: Trimmed 9406 records to 6610 (keeping 200 days of data) [2025-09-23T19:59:26.123240] [DEBUG] [LOCAL ] MGRE: Primary data saved (6610 records). [2025-09-23T19:59:26.123351] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-23T19:59:26.123433] [INFO ] [MAIN ] Update Progress: 1351/2372 symbols completed. MGRE took 26.4s. Estimated remaining: 2h 15m 34s. Rate: 7.5 symbols/min [2025-09-23T19:59:26.292307] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:26.302639] [DEBUG] [LOCAL ] MHF: Loaded 8591 existing records from primary storage. [2025-09-23T19:59:26.302794] [INFO ] [MAIN ] MHF: Loaded 8591 existing records. [2025-09-23T19:59:26.477472] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:59:26.477758] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-23T19:59:26.477813] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-23T19:59:26.478191] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-23T19:59:26.478250] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-23T19:59:26.616380] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-23T19:59:26.839518] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:59:26.930498] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:27.402196] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-23T19:59:28.202199] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-23T19:59:28.741991] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-23T19:59:28.860050] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:59:28.892217] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T19:59:29.002149] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-23T19:59:29.682245] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T19:59:29.802263] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-23T19:59:30.602203] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-23T19:59:31.402218] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-23T19:59:31.511239] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T19:59:31.686582] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T19:59:32.202198] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-23T19:59:33.002226] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-23T19:59:33.110986] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T19:59:33.170002] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T19:59:33.724948] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T19:59:33.802230] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-23T19:59:34.602261] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-23T19:59:35.402219] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-23T19:59:35.417760] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T19:59:35.472418] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T19:59:36.202254] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-23T19:59:36.787575] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T19:59:36.793703] [INFO ] [REMOTE ] MH: Full fetch complete (12057 records). [2025-09-23T19:59:36.793850] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-23T19:59:36.978698] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 43 unique days, need 200 days [2025-09-23T19:59:36.978998] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:59:36.979088] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:59:36.979182] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-23T19:59:36.979264] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-23T19:59:36.979305] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-23T19:59:36.979355] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-23T19:59:36.979416] [INFO ] [MAIN ] Update Progress: 1352/2372 symbols completed. MH took 31.1s. Estimated remaining: 2h 15m 28s. Rate: 7.5 symbols/min [2025-09-23T19:59:37.010016] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-23T19:59:37.154177] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:37.197241] [DEBUG] [LOCAL ] MHK: Loaded 42556 existing records from primary storage. [2025-09-23T19:59:37.197381] [INFO ] [MAIN ] MHK: Loaded 42556 existing records. [2025-09-23T19:59:37.378725] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:59:37.378970] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-23T19:59:37.379068] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-23T19:59:37.380225] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-23T19:59:37.380289] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-23T19:59:37.747750] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:37.783021] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T19:59:37.791836] [INFO ] [REMOTE ] MGY: Full fetch complete (75522 records). [2025-09-23T19:59:37.791958] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-23T19:59:37.807384] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-23T19:59:37.872496] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T19:59:38.199130] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-23T19:59:38.199232] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-23T19:59:38.200181] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-23T19:59:38.200245] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-23T19:59:38.201669] [DEBUG] [LOCAL ] MGY: Trimmed 75522 records to 52427 (keeping 200 days of data) [2025-09-23T19:59:38.539714] [DEBUG] [LOCAL ] MGY: Primary data saved (52427 records). [2025-09-23T19:59:38.539852] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-23T19:59:38.539938] [INFO ] [MAIN ] Update Progress: 1353/2372 symbols completed. MGY took 36.6s. Estimated remaining: 2h 15m 15s. Rate: 7.5 symbols/min [2025-09-23T19:59:38.607466] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-23T19:59:38.719461] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:38.719721] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-23T19:59:38.719771] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-23T19:59:38.720116] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-23T19:59:38.720159] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-23T19:59:38.720198] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-23T19:59:38.720230] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-23T19:59:39.111063] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:39.300330] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T19:59:39.402213] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-23T19:59:39.457082] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T19:59:40.129685] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T19:59:40.202169] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-23T19:59:40.804702] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T19:59:41.002174] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-23T19:59:41.802244] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-23T19:59:41.832627] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T19:59:42.148850] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-23T19:59:42.602293] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-23T19:59:43.402167] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-23T19:59:43.447103] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T19:59:43.956075] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T19:59:44.202186] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-23T19:59:44.912235] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T19:59:45.002171] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-23T19:59:45.344523] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T19:59:45.802204] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-23T19:59:46.602239] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-23T19:59:47.257336] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T19:59:47.284065] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:59:47.402202] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-23T19:59:48.202256] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-23T19:59:48.379982] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T19:59:48.384076] [INFO ] [REMOTE ] MHD: Full fetch complete (18760 records). [2025-09-23T19:59:48.384173] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-23T19:59:48.760886] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T19:59:48.771601] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-23T19:59:48.772840] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-23T19:59:48.773271] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-23T19:59:48.773311] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-23T19:59:48.773937] [DEBUG] [LOCAL ] MHD: Trimmed 18760 records to 12118 (keeping 200 days of data) [2025-09-23T19:59:48.855465] [DEBUG] [LOCAL ] MHD: Primary data saved (12118 records). [2025-09-23T19:59:48.855616] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-23T19:59:48.855741] [INFO ] [MAIN ] Update Progress: 1354/2372 symbols completed. MHD took 34.2s. Estimated remaining: 2h 15m 9s. Rate: 7.5 symbols/min [2025-09-23T19:59:49.027618] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-23T19:59:49.031366] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:49.042189] [DEBUG] [LOCAL ] MHN: Loaded 7771 existing records from primary storage. [2025-09-23T19:59:49.042317] [INFO ] [MAIN ] MHN: Loaded 7771 existing records. [2025-09-23T19:59:49.223713] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:59:49.224012] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-23T19:59:49.224063] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-23T19:59:49.224439] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-23T19:59:49.224501] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-23T19:59:49.401309] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T19:59:49.584422] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:49.802247] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-23T19:59:50.284066] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-23T19:59:50.602201] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-23T19:59:51.182837] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T19:59:51.402203] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-23T19:59:52.202223] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-23T19:59:52.936819] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T19:59:53.002154] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-23T19:59:53.233371] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T19:59:53.235859] [INFO ] [REMOTE ] MHF: Full fetch complete (12836 records). [2025-09-23T19:59:53.235931] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-23T19:59:53.598431] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-23T19:59:53.598512] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-23T19:59:53.598857] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-23T19:59:53.598921] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-23T19:59:53.599951] [DEBUG] [LOCAL ] MHF: Trimmed 12836 records to 8663 (keeping 200 days of data) [2025-09-23T19:59:53.653243] [DEBUG] [LOCAL ] MHF: Primary data saved (8663 records). [2025-09-23T19:59:53.653380] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-23T19:59:53.653466] [INFO ] [MAIN ] Update Progress: 1355/2372 symbols completed. MHF took 27.5s. Estimated remaining: 2h 14m 59s. Rate: 7.5 symbols/min [2025-09-23T19:59:53.827774] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:53.824322] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-23T19:59:53.853589] [DEBUG] [LOCAL ] MHO: Loaded 24376 existing records from primary storage. [2025-09-23T19:59:53.853751] [INFO ] [MAIN ] MHO: Loaded 24376 existing records. [2025-09-23T19:59:54.029247] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:59:54.029507] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-23T19:59:54.029555] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-23T19:59:54.030186] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-23T19:59:54.030247] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-23T19:59:54.179201] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-23T19:59:54.412043] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:54.598921] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:59:54.607271] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-23T19:59:54.868222] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-23T19:59:55.402240] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-23T19:59:55.731078] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-23T19:59:56.202193] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-23T19:59:57.002218] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-23T19:59:57.427406] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T19:59:57.428254] [INFO ] [REMOTE ] MHLA: Full fetch complete (1550 records). [2025-09-23T19:59:57.428322] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-23T19:59:57.553765] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T19:59:57.637611] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-23T19:59:57.637823] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:59:57.637891] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:59:57.637962] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-23T19:59:57.638024] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-23T19:59:57.638062] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-23T19:59:57.638149] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-23T19:59:57.638264] [INFO ] [MAIN ] Update Progress: 1356/2372 symbols completed. MHLA took 19.1s. Estimated remaining: 2h 14m 48s. Rate: 7.5 symbols/min [2025-09-23T19:59:57.804827] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-23T19:59:57.805728] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:59:57.806042] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-23T19:59:57.806203] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-23T19:59:57.807213] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-23T19:59:57.807267] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-23T19:59:57.807329] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-23T19:59:57.807390] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-23T19:59:58.160388] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:59:58.602240] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-23T19:59:58.650119] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T19:59:59.402182] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-23T19:59:59.969552] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T20:00:00.168337] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T20:00:00.202167] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-23T20:00:01.002239] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-23T20:00:01.802208] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-23T20:00:01.858267] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T20:00:01.892236] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T20:00:02.602211] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-23T20:00:03.402198] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-23T20:00:03.992338] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:00:03.992737] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-23T20:00:04.202197] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-23T20:00:05.002209] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-23T20:00:06.054496] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:00:06.054861] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-23T20:00:06.055403] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-23T20:00:06.150516] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-23T20:00:06.321610] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:00:06.325083] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (3.72 seconds). [2025-09-23T20:00:06.325198] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-23T20:00:06.602256] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-23T20:00:06.854465] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:00:06.854847] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-23T20:00:07.333445] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-09-23T20:00:07.402249] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-23T20:00:08.202199] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-23T20:00:09.002240] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-23T20:00:09.051302] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T20:00:09.125403] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T20:00:09.207256] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:00:09.207674] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-23T20:00:09.802227] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-23T20:00:10.602242] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-23T20:00:11.306897] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T20:00:11.402204] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-23T20:00:11.611272] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:00:11.611616] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-23T20:00:11.904892] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T20:00:12.202214] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-23T20:00:13.002242] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-23T20:00:13.734299] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T20:00:13.800996] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T20:00:13.803719] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-23T20:00:14.602238] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-23T20:00:15.402198] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-23T20:00:15.573679] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T20:00:15.581271] [INFO ] [REMOTE ] MHK: Full fetch complete (60925 records). [2025-09-23T20:00:15.581466] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-23T20:00:15.646227] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:00:15.686541] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-23T20:00:15.763396] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T20:00:16.021170] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-23T20:00:16.021253] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-23T20:00:16.022289] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-23T20:00:16.022358] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-23T20:00:16.023720] [DEBUG] [LOCAL ] MHK: Trimmed 60925 records to 42523 (keeping 200 days of data) [2025-09-23T20:00:16.212635] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-23T20:00:16.302142] [DEBUG] [LOCAL ] MHK: Primary data saved (42523 records). [2025-09-23T20:00:16.302270] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-23T20:00:16.302353] [INFO ] [MAIN ] Update Progress: 1357/2372 symbols completed. MHK took 39.3s. Estimated remaining: 2h 14m 48s. Rate: 7.5 symbols/min [2025-09-23T20:00:16.463725] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:00:16.464071] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-23T20:00:17.002236] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-23T20:00:17.802169] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-23T20:00:17.946605] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T20:00:18.604601] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-23T20:00:18.607866] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T20:00:19.402182] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-23T20:00:20.202257] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-23T20:00:20.631373] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-23T20:00:20.663497] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T20:00:21.002255] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-23T20:00:21.382194] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T20:00:21.802217] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-23T20:00:22.264685] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T20:00:22.471790] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T20:00:22.482513] [INFO ] [REMOTE ] MIAX: Full fetch complete (8510 records). [2025-09-23T20:00:22.482781] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-23T20:00:22.607374] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-23T20:00:22.692154] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 28 unique days, need 200 days [2025-09-23T20:00:22.692548] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:00:22.692626] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:00:22.692730] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-23T20:00:22.692823] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-23T20:00:22.692866] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-23T20:00:22.692911] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-23T20:00:22.693004] [INFO ] [MAIN ] Update Progress: 1358/2372 symbols completed. MIAX took 25.1s. Estimated remaining: 2h 14m 39s. Rate: 7.5 symbols/min [2025-09-23T20:00:23.396596] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T20:00:23.402146] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-23T20:00:24.197008] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T20:00:24.200098] [INFO ] [REMOTE ] MHN: Full fetch complete (11930 records). [2025-09-23T20:00:24.200199] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-23T20:00:24.207412] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-23T20:00:24.579894] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-23T20:00:24.579986] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-23T20:00:24.580302] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-23T20:00:24.580341] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-23T20:00:24.581034] [DEBUG] [LOCAL ] MHN: Trimmed 11930 records to 7787 (keeping 200 days of data) [2025-09-23T20:00:24.631168] [DEBUG] [LOCAL ] MHN: Primary data saved (7787 records). [2025-09-23T20:00:24.631359] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-23T20:00:24.631468] [INFO ] [MAIN ] Update Progress: 1359/2372 symbols completed. MHN took 35.8s. Estimated remaining: 2h 14m 26s. Rate: 7.5 symbols/min [2025-09-23T20:00:25.561796] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T20:00:25.568480] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-23T20:00:26.871624] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T20:00:26.877506] [INFO ] [REMOTE ] MHO: Full fetch complete (37547 records). [2025-09-23T20:00:26.877758] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-23T20:00:27.290937] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-23T20:00:27.291054] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-23T20:00:27.291795] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-23T20:00:27.291859] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-23T20:00:27.292929] [DEBUG] [LOCAL ] MHO: Trimmed 37547 records to 24390 (keeping 200 days of data) [2025-09-23T20:00:27.446410] [DEBUG] [LOCAL ] MHO: Primary data saved (24390 records). [2025-09-23T20:00:27.446545] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-23T20:00:27.446632] [INFO ] [MAIN ] Update Progress: 1360/2372 symbols completed. MHO took 33.8s. Estimated remaining: 2h 14m 14s. Rate: 7.5 symbols/min [2025-09-23T20:00:28.063790] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:00:28.136172] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:00:28.180674] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:00:28.198457] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-23T20:00:28.200553] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:00:28.201022] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-23T20:00:28.201814] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-23T20:00:28.201877] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-23T20:00:28.201926] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-23T20:00:28.201961] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-23T20:00:28.297863] [DEBUG] [LOCAL ] MITP: Loaded 2445 existing records from primary storage. [2025-09-23T20:00:28.319758] [INFO ] [MAIN ] MITP: Loaded 2445 existing records. [2025-09-23T20:00:28.382872] [DEBUG] [LOCAL ] MIN: Loaded 13161 existing records from primary storage. [2025-09-23T20:00:28.411545] [INFO ] [MAIN ] MIN: Loaded 13161 existing records. [2025-09-23T20:00:28.756367] [DEBUG] [LOCAL ] MIR: Loaded 50819 existing records from primary storage. [2025-09-23T20:00:28.813414] [INFO ] [MAIN ] MIR: Loaded 50819 existing records. [2025-09-23T20:00:28.850725] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:00:28.994349] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-23T20:00:29.106211] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-23T20:00:29.110156] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:00:29.139863] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-23T20:00:29.122245] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-23T20:00:29.145886] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:00:29.158371] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-23T20:00:29.163922] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-23T20:00:29.163846] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-23T20:00:29.199837] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-23T20:00:29.230789] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-23T20:00:29.265503] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:00:29.323071] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-23T20:00:29.335426] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-23T20:00:29.437213] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-23T20:00:29.448118] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-23T20:00:29.693170] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T20:00:29.788878] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-23T20:00:30.247585] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:00:30.291976] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-23T20:00:30.321104] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T20:00:30.347153] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:00:30.343702] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-23T20:00:30.347620] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-23T20:00:30.434307] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:00:30.434734] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-23T20:00:30.824042] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T20:00:30.825330] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-23T20:00:30.897566] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T20:00:31.140404] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T20:00:31.151823] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T20:00:31.402223] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-23T20:00:32.127793] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T20:00:32.125862] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T20:00:32.202154] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-23T20:00:32.604142] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T20:00:33.002204] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-23T20:00:33.802271] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-23T20:00:34.353724] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T20:00:34.602274] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-23T20:00:35.339888] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-23T20:00:35.402245] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-23T20:00:35.686731] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T20:00:36.202235] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-23T20:00:36.644316] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T20:00:37.002206] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-23T20:00:37.236052] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T20:00:37.439860] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T20:00:37.802198] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-23T20:00:38.602263] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-23T20:00:39.341023] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T20:00:39.396001] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T20:00:39.406724] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-23T20:00:40.206345] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-23T20:00:40.209297] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T20:00:40.604173] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T20:00:41.002233] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-23T20:00:41.802425] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-23T20:00:42.160189] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T20:00:42.604144] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-23T20:00:42.607818] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T20:00:43.402171] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-23T20:00:43.434211] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T20:00:44.034435] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T20:00:44.202227] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-23T20:00:44.615965] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-23T20:00:45.002199] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-23T20:00:45.802197] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-23T20:00:46.234769] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T20:00:46.588538] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T20:00:46.602148] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-23T20:00:47.402217] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-23T20:00:47.970098] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T20:00:47.970913] [INFO ] [REMOTE ] MITN: Full fetch complete (2301 records). [2025-09-23T20:00:47.970983] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-23T20:00:48.155097] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T20:00:48.155405] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:00:48.155544] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:00:48.155619] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-23T20:00:48.155737] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-23T20:00:48.155794] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-23T20:00:48.155839] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-23T20:00:48.155901] [INFO ] [MAIN ] Update Progress: 1361/2372 symbols completed. MITN took 20.7s. Estimated remaining: 2h 14m 16s. Rate: 7.5 symbols/min [2025-09-23T20:00:48.209091] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-23T20:00:48.338974] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:00:48.361969] [DEBUG] [LOCAL ] MITT: Loaded 22866 existing records from primary storage. [2025-09-23T20:00:48.362225] [INFO ] [MAIN ] MITT: Loaded 22866 existing records. [2025-09-23T20:00:48.539860] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T20:00:48.592588] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T20:00:48.594331] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:00:48.597461] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-23T20:00:48.597584] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-23T20:00:48.598523] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-23T20:00:48.598588] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-23T20:00:48.976305] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:00:49.002271] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-23T20:00:49.431790] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T20:00:49.802215] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-23T20:00:50.303595] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T20:00:50.304528] [INFO ] [REMOTE ] MITP: Full fetch complete (3348 records). [2025-09-23T20:00:50.304600] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-23T20:00:50.607280] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-23T20:00:50.665734] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-23T20:00:50.665820] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-23T20:00:50.665937] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-23T20:00:50.665996] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-23T20:00:50.666528] [DEBUG] [LOCAL ] MITP: Trimmed 3348 records to 2436 (keeping 200 days of data) [2025-09-23T20:00:50.682679] [DEBUG] [LOCAL ] MITP: Primary data saved (2436 records). [2025-09-23T20:00:50.682761] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-23T20:00:50.682915] [INFO ] [MAIN ] Update Progress: 1362/2372 symbols completed. MITP took 23.2s. Estimated remaining: 2h 14m 4s. Rate: 7.5 symbols/min [2025-09-23T20:00:50.858119] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:00:50.870834] [DEBUG] [LOCAL ] MIY: Loaded 5997 existing records from primary storage. [2025-09-23T20:00:50.870960] [INFO ] [MAIN ] MIY: Loaded 5997 existing records. [2025-09-23T20:00:51.052110] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:00:51.052376] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-23T20:00:51.052450] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-23T20:00:51.052918] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-23T20:00:51.052991] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-23T20:00:51.410016] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-23T20:00:51.441289] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:00:52.054770] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T20:00:52.202188] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-23T20:00:53.002205] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-23T20:00:53.143533] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T20:00:53.363677] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T20:00:53.744927] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T20:00:53.802170] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-23T20:00:54.434744] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-23T20:00:54.602205] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-23T20:00:55.402183] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-23T20:00:55.842344] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T20:00:56.202172] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-23T20:00:56.257858] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T20:00:57.002199] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-23T20:00:57.245324] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T20:00:57.662367] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T20:00:57.802180] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-23T20:00:58.602199] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-23T20:00:59.059054] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T20:00:59.402181] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-23T20:01:00.202155] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-23T20:01:00.307769] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T20:01:00.443508] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T20:01:01.002207] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-23T20:01:01.526194] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T20:01:01.802198] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-23T20:01:02.602216] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-23T20:01:02.604090] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T20:01:02.614226] [INFO ] [REMOTE ] MIR: Full fetch complete (73405 records). [2025-09-23T20:01:02.614461] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-23T20:01:02.675001] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T20:01:03.073174] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-23T20:01:03.073275] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-23T20:01:03.074265] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-23T20:01:03.074363] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-23T20:01:03.081613] [DEBUG] [LOCAL ] MIR: Trimmed 73405 records to 50832 (keeping 200 days of data) [2025-09-23T20:01:03.402566] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-23T20:01:03.406165] [DEBUG] [LOCAL ] MIR: Primary data saved (50832 records). [2025-09-23T20:01:03.406286] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-23T20:01:03.406529] [INFO ] [MAIN ] Update Progress: 1363/2372 symbols completed. MIR took 36.0s. Estimated remaining: 2h 13m 60s. Rate: 7.5 symbols/min [2025-09-23T20:01:03.597208] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:01:03.619747] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T20:01:03.663281] [DEBUG] [LOCAL ] MKC: Loaded 52437 existing records from primary storage. [2025-09-23T20:01:03.663435] [INFO ] [MAIN ] MKC: Loaded 52437 existing records. [2025-09-23T20:01:03.851478] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:01:03.851912] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-23T20:01:03.851981] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-23T20:01:03.853669] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-23T20:01:03.853748] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-23T20:01:04.212795] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-23T20:01:04.234316] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:01:04.452696] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T20:01:05.002197] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-23T20:01:05.148778] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T20:01:05.152891] [INFO ] [REMOTE ] MIN: Full fetch complete (17847 records). [2025-09-23T20:01:05.153053] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-23T20:01:05.576977] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-23T20:01:05.577092] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-23T20:01:05.577636] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-23T20:01:05.577749] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-23T20:01:05.578881] [DEBUG] [LOCAL ] MIN: Trimmed 17847 records to 13122 (keeping 200 days of data) [2025-09-23T20:01:05.686987] [DEBUG] [LOCAL ] MIN: Primary data saved (13122 records). [2025-09-23T20:01:05.687178] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-23T20:01:05.687345] [INFO ] [MAIN ] Update Progress: 1364/2372 symbols completed. MIN took 38.2s. Estimated remaining: 2h 13m 47s. Rate: 7.5 symbols/min [2025-09-23T20:01:05.807365] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-23T20:01:05.865711] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:01:05.909620] [DEBUG] [LOCAL ] MKL: Loaded 34159 existing records from primary storage. [2025-09-23T20:01:05.909804] [INFO ] [MAIN ] MKL: Loaded 34159 existing records. [2025-09-23T20:01:06.111056] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:01:06.111355] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-23T20:01:06.111419] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-23T20:01:06.112815] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-23T20:01:06.112890] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-23T20:01:06.514358] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:01:06.602207] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-23T20:01:06.620007] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T20:01:06.670191] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T20:01:07.402253] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-23T20:01:07.820376] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T20:01:07.990021] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T20:01:08.202220] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-23T20:01:09.002222] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-23T20:01:09.269590] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T20:01:09.802233] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-23T20:01:10.141031] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T20:01:10.602183] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-23T20:01:11.402206] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-23T20:01:11.671360] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-23T20:01:11.757904] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T20:01:12.118706] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T20:01:12.202195] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-23T20:01:12.824155] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T20:01:13.002240] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-23T20:01:13.802218] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-23T20:01:14.064817] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T20:01:14.602211] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-23T20:01:15.359334] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T20:01:15.402144] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-23T20:01:15.427244] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T20:01:15.433846] [INFO ] [REMOTE ] MITT: Full fetch complete (34949 records). [2025-09-23T20:01:15.434100] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-23T20:01:15.819787] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-23T20:01:15.819880] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-23T20:01:15.820522] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-23T20:01:15.820568] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-23T20:01:15.821414] [DEBUG] [LOCAL ] MITT: Trimmed 34949 records to 22872 (keeping 200 days of data) [2025-09-23T20:01:15.972425] [DEBUG] [LOCAL ] MITT: Primary data saved (22872 records). [2025-09-23T20:01:15.972562] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-23T20:01:15.972698] [INFO ] [MAIN ] Update Progress: 1365/2372 symbols completed. MITT took 27.8s. Estimated remaining: 2h 13m 41s. Rate: 7.5 symbols/min [2025-09-23T20:01:16.143396] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:01:16.199635] [DEBUG] [LOCAL ] MLI: Loaded 43864 existing records from primary storage. [2025-09-23T20:01:16.199814] [INFO ] [MAIN ] MLI: Loaded 43864 existing records. [2025-09-23T20:01:16.211144] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-23T20:01:16.382954] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:01:16.383297] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-23T20:01:16.383350] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-23T20:01:16.385109] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-23T20:01:16.385175] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-23T20:01:16.771510] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:01:17.002248] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-23T20:01:17.189777] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T20:01:17.757032] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T20:01:17.802236] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-23T20:01:18.395258] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T20:01:18.602227] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-23T20:01:19.111125] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T20:01:19.402212] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-23T20:01:20.158883] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T20:01:20.202185] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-23T20:01:20.288456] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T20:01:21.002240] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-23T20:01:21.631492] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T20:01:21.802199] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-23T20:01:22.449708] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T20:01:22.581501] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T20:01:22.602164] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-23T20:01:23.213254] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T20:01:23.402231] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-23T20:01:24.202200] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-23T20:01:25.002209] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-23T20:01:25.205285] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T20:01:25.802221] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-23T20:01:25.937282] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T20:01:26.009920] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T20:01:26.602262] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-23T20:01:27.402235] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-23T20:01:27.636240] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T20:01:28.161933] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T20:01:28.164292] [INFO ] [REMOTE ] MIY: Full fetch complete (9068 records). [2025-09-23T20:01:28.164402] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-23T20:01:28.204843] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-23T20:01:28.363804] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T20:01:28.763288] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-23T20:01:28.763377] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-23T20:01:28.763672] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-23T20:01:28.763734] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-23T20:01:28.764216] [DEBUG] [LOCAL ] MIY: Trimmed 9068 records to 5983 (keeping 200 days of data) [2025-09-23T20:01:28.803333] [DEBUG] [LOCAL ] MIY: Primary data saved (5983 records). [2025-09-23T20:01:28.803455] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-23T20:01:28.803691] [INFO ] [MAIN ] Update Progress: 1366/2372 symbols completed. MIY took 38.1s. Estimated remaining: 2h 13m 37s. Rate: 7.5 symbols/min [2025-09-23T20:01:28.970240] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:01:29.002235] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-23T20:01:29.029159] [DEBUG] [LOCAL ] MLM: Loaded 31033 existing records from primary storage. [2025-09-23T20:01:29.029302] [INFO ] [MAIN ] MLM: Loaded 31033 existing records. [2025-09-23T20:01:29.206468] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:01:29.206759] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-23T20:01:29.206811] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-23T20:01:29.207941] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-23T20:01:29.208002] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-23T20:01:29.562222] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:01:29.802204] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-23T20:01:30.133385] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T20:01:30.389073] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T20:01:30.602254] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-23T20:01:31.265523] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T20:01:31.402222] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-23T20:01:32.202261] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-23T20:01:32.476931] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T20:01:32.681611] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T20:01:33.002202] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-23T20:01:33.211247] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T20:01:33.802218] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-23T20:01:34.174902] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T20:01:34.602273] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-23T20:01:35.333423] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T20:01:35.402237] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-23T20:01:36.202221] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-23T20:01:36.261692] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T20:01:36.371273] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T20:01:36.376872] [INFO ] [REMOTE ] MKL: Full fetch complete (49616 records). [2025-09-23T20:01:36.377001] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-23T20:01:36.765808] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-23T20:01:36.765894] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-23T20:01:36.766785] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-23T20:01:36.766850] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-23T20:01:36.767941] [DEBUG] [LOCAL ] MKL: Trimmed 49616 records to 34101 (keeping 200 days of data) [2025-09-23T20:01:36.986924] [DEBUG] [LOCAL ] MKL: Primary data saved (34101 records). [2025-09-23T20:01:36.987077] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-23T20:01:36.987168] [INFO ] [MAIN ] Update Progress: 1367/2372 symbols completed. MKL took 31.3s. Estimated remaining: 2h 13m 29s. Rate: 7.5 symbols/min [2025-09-23T20:01:37.008725] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-23T20:01:37.169613] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:01:37.195908] [DEBUG] [LOCAL ] MLNK: Loaded 25620 existing records from primary storage. [2025-09-23T20:01:37.196052] [INFO ] [MAIN ] MLNK: Loaded 25620 existing records. [2025-09-23T20:01:37.377124] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:01:37.377459] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-23T20:01:37.377514] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-23T20:01:37.378218] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-23T20:01:37.378280] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-23T20:01:37.752281] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:01:37.802189] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-23T20:01:38.111165] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-23T20:01:38.458618] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T20:01:38.554013] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T20:01:38.602231] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-23T20:01:39.402198] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-23T20:01:40.207568] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-23T20:01:40.218035] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T20:01:41.002188] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-23T20:01:41.323943] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-23T20:01:41.332927] [INFO ] [REMOTE ] MKC: Full fetch complete (75486 records). [2025-09-23T20:01:41.333096] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-23T20:01:41.773140] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-23T20:01:41.773263] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-23T20:01:41.774479] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-23T20:01:41.774626] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-23T20:01:41.776339] [DEBUG] [LOCAL ] MKC: Trimmed 75486 records to 52433 (keeping 200 days of data) [2025-09-23T20:01:41.838370] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-23T20:01:41.936802] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T20:01:42.078179] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T20:01:42.175797] [DEBUG] [LOCAL ] MKC: Primary data saved (52433 records). [2025-09-23T20:01:42.175972] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-23T20:01:42.176086] [INFO ] [MAIN ] Update Progress: 1368/2372 symbols completed. MKC took 38.8s. Estimated remaining: 2h 13m 19s. Rate: 7.5 symbols/min [2025-09-23T20:01:42.354075] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:01:42.358955] [DEBUG] [LOCAL ] MLP: Loaded 3049 existing records from primary storage. [2025-09-23T20:01:42.359074] [INFO ] [MAIN ] MLP: Loaded 3049 existing records. [2025-09-23T20:01:42.553423] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:01:42.553802] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-23T20:01:42.553858] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-23T20:01:42.554070] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-23T20:01:42.554133] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-23T20:01:42.607345] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-23T20:01:43.069064] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:01:43.088959] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T20:01:43.402237] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-23T20:01:43.982148] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T20:01:44.202203] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-23T20:01:44.292819] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T20:01:45.002199] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-23T20:01:45.162567] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T20:01:45.802195] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-23T20:01:46.185375] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T20:01:46.427266] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T20:01:46.434630] [INFO ] [REMOTE ] MLI: Full fetch complete (63623 records). [2025-09-23T20:01:46.434805] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-23T20:01:46.612604] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-23T20:01:46.830068] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-23T20:01:46.830160] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-23T20:01:46.831037] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-23T20:01:46.831102] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-23T20:01:46.832431] [DEBUG] [LOCAL ] MLI: Trimmed 63623 records to 43850 (keeping 200 days of data) [2025-09-23T20:01:47.123446] [DEBUG] [LOCAL ] MLI: Primary data saved (43850 records). [2025-09-23T20:01:47.123593] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-23T20:01:47.123704] [INFO ] [MAIN ] Update Progress: 1369/2372 symbols completed. MLI took 31.2s. Estimated remaining: 2h 13m 9s. Rate: 7.5 symbols/min [2025-09-23T20:01:47.234189] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T20:01:47.313562] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:01:47.328617] [DEBUG] [LOCAL ] MLR: Loaded 13064 existing records from primary storage. [2025-09-23T20:01:47.328780] [INFO ] [MAIN ] MLR: Loaded 13064 existing records. [2025-09-23T20:01:47.407521] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-23T20:01:47.518970] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:01:47.519316] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-23T20:01:47.519382] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-23T20:01:47.519940] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-23T20:01:47.520002] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-23T20:01:47.901341] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:01:48.202226] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-23T20:01:48.426290] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T20:01:49.002202] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-23T20:01:49.023785] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T20:01:49.802169] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-23T20:01:50.132790] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T20:01:50.266369] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T20:01:50.602221] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-23T20:01:51.227292] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-23T20:01:51.402216] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-23T20:01:52.202208] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-23T20:01:52.773793] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T20:01:52.794596] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T20:01:53.002186] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-23T20:01:53.802197] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-23T20:01:54.366510] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T20:01:54.371306] [INFO ] [REMOTE ] MLM: Full fetch complete (45727 records). [2025-09-23T20:01:54.371410] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-23T20:01:54.612561] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-23T20:01:54.786814] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-23T20:01:54.787403] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T20:01:54.787505] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-23T20:01:54.793865] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-23T20:01:54.793933] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-23T20:01:54.795207] [DEBUG] [LOCAL ] MLM: Trimmed 45727 records to 30849 (keeping 200 days of data) [2025-09-23T20:01:54.995589] [DEBUG] [LOCAL ] MLM: Primary data saved (30849 records). [2025-09-23T20:01:54.995761] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-23T20:01:54.998043] [INFO ] [MAIN ] Update Progress: 1370/2372 symbols completed. MLM took 26.2s. Estimated remaining: 2h 13m 1s. Rate: 7.5 symbols/min [2025-09-23T20:01:55.173729] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:01:55.233744] [DEBUG] [LOCAL ] MMC: Loaded 51805 existing records from primary storage. [2025-09-23T20:01:55.233888] [INFO ] [MAIN ] MMC: Loaded 51805 existing records. [2025-09-23T20:01:55.341532] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T20:01:55.406024] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-23T20:01:55.428759] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:01:55.429715] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-23T20:01:55.429770] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-23T20:01:55.430972] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-23T20:01:55.431034] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-23T20:01:55.801257] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:01:55.873499] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T20:01:56.202206] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-23T20:01:56.762817] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T20:01:57.002263] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-23T20:01:57.802206] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-23T20:01:58.144352] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T20:01:58.602200] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-23T20:01:59.072007] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T20:01:59.402204] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-23T20:01:59.560028] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T20:02:00.202224] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-23T20:02:00.260436] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T20:02:01.002201] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-23T20:02:01.802187] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-23T20:02:01.998883] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T20:02:02.022094] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T20:02:02.590180] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T20:02:02.591399] [INFO ] [REMOTE ] MLP: Full fetch complete (4643 records). [2025-09-23T20:02:02.591467] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-23T20:02:02.612101] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-23T20:02:02.946482] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-23T20:02:02.946560] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-23T20:02:02.946714] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-23T20:02:02.946774] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-23T20:02:02.947133] [DEBUG] [LOCAL ] MLP: Trimmed 4643 records to 3085 (keeping 200 days of data) [2025-09-23T20:02:02.964826] [DEBUG] [LOCAL ] MLP: Primary data saved (3085 records). [2025-09-23T20:02:02.964892] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-23T20:02:02.964961] [INFO ] [MAIN ] Update Progress: 1371/2372 symbols completed. MLP took 20.8s. Estimated remaining: 2h 12m 53s. Rate: 7.5 symbols/min [2025-09-23T20:02:03.131780] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:02:03.144035] [DEBUG] [LOCAL ] MMD: Loaded 11103 existing records from primary storage. [2025-09-23T20:02:03.144135] [INFO ] [MAIN ] MMD: Loaded 11103 existing records. [2025-09-23T20:02:03.324541] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:02:03.324815] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-23T20:02:03.324865] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-23T20:02:03.325295] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-23T20:02:03.325356] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-23T20:02:03.407443] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-23T20:02:03.682225] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:02:04.202155] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-23T20:02:04.484419] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T20:02:04.550144] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T20:02:05.002227] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-23T20:02:05.240605] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T20:02:05.795979] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T20:02:05.802143] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-23T20:02:06.602202] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-23T20:02:07.042536] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T20:02:07.107395] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T20:02:07.402228] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-23T20:02:08.202172] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-23T20:02:08.519730] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T20:02:09.002233] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-23T20:02:09.136982] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T20:02:09.802210] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-23T20:02:10.602217] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-23T20:02:10.712372] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T20:02:10.990007] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T20:02:11.402235] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-23T20:02:11.750915] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T20:02:12.209897] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-23T20:02:12.211581] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T20:02:13.002204] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-23T20:02:13.802185] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-23T20:02:13.946672] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T20:02:14.117221] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T20:02:14.602255] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-23T20:02:15.103022] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T20:02:15.108843] [INFO ] [REMOTE ] MLNK: Full fetch complete (35808 records). [2025-09-23T20:02:15.108963] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-23T20:02:15.412380] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-23T20:02:15.507888] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-23T20:02:15.507970] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-23T20:02:15.508628] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-23T20:02:15.508709] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-23T20:02:15.509610] [DEBUG] [LOCAL ] MLNK: Trimmed 35808 records to 25677 (keeping 200 days of data) [2025-09-23T20:02:15.669708] [DEBUG] [LOCAL ] MLNK: Primary data saved (25677 records). [2025-09-23T20:02:15.669854] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-23T20:02:15.669943] [INFO ] [MAIN ] Update Progress: 1372/2372 symbols completed. MLNK took 38.7s. Estimated remaining: 2h 12m 48s. Rate: 7.5 symbols/min [2025-09-23T20:02:15.845569] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:02:15.863516] [DEBUG] [LOCAL ] MMI: Loaded 15311 existing records from primary storage. [2025-09-23T20:02:15.863885] [INFO ] [MAIN ] MMI: Loaded 15311 existing records. [2025-09-23T20:02:16.057303] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:02:16.057550] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-23T20:02:16.057597] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-23T20:02:16.058134] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-23T20:02:16.058196] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-23T20:02:16.234771] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-23T20:02:16.440517] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:02:16.449440] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T20:02:16.482944] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T20:02:17.002204] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-23T20:02:17.464159] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T20:02:17.467154] [INFO ] [REMOTE ] MLR: Full fetch complete (18602 records). [2025-09-23T20:02:17.467231] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-23T20:02:17.816018] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-23T20:02:17.868197] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-23T20:02:17.868290] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-23T20:02:17.868763] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-23T20:02:17.868825] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-23T20:02:17.869552] [DEBUG] [LOCAL ] MLR: Trimmed 18602 records to 12929 (keeping 200 days of data) [2025-09-23T20:02:17.951952] [DEBUG] [LOCAL ] MLR: Primary data saved (12929 records). [2025-09-23T20:02:17.952115] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-23T20:02:17.952204] [INFO ] [MAIN ] Update Progress: 1373/2372 symbols completed. MLR took 30.8s. Estimated remaining: 2h 12m 36s. Rate: 7.5 symbols/min [2025-09-23T20:02:18.139113] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:02:18.139294] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-23T20:02:18.139332] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-23T20:02:18.139484] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-23T20:02:18.139551] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-23T20:02:18.139639] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-23T20:02:18.139718] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-23T20:02:18.515585] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:02:18.602177] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-23T20:02:18.703367] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T20:02:18.702877] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T20:02:18.903284] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-23T20:02:19.402236] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-23T20:02:20.202254] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-23T20:02:20.264074] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T20:02:21.002247] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-23T20:02:21.802214] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-23T20:02:21.953082] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T20:02:22.083792] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T20:02:22.410304] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T20:02:22.602194] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-23T20:02:23.402193] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-23T20:02:23.577880] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T20:02:23.897922] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T20:02:24.202200] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-23T20:02:24.945987] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T20:02:25.002245] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-23T20:02:25.802231] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-23T20:02:25.930593] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T20:02:26.298977] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T20:02:26.602262] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-23T20:02:27.402185] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-23T20:02:28.202182] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-23T20:02:28.320786] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T20:02:28.436354] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T20:02:28.497105] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-23T20:02:29.002192] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-23T20:02:29.802179] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-23T20:02:29.955113] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T20:02:30.550948] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T20:02:30.602328] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-23T20:02:31.402235] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-23T20:02:32.202165] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-23T20:02:32.323536] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T20:02:32.373533] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T20:02:32.382347] [INFO ] [REMOTE ] MMC: Full fetch complete (74681 records). [2025-09-23T20:02:32.382488] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-23T20:02:32.493173] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-23T20:02:32.802095] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-23T20:02:32.802244] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-23T20:02:32.803263] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-23T20:02:32.803327] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-23T20:02:32.804840] [DEBUG] [LOCAL ] MMC: Trimmed 74681 records to 51808 (keeping 200 days of data) [2025-09-23T20:02:33.002609] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-23T20:02:33.172389] [DEBUG] [LOCAL ] MMC: Primary data saved (51808 records). [2025-09-23T20:02:33.172570] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-23T20:02:33.174713] [INFO ] [MAIN ] Update Progress: 1374/2372 symbols completed. MMC took 38.2s. Estimated remaining: 2h 12m 33s. Rate: 7.5 symbols/min [2025-09-23T20:02:33.379359] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:02:33.437872] [DEBUG] [LOCAL ] MMM: Loaded 53259 existing records from primary storage. [2025-09-23T20:02:33.438087] [INFO ] [MAIN ] MMM: Loaded 53259 existing records. [2025-09-23T20:02:33.630700] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:02:33.630999] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-23T20:02:33.631060] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-23T20:02:33.633118] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-23T20:02:33.633185] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-23T20:02:33.817030] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-23T20:02:34.028378] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:02:34.038758] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T20:02:34.602162] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-23T20:02:34.715591] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T20:02:34.718007] [INFO ] [REMOTE ] MMD: Full fetch complete (18078 records). [2025-09-23T20:02:34.718087] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-23T20:02:35.093679] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-23T20:02:35.093799] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-23T20:02:35.094285] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-23T20:02:35.094336] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-23T20:02:35.095295] [DEBUG] [LOCAL ] MMD: Trimmed 18078 records to 11144 (keeping 200 days of data) [2025-09-23T20:02:35.171757] [DEBUG] [LOCAL ] MMD: Primary data saved (11144 records). [2025-09-23T20:02:35.171907] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-23T20:02:35.171994] [INFO ] [MAIN ] Update Progress: 1375/2372 symbols completed. MMD took 32.2s. Estimated remaining: 2h 12m 21s. Rate: 7.5 symbols/min [2025-09-23T20:02:35.368244] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:02:35.369703] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T20:02:35.407327] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-23T20:02:35.410213] [DEBUG] [LOCAL ] MMS: Loaded 34017 existing records from primary storage. [2025-09-23T20:02:35.410323] [INFO ] [MAIN ] MMS: Loaded 34017 existing records. [2025-09-23T20:02:35.607308] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:02:35.607569] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-23T20:02:35.607618] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-23T20:02:35.608746] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-23T20:02:35.608816] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-23T20:02:35.989079] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:02:36.202217] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-23T20:02:37.002232] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-23T20:02:37.517308] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T20:02:37.521700] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-23T20:02:37.766909] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T20:02:37.802193] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-23T20:02:38.602259] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-23T20:02:39.297288] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T20:02:39.402275] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-23T20:02:40.202197] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-23T20:02:40.305692] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T20:02:40.470096] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-23T20:02:40.583672] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-23T20:02:41.002211] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-23T20:02:41.802231] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-23T20:02:41.974310] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T20:02:41.977294] [INFO ] [REMOTE ] MMI: Full fetch complete (20928 records). [2025-09-23T20:02:41.977435] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-23T20:02:42.372684] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-23T20:02:42.372785] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-23T20:02:42.373246] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-23T20:02:42.373290] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-23T20:02:42.374089] [DEBUG] [LOCAL ] MMI: Trimmed 20928 records to 15328 (keeping 200 days of data) [2025-09-23T20:02:42.481567] [DEBUG] [LOCAL ] MMI: Primary data saved (15328 records). [2025-09-23T20:02:42.481787] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-23T20:02:42.481895] [INFO ] [MAIN ] Update Progress: 1376/2372 symbols completed. MMI took 26.8s. Estimated remaining: 2h 12m 13s. Rate: 7.5 symbols/min [2025-09-23T20:02:42.605394] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-23T20:02:42.714940] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:02:42.728459] [DEBUG] [LOCAL ] MMT: Loaded 11071 existing records from primary storage. [2025-09-23T20:02:42.728576] [INFO ] [MAIN ] MMT: Loaded 11071 existing records. [2025-09-23T20:02:42.919256] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:02:42.919551] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-23T20:02:42.919600] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-23T20:02:42.920170] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-23T20:02:42.920232] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-23T20:02:43.316475] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:02:43.379808] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T20:02:43.402155] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-23T20:02:44.202208] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-23T20:02:44.432794] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T20:02:44.495904] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-23T20:02:44.499909] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T20:02:45.002216] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-23T20:02:45.802231] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-23T20:02:46.602234] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-23T20:02:46.659929] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T20:02:46.929427] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T20:02:47.402209] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-23T20:02:47.721308] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T20:02:48.128516] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T20:02:48.202205] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-23T20:02:49.002209] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-23T20:02:49.424024] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T20:02:49.802160] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-23T20:02:50.283399] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-23T20:02:50.602213] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-23T20:02:51.065208] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T20:02:51.402194] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-23T20:02:52.139102] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T20:02:52.207674] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-23T20:02:52.216968] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T20:02:53.002209] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-23T20:02:53.502600] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T20:02:53.503447] [INFO ] [REMOTE ] MMKT: Full fetch complete (2133 records). [2025-09-23T20:02:53.503538] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-23T20:02:53.700043] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T20:02:53.700244] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:02:53.700313] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:02:53.700383] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-23T20:02:53.700475] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-23T20:02:53.700533] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-23T20:02:53.700578] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-23T20:02:53.700664] [INFO ] [MAIN ] Update Progress: 1377/2372 symbols completed. MMKT took 35.7s. Estimated remaining: 2h 12m 7s. Rate: 7.5 symbols/min [2025-09-23T20:02:53.807698] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-23T20:02:53.906189] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:02:53.929508] [DEBUG] [LOCAL ] MMU: Loaded 17018 existing records from primary storage. [2025-09-23T20:02:53.929699] [INFO ] [MAIN ] MMU: Loaded 17018 existing records. [2025-09-23T20:02:54.120729] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:02:54.121330] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-23T20:02:54.121441] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-23T20:02:54.122156] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-23T20:02:54.122584] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-23T20:02:54.267344] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-23T20:02:54.565203] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:02:54.602203] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-23T20:02:55.336053] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T20:02:55.402243] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-23T20:02:55.608335] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T20:02:56.202326] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-23T20:02:56.202253] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T20:02:57.002237] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-23T20:02:57.802211] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-23T20:02:57.989112] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T20:02:58.272232] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T20:02:58.344258] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T20:02:58.602205] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-23T20:02:59.402226] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-23T20:02:59.635318] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T20:03:00.082040] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T20:03:00.202201] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-23T20:03:01.002203] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-23T20:03:01.802188] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-23T20:03:02.088599] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T20:03:02.124016] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T20:03:02.602436] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-23T20:03:03.402204] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-23T20:03:04.157680] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-23T20:03:04.202164] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-23T20:03:05.002214] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-23T20:03:05.421470] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T20:03:05.608494] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-09-23T20:03:05.802227] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-23T20:03:05.938828] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T20:03:05.951398] [INFO ] [REMOTE ] MMS: Full fetch complete (52280 records). [2025-09-23T20:03:05.951762] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-23T20:03:06.362416] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T20:03:06.362181] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-23T20:03:06.365287] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-23T20:03:06.366876] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-23T20:03:06.367004] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-23T20:03:06.368162] [DEBUG] [LOCAL ] MMS: Trimmed 52280 records to 33982 (keeping 200 days of data) [2025-09-23T20:03:06.592092] [DEBUG] [LOCAL ] MMS: Primary data saved (33982 records). [2025-09-23T20:03:06.592248] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-23T20:03:06.592389] [INFO ] [MAIN ] Update Progress: 1378/2372 symbols completed. MMS took 31.4s. Estimated remaining: 2h 12m 3s. Rate: 7.5 symbols/min [2025-09-23T20:03:06.607399] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-23T20:03:06.781388] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:03:06.809313] [DEBUG] [LOCAL ] MNR: Loaded 24727 existing records from primary storage. [2025-09-23T20:03:06.809447] [INFO ] [MAIN ] MNR: Loaded 24727 existing records. [2025-09-23T20:03:06.994188] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:03:06.994550] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-23T20:03:06.994714] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-23T20:03:06.995445] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-23T20:03:06.995527] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-23T20:03:07.321360] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-23T20:03:07.405591] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:03:07.405700] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-23T20:03:07.412336] [INFO ] [REMOTE ] MMM: Full fetch complete (77161 records). [2025-09-23T20:03:07.412541] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-23T20:03:07.606283] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T20:03:07.905128] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-23T20:03:07.905285] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-23T20:03:07.904970] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T20:03:07.906481] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-23T20:03:07.909587] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-23T20:03:07.915707] [DEBUG] [LOCAL ] MMM: Trimmed 77161 records to 53253 (keeping 200 days of data) [2025-09-23T20:03:08.203028] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-23T20:03:08.294183] [DEBUG] [LOCAL ] MMM: Primary data saved (53253 records). [2025-09-23T20:03:08.294424] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-23T20:03:08.295388] [INFO ] [MAIN ] Update Progress: 1379/2372 symbols completed. MMM took 35.1s. Estimated remaining: 2h 11m 50s. Rate: 7.5 symbols/min [2025-09-23T20:03:08.470420] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:03:08.524693] [DEBUG] [LOCAL ] MNSO: Loaded 44431 existing records from primary storage. [2025-09-23T20:03:08.524853] [INFO ] [MAIN ] MNSO: Loaded 44431 existing records. [2025-09-23T20:03:08.709450] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:03:08.709819] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-23T20:03:08.709880] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-23T20:03:08.711439] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-23T20:03:08.711501] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-23T20:03:09.006208] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-23T20:03:09.028221] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T20:03:09.115930] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:03:09.802215] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-23T20:03:09.967752] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T20:03:10.602214] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-23T20:03:10.670244] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T20:03:11.402189] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-23T20:03:11.517622] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T20:03:12.202212] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-23T20:03:12.996922] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T20:03:13.002136] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-23T20:03:13.035014] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T20:03:13.776815] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T20:03:13.778867] [INFO ] [REMOTE ] MMT: Full fetch complete (16405 records). [2025-09-23T20:03:13.778940] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-23T20:03:13.809136] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-23T20:03:14.170457] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-23T20:03:14.170678] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-23T20:03:14.171113] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-23T20:03:14.171156] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-23T20:03:14.171919] [DEBUG] [LOCAL ] MMT: Trimmed 16405 records to 11029 (keeping 200 days of data) [2025-09-23T20:03:14.250561] [DEBUG] [LOCAL ] MMT: Primary data saved (11029 records). [2025-09-23T20:03:14.250746] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-23T20:03:14.250880] [INFO ] [MAIN ] Update Progress: 1380/2372 symbols completed. MMT took 31.8s. Estimated remaining: 2h 11m 41s. Rate: 7.5 symbols/min [2025-09-23T20:03:14.435017] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:03:14.435273] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-23T20:03:14.435329] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-23T20:03:14.435489] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-23T20:03:14.435532] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-23T20:03:14.435573] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-23T20:03:14.435605] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-23T20:03:14.612066] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-23T20:03:14.849770] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:03:15.402190] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-23T20:03:15.448023] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T20:03:15.496066] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T20:03:16.202239] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-23T20:03:16.327866] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T20:03:17.002221] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-23T20:03:17.771914] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T20:03:17.802183] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-23T20:03:18.402466] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T20:03:18.406466] [INFO ] [REMOTE ] MMU: Full fetch complete (25770 records). [2025-09-23T20:03:18.406618] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-23T20:03:18.476197] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:03:18.493619] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-23T20:03:18.607343] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-23T20:03:18.819410] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-23T20:03:18.819772] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-23T20:03:18.820425] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-23T20:03:18.820488] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-23T20:03:18.821198] [DEBUG] [LOCAL ] MMU: Trimmed 25770 records to 16994 (keeping 200 days of data) [2025-09-23T20:03:18.946023] [DEBUG] [LOCAL ] MMU: Primary data saved (16994 records). [2025-09-23T20:03:18.946181] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-23T20:03:18.946357] [INFO ] [MAIN ] Update Progress: 1381/2372 symbols completed. MMU took 25.2s. Estimated remaining: 2h 11m 30s. Rate: 7.5 symbols/min [2025-09-23T20:03:19.049629] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:03:19.055781] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-23T20:03:19.122031] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:03:19.122226] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-23T20:03:19.122281] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-23T20:03:19.122429] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-23T20:03:19.122473] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-23T20:03:19.122515] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-23T20:03:19.122548] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-23T20:03:19.407373] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-23T20:03:19.493174] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:03:19.652526] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:03:19.652894] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-23T20:03:20.202228] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-23T20:03:21.002222] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-23T20:03:21.219718] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:03:21.220046] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-23T20:03:21.411951] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T20:03:21.802220] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-23T20:03:21.995310] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:03:21.995693] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-23T20:03:22.602233] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-23T20:03:23.402216] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-23T20:03:23.520789] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T20:03:24.202209] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-23T20:03:25.002163] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-23T20:03:25.134845] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T20:03:25.279783] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T20:03:25.802231] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-23T20:03:26.602382] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-23T20:03:27.346938] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-23T20:03:27.402143] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-23T20:03:27.506900] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T20:03:28.087158] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T20:03:28.202201] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-23T20:03:29.002269] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-23T20:03:29.584346] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-23T20:03:29.726441] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T20:03:29.802167] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-23T20:03:29.894607] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T20:03:30.602237] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-23T20:03:31.402284] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-23T20:03:31.736297] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T20:03:31.935462] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T20:03:32.202234] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-23T20:03:32.609591] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T20:03:33.002196] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-23T20:03:33.791316] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T20:03:33.802135] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-23T20:03:34.602193] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-23T20:03:35.262425] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-23T20:03:35.406702] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-23T20:03:35.409937] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T20:03:35.474271] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T20:03:36.202193] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-23T20:03:37.002190] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-23T20:03:37.158572] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T20:03:37.224730] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T20:03:37.232301] [INFO ] [REMOTE ] MNTN: Full fetch complete (24642 records). [2025-09-23T20:03:37.232427] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-23T20:03:37.435567] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 85 unique days, need 200 days [2025-09-23T20:03:37.436067] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:03:37.436157] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:03:37.436239] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-23T20:03:37.436319] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-23T20:03:37.436371] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-23T20:03:37.436464] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-23T20:03:37.436605] [INFO ] [MAIN ] Update Progress: 1382/2372 symbols completed. MNTN took 23.2s. Estimated remaining: 2h 11m 30s. Rate: 7.5 symbols/min [2025-09-23T20:03:37.619344] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:03:37.679015] [DEBUG] [LOCAL ] MOD: Loaded 45647 existing records from primary storage. [2025-09-23T20:03:37.679224] [INFO ] [MAIN ] MOD: Loaded 45647 existing records. [2025-09-23T20:03:37.807367] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-23T20:03:37.882078] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:03:37.882532] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-23T20:03:37.882594] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-23T20:03:37.884347] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-23T20:03:37.884429] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-23T20:03:38.263800] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:03:38.602182] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-23T20:03:38.773794] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T20:03:38.978035] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T20:03:39.402308] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-23T20:03:40.202194] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-23T20:03:40.386630] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T20:03:41.002220] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-23T20:03:41.656893] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T20:03:41.724811] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T20:03:41.802194] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-23T20:03:42.122577] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T20:03:42.602214] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-23T20:03:43.402188] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-23T20:03:44.202192] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-23T20:03:44.569250] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T20:03:44.573446] [INFO ] [REMOTE ] MNR: Full fetch complete (37126 records). [2025-09-23T20:03:44.573548] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-23T20:03:44.717291] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-09-23T20:03:45.047957] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-23T20:03:45.063289] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-23T20:03:45.063415] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-23T20:03:45.064140] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-23T20:03:45.064272] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-23T20:03:45.065541] [DEBUG] [LOCAL ] MNR: Trimmed 37126 records to 24702 (keeping 200 days of data) [2025-09-23T20:03:45.184548] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-23T20:03:45.259394] [DEBUG] [LOCAL ] MNR: Primary data saved (24702 records). [2025-09-23T20:03:45.259582] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-23T20:03:45.259703] [INFO ] [MAIN ] Update Progress: 1383/2372 symbols completed. MNR took 38.7s. Estimated remaining: 2h 11m 22s. Rate: 7.5 symbols/min [2025-09-23T20:03:45.439180] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:03:45.493540] [DEBUG] [LOCAL ] MODG: Loaded 51622 existing records from primary storage. [2025-09-23T20:03:45.493707] [INFO ] [MAIN ] MODG: Loaded 51622 existing records. [2025-09-23T20:03:45.661166] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T20:03:45.701920] [INFO ] [REMOTE ] MNSO: Full fetch complete (64273 records). [2025-09-23T20:03:45.706096] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-23T20:03:45.705974] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:03:45.706491] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-23T20:03:45.706633] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-23T20:03:45.739413] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-23T20:03:45.763804] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-23T20:03:45.810631] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-23T20:03:46.480681] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-23T20:03:46.481784] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-23T20:03:46.499362] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-23T20:03:46.506792] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-23T20:03:46.506708] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:03:46.508524] [DEBUG] [LOCAL ] MNSO: Trimmed 64273 records to 44382 (keeping 200 days of data) [2025-09-23T20:03:46.602712] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-23T20:03:46.793906] [DEBUG] [LOCAL ] MNSO: Primary data saved (44382 records). [2025-09-23T20:03:46.794072] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-23T20:03:46.794166] [INFO ] [MAIN ] Update Progress: 1384/2372 symbols completed. MNSO took 38.5s. Estimated remaining: 2h 11m 9s. Rate: 7.5 symbols/min [2025-09-23T20:03:46.972367] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:03:47.001094] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T20:03:47.048931] [DEBUG] [LOCAL ] MOH: Loaded 41736 existing records from primary storage. [2025-09-23T20:03:47.049084] [INFO ] [MAIN ] MOH: Loaded 41736 existing records. [2025-09-23T20:03:47.225199] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:03:47.225433] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-23T20:03:47.225486] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-23T20:03:47.226833] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-23T20:03:47.226898] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-23T20:03:47.408446] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-23T20:03:47.586898] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:03:47.870958] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T20:03:48.202247] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-23T20:03:48.238430] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T20:03:48.986136] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T20:03:49.002170] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-23T20:03:49.345562] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T20:03:49.802280] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-23T20:03:50.602156] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-23T20:03:50.697630] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T20:03:50.764619] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T20:03:51.402207] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-23T20:03:52.202219] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-23T20:03:52.831786] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-23T20:03:53.002185] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-23T20:03:53.059197] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T20:03:53.493308] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T20:03:53.802225] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-23T20:03:54.602232] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-23T20:03:55.244502] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-23T20:03:55.254092] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-23T20:03:55.254343] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-23T20:03:55.405842] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-23T20:03:55.487294] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T20:03:55.488266] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:03:55.488364] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:03:55.488584] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-23T20:03:55.488795] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-23T20:03:55.489060] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-23T20:03:55.489146] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-23T20:03:55.502809] [INFO ] [MAIN ] Update Progress: 1385/2372 symbols completed. MO took 36.6s. Estimated remaining: 2h 11m 2s. Rate: 7.5 symbols/min [2025-09-23T20:03:55.588180] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T20:03:55.716144] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:03:55.781013] [DEBUG] [LOCAL ] MOS: Loaded 53506 existing records from primary storage. [2025-09-23T20:03:55.781172] [INFO ] [MAIN ] MOS: Loaded 53506 existing records. [2025-09-23T20:03:55.973711] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:03:55.974051] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-23T20:03:55.974103] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-23T20:03:55.975481] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-23T20:03:55.975544] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-23T20:03:56.210057] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-23T20:03:56.363446] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T20:03:56.394474] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:03:57.002183] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-23T20:03:57.239872] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T20:03:57.481515] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T20:03:57.802258] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-23T20:03:58.527690] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T20:03:58.602254] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-23T20:03:59.239996] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T20:03:59.402178] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-23T20:04:00.202222] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-23T20:04:00.462277] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T20:04:00.978834] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T20:04:01.002199] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-23T20:04:01.802203] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-23T20:04:01.867319] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T20:04:02.602200] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-23T20:04:02.975494] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T20:04:03.402243] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-23T20:04:03.530212] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T20:04:04.202252] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-23T20:04:04.379698] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T20:04:04.387787] [INFO ] [REMOTE ] MOD: Full fetch complete (66172 records). [2025-09-23T20:04:04.388006] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-23T20:04:04.824573] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-23T20:04:04.824795] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-23T20:04:04.826128] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-23T20:04:04.826271] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-23T20:04:04.828205] [DEBUG] [LOCAL ] MOD: Trimmed 66172 records to 45597 (keeping 200 days of data) [2025-09-23T20:04:04.975202] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T20:04:05.004875] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-23T20:04:05.173964] [DEBUG] [LOCAL ] MOD: Primary data saved (45597 records). [2025-09-23T20:04:05.174316] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-23T20:04:05.174408] [INFO ] [MAIN ] Update Progress: 1386/2372 symbols completed. MOD took 27.7s. Estimated remaining: 2h 10m 55s. Rate: 7.5 symbols/min [2025-09-23T20:04:05.346581] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:04:05.370175] [DEBUG] [LOCAL ] MOV: Loaded 22254 existing records from primary storage. [2025-09-23T20:04:05.370349] [INFO ] [MAIN ] MOV: Loaded 22254 existing records. [2025-09-23T20:04:05.557044] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:04:05.557329] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-23T20:04:05.557378] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-23T20:04:05.558191] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-23T20:04:05.558255] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-23T20:04:05.807324] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-23T20:04:05.936731] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:04:05.975870] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T20:04:06.602288] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-23T20:04:06.865329] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T20:04:07.402246] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-23T20:04:07.653611] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-23T20:04:08.181163] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T20:04:08.202167] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-23T20:04:08.749093] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T20:04:08.757886] [INFO ] [REMOTE ] MOH: Full fetch complete (58119 records). [2025-09-23T20:04:08.758074] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-23T20:04:09.009949] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-23T20:04:09.180287] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-23T20:04:09.180382] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-23T20:04:09.181283] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-23T20:04:09.181350] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-23T20:04:09.182698] [DEBUG] [LOCAL ] MOH: Trimmed 58119 records to 41771 (keeping 200 days of data) [2025-09-23T20:04:09.434284] [DEBUG] [LOCAL ] MOH: Primary data saved (41771 records). [2025-09-23T20:04:09.434423] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-23T20:04:09.434510] [INFO ] [MAIN ] Update Progress: 1387/2372 symbols completed. MOH took 22.6s. Estimated remaining: 2h 10m 45s. Rate: 7.5 symbols/min [2025-09-23T20:04:09.616167] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:04:09.672578] [DEBUG] [LOCAL ] MP: Loaded 53662 existing records from primary storage. [2025-09-23T20:04:09.672780] [INFO ] [MAIN ] MP: Loaded 53662 existing records. [2025-09-23T20:04:09.807298] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-23T20:04:09.880175] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:04:09.880424] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-23T20:04:09.880472] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-23T20:04:09.881742] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-23T20:04:09.881806] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-23T20:04:10.282609] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:04:10.296111] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T20:04:10.333424] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-23T20:04:10.602234] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-23T20:04:11.402178] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-23T20:04:11.509743] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T20:04:11.607076] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T20:04:12.202214] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-23T20:04:13.002265] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-23T20:04:13.359098] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T20:04:13.802232] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-23T20:04:14.116206] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-23T20:04:14.171491] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T20:04:14.602210] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-23T20:04:15.402169] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-23T20:04:15.538983] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T20:04:15.600876] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T20:04:16.202242] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-23T20:04:17.002229] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-23T20:04:17.417393] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T20:04:17.802197] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-23T20:04:18.061854] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T20:04:18.142993] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T20:04:18.602225] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-23T20:04:19.402182] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-23T20:04:19.642367] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T20:04:20.202186] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-23T20:04:20.398550] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T20:04:20.932703] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T20:04:21.002213] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-23T20:04:21.691176] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T20:04:21.802171] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-23T20:04:21.840179] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T20:04:22.602191] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-23T20:04:23.402180] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-23T20:04:23.553282] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T20:04:23.991865] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T20:04:24.169371] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T20:04:24.202283] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-23T20:04:25.002261] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-23T20:04:25.802198] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-23T20:04:26.039312] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T20:04:26.049944] [INFO ] [REMOTE ] MODG: Full fetch complete (74721 records). [2025-09-23T20:04:26.050102] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-23T20:04:26.451170] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-23T20:04:26.451315] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-23T20:04:26.452307] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-23T20:04:26.452373] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-23T20:04:26.453838] [DEBUG] [LOCAL ] MODG: Trimmed 74721 records to 51574 (keeping 200 days of data) [2025-09-23T20:04:26.618913] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-23T20:04:26.757610] [DEBUG] [LOCAL ] MODG: Primary data saved (51574 records). [2025-09-23T20:04:26.757774] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-23T20:04:26.757864] [INFO ] [MAIN ] Update Progress: 1388/2372 symbols completed. MODG took 41.5s. Estimated remaining: 2h 10m 43s. Rate: 7.5 symbols/min [2025-09-23T20:04:26.874484] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T20:04:26.951195] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:04:26.975949] [DEBUG] [LOCAL ] MPA: Loaded 5242 existing records from primary storage. [2025-09-23T20:04:26.992707] [INFO ] [MAIN ] MPA: Loaded 5242 existing records. [2025-09-23T20:04:27.065824] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T20:04:27.191154] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:04:27.191533] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-23T20:04:27.191594] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-23T20:04:27.192105] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-23T20:04:27.192170] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-23T20:04:27.410290] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-23T20:04:27.546501] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:04:28.202161] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-23T20:04:28.391240] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T20:04:28.400177] [INFO ] [REMOTE ] MOS: Full fetch complete (77449 records). [2025-09-23T20:04:28.400303] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-23T20:04:28.824715] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-23T20:04:28.825816] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-23T20:04:28.827343] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-23T20:04:28.827448] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-23T20:04:28.826206] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T20:04:28.831473] [DEBUG] [LOCAL ] MOS: Trimmed 77449 records to 53506 (keeping 200 days of data) [2025-09-23T20:04:29.016625] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-23T20:04:29.170057] [DEBUG] [LOCAL ] MOS: Primary data saved (53506 records). [2025-09-23T20:04:29.170197] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-23T20:04:29.170280] [INFO ] [MAIN ] Update Progress: 1389/2372 symbols completed. MOS took 33.7s. Estimated remaining: 2h 10m 31s. Rate: 7.5 symbols/min [2025-09-23T20:04:29.339378] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:04:29.394687] [DEBUG] [LOCAL ] MPC: Loaded 52129 existing records from primary storage. [2025-09-23T20:04:29.394827] [INFO ] [MAIN ] MPC: Loaded 52129 existing records. [2025-09-23T20:04:29.573238] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:04:29.573630] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-23T20:04:29.573715] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-23T20:04:29.574961] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-23T20:04:29.575022] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-23T20:04:29.815449] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-23T20:04:29.937530] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:04:29.968420] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-23T20:04:30.038467] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T20:04:30.143782] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T20:04:30.602195] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-23T20:04:31.402209] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-23T20:04:32.202216] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-23T20:04:32.802838] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-23T20:04:32.855884] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T20:04:33.002386] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-23T20:04:33.275734] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T20:04:33.802200] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-23T20:04:34.602196] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-23T20:04:35.265839] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T20:04:35.281802] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-23T20:04:35.349002] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T20:04:35.402195] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-23T20:04:36.150825] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T20:04:36.202220] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-23T20:04:37.002204] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-23T20:04:37.802205] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-23T20:04:37.989478] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T20:04:38.042562] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T20:04:38.046631] [INFO ] [REMOTE ] MOV: Full fetch complete (30739 records). [2025-09-23T20:04:38.046780] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-23T20:04:38.422770] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-23T20:04:38.422859] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-23T20:04:38.423456] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-23T20:04:38.423497] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-23T20:04:38.424295] [DEBUG] [LOCAL ] MOV: Trimmed 30739 records to 22219 (keeping 200 days of data) [2025-09-23T20:04:38.585081] [DEBUG] [LOCAL ] MOV: Primary data saved (22219 records). [2025-09-23T20:04:38.585251] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-23T20:04:38.585387] [INFO ] [MAIN ] Update Progress: 1390/2372 symbols completed. MOV took 33.4s. Estimated remaining: 2h 10m 24s. Rate: 7.5 symbols/min [2025-09-23T20:04:38.609266] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-23T20:04:38.773057] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:04:38.826793] [DEBUG] [LOCAL ] MPLX: Loaded 50758 existing records from primary storage. [2025-09-23T20:04:38.826970] [INFO ] [MAIN ] MPLX: Loaded 50758 existing records. [2025-09-23T20:04:39.005385] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:04:39.005694] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-23T20:04:39.005753] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-23T20:04:39.006937] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-23T20:04:39.007000] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-23T20:04:39.377277] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:04:39.402156] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-23T20:04:40.202232] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-23T20:04:40.500228] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-23T20:04:40.559911] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-23T20:04:40.839114] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T20:04:41.002205] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-23T20:04:41.474182] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T20:04:41.660167] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T20:04:41.802196] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-23T20:04:42.602237] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-23T20:04:43.231266] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T20:04:43.402177] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-23T20:04:43.520082] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T20:04:44.202196] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-23T20:04:45.002177] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-23T20:04:45.310188] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T20:04:45.409970] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T20:04:45.802213] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-23T20:04:46.551861] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T20:04:46.602162] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-23T20:04:47.241855] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T20:04:47.243350] [INFO ] [REMOTE ] MPA: Full fetch complete (7090 records). [2025-09-23T20:04:47.243422] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-23T20:04:47.407425] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-23T20:04:47.647353] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-23T20:04:47.647582] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-23T20:04:47.647981] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-23T20:04:47.648091] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-23T20:04:47.649441] [DEBUG] [LOCAL ] MPA: Trimmed 7090 records to 5226 (keeping 200 days of data) [2025-09-23T20:04:47.716984] [DEBUG] [LOCAL ] MPA: Primary data saved (5226 records). [2025-09-23T20:04:47.720684] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-23T20:04:47.720947] [INFO ] [MAIN ] Update Progress: 1391/2372 symbols completed. MPA took 21.0s. Estimated remaining: 2h 10m 17s. Rate: 7.5 symbols/min [2025-09-23T20:04:47.771570] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-23T20:04:47.924300] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:04:47.934174] [DEBUG] [LOCAL ] MPV: Loaded 5174 existing records from primary storage. [2025-09-23T20:04:47.934305] [INFO ] [MAIN ] MPV: Loaded 5174 existing records. [2025-09-23T20:04:48.118442] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:04:48.118763] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-23T20:04:48.118831] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-23T20:04:48.119149] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-23T20:04:48.119219] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-23T20:04:48.211519] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-23T20:04:48.546699] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:04:49.002188] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-23T20:04:49.332795] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T20:04:49.802250] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-23T20:04:50.204378] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-23T20:04:50.602247] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-23T20:04:50.686494] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-23T20:04:50.715798] [INFO ] [REMOTE ] MP: Full fetch complete (77298 records). [2025-09-23T20:04:50.726698] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-23T20:04:50.764553] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T20:04:51.155222] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-23T20:04:51.155342] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-23T20:04:51.156448] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-23T20:04:51.156570] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-23T20:04:51.161355] [DEBUG] [LOCAL ] MP: Trimmed 77298 records to 53663 (keeping 200 days of data) [2025-09-23T20:04:51.402316] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-23T20:04:51.504217] [DEBUG] [LOCAL ] MP: Primary data saved (53663 records). [2025-09-23T20:04:51.504365] [INFO ] [MAIN ] MP: Full history saved. [2025-09-23T20:04:51.504487] [INFO ] [MAIN ] Update Progress: 1392/2372 symbols completed. MP took 42.1s. Estimated remaining: 2h 10m 6s. Rate: 7.5 symbols/min [2025-09-23T20:04:51.671122] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:04:51.742834] [DEBUG] [LOCAL ] MPW: Loaded 53504 existing records from primary storage. [2025-09-23T20:04:51.743058] [INFO ] [MAIN ] MPW: Loaded 53504 existing records. [2025-09-23T20:04:51.927886] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:04:51.928223] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-23T20:04:51.928294] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-23T20:04:51.929609] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-23T20:04:51.929769] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-23T20:04:52.218126] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-23T20:04:52.310042] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:04:52.432545] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T20:04:52.897706] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T20:04:53.002202] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-23T20:04:53.478558] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-23T20:04:53.697397] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T20:04:53.802250] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-23T20:04:54.553157] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T20:04:54.602235] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-23T20:04:55.268557] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-23T20:04:55.402264] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-23T20:04:56.006863] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T20:04:56.202229] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-23T20:04:57.002253] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-23T20:04:57.610448] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T20:04:57.802204] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-23T20:04:58.002415] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T20:04:58.143871] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-23T20:04:58.602198] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-23T20:04:59.402214] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-23T20:05:00.024077] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T20:05:00.202225] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-23T20:05:00.291673] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T20:05:01.002233] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-23T20:05:01.737149] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T20:05:01.740455] [INFO ] [REMOTE ] MPV: Full fetch complete (8058 records). [2025-09-23T20:05:01.740680] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-23T20:05:01.809564] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-23T20:05:02.162067] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-23T20:05:02.162346] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-23T20:05:02.162834] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-23T20:05:02.162922] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-23T20:05:02.163740] [DEBUG] [LOCAL ] MPV: Trimmed 8058 records to 5142 (keeping 200 days of data) [2025-09-23T20:05:02.232534] [DEBUG] [LOCAL ] MPV: Primary data saved (5142 records). [2025-09-23T20:05:02.234849] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-23T20:05:02.247261] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-23T20:05:02.247738] [INFO ] [MAIN ] Update Progress: 1393/2372 symbols completed. MPV took 14.5s. Estimated remaining: 2h 10m 0s. Rate: 7.5 symbols/min [2025-09-23T20:05:02.429737] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:05:02.440788] [DEBUG] [LOCAL ] MPX: Loaded 4229 existing records from primary storage. [2025-09-23T20:05:02.440919] [INFO ] [MAIN ] MPX: Loaded 4229 existing records. [2025-09-23T20:05:02.605124] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-23T20:05:02.628394] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:05:02.629604] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-23T20:05:02.629693] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-23T20:05:02.629971] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-23T20:05:02.630047] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-23T20:05:03.004664] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:05:03.402183] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-23T20:05:03.692760] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T20:05:03.938067] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T20:05:04.202247] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-23T20:05:05.002205] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-23T20:05:05.349191] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T20:05:05.802168] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-23T20:05:05.991691] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T20:05:06.277199] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T20:05:06.602236] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-23T20:05:07.328837] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T20:05:07.410632] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-23T20:05:07.432633] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T20:05:08.202209] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-23T20:05:08.829171] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-23T20:05:09.002210] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-23T20:05:09.193709] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T20:05:09.202923] [INFO ] [REMOTE ] MPC: Full fetch complete (75894 records). [2025-09-23T20:05:09.203063] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-23T20:05:09.632595] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-23T20:05:09.632762] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-23T20:05:09.633882] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-23T20:05:09.633953] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-23T20:05:09.635734] [DEBUG] [LOCAL ] MPC: Trimmed 75894 records to 52130 (keeping 200 days of data) [2025-09-23T20:05:09.716390] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T20:05:09.855864] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-23T20:05:10.018004] [DEBUG] [LOCAL ] MPC: Primary data saved (52130 records). [2025-09-23T20:05:10.018158] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-23T20:05:10.020174] [INFO ] [MAIN ] Update Progress: 1394/2372 symbols completed. MPC took 40.8s. Estimated remaining: 2h 9m 52s. Rate: 7.5 symbols/min [2025-09-23T20:05:10.208429] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:05:10.226502] [DEBUG] [LOCAL ] MQT: Loaded 8375 existing records from primary storage. [2025-09-23T20:05:10.226636] [INFO ] [MAIN ] MQT: Loaded 8375 existing records. [2025-09-23T20:05:10.418793] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:05:10.419131] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-23T20:05:10.419190] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-23T20:05:10.420206] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-23T20:05:10.420295] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-23T20:05:10.540502] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T20:05:10.612434] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-23T20:05:10.809353] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:05:11.368319] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T20:05:11.402202] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-23T20:05:12.202195] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-23T20:05:13.007311] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-23T20:05:13.016112] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T20:05:13.599523] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T20:05:13.633958] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-23T20:05:13.802201] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-23T20:05:14.582921] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T20:05:14.602151] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-23T20:05:15.381042] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T20:05:15.402204] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-23T20:05:16.155217] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T20:05:16.202163] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-23T20:05:17.002289] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-23T20:05:17.140289] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T20:05:17.802265] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-23T20:05:18.231207] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T20:05:18.602220] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-23T20:05:18.819034] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T20:05:18.828890] [INFO ] [REMOTE ] MPLX: Full fetch complete (73981 records). [2025-09-23T20:05:18.829070] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-23T20:05:19.225982] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-23T20:05:19.226075] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-23T20:05:19.227036] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-23T20:05:19.227115] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-23T20:05:19.228623] [DEBUG] [LOCAL ] MPLX: Trimmed 73981 records to 50738 (keeping 200 days of data) [2025-09-23T20:05:19.411552] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-23T20:05:19.552251] [DEBUG] [LOCAL ] MPLX: Primary data saved (50738 records). [2025-09-23T20:05:19.552409] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-23T20:05:19.552533] [INFO ] [MAIN ] Update Progress: 1395/2372 symbols completed. MPLX took 41.0s. Estimated remaining: 2h 9m 45s. Rate: 7.5 symbols/min [2025-09-23T20:05:19.728494] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:05:19.750052] [DEBUG] [LOCAL ] MQY: Loaded 16777 existing records from primary storage. [2025-09-23T20:05:19.750201] [INFO ] [MAIN ] MQY: Loaded 16777 existing records. [2025-09-23T20:05:19.954235] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:05:19.954590] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-23T20:05:19.954756] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-23T20:05:19.955583] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-23T20:05:19.955704] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-23T20:05:20.069811] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T20:05:20.202246] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-23T20:05:20.345027] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:05:20.543375] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T20:05:20.647343] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-23T20:05:21.002239] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-23T20:05:21.802240] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-23T20:05:22.096294] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T20:05:22.404015] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T20:05:22.602223] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-23T20:05:23.402215] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-23T20:05:24.202236] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-23T20:05:24.476627] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T20:05:24.534414] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T20:05:24.782888] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T20:05:25.002220] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-23T20:05:25.700777] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T20:05:25.802191] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-23T20:05:26.519362] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T20:05:26.602197] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-23T20:05:27.342326] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T20:05:27.345745] [INFO ] [REMOTE ] MQT: Full fetch complete (13290 records). [2025-09-23T20:05:27.345881] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-23T20:05:27.408814] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-23T20:05:27.730892] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-23T20:05:27.730971] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-23T20:05:27.731307] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-23T20:05:27.731346] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-23T20:05:27.731860] [DEBUG] [LOCAL ] MQT: Trimmed 13290 records to 8399 (keeping 200 days of data) [2025-09-23T20:05:27.782025] [DEBUG] [LOCAL ] MQT: Primary data saved (8399 records). [2025-09-23T20:05:27.782149] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-23T20:05:27.782231] [INFO ] [MAIN ] Update Progress: 1396/2372 symbols completed. MQT took 17.8s. Estimated remaining: 2h 9m 38s. Rate: 7.5 symbols/min [2025-09-23T20:05:27.949363] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:05:27.994125] [DEBUG] [LOCAL ] MRC: Loaded 37550 existing records from primary storage. [2025-09-23T20:05:27.994316] [INFO ] [MAIN ] MRC: Loaded 37550 existing records. [2025-09-23T20:05:28.173865] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:05:28.174148] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-23T20:05:28.174224] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-23T20:05:28.175220] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-23T20:05:28.175285] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-23T20:05:28.207312] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-23T20:05:28.561227] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T20:05:28.567335] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:05:28.715296] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T20:05:28.716508] [INFO ] [REMOTE ] MPX: Full fetch complete (6841 records). [2025-09-23T20:05:28.716581] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-23T20:05:29.007331] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-23T20:05:29.083330] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-23T20:05:29.083403] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-23T20:05:29.083585] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-23T20:05:29.083623] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-23T20:05:29.084040] [DEBUG] [LOCAL ] MPX: Trimmed 6841 records to 4195 (keeping 200 days of data) [2025-09-23T20:05:29.111948] [DEBUG] [LOCAL ] MPX: Primary data saved (4195 records). [2025-09-23T20:05:29.112052] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-23T20:05:29.112136] [INFO ] [MAIN ] Update Progress: 1397/2372 symbols completed. MPX took 26.9s. Estimated remaining: 2h 9m 25s. Rate: 7.5 symbols/min [2025-09-23T20:05:29.802237] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-23T20:05:30.069230] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T20:05:30.602246] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-23T20:05:31.402223] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-23T20:05:31.459375] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T20:05:31.632947] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T20:05:32.202251] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-23T20:05:32.730492] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T20:05:33.002200] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-23T20:05:33.802166] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-23T20:05:34.021058] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T20:05:34.093620] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T20:05:34.602269] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-23T20:05:35.192797] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T20:05:35.216576] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T20:05:35.402206] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-23T20:05:36.202175] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-23T20:05:36.430169] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T20:05:37.002194] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-23T20:05:37.413002] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T20:05:37.802181] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-23T20:05:38.061605] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T20:05:38.602211] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-23T20:05:39.402216] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-23T20:05:39.546294] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T20:05:40.061324] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T20:05:40.202180] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-23T20:05:40.233017] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T20:05:40.236796] [INFO ] [REMOTE ] MQY: Full fetch complete (27166 records). [2025-09-23T20:05:40.236874] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-23T20:05:40.628581] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-23T20:05:40.628689] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-23T20:05:40.629245] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-23T20:05:40.629287] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-23T20:05:40.629961] [DEBUG] [LOCAL ] MQY: Trimmed 27166 records to 16742 (keeping 200 days of data) [2025-09-23T20:05:40.731906] [DEBUG] [LOCAL ] MQY: Primary data saved (16742 records). [2025-09-23T20:05:40.732040] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-23T20:05:40.732125] [INFO ] [MAIN ] Update Progress: 1398/2372 symbols completed. MQY took 21.2s. Estimated remaining: 2h 9m 20s. Rate: 7.5 symbols/min [2025-09-23T20:05:41.002183] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-23T20:05:42.249567] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-23T20:05:42.259624] [INFO ] [REMOTE ] MPW: Full fetch complete (77530 records). [2025-09-23T20:05:42.259884] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-23T20:05:42.722735] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T20:05:42.751845] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-23T20:05:42.752681] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-23T20:05:42.753921] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-23T20:05:42.754013] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-23T20:05:42.754721] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-23T20:05:42.757125] [DEBUG] [LOCAL ] MPW: Trimmed 77530 records to 53506 (keeping 200 days of data) [2025-09-23T20:05:43.075033] [DEBUG] [LOCAL ] MPW: Primary data saved (53506 records). [2025-09-23T20:05:43.075215] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-23T20:05:43.075310] [INFO ] [MAIN ] Update Progress: 1399/2372 symbols completed. MPW took 51.6s. Estimated remaining: 2h 9m 8s. Rate: 7.5 symbols/min [2025-09-23T20:05:43.998755] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T20:05:44.006893] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-23T20:05:45.316504] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T20:05:45.324073] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-23T20:05:46.900286] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T20:05:46.910363] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-23T20:05:48.289446] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T20:05:48.300872] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-23T20:05:49.711588] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T20:05:49.717934] [INFO ] [REMOTE ] MRC: Full fetch complete (54469 records). [2025-09-23T20:05:49.718043] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-23T20:05:50.107821] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-23T20:05:50.107947] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-23T20:05:50.108868] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-23T20:05:50.108938] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-23T20:05:50.110136] [DEBUG] [LOCAL ] MRC: Trimmed 54469 records to 37580 (keeping 200 days of data) [2025-09-23T20:05:50.333822] [DEBUG] [LOCAL ] MRC: Primary data saved (37580 records). [2025-09-23T20:05:50.333977] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-23T20:05:50.334096] [INFO ] [MAIN ] Update Progress: 1400/2372 symbols completed. MRC took 22.6s. Estimated remaining: 2h 8m 59s. Rate: 7.5 symbols/min [2025-09-23T20:05:50.908332] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:05:51.017723] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:05:51.060919] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:05:51.057540] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:05:51.061571] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-23T20:05:51.061638] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-23T20:05:51.062099] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-23T20:05:51.062165] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-23T20:05:51.062349] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-23T20:05:51.062406] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-23T20:05:51.252892] [DEBUG] [LOCAL ] MSA: Loaded 18724 existing records from primary storage. [2025-09-23T20:05:51.267772] [INFO ] [MAIN ] MSA: Loaded 18724 existing records. [2025-09-23T20:05:51.649708] [DEBUG] [LOCAL ] MS: Loaded 53693 existing records from primary storage. [2025-09-23T20:05:51.672254] [INFO ] [MAIN ] MS: Loaded 53693 existing records. [2025-09-23T20:05:51.693403] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-23T20:05:51.785391] [INFO ] [MAIN ] MRK: Loaded 53789 existing records. [2025-09-23T20:05:51.775583] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:05:51.923466] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:05:51.933218] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-23T20:05:51.964251] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-23T20:05:51.990128] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-23T20:05:52.019932] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-23T20:05:52.020352] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-23T20:05:52.222109] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:05:52.252990] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-23T20:05:52.276420] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-23T20:05:52.293875] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:05:52.294514] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-23T20:05:52.294990] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-23T20:05:52.294704] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:05:52.295988] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-23T20:05:52.301617] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-23T20:05:52.301818] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-23T20:05:52.301913] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-23T20:05:52.351480] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-23T20:05:52.414092] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-23T20:05:52.592586] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:05:52.682378] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-23T20:05:52.718374] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-23T20:05:52.909811] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:05:52.978945] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-23T20:05:53.292771] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:05:53.308557] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-23T20:05:53.313934] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:05:53.314245] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-23T20:05:54.125149] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T20:05:54.129265] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-23T20:05:54.341597] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T20:05:54.349585] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-23T20:05:54.770772] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T20:05:54.774077] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-23T20:05:55.079177] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T20:05:55.093231] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-23T20:05:55.210261] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T20:05:55.221104] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-23T20:05:55.630545] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T20:05:55.641361] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-23T20:05:55.783055] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T20:05:55.786915] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-23T20:05:56.669393] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T20:05:56.673618] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-23T20:05:56.874857] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T20:05:57.002303] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-23T20:05:57.251330] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-23T20:05:57.333742] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T20:05:57.600419] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T20:05:57.802208] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-23T20:05:58.602273] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-23T20:05:59.031085] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-23T20:05:59.275163] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T20:05:59.407303] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-23T20:05:59.429689] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T20:06:00.202246] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-23T20:06:01.002184] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-23T20:06:01.256000] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T20:06:01.457105] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-23T20:06:01.802235] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-23T20:06:02.602205] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-23T20:06:03.402293] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-23T20:06:03.672904] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-23T20:06:04.202269] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-23T20:06:05.947999] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-23T20:06:05.958259] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-23T20:06:06.097877] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (3.50 seconds). [2025-09-23T20:06:06.104133] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-23T20:06:06.279367] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T20:06:06.343678] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (4.54 seconds). [2025-09-23T20:06:06.602193] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-23T20:06:06.864055] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T20:06:07.402209] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-23T20:06:08.077893] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-23T20:06:08.202205] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-23T20:06:08.631103] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T20:06:08.634679] [INFO ] [REMOTE ] MSA: Full fetch complete (25708 records). [2025-09-23T20:06:08.634768] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-23T20:06:08.908472] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T20:06:09.010748] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-23T20:06:09.118493] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-23T20:06:09.118591] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-23T20:06:09.119407] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-23T20:06:09.119475] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-23T20:06:09.120357] [DEBUG] [LOCAL ] MSA: Trimmed 25708 records to 18742 (keeping 200 days of data) [2025-09-23T20:06:09.258217] [DEBUG] [LOCAL ] MSA: Primary data saved (18742 records). [2025-09-23T20:06:09.258410] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-23T20:06:09.258526] [INFO ] [MAIN ] Update Progress: 1401/2372 symbols completed. MSA took 18.9s. Estimated remaining: 2h 8m 59s. Rate: 7.5 symbols/min [2025-09-23T20:06:09.449458] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:06:09.459668] [DEBUG] [LOCAL ] MSB: Loaded 7852 existing records from primary storage. [2025-09-23T20:06:09.459791] [INFO ] [MAIN ] MSB: Loaded 7852 existing records. [2025-09-23T20:06:09.670246] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:06:09.674860] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-23T20:06:09.674940] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-23T20:06:09.677386] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-23T20:06:09.677310] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T20:06:09.691994] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-23T20:06:09.807398] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-23T20:06:10.052711] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:06:10.602218] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-23T20:06:11.204622] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-23T20:06:11.258366] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T20:06:11.402158] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-23T20:06:11.514407] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T20:06:11.522507] [INFO ] [REMOTE ] MRP: Full fetch complete (54254 records). [2025-09-23T20:06:11.522708] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-23T20:06:11.726545] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 157 unique days, need 200 days [2025-09-23T20:06:11.727206] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:06:11.727278] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:06:11.727327] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-23T20:06:11.727393] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-23T20:06:11.727436] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-23T20:06:11.727492] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-23T20:06:11.727611] [INFO ] [MAIN ] Update Progress: 1402/2372 symbols completed. MRP took 21.4s. Estimated remaining: 2h 8m 47s. Rate: 7.5 symbols/min [2025-09-23T20:06:11.910011] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:06:11.910224] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-23T20:06:11.910279] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-23T20:06:11.910432] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-23T20:06:11.910475] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-23T20:06:11.910519] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-23T20:06:11.910552] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-23T20:06:12.207348] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-23T20:06:12.298228] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:06:13.002248] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-23T20:06:13.802252] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-23T20:06:14.724385] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T20:06:14.728550] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-23T20:06:15.000052] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (3.60 seconds). [2025-09-23T20:06:15.402216] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-23T20:06:15.910179] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-23T20:06:15.970561] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (3.76 seconds). [2025-09-23T20:06:16.202159] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-23T20:06:16.353660] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T20:06:16.685151] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T20:06:17.002229] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-23T20:06:17.479634] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T20:06:17.802178] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-23T20:06:17.888600] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-23T20:06:18.165713] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-23T20:06:18.602199] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-23T20:06:19.402195] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-23T20:06:20.202219] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-23T20:06:20.622234] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-23T20:06:20.631332] [INFO ] [REMOTE ] MRK: Full fetch complete (77857 records). [2025-09-23T20:06:20.631476] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-23T20:06:20.791716] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T20:06:21.008432] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-23T20:06:21.070581] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-23T20:06:21.070737] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-23T20:06:21.071914] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-23T20:06:21.072042] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-23T20:06:21.074056] [DEBUG] [LOCAL ] MRK: Trimmed 77857 records to 53789 (keeping 200 days of data) [2025-09-23T20:06:21.208293] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T20:06:21.484021] [DEBUG] [LOCAL ] MRK: Primary data saved (53789 records). [2025-09-23T20:06:21.484207] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-23T20:06:21.485368] [INFO ] [MAIN ] Update Progress: 1403/2372 symbols completed. MRK took 31.2s. Estimated remaining: 2h 8m 40s. Rate: 7.5 symbols/min [2025-09-23T20:06:21.659372] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:06:21.699790] [DEBUG] [LOCAL ] MSCI: Loaded 34854 existing records from primary storage. [2025-09-23T20:06:21.700021] [INFO ] [MAIN ] MSCI: Loaded 34854 existing records. [2025-09-23T20:06:21.803036] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-23T20:06:21.889567] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:06:21.896599] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T20:06:21.898889] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-23T20:06:21.899593] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-23T20:06:21.901444] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-23T20:06:21.901511] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-23T20:06:22.252886] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:06:22.256416] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T20:06:22.602224] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-23T20:06:23.402228] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-23T20:06:24.016717] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T20:06:24.202190] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-23T20:06:25.002211] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-23T20:06:25.211664] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T20:06:25.270255] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-23T20:06:25.307225] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T20:06:25.802215] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-23T20:06:26.211095] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T20:06:26.602240] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-23T20:06:27.040480] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T20:06:27.402293] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-23T20:06:28.202221] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-23T20:06:28.546745] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-23T20:06:29.002207] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-23T20:06:29.425501] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T20:06:29.642471] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T20:06:29.643635] [INFO ] [REMOTE ] MSC: Full fetch complete (2491 records). [2025-09-23T20:06:29.643733] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-23T20:06:29.807448] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-23T20:06:29.852532] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-23T20:06:29.852833] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:06:29.852903] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:06:29.853013] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-23T20:06:29.853091] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-23T20:06:29.853130] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-23T20:06:29.853188] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-23T20:06:29.853297] [INFO ] [MAIN ] Update Progress: 1404/2372 symbols completed. MSC took 18.1s. Estimated remaining: 2h 8m 33s. Rate: 7.5 symbols/min [2025-09-23T20:06:30.040116] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:06:30.056460] [DEBUG] [LOCAL ] MSD: Loaded 15603 existing records from primary storage. [2025-09-23T20:06:30.056630] [INFO ] [MAIN ] MSD: Loaded 15603 existing records. [2025-09-23T20:06:30.232040] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:06:30.232387] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-23T20:06:30.232444] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-23T20:06:30.233119] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-23T20:06:30.233182] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-23T20:06:30.598633] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:06:30.603682] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-23T20:06:30.606959] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T20:06:31.402197] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-23T20:06:32.014621] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T20:06:32.039796] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T20:06:32.202202] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-23T20:06:33.002197] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-23T20:06:33.761782] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T20:06:33.802151] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-23T20:06:34.602172] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-23T20:06:34.884613] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T20:06:35.263546] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T20:06:35.402161] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-23T20:06:35.694980] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T20:06:36.202158] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-23T20:06:36.213335] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T20:06:37.002197] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-23T20:06:37.477053] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T20:06:37.802212] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-23T20:06:38.602196] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-23T20:06:38.779386] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T20:06:38.788500] [INFO ] [REMOTE ] MS: Full fetch complete (77719 records). [2025-09-23T20:06:38.788675] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-23T20:06:39.091211] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T20:06:39.237930] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-23T20:06:39.238087] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-23T20:06:39.239731] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-23T20:06:39.239833] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-23T20:06:39.242117] [DEBUG] [LOCAL ] MS: Trimmed 77719 records to 53693 (keeping 200 days of data) [2025-09-23T20:06:39.439468] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-23T20:06:39.490708] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T20:06:39.616880] [DEBUG] [LOCAL ] MS: Primary data saved (53693 records). [2025-09-23T20:06:39.617023] [INFO ] [MAIN ] MS: Full history saved. [2025-09-23T20:06:39.619707] [INFO ] [MAIN ] Update Progress: 1405/2372 symbols completed. MS took 49.3s. Estimated remaining: 2h 8m 26s. Rate: 7.5 symbols/min [2025-09-23T20:06:39.793555] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:06:39.832814] [DEBUG] [LOCAL ] MSDL: Loaded 38008 existing records from primary storage. [2025-09-23T20:06:39.833008] [INFO ] [MAIN ] MSDL: Loaded 38008 existing records. [2025-09-23T20:06:40.015040] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:06:40.015311] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-23T20:06:40.015359] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-23T20:06:40.016547] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-23T20:06:40.016626] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-23T20:06:40.209970] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-23T20:06:40.383342] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:06:41.002177] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-23T20:06:41.056347] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T20:06:41.227483] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T20:06:41.802225] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-23T20:06:42.304870] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T20:06:42.602232] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-23T20:06:42.720809] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T20:06:43.402268] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-23T20:06:44.202225] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-23T20:06:44.244636] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T20:06:44.267250] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-23T20:06:45.002229] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-23T20:06:45.292212] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T20:06:45.510598] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T20:06:45.802228] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-23T20:06:46.602264] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-23T20:06:46.732293] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T20:06:47.332971] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T20:06:47.334680] [INFO ] [REMOTE ] MSB: Full fetch complete (12836 records). [2025-09-23T20:06:47.334760] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-23T20:06:47.402398] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-23T20:06:47.721963] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-23T20:06:47.722109] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-23T20:06:47.722420] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-23T20:06:47.722479] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-23T20:06:47.723099] [DEBUG] [LOCAL ] MSB: Trimmed 12836 records to 7854 (keeping 200 days of data) [2025-09-23T20:06:47.775554] [DEBUG] [LOCAL ] MSB: Primary data saved (7854 records). [2025-09-23T20:06:47.775706] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-23T20:06:47.775885] [INFO ] [MAIN ] Update Progress: 1406/2372 symbols completed. MSB took 38.5s. Estimated remaining: 2h 8m 18s. Rate: 7.5 symbols/min [2025-09-23T20:06:47.945195] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:06:47.974903] [DEBUG] [LOCAL ] MSGE: Loaded 27081 existing records from primary storage. [2025-09-23T20:06:47.975040] [INFO ] [MAIN ] MSGE: Loaded 27081 existing records. [2025-09-23T20:06:48.160343] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:06:48.160898] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-23T20:06:48.160988] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-23T20:06:48.162422] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-23T20:06:48.162492] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-23T20:06:48.207429] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-23T20:06:48.523008] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:06:49.002179] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-23T20:06:49.029356] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T20:06:49.193842] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T20:06:49.203891] [INFO ] [REMOTE ] MSCI: Full fetch complete (50272 records). [2025-09-23T20:06:49.204010] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-23T20:06:49.611740] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-23T20:06:49.611826] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-23T20:06:49.612663] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-23T20:06:49.612740] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-23T20:06:49.615071] [DEBUG] [LOCAL ] MSCI: Trimmed 50272 records to 34875 (keeping 200 days of data) [2025-09-23T20:06:49.805570] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-23T20:06:49.854999] [DEBUG] [LOCAL ] MSCI: Primary data saved (34875 records). [2025-09-23T20:06:49.855224] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-23T20:06:49.855588] [INFO ] [MAIN ] Update Progress: 1407/2372 symbols completed. MSCI took 28.4s. Estimated remaining: 2h 8m 6s. Rate: 7.5 symbols/min [2025-09-23T20:06:50.080308] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:06:50.102575] [DEBUG] [LOCAL ] MSGS: Loaded 16853 existing records from primary storage. [2025-09-23T20:06:50.102743] [INFO ] [MAIN ] MSGS: Loaded 16853 existing records. [2025-09-23T20:06:50.302311] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T20:06:50.315563] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:06:50.324270] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-23T20:06:50.324765] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-23T20:06:50.325516] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-23T20:06:50.325616] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-23T20:06:50.607575] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-23T20:06:50.712191] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:06:50.841949] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T20:06:51.402209] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-23T20:06:52.181043] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T20:06:52.202290] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T20:06:52.202379] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-23T20:06:53.002227] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-23T20:06:53.567879] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T20:06:53.802224] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-23T20:06:53.920009] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T20:06:54.306094] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T20:06:54.602250] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-23T20:06:55.402225] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-23T20:06:55.642744] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T20:06:56.202240] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-23T20:06:56.599898] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T20:06:57.002240] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-23T20:06:57.416128] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T20:06:57.802292] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-23T20:06:58.374797] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T20:06:58.602205] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-23T20:06:58.867738] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T20:06:59.402234] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-23T20:06:59.916586] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T20:07:00.202187] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-23T20:07:00.525431] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T20:07:00.530519] [INFO ] [REMOTE ] MSD: Full fetch complete (22107 records). [2025-09-23T20:07:00.530714] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-23T20:07:00.953355] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-23T20:07:00.953509] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-23T20:07:00.954569] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-23T20:07:00.954694] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-23T20:07:00.956105] [DEBUG] [LOCAL ] MSD: Trimmed 22107 records to 15585 (keeping 200 days of data) [2025-09-23T20:07:01.010973] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-23T20:07:01.064098] [DEBUG] [LOCAL ] MSD: Primary data saved (15585 records). [2025-09-23T20:07:01.064333] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-23T20:07:01.064504] [INFO ] [MAIN ] Update Progress: 1408/2372 symbols completed. MSD took 31.2s. Estimated remaining: 2h 8m 0s. Rate: 7.5 symbols/min [2025-09-23T20:07:01.254189] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:01.316861] [DEBUG] [LOCAL ] MSI: Loaded 40595 existing records from primary storage. [2025-09-23T20:07:01.317071] [INFO ] [MAIN ] MSI: Loaded 40595 existing records. [2025-09-23T20:07:01.519323] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:07:01.520407] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-23T20:07:01.520732] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-23T20:07:01.522801] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-23T20:07:01.522894] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-23T20:07:01.707149] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T20:07:01.805691] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-23T20:07:01.953460] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T20:07:02.028963] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:02.602246] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-23T20:07:03.172385] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T20:07:03.402256] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-23T20:07:04.202294] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-23T20:07:04.251793] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T20:07:04.708460] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T20:07:05.002263] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-23T20:07:05.812924] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-23T20:07:05.834095] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T20:07:05.870549] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T20:07:06.602300] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-23T20:07:07.151836] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T20:07:07.402296] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-23T20:07:08.202204] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-23T20:07:08.278045] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T20:07:08.287740] [INFO ] [REMOTE ] MSDL: Full fetch complete (54230 records). [2025-09-23T20:07:08.287940] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-23T20:07:08.588525] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T20:07:08.789045] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-23T20:07:08.789406] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-23T20:07:08.790919] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-23T20:07:08.790994] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-23T20:07:08.794223] [DEBUG] [LOCAL ] MSDL: Trimmed 54230 records to 38020 (keeping 200 days of data) [2025-09-23T20:07:08.943242] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T20:07:09.020461] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-23T20:07:09.096298] [DEBUG] [LOCAL ] MSDL: Primary data saved (38020 records). [2025-09-23T20:07:09.096520] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-23T20:07:09.096695] [INFO ] [MAIN ] Update Progress: 1409/2372 symbols completed. MSDL took 29.5s. Estimated remaining: 2h 7m 52s. Rate: 7.5 symbols/min [2025-09-23T20:07:09.276368] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:09.276668] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-23T20:07:09.276724] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-23T20:07:09.276875] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-23T20:07:09.276918] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-23T20:07:09.276959] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-23T20:07:09.276991] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-23T20:07:09.647009] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:09.802237] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-23T20:07:10.034782] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T20:07:10.602166] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-23T20:07:10.830742] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:07:10.831145] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-23T20:07:11.055164] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T20:07:11.402218] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-23T20:07:12.202225] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-23T20:07:12.422978] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T20:07:13.002269] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-23T20:07:13.291821] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T20:07:13.802251] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-23T20:07:14.329739] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T20:07:14.603229] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-23T20:07:14.605126] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T20:07:14.609671] [INFO ] [REMOTE ] MSGS: Full fetch complete (22290 records). [2025-09-23T20:07:14.609781] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-23T20:07:15.006596] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-23T20:07:15.006940] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-23T20:07:15.007707] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-23T20:07:15.007790] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-23T20:07:15.008684] [DEBUG] [LOCAL ] MSGS: Trimmed 22290 records to 16869 (keeping 200 days of data) [2025-09-23T20:07:15.124625] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T20:07:15.131773] [DEBUG] [LOCAL ] MSGS: Primary data saved (16869 records). [2025-09-23T20:07:15.131940] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-23T20:07:15.132052] [INFO ] [MAIN ] Update Progress: 1410/2372 symbols completed. MSGS took 25.3s. Estimated remaining: 2h 7m 43s. Rate: 7.5 symbols/min [2025-09-23T20:07:15.316287] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:15.358177] [DEBUG] [LOCAL ] MSM: Loaded 35425 existing records from primary storage. [2025-09-23T20:07:15.358338] [INFO ] [MAIN ] MSM: Loaded 35425 existing records. [2025-09-23T20:07:15.408374] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-23T20:07:15.545711] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:07:15.546068] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-23T20:07:15.546123] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-23T20:07:15.547308] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-23T20:07:15.547371] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-23T20:07:15.907777] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:16.202205] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-23T20:07:16.799222] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T20:07:17.002235] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-23T20:07:17.802266] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-23T20:07:17.911112] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T20:07:18.279150] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T20:07:18.284895] [INFO ] [REMOTE ] MSGE: Full fetch complete (40185 records). [2025-09-23T20:07:18.284978] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-23T20:07:18.608332] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-23T20:07:18.622369] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T20:07:18.713511] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-23T20:07:18.713585] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-23T20:07:18.714335] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-23T20:07:18.714396] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-23T20:07:18.716820] [DEBUG] [LOCAL ] MSGE: Trimmed 40185 records to 27130 (keeping 200 days of data) [2025-09-23T20:07:18.882399] [DEBUG] [LOCAL ] MSGE: Primary data saved (27130 records). [2025-09-23T20:07:18.882547] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-23T20:07:18.882637] [INFO ] [MAIN ] Update Progress: 1411/2372 symbols completed. MSGE took 31.1s. Estimated remaining: 2h 7m 32s. Rate: 7.5 symbols/min [2025-09-23T20:07:19.048961] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:19.107280] [DEBUG] [LOCAL ] MT: Loaded 50759 existing records from primary storage. [2025-09-23T20:07:19.107429] [INFO ] [MAIN ] MT: Loaded 50759 existing records. [2025-09-23T20:07:19.284754] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:07:19.285014] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-23T20:07:19.285061] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-23T20:07:19.286852] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-23T20:07:19.286914] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-23T20:07:19.407352] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-23T20:07:19.663109] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:20.189326] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T20:07:20.204042] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-23T20:07:20.210449] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T20:07:21.002240] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-23T20:07:21.701801] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T20:07:21.802211] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-23T20:07:21.944176] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T20:07:22.385424] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T20:07:22.602242] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-23T20:07:23.402203] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-23T20:07:23.898146] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T20:07:24.202232] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-23T20:07:25.002261] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-23T20:07:25.252878] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T20:07:25.275814] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T20:07:25.802195] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-23T20:07:26.033875] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T20:07:26.602256] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-23T20:07:27.402217] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-23T20:07:27.483034] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T20:07:28.202179] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-23T20:07:28.604927] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-23T20:07:29.002226] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-23T20:07:29.052082] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T20:07:29.802183] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-23T20:07:29.814455] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T20:07:29.861781] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T20:07:30.602215] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-23T20:07:31.367057] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T20:07:31.402196] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-23T20:07:32.202194] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-23T20:07:32.448116] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-23T20:07:32.493712] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T20:07:33.002190] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-23T20:07:33.528860] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T20:07:33.714284] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T20:07:33.718380] [INFO ] [REMOTE ] MSIF: Full fetch complete (16069 records). [2025-09-23T20:07:33.718469] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-23T20:07:33.807357] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-23T20:07:33.906321] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 163 unique days, need 200 days [2025-09-23T20:07:33.906632] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:07:33.906734] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:07:33.906809] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-23T20:07:33.906874] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-23T20:07:33.906923] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-23T20:07:33.907004] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-23T20:07:33.907086] [INFO ] [MAIN ] Update Progress: 1412/2372 symbols completed. MSIF took 24.8s. Estimated remaining: 2h 7m 29s. Rate: 7.5 symbols/min [2025-09-23T20:07:34.077947] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:34.121781] [DEBUG] [LOCAL ] MTAL: Loaded 36305 existing records from primary storage. [2025-09-23T20:07:34.121940] [INFO ] [MAIN ] MTAL: Loaded 36305 existing records. [2025-09-23T20:07:34.303256] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:07:34.303532] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-23T20:07:34.303581] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-23T20:07:34.304564] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-23T20:07:34.304627] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-23T20:07:34.607295] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-23T20:07:34.669330] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:35.402165] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-23T20:07:35.558776] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T20:07:36.202201] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-23T20:07:36.688017] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T20:07:36.729360] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T20:07:37.002257] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-23T20:07:37.235299] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T20:07:37.802307] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-23T20:07:38.602263] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-23T20:07:38.665168] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T20:07:38.880255] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T20:07:39.402203] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-23T20:07:40.202182] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-23T20:07:40.574619] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T20:07:41.002157] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-23T20:07:41.069440] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T20:07:41.304980] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T20:07:41.802208] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-23T20:07:42.602169] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-23T20:07:42.903792] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T20:07:43.097629] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T20:07:43.402224] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-23T20:07:44.202247] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-23T20:07:44.631229] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T20:07:44.638382] [INFO ] [REMOTE ] MSI: Full fetch complete (58568 records). [2025-09-23T20:07:44.638565] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-23T20:07:45.006617] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-23T20:07:45.050156] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-23T20:07:45.050252] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-23T20:07:45.051153] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-23T20:07:45.051253] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-23T20:07:45.052537] [DEBUG] [LOCAL ] MSI: Trimmed 58568 records to 40590 (keeping 200 days of data) [2025-09-23T20:07:45.324157] [DEBUG] [LOCAL ] MSI: Primary data saved (40590 records). [2025-09-23T20:07:45.324394] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-23T20:07:45.324499] [INFO ] [MAIN ] Update Progress: 1413/2372 symbols completed. MSI took 44.3s. Estimated remaining: 2h 7m 24s. Rate: 7.5 symbols/min [2025-09-23T20:07:45.524073] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:45.526950] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-23T20:07:45.582609] [DEBUG] [LOCAL ] MTB: Loaded 47175 existing records from primary storage. [2025-09-23T20:07:45.582780] [INFO ] [MAIN ] MTB: Loaded 47175 existing records. [2025-09-23T20:07:45.762524] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:07:45.775786] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-23T20:07:45.784117] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-23T20:07:45.786396] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-23T20:07:45.786349] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T20:07:45.786577] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-23T20:07:45.810544] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-23T20:07:46.176285] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:46.612814] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-23T20:07:46.616631] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T20:07:47.402221] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-23T20:07:47.721113] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T20:07:47.754043] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T20:07:48.202162] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-23T20:07:48.664932] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T20:07:49.002255] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-23T20:07:49.189306] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T20:07:49.802232] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-23T20:07:50.512319] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T20:07:50.602159] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-23T20:07:51.402231] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-23T20:07:51.717048] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T20:07:52.202162] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-23T20:07:52.293952] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T20:07:52.302319] [INFO ] [REMOTE ] MT: Full fetch complete (73459 records). [2025-09-23T20:07:52.302458] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-23T20:07:52.702058] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-23T20:07:52.702335] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-23T20:07:52.703385] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-23T20:07:52.703450] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-23T20:07:52.704868] [DEBUG] [LOCAL ] MT: Trimmed 73459 records to 50737 (keeping 200 days of data) [2025-09-23T20:07:52.821938] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T20:07:53.004161] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-23T20:07:53.041784] [DEBUG] [LOCAL ] MT: Primary data saved (50737 records). [2025-09-23T20:07:53.041933] [INFO ] [MAIN ] MT: Full history saved. [2025-09-23T20:07:53.042021] [INFO ] [MAIN ] Update Progress: 1414/2372 symbols completed. MT took 34.2s. Estimated remaining: 2h 7m 15s. Rate: 7.5 symbols/min [2025-09-23T20:07:53.214498] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:53.232232] [DEBUG] [LOCAL ] MTD: Loaded 15215 existing records from primary storage. [2025-09-23T20:07:53.232370] [INFO ] [MAIN ] MTD: Loaded 15215 existing records. [2025-09-23T20:07:53.406638] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:07:53.406927] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-23T20:07:53.406977] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-23T20:07:53.407520] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-23T20:07:53.407579] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-23T20:07:53.804057] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:53.804204] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-23T20:07:54.048850] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T20:07:54.473122] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T20:07:54.602216] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-23T20:07:55.059596] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T20:07:55.066608] [INFO ] [REMOTE ] MSM: Full fetch complete (52008 records). [2025-09-23T20:07:55.066774] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-23T20:07:55.407269] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-23T20:07:55.536679] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-23T20:07:55.536805] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-23T20:07:55.537878] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-23T20:07:55.537967] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-23T20:07:55.539695] [DEBUG] [LOCAL ] MSM: Trimmed 52008 records to 35420 (keeping 200 days of data) [2025-09-23T20:07:55.685032] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T20:07:55.794692] [DEBUG] [LOCAL ] MSM: Primary data saved (35420 records). [2025-09-23T20:07:55.794857] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-23T20:07:55.794961] [INFO ] [MAIN ] Update Progress: 1415/2372 symbols completed. MSM took 40.7s. Estimated remaining: 2h 7m 4s. Rate: 7.5 symbols/min [2025-09-23T20:07:55.964202] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:56.014841] [DEBUG] [LOCAL ] MTDR: Loaded 51549 existing records from primary storage. [2025-09-23T20:07:56.014993] [INFO ] [MAIN ] MTDR: Loaded 51549 existing records. [2025-09-23T20:07:56.198153] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:07:56.198462] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-23T20:07:56.198515] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-23T20:07:56.199757] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-23T20:07:56.199821] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-23T20:07:56.211174] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-23T20:07:56.565618] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:57.002191] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-23T20:07:57.034806] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T20:07:57.041302] [INFO ] [REMOTE ] MTAL: Full fetch complete (46731 records). [2025-09-23T20:07:57.041421] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-23T20:07:57.420375] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-23T20:07:57.420456] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-23T20:07:57.421218] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-23T20:07:57.421279] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-23T20:07:57.422319] [DEBUG] [LOCAL ] MTAL: Trimmed 46731 records to 36328 (keeping 200 days of data) [2025-09-23T20:07:57.631559] [DEBUG] [LOCAL ] MTAL: Primary data saved (36328 records). [2025-09-23T20:07:57.631731] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-23T20:07:57.631858] [INFO ] [MAIN ] Update Progress: 1416/2372 symbols completed. MTAL took 23.7s. Estimated remaining: 2h 6m 52s. Rate: 7.5 symbols/min [2025-09-23T20:07:57.808177] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-23T20:07:57.808026] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:07:57.837804] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T20:07:57.891708] [DEBUG] [LOCAL ] MTG: Loaded 51374 existing records from primary storage. [2025-09-23T20:07:57.891857] [INFO ] [MAIN ] MTG: Loaded 51374 existing records. [2025-09-23T20:07:58.071388] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:07:58.071618] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-23T20:07:58.071695] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-23T20:07:58.072770] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-23T20:07:58.072831] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-23T20:07:58.434456] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:07:58.602175] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-23T20:07:58.640065] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T20:07:58.783312] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T20:07:59.402268] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-23T20:08:00.202169] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-23T20:08:00.237922] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T20:08:00.363897] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T20:08:01.002199] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-23T20:08:01.702442] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T20:08:01.802225] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-23T20:08:02.083895] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T20:08:02.602210] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-23T20:08:03.402204] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-23T20:08:03.436297] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T20:08:04.202232] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-23T20:08:04.395341] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T20:08:04.424276] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T20:08:05.002209] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-23T20:08:05.500677] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T20:08:05.802234] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-23T20:08:06.602178] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-23T20:08:06.740202] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T20:08:07.202962] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T20:08:07.402196] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-23T20:08:08.212189] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-23T20:08:08.215592] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T20:08:08.676337] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T20:08:09.002204] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-23T20:08:09.802168] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-23T20:08:09.898015] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T20:08:10.454605] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T20:08:10.602164] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-23T20:08:10.998887] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T20:08:11.402277] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-23T20:08:12.202187] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-23T20:08:12.319448] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T20:08:12.942519] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T20:08:13.002245] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-23T20:08:13.802171] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-23T20:08:14.131777] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T20:08:14.602172] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-23T20:08:14.933038] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T20:08:15.402190] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-23T20:08:15.500293] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T20:08:15.539637] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T20:08:16.202203] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-23T20:08:17.002207] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-23T20:08:17.169109] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T20:08:17.547159] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T20:08:17.802210] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-23T20:08:18.023931] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T20:08:18.602268] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-23T20:08:19.402228] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-23T20:08:19.537564] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T20:08:20.013398] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-23T20:08:20.021173] [INFO ] [REMOTE ] MTB: Full fetch complete (68406 records). [2025-09-23T20:08:20.021308] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-23T20:08:20.202797] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-23T20:08:20.423139] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-23T20:08:20.423235] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-23T20:08:20.424197] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-23T20:08:20.424307] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-23T20:08:20.425944] [DEBUG] [LOCAL ] MTB: Trimmed 68406 records to 47070 (keeping 200 days of data) [2025-09-23T20:08:20.720303] [DEBUG] [LOCAL ] MTB: Primary data saved (47070 records). [2025-09-23T20:08:20.720451] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-23T20:08:20.720539] [INFO ] [MAIN ] Update Progress: 1417/2372 symbols completed. MTB took 35.4s. Estimated remaining: 2h 6m 54s. Rate: 7.5 symbols/min [2025-09-23T20:08:20.894532] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:08:20.937238] [DEBUG] [LOCAL ] MTH: Loaded 43969 existing records from primary storage. [2025-09-23T20:08:20.937396] [INFO ] [MAIN ] MTH: Loaded 43969 existing records. [2025-09-23T20:08:21.007979] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-23T20:08:21.146535] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T20:08:21.154013] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:08:21.156558] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-23T20:08:21.156809] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-23T20:08:21.157037] [INFO ] [REMOTE ] MTD: Full fetch complete (20983 records). [2025-09-23T20:08:21.157112] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-23T20:08:21.168455] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-23T20:08:21.178225] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-23T20:08:21.790900] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-23T20:08:21.860869] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-23T20:08:21.958287] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-23T20:08:21.962445] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-23T20:08:21.991682] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-23T20:08:21.991805] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-23T20:08:21.991149] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:08:21.992622] [DEBUG] [LOCAL ] MTD: Trimmed 20983 records to 15173 (keeping 200 days of data) [2025-09-23T20:08:22.089930] [DEBUG] [LOCAL ] MTD: Primary data saved (15173 records). [2025-09-23T20:08:22.090086] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-23T20:08:22.090196] [INFO ] [MAIN ] Update Progress: 1418/2372 symbols completed. MTD took 29.0s. Estimated remaining: 2h 6m 42s. Rate: 7.5 symbols/min [2025-09-23T20:08:22.305071] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:08:22.350173] [DEBUG] [LOCAL ] MTN: Loaded 38983 existing records from primary storage. [2025-09-23T20:08:22.350339] [INFO ] [MAIN ] MTN: Loaded 38983 existing records. [2025-09-23T20:08:22.532564] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:08:22.532935] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-23T20:08:22.532985] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-23T20:08:22.534012] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-23T20:08:22.534075] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-23T20:08:22.611755] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-23T20:08:22.907340] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:08:22.934205] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T20:08:23.402184] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-23T20:08:23.736132] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T20:08:24.155911] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T20:08:24.202173] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-23T20:08:24.981093] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T20:08:25.002209] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-23T20:08:25.724977] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T20:08:25.802186] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-23T20:08:26.602206] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-23T20:08:26.753083] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T20:08:27.402174] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-23T20:08:27.653731] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T20:08:27.662387] [INFO ] [REMOTE ] MTG: Full fetch complete (73980 records). [2025-09-23T20:08:27.662550] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-23T20:08:28.080410] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-23T20:08:28.080611] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-23T20:08:28.081819] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-23T20:08:28.081959] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-23T20:08:28.083587] [DEBUG] [LOCAL ] MTG: Trimmed 73980 records to 51366 (keeping 200 days of data) [2025-09-23T20:08:28.207811] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-23T20:08:28.360859] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T20:08:28.438099] [DEBUG] [LOCAL ] MTG: Primary data saved (51366 records). [2025-09-23T20:08:28.438254] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-23T20:08:28.438362] [INFO ] [MAIN ] Update Progress: 1419/2372 symbols completed. MTG took 30.8s. Estimated remaining: 2h 6m 33s. Rate: 7.5 symbols/min [2025-09-23T20:08:28.616721] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:08:28.617038] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-23T20:08:28.617172] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-23T20:08:28.617553] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-23T20:08:28.617690] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-23T20:08:28.617858] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-23T20:08:28.618009] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-23T20:08:28.832130] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T20:08:29.007318] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-23T20:08:29.065639] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:08:29.802202] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-23T20:08:29.990265] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T20:08:29.998866] [INFO ] [REMOTE ] MTDR: Full fetch complete (73384 records). [2025-09-23T20:08:29.999011] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-23T20:08:30.104670] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-23T20:08:30.394623] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-23T20:08:30.394744] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-23T20:08:30.395742] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-23T20:08:30.395807] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-23T20:08:30.397284] [DEBUG] [LOCAL ] MTDR: Trimmed 73384 records to 51550 (keeping 200 days of data) [2025-09-23T20:08:30.613714] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-23T20:08:30.699713] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T20:08:30.751461] [DEBUG] [LOCAL ] MTDR: Primary data saved (51550 records). [2025-09-23T20:08:30.751628] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-23T20:08:30.751772] [INFO ] [MAIN ] Update Progress: 1420/2372 symbols completed. MTDR took 35.0s. Estimated remaining: 2h 6m 21s. Rate: 7.5 symbols/min [2025-09-23T20:08:30.929500] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:08:30.951685] [DEBUG] [LOCAL ] MTRN: Loaded 18011 existing records from primary storage. [2025-09-23T20:08:30.951850] [INFO ] [MAIN ] MTRN: Loaded 18011 existing records. [2025-09-23T20:08:31.068812] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T20:08:31.147433] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:08:31.147714] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-23T20:08:31.147769] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-23T20:08:31.148419] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-23T20:08:31.148480] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-23T20:08:31.412366] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-23T20:08:31.553682] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:08:32.202194] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-23T20:08:32.615039] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T20:08:32.878294] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T20:08:33.002185] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-23T20:08:33.802186] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-23T20:08:34.485163] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T20:08:34.602194] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-23T20:08:34.973775] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T20:08:35.120346] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T20:08:35.402234] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-23T20:08:36.202263] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-23T20:08:37.004975] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-23T20:08:37.007430] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T20:08:37.107179] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T20:08:37.802232] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-23T20:08:38.161139] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T20:08:38.602231] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-23T20:08:38.685079] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T20:08:38.978306] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T20:08:39.402260] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-23T20:08:40.202201] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-23T20:08:40.919211] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T20:08:41.002158] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-23T20:08:41.694043] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T20:08:41.802218] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-23T20:08:42.441038] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T20:08:42.494965] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T20:08:42.602240] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-23T20:08:43.402252] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-23T20:08:43.476984] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T20:08:44.085267] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T20:08:44.202192] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-23T20:08:45.002225] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-23T20:08:45.171170] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T20:08:45.438998] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T20:08:45.802197] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-23T20:08:46.602194] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-23T20:08:46.957466] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T20:08:47.395327] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T20:08:47.405148] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-23T20:08:47.841738] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T20:08:47.842553] [INFO ] [REMOTE ] MTR: Full fetch complete (2583 records). [2025-09-23T20:08:47.842638] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-23T20:08:48.054263] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T20:08:48.054500] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:08:48.054552] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:08:48.054591] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-23T20:08:48.054709] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-23T20:08:48.054764] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-23T20:08:48.054806] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-23T20:08:48.054864] [INFO ] [MAIN ] Update Progress: 1421/2372 symbols completed. MTR took 19.6s. Estimated remaining: 2h 6m 19s. Rate: 7.5 symbols/min [2025-09-23T20:08:48.213030] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-23T20:08:48.246076] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:08:48.276952] [DEBUG] [LOCAL ] MTUS: Loaded 28785 existing records from primary storage. [2025-09-23T20:08:48.277099] [INFO ] [MAIN ] MTUS: Loaded 28785 existing records. [2025-09-23T20:08:48.468872] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:08:48.469168] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-23T20:08:48.469251] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-23T20:08:48.471169] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-23T20:08:48.471281] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-23T20:08:48.821209] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:08:49.002304] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-23T20:08:49.790345] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T20:08:49.802134] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-23T20:08:50.193943] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T20:08:50.602202] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-23T20:08:50.927513] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T20:08:51.402204] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-23T20:08:51.606164] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T20:08:52.202253] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-23T20:08:52.494749] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T20:08:53.002222] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-23T20:08:53.802237] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-23T20:08:53.917002] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T20:08:53.924463] [INFO ] [REMOTE ] MTH: Full fetch complete (62680 records). [2025-09-23T20:08:53.924592] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-23T20:08:54.356060] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-23T20:08:54.356464] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-23T20:08:54.358273] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-23T20:08:54.358383] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-23T20:08:54.360273] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T20:08:54.369458] [DEBUG] [LOCAL ] MTH: Trimmed 62680 records to 43945 (keeping 200 days of data) [2025-09-23T20:08:54.602438] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-23T20:08:54.656043] [DEBUG] [LOCAL ] MTH: Primary data saved (43945 records). [2025-09-23T20:08:54.656175] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-23T20:08:54.656296] [INFO ] [MAIN ] Update Progress: 1422/2372 symbols completed. MTH took 33.9s. Estimated remaining: 2h 6m 10s. Rate: 7.5 symbols/min [2025-09-23T20:08:54.831113] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:08:54.858813] [DEBUG] [LOCAL ] MTW: Loaded 26506 existing records from primary storage. [2025-09-23T20:08:54.858951] [INFO ] [MAIN ] MTW: Loaded 26506 existing records. [2025-09-23T20:08:55.040358] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T20:08:55.077804] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:08:55.078173] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-23T20:08:55.078248] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-23T20:08:55.079083] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-23T20:08:55.079176] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-23T20:08:55.407331] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-23T20:08:55.438862] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:08:56.151958] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T20:08:56.162781] [INFO ] [REMOTE ] MTN: Full fetch complete (56139 records). [2025-09-23T20:08:56.162938] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-23T20:08:56.207397] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-23T20:08:56.519620] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T20:08:56.619003] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-23T20:08:56.619086] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-23T20:08:56.619958] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-23T20:08:56.620070] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-23T20:08:56.621353] [DEBUG] [LOCAL ] MTN: Trimmed 56139 records to 39014 (keeping 200 days of data) [2025-09-23T20:08:56.881180] [DEBUG] [LOCAL ] MTN: Primary data saved (39014 records). [2025-09-23T20:08:56.881329] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-23T20:08:56.881478] [INFO ] [MAIN ] Update Progress: 1423/2372 symbols completed. MTN took 34.8s. Estimated remaining: 2h 5m 58s. Rate: 7.5 symbols/min [2025-09-23T20:08:57.007472] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-23T20:08:57.071531] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:08:57.102605] [DEBUG] [LOCAL ] MTX: Loaded 22850 existing records from primary storage. [2025-09-23T20:08:57.102772] [INFO ] [MAIN ] MTX: Loaded 22850 existing records. [2025-09-23T20:08:57.302915] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:08:57.304551] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T20:08:57.309786] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-23T20:08:57.310403] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-23T20:08:57.311195] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-23T20:08:57.311283] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-23T20:08:57.679280] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:08:57.802172] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-23T20:08:58.339539] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T20:08:58.602248] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-23T20:08:58.790362] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T20:08:59.402217] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-23T20:08:59.705913] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T20:09:00.202161] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-23T20:09:00.225073] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T20:09:01.002224] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-23T20:09:01.538445] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T20:09:01.802212] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-23T20:09:02.564126] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T20:09:02.602228] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-23T20:09:03.402287] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-23T20:09:04.049980] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-23T20:09:04.202249] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-23T20:09:04.333813] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T20:09:05.007328] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-23T20:09:05.018114] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T20:09:05.521094] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T20:09:05.802274] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-23T20:09:06.251164] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T20:09:06.602238] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-23T20:09:06.857686] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T20:09:07.402266] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-23T20:09:07.668586] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T20:09:08.202187] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-23T20:09:08.441898] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T20:09:09.009545] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-23T20:09:09.014592] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T20:09:09.802201] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-23T20:09:10.349163] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T20:09:10.602192] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-23T20:09:10.839462] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T20:09:11.402252] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-23T20:09:11.933961] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T20:09:12.202251] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-23T20:09:12.567050] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T20:09:13.002214] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-23T20:09:13.308325] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T20:09:13.802188] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-23T20:09:13.863719] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T20:09:14.602213] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-23T20:09:14.998902] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T20:09:15.006463] [INFO ] [REMOTE ] MTUS: Full fetch complete (42803 records). [2025-09-23T20:09:15.006616] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-23T20:09:15.406548] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-23T20:09:15.406825] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-23T20:09:15.407872] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-23T20:09:15.408737] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-23T20:09:15.408892] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-23T20:09:15.410097] [DEBUG] [LOCAL ] MTUS: Trimmed 42803 records to 28728 (keeping 200 days of data) [2025-09-23T20:09:15.602965] [DEBUG] [LOCAL ] MTUS: Primary data saved (28728 records). [2025-09-23T20:09:15.603211] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-23T20:09:15.603397] [INFO ] [MAIN ] Update Progress: 1424/2372 symbols completed. MTUS took 27.5s. Estimated remaining: 2h 5m 58s. Rate: 7.5 symbols/min [2025-09-23T20:09:15.722347] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T20:09:15.797860] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:09:15.851501] [DEBUG] [LOCAL ] MTZ: Loaded 43479 existing records from primary storage. [2025-09-23T20:09:15.851667] [INFO ] [MAIN ] MTZ: Loaded 43479 existing records. [2025-09-23T20:09:16.032894] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:09:16.033269] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-23T20:09:16.033373] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-23T20:09:16.034828] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-23T20:09:16.034892] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-23T20:09:16.202564] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-23T20:09:16.395669] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T20:09:16.423567] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:09:16.427316] [INFO ] [REMOTE ] MTRN: Full fetch complete (23314 records). [2025-09-23T20:09:16.427391] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-23T20:09:16.817821] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-23T20:09:16.817917] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-23T20:09:16.818583] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-23T20:09:16.818668] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-23T20:09:16.819342] [DEBUG] [LOCAL ] MTRN: Trimmed 23314 records to 18095 (keeping 200 days of data) [2025-09-23T20:09:16.953140] [DEBUG] [LOCAL ] MTRN: Primary data saved (18095 records). [2025-09-23T20:09:16.953345] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-23T20:09:16.953483] [INFO ] [MAIN ] Update Progress: 1425/2372 symbols completed. MTRN took 46.2s. Estimated remaining: 2h 5m 45s. Rate: 7.5 symbols/min [2025-09-23T20:09:17.010237] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-23T20:09:17.228152] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:09:17.251324] [DEBUG] [LOCAL ] MUA: Loaded 12232 existing records from primary storage. [2025-09-23T20:09:17.251538] [INFO ] [MAIN ] MUA: Loaded 12232 existing records. [2025-09-23T20:09:17.488251] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:09:17.488845] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-23T20:09:17.488920] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-23T20:09:17.489835] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-23T20:09:17.489902] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-23T20:09:17.638275] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T20:09:17.807438] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-23T20:09:17.934690] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:09:18.529825] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T20:09:18.602153] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-23T20:09:19.402268] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-23T20:09:19.846065] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T20:09:20.202267] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-23T20:09:21.002177] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-23T20:09:21.312103] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T20:09:21.332140] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T20:09:21.608577] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-09-23T20:09:21.633466] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T20:09:21.802247] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-23T20:09:22.419903] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T20:09:22.602199] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-23T20:09:23.402174] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-23T20:09:23.538387] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T20:09:24.202252] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-23T20:09:24.764738] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T20:09:25.002180] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-23T20:09:25.145431] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T20:09:25.802197] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-23T20:09:26.602200] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-23T20:09:26.732455] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T20:09:27.165837] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T20:09:27.402186] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-23T20:09:27.539804] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T20:09:28.202249] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-23T20:09:28.344474] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T20:09:28.352551] [INFO ] [REMOTE ] MTX: Full fetch complete (31083 records). [2025-09-23T20:09:28.352784] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-23T20:09:28.772932] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-23T20:09:28.773055] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-23T20:09:28.774062] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-23T20:09:28.774130] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-23T20:09:28.775548] [DEBUG] [LOCAL ] MTX: Trimmed 31083 records to 22897 (keeping 200 days of data) [2025-09-23T20:09:28.935161] [DEBUG] [LOCAL ] MTX: Primary data saved (22897 records). [2025-09-23T20:09:28.935379] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-23T20:09:28.935546] [INFO ] [MAIN ] Update Progress: 1426/2372 symbols completed. MTX took 32.1s. Estimated remaining: 2h 5m 40s. Rate: 7.5 symbols/min [2025-09-23T20:09:29.007320] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-23T20:09:29.120604] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T20:09:29.177140] [INFO ] [REMOTE ] MTW: Full fetch complete (38439 records). [2025-09-23T20:09:29.182990] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:09:29.183340] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-23T20:09:29.438861] [DEBUG] [LOCAL ] MUC: Loaded 20075 existing records from primary storage. [2025-09-23T20:09:29.463833] [INFO ] [MAIN ] MUC: Loaded 20075 existing records. [2025-09-23T20:09:29.821934] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-23T20:09:29.821844] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-23T20:09:29.831160] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-23T20:09:29.833174] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-23T20:09:29.833679] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-23T20:09:29.833377] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:09:29.842998] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T20:09:29.843243] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-23T20:09:29.846631] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-23T20:09:29.847354] [DEBUG] [LOCAL ] MTW: Trimmed 38439 records to 26521 (keeping 200 days of data) [2025-09-23T20:09:29.847830] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-23T20:09:29.847914] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-23T20:09:30.335282] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:09:30.396580] [DEBUG] [LOCAL ] MTW: Primary data saved (26521 records). [2025-09-23T20:09:30.396779] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-23T20:09:30.396886] [INFO ] [MAIN ] Update Progress: 1427/2372 symbols completed. MTW took 35.7s. Estimated remaining: 2h 5m 28s. Rate: 7.5 symbols/min [2025-09-23T20:09:30.566689] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:09:30.579969] [DEBUG] [LOCAL ] MUE: Loaded 11972 existing records from primary storage. [2025-09-23T20:09:30.580091] [INFO ] [MAIN ] MUE: Loaded 11972 existing records. [2025-09-23T20:09:30.610149] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-23T20:09:30.758732] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:09:30.758964] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-23T20:09:30.759012] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-23T20:09:30.759394] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-23T20:09:30.759453] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-23T20:09:31.109369] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:09:31.402244] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-23T20:09:31.464599] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T20:09:31.871865] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T20:09:32.143873] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T20:09:32.202224] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-23T20:09:33.002206] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-23T20:09:33.802194] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-23T20:09:33.852480] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T20:09:34.022183] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T20:09:34.289529] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-23T20:09:34.602216] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-23T20:09:35.402182] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-23T20:09:35.528297] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T20:09:35.948977] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T20:09:36.202229] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-23T20:09:37.002249] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-23T20:09:37.633565] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T20:09:37.673987] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T20:09:37.802201] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-23T20:09:38.602219] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-23T20:09:38.669479] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T20:09:38.671777] [INFO ] [REMOTE ] MUA: Full fetch complete (18699 records). [2025-09-23T20:09:38.671849] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-23T20:09:39.037028] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-23T20:09:39.037123] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-23T20:09:39.037539] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-23T20:09:39.037581] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-23T20:09:39.038148] [DEBUG] [LOCAL ] MUA: Trimmed 18699 records to 12209 (keeping 200 days of data) [2025-09-23T20:09:39.112168] [DEBUG] [LOCAL ] MUA: Primary data saved (12209 records). [2025-09-23T20:09:39.112311] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-23T20:09:39.112398] [INFO ] [MAIN ] Update Progress: 1428/2372 symbols completed. MUA took 22.2s. Estimated remaining: 2h 5m 20s. Rate: 7.5 symbols/min [2025-09-23T20:09:39.281794] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:09:39.344242] [DEBUG] [LOCAL ] MUFG: Loaded 52636 existing records from primary storage. [2025-09-23T20:09:39.344417] [INFO ] [MAIN ] MUFG: Loaded 52636 existing records. [2025-09-23T20:09:39.407855] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-23T20:09:39.529756] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:09:39.530053] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-23T20:09:39.530107] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-23T20:09:39.531218] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-23T20:09:39.531281] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-23T20:09:39.897787] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:09:40.183458] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T20:09:40.198744] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T20:09:40.202148] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-23T20:09:41.002204] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-23T20:09:41.802222] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-23T20:09:41.913631] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T20:09:42.563410] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T20:09:42.602234] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-23T20:09:42.785354] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T20:09:43.402238] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-23T20:09:43.672562] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T20:09:44.185532] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T20:09:44.202179] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-23T20:09:45.002727] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T20:09:45.002913] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-23T20:09:45.802192] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-23T20:09:46.602204] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-23T20:09:46.794583] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T20:09:46.802636] [INFO ] [REMOTE ] MTZ: Full fetch complete (63426 records). [2025-09-23T20:09:46.802857] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-23T20:09:46.935597] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T20:09:47.216171] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-23T20:09:47.216266] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-23T20:09:47.217149] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-23T20:09:47.217215] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-23T20:09:47.218569] [DEBUG] [LOCAL ] MTZ: Trimmed 63426 records to 43439 (keeping 200 days of data) [2025-09-23T20:09:47.403005] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-23T20:09:47.489989] [DEBUG] [LOCAL ] MTZ: Primary data saved (43439 records). [2025-09-23T20:09:47.490152] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-23T20:09:47.490243] [INFO ] [MAIN ] Update Progress: 1429/2372 symbols completed. MTZ took 31.9s. Estimated remaining: 2h 5m 13s. Rate: 7.5 symbols/min [2025-09-23T20:09:47.685158] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:09:47.700081] [DEBUG] [LOCAL ] MUJ: Loaded 13226 existing records from primary storage. [2025-09-23T20:09:47.700216] [INFO ] [MAIN ] MUJ: Loaded 13226 existing records. [2025-09-23T20:09:47.887809] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:09:47.888371] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-23T20:09:47.888450] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-23T20:09:47.888991] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-23T20:09:47.889053] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-23T20:09:48.211972] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-23T20:09:48.293107] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T20:09:48.295570] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T20:09:48.329164] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:09:49.002238] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-23T20:09:49.296357] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T20:09:49.785537] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T20:09:49.802162] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-23T20:09:50.577617] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T20:09:50.602146] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-23T20:09:51.402205] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-23T20:09:51.516266] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T20:09:52.158778] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T20:09:52.202189] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-23T20:09:53.002174] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-23T20:09:53.139326] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T20:09:53.802255] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-23T20:09:54.615583] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-23T20:09:54.618091] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T20:09:54.660255] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T20:09:55.306298] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-23T20:09:55.402225] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-23T20:09:56.202241] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-23T20:09:56.485419] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T20:09:56.906073] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T20:09:56.908827] [INFO ] [REMOTE ] MUE: Full fetch complete (16186 records). [2025-09-23T20:09:56.908912] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-23T20:09:57.007355] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-23T20:09:57.305980] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-23T20:09:57.306092] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-23T20:09:57.306464] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-23T20:09:57.306505] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-23T20:09:57.307224] [DEBUG] [LOCAL ] MUE: Trimmed 16186 records to 11990 (keeping 200 days of data) [2025-09-23T20:09:57.382007] [DEBUG] [LOCAL ] MUE: Primary data saved (11990 records). [2025-09-23T20:09:57.382166] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-23T20:09:57.382254] [INFO ] [MAIN ] Update Progress: 1430/2372 symbols completed. MUE took 27.0s. Estimated remaining: 2h 5m 6s. Rate: 7.5 symbols/min [2025-09-23T20:09:57.554459] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:09:57.609550] [DEBUG] [LOCAL ] MUR: Loaded 52929 existing records from primary storage. [2025-09-23T20:09:57.609745] [INFO ] [MAIN ] MUR: Loaded 52929 existing records. [2025-09-23T20:09:57.789691] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:09:57.789973] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-23T20:09:57.790025] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-23T20:09:57.791860] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-23T20:09:57.791922] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-23T20:09:57.807896] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-23T20:09:58.154456] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:09:58.602165] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-23T20:09:59.010350] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T20:09:59.042849] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T20:09:59.355270] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T20:09:59.402194] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-23T20:10:00.199446] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T20:10:00.202592] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-23T20:10:01.002257] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-23T20:10:01.802218] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-23T20:10:01.895478] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T20:10:01.925439] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T20:10:02.602216] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-23T20:10:03.402209] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-23T20:10:03.427075] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T20:10:03.431347] [INFO ] [REMOTE ] MUC: Full fetch complete (30091 records). [2025-09-23T20:10:03.431453] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-23T20:10:03.783518] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T20:10:03.833288] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-23T20:10:03.833362] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-23T20:10:03.833972] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-23T20:10:03.834032] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-23T20:10:03.834747] [DEBUG] [LOCAL ] MUC: Trimmed 30091 records to 20165 (keeping 200 days of data) [2025-09-23T20:10:03.954535] [DEBUG] [LOCAL ] MUC: Primary data saved (20165 records). [2025-09-23T20:10:03.954689] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-23T20:10:03.954785] [INFO ] [MAIN ] Update Progress: 1431/2372 symbols completed. MUC took 35.0s. Estimated remaining: 2h 4m 57s. Rate: 7.5 symbols/min [2025-09-23T20:10:04.122667] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:10:04.147513] [DEBUG] [LOCAL ] MUSA: Loaded 25049 existing records from primary storage. [2025-09-23T20:10:04.147639] [INFO ] [MAIN ] MUSA: Loaded 25049 existing records. [2025-09-23T20:10:04.210216] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-23T20:10:04.330407] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:10:04.330661] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-23T20:10:04.330722] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-23T20:10:04.331403] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-23T20:10:04.331463] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-23T20:10:04.694280] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:10:05.002161] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-23T20:10:05.181871] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T20:10:05.278045] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T20:10:05.802172] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-23T20:10:06.037359] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T20:10:06.602198] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-23T20:10:07.402196] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-23T20:10:07.847805] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-23T20:10:07.984785] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T20:10:08.202271] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-23T20:10:08.476106] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T20:10:08.823216] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T20:10:09.002208] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-23T20:10:09.802873] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-23T20:10:09.806891] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T20:10:10.602258] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-23T20:10:11.402174] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-23T20:10:11.686801] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-23T20:10:11.824141] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T20:10:12.142817] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T20:10:12.146066] [INFO ] [REMOTE ] MUJ: Full fetch complete (20333 records). [2025-09-23T20:10:12.146174] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-23T20:10:12.207463] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-23T20:10:12.548314] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-23T20:10:12.548414] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-23T20:10:12.548894] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-23T20:10:12.548958] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-23T20:10:12.549822] [DEBUG] [LOCAL ] MUJ: Trimmed 20333 records to 13307 (keeping 200 days of data) [2025-09-23T20:10:12.634040] [DEBUG] [LOCAL ] MUJ: Primary data saved (13307 records). [2025-09-23T20:10:12.634204] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-23T20:10:12.634332] [INFO ] [MAIN ] Update Progress: 1432/2372 symbols completed. MUJ took 25.1s. Estimated remaining: 2h 4m 49s. Rate: 7.5 symbols/min [2025-09-23T20:10:12.809780] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:10:12.810021] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-23T20:10:12.810078] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-23T20:10:12.810228] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-23T20:10:12.810271] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-23T20:10:12.810314] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-23T20:10:12.810348] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-23T20:10:13.006890] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-23T20:10:13.209127] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:10:13.802177] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-23T20:10:14.185848] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T20:10:14.602180] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-23T20:10:14.632226] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T20:10:14.692200] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T20:10:15.402243] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-23T20:10:16.200869] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T20:10:16.207568] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-23T20:10:17.002322] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-23T20:10:17.208553] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T20:10:17.247889] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-23T20:10:17.802224] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-23T20:10:18.602265] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-23T20:10:18.877592] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-23T20:10:18.878959] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T20:10:18.921435] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-23T20:10:18.931561] [INFO ] [REMOTE ] MUFG: Full fetch complete (75426 records). [2025-09-23T20:10:18.931877] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-23T20:10:19.362979] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-23T20:10:19.363091] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-23T20:10:19.364153] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-23T20:10:19.364220] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-23T20:10:19.365899] [DEBUG] [LOCAL ] MUFG: Trimmed 75426 records to 52623 (keeping 200 days of data) [2025-09-23T20:10:19.421777] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-23T20:10:19.726287] [DEBUG] [LOCAL ] MUFG: Primary data saved (52623 records). [2025-09-23T20:10:19.726510] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-23T20:10:19.726624] [INFO ] [MAIN ] Update Progress: 1433/2372 symbols completed. MUFG took 40.6s. Estimated remaining: 2h 4m 41s. Rate: 7.5 symbols/min [2025-09-23T20:10:19.914691] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:10:19.961167] [DEBUG] [LOCAL ] MUX: Loaded 42394 existing records from primary storage. [2025-09-23T20:10:19.961365] [INFO ] [MAIN ] MUX: Loaded 42394 existing records. [2025-09-23T20:10:20.146268] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:10:20.146603] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-23T20:10:20.146685] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-23T20:10:20.147978] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-23T20:10:20.148042] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-23T20:10:20.213564] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-23T20:10:20.540525] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:10:20.739772] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T20:10:21.002208] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-23T20:10:21.802179] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-23T20:10:22.029313] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:10:22.049300] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-23T20:10:22.051513] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T20:10:22.083725] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T20:10:22.602213] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-23T20:10:23.402216] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-23T20:10:23.704626] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T20:10:24.202222] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-23T20:10:24.552232] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T20:10:25.002191] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-23T20:10:25.213814] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:10:25.214156] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-23T20:10:25.802211] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-23T20:10:26.033282] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-23T20:10:26.067319] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T20:10:26.602196] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-23T20:10:27.402210] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-23T20:10:27.799251] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T20:10:28.202210] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-23T20:10:28.426424] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-23T20:10:29.002205] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-23T20:10:29.145205] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T20:10:29.227495] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-23T20:10:29.802237] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-23T20:10:30.036371] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-23T20:10:30.602223] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-23T20:10:30.825001] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-23T20:10:31.402235] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-23T20:10:32.202265] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-23T20:10:33.002182] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-23T20:10:33.284080] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T20:10:33.315239] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T20:10:33.320866] [INFO ] [REMOTE ] MUSA: Full fetch complete (35000 records). [2025-09-23T20:10:33.320967] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-23T20:10:33.695014] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-23T20:10:33.695099] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-23T20:10:33.695871] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-23T20:10:33.695934] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-23T20:10:33.696822] [DEBUG] [LOCAL ] MUSA: Trimmed 35000 records to 24995 (keeping 200 days of data) [2025-09-23T20:10:33.802268] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-23T20:10:33.858598] [DEBUG] [LOCAL ] MUSA: Primary data saved (24995 records). [2025-09-23T20:10:33.858766] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-23T20:10:33.858859] [INFO ] [MAIN ] Update Progress: 1434/2372 symbols completed. MUSA took 29.9s. Estimated remaining: 2h 4m 37s. Rate: 7.5 symbols/min [2025-09-23T20:10:34.029292] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:10:34.043603] [DEBUG] [LOCAL ] MVF: Loaded 12801 existing records from primary storage. [2025-09-23T20:10:34.043757] [INFO ] [MAIN ] MVF: Loaded 12801 existing records. [2025-09-23T20:10:34.227858] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:10:34.228129] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-23T20:10:34.228177] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-23T20:10:34.228568] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-23T20:10:34.228630] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-23T20:10:34.605900] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-23T20:10:34.619362] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:10:34.648471] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T20:10:34.854392] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-23T20:10:35.402185] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-23T20:10:35.523507] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T20:10:36.127749] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T20:10:36.202210] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-23T20:10:36.986833] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T20:10:37.002192] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-23T20:10:37.802199] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-23T20:10:37.937854] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T20:10:38.602209] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-23T20:10:39.228781] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:10:39.229223] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-23T20:10:39.229344] [INFO ] [REMOTE ] MUSE: Full fetch complete (104 records). [2025-09-23T20:10:39.229436] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-23T20:10:39.230329] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:10:39.230412] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:10:39.230483] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:10:39.230558] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-23T20:10:39.230637] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-23T20:10:39.230721] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-23T20:10:39.231004] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-23T20:10:39.231376] [INFO ] [MAIN ] Update Progress: 1435/2372 symbols completed. MUSE took 26.6s. Estimated remaining: 2h 4m 27s. Rate: 7.5 symbols/min [2025-09-23T20:10:39.414231] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-23T20:10:39.487989] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T20:10:39.491406] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:10:39.522569] [DEBUG] [LOCAL ] MVO: Loaded 9049 existing records from primary storage. [2025-09-23T20:10:39.522813] [INFO ] [MAIN ] MVO: Loaded 9049 existing records. [2025-09-23T20:10:39.718319] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:10:39.718587] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-23T20:10:39.718639] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-23T20:10:39.719121] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-23T20:10:39.719183] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-23T20:10:40.083114] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:10:40.202216] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-23T20:10:40.414446] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T20:10:41.002221] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-23T20:10:41.633835] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T20:10:41.802225] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-23T20:10:41.996970] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T20:10:42.602252] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-23T20:10:43.402254] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-23T20:10:43.530106] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T20:10:43.772489] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T20:10:43.781753] [INFO ] [REMOTE ] MUR: Full fetch complete (76368 records). [2025-09-23T20:10:43.781941] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-23T20:10:44.189727] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-23T20:10:44.189832] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-23T20:10:44.190820] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-23T20:10:44.190887] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-23T20:10:44.192504] [DEBUG] [LOCAL ] MUR: Trimmed 76368 records to 52929 (keeping 200 days of data) [2025-09-23T20:10:44.252443] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-23T20:10:44.579776] [DEBUG] [LOCAL ] MUR: Primary data saved (52929 records). [2025-09-23T20:10:44.579934] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-23T20:10:44.580021] [INFO ] [MAIN ] Update Progress: 1436/2372 symbols completed. MUR took 47.2s. Estimated remaining: 2h 4m 18s. Rate: 7.5 symbols/min [2025-09-23T20:10:44.751993] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:10:44.763598] [DEBUG] [LOCAL ] MVT: Loaded 10049 existing records from primary storage. [2025-09-23T20:10:44.763756] [INFO ] [MAIN ] MVT: Loaded 10049 existing records. [2025-09-23T20:10:44.956009] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:10:44.956410] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-23T20:10:44.956482] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-23T20:10:44.964768] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-23T20:10:44.979048] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-23T20:10:45.011038] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T20:10:45.008273] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-23T20:10:45.315803] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T20:10:45.387918] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:10:45.802170] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-23T20:10:45.959913] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T20:10:46.602213] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-23T20:10:47.400081] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T20:10:47.409261] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-23T20:10:47.552007] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T20:10:48.202180] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-23T20:10:48.387769] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T20:10:49.002183] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-23T20:10:49.025560] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T20:10:49.802221] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-23T20:10:50.537468] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T20:10:50.602176] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-23T20:10:50.740317] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T20:10:51.402186] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-23T20:10:51.416874] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T20:10:52.202284] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-23T20:10:52.226583] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T20:10:53.002245] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-23T20:10:53.240749] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T20:10:53.760844] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T20:10:53.802213] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-23T20:10:54.506343] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T20:10:54.602302] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-23T20:10:55.305941] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T20:10:55.402215] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-23T20:10:56.202222] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-23T20:10:56.378620] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T20:10:56.381919] [INFO ] [REMOTE ] MVF: Full fetch complete (19186 records). [2025-09-23T20:10:56.382059] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-23T20:10:56.760004] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-23T20:10:56.765387] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-23T20:10:56.766684] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T20:10:56.766457] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-23T20:10:56.768832] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-23T20:10:56.770104] [DEBUG] [LOCAL ] MVF: Trimmed 19186 records to 12776 (keeping 200 days of data) [2025-09-23T20:10:56.846387] [DEBUG] [LOCAL ] MVF: Primary data saved (12776 records). [2025-09-23T20:10:56.846545] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-23T20:10:56.846639] [INFO ] [MAIN ] Update Progress: 1437/2372 symbols completed. MVF took 23.0s. Estimated remaining: 2h 4m 12s. Rate: 7.5 symbols/min [2025-09-23T20:10:57.002231] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-23T20:10:57.802248] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-23T20:10:58.568713] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T20:10:58.602255] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-23T20:10:58.707498] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T20:10:58.717246] [INFO ] [REMOTE ] MUX: Full fetch complete (58680 records). [2025-09-23T20:10:58.717396] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-23T20:10:59.104072] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-23T20:10:59.104169] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-23T20:10:59.105056] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-23T20:10:59.105141] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-23T20:10:59.106834] [DEBUG] [LOCAL ] MUX: Trimmed 58680 records to 42469 (keeping 200 days of data) [2025-09-23T20:10:59.368604] [DEBUG] [LOCAL ] MUX: Primary data saved (42469 records). [2025-09-23T20:10:59.368779] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-23T20:10:59.368872] [INFO ] [MAIN ] Update Progress: 1438/2372 symbols completed. MUX took 39.6s. Estimated remaining: 2h 4m 1s. Rate: 7.5 symbols/min [2025-09-23T20:10:59.402261] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-23T20:10:59.430342] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T20:11:00.202262] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-23T20:11:00.215995] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T20:11:01.002319] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-23T20:11:01.136569] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T20:11:01.792080] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T20:11:01.802197] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-23T20:11:02.602247] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-23T20:11:02.793052] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T20:11:03.402276] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-23T20:11:03.524737] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T20:11:03.526930] [INFO ] [REMOTE ] MVO: Full fetch complete (14613 records). [2025-09-23T20:11:03.527009] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-23T20:11:03.892430] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-23T20:11:03.892516] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-23T20:11:03.892861] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-23T20:11:03.892922] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-23T20:11:03.893400] [DEBUG] [LOCAL ] MVO: Trimmed 14613 records to 9070 (keeping 200 days of data) [2025-09-23T20:11:03.945873] [DEBUG] [LOCAL ] MVO: Primary data saved (9070 records). [2025-09-23T20:11:03.945991] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-23T20:11:03.946088] [INFO ] [MAIN ] Update Progress: 1439/2372 symbols completed. MVO took 24.7s. Estimated remaining: 2h 3m 51s. Rate: 7.5 symbols/min [2025-09-23T20:11:04.112177] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T20:11:04.202210] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-23T20:11:04.997453] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T20:11:05.002137] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-23T20:11:05.890716] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T20:11:05.893160] [INFO ] [REMOTE ] MVT: Full fetch complete (14606 records). [2025-09-23T20:11:05.893254] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-23T20:11:06.274720] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-23T20:11:06.274864] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-23T20:11:06.275265] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-23T20:11:06.275344] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-23T20:11:06.276212] [DEBUG] [LOCAL ] MVT: Trimmed 14606 records to 10081 (keeping 200 days of data) [2025-09-23T20:11:06.341667] [DEBUG] [LOCAL ] MVT: Primary data saved (10081 records). [2025-09-23T20:11:06.341836] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-23T20:11:06.341954] [INFO ] [MAIN ] Update Progress: 1440/2372 symbols completed. MVT took 21.8s. Estimated remaining: 2h 3m 39s. Rate: 7.5 symbols/min [2025-09-23T20:11:07.065228] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:07.064027] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:07.102233] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:07.106451] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-23T20:11:07.108756] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-23T20:11:07.108273] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:07.109174] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-23T20:11:07.109354] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-23T20:11:07.109449] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-23T20:11:07.109501] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-23T20:11:07.207109] [DEBUG] [LOCAL ] MXF: Loaded 6012 existing records from primary storage. [2025-09-23T20:11:07.219859] [INFO ] [MAIN ] MXF: Loaded 6012 existing records. [2025-09-23T20:11:07.362321] [DEBUG] [LOCAL ] MX: Loaded 22982 existing records from primary storage. [2025-09-23T20:11:07.390626] [INFO ] [MAIN ] MX: Loaded 22982 existing records. [2025-09-23T20:11:07.645717] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:11:07.708983] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-23T20:11:07.745409] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-23T20:11:07.767327] [DEBUG] [LOCAL ] MWA: Loaded 47143 existing records from primary storage. [2025-09-23T20:11:07.782720] [INFO ] [MAIN ] MWA: Loaded 47143 existing records. [2025-09-23T20:11:07.788666] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-23T20:11:07.799276] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-23T20:11:08.040617] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:11:08.090783] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-23T20:11:08.109553] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-23T20:11:08.094376] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:08.125515] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-23T20:11:08.135908] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-23T20:11:08.159789] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-23T20:11:08.548438] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:11:08.632519] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-23T20:11:08.720704] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-23T20:11:08.722908] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T20:11:08.763050] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-23T20:11:08.785688] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-23T20:11:08.785486] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-23T20:11:09.442136] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-23T20:11:09.446530] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:09.473813] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-23T20:11:09.514909] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-23T20:11:09.610057] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:09.640031] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-23T20:11:09.887504] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:09.887956] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-23T20:11:10.100116] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T20:11:10.463115] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T20:11:10.602206] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-23T20:11:10.718900] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T20:11:11.174953] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T20:11:11.198931] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T20:11:11.402279] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-23T20:11:11.916928] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T20:11:12.202212] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-23T20:11:13.002210] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-23T20:11:13.165512] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T20:11:13.698481] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T20:11:13.802215] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-23T20:11:14.602195] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-23T20:11:15.064852] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T20:11:15.342073] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T20:11:15.402200] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-23T20:11:15.830527] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T20:11:16.202207] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-23T20:11:17.002222] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-23T20:11:17.261362] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T20:11:17.802212] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-23T20:11:18.309746] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T20:11:18.602160] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-23T20:11:19.004439] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T20:11:19.092951] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-23T20:11:19.402279] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-23T20:11:20.202193] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-23T20:11:20.569386] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T20:11:21.002208] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-23T20:11:21.568704] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T20:11:21.802206] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-23T20:11:22.251257] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T20:11:22.320254] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T20:11:22.602212] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-23T20:11:23.381715] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T20:11:23.402181] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-23T20:11:24.016634] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T20:11:24.202255] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-23T20:11:24.741127] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-23T20:11:25.002271] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-23T20:11:25.802188] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-23T20:11:26.013936] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T20:11:26.602266] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-23T20:11:27.402169] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-23T20:11:27.568689] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T20:11:27.631219] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T20:11:27.871545] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T20:11:28.202193] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-23T20:11:29.002241] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-23T20:11:29.558024] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T20:11:29.559148] [INFO ] [REMOTE ] MXF: Full fetch complete (10513 records). [2025-09-23T20:11:29.559227] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-23T20:11:29.807470] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-23T20:11:29.940842] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-23T20:11:29.940997] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-23T20:11:29.941354] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-23T20:11:29.941472] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-23T20:11:29.942225] [DEBUG] [LOCAL ] MXF: Trimmed 10513 records to 6002 (keeping 200 days of data) [2025-09-23T20:11:30.011360] [DEBUG] [LOCAL ] MXF: Primary data saved (6002 records). [2025-09-23T20:11:30.013999] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T20:11:30.014218] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-23T20:11:30.024007] [INFO ] [MAIN ] Update Progress: 1441/2372 symbols completed. MXF took 23.7s. Estimated remaining: 2h 3m 41s. Rate: 7.5 symbols/min [2025-09-23T20:11:30.194436] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:30.214902] [DEBUG] [LOCAL ] MYD: Loaded 13748 existing records from primary storage. [2025-09-23T20:11:30.215044] [INFO ] [MAIN ] MYD: Loaded 13748 existing records. [2025-09-23T20:11:30.393164] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:11:30.393426] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-23T20:11:30.393493] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-23T20:11:30.394197] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-23T20:11:30.394257] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-23T20:11:30.607406] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-23T20:11:30.764558] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:31.184691] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T20:11:31.204116] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T20:11:31.402224] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-23T20:11:31.866481] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T20:11:32.202254] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-23T20:11:33.002220] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-23T20:11:33.802256] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-23T20:11:33.850603] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T20:11:34.212526] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T20:11:34.216831] [INFO ] [REMOTE ] MX: Full fetch complete (31842 records). [2025-09-23T20:11:34.216944] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-23T20:11:34.616217] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-23T20:11:34.635301] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-23T20:11:34.643845] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-23T20:11:34.644696] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-23T20:11:34.645458] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-23T20:11:34.646269] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T20:11:34.652737] [DEBUG] [LOCAL ] MX: Trimmed 31842 records to 23049 (keeping 200 days of data) [2025-09-23T20:11:34.804276] [DEBUG] [LOCAL ] MX: Primary data saved (23049 records). [2025-09-23T20:11:34.804420] [INFO ] [MAIN ] MX: Full history saved. [2025-09-23T20:11:34.804521] [INFO ] [MAIN ] Update Progress: 1442/2372 symbols completed. MX took 28.4s. Estimated remaining: 2h 3m 31s. Rate: 7.5 symbols/min [2025-09-23T20:11:34.979945] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:35.010200] [DEBUG] [LOCAL ] MYE: Loaded 25322 existing records from primary storage. [2025-09-23T20:11:35.010345] [INFO ] [MAIN ] MYE: Loaded 25322 existing records. [2025-09-23T20:11:35.104269] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T20:11:35.199544] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:11:35.201512] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-23T20:11:35.201570] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-23T20:11:35.202921] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-23T20:11:35.202983] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-23T20:11:35.409182] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-23T20:11:35.561624] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:36.202197] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-23T20:11:37.002200] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-23T20:11:37.105509] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T20:11:37.170711] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T20:11:37.394026] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T20:11:37.395190] [INFO ] [REMOTE ] MXE: Full fetch complete (2685 records). [2025-09-23T20:11:37.395261] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-23T20:11:37.573730] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T20:11:37.573950] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:11:37.574018] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:11:37.574109] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-23T20:11:37.574173] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-23T20:11:37.574210] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-23T20:11:37.574249] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-23T20:11:37.574312] [INFO ] [MAIN ] Update Progress: 1443/2372 symbols completed. MXE took 31.2s. Estimated remaining: 2h 3m 20s. Rate: 7.5 symbols/min [2025-09-23T20:11:37.760111] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:37.796223] [DEBUG] [LOCAL ] MYI: Loaded 19310 existing records from primary storage. [2025-09-23T20:11:37.796387] [INFO ] [MAIN ] MYI: Loaded 19310 existing records. [2025-09-23T20:11:37.807383] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-23T20:11:37.984510] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:11:37.984849] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-23T20:11:37.984906] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-23T20:11:37.985707] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-23T20:11:37.985768] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-23T20:11:38.342990] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:38.602209] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-23T20:11:39.402220] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-23T20:11:39.445293] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T20:11:39.892774] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T20:11:40.202232] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-23T20:11:40.400275] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T20:11:41.002201] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-23T20:11:41.802205] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-23T20:11:42.038607] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T20:11:42.062255] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T20:11:42.067307] [INFO ] [REMOTE ] MWA: Full fetch complete (67839 records). [2025-09-23T20:11:42.068214] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-23T20:11:42.499357] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-23T20:11:42.499462] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-23T20:11:42.500409] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-23T20:11:42.500481] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-23T20:11:42.502017] [DEBUG] [LOCAL ] MWA: Trimmed 67839 records to 47125 (keeping 200 days of data) [2025-09-23T20:11:42.607933] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-23T20:11:42.662310] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T20:11:42.834163] [DEBUG] [LOCAL ] MWA: Primary data saved (47125 records). [2025-09-23T20:11:42.834313] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-23T20:11:42.834416] [INFO ] [MAIN ] Update Progress: 1444/2372 symbols completed. MWA took 36.5s. Estimated remaining: 2h 3m 10s. Rate: 7.5 symbols/min [2025-09-23T20:11:43.016475] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:43.031032] [DEBUG] [LOCAL ] MYN: Loaded 10334 existing records from primary storage. [2025-09-23T20:11:43.031277] [INFO ] [MAIN ] MYN: Loaded 10334 existing records. [2025-09-23T20:11:43.227518] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:11:43.227830] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-23T20:11:43.227883] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-23T20:11:43.228429] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-23T20:11:43.228493] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-23T20:11:43.405371] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-23T20:11:43.648922] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:43.807531] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T20:11:44.202161] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-23T20:11:44.564153] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T20:11:45.002205] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-23T20:11:45.238537] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T20:11:45.523575] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T20:11:45.802218] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-23T20:11:46.602202] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-23T20:11:47.008801] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T20:11:47.402229] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-23T20:11:47.458320] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T20:11:48.209878] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-23T20:11:48.218510] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T20:11:49.002226] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-23T20:11:49.193798] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T20:11:49.802217] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-23T20:11:50.017797] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T20:11:50.602290] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-23T20:11:51.126432] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T20:11:51.384566] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T20:11:51.402215] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-23T20:11:52.202235] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-23T20:11:52.307754] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T20:11:53.002242] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-23T20:11:53.036684] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T20:11:53.785784] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T20:11:53.802197] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-23T20:11:54.571497] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T20:11:54.602174] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-23T20:11:55.402164] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-23T20:11:55.710118] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T20:11:56.202261] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-23T20:11:56.215090] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T20:11:57.002265] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-23T20:11:57.564381] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T20:11:57.630050] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T20:11:57.632710] [INFO ] [REMOTE ] MYD: Full fetch complete (20789 records). [2025-09-23T20:11:57.632786] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-23T20:11:57.807623] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-23T20:11:58.049420] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-23T20:11:58.049507] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-23T20:11:58.050024] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-23T20:11:58.050099] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-23T20:11:58.050785] [DEBUG] [LOCAL ] MYD: Trimmed 20789 records to 13760 (keeping 200 days of data) [2025-09-23T20:11:58.143927] [DEBUG] [LOCAL ] MYD: Primary data saved (13760 records). [2025-09-23T20:11:58.144065] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-23T20:11:58.144147] [INFO ] [MAIN ] Update Progress: 1445/2372 symbols completed. MYD took 28.1s. Estimated remaining: 2h 3m 7s. Rate: 7.5 symbols/min [2025-09-23T20:11:58.318978] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:11:58.363104] [DEBUG] [LOCAL ] NABL: Loaded 40033 existing records from primary storage. [2025-09-23T20:11:58.363244] [INFO ] [MAIN ] NABL: Loaded 40033 existing records. [2025-09-23T20:11:58.551153] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:11:58.551377] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-23T20:11:58.551428] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-23T20:11:58.552481] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-23T20:11:58.552545] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-23T20:11:58.607266] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-23T20:11:58.926136] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:11:58.935621] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T20:11:59.402194] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-23T20:11:59.421278] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T20:12:00.202183] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-23T20:12:00.424175] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T20:12:01.002178] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-23T20:12:01.425580] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T20:12:01.802274] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-23T20:12:02.602236] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-23T20:12:03.210816] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-23T20:12:03.402255] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-23T20:12:04.202215] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-23T20:12:04.604587] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-23T20:12:04.819325] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T20:12:04.864691] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T20:12:05.002249] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-23T20:12:05.161707] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T20:12:05.802240] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-23T20:12:06.074158] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T20:12:06.602220] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-23T20:12:07.204562] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T20:12:07.385274] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T20:12:07.402145] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-23T20:12:08.202227] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-23T20:12:08.710372] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T20:12:08.715424] [INFO ] [REMOTE ] MYI: Full fetch complete (29508 records). [2025-09-23T20:12:08.715512] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-23T20:12:09.006277] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-23T20:12:09.100624] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-23T20:12:09.100763] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-23T20:12:09.101532] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-23T20:12:09.101635] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-23T20:12:09.115875] [DEBUG] [LOCAL ] MYI: Trimmed 29508 records to 19317 (keeping 200 days of data) [2025-09-23T20:12:09.117282] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T20:12:09.254669] [DEBUG] [LOCAL ] MYI: Primary data saved (19317 records). [2025-09-23T20:12:09.254878] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-23T20:12:09.254976] [INFO ] [MAIN ] Update Progress: 1446/2372 symbols completed. MYI took 31.7s. Estimated remaining: 2h 3m 1s. Rate: 7.5 symbols/min [2025-09-23T20:12:09.429360] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:12:09.454915] [DEBUG] [LOCAL ] NAC: Loaded 24636 existing records from primary storage. [2025-09-23T20:12:09.455059] [INFO ] [MAIN ] NAC: Loaded 24636 existing records. [2025-09-23T20:12:09.641288] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:12:09.649800] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-23T20:12:09.650069] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T20:12:09.650220] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-23T20:12:09.654016] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-23T20:12:09.654094] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-23T20:12:09.812349] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-23T20:12:10.044447] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:12:10.436915] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T20:12:10.602191] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-23T20:12:11.181888] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T20:12:11.184536] [INFO ] [REMOTE ] MYN: Full fetch complete (15553 records). [2025-09-23T20:12:11.184611] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-23T20:12:11.407533] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-23T20:12:11.564615] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-23T20:12:11.564748] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-23T20:12:11.565287] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-23T20:12:11.565349] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-23T20:12:11.566056] [DEBUG] [LOCAL ] MYN: Trimmed 15553 records to 10315 (keeping 200 days of data) [2025-09-23T20:12:11.630305] [DEBUG] [LOCAL ] MYN: Primary data saved (10315 records). [2025-09-23T20:12:11.630480] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-23T20:12:11.630600] [INFO ] [MAIN ] Update Progress: 1447/2372 symbols completed. MYN took 28.8s. Estimated remaining: 2h 2m 50s. Rate: 7.5 symbols/min [2025-09-23T20:12:11.815870] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:12:11.860271] [DEBUG] [LOCAL ] NAD: Loaded 34029 existing records from primary storage. [2025-09-23T20:12:11.860421] [INFO ] [MAIN ] NAD: Loaded 34029 existing records. [2025-09-23T20:12:12.036147] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:12:12.036408] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-23T20:12:12.036475] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-23T20:12:12.037898] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-23T20:12:12.037963] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-23T20:12:12.208605] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-23T20:12:12.395957] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:12:12.877402] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T20:12:13.002203] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-23T20:12:13.223511] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T20:12:13.802181] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-23T20:12:13.930968] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T20:12:13.935445] [INFO ] [REMOTE ] MYE: Full fetch complete (36871 records). [2025-09-23T20:12:13.935563] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-23T20:12:14.341894] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-23T20:12:14.341994] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-23T20:12:14.342816] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-23T20:12:14.342879] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-23T20:12:14.343760] [DEBUG] [LOCAL ] MYE: Trimmed 36871 records to 25195 (keeping 200 days of data) [2025-09-23T20:12:14.511207] [DEBUG] [LOCAL ] MYE: Primary data saved (25195 records). [2025-09-23T20:12:14.511356] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-23T20:12:14.511446] [INFO ] [MAIN ] Update Progress: 1448/2372 symbols completed. MYE took 39.7s. Estimated remaining: 2h 2m 38s. Rate: 7.5 symbols/min [2025-09-23T20:12:14.607358] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-23T20:12:14.707109] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:12:14.718023] [DEBUG] [LOCAL ] NAN: Loaded 9054 existing records from primary storage. [2025-09-23T20:12:14.718156] [INFO ] [MAIN ] NAN: Loaded 9054 existing records. [2025-09-23T20:12:14.901344] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:12:14.901715] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-23T20:12:14.901775] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-23T20:12:14.902188] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-23T20:12:14.902276] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-23T20:12:15.292267] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:12:15.402195] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-23T20:12:15.518180] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T20:12:16.202201] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-23T20:12:16.732129] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T20:12:16.869320] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T20:12:17.002174] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-23T20:12:17.085973] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-23T20:12:17.802199] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-23T20:12:18.220187] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T20:12:18.602197] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-23T20:12:18.933232] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T20:12:19.402199] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-23T20:12:19.908996] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T20:12:20.202193] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-23T20:12:20.374147] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T20:12:21.002193] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-23T20:12:21.803563] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-23T20:12:21.824233] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T20:12:21.967782] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T20:12:22.602218] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-23T20:12:23.326508] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T20:12:23.363449] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T20:12:23.402184] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-23T20:12:24.202205] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-23T20:12:24.957365] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T20:12:25.002158] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-23T20:12:25.259624] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T20:12:25.802236] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-23T20:12:26.338043] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T20:12:26.360118] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T20:12:26.602189] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-23T20:12:27.402159] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-23T20:12:27.553760] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T20:12:28.202169] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-23T20:12:28.595466] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T20:12:29.002251] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-23T20:12:29.571308] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T20:12:29.802277] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-23T20:12:30.082029] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T20:12:30.546810] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T20:12:30.602183] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-23T20:12:31.338736] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T20:12:31.402274] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-23T20:12:32.202243] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-23T20:12:32.507473] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T20:12:33.002208] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-23T20:12:33.134424] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T20:12:33.392567] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T20:12:33.802202] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-23T20:12:34.602228] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-23T20:12:35.076776] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T20:12:35.081702] [INFO ] [REMOTE ] NAC: Full fetch complete (36308 records). [2025-09-23T20:12:35.081810] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-23T20:12:35.416300] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-23T20:12:35.470260] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-23T20:12:35.470350] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-23T20:12:35.471103] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-23T20:12:35.471166] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-23T20:12:35.472071] [DEBUG] [LOCAL ] NAC: Trimmed 36308 records to 24661 (keeping 200 days of data) [2025-09-23T20:12:35.628246] [DEBUG] [LOCAL ] NAC: Primary data saved (24661 records). [2025-09-23T20:12:35.628380] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-23T20:12:35.628477] [INFO ] [MAIN ] Update Progress: 1449/2372 symbols completed. NAC took 26.4s. Estimated remaining: 2h 2m 39s. Rate: 7.5 symbols/min [2025-09-23T20:12:35.801366] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:12:35.851099] [DEBUG] [LOCAL ] NAT: Loaded 49108 existing records from primary storage. [2025-09-23T20:12:35.851264] [INFO ] [MAIN ] NAT: Loaded 49108 existing records. [2025-09-23T20:12:36.034881] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:12:36.035555] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-23T20:12:36.035672] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-23T20:12:36.043021] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-23T20:12:36.048362] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-23T20:12:36.147182] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T20:12:36.218258] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-23T20:12:36.298439] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T20:12:36.480264] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:12:37.002222] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-23T20:12:37.503823] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T20:12:37.802191] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-23T20:12:37.826171] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T20:12:38.602204] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-23T20:12:39.245544] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T20:12:39.252734] [INFO ] [REMOTE ] NABL: Full fetch complete (56726 records). [2025-09-23T20:12:39.252923] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-23T20:12:39.416177] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-23T20:12:39.468827] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T20:12:39.513627] [INFO ] [REMOTE ] NAN: Full fetch complete (14117 records). [2025-09-23T20:12:39.519115] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-23T20:12:39.884686] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-23T20:12:39.903389] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-23T20:12:39.915221] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-23T20:12:39.956870] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-23T20:12:40.022552] [DEBUG] [LOCAL ] NABL: Trimmed 56726 records to 39949 (keeping 200 days of data) [2025-09-23T20:12:40.156698] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-23T20:12:40.182112] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-23T20:12:40.182987] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-23T20:12:40.183324] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-23T20:12:40.186713] [DEBUG] [LOCAL ] NAN: Trimmed 14117 records to 9048 (keeping 200 days of data) [2025-09-23T20:12:40.223847] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-23T20:12:40.270467] [DEBUG] [LOCAL ] NAN: Primary data saved (9048 records). [2025-09-23T20:12:40.271504] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-23T20:12:40.271943] [INFO ] [MAIN ] Update Progress: 1450/2372 symbols completed. NAN took 25.8s. Estimated remaining: 2h 2m 29s. Rate: 7.5 symbols/min [2025-09-23T20:12:40.542427] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:12:40.587702] [DEBUG] [LOCAL ] NATL: Loaded 32779 existing records from primary storage. [2025-09-23T20:12:40.588785] [INFO ] [MAIN ] NATL: Loaded 32779 existing records. [2025-09-23T20:12:40.759363] [DEBUG] [LOCAL ] NABL: Primary data saved (39949 records). [2025-09-23T20:12:40.781616] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-23T20:12:40.786207] [INFO ] [MAIN ] Update Progress: 1451/2372 symbols completed. NABL took 42.6s. Estimated remaining: 2h 2m 16s. Rate: 7.5 symbols/min [2025-09-23T20:12:40.786337] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:12:40.798036] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-23T20:12:40.818177] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-23T20:12:40.861527] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-23T20:12:40.877041] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-23T20:12:41.080586] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:12:41.212226] [DEBUG] [LOCAL ] NAZ: Loaded 2636 existing records from primary storage. [2025-09-23T20:12:41.223304] [INFO ] [MAIN ] NAZ: Loaded 2636 existing records. [2025-09-23T20:12:41.457617] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:12:41.515994] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-23T20:12:41.522736] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:12:41.524071] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-23T20:12:41.524183] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-23T20:12:41.524528] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-23T20:12:41.524589] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-23T20:12:41.841494] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T20:12:41.913548] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-23T20:12:41.960237] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:12:42.279828] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-23T20:12:42.466853] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T20:12:42.602194] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-23T20:12:43.259971] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T20:12:43.402136] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-23T20:12:43.859291] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T20:12:44.202247] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-23T20:12:44.757864] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T20:12:44.763731] [INFO ] [REMOTE ] NAD: Full fetch complete (50190 records). [2025-09-23T20:12:44.763848] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-23T20:12:44.875306] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T20:12:45.007436] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-23T20:12:45.154943] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-23T20:12:45.155028] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-23T20:12:45.155847] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-23T20:12:45.155908] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-23T20:12:45.156917] [DEBUG] [LOCAL ] NAD: Trimmed 50190 records to 34040 (keeping 200 days of data) [2025-09-23T20:12:45.358093] [DEBUG] [LOCAL ] NAD: Primary data saved (34040 records). [2025-09-23T20:12:45.358241] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-23T20:12:45.358346] [INFO ] [MAIN ] Update Progress: 1452/2372 symbols completed. NAD took 33.7s. Estimated remaining: 2h 2m 6s. Rate: 7.5 symbols/min [2025-09-23T20:12:45.525952] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:12:45.536497] [DEBUG] [LOCAL ] NBB: Loaded 8877 existing records from primary storage. [2025-09-23T20:12:45.536608] [INFO ] [MAIN ] NBB: Loaded 8877 existing records. [2025-09-23T20:12:45.713410] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:12:45.713708] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-23T20:12:45.713764] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-23T20:12:45.714117] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-23T20:12:45.714176] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-23T20:12:45.807310] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-23T20:12:46.078266] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:12:46.602159] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-23T20:12:47.006867] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-23T20:12:47.030286] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T20:12:47.205718] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T20:12:47.402166] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-23T20:12:47.957502] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T20:12:48.202257] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-23T20:12:49.002194] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-23T20:12:49.799596] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T20:12:49.808583] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-23T20:12:49.906558] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T20:12:50.386242] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T20:12:50.602260] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-23T20:12:51.250745] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T20:12:51.402200] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-23T20:12:52.202215] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-23T20:12:53.002229] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-23T20:12:53.212839] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T20:12:53.509230] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T20:12:53.802335] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-23T20:12:53.977610] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T20:12:54.399442] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T20:12:54.602232] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-23T20:12:55.402251] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-23T20:12:55.866000] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T20:12:56.202207] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-23T20:12:56.437763] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T20:12:56.680397] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T20:12:57.002203] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-23T20:12:57.562963] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T20:12:57.802205] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-23T20:12:58.352472] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T20:12:58.602205] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-23T20:12:59.402214] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-23T20:13:00.138778] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-23T20:13:00.202182] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-23T20:13:00.319511] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T20:13:01.002228] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-23T20:13:01.301896] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T20:13:01.465615] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T20:13:01.466921] [INFO ] [REMOTE ] NAZ: Full fetch complete (4391 records). [2025-09-23T20:13:01.466995] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-23T20:13:01.816520] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-23T20:13:01.869213] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-23T20:13:01.869329] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-23T20:13:01.869946] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-23T20:13:01.870134] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-23T20:13:01.870728] [DEBUG] [LOCAL ] NAZ: Trimmed 4391 records to 2624 (keeping 200 days of data) [2025-09-23T20:13:01.888174] [DEBUG] [LOCAL ] NAZ: Primary data saved (2624 records). [2025-09-23T20:13:01.888316] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-23T20:13:01.888439] [INFO ] [MAIN ] Update Progress: 1453/2372 symbols completed. NAZ took 21.1s. Estimated remaining: 2h 2m 3s. Rate: 7.5 symbols/min [2025-09-23T20:13:02.066069] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:13:02.088759] [DEBUG] [LOCAL ] NBHC: Loaded 23082 existing records from primary storage. [2025-09-23T20:13:02.088923] [INFO ] [MAIN ] NBHC: Loaded 23082 existing records. [2025-09-23T20:13:02.271148] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:13:02.271416] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-23T20:13:02.271466] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-23T20:13:02.272206] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-23T20:13:02.272510] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-23T20:13:02.624800] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-23T20:13:02.629712] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:13:03.402181] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-23T20:13:03.562878] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T20:13:03.607318] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T20:13:04.202274] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-23T20:13:04.249450] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T20:13:04.991156] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T20:13:05.002141] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-23T20:13:05.746315] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T20:13:05.802202] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-23T20:13:06.521689] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T20:13:06.602223] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-23T20:13:07.402198] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-23T20:13:07.483219] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T20:13:08.202291] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-23T20:13:09.006151] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-23T20:13:09.013383] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T20:13:09.331307] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T20:13:09.504884] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T20:13:09.802255] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-23T20:13:10.602203] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-23T20:13:11.175101] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T20:13:11.402196] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-23T20:13:12.101542] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T20:13:12.147843] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T20:13:12.202220] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-23T20:13:13.002193] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-23T20:13:13.205301] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T20:13:13.632424] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T20:13:13.634706] [INFO ] [REMOTE ] NBB: Full fetch complete (13910 records). [2025-09-23T20:13:13.634803] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-23T20:13:13.802158] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-23T20:13:14.019739] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-23T20:13:14.019842] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-23T20:13:14.020217] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-23T20:13:14.020289] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-23T20:13:14.020936] [DEBUG] [LOCAL ] NBB: Trimmed 13910 records to 8868 (keeping 200 days of data) [2025-09-23T20:13:14.079581] [DEBUG] [LOCAL ] NBB: Primary data saved (8868 records). [2025-09-23T20:13:14.079754] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-23T20:13:14.079883] [INFO ] [MAIN ] Update Progress: 1454/2372 symbols completed. NBB took 28.7s. Estimated remaining: 2h 1m 58s. Rate: 7.5 symbols/min [2025-09-23T20:13:14.248291] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:13:14.289918] [DEBUG] [LOCAL ] NBR: Loaded 34821 existing records from primary storage. [2025-09-23T20:13:14.290085] [INFO ] [MAIN ] NBR: Loaded 34821 existing records. [2025-09-23T20:13:14.473230] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:13:14.473539] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-23T20:13:14.473612] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-23T20:13:14.474593] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-23T20:13:14.474693] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-23T20:13:14.610348] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-23T20:13:14.872682] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:13:15.051500] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T20:13:15.402197] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-23T20:13:15.493910] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T20:13:16.202206] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-23T20:13:16.804055] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T20:13:17.002199] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-23T20:13:17.641735] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T20:13:17.648143] [INFO ] [REMOTE ] NATL: Full fetch complete (45621 records). [2025-09-23T20:13:17.648333] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-23T20:13:17.807272] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-23T20:13:18.093375] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-23T20:13:18.093465] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-23T20:13:18.094318] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-23T20:13:18.094389] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-23T20:13:18.095629] [DEBUG] [LOCAL ] NATL: Trimmed 45621 records to 32802 (keeping 200 days of data) [2025-09-23T20:13:18.300875] [DEBUG] [LOCAL ] NATL: Primary data saved (32802 records). [2025-09-23T20:13:18.301016] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-23T20:13:18.301118] [INFO ] [MAIN ] Update Progress: 1455/2372 symbols completed. NATL took 38.0s. Estimated remaining: 2h 1m 48s. Rate: 7.5 symbols/min [2025-09-23T20:13:18.485370] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:13:18.510133] [DEBUG] [LOCAL ] NBXG: Loaded 22674 existing records from primary storage. [2025-09-23T20:13:18.510274] [INFO ] [MAIN ] NBXG: Loaded 22674 existing records. [2025-09-23T20:13:18.602977] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-23T20:13:18.696623] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:13:18.696903] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-23T20:13:18.696972] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-23T20:13:18.697611] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-23T20:13:18.697722] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-23T20:13:19.097198] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:13:19.099454] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-23T20:13:19.109546] [INFO ] [REMOTE ] NAT: Full fetch complete (72181 records). [2025-09-23T20:13:19.109717] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-23T20:13:19.233543] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T20:13:19.408278] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-23T20:13:19.560057] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-23T20:13:19.560186] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-23T20:13:19.561751] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-23T20:13:19.561871] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-23T20:13:19.581110] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T20:13:19.587367] [DEBUG] [LOCAL ] NAT: Trimmed 72181 records to 49132 (keeping 200 days of data) [2025-09-23T20:13:19.896089] [DEBUG] [LOCAL ] NAT: Primary data saved (49132 records). [2025-09-23T20:13:19.896225] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-23T20:13:19.896344] [INFO ] [MAIN ] Update Progress: 1456/2372 symbols completed. NAT took 44.3s. Estimated remaining: 2h 1m 36s. Rate: 7.5 symbols/min [2025-09-23T20:13:20.067403] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:13:20.071500] [DEBUG] [LOCAL ] NC: Loaded 1907 existing records from primary storage. [2025-09-23T20:13:20.071583] [INFO ] [MAIN ] NC: Loaded 1907 existing records. [2025-09-23T20:13:20.209979] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-23T20:13:20.254958] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:13:20.255750] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-23T20:13:20.255807] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-23T20:13:20.256004] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-23T20:13:20.256062] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-23T20:13:20.626661] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:13:20.817986] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T20:13:21.001671] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T20:13:21.007067] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-23T20:13:21.802209] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-23T20:13:22.602181] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-23T20:13:22.660747] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T20:13:22.897949] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T20:13:23.076133] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-23T20:13:23.402210] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-23T20:13:24.202226] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-23T20:13:24.414570] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T20:13:25.002221] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-23T20:13:25.549058] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T20:13:25.574921] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T20:13:25.802224] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-23T20:13:26.602194] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-23T20:13:26.915336] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T20:13:27.239747] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T20:13:27.402243] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-23T20:13:28.202238] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-23T20:13:28.399340] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T20:13:28.530733] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T20:13:29.002250] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-23T20:13:29.802237] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-23T20:13:30.412818] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T20:13:30.528089] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T20:13:30.602174] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-23T20:13:31.402279] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-23T20:13:31.741593] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T20:13:31.861551] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T20:13:32.202205] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-23T20:13:33.002266] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-23T20:13:33.681387] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T20:13:33.777341] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T20:13:33.802157] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-23T20:13:34.602218] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-23T20:13:34.870780] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T20:13:34.913508] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-23T20:13:35.402200] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-23T20:13:36.202180] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-23T20:13:36.590472] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T20:13:36.813777] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T20:13:37.002252] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-23T20:13:37.802222] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-23T20:13:37.994323] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T20:13:38.097835] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-23T20:13:38.602238] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-23T20:13:39.402204] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-23T20:13:40.007989] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T20:13:40.171467] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T20:13:40.202163] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-23T20:13:41.002200] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-23T20:13:41.759593] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T20:13:41.767393] [INFO ] [REMOTE ] NBR: Full fetch complete (49457 records). [2025-09-23T20:13:41.767504] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-23T20:13:41.807298] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-23T20:13:41.891713] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T20:13:42.204416] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-23T20:13:42.204567] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-23T20:13:42.205381] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-23T20:13:42.205445] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-23T20:13:42.206565] [DEBUG] [LOCAL ] NBR: Trimmed 49457 records to 34912 (keeping 200 days of data) [2025-09-23T20:13:42.309912] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T20:13:42.422076] [DEBUG] [LOCAL ] NBR: Primary data saved (34912 records). [2025-09-23T20:13:42.422227] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-23T20:13:42.422346] [INFO ] [MAIN ] Update Progress: 1457/2372 symbols completed. NBR took 28.3s. Estimated remaining: 2h 1m 37s. Rate: 7.5 symbols/min [2025-09-23T20:13:42.593857] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:13:42.602208] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-23T20:13:42.607746] [DEBUG] [LOCAL ] NCA: Loaded 10054 existing records from primary storage. [2025-09-23T20:13:42.607849] [INFO ] [MAIN ] NCA: Loaded 10054 existing records. [2025-09-23T20:13:42.786290] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:13:42.786599] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-23T20:13:42.786685] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-23T20:13:42.787248] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-23T20:13:42.787312] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-23T20:13:43.149280] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:13:43.182026] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T20:13:43.183411] [INFO ] [REMOTE ] NC: Full fetch complete (2710 records). [2025-09-23T20:13:43.183506] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-23T20:13:43.407379] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-23T20:13:43.552787] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-23T20:13:43.552876] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-23T20:13:43.552996] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-23T20:13:43.553120] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-23T20:13:43.553479] [DEBUG] [LOCAL ] NC: Trimmed 2710 records to 1907 (keeping 200 days of data) [2025-09-23T20:13:43.565366] [DEBUG] [LOCAL ] NC: Primary data saved (1907 records). [2025-09-23T20:13:43.565429] [INFO ] [MAIN ] NC: Full history saved. [2025-09-23T20:13:43.565498] [INFO ] [MAIN ] Update Progress: 1458/2372 symbols completed. NC took 23.7s. Estimated remaining: 2h 1m 25s. Rate: 7.5 symbols/min [2025-09-23T20:13:43.732664] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:13:43.763024] [DEBUG] [LOCAL ] NCDL: Loaded 21696 existing records from primary storage. [2025-09-23T20:13:43.763173] [INFO ] [MAIN ] NCDL: Loaded 21696 existing records. [2025-09-23T20:13:43.937754] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:13:43.938031] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-23T20:13:43.938079] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-23T20:13:43.938897] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-23T20:13:43.938957] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-23T20:13:44.210224] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-23T20:13:44.310997] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:13:44.537029] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T20:13:44.540801] [INFO ] [REMOTE ] NBXG: Full fetch complete (33050 records). [2025-09-23T20:13:44.540919] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-23T20:13:44.914039] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-23T20:13:44.914126] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-23T20:13:44.914776] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-23T20:13:44.914838] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-23T20:13:44.915803] [DEBUG] [LOCAL ] NBXG: Trimmed 33050 records to 22623 (keeping 200 days of data) [2025-09-23T20:13:45.008752] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-23T20:13:45.061942] [DEBUG] [LOCAL ] NBXG: Primary data saved (22623 records). [2025-09-23T20:13:45.062069] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-23T20:13:45.062149] [INFO ] [MAIN ] Update Progress: 1459/2372 symbols completed. NBXG took 26.8s. Estimated remaining: 2h 1m 13s. Rate: 7.5 symbols/min [2025-09-23T20:13:45.230948] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:13:45.288507] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-23T20:13:45.288693] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-09-23T20:13:45.411859] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T20:13:45.487292] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:13:45.487577] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-23T20:13:45.487670] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-23T20:13:45.489558] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-23T20:13:45.489665] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-23T20:13:45.807063] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-23T20:13:45.876461] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:13:45.903956] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T20:13:46.602211] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-23T20:13:47.212807] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T20:13:47.402159] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-23T20:13:48.202163] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-23T20:13:48.409207] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T20:13:48.532723] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T20:13:48.665744] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T20:13:49.002224] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-23T20:13:49.802220] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-23T20:13:50.602177] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-23T20:13:50.723713] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T20:13:50.990499] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T20:13:51.402223] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-23T20:13:51.909725] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T20:13:51.915386] [INFO ] [REMOTE ] NBHC: Full fetch complete (31866 records). [2025-09-23T20:13:51.915494] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-23T20:13:52.202611] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-23T20:13:52.250346] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T20:13:52.319153] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-23T20:13:52.319249] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-23T20:13:52.320028] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-23T20:13:52.320093] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-23T20:13:52.321091] [DEBUG] [LOCAL ] NBHC: Trimmed 31866 records to 23147 (keeping 200 days of data) [2025-09-23T20:13:52.471962] [DEBUG] [LOCAL ] NBHC: Primary data saved (23147 records). [2025-09-23T20:13:52.472099] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-23T20:13:52.472214] [INFO ] [MAIN ] Update Progress: 1460/2372 symbols completed. NBHC took 50.6s. Estimated remaining: 2h 1m 4s. Rate: 7.5 symbols/min [2025-09-23T20:13:52.643930] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:13:52.662429] [DEBUG] [LOCAL ] NCV: Loaded 13376 existing records from primary storage. [2025-09-23T20:13:52.662572] [INFO ] [MAIN ] NCV: Loaded 13376 existing records. [2025-09-23T20:13:52.839854] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:13:52.840120] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-23T20:13:52.840167] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-23T20:13:52.840732] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-23T20:13:52.840791] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-23T20:13:53.015505] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-23T20:13:53.207506] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:13:53.802179] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-23T20:13:54.114689] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T20:13:54.159633] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-23T20:13:54.598081] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T20:13:54.603543] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-23T20:13:55.402237] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-23T20:13:56.202178] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-23T20:13:56.527001] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T20:13:56.759922] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-23T20:13:56.929953] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T20:13:57.002232] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-23T20:13:57.802201] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-23T20:13:57.890963] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T20:13:58.602167] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-23T20:13:58.950761] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T20:13:59.402235] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-23T20:13:59.536206] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T20:14:00.017886] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T20:14:00.202213] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-23T20:14:01.002164] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-23T20:14:01.396384] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T20:14:01.802213] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-23T20:14:01.827811] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T20:14:02.602200] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-23T20:14:02.912399] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T20:14:03.402226] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-23T20:14:03.423581] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T20:14:04.202187] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-23T20:14:04.463044] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T20:14:04.916244] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T20:14:05.002261] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-23T20:14:05.802261] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-23T20:14:06.602211] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-23T20:14:06.718724] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T20:14:07.273446] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-23T20:14:07.274692] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T20:14:07.402204] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-23T20:14:08.196368] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T20:14:08.198910] [INFO ] [REMOTE ] NCA: Full fetch complete (15738 records). [2025-09-23T20:14:08.199002] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-23T20:14:08.210474] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-23T20:14:08.571973] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-23T20:14:08.572064] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-23T20:14:08.572404] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-23T20:14:08.572468] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-23T20:14:08.573018] [DEBUG] [LOCAL ] NCA: Trimmed 15738 records to 10038 (keeping 200 days of data) [2025-09-23T20:14:08.632256] [DEBUG] [LOCAL ] NCA: Primary data saved (10038 records). [2025-09-23T20:14:08.632394] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-23T20:14:08.632478] [INFO ] [MAIN ] Update Progress: 1461/2372 symbols completed. NCA took 26.2s. Estimated remaining: 2h 1m 1s. Rate: 7.5 symbols/min [2025-09-23T20:14:08.800974] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:14:08.814570] [DEBUG] [LOCAL ] NCZ: Loaded 11740 existing records from primary storage. [2025-09-23T20:14:08.814722] [INFO ] [MAIN ] NCZ: Loaded 11740 existing records. [2025-09-23T20:14:08.992383] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:14:08.992581] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-23T20:14:08.992638] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-23T20:14:08.993204] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-23T20:14:08.993265] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-23T20:14:09.007392] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-23T20:14:09.360232] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:14:09.802215] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-23T20:14:10.096360] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T20:14:10.501811] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-23T20:14:10.602142] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-23T20:14:10.951014] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T20:14:10.954698] [INFO ] [REMOTE ] NCDL: Full fetch complete (33334 records). [2025-09-23T20:14:10.954787] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-23T20:14:11.377053] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-23T20:14:11.377135] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-23T20:14:11.377884] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-23T20:14:11.377948] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-23T20:14:11.378734] [DEBUG] [LOCAL ] NCDL: Trimmed 33334 records to 21570 (keeping 200 days of data) [2025-09-23T20:14:11.443463] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-23T20:14:11.532885] [DEBUG] [LOCAL ] NCDL: Primary data saved (21570 records). [2025-09-23T20:14:11.533031] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-23T20:14:11.533118] [INFO ] [MAIN ] Update Progress: 1462/2372 symbols completed. NCDL took 28.0s. Estimated remaining: 2h 0m 50s. Rate: 7.5 symbols/min [2025-09-23T20:14:11.721550] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:14:11.739738] [DEBUG] [LOCAL ] NDMO: Loaded 16551 existing records from primary storage. [2025-09-23T20:14:11.739883] [INFO ] [MAIN ] NDMO: Loaded 16551 existing records. [2025-09-23T20:14:11.940024] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:14:11.940451] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-23T20:14:11.940532] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-23T20:14:11.941184] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-23T20:14:11.941246] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-23T20:14:12.205606] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-23T20:14:12.336275] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:14:12.592465] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T20:14:12.799940] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T20:14:12.822264] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T20:14:13.002212] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-23T20:14:13.802230] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-23T20:14:14.301902] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T20:14:14.602232] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-23T20:14:15.007145] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T20:14:15.402223] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-23T20:14:15.576216] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T20:14:16.174377] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T20:14:16.202179] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-23T20:14:17.002214] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-23T20:14:17.191328] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T20:14:17.802213] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-23T20:14:18.602258] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-23T20:14:18.725300] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T20:14:19.198323] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T20:14:19.257048] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-23T20:14:19.402232] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-23T20:14:20.202175] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-23T20:14:20.360508] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T20:14:20.363431] [INFO ] [REMOTE ] NCV: Full fetch complete (23110 records). [2025-09-23T20:14:20.363518] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-23T20:14:20.751273] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-23T20:14:20.751397] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-23T20:14:20.751988] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-23T20:14:20.752059] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-23T20:14:20.752789] [DEBUG] [LOCAL ] NCV: Trimmed 23110 records to 13373 (keeping 200 days of data) [2025-09-23T20:14:20.839183] [DEBUG] [LOCAL ] NCV: Primary data saved (13373 records). [2025-09-23T20:14:20.839313] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-23T20:14:20.839398] [INFO ] [MAIN ] Update Progress: 1463/2372 symbols completed. NCV took 28.4s. Estimated remaining: 2h 0m 43s. Rate: 7.5 symbols/min [2025-09-23T20:14:21.022423] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:14:21.019086] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-23T20:14:21.023070] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T20:14:21.079021] [DEBUG] [LOCAL ] NE: Loaded 52391 existing records from primary storage. [2025-09-23T20:14:21.079197] [INFO ] [MAIN ] NE: Loaded 52391 existing records. [2025-09-23T20:14:21.259659] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:14:21.260005] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-23T20:14:21.260103] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-23T20:14:21.263033] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-23T20:14:21.263097] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-23T20:14:21.627059] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:14:21.802237] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-23T20:14:21.823247] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T20:14:22.602279] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-23T20:14:22.719357] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T20:14:23.402228] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-23T20:14:23.764126] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T20:14:24.202241] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-23T20:14:25.002179] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-23T20:14:25.084189] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T20:14:25.113241] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T20:14:25.802182] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-23T20:14:25.911766] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T20:14:26.313489] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T20:14:26.602183] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-23T20:14:27.402238] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-23T20:14:28.202193] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-23T20:14:28.290343] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T20:14:28.654875] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-23T20:14:29.002196] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-23T20:14:29.753222] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T20:14:29.775972] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T20:14:29.802152] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-23T20:14:30.602244] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-23T20:14:30.878219] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T20:14:31.402249] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-23T20:14:32.138979] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T20:14:32.202151] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-23T20:14:32.818854] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-23T20:14:32.828228] [INFO ] [REMOTE ] NCLH: Full fetch complete (77808 records). [2025-09-23T20:14:32.828397] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-23T20:14:33.002986] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T20:14:33.003065] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-23T20:14:33.291424] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-23T20:14:33.291505] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-23T20:14:33.292494] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-23T20:14:33.292558] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-23T20:14:33.294148] [DEBUG] [LOCAL ] NCLH: Trimmed 77808 records to 53753 (keeping 200 days of data) [2025-09-23T20:14:33.622322] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-09-23T20:14:33.622466] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-23T20:14:33.622550] [INFO ] [MAIN ] Update Progress: 1464/2372 symbols completed. NCLH took 48.6s. Estimated remaining: 2h 0m 38s. Rate: 7.5 symbols/min [2025-09-23T20:14:33.802499] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-23T20:14:33.804230] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:14:33.842421] [DEBUG] [LOCAL ] NEA: Loaded 35290 existing records from primary storage. [2025-09-23T20:14:33.842581] [INFO ] [MAIN ] NEA: Loaded 35290 existing records. [2025-09-23T20:14:34.040255] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:14:34.040819] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-23T20:14:34.040950] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-23T20:14:34.042090] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-23T20:14:34.042155] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-23T20:14:34.165801] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T20:14:34.194146] [INFO ] [REMOTE ] NDMO: Full fetch complete (25053 records). [2025-09-23T20:14:34.214328] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-23T20:14:34.647633] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:14:34.642214] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-23T20:14:34.855164] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-23T20:14:34.855261] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-23T20:14:34.855885] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-23T20:14:34.855950] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-23T20:14:34.856613] [DEBUG] [LOCAL ] NDMO: Trimmed 25053 records to 16614 (keeping 200 days of data) [2025-09-23T20:14:34.956610] [DEBUG] [LOCAL ] NDMO: Primary data saved (16614 records). [2025-09-23T20:14:34.956794] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-23T20:14:34.956921] [INFO ] [MAIN ] Update Progress: 1465/2372 symbols completed. NDMO took 23.4s. Estimated remaining: 2h 0m 26s. Rate: 7.5 symbols/min [2025-09-23T20:14:35.131256] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:14:35.185012] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-23T20:14:35.185186] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-09-23T20:14:35.378082] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:14:35.378499] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-23T20:14:35.378693] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-23T20:14:35.379976] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-23T20:14:35.380047] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-23T20:14:35.412318] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-23T20:14:35.671554] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T20:14:35.669869] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T20:14:35.810963] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:14:36.202214] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-23T20:14:36.972977] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T20:14:37.002147] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-23T20:14:37.802172] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-23T20:14:38.200909] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-23T20:14:38.381627] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T20:14:38.384295] [INFO ] [REMOTE ] NCZ: Full fetch complete (21547 records). [2025-09-23T20:14:38.384372] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-23T20:14:38.530526] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T20:14:38.607361] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-23T20:14:38.844741] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-23T20:14:38.844826] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-23T20:14:38.845299] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-23T20:14:38.845358] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-23T20:14:38.845998] [DEBUG] [LOCAL ] NCZ: Trimmed 21547 records to 11753 (keeping 200 days of data) [2025-09-23T20:14:38.918967] [DEBUG] [LOCAL ] NCZ: Primary data saved (11753 records). [2025-09-23T20:14:38.919106] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-23T20:14:38.919190] [INFO ] [MAIN ] Update Progress: 1466/2372 symbols completed. NCZ took 30.3s. Estimated remaining: 2h 0m 16s. Rate: 7.5 symbols/min [2025-09-23T20:14:39.093269] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:14:39.148664] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-23T20:14:39.148821] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-09-23T20:14:39.325572] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:14:39.325868] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-23T20:14:39.325926] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-23T20:14:39.327065] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-23T20:14:39.327125] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-23T20:14:39.407349] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-23T20:14:39.681931] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:14:40.202200] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-23T20:14:40.871956] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-23T20:14:40.997857] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T20:14:41.008023] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-23T20:14:41.029749] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T20:14:41.802267] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-23T20:14:42.602216] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-23T20:14:42.972974] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-23T20:14:43.402193] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-23T20:14:44.012103] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-23T20:14:44.090926] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T20:14:44.202228] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-23T20:14:45.002207] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-23T20:14:45.471661] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-23T20:14:45.528320] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T20:14:45.802207] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-23T20:14:46.319927] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T20:14:46.602213] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-23T20:14:47.362137] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T20:14:47.402192] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-23T20:14:48.202193] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-23T20:14:48.328295] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T20:14:48.747779] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T20:14:49.002242] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-23T20:14:49.802280] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-23T20:14:50.282992] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-23T20:14:50.602211] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-23T20:14:51.070392] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-23T20:14:51.255002] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T20:14:51.402239] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-23T20:14:52.202261] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-23T20:14:52.481771] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T20:14:53.002244] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-23T20:14:53.234089] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T20:14:53.577393] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T20:14:53.802224] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-23T20:14:54.602244] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-23T20:14:55.037836] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T20:14:55.402184] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-23T20:14:55.931137] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-23T20:14:56.026566] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T20:14:56.202171] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-23T20:14:57.002241] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-23T20:14:57.627539] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-23T20:14:57.665109] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T20:14:57.674344] [INFO ] [REMOTE ] NE: Full fetch complete (75389 records). [2025-09-23T20:14:57.674512] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-23T20:14:57.817169] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-23T20:14:58.075401] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-23T20:14:58.075558] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-23T20:14:58.076590] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-23T20:14:58.076681] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-23T20:14:58.078262] [DEBUG] [LOCAL ] NE: Trimmed 75389 records to 52390 (keeping 200 days of data) [2025-09-23T20:14:58.460409] [DEBUG] [LOCAL ] NE: Primary data saved (52390 records). [2025-09-23T20:14:58.460636] [INFO ] [MAIN ] NE: Full history saved. [2025-09-23T20:14:58.460841] [INFO ] [MAIN ] Update Progress: 1467/2372 symbols completed. NE took 37.6s. Estimated remaining: 2h 0m 15s. Rate: 7.5 symbols/min [2025-09-23T20:14:58.608206] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-23T20:14:58.745267] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:14:58.822923] [DEBUG] [LOCAL ] NET: Loaded 53072 existing records from primary storage. [2025-09-23T20:14:58.823163] [INFO ] [MAIN ] NET: Loaded 53072 existing records. [2025-09-23T20:14:59.133607] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:14:59.134865] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-23T20:14:59.135133] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-23T20:14:59.136433] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-23T20:14:59.136501] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-23T20:14:59.504908] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T20:14:59.562527] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-23T20:14:59.634279] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:14:59.672047] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-23T20:15:00.202208] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-23T20:15:00.494761] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T20:15:01.002166] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-23T20:15:01.026311] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T20:15:01.802221] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-23T20:15:02.602167] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-23T20:15:02.851149] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-23T20:15:03.413784] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-23T20:15:03.419768] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-23T20:15:03.429449] [INFO ] [REMOTE ] NEE: Full fetch complete (77759 records). [2025-09-23T20:15:03.429681] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-23T20:15:03.834486] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-23T20:15:03.834584] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-23T20:15:03.835730] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-23T20:15:03.835802] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-23T20:15:03.837409] [DEBUG] [LOCAL ] NEE: Trimmed 77759 records to 53707 (keeping 200 days of data) [2025-09-23T20:15:04.184210] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-09-23T20:15:04.184421] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-23T20:15:04.184538] [INFO ] [MAIN ] Update Progress: 1468/2372 symbols completed. NEE took 29.2s. Estimated remaining: 2h 0m 5s. Rate: 7.5 symbols/min [2025-09-23T20:15:04.361900] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:15:04.372865] [DEBUG] [LOCAL ] NEU: Loaded 8155 existing records from primary storage. [2025-09-23T20:15:04.373006] [INFO ] [MAIN ] NEU: Loaded 8155 existing records. [2025-09-23T20:15:04.560231] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:15:04.560582] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-23T20:15:04.560691] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-23T20:15:04.561076] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-23T20:15:04.561137] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-23T20:15:04.921717] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:15:04.922059] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-23T20:15:05.428571] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (3.63 seconds). [2025-09-23T20:15:05.440982] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-23T20:15:05.728513] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-09-23T20:15:05.739720] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T20:15:05.743266] [INFO ] [REMOTE ] NEA: Full fetch complete (52331 records). [2025-09-23T20:15:05.743384] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-23T20:15:05.803636] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-23T20:15:06.152120] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-23T20:15:06.152295] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-23T20:15:06.153158] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-23T20:15:06.153241] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-23T20:15:06.154738] [DEBUG] [LOCAL ] NEA: Trimmed 52331 records to 35279 (keeping 200 days of data) [2025-09-23T20:15:06.186558] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-09-23T20:15:06.391577] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T20:15:06.421254] [DEBUG] [LOCAL ] NEA: Primary data saved (35279 records). [2025-09-23T20:15:06.421403] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-23T20:15:06.421487] [INFO ] [MAIN ] Update Progress: 1469/2372 symbols completed. NEA took 32.8s. Estimated remaining: 1h 59m 54s. Rate: 7.5 symbols/min [2025-09-23T20:15:06.592337] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:15:06.596250] [DEBUG] [LOCAL ] NEUE: Loaded 2247 existing records from primary storage. [2025-09-23T20:15:06.596330] [INFO ] [MAIN ] NEUE: Loaded 2247 existing records. [2025-09-23T20:15:06.607353] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-23T20:15:06.780198] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:15:06.780432] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-23T20:15:06.780478] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-23T20:15:06.780735] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-23T20:15:06.780795] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-23T20:15:07.153786] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:15:07.195527] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T20:15:07.402227] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-23T20:15:08.076421] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T20:15:08.202254] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-23T20:15:08.710513] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-23T20:15:08.763737] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-23T20:15:09.002218] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-23T20:15:09.432605] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T20:15:09.802266] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-23T20:15:10.414354] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T20:15:10.602203] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-23T20:15:11.264472] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T20:15:11.402206] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-23T20:15:12.130353] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T20:15:12.202172] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-23T20:15:12.977628] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T20:15:13.002152] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-23T20:15:13.802193] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-23T20:15:14.602235] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-23T20:15:15.141259] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-23T20:15:15.141385] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T20:15:15.402225] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-23T20:15:16.202210] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-23T20:15:16.986811] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-09-23T20:15:17.002134] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-23T20:15:17.008287] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T20:15:17.013241] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T20:15:17.802228] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-23T20:15:18.602183] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-23T20:15:19.299342] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-23T20:15:19.322831] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T20:15:19.402183] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-23T20:15:19.560901] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T20:15:20.202226] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-23T20:15:21.002376] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-23T20:15:21.050874] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T20:15:21.428051] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T20:15:21.802286] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-23T20:15:21.899787] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-23T20:15:21.913129] [INFO ] [REMOTE ] NEM: Full fetch complete (77749 records). [2025-09-23T20:15:21.913553] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-23T20:15:22.336889] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-23T20:15:22.337082] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-23T20:15:22.338665] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-23T20:15:22.338758] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-23T20:15:22.343704] [DEBUG] [LOCAL ] NEM: Trimmed 77749 records to 53708 (keeping 200 days of data) [2025-09-23T20:15:22.602744] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-23T20:15:22.726589] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-09-23T20:15:22.726762] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-23T20:15:22.726871] [INFO ] [MAIN ] Update Progress: 1470/2372 symbols completed. NEM took 43.8s. Estimated remaining: 1h 59m 51s. Rate: 7.5 symbols/min [2025-09-23T20:15:22.909265] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:15:22.921255] [DEBUG] [LOCAL ] NEXA: Loaded 4047 existing records from primary storage. [2025-09-23T20:15:22.921396] [INFO ] [MAIN ] NEXA: Loaded 4047 existing records. [2025-09-23T20:15:23.105485] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:15:23.105919] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-23T20:15:23.106000] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-23T20:15:23.106345] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-23T20:15:23.106407] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-23T20:15:23.407335] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-23T20:15:23.484264] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:15:23.494389] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T20:15:23.868576] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T20:15:23.944992] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-23T20:15:24.202205] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-23T20:15:24.620431] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T20:15:25.002210] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-23T20:15:25.787596] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T20:15:25.802133] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-23T20:15:26.604452] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-23T20:15:26.606258] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T20:15:27.402203] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-23T20:15:27.817860] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T20:15:28.202213] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-23T20:15:28.649950] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-23T20:15:28.665621] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T20:15:29.002206] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-23T20:15:29.568232] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T20:15:29.802251] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-23T20:15:30.602237] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-23T20:15:31.282871] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T20:15:31.283981] [INFO ] [REMOTE ] NEUE: Full fetch complete (4014 records). [2025-09-23T20:15:31.284051] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-23T20:15:31.407351] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-23T20:15:31.750742] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-23T20:15:31.750870] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-23T20:15:31.751074] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-23T20:15:31.751290] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-23T20:15:31.752087] [DEBUG] [LOCAL ] NEUE: Trimmed 4014 records to 2248 (keeping 200 days of data) [2025-09-23T20:15:31.768905] [DEBUG] [LOCAL ] NEUE: Primary data saved (2248 records). [2025-09-23T20:15:31.769023] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-23T20:15:31.769133] [INFO ] [MAIN ] Update Progress: 1471/2372 symbols completed. NEUE took 25.3s. Estimated remaining: 1h 59m 44s. Rate: 7.5 symbols/min [2025-09-23T20:15:31.951609] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:15:31.957258] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T20:15:31.997557] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-23T20:15:32.050320] [DEBUG] [LOCAL ] NFG: Loaded 38524 existing records from primary storage. [2025-09-23T20:15:32.050481] [INFO ] [MAIN ] NFG: Loaded 38524 existing records. [2025-09-23T20:15:32.208057] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-23T20:15:32.240222] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:15:32.240448] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-23T20:15:32.240496] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-23T20:15:32.241404] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-23T20:15:32.241465] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-23T20:15:32.621872] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:15:33.002256] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-23T20:15:33.802257] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-23T20:15:34.358456] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T20:15:34.410040] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T20:15:34.455451] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-23T20:15:34.604571] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-23T20:15:35.402257] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-23T20:15:36.129329] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T20:15:36.202217] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-23T20:15:37.002284] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-23T20:15:37.028616] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T20:15:37.399015] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-23T20:15:37.410628] [INFO ] [REMOTE ] NET: Full fetch complete (76881 records). [2025-09-23T20:15:37.410871] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-23T20:15:37.808990] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-23T20:15:37.807289] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T20:15:37.835306] [INFO ] [REMOTE ] NEU: Full fetch complete (10155 records). [2025-09-23T20:15:37.835736] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-23T20:15:37.835614] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-23T20:15:37.835895] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-23T20:15:37.837394] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-23T20:15:37.870001] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-23T20:15:37.951746] [DEBUG] [LOCAL ] NET: Trimmed 76881 records to 53063 (keeping 200 days of data) [2025-09-23T20:15:38.331497] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-23T20:15:38.331962] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-23T20:15:38.332551] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-23T20:15:38.332987] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-23T20:15:38.335904] [DEBUG] [LOCAL ] NEU: Trimmed 10155 records to 8116 (keeping 200 days of data) [2025-09-23T20:15:38.418345] [DEBUG] [LOCAL ] NEU: Primary data saved (8116 records). [2025-09-23T20:15:38.419385] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-23T20:15:38.419951] [INFO ] [MAIN ] Update Progress: 1472/2372 symbols completed. NEU took 34.2s. Estimated remaining: 1h 59m 35s. Rate: 7.5 symbols/min [2025-09-23T20:15:38.619986] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-23T20:15:38.702728] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:15:38.738586] [DEBUG] [LOCAL ] NFJ: Loaded 20357 existing records from primary storage. [2025-09-23T20:15:38.739273] [INFO ] [MAIN ] NFJ: Loaded 20357 existing records. [2025-09-23T20:15:38.947207] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:15:38.949438] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-23T20:15:38.949506] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-23T20:15:38.950835] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-23T20:15:38.951576] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-23T20:15:39.270927] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T20:15:39.411004] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-23T20:15:39.460195] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:15:39.496318] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T20:15:39.521956] [DEBUG] [LOCAL ] NET: Primary data saved (53063 records). [2025-09-23T20:15:39.522114] [INFO ] [MAIN ] NET: Full history saved. [2025-09-23T20:15:39.522243] [INFO ] [MAIN ] Update Progress: 1473/2372 symbols completed. NET took 41.1s. Estimated remaining: 1h 59m 23s. Rate: 7.5 symbols/min [2025-09-23T20:15:39.693722] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:15:39.741903] [DEBUG] [LOCAL ] NGG: Loaded 46155 existing records from primary storage. [2025-09-23T20:15:39.742079] [INFO ] [MAIN ] NGG: Loaded 46155 existing records. [2025-09-23T20:15:39.933143] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:15:39.933860] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-23T20:15:39.933920] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-23T20:15:39.935246] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-23T20:15:39.935362] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-23T20:15:40.206204] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-23T20:15:40.250425] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T20:15:40.295145] [INFO ] [REMOTE ] NEXA: Full fetch complete (7493 records). [2025-09-23T20:15:40.317177] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-23T20:15:40.346008] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:15:40.708775] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-23T20:15:40.708859] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-23T20:15:40.709052] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-23T20:15:40.709090] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-23T20:15:40.709795] [DEBUG] [LOCAL ] NEXA: Trimmed 7493 records to 4075 (keeping 200 days of data) [2025-09-23T20:15:40.736905] [DEBUG] [LOCAL ] NEXA: Primary data saved (4075 records). [2025-09-23T20:15:40.737034] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-23T20:15:40.737136] [INFO ] [MAIN ] Update Progress: 1474/2372 symbols completed. NEXA took 18.0s. Estimated remaining: 1h 59m 11s. Rate: 7.5 symbols/min [2025-09-23T20:15:40.908025] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:15:40.952027] [DEBUG] [LOCAL ] NGL: Loaded 30374 existing records from primary storage. [2025-09-23T20:15:40.952187] [INFO ] [MAIN ] NGL: Loaded 30374 existing records. [2025-09-23T20:15:41.007401] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-23T20:15:41.150078] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:15:41.150420] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-23T20:15:41.150477] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-23T20:15:41.151258] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-23T20:15:41.151318] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-23T20:15:41.522170] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:15:41.807360] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-23T20:15:41.828830] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T20:15:42.243735] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T20:15:42.602203] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-23T20:15:43.201798] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T20:15:43.402197] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-23T20:15:43.738814] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T20:15:44.202219] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-23T20:15:45.003251] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-23T20:15:45.006403] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T20:15:45.228231] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T20:15:45.802203] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-23T20:15:46.218953] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T20:15:46.503512] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T20:15:46.602214] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-23T20:15:47.402203] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-23T20:15:48.200836] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T20:15:48.208831] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-23T20:15:48.771205] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T20:15:49.002192] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-23T20:15:49.504294] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T20:15:49.802215] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-23T20:15:50.561341] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T20:15:50.602196] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-23T20:15:51.351796] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T20:15:51.402182] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-23T20:15:51.763883] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T20:15:52.202279] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-23T20:15:52.813871] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T20:15:53.002257] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-23T20:15:53.340286] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T20:15:53.802263] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-23T20:15:54.602238] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-23T20:15:54.649044] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T20:15:55.026748] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T20:15:55.198065] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T20:15:55.402209] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-23T20:15:56.202269] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-23T20:15:57.009123] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-23T20:15:57.013715] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T20:15:57.020531] [INFO ] [REMOTE ] NFG: Full fetch complete (56489 records). [2025-09-23T20:15:57.020717] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-23T20:15:57.475220] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-23T20:15:57.475343] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-23T20:15:57.476392] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-23T20:15:57.476463] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-23T20:15:57.478174] [DEBUG] [LOCAL ] NFG: Trimmed 56489 records to 38470 (keeping 200 days of data) [2025-09-23T20:15:57.740786] [DEBUG] [LOCAL ] NFG: Primary data saved (38470 records). [2025-09-23T20:15:57.740944] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-23T20:15:57.741036] [INFO ] [MAIN ] Update Progress: 1475/2372 symbols completed. NFG took 26.0s. Estimated remaining: 1h 59m 8s. Rate: 7.5 symbols/min [2025-09-23T20:15:57.808958] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-23T20:15:57.934038] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:15:57.967928] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T20:15:57.987224] [DEBUG] [LOCAL ] NGS: Loaded 11503 existing records from primary storage. [2025-09-23T20:15:57.987356] [INFO ] [MAIN ] NGS: Loaded 11503 existing records. [2025-09-23T20:15:58.182969] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:15:58.197435] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-23T20:15:58.197504] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-23T20:15:58.198503] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-23T20:15:58.198435] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T20:15:58.198745] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-23T20:15:58.595502] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:15:58.602147] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-23T20:15:58.743137] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T20:15:59.134533] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T20:15:59.402210] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-23T20:16:00.145558] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T20:16:00.202166] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-23T20:16:00.976375] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T20:16:01.002207] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-23T20:16:01.802211] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-23T20:16:02.014981] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T20:16:02.602187] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-23T20:16:03.402183] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-23T20:16:03.462291] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T20:16:03.512105] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T20:16:04.202177] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-23T20:16:04.525518] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T20:16:05.002185] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-23T20:16:05.047405] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T20:16:05.744827] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T20:16:05.802195] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-23T20:16:06.602211] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-23T20:16:06.852940] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T20:16:07.402210] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-23T20:16:08.022722] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T20:16:08.202193] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-23T20:16:08.352059] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T20:16:09.002240] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-23T20:16:09.146365] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T20:16:09.599523] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T20:16:09.802215] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-23T20:16:10.483702] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T20:16:10.602228] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-23T20:16:11.402246] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-23T20:16:12.029918] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T20:16:12.046237] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T20:16:12.202188] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-23T20:16:13.002246] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-23T20:16:13.670391] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T20:16:13.802253] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-23T20:16:14.184422] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T20:16:14.192383] [INFO ] [REMOTE ] NGG: Full fetch complete (66291 records). [2025-09-23T20:16:14.192563] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-23T20:16:14.607398] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-23T20:16:14.722095] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-23T20:16:14.722208] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-23T20:16:14.723362] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-23T20:16:14.723498] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-23T20:16:14.725535] [DEBUG] [LOCAL ] NGG: Trimmed 66291 records to 46138 (keeping 200 days of data) [2025-09-23T20:16:14.972476] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T20:16:15.062779] [DEBUG] [LOCAL ] NGG: Primary data saved (46138 records). [2025-09-23T20:16:15.062946] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-23T20:16:15.063053] [INFO ] [MAIN ] Update Progress: 1476/2372 symbols completed. NGG took 35.5s. Estimated remaining: 1h 59m 6s. Rate: 7.5 symbols/min [2025-09-23T20:16:15.252082] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:16:15.259381] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T20:16:15.262042] [INFO ] [REMOTE ] NGS: Full fetch complete (17218 records). [2025-09-23T20:16:15.262152] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-23T20:16:15.420215] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-23T20:16:15.452863] [DEBUG] [LOCAL ] NGVC: Loaded 22375 existing records from primary storage. [2025-09-23T20:16:15.552472] [INFO ] [MAIN ] NGVC: Loaded 22375 existing records. [2025-09-23T20:16:15.896481] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-23T20:16:15.902815] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:16:15.902936] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-23T20:16:15.903488] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-23T20:16:15.903575] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-23T20:16:15.904026] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-23T20:16:15.904607] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-23T20:16:15.904953] [DEBUG] [LOCAL ] NGS: Trimmed 17218 records to 11521 (keeping 200 days of data) [2025-09-23T20:16:15.905750] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-23T20:16:15.905909] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-23T20:16:16.204155] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-23T20:16:16.363689] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:16:16.379391] [DEBUG] [LOCAL ] NGS: Primary data saved (11521 records). [2025-09-23T20:16:16.379559] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-23T20:16:16.379682] [INFO ] [MAIN ] Update Progress: 1477/2372 symbols completed. NGS took 18.6s. Estimated remaining: 1h 58m 54s. Rate: 7.5 symbols/min [2025-09-23T20:16:16.897262] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T20:16:17.002197] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-23T20:16:17.296381] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T20:16:17.301371] [INFO ] [REMOTE ] NFJ: Full fetch complete (30446 records). [2025-09-23T20:16:17.301528] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-23T20:16:17.699224] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-23T20:16:17.699324] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-23T20:16:17.700082] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-23T20:16:17.700148] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-23T20:16:17.701092] [DEBUG] [LOCAL ] NFJ: Trimmed 30446 records to 20291 (keeping 200 days of data) [2025-09-23T20:16:17.802358] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-23T20:16:17.844943] [DEBUG] [LOCAL ] NFJ: Primary data saved (20291 records). [2025-09-23T20:16:17.845076] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-23T20:16:17.845221] [INFO ] [MAIN ] Update Progress: 1478/2372 symbols completed. NFJ took 39.4s. Estimated remaining: 1h 58m 42s. Rate: 7.5 symbols/min [2025-09-23T20:16:18.062362] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T20:16:18.602251] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-23T20:16:19.121249] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T20:16:19.127961] [INFO ] [REMOTE ] NGL: Full fetch complete (40962 records). [2025-09-23T20:16:19.128137] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-23T20:16:19.591295] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-23T20:16:19.596691] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-23T20:16:19.602259] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-23T20:16:19.603511] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T20:16:19.603619] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-23T20:16:19.608405] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-23T20:16:19.610043] [DEBUG] [LOCAL ] NGL: Trimmed 40962 records to 30539 (keeping 200 days of data) [2025-09-23T20:16:19.801031] [DEBUG] [LOCAL ] NGL: Primary data saved (30539 records). [2025-09-23T20:16:19.801178] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-23T20:16:19.801279] [INFO ] [MAIN ] Update Progress: 1479/2372 symbols completed. NGL took 39.1s. Estimated remaining: 1h 58m 31s. Rate: 7.5 symbols/min [2025-09-23T20:16:20.772697] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T20:16:20.777502] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-23T20:16:21.931718] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T20:16:21.937833] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-23T20:16:23.153724] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T20:16:23.159156] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-23T20:16:24.083019] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T20:16:24.088394] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-23T20:16:25.309141] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T20:16:25.314733] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-23T20:16:26.637558] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T20:16:26.644127] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-23T20:16:27.819980] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T20:16:27.825767] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-23T20:16:28.900277] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T20:16:28.904302] [INFO ] [REMOTE ] NGVC: Full fetch complete (30224 records). [2025-09-23T20:16:28.904379] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-23T20:16:29.283802] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-23T20:16:29.283882] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-23T20:16:29.284486] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-23T20:16:29.284527] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-23T20:16:29.285295] [DEBUG] [LOCAL ] NGVC: Trimmed 30224 records to 22329 (keeping 200 days of data) [2025-09-23T20:16:29.422729] [DEBUG] [LOCAL ] NGVC: Primary data saved (22329 records). [2025-09-23T20:16:29.422855] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-23T20:16:29.422934] [INFO ] [MAIN ] Update Progress: 1480/2372 symbols completed. NGVC took 14.4s. Estimated remaining: 1h 58m 24s. Rate: 7.5 symbols/min [2025-09-23T20:16:30.116753] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:16:30.117775] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:16:30.138274] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:16:30.165856] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:16:30.166488] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-09-23T20:16:30.166540] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-09-23T20:16:30.166699] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-23T20:16:30.166750] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-23T20:16:30.166792] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-23T20:16:30.166824] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-23T20:16:30.297859] [DEBUG] [LOCAL ] NIC: Loaded 8853 existing records from primary storage. [2025-09-23T20:16:30.306009] [INFO ] [MAIN ] NIC: Loaded 8853 existing records. [2025-09-23T20:16:30.307409] [DEBUG] [LOCAL ] NHI: Loaded 22012 existing records from primary storage. [2025-09-23T20:16:30.307924] [DEBUG] [LOCAL ] NGVT: Loaded 24402 existing records from primary storage. [2025-09-23T20:16:30.308045] [INFO ] [MAIN ] NGVT: Loaded 24402 existing records. [2025-09-23T20:16:30.313348] [INFO ] [MAIN ] NHI: Loaded 22012 existing records. [2025-09-23T20:16:30.859231] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:16:30.950576] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-23T20:16:30.996529] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-23T20:16:31.071391] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:16:31.071663] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-23T20:16:31.105254] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-23T20:16:31.105442] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:16:31.089283] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-23T20:16:31.126337] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-23T20:16:31.136923] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-23T20:16:31.175625] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-23T20:16:31.175568] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-23T20:16:31.223476] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-23T20:16:31.228791] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-23T20:16:31.319838] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-23T20:16:31.328188] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:16:31.372992] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-23T20:16:32.096244] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:16:32.177700] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:16:32.174599] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-23T20:16:32.183225] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-23T20:16:32.320135] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:16:32.320427] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-23T20:16:33.012915] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T20:16:33.015783] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-23T20:16:33.194598] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T20:16:33.200303] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-23T20:16:33.474558] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-23T20:16:33.485399] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-23T20:16:33.522478] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T20:16:33.527876] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-23T20:16:33.842505] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T20:16:33.844586] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-23T20:16:34.376194] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T20:16:34.381311] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-23T20:16:34.624783] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T20:16:34.632794] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-23T20:16:34.685451] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T20:16:34.687801] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-23T20:16:34.852816] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T20:16:35.245620] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T20:16:35.402172] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-23T20:16:35.457748] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T20:16:35.555915] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T20:16:36.202219] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-23T20:16:36.724530] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T20:16:37.002210] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-23T20:16:37.058982] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T20:16:37.802240] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-23T20:16:37.893441] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T20:16:38.602221] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-23T20:16:38.980286] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T20:16:39.402198] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-23T20:16:40.202271] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-23T20:16:40.568065] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T20:16:40.593543] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T20:16:40.999904] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T20:16:41.002336] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-23T20:16:41.802174] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-23T20:16:41.822531] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T20:16:42.602166] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-23T20:16:42.990852] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T20:16:43.183583] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T20:16:43.402204] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-23T20:16:44.202278] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-23T20:16:44.576282] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T20:16:45.002263] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-23T20:16:45.802242] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-23T20:16:46.323307] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-23T20:16:46.411021] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T20:16:46.597404] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T20:16:46.602462] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-23T20:16:47.402159] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-23T20:16:47.480999] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T20:16:48.202222] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-23T20:16:48.416373] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T20:16:49.002290] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-23T20:16:49.668992] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T20:16:49.670751] [INFO ] [REMOTE ] NIC: Full fetch complete (12124 records). [2025-09-23T20:16:49.670844] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-23T20:16:49.802179] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-23T20:16:50.061046] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-23T20:16:50.061229] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-23T20:16:50.061697] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-23T20:16:50.061845] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-23T20:16:50.062731] [DEBUG] [LOCAL ] NIC: Trimmed 12124 records to 8869 (keeping 200 days of data) [2025-09-23T20:16:50.138484] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T20:16:50.164547] [DEBUG] [LOCAL ] NIC: Primary data saved (8869 records). [2025-09-23T20:16:50.164696] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-23T20:16:50.164789] [INFO ] [MAIN ] Update Progress: 1481/2372 symbols completed. NIC took 20.7s. Estimated remaining: 1h 58m 23s. Rate: 7.5 symbols/min [2025-09-23T20:16:50.334368] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:16:50.346989] [DEBUG] [LOCAL ] NIE: Loaded 11610 existing records from primary storage. [2025-09-23T20:16:50.347116] [INFO ] [MAIN ] NIE: Loaded 11610 existing records. [2025-09-23T20:16:50.525775] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:16:50.526051] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-23T20:16:50.526099] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-23T20:16:50.526548] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-23T20:16:50.526608] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-23T20:16:50.607317] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-23T20:16:50.891913] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:16:50.904310] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T20:16:51.402253] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-23T20:16:52.206009] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-23T20:16:52.212894] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T20:16:52.258919] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T20:16:53.002221] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-23T20:16:53.440870] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T20:16:53.802241] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-23T20:16:53.846445] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T20:16:54.602514] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-23T20:16:55.402170] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-23T20:16:55.610934] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T20:16:55.846361] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T20:16:56.152948] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T20:16:56.202144] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-23T20:16:57.002216] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-23T20:16:57.422126] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T20:16:57.426309] [INFO ] [REMOTE ] NHI: Full fetch complete (31646 records). [2025-09-23T20:16:57.426471] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-23T20:16:57.813946] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-23T20:16:57.811831] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-23T20:16:57.814108] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-23T20:16:57.815908] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-23T20:16:57.815982] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-23T20:16:57.817266] [DEBUG] [LOCAL ] NHI: Trimmed 31646 records to 22081 (keeping 200 days of data) [2025-09-23T20:16:57.966386] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T20:16:57.971608] [DEBUG] [LOCAL ] NHI: Primary data saved (22081 records). [2025-09-23T20:16:57.971826] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-23T20:16:57.971942] [INFO ] [MAIN ] Update Progress: 1482/2372 symbols completed. NHI took 28.5s. Estimated remaining: 1h 58m 15s. Rate: 7.5 symbols/min [2025-09-23T20:16:58.149971] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:16:58.158194] [DEBUG] [LOCAL ] NIM: Loaded 4079 existing records from primary storage. [2025-09-23T20:16:58.158311] [INFO ] [MAIN ] NIM: Loaded 4079 existing records. [2025-09-23T20:16:58.336815] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:16:58.337093] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-23T20:16:58.337141] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-23T20:16:58.337442] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-23T20:16:58.337501] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-23T20:16:58.607346] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-23T20:16:58.717035] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:16:58.965926] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T20:16:58.972526] [INFO ] [REMOTE ] NGVT: Full fetch complete (34535 records). [2025-09-23T20:16:58.972800] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-23T20:16:59.394533] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-23T20:16:59.394638] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-23T20:16:59.395375] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-23T20:16:59.395437] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-23T20:16:59.396488] [DEBUG] [LOCAL ] NGVT: Trimmed 34535 records to 24417 (keeping 200 days of data) [2025-09-23T20:16:59.443712] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-23T20:16:59.540451] [DEBUG] [LOCAL ] NGVT: Primary data saved (24417 records). [2025-09-23T20:16:59.540590] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-23T20:16:59.540697] [INFO ] [MAIN ] Update Progress: 1483/2372 symbols completed. NGVT took 30.1s. Estimated remaining: 1h 58m 3s. Rate: 7.5 symbols/min [2025-09-23T20:16:59.711442] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:16:59.739573] [DEBUG] [LOCAL ] NINE: Loaded 28634 existing records from primary storage. [2025-09-23T20:16:59.739744] [INFO ] [MAIN ] NINE: Loaded 28634 existing records. [2025-09-23T20:16:59.926903] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:16:59.927165] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-23T20:16:59.927234] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-23T20:16:59.928198] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-23T20:16:59.928262] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-23T20:17:00.207330] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-23T20:17:00.245551] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T20:17:00.307503] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:17:00.577867] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T20:17:00.919534] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T20:17:01.002196] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-23T20:17:01.747315] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T20:17:01.802211] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-23T20:17:02.602205] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-23T20:17:02.893965] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T20:17:02.950881] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-23T20:17:02.959474] [INFO ] [REMOTE ] NI: Full fetch complete (76874 records). [2025-09-23T20:17:02.959601] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-23T20:17:02.960341] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:17:02.960430] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:17:02.960506] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:17:02.960578] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-23T20:17:02.960680] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-23T20:17:02.960736] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-09-23T20:17:02.960796] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-09-23T20:17:02.960892] [INFO ] [MAIN ] Update Progress: 1484/2372 symbols completed. NI took 33.5s. Estimated remaining: 1h 57m 53s. Rate: 7.5 symbols/min [2025-09-23T20:17:03.136570] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:17:03.187942] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-23T20:17:03.188089] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-09-23T20:17:03.369817] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:17:03.370056] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-23T20:17:03.370103] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-23T20:17:03.371434] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-23T20:17:03.371495] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-23T20:17:03.407428] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-23T20:17:03.745608] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:17:04.202212] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-23T20:17:04.311702] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T20:17:04.607780] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T20:17:05.002193] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-23T20:17:05.802200] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-23T20:17:05.823222] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T20:17:06.602239] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-23T20:17:07.402186] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-23T20:17:07.591278] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T20:17:08.202219] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-23T20:17:08.352479] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-23T20:17:08.851570] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T20:17:09.002227] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-23T20:17:09.363873] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-23T20:17:09.802213] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-23T20:17:10.602199] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-23T20:17:10.929883] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T20:17:11.073085] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T20:17:11.402220] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-23T20:17:11.546477] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-23T20:17:12.009720] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T20:17:12.012190] [INFO ] [REMOTE ] NIE: Full fetch complete (16358 records). [2025-09-23T20:17:12.012280] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-23T20:17:12.207328] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-23T20:17:12.400322] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-23T20:17:12.400405] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-23T20:17:12.400800] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-23T20:17:12.400862] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-23T20:17:12.401420] [DEBUG] [LOCAL ] NIE: Trimmed 16358 records to 11612 (keeping 200 days of data) [2025-09-23T20:17:12.473576] [DEBUG] [LOCAL ] NIE: Primary data saved (11612 records). [2025-09-23T20:17:12.473776] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-23T20:17:12.473872] [INFO ] [MAIN ] Update Progress: 1485/2372 symbols completed. NIE took 22.3s. Estimated remaining: 1h 57m 46s. Rate: 7.5 symbols/min [2025-09-23T20:17:12.645442] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:17:12.645661] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-23T20:17:12.645719] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-23T20:17:12.645874] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-23T20:17:12.645916] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-23T20:17:12.645957] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-23T20:17:12.645989] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-23T20:17:13.011367] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:17:13.007231] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-23T20:17:13.681083] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T20:17:13.802216] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-23T20:17:14.054862] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:17:14.055850] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-23T20:17:14.602246] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-23T20:17:14.846432] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:17:14.846793] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-23T20:17:15.402226] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-23T20:17:15.436454] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-23T20:17:16.202230] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-23T20:17:16.471557] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:17:16.471989] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-23T20:17:16.712465] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T20:17:17.002239] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-23T20:17:17.802246] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-23T20:17:18.574843] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T20:17:18.602197] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-23T20:17:19.254578] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T20:17:19.402236] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-23T20:17:19.707785] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-23T20:17:20.202225] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-23T20:17:20.832409] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T20:17:21.002239] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-23T20:17:21.620849] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T20:17:21.802257] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-23T20:17:22.602187] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-23T20:17:22.744337] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-23T20:17:22.840103] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:17:22.840428] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-23T20:17:23.402187] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-23T20:17:23.651783] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:17:23.652184] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-23T20:17:23.676453] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-23T20:17:24.202217] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-23T20:17:25.002258] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-23T20:17:25.248161] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:17:25.248496] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-23T20:17:25.802193] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-23T20:17:26.054262] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:17:26.054580] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-23T20:17:26.602163] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-23T20:17:26.635689] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-23T20:17:27.261801] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T20:17:27.402203] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-23T20:17:28.202199] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-23T20:17:28.930049] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T20:17:28.947577] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T20:17:29.002160] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-23T20:17:29.802260] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-23T20:17:30.477061] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T20:17:30.602274] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-23T20:17:30.688546] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T20:17:31.402199] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-23T20:17:31.863781] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T20:17:32.202208] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-23T20:17:32.586445] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T20:17:32.850350] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T20:17:32.857878] [INFO ] [REMOTE ] NIQ: Full fetch complete (15019 records). [2025-09-23T20:17:32.858013] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-23T20:17:33.010837] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-23T20:17:33.048820] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 44 unique days, need 200 days [2025-09-23T20:17:33.049332] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:17:33.049450] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:17:33.049544] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-23T20:17:33.049677] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-23T20:17:33.049750] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-23T20:17:33.049821] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-23T20:17:33.049912] [INFO ] [MAIN ] Update Progress: 1486/2372 symbols completed. NIQ took 20.6s. Estimated remaining: 1h 57m 45s. Rate: 7.5 symbols/min [2025-09-23T20:17:33.219306] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:17:33.256754] [DEBUG] [LOCAL ] NJR: Loaded 38056 existing records from primary storage. [2025-09-23T20:17:33.256899] [INFO ] [MAIN ] NJR: Loaded 38056 existing records. [2025-09-23T20:17:33.432685] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:17:33.432967] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-23T20:17:33.433027] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-23T20:17:33.434864] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-23T20:17:33.434929] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-23T20:17:33.789543] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:17:33.802150] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-23T20:17:34.186607] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T20:17:34.190616] [INFO ] [REMOTE ] NINE: Full fetch complete (44369 records). [2025-09-23T20:17:34.190773] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-23T20:17:34.606060] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-23T20:17:34.621999] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-23T20:17:34.622109] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-23T20:17:34.622907] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-23T20:17:34.623106] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-23T20:17:34.624182] [DEBUG] [LOCAL ] NINE: Trimmed 44369 records to 28506 (keeping 200 days of data) [2025-09-23T20:17:34.785537] [DEBUG] [LOCAL ] NINE: Primary data saved (28506 records). [2025-09-23T20:17:34.785706] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-23T20:17:34.785814] [INFO ] [MAIN ] Update Progress: 1487/2372 symbols completed. NINE took 35.2s. Estimated remaining: 1h 57m 34s. Rate: 7.5 symbols/min [2025-09-23T20:17:34.963252] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:17:34.963581] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-23T20:17:34.963738] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-23T20:17:34.963986] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-23T20:17:34.964038] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-23T20:17:34.964082] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-23T20:17:34.964116] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-23T20:17:35.227476] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T20:17:35.264479] [INFO ] [REMOTE ] NIM: Full fetch complete (6842 records). [2025-09-23T20:17:35.280455] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-23T20:17:35.381577] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:17:35.407982] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-23T20:17:35.569360] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T20:17:35.785509] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-23T20:17:35.785593] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-23T20:17:35.785797] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-23T20:17:35.785858] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-23T20:17:35.786287] [DEBUG] [LOCAL ] NIM: Trimmed 6842 records to 4101 (keeping 200 days of data) [2025-09-23T20:17:35.812101] [DEBUG] [LOCAL ] NIM: Primary data saved (4101 records). [2025-09-23T20:17:35.812251] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-23T20:17:35.812345] [INFO ] [MAIN ] Update Progress: 1488/2372 symbols completed. NIM took 37.8s. Estimated remaining: 1h 57m 21s. Rate: 7.5 symbols/min [2025-09-23T20:17:35.984733] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:17:36.000415] [DEBUG] [LOCAL ] NKX: Loaded 13576 existing records from primary storage. [2025-09-23T20:17:36.000559] [INFO ] [MAIN ] NKX: Loaded 13576 existing records. [2025-09-23T20:17:36.179963] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:17:36.180239] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-23T20:17:36.180288] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-23T20:17:36.180808] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-23T20:17:36.180868] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-23T20:17:36.211595] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-23T20:17:36.551509] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:17:37.002212] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-23T20:17:37.807272] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-23T20:17:37.823798] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T20:17:37.878957] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-23T20:17:38.578922] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T20:17:38.602169] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-23T20:17:39.405833] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-23T20:17:39.438835] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-23T20:17:39.463525] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T20:17:40.202244] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-23T20:17:40.905038] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T20:17:40.923398] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T20:17:41.002223] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-23T20:17:41.802228] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-23T20:17:42.602200] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-23T20:17:42.654542] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T20:17:43.402186] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-23T20:17:43.515455] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T20:17:44.202223] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-23T20:17:44.471109] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-23T20:17:44.923464] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T20:17:45.002191] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-23T20:17:45.802230] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-23T20:17:46.602224] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-23T20:17:46.651584] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T20:17:46.705711] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T20:17:46.713043] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-23T20:17:47.402206] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-23T20:17:48.202233] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-23T20:17:49.002167] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-23T20:17:49.196335] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-23T20:17:49.363840] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T20:17:49.553846] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-23T20:17:49.802199] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-23T20:17:49.838729] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T20:17:50.602236] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-23T20:17:51.402265] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-23T20:17:52.202190] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-23T20:17:52.241343] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T20:17:52.407464] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-23T20:17:52.485809] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T20:17:52.548501] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-23T20:17:52.560346] [INFO ] [REMOTE ] NIO: Full fetch complete (77584 records). [2025-09-23T20:17:52.560530] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-23T20:17:52.561709] [FATAL] [VALIDATOR ] NIO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:17:52.561829] [FATAL] [MAIN ] NIO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:17:52.561896] [WARN ] [MAIN ] NIO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:17:52.561956] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-23T20:17:52.562061] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-09-23T20:17:52.562118] [INFO ] [LOCAL ] NIO: Starting deletion of derivative data. [2025-09-23T20:17:52.562574] [DEBUG] [LOCAL ] NIO: Deleted derivative data file. [2025-09-23T20:17:52.562736] [INFO ] [MAIN ] Update Progress: 1489/2372 symbols completed. NIO took 49.6s. Estimated remaining: 1h 57m 19s. Rate: 7.5 symbols/min [2025-09-23T20:17:52.740566] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:17:52.740779] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-23T20:17:52.740835] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-23T20:17:52.741001] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-23T20:17:52.741049] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-23T20:17:52.741091] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-23T20:17:52.741126] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-23T20:17:53.007572] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-23T20:17:53.118771] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:17:53.802221] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-23T20:17:54.602222] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-23T20:17:54.696739] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T20:17:55.402264] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-23T20:17:55.670762] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T20:17:56.202251] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-23T20:17:56.287867] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-23T20:17:56.853694] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T20:17:56.868116] [INFO ] [REMOTE ] NJR: Full fetch complete (54297 records). [2025-09-23T20:17:56.868745] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-23T20:17:56.869583] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T20:17:57.007340] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-23T20:17:57.312116] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-23T20:17:57.312198] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-23T20:17:57.313057] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-23T20:17:57.313152] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-23T20:17:57.314262] [DEBUG] [LOCAL ] NJR: Trimmed 54297 records to 38098 (keeping 200 days of data) [2025-09-23T20:17:57.556991] [DEBUG] [LOCAL ] NJR: Primary data saved (38098 records). [2025-09-23T20:17:57.557138] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-23T20:17:57.557284] [INFO ] [MAIN ] Update Progress: 1490/2372 symbols completed. NJR took 24.5s. Estimated remaining: 1h 57m 9s. Rate: 7.5 symbols/min [2025-09-23T20:17:57.728314] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:17:57.743586] [DEBUG] [LOCAL ] NLOP: Loaded 11818 existing records from primary storage. [2025-09-23T20:17:57.743755] [INFO ] [MAIN ] NLOP: Loaded 11818 existing records. [2025-09-23T20:17:57.807313] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-23T20:17:57.853702] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T20:17:57.938479] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:17:57.938771] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-23T20:17:57.938826] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-23T20:17:57.939377] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-23T20:17:57.939440] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-23T20:17:58.309794] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:17:58.602233] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-23T20:17:58.701275] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T20:17:58.704906] [INFO ] [REMOTE ] NKX: Full fetch complete (19391 records). [2025-09-23T20:17:58.705187] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-23T20:17:59.094326] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-23T20:17:59.094442] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-23T20:17:59.095293] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-23T20:17:59.095442] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-23T20:17:59.096477] [DEBUG] [LOCAL ] NKX: Trimmed 19391 records to 13537 (keeping 200 days of data) [2025-09-23T20:17:59.211727] [DEBUG] [LOCAL ] NKX: Primary data saved (13537 records). [2025-09-23T20:17:59.211992] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-23T20:17:59.212177] [INFO ] [MAIN ] Update Progress: 1491/2372 symbols completed. NKX took 23.4s. Estimated remaining: 1h 56m 57s. Rate: 7.5 symbols/min [2025-09-23T20:17:59.327487] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T20:17:59.410841] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:17:59.410687] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-23T20:17:59.498446] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-23T20:17:59.498695] [INFO ] [MAIN ] NLY: Loaded 53581 existing records. [2025-09-23T20:17:59.681308] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:17:59.681676] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-23T20:17:59.681748] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-23T20:17:59.683184] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-23T20:17:59.683263] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-23T20:18:00.055085] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:18:00.202200] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-23T20:18:00.849678] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T20:18:01.002235] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-23T20:18:01.802183] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-23T20:18:01.958368] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T20:18:02.602197] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-23T20:18:02.781318] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-23T20:18:03.402264] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-23T20:18:03.899971] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T20:18:04.202244] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-23T20:18:04.897939] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T20:18:05.002194] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-23T20:18:05.806865] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-23T20:18:05.835517] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (4.03 seconds). [2025-09-23T20:18:05.883690] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T20:18:06.532048] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T20:18:06.602200] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-23T20:18:06.912101] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (3.51 seconds). [2025-09-23T20:18:07.402215] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-23T20:18:08.202175] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-23T20:18:08.548845] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T20:18:08.888110] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T20:18:09.002229] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-23T20:18:09.802202] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-23T20:18:09.886142] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-23T20:18:10.200715] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T20:18:10.542591] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T20:18:10.602152] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-23T20:18:11.402196] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-23T20:18:12.202234] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-23T20:18:12.623863] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T20:18:12.884018] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T20:18:13.002218] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-23T20:18:13.788052] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-23T20:18:13.802150] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-23T20:18:14.602215] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-23T20:18:15.177051] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T20:18:15.229114] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T20:18:15.230936] [INFO ] [REMOTE ] NL: Full fetch complete (6908 records). [2025-09-23T20:18:15.231010] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-23T20:18:15.419028] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-23T20:18:15.428695] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T20:18:15.429023] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:18:15.430028] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:18:15.430171] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-23T20:18:15.430277] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-23T20:18:15.430374] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-23T20:18:15.430478] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-23T20:18:15.430623] [INFO ] [MAIN ] Update Progress: 1492/2372 symbols completed. NL took 22.9s. Estimated remaining: 1h 56m 54s. Rate: 7.5 symbols/min [2025-09-23T20:18:15.670740] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:18:15.698691] [DEBUG] [LOCAL ] NMAI: Loaded 13187 existing records from primary storage. [2025-09-23T20:18:15.698860] [INFO ] [MAIN ] NMAI: Loaded 13187 existing records. [2025-09-23T20:18:15.878940] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:18:15.879181] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-23T20:18:15.879237] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-23T20:18:15.879874] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-23T20:18:15.879935] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-23T20:18:16.204495] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-23T20:18:16.248160] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:18:16.341480] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-23T20:18:16.350002] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-23T20:18:16.350130] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-23T20:18:16.560542] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T20:18:16.561925] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:18:16.562032] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:18:16.562131] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-23T20:18:16.562239] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-23T20:18:16.562297] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-23T20:18:16.562344] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-23T20:18:16.562510] [INFO ] [MAIN ] Update Progress: 1493/2372 symbols completed. NKE took 41.8s. Estimated remaining: 1h 56m 42s. Rate: 7.5 symbols/min [2025-09-23T20:18:16.730594] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:18:16.730782] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-23T20:18:16.730825] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-23T20:18:16.731017] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-23T20:18:16.731070] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-23T20:18:16.731111] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-23T20:18:16.731143] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-23T20:18:17.007836] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-23T20:18:17.094167] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:18:17.802255] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-23T20:18:18.214455] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:18:18.214890] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-23T20:18:18.275688] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-23T20:18:18.312097] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-23T20:18:18.327927] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T20:18:18.602216] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-23T20:18:18.857705] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:18:18.858095] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-23T20:18:19.402192] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-23T20:18:20.202199] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-23T20:18:21.002173] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-23T20:18:21.077103] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T20:18:21.111766] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T20:18:21.290077] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:18:21.290416] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-23T20:18:21.802232] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-23T20:18:22.576318] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T20:18:22.602160] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-23T20:18:22.992466] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T20:18:23.402202] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-23T20:18:24.202207] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-23T20:18:25.002240] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-23T20:18:25.810613] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-23T20:18:25.834156] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-23T20:18:25.972283] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T20:18:26.146556] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T20:18:26.417283] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T20:18:26.602199] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-23T20:18:27.402205] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-23T20:18:28.202201] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-23T20:18:28.302322] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T20:18:28.523037] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T20:18:29.002229] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-23T20:18:29.802267] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-23T20:18:29.914238] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T20:18:29.950375] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T20:18:30.314959] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T20:18:30.602245] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-23T20:18:31.402227] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-23T20:18:31.602082] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T20:18:32.202257] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-23T20:18:33.002283] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-23T20:18:33.365842] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T20:18:33.802183] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-23T20:18:34.061217] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T20:18:34.070323] [INFO ] [REMOTE ] NLY: Full fetch complete (77556 records). [2025-09-23T20:18:34.070470] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-23T20:18:34.203038] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T20:18:34.248069] [INFO ] [REMOTE ] NLOP: Full fetch complete (17635 records). [2025-09-23T20:18:34.282240] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-23T20:18:34.612984] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-23T20:18:34.714518] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-23T20:18:34.726479] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-23T20:18:34.761824] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-23T20:18:34.800264] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-23T20:18:34.886110] [DEBUG] [LOCAL ] NLY: Trimmed 77556 records to 53581 (keeping 200 days of data) [2025-09-23T20:18:34.912423] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-23T20:18:34.913196] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-23T20:18:34.913453] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-23T20:18:34.913496] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-23T20:18:34.914789] [DEBUG] [LOCAL ] NLOP: Trimmed 17635 records to 11813 (keeping 200 days of data) [2025-09-23T20:18:35.105310] [DEBUG] [LOCAL ] NLOP: Primary data saved (11813 records). [2025-09-23T20:18:35.106194] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-23T20:18:35.106611] [INFO ] [MAIN ] Update Progress: 1494/2372 symbols completed. NLOP took 37.5s. Estimated remaining: 1h 56m 40s. Rate: 7.5 symbols/min [2025-09-23T20:18:35.305276] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:18:35.432219] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T20:18:35.448508] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-23T20:18:35.460756] [DEBUG] [LOCAL ] NMCO: Loaded 16527 existing records from primary storage. [2025-09-23T20:18:35.462059] [INFO ] [MAIN ] NMCO: Loaded 16527 existing records. [2025-09-23T20:18:35.687431] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:18:35.690072] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-23T20:18:35.690460] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-23T20:18:35.692688] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-23T20:18:35.692984] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-23T20:18:35.953824] [DEBUG] [LOCAL ] NLY: Primary data saved (53581 records). [2025-09-23T20:18:35.986675] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T20:18:35.986753] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-23T20:18:36.013856] [INFO ] [MAIN ] Update Progress: 1495/2372 symbols completed. NLY took 36.8s. Estimated remaining: 1h 56m 28s. Rate: 7.5 symbols/min [2025-09-23T20:18:36.204436] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-23T20:18:36.329282] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:18:36.354707] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:18:36.363790] [DEBUG] [LOCAL ] NMG: Loaded 7500 existing records from primary storage. [2025-09-23T20:18:36.363922] [INFO ] [MAIN ] NMG: Loaded 7500 existing records. [2025-09-23T20:18:36.549686] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:18:36.549954] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-23T20:18:36.550040] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-23T20:18:36.550367] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-23T20:18:36.550434] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-23T20:18:36.911053] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:18:37.002177] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-23T20:18:37.341485] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T20:18:37.423751] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-23T20:18:37.802200] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-23T20:18:37.919087] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T20:18:38.602194] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-23T20:18:39.402171] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-23T20:18:39.473012] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T20:18:39.481140] [INFO ] [REMOTE ] NMAX: Full fetch complete (39973 records). [2025-09-23T20:18:39.481347] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-23T20:18:39.617047] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T20:18:39.699531] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 122 unique days, need 200 days [2025-09-23T20:18:39.700053] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:18:39.700125] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:18:39.700199] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-23T20:18:39.700268] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-23T20:18:39.700307] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-23T20:18:39.700348] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-23T20:18:39.700432] [INFO ] [MAIN ] Update Progress: 1496/2372 symbols completed. NMAX took 23.1s. Estimated remaining: 1h 56m 18s. Rate: 7.5 symbols/min [2025-09-23T20:18:39.889567] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:18:39.895829] [DEBUG] [LOCAL ] NMI: Loaded 4059 existing records from primary storage. [2025-09-23T20:18:39.895940] [INFO ] [MAIN ] NMI: Loaded 4059 existing records. [2025-09-23T20:18:40.084223] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:18:40.084615] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-23T20:18:40.084724] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-23T20:18:40.084964] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-23T20:18:40.085024] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-23T20:18:40.207263] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-23T20:18:40.416107] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T20:18:40.478762] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:18:41.002212] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-23T20:18:41.196225] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T20:18:41.802191] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-23T20:18:41.932729] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T20:18:42.602239] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-23T20:18:42.777434] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T20:18:43.402165] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-23T20:18:43.677937] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T20:18:43.945904] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T20:18:44.202260] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-23T20:18:45.002163] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-23T20:18:45.080043] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T20:18:45.670889] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-23T20:18:45.802224] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-23T20:18:46.602164] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-23T20:18:46.657414] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-23T20:18:47.402171] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-23T20:18:47.577490] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T20:18:48.057065] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T20:18:48.202260] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-23T20:18:49.002229] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-23T20:18:49.051465] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T20:18:49.802290] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-23T20:18:50.000685] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T20:18:50.401971] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T20:18:50.602195] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-23T20:18:51.367372] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T20:18:51.402199] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-23T20:18:51.901210] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T20:18:51.903195] [INFO ] [REMOTE ] NMG: Full fetch complete (12912 records). [2025-09-23T20:18:51.903273] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-23T20:18:52.207256] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-23T20:18:52.281574] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-23T20:18:52.281688] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-23T20:18:52.281997] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-23T20:18:52.282040] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-23T20:18:52.282527] [DEBUG] [LOCAL ] NMG: Trimmed 12912 records to 7560 (keeping 200 days of data) [2025-09-23T20:18:52.327110] [DEBUG] [LOCAL ] NMG: Primary data saved (7560 records). [2025-09-23T20:18:52.327236] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-23T20:18:52.327318] [INFO ] [MAIN ] Update Progress: 1497/2372 symbols completed. NMG took 16.3s. Estimated remaining: 1h 56m 13s. Rate: 7.5 symbols/min [2025-09-23T20:18:52.503421] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:18:52.519468] [DEBUG] [LOCAL ] NMM: Loaded 14314 existing records from primary storage. [2025-09-23T20:18:52.519629] [INFO ] [MAIN ] NMM: Loaded 14314 existing records. [2025-09-23T20:18:52.707155] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:18:52.707394] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-23T20:18:52.707445] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-23T20:18:52.708033] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-23T20:18:52.708112] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-23T20:18:53.007269] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-23T20:18:53.050712] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T20:18:53.159186] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:18:53.802231] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-23T20:18:54.201360] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T20:18:54.221182] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T20:18:54.602210] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-23T20:18:55.099834] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T20:18:55.402208] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-23T20:18:56.202174] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-23T20:18:56.381328] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T20:18:56.842795] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T20:18:56.845903] [INFO ] [REMOTE ] NMAI: Full fetch complete (20019 records). [2025-09-23T20:18:56.845985] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-23T20:18:57.007414] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-23T20:18:57.239475] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-23T20:18:57.239559] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-23T20:18:57.240031] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-23T20:18:57.240093] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-23T20:18:57.241142] [DEBUG] [LOCAL ] NMAI: Trimmed 20019 records to 13132 (keeping 200 days of data) [2025-09-23T20:18:57.329856] [DEBUG] [LOCAL ] NMAI: Primary data saved (13132 records). [2025-09-23T20:18:57.330016] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-23T20:18:57.330103] [INFO ] [MAIN ] Update Progress: 1498/2372 symbols completed. NMAI took 41.9s. Estimated remaining: 1h 56m 3s. Rate: 7.5 symbols/min [2025-09-23T20:18:57.513738] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T20:18:57.513538] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:18:57.559755] [DEBUG] [LOCAL ] NMR: Loaded 35091 existing records from primary storage. [2025-09-23T20:18:57.559905] [INFO ] [MAIN ] NMR: Loaded 35091 existing records. [2025-09-23T20:18:57.738831] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:18:57.739110] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-23T20:18:57.739157] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-23T20:18:57.740217] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-23T20:18:57.740278] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-23T20:18:57.807309] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-23T20:18:58.099116] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:18:58.602166] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-23T20:18:58.928714] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T20:18:59.402214] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-23T20:18:59.651917] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T20:19:00.202214] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-23T20:19:00.494090] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T20:19:01.002234] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-23T20:19:01.294523] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T20:19:01.699472] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T20:19:01.802216] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-23T20:19:02.428765] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T20:19:02.602230] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-23T20:19:03.212447] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T20:19:03.402264] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-23T20:19:04.078397] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T20:19:04.202214] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-23T20:19:05.002215] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-23T20:19:05.498471] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T20:19:05.579015] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T20:19:05.802207] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-23T20:19:06.602222] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-23T20:19:07.288287] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T20:19:07.310524] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T20:19:07.402194] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-23T20:19:08.202207] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-23T20:19:08.869716] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T20:19:08.927877] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T20:19:08.929485] [INFO ] [REMOTE ] NMI: Full fetch complete (6241 records). [2025-09-23T20:19:08.929559] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-23T20:19:09.007536] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-23T20:19:09.326200] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-23T20:19:09.326290] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-23T20:19:09.326481] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-23T20:19:09.326520] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-23T20:19:09.326930] [DEBUG] [LOCAL ] NMI: Trimmed 6241 records to 4064 (keeping 200 days of data) [2025-09-23T20:19:09.351162] [DEBUG] [LOCAL ] NMI: Primary data saved (4064 records). [2025-09-23T20:19:09.351265] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-23T20:19:09.351346] [INFO ] [MAIN ] Update Progress: 1499/2372 symbols completed. NMI took 29.7s. Estimated remaining: 1h 55m 57s. Rate: 7.5 symbols/min [2025-09-23T20:19:09.521756] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:19:09.526405] [DEBUG] [LOCAL ] NMS: Loaded 2888 existing records from primary storage. [2025-09-23T20:19:09.526564] [INFO ] [MAIN ] NMS: Loaded 2888 existing records. [2025-09-23T20:19:09.709341] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:19:09.709636] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-23T20:19:09.709719] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-23T20:19:09.710072] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-23T20:19:09.710133] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-23T20:19:09.809432] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-23T20:19:10.076192] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:19:10.176385] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T20:19:10.602212] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-23T20:19:11.120485] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T20:19:11.402177] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-23T20:19:11.563926] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T20:19:12.106309] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T20:19:12.110250] [INFO ] [REMOTE ] NMCO: Full fetch complete (24499 records). [2025-09-23T20:19:12.110418] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-23T20:19:12.207418] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-23T20:19:12.516421] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-23T20:19:12.516551] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-23T20:19:12.517492] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-23T20:19:12.517569] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-23T20:19:12.519062] [DEBUG] [LOCAL ] NMCO: Trimmed 24499 records to 16543 (keeping 200 days of data) [2025-09-23T20:19:12.639394] [DEBUG] [LOCAL ] NMCO: Primary data saved (16543 records). [2025-09-23T20:19:12.639611] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-23T20:19:12.639762] [INFO ] [MAIN ] Update Progress: 1500/2372 symbols completed. NMCO took 37.5s. Estimated remaining: 1h 55m 47s. Rate: 7.5 symbols/min [2025-09-23T20:19:12.751919] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T20:19:12.828198] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:19:12.833690] [DEBUG] [LOCAL ] NMT: Loaded 2845 existing records from primary storage. [2025-09-23T20:19:12.833844] [INFO ] [MAIN ] NMT: Loaded 2845 existing records. [2025-09-23T20:19:13.007331] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-23T20:19:13.038176] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:19:13.038628] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-23T20:19:13.038723] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-23T20:19:13.039045] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-23T20:19:13.039108] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-23T20:19:13.429791] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:19:13.802206] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-23T20:19:14.307567] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-23T20:19:14.602219] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-23T20:19:14.648870] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T20:19:15.402270] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-23T20:19:15.472210] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T20:19:16.202250] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-23T20:19:16.819445] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T20:19:16.874962] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T20:19:17.002235] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-23T20:19:17.802204] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-23T20:19:18.353057] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T20:19:18.380003] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T20:19:18.602204] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-23T20:19:19.402218] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-23T20:19:19.615097] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T20:19:19.747191] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T20:19:20.202225] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-23T20:19:21.002259] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-23T20:19:21.735589] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T20:19:21.754050] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T20:19:21.802168] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-23T20:19:22.542141] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T20:19:22.602170] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-23T20:19:23.402214] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-23T20:19:23.463433] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T20:19:23.466236] [INFO ] [REMOTE ] NMM: Full fetch complete (22395 records). [2025-09-23T20:19:23.466317] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-23T20:19:23.841143] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-23T20:19:23.841258] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-23T20:19:23.841845] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-23T20:19:23.841930] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-23T20:19:23.847520] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T20:19:23.850372] [DEBUG] [LOCAL ] NMM: Trimmed 22395 records to 14304 (keeping 200 days of data) [2025-09-23T20:19:23.943396] [DEBUG] [LOCAL ] NMM: Primary data saved (14304 records). [2025-09-23T20:19:23.943551] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-23T20:19:23.943662] [INFO ] [MAIN ] Update Progress: 1501/2372 symbols completed. NMM took 31.6s. Estimated remaining: 1h 55m 41s. Rate: 7.5 symbols/min [2025-09-23T20:19:24.117037] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:19:24.138828] [DEBUG] [LOCAL ] NMZ: Loaded 21499 existing records from primary storage. [2025-09-23T20:19:24.138992] [INFO ] [MAIN ] NMZ: Loaded 21499 existing records. [2025-09-23T20:19:24.207397] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-23T20:19:24.321676] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:19:24.321940] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-23T20:19:24.322027] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-23T20:19:24.322893] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-23T20:19:24.322955] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-23T20:19:24.681228] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:19:25.002199] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-23T20:19:25.498261] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T20:19:25.629622] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T20:19:25.802212] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-23T20:19:26.602215] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-23T20:19:27.015101] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T20:19:27.149327] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T20:19:27.402244] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-23T20:19:28.202239] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-23T20:19:28.717296] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T20:19:28.723501] [INFO ] [REMOTE ] NMR: Full fetch complete (50176 records). [2025-09-23T20:19:28.723676] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-23T20:19:29.007324] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-23T20:19:29.140395] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-23T20:19:29.140507] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-23T20:19:29.141828] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-23T20:19:29.141897] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-23T20:19:29.143471] [DEBUG] [LOCAL ] NMR: Trimmed 50176 records to 35045 (keeping 200 days of data) [2025-09-23T20:19:29.360928] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T20:19:29.392012] [DEBUG] [LOCAL ] NMR: Primary data saved (35045 records). [2025-09-23T20:19:29.392224] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-23T20:19:29.392341] [INFO ] [MAIN ] Update Progress: 1502/2372 symbols completed. NMR took 32.1s. Estimated remaining: 1h 55m 31s. Rate: 7.5 symbols/min [2025-09-23T20:19:29.582789] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:19:29.587898] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T20:19:29.602721] [DEBUG] [LOCAL ] NNI: Loaded 9907 existing records from primary storage. [2025-09-23T20:19:29.602903] [INFO ] [MAIN ] NNI: Loaded 9907 existing records. [2025-09-23T20:19:29.794318] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:19:29.794722] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-23T20:19:29.794782] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-23T20:19:29.795517] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-23T20:19:29.795603] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-23T20:19:29.807378] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-23T20:19:30.274539] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:19:30.500472] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T20:19:30.602238] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-23T20:19:31.402290] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-23T20:19:31.435022] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T20:19:31.754270] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-23T20:19:32.202297] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-23T20:19:32.724195] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T20:19:33.002225] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-23T20:19:33.530154] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T20:19:33.802222] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-23T20:19:34.602214] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-23T20:19:34.885843] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T20:19:35.070071] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T20:19:35.402212] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-23T20:19:36.088349] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T20:19:36.202217] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-23T20:19:36.808857] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T20:19:37.002194] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-23T20:19:37.802173] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-23T20:19:38.047216] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T20:19:38.397899] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T20:19:38.602186] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-23T20:19:39.403089] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-23T20:19:39.407155] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T20:19:40.202214] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-23T20:19:40.716627] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T20:19:40.717551] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T20:19:40.721034] [INFO ] [REMOTE ] NMS: Full fetch complete (4038 records). [2025-09-23T20:19:40.725109] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-23T20:19:41.005850] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-23T20:19:41.089162] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-23T20:19:41.089265] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-23T20:19:41.089408] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-23T20:19:41.089448] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-23T20:19:41.090030] [DEBUG] [LOCAL ] NMS: Trimmed 4038 records to 2884 (keeping 200 days of data) [2025-09-23T20:19:41.107836] [DEBUG] [LOCAL ] NMS: Primary data saved (2884 records). [2025-09-23T20:19:41.107921] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-23T20:19:41.108025] [INFO ] [MAIN ] Update Progress: 1503/2372 symbols completed. NMS took 31.8s. Estimated remaining: 1h 55m 25s. Rate: 7.5 symbols/min [2025-09-23T20:19:41.279628] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:19:41.337799] [DEBUG] [LOCAL ] NNN: Loaded 48446 existing records from primary storage. [2025-09-23T20:19:41.338021] [INFO ] [MAIN ] NNN: Loaded 48446 existing records. [2025-09-23T20:19:41.542141] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:19:41.542423] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-23T20:19:41.542474] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-23T20:19:41.545382] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-23T20:19:41.545461] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-23T20:19:41.803990] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-23T20:19:41.935877] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T20:19:42.131771] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:19:42.602251] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-23T20:19:42.911987] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T20:19:42.976805] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T20:19:43.402214] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-23T20:19:43.779429] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T20:19:44.202197] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-23T20:19:44.724071] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T20:19:45.002219] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-23T20:19:45.802193] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-23T20:19:46.158355] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T20:19:46.602193] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-23T20:19:46.660434] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T20:19:47.402227] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-23T20:19:47.572557] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T20:19:48.202235] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-23T20:19:48.604624] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T20:19:48.931596] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T20:19:49.002219] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-23T20:19:49.802208] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-23T20:19:49.876161] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T20:19:50.326541] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T20:19:50.327815] [INFO ] [REMOTE ] NMT: Full fetch complete (4281 records). [2025-09-23T20:19:50.327885] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-23T20:19:50.607367] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-23T20:19:50.712260] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-23T20:19:50.712377] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-23T20:19:50.712576] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-23T20:19:50.712639] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-23T20:19:50.713287] [DEBUG] [LOCAL ] NMT: Trimmed 4281 records to 2847 (keeping 200 days of data) [2025-09-23T20:19:50.737238] [DEBUG] [LOCAL ] NMT: Primary data saved (2847 records). [2025-09-23T20:19:50.737446] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-23T20:19:50.737593] [INFO ] [MAIN ] Update Progress: 1504/2372 symbols completed. NMT took 38.1s. Estimated remaining: 1h 55m 18s. Rate: 7.5 symbols/min [2025-09-23T20:19:50.920744] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:19:50.928570] [DEBUG] [LOCAL ] NNY: Loaded 5719 existing records from primary storage. [2025-09-23T20:19:50.928717] [INFO ] [MAIN ] NNY: Loaded 5719 existing records. [2025-09-23T20:19:51.126011] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:19:51.126331] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-23T20:19:51.126390] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-23T20:19:51.126790] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-23T20:19:51.126853] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-23T20:19:51.407317] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-23T20:19:51.534523] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:19:51.717052] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T20:19:52.202207] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-23T20:19:52.951118] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T20:19:52.971470] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T20:19:53.002157] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-23T20:19:53.806149] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-23T20:19:53.808346] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T20:19:54.602188] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-23T20:19:54.963834] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T20:19:54.972489] [INFO ] [REMOTE ] NMZ: Full fetch complete (31934 records). [2025-09-23T20:19:54.972781] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-23T20:19:55.359084] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T20:19:55.383906] [INFO ] [REMOTE ] NNI: Full fetch complete (12621 records). [2025-09-23T20:19:55.414920] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-23T20:19:55.415045] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-23T20:19:55.479103] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-23T20:19:55.520895] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-23T20:19:55.559054] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-23T20:19:55.592008] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-23T20:19:55.640113] [DEBUG] [LOCAL ] NMZ: Trimmed 31934 records to 21604 (keeping 200 days of data) [2025-09-23T20:19:56.005589] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-23T20:19:56.006621] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-23T20:19:56.007473] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-23T20:19:56.007869] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-23T20:19:56.011851] [DEBUG] [LOCAL ] NNI: Trimmed 12621 records to 9959 (keeping 200 days of data) [2025-09-23T20:19:56.111413] [DEBUG] [LOCAL ] NNI: Primary data saved (9959 records). [2025-09-23T20:19:56.118542] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-23T20:19:56.119350] [INFO ] [MAIN ] Update Progress: 1505/2372 symbols completed. NNI took 26.7s. Estimated remaining: 1h 55m 9s. Rate: 7.5 symbols/min [2025-09-23T20:19:56.198062] [DEBUG] [LOCAL ] NMZ: Primary data saved (21604 records). [2025-09-23T20:19:56.204577] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-23T20:19:56.215347] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-23T20:19:56.232366] [INFO ] [MAIN ] Update Progress: 1506/2372 symbols completed. NMZ took 32.3s. Estimated remaining: 1h 54m 56s. Rate: 7.5 symbols/min [2025-09-23T20:19:56.434521] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:19:56.516496] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:19:56.524487] [DEBUG] [LOCAL ] NOA: Loaded 16312 existing records from primary storage. [2025-09-23T20:19:56.524663] [INFO ] [MAIN ] NOA: Loaded 16312 existing records. [2025-09-23T20:19:56.705248] [DEBUG] [LOCAL ] NOAH: Loaded 20036 existing records from primary storage. [2025-09-23T20:19:56.717284] [INFO ] [MAIN ] NOAH: Loaded 20036 existing records. [2025-09-23T20:19:56.739088] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:19:56.819924] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-23T20:19:56.856340] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-23T20:19:56.877504] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-23T20:19:56.887903] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-23T20:19:57.000271] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:19:57.039609] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-23T20:19:57.058106] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-23T20:19:57.083876] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-23T20:19:57.089237] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-23T20:19:57.360308] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T20:19:57.481418] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-23T20:19:57.740954] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:19:57.780637] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-23T20:19:57.807718] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-23T20:19:57.917740] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:19:58.351552] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T20:19:58.602228] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-23T20:19:58.696580] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T20:19:59.402162] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-23T20:19:59.804197] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T20:20:00.202211] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-23T20:20:00.295337] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T20:20:01.002220] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-23T20:20:01.676496] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-23T20:20:01.802258] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-23T20:20:02.005046] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T20:20:02.602241] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-23T20:20:02.870677] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T20:20:03.402254] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-23T20:20:04.202214] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-23T20:20:04.420799] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T20:20:04.606031] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T20:20:05.002182] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-23T20:20:05.138591] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T20:20:05.802194] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-23T20:20:05.849371] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T20:20:06.602234] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-23T20:20:06.762208] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T20:20:07.402212] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-23T20:20:07.543500] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T20:20:08.157593] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T20:20:08.202155] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-23T20:20:09.002217] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-23T20:20:09.802173] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-23T20:20:09.916211] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T20:20:10.249472] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T20:20:10.298079] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T20:20:10.602183] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-23T20:20:11.402172] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-23T20:20:11.641603] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-23T20:20:12.202209] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-23T20:20:13.002233] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-23T20:20:13.068321] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T20:20:13.463483] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T20:20:13.802230] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-23T20:20:14.123623] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T20:20:14.560928] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T20:20:14.602171] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-23T20:20:15.402160] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-23T20:20:15.637018] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T20:20:16.202223] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-23T20:20:17.002193] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-23T20:20:17.066668] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T20:20:17.103877] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T20:20:17.802166] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-23T20:20:17.891826] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T20:20:17.898753] [INFO ] [REMOTE ] NOAH: Full fetch complete (28928 records). [2025-09-23T20:20:17.898969] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-23T20:20:18.343523] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-23T20:20:18.343685] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-23T20:20:18.344301] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-23T20:20:18.344372] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-23T20:20:18.345164] [DEBUG] [LOCAL ] NOAH: Trimmed 28928 records to 20090 (keeping 200 days of data) [2025-09-23T20:20:18.466857] [DEBUG] [LOCAL ] NOAH: Primary data saved (20090 records). [2025-09-23T20:20:18.466985] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-23T20:20:18.467083] [INFO ] [MAIN ] Update Progress: 1507/2372 symbols completed. NOAH took 22.2s. Estimated remaining: 1h 54m 57s. Rate: 7.5 symbols/min [2025-09-23T20:20:18.607382] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-23T20:20:18.641386] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:20:18.700599] [DEBUG] [LOCAL ] NOC: Loaded 42698 existing records from primary storage. [2025-09-23T20:20:18.700773] [INFO ] [MAIN ] NOC: Loaded 42698 existing records. [2025-09-23T20:20:18.888118] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:20:18.888844] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-23T20:20:18.888904] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-23T20:20:18.890099] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-23T20:20:18.890161] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-23T20:20:19.255317] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T20:20:19.260745] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:20:19.402192] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-23T20:20:19.550805] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T20:20:20.106312] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T20:20:20.202181] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-23T20:20:21.002243] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-23T20:20:21.802199] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-23T20:20:21.858831] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T20:20:21.867443] [INFO ] [REMOTE ] NNN: Full fetch complete (70194 records). [2025-09-23T20:20:21.867591] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-23T20:20:22.071593] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T20:20:22.297337] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-23T20:20:22.297439] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-23T20:20:22.298402] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-23T20:20:22.298468] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-23T20:20:22.302736] [DEBUG] [LOCAL ] NNN: Trimmed 70194 records to 48450 (keeping 200 days of data) [2025-09-23T20:20:22.605050] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-23T20:20:22.606378] [DEBUG] [LOCAL ] NNN: Primary data saved (48450 records). [2025-09-23T20:20:22.606686] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-23T20:20:22.606839] [INFO ] [MAIN ] Update Progress: 1508/2372 symbols completed. NNN took 41.5s. Estimated remaining: 1h 54m 46s. Rate: 7.5 symbols/min [2025-09-23T20:20:22.787885] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:20:22.843832] [DEBUG] [LOCAL ] NOG: Loaded 51153 existing records from primary storage. [2025-09-23T20:20:22.843985] [INFO ] [MAIN ] NOG: Loaded 51153 existing records. [2025-09-23T20:20:23.029806] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:20:23.030132] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-23T20:20:23.030183] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-23T20:20:23.031594] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-23T20:20:23.031681] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-23T20:20:23.371332] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T20:20:23.421432] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-23T20:20:23.431429] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:20:23.457614] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T20:20:24.115916] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T20:20:24.202208] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-23T20:20:25.002215] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-23T20:20:25.802191] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-23T20:20:25.989781] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T20:20:26.044475] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T20:20:26.430358] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T20:20:26.433006] [INFO ] [REMOTE ] NNY: Full fetch complete (8957 records). [2025-09-23T20:20:26.433083] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-23T20:20:26.610772] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-23T20:20:26.838008] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-23T20:20:26.838090] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-23T20:20:26.838425] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-23T20:20:26.838482] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-23T20:20:26.838941] [DEBUG] [LOCAL ] NNY: Trimmed 8957 records to 5702 (keeping 200 days of data) [2025-09-23T20:20:26.878310] [DEBUG] [LOCAL ] NNY: Primary data saved (5702 records). [2025-09-23T20:20:26.878426] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-23T20:20:26.878538] [INFO ] [MAIN ] Update Progress: 1509/2372 symbols completed. NNY took 36.1s. Estimated remaining: 1h 54m 36s. Rate: 7.5 symbols/min [2025-09-23T20:20:27.047981] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:20:27.117834] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-23T20:20:27.118000] [INFO ] [MAIN ] NOK: Loaded 53621 existing records. [2025-09-23T20:20:27.304426] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:20:27.304745] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-23T20:20:27.304804] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-23T20:20:27.306529] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-23T20:20:27.306594] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-23T20:20:27.409827] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-23T20:20:27.494551] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T20:20:27.593960] [INFO ] [REMOTE ] NOA: Full fetch complete (21810 records). [2025-09-23T20:20:27.616475] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-23T20:20:27.821125] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:20:28.108422] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-23T20:20:28.108526] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-23T20:20:28.109139] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-23T20:20:28.109204] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-23T20:20:28.110121] [DEBUG] [LOCAL ] NOA: Trimmed 21810 records to 16275 (keeping 200 days of data) [2025-09-23T20:20:28.205072] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-23T20:20:28.228035] [DEBUG] [LOCAL ] NOA: Primary data saved (16275 records). [2025-09-23T20:20:28.228320] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-23T20:20:28.228423] [INFO ] [MAIN ] Update Progress: 1510/2372 symbols completed. NOA took 32.1s. Estimated remaining: 1h 54m 25s. Rate: 7.5 symbols/min [2025-09-23T20:20:28.416824] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:20:28.417023] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-23T20:20:28.417063] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-23T20:20:28.417211] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-23T20:20:28.417255] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-23T20:20:28.417298] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-23T20:20:28.417333] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-23T20:20:28.812904] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:20:29.002170] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-23T20:20:29.244491] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T20:20:29.802225] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-23T20:20:30.274055] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T20:20:30.369174] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T20:20:30.602184] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-23T20:20:31.328675] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T20:20:31.402211] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-23T20:20:32.202232] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-23T20:20:32.416623] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T20:20:33.002208] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-23T20:20:33.358161] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T20:20:33.662851] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T20:20:33.802196] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-23T20:20:34.602217] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-23T20:20:34.764927] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T20:20:35.036107] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T20:20:35.402202] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-23T20:20:35.770489] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-23T20:20:35.785609] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T20:20:36.202203] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-23T20:20:37.002250] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-23T20:20:37.802240] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-23T20:20:38.194089] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T20:20:38.498708] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-23T20:20:38.602193] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-23T20:20:38.877538] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T20:20:39.402212] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-23T20:20:39.952969] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T20:20:40.202233] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-23T20:20:40.726844] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T20:20:40.729050] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T20:20:41.002199] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-23T20:20:41.802216] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-23T20:20:42.206754] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T20:20:42.602176] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-23T20:20:42.782383] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T20:20:43.402197] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-23T20:20:44.202249] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-23T20:20:44.607198] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T20:20:45.002211] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-23T20:20:45.261817] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T20:20:45.403850] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T20:20:45.802212] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-23T20:20:46.090842] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T20:20:46.296114] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-23T20:20:46.602197] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-23T20:20:47.083202] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T20:20:47.402207] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-23T20:20:48.202196] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-23T20:20:48.744821] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T20:20:48.745836] [INFO ] [REMOTE ] NOM: Full fetch complete (1721 records). [2025-09-23T20:20:48.745908] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-23T20:20:48.926877] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-23T20:20:48.927059] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:20:48.927127] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:20:48.927197] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-23T20:20:48.927316] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-23T20:20:48.927359] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-23T20:20:48.927416] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-23T20:20:48.927496] [INFO ] [MAIN ] Update Progress: 1511/2372 symbols completed. NOM took 20.7s. Estimated remaining: 1h 54m 24s. Rate: 7.5 symbols/min [2025-09-23T20:20:49.007298] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-23T20:20:49.105358] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:20:49.161948] [DEBUG] [LOCAL ] NOMD: Loaded 41390 existing records from primary storage. [2025-09-23T20:20:49.162094] [INFO ] [MAIN ] NOMD: Loaded 41390 existing records. [2025-09-23T20:20:49.342191] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:20:49.342558] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-23T20:20:49.342683] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-23T20:20:49.343754] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-23T20:20:49.343818] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-23T20:20:49.719629] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-23T20:20:49.779810] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:20:49.802192] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-23T20:20:50.413713] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T20:20:50.602185] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-23T20:20:51.402195] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-23T20:20:52.024295] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T20:20:52.126382] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T20:20:52.133108] [INFO ] [REMOTE ] NOC: Full fetch complete (62159 records). [2025-09-23T20:20:52.133262] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-23T20:20:52.209764] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-23T20:20:52.554738] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-23T20:20:52.554922] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-23T20:20:52.555983] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-23T20:20:52.556180] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-23T20:20:52.578936] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T20:20:52.579091] [DEBUG] [LOCAL ] NOC: Trimmed 62159 records to 42599 (keeping 200 days of data) [2025-09-23T20:20:52.872863] [DEBUG] [LOCAL ] NOC: Primary data saved (42599 records). [2025-09-23T20:20:52.872997] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-23T20:20:52.875078] [INFO ] [MAIN ] Update Progress: 1512/2372 symbols completed. NOC took 34.4s. Estimated remaining: 1h 54m 14s. Rate: 7.5 symbols/min [2025-09-23T20:20:53.007312] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-23T20:20:53.066582] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:20:53.115417] [DEBUG] [LOCAL ] NOTE: Loaded 43132 existing records from primary storage. [2025-09-23T20:20:53.115590] [INFO ] [MAIN ] NOTE: Loaded 43132 existing records. [2025-09-23T20:20:53.326532] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:20:53.326813] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-23T20:20:53.326865] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-23T20:20:53.327775] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-23T20:20:53.327836] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-23T20:20:53.696024] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:20:53.802216] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-23T20:20:54.369686] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-23T20:20:54.602236] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-23T20:20:54.952847] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T20:20:55.321344] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T20:20:55.402234] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-23T20:20:56.202213] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-23T20:20:56.677727] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T20:20:56.687823] [INFO ] [REMOTE ] NOK: Full fetch complete (77632 records). [2025-09-23T20:20:56.687983] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-23T20:20:57.016661] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-23T20:20:57.215513] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-23T20:20:57.215880] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-23T20:20:57.217589] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-23T20:20:57.220435] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-23T20:20:57.220312] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T20:20:57.238333] [DEBUG] [LOCAL ] NOK: Trimmed 77632 records to 53621 (keeping 200 days of data) [2025-09-23T20:20:57.496879] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T20:20:57.613826] [DEBUG] [LOCAL ] NOK: Primary data saved (53621 records). [2025-09-23T20:20:57.614003] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-23T20:20:57.614123] [INFO ] [MAIN ] Update Progress: 1513/2372 symbols completed. NOK took 30.7s. Estimated remaining: 1h 54m 4s. Rate: 7.5 symbols/min [2025-09-23T20:20:57.807264] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-23T20:20:57.808524] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:20:57.870826] [DEBUG] [LOCAL ] NOV: Loaded 53184 existing records from primary storage. [2025-09-23T20:20:57.870991] [INFO ] [MAIN ] NOV: Loaded 53184 existing records. [2025-09-23T20:20:58.074097] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:20:58.074435] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-23T20:20:58.074520] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-23T20:20:58.075938] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-23T20:20:58.076004] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-23T20:20:58.478418] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:20:58.602171] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-23T20:20:59.028570] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-23T20:20:59.397865] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T20:20:59.406694] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-23T20:21:00.202185] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-23T20:21:00.263598] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T20:21:01.002175] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-23T20:21:01.451159] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T20:21:01.802213] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-23T20:21:02.602208] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-23T20:21:02.695099] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-23T20:21:03.402306] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-23T20:21:04.002282] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (3.00 seconds). [2025-09-23T20:21:04.202198] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-23T20:21:04.697035] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-23T20:21:05.002206] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-23T20:21:05.072291] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T20:21:05.372097] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (3.57 seconds). [2025-09-23T20:21:05.802256] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-23T20:21:06.131591] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T20:21:06.340856] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T20:21:06.602236] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-23T20:21:07.402177] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-23T20:21:07.644552] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T20:21:08.202162] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-23T20:21:08.527017] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T20:21:08.729737] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T20:21:09.002237] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-23T20:21:09.802196] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-23T20:21:09.858554] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T20:21:10.176309] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T20:21:10.602233] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-23T20:21:11.402248] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-23T20:21:11.444617] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T20:21:11.453119] [INFO ] [REMOTE ] NOG: Full fetch complete (73616 records). [2025-09-23T20:21:11.453250] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-23T20:21:11.857031] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-23T20:21:11.857122] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-23T20:21:11.858194] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-23T20:21:11.858263] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-23T20:21:11.859779] [DEBUG] [LOCAL ] NOG: Trimmed 73616 records to 51164 (keeping 200 days of data) [2025-09-23T20:21:12.194946] [DEBUG] [LOCAL ] NOG: Primary data saved (51164 records). [2025-09-23T20:21:12.195111] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-23T20:21:12.195238] [INFO ] [MAIN ] Update Progress: 1514/2372 symbols completed. NOG took 49.6s. Estimated remaining: 1h 53m 60s. Rate: 7.5 symbols/min [2025-09-23T20:21:12.216724] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-23T20:21:12.377868] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:21:12.378130] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-09-23T20:21:12.378256] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-23T20:21:12.378681] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-23T20:21:12.378789] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-23T20:21:12.378858] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-23T20:21:12.378897] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-23T20:21:12.729746] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-23T20:21:12.826866] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:21:13.002234] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-23T20:21:13.284749] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T20:21:13.787060] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T20:21:13.802159] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-23T20:21:14.602238] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-23T20:21:14.860318] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T20:21:15.369691] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T20:21:15.378101] [INFO ] [REMOTE ] NOMD: Full fetch complete (58896 records). [2025-09-23T20:21:15.378445] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-23T20:21:15.407473] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-23T20:21:15.797582] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-23T20:21:15.797734] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-23T20:21:15.798837] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-23T20:21:15.798906] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-23T20:21:15.800401] [DEBUG] [LOCAL ] NOMD: Trimmed 58896 records to 41396 (keeping 200 days of data) [2025-09-23T20:21:16.066009] [DEBUG] [LOCAL ] NOMD: Primary data saved (41396 records). [2025-09-23T20:21:16.066150] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-23T20:21:16.066240] [INFO ] [MAIN ] Update Progress: 1515/2372 symbols completed. NOMD took 27.1s. Estimated remaining: 1h 53m 49s. Rate: 7.5 symbols/min [2025-09-23T20:21:16.207447] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-23T20:21:16.253968] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:21:16.254124] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-23T20:21:16.254162] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-23T20:21:16.254305] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-23T20:21:16.254347] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-23T20:21:16.254389] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-23T20:21:16.254424] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-23T20:21:16.653531] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:21:16.788474] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-23T20:21:17.002222] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-23T20:21:17.501598] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:21:17.501956] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-23T20:21:17.802207] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-23T20:21:18.128480] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-23T20:21:18.578102] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-23T20:21:18.602161] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-23T20:21:19.407376] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-23T20:21:19.441411] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T20:21:20.202225] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-23T20:21:20.597911] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-23T20:21:21.002225] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-23T20:21:21.212497] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T20:21:21.251930] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:21:21.252273] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-23T20:21:21.631567] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T20:21:21.802198] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-23T20:21:22.602206] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-23T20:21:22.959487] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T20:21:22.964921] [INFO ] [REMOTE ] NOTE: Full fetch complete (64629 records). [2025-09-23T20:21:22.965089] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-23T20:21:23.406310] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-23T20:21:23.405905] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-23T20:21:23.406752] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-23T20:21:23.408278] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-23T20:21:23.409127] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-23T20:21:23.411302] [DEBUG] [LOCAL ] NOTE: Trimmed 64629 records to 42980 (keeping 200 days of data) [2025-09-23T20:21:23.673420] [DEBUG] [LOCAL ] NOTE: Primary data saved (42980 records). [2025-09-23T20:21:23.673582] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-23T20:21:23.673754] [INFO ] [MAIN ] Update Progress: 1516/2372 symbols completed. NOTE took 30.8s. Estimated remaining: 1h 53m 41s. Rate: 7.5 symbols/min [2025-09-23T20:21:23.851862] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:21:23.872086] [DEBUG] [LOCAL ] NPCT: Loaded 16799 existing records from primary storage. [2025-09-23T20:21:23.872230] [INFO ] [MAIN ] NPCT: Loaded 16799 existing records. [2025-09-23T20:21:24.063515] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:21:24.064142] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-23T20:21:24.064221] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-23T20:21:24.064886] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-23T20:21:24.064952] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-23T20:21:24.210113] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-23T20:21:24.259340] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T20:21:24.502247] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:21:25.002243] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-23T20:21:25.044638] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T20:21:25.313817] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T20:21:25.802170] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-23T20:21:25.872015] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T20:21:26.502390] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T20:21:26.602204] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-23T20:21:27.402208] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-23T20:21:28.202216] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-23T20:21:28.949376] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-23T20:21:29.007329] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-23T20:21:29.031364] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T20:21:29.341625] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T20:21:29.802200] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-23T20:21:30.042103] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T20:21:30.602203] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-23T20:21:31.402236] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-23T20:21:31.653248] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T20:21:31.984541] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T20:21:32.202249] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-23T20:21:32.759031] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-23T20:21:33.002204] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-23T20:21:33.802209] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-23T20:21:33.940124] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T20:21:33.949567] [INFO ] [REMOTE ] NOV: Full fetch complete (76981 records). [2025-09-23T20:21:33.949774] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-23T20:21:34.385052] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-23T20:21:34.385161] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-23T20:21:34.386306] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-23T20:21:34.386372] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-23T20:21:34.387928] [DEBUG] [LOCAL ] NOV: Trimmed 76981 records to 53184 (keeping 200 days of data) [2025-09-23T20:21:34.596769] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T20:21:34.623883] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-23T20:21:34.765529] [DEBUG] [LOCAL ] NOV: Primary data saved (53184 records). [2025-09-23T20:21:34.765719] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-23T20:21:34.765888] [INFO ] [MAIN ] Update Progress: 1517/2372 symbols completed. NOV took 37.2s. Estimated remaining: 1h 53m 35s. Rate: 7.5 symbols/min [2025-09-23T20:21:34.842336] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T20:21:35.402215] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-23T20:21:35.554448] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T20:21:36.202207] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-23T20:21:37.002191] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-23T20:21:37.297786] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T20:21:37.556755] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T20:21:37.683760] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T20:21:37.802210] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-23T20:21:38.602202] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-23T20:21:38.873130] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T20:21:39.402191] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-23T20:21:39.671299] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T20:21:40.202294] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-23T20:21:40.311814] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-23T20:21:40.312193] [WARN ] [REMOTE ] NPB: No data returned for month 2025-09 [2025-09-23T20:21:40.312296] [INFO ] [REMOTE ] NPB: Full fetch complete (14088 records). [2025-09-23T20:21:40.312368] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-23T20:21:40.313084] [FATAL] [VALIDATOR ] NPB: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:21:40.313165] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:21:40.313210] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:21:40.313249] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-23T20:21:40.313305] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-23T20:21:40.313342] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-23T20:21:40.313400] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-23T20:21:40.313482] [INFO ] [MAIN ] Update Progress: 1518/2372 symbols completed. NPB took 24.2s. Estimated remaining: 1h 53m 26s. Rate: 7.5 symbols/min [2025-09-23T20:21:41.002211] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-23T20:21:41.321487] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T20:21:41.802201] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-23T20:21:42.079711] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T20:21:42.576304] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T20:21:42.585178] [INFO ] [REMOTE ] NOW: Full fetch complete (70469 records). [2025-09-23T20:21:42.585442] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-23T20:21:42.586818] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:21:42.586937] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:21:42.586984] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:21:42.587029] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-23T20:21:42.587132] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-23T20:21:42.587194] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-09-23T20:21:42.587242] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-09-23T20:21:42.587385] [INFO ] [MAIN ] Update Progress: 1519/2372 symbols completed. NOW took 30.4s. Estimated remaining: 1h 53m 14s. Rate: 7.5 symbols/min [2025-09-23T20:21:42.602223] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-23T20:21:43.736117] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T20:21:43.741504] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-23T20:21:44.904235] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T20:21:44.909327] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-23T20:21:45.853462] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T20:21:45.858289] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-23T20:21:46.769029] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T20:21:46.772972] [INFO ] [REMOTE ] NPCT: Full fetch complete (25169 records). [2025-09-23T20:21:46.773164] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-23T20:21:47.334506] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-23T20:21:47.334620] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-23T20:21:47.335263] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-23T20:21:47.335326] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-23T20:21:47.336209] [DEBUG] [LOCAL ] NPCT: Trimmed 25169 records to 16832 (keeping 200 days of data) [2025-09-23T20:21:47.443779] [DEBUG] [LOCAL ] NPCT: Primary data saved (16832 records). [2025-09-23T20:21:47.443929] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-23T20:21:47.444014] [INFO ] [MAIN ] Update Progress: 1520/2372 symbols completed. NPCT took 23.8s. Estimated remaining: 1h 53m 5s. Rate: 7.5 symbols/min [2025-09-23T20:21:48.078287] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:21:48.200752] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:21:48.180744] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:21:48.200981] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-23T20:21:48.223279] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-23T20:21:48.228550] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:21:48.226909] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-23T20:21:48.229316] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-23T20:21:48.229794] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-23T20:21:48.229883] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-23T20:21:48.356810] [DEBUG] [LOCAL ] NPO: Loaded 12809 existing records from primary storage. [2025-09-23T20:21:48.361106] [DEBUG] [LOCAL ] NPK: Loaded 8089 existing records from primary storage. [2025-09-23T20:21:48.372059] [INFO ] [MAIN ] NPK: Loaded 8089 existing records. [2025-09-23T20:21:48.360741] [DEBUG] [LOCAL ] NPFD: Loaded 9764 existing records from primary storage. [2025-09-23T20:21:48.377470] [INFO ] [MAIN ] NPFD: Loaded 9764 existing records. [2025-09-23T20:21:48.377556] [INFO ] [MAIN ] NPO: Loaded 12809 existing records. [2025-09-23T20:21:49.116227] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:21:49.217458] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:21:49.167163] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-23T20:21:49.217894] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-23T20:21:49.210622] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:21:49.217670] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:21:49.218238] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-23T20:21:49.218147] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-23T20:21:49.219120] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-23T20:21:49.218899] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-23T20:21:49.219252] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-23T20:21:49.219466] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-23T20:21:49.219389] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-23T20:21:49.226192] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-23T20:21:49.219497] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-23T20:21:49.243324] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-23T20:21:49.237639] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-23T20:21:50.246341] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:21:50.298364] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-23T20:21:50.388730] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:21:50.378935] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:21:50.391629] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-23T20:21:50.391297] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-23T20:21:50.395402] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T20:21:50.399748] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-23T20:21:51.300431] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T20:21:51.302748] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-23T20:21:51.332263] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T20:21:51.335603] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-23T20:21:51.414064] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T20:21:51.417357] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-23T20:21:51.692723] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T20:21:51.778458] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T20:21:51.858831] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T20:21:51.996255] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T20:21:52.202206] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-23T20:21:52.903205] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T20:21:53.002215] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-23T20:21:53.802347] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-23T20:21:53.874142] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T20:21:54.602256] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-23T20:21:54.643545] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T20:21:55.402252] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-23T20:21:55.735136] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T20:21:56.202246] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-23T20:21:56.222945] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T20:21:57.002278] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-23T20:21:57.167504] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T20:21:57.480630] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T20:21:57.802256] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-23T20:21:58.605711] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-23T20:21:58.610407] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T20:21:59.402179] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-23T20:21:59.683033] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T20:22:00.202243] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-23T20:22:00.267532] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T20:22:01.002244] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-23T20:22:01.117127] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T20:22:01.802230] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-23T20:22:02.171845] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T20:22:02.602232] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-23T20:22:02.657756] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-23T20:22:03.408590] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-23T20:22:03.413787] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T20:22:04.202175] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-23T20:22:04.334757] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T20:22:05.002294] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-23T20:22:05.020189] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T20:22:05.798165] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T20:22:05.802134] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-23T20:22:06.602251] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-23T20:22:06.655273] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T20:22:07.402260] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-23T20:22:08.109077] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T20:22:08.110814] [INFO ] [REMOTE ] NPK: Full fetch complete (10892 records). [2025-09-23T20:22:08.110937] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-23T20:22:08.206402] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-23T20:22:08.485188] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T20:22:08.610540] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-23T20:22:08.610673] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-23T20:22:08.611031] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-23T20:22:08.611158] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-23T20:22:08.613117] [DEBUG] [LOCAL ] NPK: Trimmed 10892 records to 8076 (keeping 200 days of data) [2025-09-23T20:22:08.668951] [DEBUG] [LOCAL ] NPK: Primary data saved (8076 records). [2025-09-23T20:22:08.669178] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-23T20:22:08.669394] [INFO ] [MAIN ] Update Progress: 1521/2372 symbols completed. NPK took 21.2s. Estimated remaining: 1h 53m 4s. Rate: 7.5 symbols/min [2025-09-23T20:22:08.845152] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:22:08.862045] [DEBUG] [LOCAL ] NPV: Loaded 4937 existing records from primary storage. [2025-09-23T20:22:08.862193] [INFO ] [MAIN ] NPV: Loaded 4937 existing records. [2025-09-23T20:22:09.013413] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-23T20:22:09.059710] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:22:09.060541] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-23T20:22:09.060668] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-23T20:22:09.061035] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-23T20:22:09.061115] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-23T20:22:09.280633] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T20:22:09.494383] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:22:09.733904] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T20:22:09.802160] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-23T20:22:10.602161] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-23T20:22:10.824622] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T20:22:11.227437] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T20:22:11.402227] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-23T20:22:12.170812] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T20:22:12.202224] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-23T20:22:12.790384] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T20:22:12.792687] [INFO ] [REMOTE ] NPFD: Full fetch complete (14768 records). [2025-09-23T20:22:12.792764] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-23T20:22:13.007368] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-23T20:22:13.162151] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-23T20:22:13.162233] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-23T20:22:13.162570] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-23T20:22:13.162608] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-23T20:22:13.163139] [DEBUG] [LOCAL ] NPFD: Trimmed 14768 records to 9670 (keeping 200 days of data) [2025-09-23T20:22:13.230274] [DEBUG] [LOCAL ] NPFD: Primary data saved (9670 records). [2025-09-23T20:22:13.230406] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-23T20:22:13.230529] [INFO ] [MAIN ] Update Progress: 1522/2372 symbols completed. NPFD took 25.8s. Estimated remaining: 1h 52m 54s. Rate: 7.5 symbols/min [2025-09-23T20:22:13.403365] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:22:13.454828] [DEBUG] [LOCAL ] NPWR: Loaded 43055 existing records from primary storage. [2025-09-23T20:22:13.455029] [INFO ] [MAIN ] NPWR: Loaded 43055 existing records. [2025-09-23T20:22:13.634352] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:22:13.634718] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-23T20:22:13.634777] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-23T20:22:13.636712] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-23T20:22:13.636801] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-23T20:22:13.820728] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-23T20:22:14.016586] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:22:14.515880] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T20:22:14.602185] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-23T20:22:14.677723] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T20:22:15.221831] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T20:22:15.402257] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-23T20:22:16.202184] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-23T20:22:16.277277] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T20:22:16.280186] [INFO ] [REMOTE ] NPO: Full fetch complete (18089 records). [2025-09-23T20:22:16.280333] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-23T20:22:16.726165] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-23T20:22:16.726257] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-23T20:22:16.726839] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-23T20:22:16.726906] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-23T20:22:16.727603] [DEBUG] [LOCAL ] NPO: Trimmed 18089 records to 12839 (keeping 200 days of data) [2025-09-23T20:22:16.833063] [DEBUG] [LOCAL ] NPO: Primary data saved (12839 records). [2025-09-23T20:22:16.833823] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-23T20:22:16.834145] [INFO ] [MAIN ] Update Progress: 1523/2372 symbols completed. NPO took 29.4s. Estimated remaining: 1h 52m 44s. Rate: 7.5 symbols/min [2025-09-23T20:22:17.002299] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-23T20:22:17.030325] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:22:17.050099] [DEBUG] [LOCAL ] NQP: Loaded 9278 existing records from primary storage. [2025-09-23T20:22:17.050240] [INFO ] [MAIN ] NQP: Loaded 9278 existing records. [2025-09-23T20:22:17.245014] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:22:17.245354] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-23T20:22:17.245726] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-23T20:22:17.247098] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-23T20:22:17.247208] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-23T20:22:17.674103] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:22:17.699558] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T20:22:17.802239] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-23T20:22:17.820113] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T20:22:18.602237] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-23T20:22:19.402175] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-23T20:22:19.431057] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T20:22:20.202206] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-23T20:22:20.244011] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T20:22:20.411189] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T20:22:20.880189] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T20:22:21.002244] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-23T20:22:21.632426] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-23T20:22:21.802213] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-23T20:22:22.461902] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T20:22:22.602194] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-23T20:22:23.304111] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T20:22:23.402232] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-23T20:22:24.202213] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-23T20:22:24.915122] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T20:22:24.939909] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T20:22:25.002185] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-23T20:22:25.802212] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-23T20:22:26.310922] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T20:22:26.583220] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T20:22:26.602160] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-23T20:22:27.402184] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-23T20:22:27.475759] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T20:22:28.202236] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-23T20:22:28.977227] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T20:22:29.002925] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-23T20:22:29.008953] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T20:22:29.802205] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-23T20:22:30.602207] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-23T20:22:30.870336] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T20:22:30.945594] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-23T20:22:31.402310] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-23T20:22:31.493041] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T20:22:31.846959] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T20:22:32.202225] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-23T20:22:33.002373] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-23T20:22:33.802192] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-23T20:22:33.835755] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T20:22:33.909732] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T20:22:34.602201] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-23T20:22:34.916563] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T20:22:34.923316] [INFO ] [REMOTE ] NPKI: Full fetch complete (52785 records). [2025-09-23T20:22:34.923439] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-23T20:22:35.132885] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-23T20:22:35.133547] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:22:35.133699] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:22:35.133963] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-23T20:22:35.140236] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-23T20:22:35.141083] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T20:22:35.140831] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-23T20:22:35.144148] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-23T20:22:35.144240] [INFO ] [MAIN ] Update Progress: 1524/2372 symbols completed. NPKI took 47.7s. Estimated remaining: 1h 52m 42s. Rate: 7.5 symbols/min [2025-09-23T20:22:35.343405] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:22:35.392265] [DEBUG] [LOCAL ] NRDY: Loaded 33052 existing records from primary storage. [2025-09-23T20:22:35.392438] [INFO ] [MAIN ] NRDY: Loaded 33052 existing records. [2025-09-23T20:22:35.407369] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-23T20:22:35.591694] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:22:35.591952] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-23T20:22:35.591999] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-23T20:22:35.593328] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-23T20:22:35.593393] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-23T20:22:35.980838] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:22:36.202216] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-23T20:22:36.887590] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T20:22:37.002203] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-23T20:22:37.213878] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T20:22:37.678212] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T20:22:37.679958] [INFO ] [REMOTE ] NPV: Full fetch complete (6861 records). [2025-09-23T20:22:37.680032] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-23T20:22:37.807388] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-23T20:22:38.053113] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-23T20:22:38.053204] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-23T20:22:38.053394] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-23T20:22:38.053432] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-23T20:22:38.053909] [DEBUG] [LOCAL ] NPV: Trimmed 6861 records to 5013 (keeping 200 days of data) [2025-09-23T20:22:38.091171] [DEBUG] [LOCAL ] NPV: Primary data saved (5013 records). [2025-09-23T20:22:38.091324] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-23T20:22:38.091480] [INFO ] [MAIN ] Update Progress: 1525/2372 symbols completed. NPV took 29.4s. Estimated remaining: 1h 52m 31s. Rate: 7.5 symbols/min [2025-09-23T20:22:38.272334] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:22:38.285156] [DEBUG] [LOCAL ] NREF: Loaded 7823 existing records from primary storage. [2025-09-23T20:22:38.285446] [INFO ] [MAIN ] NREF: Loaded 7823 existing records. [2025-09-23T20:22:38.477344] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:22:38.477634] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-23T20:22:38.477727] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-23T20:22:38.478216] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-23T20:22:38.478279] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-23T20:22:38.607332] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-23T20:22:39.046277] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:22:39.402223] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-23T20:22:39.492837] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T20:22:39.496323] [INFO ] [REMOTE ] NQP: Full fetch complete (13505 records). [2025-09-23T20:22:39.496553] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-23T20:22:40.114074] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-23T20:22:40.117074] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-23T20:22:40.117218] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-23T20:22:40.118341] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-23T20:22:40.128815] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-23T20:22:40.130901] [DEBUG] [LOCAL ] NQP: Trimmed 13505 records to 9312 (keeping 200 days of data) [2025-09-23T20:22:40.202714] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-23T20:22:40.203070] [DEBUG] [LOCAL ] NQP: Primary data saved (9312 records). [2025-09-23T20:22:40.204471] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-23T20:22:40.204611] [INFO ] [MAIN ] Update Progress: 1526/2372 symbols completed. NQP took 23.4s. Estimated remaining: 1h 52m 20s. Rate: 7.5 symbols/min [2025-09-23T20:22:40.257787] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T20:22:40.419385] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:22:40.419680] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-23T20:22:40.419735] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-23T20:22:40.419901] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-23T20:22:40.419945] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-23T20:22:40.419986] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-23T20:22:40.420019] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-23T20:22:40.881079] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:22:41.002193] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-23T20:22:41.676371] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T20:22:41.802187] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-23T20:22:41.953725] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T20:22:42.602216] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-23T20:22:43.402207] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-23T20:22:43.713257] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-23T20:22:44.202213] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-23T20:22:44.395316] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T20:22:44.660704] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T20:22:44.986731] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T20:22:45.002177] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-23T20:22:45.802227] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-23T20:22:46.558375] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T20:22:46.602177] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-23T20:22:47.402187] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-23T20:22:47.749622] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T20:22:48.068985] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T20:22:48.202175] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-23T20:22:48.213908] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T20:22:49.002235] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-23T20:22:49.802204] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-23T20:22:50.190412] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T20:22:50.564582] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T20:22:50.602193] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-23T20:22:51.402168] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-23T20:22:51.660277] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T20:22:52.186461] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T20:22:52.203384] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-23T20:22:52.205908] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T20:22:53.002236] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-23T20:22:53.802235] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-23T20:22:54.602225] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-23T20:23:06.526108] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (13.52 seconds). [2025-09-23T20:23:06.528766] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-23T20:23:06.629550] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (12.03 seconds). [2025-09-23T20:23:06.639688] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-23T20:23:06.804306] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (14.60 seconds). [2025-09-23T20:23:06.813892] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-23T20:23:07.258468] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T20:23:07.261996] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-23T20:23:07.410264] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (13.61 seconds). [2025-09-23T20:23:07.421790] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-23T20:23:07.696871] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T20:23:07.706666] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-23T20:23:07.888502] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T20:23:07.892825] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-23T20:23:08.435126] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T20:23:08.444206] [INFO ] [REMOTE ] NPWR: Full fetch complete (58997 records). [2025-09-23T20:23:08.444594] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-23T20:23:08.497323] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T20:23:08.534965] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-23T20:23:08.827624] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T20:23:08.871393] [INFO ] [REMOTE ] NRDY: Full fetch complete (52534 records). [2025-09-23T20:23:08.915187] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-23T20:23:08.894268] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-23T20:23:08.916381] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-23T20:23:08.917507] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-23T20:23:08.917884] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-23T20:23:09.028327] [DEBUG] [LOCAL ] NPWR: Trimmed 58997 records to 43187 (keeping 200 days of data) [2025-09-23T20:23:09.302618] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T20:23:09.328918] [INFO ] [REMOTE ] NREF: Full fetch complete (10863 records). [2025-09-23T20:23:09.354387] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-23T20:23:09.592904] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-23T20:23:09.658167] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-23T20:23:09.699186] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-23T20:23:09.725470] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-23T20:23:09.834931] [DEBUG] [LOCAL ] NRDY: Trimmed 52534 records to 33119 (keeping 200 days of data) [2025-09-23T20:23:09.950157] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T20:23:10.042925] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-23T20:23:10.045180] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-23T20:23:10.046540] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-23T20:23:10.048046] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-23T20:23:10.050171] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-23T20:23:10.053933] [DEBUG] [LOCAL ] NREF: Trimmed 10863 records to 7864 (keeping 200 days of data) [2025-09-23T20:23:10.217580] [DEBUG] [LOCAL ] NREF: Primary data saved (7864 records). [2025-09-23T20:23:10.218941] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-23T20:23:10.219377] [INFO ] [MAIN ] Update Progress: 1527/2372 symbols completed. NREF took 32.1s. Estimated remaining: 1h 52m 24s. Rate: 7.5 symbols/min [2025-09-23T20:23:10.420437] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:10.537430] [DEBUG] [LOCAL ] NRGV: Loaded 42806 existing records from primary storage. [2025-09-23T20:23:10.541765] [INFO ] [MAIN ] NRGV: Loaded 42806 existing records. [2025-09-23T20:23:10.700847] [DEBUG] [LOCAL ] NPWR: Primary data saved (43187 records). [2025-09-23T20:23:10.729782] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-23T20:23:10.748023] [INFO ] [MAIN ] Update Progress: 1528/2372 symbols completed. NPWR took 57.5s. Estimated remaining: 1h 52m 12s. Rate: 7.5 symbols/min [2025-09-23T20:23:10.803083] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:23:10.842798] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-23T20:23:10.843358] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-23T20:23:10.855233] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-23T20:23:10.869427] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-23T20:23:10.948763] [DEBUG] [LOCAL ] NRDY: Primary data saved (33119 records). [2025-09-23T20:23:11.061939] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-23T20:23:11.068590] [INFO ] [MAIN ] Update Progress: 1529/2372 symbols completed. NRDY took 35.9s. Estimated remaining: 1h 51m 60s. Rate: 7.5 symbols/min [2025-09-23T20:23:11.126090] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:11.532872] [DEBUG] [LOCAL ] NRK: Loaded 19581 existing records from primary storage. [2025-09-23T20:23:11.531800] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:11.538326] [INFO ] [MAIN ] NRK: Loaded 19581 existing records. [2025-09-23T20:23:11.644952] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:11.673189] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-23T20:23:11.711822] [DEBUG] [LOCAL ] NRP: Loaded 4088 existing records from primary storage. [2025-09-23T20:23:11.732321] [INFO ] [MAIN ] NRP: Loaded 4088 existing records. [2025-09-23T20:23:11.917794] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:23:11.950931] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-23T20:23:11.962176] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-23T20:23:11.996201] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-23T20:23:12.011980] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-23T20:23:12.058946] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:23:12.081165] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-23T20:23:12.116740] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-23T20:23:12.129504] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-23T20:23:12.146373] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-23T20:23:12.827231] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-23T20:23:12.865934] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:12.911090] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-23T20:23:12.893857] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-23T20:23:12.960226] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:12.961115] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-23T20:23:13.429455] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T20:23:13.439809] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-23T20:23:13.486946] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T20:23:13.489248] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-23T20:23:13.870128] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T20:23:13.875349] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-23T20:23:14.256268] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T20:23:14.258877] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-23T20:23:14.714273] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T20:23:14.715969] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-23T20:23:14.767008] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T20:23:14.780757] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-23T20:23:14.923955] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T20:23:14.933246] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-23T20:23:15.162313] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-23T20:23:15.164514] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-23T20:23:15.249563] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T20:23:15.253866] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-23T20:23:15.627849] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T20:23:15.629778] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-23T20:23:15.892948] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T20:23:15.896857] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-23T20:23:16.383068] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T20:23:16.383291] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T20:23:16.393846] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-23T20:23:16.394598] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-23T20:23:16.536494] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T20:23:16.549130] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-23T20:23:16.571848] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-23T20:23:16.829620] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T20:23:17.002231] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-23T20:23:17.678342] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T20:23:17.802180] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-23T20:23:18.131601] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T20:23:18.319602] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T20:23:18.602250] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-23T20:23:19.402159] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-23T20:23:19.531029] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T20:23:19.792309] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T20:23:19.914727] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T20:23:20.202203] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-23T20:23:20.834959] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T20:23:21.002214] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-23T20:23:21.643191] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T20:23:21.644689] [INFO ] [REMOTE ] NRP: Full fetch complete (6545 records). [2025-09-23T20:23:21.644758] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-23T20:23:21.807339] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-23T20:23:22.036733] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-23T20:23:22.036826] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-23T20:23:22.037027] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-23T20:23:22.037069] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-23T20:23:22.037516] [DEBUG] [LOCAL ] NRP: Trimmed 6545 records to 4099 (keeping 200 days of data) [2025-09-23T20:23:22.064918] [DEBUG] [LOCAL ] NRP: Primary data saved (4099 records). [2025-09-23T20:23:22.065063] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-23T20:23:22.065157] [INFO ] [MAIN ] Update Progress: 1530/2372 symbols completed. NRP took 11.0s. Estimated remaining: 1h 51m 53s. Rate: 7.5 symbols/min [2025-09-23T20:23:22.246251] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:22.252706] [DEBUG] [LOCAL ] NRT: Loaded 4853 existing records from primary storage. [2025-09-23T20:23:22.252806] [INFO ] [MAIN ] NRT: Loaded 4853 existing records. [2025-09-23T20:23:22.431880] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:23:22.432151] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-23T20:23:22.432200] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-23T20:23:22.432761] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-23T20:23:22.432821] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-23T20:23:22.611121] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-23T20:23:22.801217] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:23.402180] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-23T20:23:23.617176] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T20:23:23.663939] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T20:23:23.791587] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T20:23:23.800709] [INFO ] [REMOTE ] NRG: Full fetch complete (76165 records). [2025-09-23T20:23:23.800904] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-23T20:23:23.801755] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:23:23.801853] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:23:23.801896] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:23:23.801934] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-23T20:23:23.801993] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-23T20:23:23.802031] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-23T20:23:23.802098] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-09-23T20:23:23.802182] [INFO ] [MAIN ] Update Progress: 1531/2372 symbols completed. NRG took 43.6s. Estimated remaining: 1h 51m 42s. Rate: 7.5 symbols/min [2025-09-23T20:23:23.987400] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:23.993173] [DEBUG] [LOCAL ] NRUC: Loaded 3101 existing records from primary storage. [2025-09-23T20:23:23.993264] [INFO ] [MAIN ] NRUC: Loaded 3101 existing records. [2025-09-23T20:23:24.179853] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:23:24.180176] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-23T20:23:24.180231] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-23T20:23:24.180683] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-23T20:23:24.180745] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-23T20:23:24.207384] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-23T20:23:24.568101] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:25.002211] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-23T20:23:25.476540] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T20:23:25.535247] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T20:23:25.802205] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-23T20:23:26.602206] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-23T20:23:26.691702] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T20:23:27.402226] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-23T20:23:27.535376] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T20:23:28.100907] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T20:23:28.202192] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-23T20:23:29.002160] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-23T20:23:29.073096] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T20:23:29.802214] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-23T20:23:29.862776] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T20:23:29.867192] [INFO ] [REMOTE ] NRK: Full fetch complete (27730 records). [2025-09-23T20:23:29.867325] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-23T20:23:30.252317] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-23T20:23:30.252589] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-23T20:23:30.253217] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-23T20:23:30.253281] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-23T20:23:30.254246] [DEBUG] [LOCAL ] NRK: Trimmed 27730 records to 19632 (keeping 200 days of data) [2025-09-23T20:23:30.380638] [DEBUG] [LOCAL ] NRK: Primary data saved (19632 records). [2025-09-23T20:23:30.380880] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-23T20:23:30.381036] [INFO ] [MAIN ] Update Progress: 1532/2372 symbols completed. NRK took 19.6s. Estimated remaining: 1h 51m 33s. Rate: 7.5 symbols/min [2025-09-23T20:23:30.560444] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:30.603562] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-23T20:23:30.605388] [DEBUG] [LOCAL ] NSA: Loaded 44842 existing records from primary storage. [2025-09-23T20:23:30.605583] [INFO ] [MAIN ] NSA: Loaded 44842 existing records. [2025-09-23T20:23:30.788852] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:23:30.789090] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-23T20:23:30.789139] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-23T20:23:30.790998] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-23T20:23:30.791063] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-23T20:23:31.175851] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:31.298173] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T20:23:31.407983] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-23T20:23:31.414092] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T20:23:32.202277] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-23T20:23:33.002231] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-23T20:23:33.130293] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T20:23:33.658029] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T20:23:33.699630] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T20:23:33.802223] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-23T20:23:34.581049] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T20:23:34.602148] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-23T20:23:35.094063] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T20:23:35.402203] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-23T20:23:36.059073] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T20:23:36.202209] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-23T20:23:37.002229] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-23T20:23:37.646182] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T20:23:37.646903] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T20:23:37.802200] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-23T20:23:38.602220] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-23T20:23:39.231461] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T20:23:39.250061] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T20:23:39.402209] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-23T20:23:40.202249] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-23T20:23:40.614596] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T20:23:41.002240] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-23T20:23:41.111531] [DEBUG] [REMOTE ] NSA: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-23T20:23:41.111936] [WARN ] [REMOTE ] NSA: No data returned for month 2025-03 [2025-09-23T20:23:41.278826] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T20:23:41.802280] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-23T20:23:42.602254] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-23T20:23:43.312244] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T20:23:43.313579] [INFO ] [REMOTE ] NRT: Full fetch complete (8079 records). [2025-09-23T20:23:43.313672] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-23T20:23:43.406696] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-23T20:23:43.708413] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T20:23:43.724139] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-23T20:23:43.724294] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-23T20:23:43.724782] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-23T20:23:43.724862] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-23T20:23:43.725830] [DEBUG] [LOCAL ] NRT: Trimmed 8079 records to 4858 (keeping 200 days of data) [2025-09-23T20:23:43.753146] [DEBUG] [LOCAL ] NRT: Primary data saved (4858 records). [2025-09-23T20:23:43.753267] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-23T20:23:43.753362] [INFO ] [MAIN ] Update Progress: 1533/2372 symbols completed. NRT took 21.7s. Estimated remaining: 1h 51m 28s. Rate: 7.5 symbols/min [2025-09-23T20:23:43.925369] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:43.925740] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-23T20:23:43.925796] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-23T20:23:43.925904] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-23T20:23:43.925944] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-23T20:23:43.925989] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-23T20:23:43.926021] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-23T20:23:44.206243] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-23T20:23:44.206177] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T20:23:44.301995] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:45.002250] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-23T20:23:45.802213] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-23T20:23:45.934246] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T20:23:45.942480] [INFO ] [REMOTE ] NRGV: Full fetch complete (61748 records). [2025-09-23T20:23:45.942593] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-23T20:23:46.371415] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-23T20:23:46.371507] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-23T20:23:46.372408] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-23T20:23:46.372472] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-23T20:23:46.373785] [DEBUG] [LOCAL ] NRGV: Trimmed 61748 records to 42910 (keeping 200 days of data) [2025-09-23T20:23:46.602542] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-23T20:23:46.634088] [DEBUG] [LOCAL ] NRGV: Primary data saved (42910 records). [2025-09-23T20:23:46.634253] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-23T20:23:46.634354] [INFO ] [MAIN ] Update Progress: 1534/2372 symbols completed. NRGV took 36.4s. Estimated remaining: 1h 51m 17s. Rate: 7.5 symbols/min [2025-09-23T20:23:46.815951] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:46.856884] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-23T20:23:46.895430] [DEBUG] [LOCAL ] NSP: Loaded 34883 existing records from primary storage. [2025-09-23T20:23:46.895577] [INFO ] [MAIN ] NSP: Loaded 34883 existing records. [2025-09-23T20:23:47.075574] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:23:47.075880] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-23T20:23:47.075993] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-23T20:23:47.077578] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-23T20:23:47.077664] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-23T20:23:47.294981] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T20:23:47.406459] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-23T20:23:47.452358] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:47.526028] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T20:23:48.202218] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-23T20:23:49.002180] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-23T20:23:49.108781] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T20:23:49.427472] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T20:23:49.560409] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T20:23:49.802200] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-23T20:23:50.315382] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T20:23:50.602203] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-23T20:23:51.402268] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-23T20:23:52.202219] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-23T20:23:52.267555] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T20:23:52.269457] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T20:23:53.002206] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-23T20:23:53.589307] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T20:23:53.802210] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-23T20:23:53.947801] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T20:23:54.602250] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-23T20:23:55.109376] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T20:23:55.110470] [INFO ] [REMOTE ] NRUC: Full fetch complete (5550 records). [2025-09-23T20:23:55.110539] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-23T20:23:55.433223] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-23T20:23:55.517525] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-23T20:23:55.517623] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-23T20:23:55.517852] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-23T20:23:55.517934] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-23T20:23:55.535978] [DEBUG] [LOCAL ] NRUC: Trimmed 5550 records to 3074 (keeping 200 days of data) [2025-09-23T20:23:55.563429] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T20:23:55.584056] [DEBUG] [LOCAL ] NRUC: Primary data saved (3074 records). [2025-09-23T20:23:55.584160] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-23T20:23:55.584240] [INFO ] [MAIN ] Update Progress: 1535/2372 symbols completed. NRUC took 31.8s. Estimated remaining: 1h 51m 10s. Rate: 7.5 symbols/min [2025-09-23T20:23:55.753240] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:23:55.776075] [DEBUG] [LOCAL ] NTB: Loaded 20720 existing records from primary storage. [2025-09-23T20:23:55.776213] [INFO ] [MAIN ] NTB: Loaded 20720 existing records. [2025-09-23T20:23:55.952190] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:23:55.952450] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-23T20:23:55.952498] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-23T20:23:55.953545] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-23T20:23:55.953606] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-23T20:23:56.207426] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-23T20:23:56.314355] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:23:57.002167] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-23T20:23:57.471893] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-23T20:23:57.754604] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T20:23:57.794470] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T20:23:57.802136] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-23T20:23:58.602183] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-23T20:23:58.953978] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T20:23:59.402394] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-23T20:24:00.202203] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-23T20:24:00.317071] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T20:24:00.741185] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T20:24:00.750187] [INFO ] [REMOTE ] NSA: Full fetch complete (55244 records). [2025-09-23T20:24:00.750325] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-23T20:24:00.981041] [WARN ] [VALIDATOR ] NSA: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T20:24:00.981753] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:24:00.981835] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:24:00.981933] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-23T20:24:00.982048] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-09-23T20:24:00.982123] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-09-23T20:24:00.982633] [DEBUG] [LOCAL ] NSA: Deleted derivative data file. [2025-09-23T20:24:00.982872] [INFO ] [MAIN ] Update Progress: 1536/2372 symbols completed. NSA took 30.6s. Estimated remaining: 1h 51m 1s. Rate: 7.5 symbols/min [2025-09-23T20:24:01.007252] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-23T20:24:01.174789] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:24:01.174993] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-23T20:24:01.175049] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-23T20:24:01.175196] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-23T20:24:01.175282] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-23T20:24:01.175335] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-23T20:24:01.175370] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-23T20:24:01.563491] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T20:24:01.625420] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:24:01.802246] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-23T20:24:02.602230] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-23T20:24:03.402200] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-23T20:24:03.587844] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-23T20:24:04.004168] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T20:24:04.202207] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-23T20:24:04.628795] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-23T20:24:04.782867] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-23T20:24:04.903908] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T20:24:05.002226] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-23T20:24:05.567235] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T20:24:05.802211] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-23T20:24:06.602199] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-23T20:24:07.407354] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-23T20:24:07.435465] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T20:24:07.638941] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T20:24:08.202263] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-23T20:24:08.357548] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T20:24:09.002254] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-23T20:24:09.491098] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-23T20:24:09.647491] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T20:24:09.802175] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-23T20:24:10.602206] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-23T20:24:11.388378] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T20:24:11.402144] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-23T20:24:12.202163] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-23T20:24:12.506927] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T20:24:12.616095] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T20:24:12.753788] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T20:24:13.002205] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-23T20:24:13.802204] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-23T20:24:14.602196] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-23T20:24:14.878910] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T20:24:14.900578] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T20:24:15.402240] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-23T20:24:15.752963] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T20:24:16.165420] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T20:24:16.173822] [INFO ] [REMOTE ] NSC: Full fetch complete (70590 records). [2025-09-23T20:24:16.173974] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-23T20:24:16.174977] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:24:16.175096] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:24:16.175169] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:24:16.175279] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-23T20:24:16.175403] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-23T20:24:16.175461] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-23T20:24:16.175523] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-09-23T20:24:16.175697] [INFO ] [MAIN ] Update Progress: 1537/2372 symbols completed. NSC took 32.4s. Estimated remaining: 1h 50m 57s. Rate: 7.5 symbols/min [2025-09-23T20:24:16.209070] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-23T20:24:16.362958] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:24:16.426711] [DEBUG] [LOCAL ] NTR: Loaded 52586 existing records from primary storage. [2025-09-23T20:24:16.426904] [INFO ] [MAIN ] NTR: Loaded 52586 existing records. [2025-09-23T20:24:16.630003] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:24:16.630267] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-23T20:24:16.630365] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-23T20:24:16.632020] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-23T20:24:16.632084] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-23T20:24:17.008110] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-23T20:24:17.034133] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:24:17.802232] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-23T20:24:18.304240] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T20:24:18.602173] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-23T20:24:18.654560] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-23T20:24:19.359082] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T20:24:19.402246] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-23T20:24:20.072374] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-23T20:24:20.202215] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-23T20:24:20.469317] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T20:24:21.002239] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-23T20:24:21.561630] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-23T20:24:21.802221] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-23T20:24:21.999437] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T20:24:22.314299] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T20:24:22.315288] [INFO ] [REMOTE ] NTEST: Full fetch complete (1988 records). [2025-09-23T20:24:22.315425] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-23T20:24:22.515526] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-23T20:24:22.515754] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:24:22.515855] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:24:22.515978] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-23T20:24:22.516073] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-23T20:24:22.516153] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-23T20:24:22.516221] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-23T20:24:22.516293] [INFO ] [MAIN ] Update Progress: 1538/2372 symbols completed. NTEST took 21.5s. Estimated remaining: 1h 50m 48s. Rate: 7.5 symbols/min [2025-09-23T20:24:22.607372] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-23T20:24:22.696480] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:24:22.757773] [DEBUG] [LOCAL ] NTST: Loaded 43435 existing records from primary storage. [2025-09-23T20:24:22.757966] [INFO ] [MAIN ] NTST: Loaded 43435 existing records. [2025-09-23T20:24:22.969841] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:24:22.970226] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-23T20:24:22.970306] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-23T20:24:22.971551] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-23T20:24:22.971625] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-23T20:24:23.358331] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:24:23.402184] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-23T20:24:24.202169] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-23T20:24:24.410863] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T20:24:24.906945] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T20:24:25.007505] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-23T20:24:25.021794] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T20:24:25.802217] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-23T20:24:26.602192] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-23T20:24:26.970430] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-23T20:24:27.235551] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T20:24:27.369172] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T20:24:27.402255] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-23T20:24:28.202227] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-23T20:24:29.002251] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-23T20:24:29.385761] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T20:24:29.800225] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T20:24:29.803536] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-23T20:24:30.098146] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T20:24:30.102321] [INFO ] [REMOTE ] NTB: Full fetch complete (30916 records). [2025-09-23T20:24:30.102487] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-23T20:24:30.537713] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-23T20:24:30.537803] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-23T20:24:30.538540] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-23T20:24:30.538665] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-23T20:24:30.539462] [DEBUG] [LOCAL ] NTB: Trimmed 30916 records to 20685 (keeping 200 days of data) [2025-09-23T20:24:30.615740] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-23T20:24:30.700617] [DEBUG] [LOCAL ] NTB: Primary data saved (20685 records). [2025-09-23T20:24:30.700976] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-23T20:24:30.701139] [INFO ] [MAIN ] Update Progress: 1539/2372 symbols completed. NTB took 35.1s. Estimated remaining: 1h 50m 40s. Rate: 7.5 symbols/min [2025-09-23T20:24:30.876872] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:24:30.963678] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-23T20:24:30.964308] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-09-23T20:24:31.186187] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:24:31.186621] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-23T20:24:31.186716] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-23T20:24:31.188698] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-23T20:24:31.188762] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-23T20:24:31.407379] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-23T20:24:31.589453] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:24:31.891371] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-23T20:24:32.138042] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T20:24:32.202402] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-23T20:24:32.580084] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T20:24:32.589873] [INFO ] [REMOTE ] NSP: Full fetch complete (49425 records). [2025-09-23T20:24:32.590064] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-23T20:24:33.009629] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-23T20:24:33.030082] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-23T20:24:33.030188] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-23T20:24:33.031152] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-23T20:24:33.031221] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-23T20:24:33.032743] [DEBUG] [LOCAL ] NSP: Trimmed 49425 records to 34921 (keeping 200 days of data) [2025-09-23T20:24:33.216783] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T20:24:33.331919] [DEBUG] [LOCAL ] NSP: Primary data saved (34921 records). [2025-09-23T20:24:33.332096] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-23T20:24:33.332242] [INFO ] [MAIN ] Update Progress: 1540/2372 symbols completed. NSP took 46.7s. Estimated remaining: 1h 50m 29s. Rate: 7.5 symbols/min [2025-09-23T20:24:33.529271] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:24:33.529467] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-23T20:24:33.529505] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-23T20:24:33.529696] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-23T20:24:33.529747] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-23T20:24:33.529789] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-23T20:24:33.529821] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-23T20:24:33.804002] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-23T20:24:33.882171] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:24:34.512486] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T20:24:34.602203] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-23T20:24:35.402209] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-23T20:24:36.202317] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-23T20:24:36.349789] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-23T20:24:36.709409] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-23T20:24:36.791264] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T20:24:37.002259] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-23T20:24:37.453784] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T20:24:37.802215] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-23T20:24:38.602204] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-23T20:24:38.927053] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T20:24:39.402241] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-23T20:24:39.898809] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-23T20:24:40.202203] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-23T20:24:40.421291] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-23T20:24:41.002253] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-23T20:24:41.254473] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-23T20:24:41.639610] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T20:24:41.802252] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-23T20:24:42.602251] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-23T20:24:42.941498] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T20:24:43.402238] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-23T20:24:43.770700] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T20:24:44.134041] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T20:24:44.202203] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-23T20:24:45.002201] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-23T20:24:45.125042] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T20:24:45.138193] [INFO ] [REMOTE ] NTR: Full fetch complete (76284 records). [2025-09-23T20:24:45.138395] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-23T20:24:45.584931] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-23T20:24:45.585144] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-23T20:24:45.587363] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-23T20:24:45.587468] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-23T20:24:45.623360] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T20:24:45.632080] [DEBUG] [LOCAL ] NTR: Trimmed 76284 records to 52579 (keeping 200 days of data) [2025-09-23T20:24:45.837243] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-23T20:24:46.023663] [DEBUG] [LOCAL ] NTR: Primary data saved (52579 records). [2025-09-23T20:24:46.023894] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-23T20:24:46.024044] [INFO ] [MAIN ] Update Progress: 1541/2372 symbols completed. NTR took 29.8s. Estimated remaining: 1h 50m 24s. Rate: 7.5 symbols/min [2025-09-23T20:24:46.201881] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:24:46.245072] [DEBUG] [LOCAL ] NUS: Loaded 36414 existing records from primary storage. [2025-09-23T20:24:46.245331] [INFO ] [MAIN ] NUS: Loaded 36414 existing records. [2025-09-23T20:24:46.442872] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:24:46.443553] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-23T20:24:46.443706] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-23T20:24:46.445249] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-23T20:24:46.445318] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-23T20:24:46.607521] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-23T20:24:46.845547] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:24:47.343245] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-23T20:24:47.402265] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-23T20:24:47.669257] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T20:24:48.202200] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-23T20:24:48.904029] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-23T20:24:49.002263] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-23T20:24:49.467350] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T20:24:49.802222] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-23T20:24:49.850520] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-23T20:24:50.602231] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-23T20:24:50.985427] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-23T20:24:51.402241] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-23T20:24:51.531594] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T20:24:51.541473] [INFO ] [REMOTE ] NTST: Full fetch complete (60727 records). [2025-09-23T20:24:51.541695] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-23T20:24:51.996051] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T20:24:51.996224] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-23T20:24:51.996455] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-23T20:24:52.005939] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-23T20:24:52.006855] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-23T20:24:52.008421] [DEBUG] [LOCAL ] NTST: Trimmed 60727 records to 43542 (keeping 200 days of data) [2025-09-23T20:24:52.203196] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-23T20:24:52.293906] [DEBUG] [LOCAL ] NTST: Primary data saved (43542 records). [2025-09-23T20:24:52.294051] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-23T20:24:52.294147] [INFO ] [MAIN ] Update Progress: 1542/2372 symbols completed. NTST took 29.8s. Estimated remaining: 1h 50m 15s. Rate: 7.5 symbols/min [2025-09-23T20:24:52.474002] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:24:52.496828] [DEBUG] [LOCAL ] NUV: Loaded 23066 existing records from primary storage. [2025-09-23T20:24:52.496978] [INFO ] [MAIN ] NUV: Loaded 23066 existing records. [2025-09-23T20:24:52.679566] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:24:52.679843] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-23T20:24:52.679894] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-23T20:24:52.680913] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-23T20:24:52.680975] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-23T20:24:53.010275] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-23T20:24:53.051876] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:24:53.168186] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T20:24:53.775341] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T20:24:53.802193] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-23T20:24:54.602252] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-23T20:24:55.379148] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T20:24:55.407291] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-23T20:24:55.424582] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-23T20:24:56.202155] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-23T20:24:56.321800] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T20:24:56.488008] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T20:24:57.002213] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-23T20:24:57.802239] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-23T20:24:58.455811] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-23T20:24:58.607875] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-23T20:24:58.614389] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T20:24:59.030154] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T20:24:59.402255] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-23T20:25:00.163196] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T20:25:00.171742] [INFO ] [REMOTE ] NUE: Full fetch complete (74566 records). [2025-09-23T20:25:00.171945] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-23T20:25:00.172987] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:25:00.173092] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:25:00.173137] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:25:00.173189] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-23T20:25:00.173261] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-23T20:25:00.173301] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-23T20:25:00.173341] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-23T20:25:00.173588] [INFO ] [MAIN ] Update Progress: 1543/2372 symbols completed. NUE took 26.8s. Estimated remaining: 1h 50m 7s. Rate: 7.5 symbols/min [2025-09-23T20:25:00.207631] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-23T20:25:00.357051] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:25:00.414214] [DEBUG] [LOCAL ] NUVB: Loaded 51209 existing records from primary storage. [2025-09-23T20:25:00.414380] [INFO ] [MAIN ] NUVB: Loaded 51209 existing records. [2025-09-23T20:25:00.596291] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:25:00.596773] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-23T20:25:00.596830] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-23T20:25:00.598159] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-23T20:25:00.598220] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-23T20:25:01.005194] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-23T20:25:01.010967] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:25:01.283517] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-23T20:25:01.802203] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-23T20:25:02.051220] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T20:25:02.413877] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T20:25:02.602213] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-23T20:25:03.402268] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-23T20:25:03.479403] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T20:25:04.202265] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-23T20:25:04.834550] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T20:25:04.948868] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-23T20:25:04.973855] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T20:25:05.002140] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-23T20:25:05.802249] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-23T20:25:06.099503] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T20:25:06.602203] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-23T20:25:07.245373] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T20:25:07.402195] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-23T20:25:08.030274] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T20:25:08.197207] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T20:25:08.202518] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-23T20:25:09.002208] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-23T20:25:09.735986] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T20:25:09.802206] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-23T20:25:10.332574] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T20:25:10.602210] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-23T20:25:11.402222] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-23T20:25:11.880300] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T20:25:12.056497] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-23T20:25:12.072088] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-23T20:25:12.072289] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-23T20:25:12.215002] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-23T20:25:12.480891] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-23T20:25:12.480973] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-23T20:25:12.481983] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-23T20:25:12.482048] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-23T20:25:12.483543] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 53746 (keeping 200 days of data) [2025-09-23T20:25:12.831173] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-09-23T20:25:12.831375] [INFO ] [MAIN ] NU: Full history saved. [2025-09-23T20:25:12.831496] [INFO ] [MAIN ] Update Progress: 1544/2372 symbols completed. NU took 42.1s. Estimated remaining: 1h 50m 1s. Rate: 7.5 symbols/min [2025-09-23T20:25:13.011490] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:25:13.007423] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-23T20:25:13.039883] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T20:25:13.052857] [DEBUG] [LOCAL ] NUW: Loaded 7413 existing records from primary storage. [2025-09-23T20:25:13.052969] [INFO ] [MAIN ] NUW: Loaded 7413 existing records. [2025-09-23T20:25:13.233313] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:25:13.233940] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-23T20:25:13.234001] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-23T20:25:13.234535] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-23T20:25:13.234734] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-23T20:25:13.536827] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T20:25:13.619967] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:25:13.802203] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-23T20:25:14.179876] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T20:25:14.185978] [INFO ] [REMOTE ] NUS: Full fetch complete (53913 records). [2025-09-23T20:25:14.186083] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-23T20:25:14.584904] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-23T20:25:14.584985] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-23T20:25:14.585846] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-23T20:25:14.585908] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-23T20:25:14.586998] [DEBUG] [LOCAL ] NUS: Trimmed 53913 records to 36464 (keeping 200 days of data) [2025-09-23T20:25:14.634600] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-23T20:25:14.805257] [DEBUG] [LOCAL ] NUS: Primary data saved (36464 records). [2025-09-23T20:25:14.805428] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-23T20:25:14.805519] [INFO ] [MAIN ] Update Progress: 1545/2372 symbols completed. NUS took 28.8s. Estimated remaining: 1h 49m 50s. Rate: 7.5 symbols/min [2025-09-23T20:25:14.980069] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:25:15.009354] [DEBUG] [LOCAL ] NVG: Loaded 27227 existing records from primary storage. [2025-09-23T20:25:15.009486] [INFO ] [MAIN ] NVG: Loaded 27227 existing records. [2025-09-23T20:25:15.194170] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:25:15.194563] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-23T20:25:15.194749] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-23T20:25:15.195609] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-23T20:25:15.195702] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-23T20:25:15.411254] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-23T20:25:15.518560] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T20:25:15.609736] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:25:15.847614] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T20:25:16.163169] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T20:25:16.202157] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-23T20:25:16.895572] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T20:25:17.002214] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-23T20:25:17.802208] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-23T20:25:18.602275] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-23T20:25:18.816924] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T20:25:18.841298] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T20:25:19.402205] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-23T20:25:19.892876] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T20:25:20.202214] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-23T20:25:20.272528] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T20:25:21.002229] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-23T20:25:21.802170] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-23T20:25:21.916566] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T20:25:22.408278] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T20:25:22.594479] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T20:25:22.598767] [INFO ] [REMOTE ] NUV: Full fetch complete (34458 records). [2025-09-23T20:25:22.598870] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-23T20:25:22.610210] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-23T20:25:22.995488] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-23T20:25:22.995574] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-23T20:25:22.996343] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-23T20:25:22.996407] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-23T20:25:22.997292] [DEBUG] [LOCAL ] NUV: Trimmed 34458 records to 23239 (keeping 200 days of data) [2025-09-23T20:25:23.135337] [DEBUG] [LOCAL ] NUV: Primary data saved (23239 records). [2025-09-23T20:25:23.135473] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-23T20:25:23.135577] [INFO ] [MAIN ] Update Progress: 1546/2372 symbols completed. NUV took 30.8s. Estimated remaining: 1h 49m 42s. Rate: 7.5 symbols/min [2025-09-23T20:25:23.314372] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:25:23.346909] [DEBUG] [LOCAL ] NVGS: Loaded 31141 existing records from primary storage. [2025-09-23T20:25:23.347073] [INFO ] [MAIN ] NVGS: Loaded 31141 existing records. [2025-09-23T20:25:23.414677] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-23T20:25:23.538800] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:25:23.539078] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-23T20:25:23.539130] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-23T20:25:23.540053] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-23T20:25:23.540129] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-23T20:25:23.924168] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:25:23.992872] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T20:25:24.202207] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-23T20:25:25.002262] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-23T20:25:25.069987] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T20:25:25.323942] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-23T20:25:25.802203] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-23T20:25:25.839900] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T20:25:26.418686] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T20:25:26.602225] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-23T20:25:27.376218] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T20:25:27.402219] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-23T20:25:28.202200] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-23T20:25:28.746835] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T20:25:29.002177] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-23T20:25:29.351372] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T20:25:29.460138] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T20:25:29.802209] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-23T20:25:30.602254] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-23T20:25:31.224813] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T20:25:31.272103] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T20:25:31.402236] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-23T20:25:32.138967] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T20:25:32.202174] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-23T20:25:33.002207] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-23T20:25:33.103135] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T20:25:33.104863] [INFO ] [REMOTE ] NUW: Full fetch complete (11796 records). [2025-09-23T20:25:33.104947] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-23T20:25:33.489186] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-23T20:25:33.489276] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-23T20:25:33.489597] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-23T20:25:33.489638] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-23T20:25:33.490293] [DEBUG] [LOCAL ] NUW: Trimmed 11796 records to 7438 (keeping 200 days of data) [2025-09-23T20:25:33.537978] [DEBUG] [LOCAL ] NUW: Primary data saved (7438 records). [2025-09-23T20:25:33.538130] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-23T20:25:33.538238] [INFO ] [MAIN ] Update Progress: 1547/2372 symbols completed. NUW took 20.7s. Estimated remaining: 1h 49m 36s. Rate: 7.5 symbols/min [2025-09-23T20:25:33.719489] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:25:33.774389] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-23T20:25:33.774576] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-09-23T20:25:33.818808] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-23T20:25:33.965027] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:25:33.965317] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-23T20:25:33.965376] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-23T20:25:33.967446] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-23T20:25:33.967515] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-23T20:25:34.358115] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:25:34.361223] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T20:25:34.602230] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-23T20:25:35.402264] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-23T20:25:35.743721] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T20:25:36.088893] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T20:25:36.202272] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-23T20:25:36.328297] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T20:25:37.002245] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-23T20:25:37.802220] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-23T20:25:38.462792] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T20:25:38.602263] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-23T20:25:38.700161] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-23T20:25:38.731802] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T20:25:39.402242] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-23T20:25:40.202192] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-23T20:25:40.568196] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T20:25:41.002230] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-23T20:25:41.556162] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T20:25:41.802286] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-23T20:25:41.908272] [DEBUG] [REMOTE ] NVG: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-23T20:25:41.908603] [WARN ] [REMOTE ] NVG: No data returned for month 2025-09 [2025-09-23T20:25:41.908754] [INFO ] [REMOTE ] NVG: Full fetch complete (37096 records). [2025-09-23T20:25:41.908846] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-23T20:25:41.909697] [FATAL] [VALIDATOR ] NVG: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:25:41.909796] [FATAL] [MAIN ] NVG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:25:41.909883] [WARN ] [MAIN ] NVG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:25:41.909973] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-23T20:25:41.910077] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-09-23T20:25:41.910135] [INFO ] [LOCAL ] NVG: Starting deletion of derivative data. [2025-09-23T20:25:41.910578] [DEBUG] [LOCAL ] NVG: Deleted derivative data file. [2025-09-23T20:25:41.910706] [INFO ] [MAIN ] Update Progress: 1548/2372 symbols completed. NVG took 27.1s. Estimated remaining: 1h 49m 28s. Rate: 7.5 symbols/min [2025-09-23T20:25:42.116161] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:25:42.150913] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-09-23T20:25:42.179088] [DEBUG] [LOCAL ] NVR: Loaded 19257 existing records from primary storage. [2025-09-23T20:25:42.179248] [INFO ] [MAIN ] NVR: Loaded 19257 existing records. [2025-09-23T20:25:42.369744] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:25:42.370188] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-23T20:25:42.370266] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-23T20:25:42.387841] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-23T20:25:42.388224] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-23T20:25:42.423072] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T20:25:42.611860] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-23T20:25:42.771964] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:25:43.402253] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-23T20:25:44.126292] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T20:25:44.209987] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-23T20:25:44.215936] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T20:25:45.002231] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-23T20:25:45.648846] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T20:25:45.802198] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-23T20:25:46.602237] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-23T20:25:47.334768] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-23T20:25:47.411416] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-23T20:25:47.417019] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T20:25:47.427301] [INFO ] [REMOTE ] NUVB: Full fetch complete (72502 records). [2025-09-23T20:25:47.427463] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-23T20:25:47.838499] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-23T20:25:47.838592] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-23T20:25:47.839629] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-23T20:25:47.839723] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-23T20:25:47.841521] [DEBUG] [LOCAL ] NUVB: Trimmed 72502 records to 51209 (keeping 200 days of data) [2025-09-23T20:25:48.116547] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T20:25:48.203748] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-23T20:25:48.217262] [DEBUG] [LOCAL ] NUVB: Primary data saved (51209 records). [2025-09-23T20:25:48.217364] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-23T20:25:48.217473] [INFO ] [MAIN ] Update Progress: 1549/2372 symbols completed. NUVB took 48.0s. Estimated remaining: 1h 49m 19s. Rate: 7.5 symbols/min [2025-09-23T20:25:48.396601] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:25:48.445868] [DEBUG] [LOCAL ] NVRI: Loaded 38810 existing records from primary storage. [2025-09-23T20:25:48.446048] [INFO ] [MAIN ] NVRI: Loaded 38810 existing records. [2025-09-23T20:25:48.640926] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:25:48.660905] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-23T20:25:48.661672] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-23T20:25:48.662339] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T20:25:48.670630] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-23T20:25:48.670743] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-23T20:25:49.003570] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-23T20:25:49.042204] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:25:49.802164] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-23T20:25:50.107782] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T20:25:50.602168] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-23T20:25:50.847002] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-23T20:25:51.007957] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T20:25:51.402197] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-23T20:25:51.470934] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T20:25:52.202204] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-23T20:25:52.857001] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T20:25:53.002176] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-23T20:25:53.470205] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T20:25:53.802219] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-23T20:25:54.145166] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T20:25:54.590499] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T20:25:54.602133] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-23T20:25:55.402177] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-23T20:25:55.778956] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T20:25:56.202255] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-23T20:25:57.002257] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-23T20:25:57.813295] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-23T20:25:57.817373] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T20:25:57.937791] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-23T20:25:57.967153] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T20:25:58.602208] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-23T20:25:58.802448] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T20:25:59.402200] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-23T20:26:00.202211] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-23T20:26:00.688011] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T20:26:00.692336] [INFO ] [REMOTE ] NVGS: Full fetch complete (41515 records). [2025-09-23T20:26:00.692421] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-23T20:26:01.004482] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-23T20:26:01.070298] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-23T20:26:01.070586] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-23T20:26:01.071404] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-23T20:26:01.071465] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-23T20:26:01.072466] [DEBUG] [LOCAL ] NVGS: Trimmed 41515 records to 31106 (keeping 200 days of data) [2025-09-23T20:26:01.266003] [DEBUG] [LOCAL ] NVGS: Primary data saved (31106 records). [2025-09-23T20:26:01.266146] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-23T20:26:01.266235] [INFO ] [MAIN ] Update Progress: 1550/2372 symbols completed. NVGS took 38.1s. Estimated remaining: 1h 49m 14s. Rate: 7.5 symbols/min [2025-09-23T20:26:01.441349] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:26:01.481998] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-09-23T20:26:01.537462] [DEBUG] [LOCAL ] NVS: Loaded 51691 existing records from primary storage. [2025-09-23T20:26:01.537624] [INFO ] [MAIN ] NVS: Loaded 51691 existing records. [2025-09-23T20:26:01.720513] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:26:01.721162] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-23T20:26:01.721283] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-23T20:26:01.729449] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-23T20:26:01.729561] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-23T20:26:01.787955] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T20:26:01.802781] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-23T20:26:02.061031] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T20:26:02.147807] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:26:02.602254] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-23T20:26:03.402247] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-23T20:26:04.202217] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-23T20:26:04.487307] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T20:26:04.535075] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-09-23T20:26:04.557048] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T20:26:04.562145] [INFO ] [REMOTE ] NVR: Full fetch complete (29879 records). [2025-09-23T20:26:04.562241] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-23T20:26:04.939103] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-23T20:26:04.939192] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-23T20:26:04.939836] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-23T20:26:04.939898] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-23T20:26:04.941749] [DEBUG] [LOCAL ] NVR: Trimmed 29879 records to 19206 (keeping 200 days of data) [2025-09-23T20:26:05.025681] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-23T20:26:05.063600] [DEBUG] [LOCAL ] NVR: Primary data saved (19206 records). [2025-09-23T20:26:05.063780] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-23T20:26:05.063870] [INFO ] [MAIN ] Update Progress: 1551/2372 symbols completed. NVR took 23.2s. Estimated remaining: 1h 49m 4s. Rate: 7.5 symbols/min [2025-09-23T20:26:05.257302] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:26:05.310511] [DEBUG] [LOCAL ] NVST: Loaded 51671 existing records from primary storage. [2025-09-23T20:26:05.310702] [INFO ] [MAIN ] NVST: Loaded 51671 existing records. [2025-09-23T20:26:05.449254] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T20:26:05.527266] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:26:05.527512] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-23T20:26:05.527559] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-23T20:26:05.528694] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-23T20:26:05.528754] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-23T20:26:05.802983] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-23T20:26:05.881040] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:26:06.602212] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-23T20:26:06.702367] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T20:26:07.402251] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-23T20:26:08.202180] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-23T20:26:08.296154] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-23T20:26:08.386083] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T20:26:08.447980] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T20:26:09.002202] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-23T20:26:09.678884] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T20:26:09.802193] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-23T20:26:10.011428] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T20:26:10.602199] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-23T20:26:11.402258] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-23T20:26:11.892987] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-23T20:26:11.934554] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T20:26:12.202207] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-23T20:26:12.684333] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T20:26:13.002222] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-23T20:26:13.773210] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T20:26:13.780969] [INFO ] [REMOTE ] NVRI: Full fetch complete (55814 records). [2025-09-23T20:26:13.781167] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-23T20:26:13.804096] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-23T20:26:14.212664] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-23T20:26:14.212801] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-23T20:26:14.214189] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-23T20:26:14.214261] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-23T20:26:14.216175] [DEBUG] [LOCAL ] NVRI: Trimmed 55814 records to 38782 (keeping 200 days of data) [2025-09-23T20:26:14.469089] [DEBUG] [LOCAL ] NVRI: Primary data saved (38782 records). [2025-09-23T20:26:14.469361] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-23T20:26:14.469525] [INFO ] [MAIN ] Update Progress: 1552/2372 symbols completed. NVRI took 26.3s. Estimated remaining: 1h 48m 56s. Rate: 7.5 symbols/min [2025-09-23T20:26:14.607353] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-23T20:26:14.660080] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:26:14.718994] [DEBUG] [LOCAL ] NVT: Loaded 51608 existing records from primary storage. [2025-09-23T20:26:14.719166] [INFO ] [MAIN ] NVT: Loaded 51608 existing records. [2025-09-23T20:26:14.896285] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:26:14.896562] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-23T20:26:14.896637] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-23T20:26:14.897833] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-23T20:26:14.897895] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-23T20:26:15.252022] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:26:15.402262] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-23T20:26:15.834273] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-23T20:26:15.939084] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-23T20:26:15.988782] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T20:26:16.202217] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-23T20:26:17.002171] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-23T20:26:17.213312] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T20:26:17.573906] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T20:26:17.802196] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-23T20:26:18.602266] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-23T20:26:19.402224] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-23T20:26:19.604248] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T20:26:19.705256] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-09-23T20:26:19.714466] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-09-23T20:26:19.714704] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-23T20:26:20.145188] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-23T20:26:20.145334] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-23T20:26:20.146615] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-23T20:26:20.146754] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-23T20:26:20.148991] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 53784 (keeping 200 days of data) [2025-09-23T20:26:20.234183] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-23T20:26:20.284466] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T20:26:20.549227] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-09-23T20:26:20.549496] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-23T20:26:20.549759] [INFO ] [MAIN ] Update Progress: 1553/2372 symbols completed. NVO took 47.0s. Estimated remaining: 1h 48m 47s. Rate: 7.5 symbols/min [2025-09-23T20:26:20.734082] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:26:20.797523] [DEBUG] [LOCAL ] NWG: Loaded 51636 existing records from primary storage. [2025-09-23T20:26:20.797702] [INFO ] [MAIN ] NWG: Loaded 51636 existing records. [2025-09-23T20:26:20.977796] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:26:20.978240] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-23T20:26:20.978300] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-23T20:26:20.979451] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-23T20:26:20.979529] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-23T20:26:21.011794] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-23T20:26:21.379491] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:26:21.403727] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T20:26:21.674463] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T20:26:21.802225] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-23T20:26:22.547321] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T20:26:22.602192] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-23T20:26:23.402233] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-23T20:26:23.597104] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T20:26:24.202169] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-23T20:26:24.602169] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T20:26:25.002183] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-23T20:26:25.396027] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T20:26:25.802184] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-23T20:26:26.025286] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-23T20:26:26.421505] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T20:26:26.602207] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-23T20:26:27.360877] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T20:26:27.402151] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-23T20:26:28.073357] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T20:26:28.202211] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-23T20:26:29.053303] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-23T20:26:29.088726] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T20:26:29.770626] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T20:26:29.802170] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-23T20:26:30.602178] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-23T20:26:30.809854] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T20:26:31.402181] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-23T20:26:31.585623] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T20:26:31.594775] [INFO ] [REMOTE ] NVS: Full fetch complete (74817 records). [2025-09-23T20:26:31.594918] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-23T20:26:32.025727] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-23T20:26:32.025835] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-23T20:26:32.026883] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-23T20:26:32.026950] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-23T20:26:32.028473] [DEBUG] [LOCAL ] NVS: Trimmed 74817 records to 51667 (keeping 200 days of data) [2025-09-23T20:26:32.207684] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-23T20:26:32.369404] [DEBUG] [LOCAL ] NVS: Primary data saved (51667 records). [2025-09-23T20:26:32.369565] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-23T20:26:32.369844] [INFO ] [MAIN ] Update Progress: 1554/2372 symbols completed. NVS took 31.1s. Estimated remaining: 1h 48m 41s. Rate: 7.5 symbols/min [2025-09-23T20:26:32.519902] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-23T20:26:32.601511] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:26:32.631830] [DEBUG] [LOCAL ] NWN: Loaded 26838 existing records from primary storage. [2025-09-23T20:26:32.631996] [INFO ] [MAIN ] NWN: Loaded 26838 existing records. [2025-09-23T20:26:32.815886] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:26:32.816200] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-23T20:26:32.816268] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-23T20:26:32.817391] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-23T20:26:32.817479] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-23T20:26:33.004010] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-23T20:26:33.183391] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:26:33.206001] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T20:26:33.217974] [INFO ] [REMOTE ] NVST: Full fetch complete (74075 records). [2025-09-23T20:26:33.218129] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-23T20:26:33.630415] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-23T20:26:33.630625] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-23T20:26:33.631957] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-23T20:26:33.632097] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-23T20:26:33.634259] [DEBUG] [LOCAL ] NVST: Trimmed 74075 records to 51650 (keeping 200 days of data) [2025-09-23T20:26:33.755678] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T20:26:33.848369] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-23T20:26:33.989565] [DEBUG] [LOCAL ] NVST: Primary data saved (51650 records). [2025-09-23T20:26:33.989767] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-23T20:26:33.989895] [INFO ] [MAIN ] Update Progress: 1555/2372 symbols completed. NVST took 28.9s. Estimated remaining: 1h 48m 30s. Rate: 7.5 symbols/min [2025-09-23T20:26:34.158439] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:26:34.193176] [DEBUG] [LOCAL ] NX: Loaded 33418 existing records from primary storage. [2025-09-23T20:26:34.193335] [INFO ] [MAIN ] NX: Loaded 33418 existing records. [2025-09-23T20:26:34.378937] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:26:34.379239] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-23T20:26:34.379294] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-23T20:26:34.380197] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-23T20:26:34.380273] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-23T20:26:34.626254] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-23T20:26:34.747991] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:26:34.955686] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T20:26:35.402223] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-23T20:26:35.586721] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T20:26:35.859184] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T20:26:36.202229] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-23T20:26:36.609373] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T20:26:37.002205] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-23T20:26:37.802186] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-23T20:26:38.336248] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-23T20:26:38.364313] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T20:26:38.602230] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-23T20:26:38.681826] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T20:26:39.402253] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-23T20:26:40.182997] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T20:26:40.202176] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-23T20:26:40.880310] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T20:26:41.002238] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-23T20:26:41.798479] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T20:26:41.808671] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-23T20:26:41.846200] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T20:26:42.602269] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-23T20:26:43.356084] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T20:26:43.402148] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-23T20:26:44.204502] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T20:26:44.204752] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-23T20:26:44.883467] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T20:26:45.002197] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-23T20:26:45.645780] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T20:26:45.654598] [INFO ] [REMOTE ] NVT: Full fetch complete (74493 records). [2025-09-23T20:26:45.654824] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-23T20:26:45.807306] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-23T20:26:46.058684] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-23T20:26:46.058793] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-23T20:26:46.059847] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-23T20:26:46.059914] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-23T20:26:46.077278] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T20:26:46.076466] [DEBUG] [LOCAL ] NVT: Trimmed 74493 records to 51600 (keeping 200 days of data) [2025-09-23T20:26:46.406188] [DEBUG] [LOCAL ] NVT: Primary data saved (51600 records). [2025-09-23T20:26:46.406344] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-23T20:26:46.406444] [INFO ] [MAIN ] Update Progress: 1556/2372 symbols completed. NVT took 31.9s. Estimated remaining: 1h 48m 24s. Rate: 7.5 symbols/min [2025-09-23T20:26:46.575269] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:26:46.582754] [DEBUG] [LOCAL ] NXC: Loaded 4193 existing records from primary storage. [2025-09-23T20:26:46.582877] [INFO ] [MAIN ] NXC: Loaded 4193 existing records. [2025-09-23T20:26:46.614128] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-23T20:26:46.763458] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:26:46.763762] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-23T20:26:46.763816] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-23T20:26:46.764177] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-23T20:26:46.764237] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-23T20:26:47.118619] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:26:47.402177] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-23T20:26:47.782787] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T20:26:48.099213] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T20:26:48.202172] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-23T20:26:48.783341] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T20:26:49.002285] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-23T20:26:49.521399] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T20:26:49.802194] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-23T20:26:49.827508] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T20:26:50.602208] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-23T20:26:51.106006] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T20:26:51.177824] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T20:26:51.402249] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-23T20:26:52.030759] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T20:26:52.202234] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-23T20:26:53.002257] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-23T20:26:53.539580] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T20:26:53.690737] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T20:26:53.802214] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-23T20:26:54.602198] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-23T20:26:55.217274] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T20:26:55.402210] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-23T20:26:55.815469] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T20:26:56.202227] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-23T20:26:56.609278] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T20:26:56.909112] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T20:26:57.002242] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-23T20:26:57.412504] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T20:26:57.802245] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-23T20:26:58.602219] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-23T20:26:58.949781] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T20:26:58.954442] [INFO ] [REMOTE ] NWN: Full fetch complete (37013 records). [2025-09-23T20:26:58.954575] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-23T20:26:59.351634] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-23T20:26:59.351784] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-23T20:26:59.352785] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-23T20:26:59.352853] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-23T20:26:59.354115] [DEBUG] [LOCAL ] NWN: Trimmed 37013 records to 26869 (keeping 200 days of data) [2025-09-23T20:26:59.410496] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-23T20:26:59.535861] [DEBUG] [LOCAL ] NWN: Primary data saved (26869 records). [2025-09-23T20:26:59.536076] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-23T20:26:59.536249] [INFO ] [MAIN ] Update Progress: 1557/2372 symbols completed. NWN took 27.2s. Estimated remaining: 1h 48m 19s. Rate: 7.5 symbols/min [2025-09-23T20:27:00.202269] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-23T20:27:00.605447] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-23T20:27:00.911635] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T20:27:00.964639] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T20:27:01.002261] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-23T20:27:01.763074] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T20:27:01.802335] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-23T20:27:02.602226] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-23T20:27:03.402248] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-23T20:27:04.298453] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T20:27:04.300870] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-23T20:27:04.303021] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-23T20:27:04.311844] [INFO ] [REMOTE ] NX: Full fetch complete (48240 records). [2025-09-23T20:27:04.312012] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-23T20:27:04.702837] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-23T20:27:04.702926] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-23T20:27:04.703795] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-23T20:27:04.703858] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-23T20:27:04.704919] [DEBUG] [LOCAL ] NX: Trimmed 48240 records to 33437 (keeping 200 days of data) [2025-09-23T20:27:04.936846] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-23T20:27:04.965386] [DEBUG] [LOCAL ] NX: Primary data saved (33437 records). [2025-09-23T20:27:04.965580] [INFO ] [MAIN ] NX: Full history saved. [2025-09-23T20:27:04.965727] [INFO ] [MAIN ] Update Progress: 1558/2372 symbols completed. NX took 31.0s. Estimated remaining: 1h 48m 10s. Rate: 7.5 symbols/min [2025-09-23T20:27:05.002248] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-23T20:27:05.122185] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T20:27:05.123865] [INFO ] [REMOTE ] NXC: Full fetch complete (6045 records). [2025-09-23T20:27:05.123939] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-23T20:27:05.507023] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-23T20:27:05.507110] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-23T20:27:05.507304] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-23T20:27:05.507352] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-23T20:27:05.507829] [DEBUG] [LOCAL ] NXC: Trimmed 6045 records to 4210 (keeping 200 days of data) [2025-09-23T20:27:05.534029] [DEBUG] [LOCAL ] NXC: Primary data saved (4210 records). [2025-09-23T20:27:05.534162] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-23T20:27:05.534312] [INFO ] [MAIN ] Update Progress: 1559/2372 symbols completed. NXC took 19.1s. Estimated remaining: 1h 47m 58s. Rate: 7.5 symbols/min [2025-09-23T20:27:06.756144] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T20:27:06.764848] [INFO ] [REMOTE ] NWG: Full fetch complete (73092 records). [2025-09-23T20:27:06.765006] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-23T20:27:07.165341] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-23T20:27:07.165427] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-23T20:27:07.166580] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-23T20:27:07.166666] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-23T20:27:07.168179] [DEBUG] [LOCAL ] NWG: Trimmed 73092 records to 51614 (keeping 200 days of data) [2025-09-23T20:27:07.489513] [DEBUG] [LOCAL ] NWG: Primary data saved (51614 records). [2025-09-23T20:27:07.489679] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-23T20:27:07.489785] [INFO ] [MAIN ] Update Progress: 1560/2372 symbols completed. NWG took 46.9s. Estimated remaining: 1h 47m 47s. Rate: 7.5 symbols/min [2025-09-23T20:27:08.153001] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:08.151871] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:08.189398] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:08.219710] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-23T20:27:08.220346] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-23T20:27:08.242214] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:08.242707] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-23T20:27:08.242913] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-23T20:27:08.243449] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-23T20:27:08.243543] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-23T20:27:08.361073] [DEBUG] [LOCAL ] NXG: Loaded 10497 existing records from primary storage. [2025-09-23T20:27:08.374540] [INFO ] [MAIN ] NXG: Loaded 10497 existing records. [2025-09-23T20:27:08.501291] [DEBUG] [LOCAL ] NXDT: Loaded 16470 existing records from primary storage. [2025-09-23T20:27:08.556212] [INFO ] [MAIN ] NXDT: Loaded 16470 existing records. [2025-09-23T20:27:08.759633] [DEBUG] [LOCAL ] NXE: Loaded 52981 existing records from primary storage. [2025-09-23T20:27:08.765005] [INFO ] [MAIN ] NXE: Loaded 52981 existing records. [2025-09-23T20:27:08.882039] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:27:08.973804] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-23T20:27:08.989715] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-23T20:27:09.047820] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-23T20:27:09.100548] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-23T20:27:09.195212] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:09.236698] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-23T20:27:09.298969] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:27:09.356413] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-23T20:27:09.395927] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-23T20:27:09.418247] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-23T20:27:09.423598] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-23T20:27:09.417413] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:27:09.459099] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-23T20:27:09.478944] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-23T20:27:09.554972] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-23T20:27:09.579223] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-23T20:27:09.688462] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:27:09.767313] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-23T20:27:09.853454] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-23T20:27:10.236489] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:27:10.292684] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-23T20:27:10.305822] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:10.335219] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-23T20:27:10.358495] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-23T20:27:10.502744] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:10.534717] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-23T20:27:10.571939] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:10.572261] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-23T20:27:10.684738] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:27:10.685124] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-23T20:27:10.685720] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-23T20:27:10.927903] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:27:10.928232] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-23T20:27:11.402199] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-23T20:27:11.512291] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T20:27:11.718836] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:27:11.719186] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-23T20:27:11.742175] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T20:27:12.202204] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-23T20:27:12.517507] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T20:27:13.002168] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-23T20:27:13.018727] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T20:27:13.802178] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-23T20:27:13.909907] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T20:27:14.057425] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:27:14.057780] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-23T20:27:14.602197] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-23T20:27:15.336057] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T20:27:15.402174] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-23T20:27:16.202206] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-23T20:27:16.861944] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T20:27:17.002246] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-23T20:27:17.297286] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:27:17.297614] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-23T20:27:17.802188] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-23T20:27:17.914894] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T20:27:18.602244] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-23T20:27:18.981123] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T20:27:19.402227] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-23T20:27:20.158447] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T20:27:20.202183] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-23T20:27:20.426945] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T20:27:20.917144] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T20:27:21.002266] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-23T20:27:21.802224] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-23T20:27:22.599226] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T20:27:22.602134] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-23T20:27:22.784884] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-23T20:27:23.402160] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-23T20:27:23.614065] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T20:27:24.202196] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-23T20:27:25.002193] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-23T20:27:25.208107] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T20:27:25.234161] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T20:27:25.802244] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-23T20:27:26.602243] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-23T20:27:26.788282] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T20:27:26.814696] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T20:27:27.402276] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-23T20:27:27.542677] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T20:27:28.202257] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-23T20:27:28.928301] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T20:27:28.931762] [INFO ] [REMOTE ] NXG: Full fetch complete (14408 records). [2025-09-23T20:27:28.931843] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-23T20:27:29.010328] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-23T20:27:29.076708] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T20:27:29.106949] [INFO ] [REMOTE ] NXDR: Full fetch complete (16620 records). [2025-09-23T20:27:29.131208] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-23T20:27:29.593558] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 46 unique days, need 200 days [2025-09-23T20:27:29.604197] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:27:29.604537] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-23T20:27:29.604451] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:27:29.604788] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-23T20:27:29.604732] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-23T20:27:29.604969] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-23T20:27:29.605535] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-23T20:27:29.605777] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-23T20:27:29.605710] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-23T20:27:29.606271] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-23T20:27:29.606578] [INFO ] [MAIN ] Update Progress: 1561/2372 symbols completed. NXDR took 22.1s. Estimated remaining: 1h 47m 46s. Rate: 7.5 symbols/min [2025-09-23T20:27:29.607190] [DEBUG] [LOCAL ] NXG: Trimmed 14408 records to 10489 (keeping 200 days of data) [2025-09-23T20:27:29.816859] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-23T20:27:29.847075] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:29.867371] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T20:27:29.890287] [DEBUG] [LOCAL ] NXJ: Loaded 14967 existing records from primary storage. [2025-09-23T20:27:29.891920] [INFO ] [MAIN ] NXJ: Loaded 14967 existing records. [2025-09-23T20:27:30.056231] [DEBUG] [LOCAL ] NXG: Primary data saved (10489 records). [2025-09-23T20:27:30.062333] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-23T20:27:30.066107] [INFO ] [MAIN ] Update Progress: 1562/2372 symbols completed. NXG took 22.6s. Estimated remaining: 1h 47m 35s. Rate: 7.5 symbols/min [2025-09-23T20:27:30.169285] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:27:30.192496] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-23T20:27:30.203729] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-23T20:27:30.209587] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-23T20:27:30.219974] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-23T20:27:30.394718] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:30.460276] [DEBUG] [LOCAL ] NXN: Loaded 2312 existing records from primary storage. [2025-09-23T20:27:30.461878] [INFO ] [MAIN ] NXN: Loaded 2312 existing records. [2025-09-23T20:27:30.603067] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-23T20:27:30.848447] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:27:30.870628] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:30.870955] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-23T20:27:30.871309] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-23T20:27:30.871611] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-23T20:27:30.871711] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-23T20:27:31.248537] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:31.402211] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-23T20:27:31.490571] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T20:27:31.845207] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T20:27:31.847630] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T20:27:32.202201] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-23T20:27:32.889277] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T20:27:33.002241] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-23T20:27:33.802187] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-23T20:27:33.999407] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T20:27:34.602209] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-23T20:27:35.402232] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-23T20:27:35.545261] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T20:27:35.735602] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T20:27:35.833708] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T20:27:36.202246] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-23T20:27:37.002279] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-23T20:27:37.561904] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T20:27:37.747043] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T20:27:37.802188] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-23T20:27:38.602195] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-23T20:27:39.402786] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-23T20:27:39.408595] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T20:27:39.451018] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T20:27:39.941347] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T20:27:40.202248] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-23T20:27:41.002206] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-23T20:27:41.802248] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-23T20:27:42.061999] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T20:27:42.197581] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-23T20:27:42.602204] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-23T20:27:42.623241] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T20:27:42.987083] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-23T20:27:43.402214] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-23T20:27:44.195332] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T20:27:44.198094] [INFO ] [REMOTE ] NXDT: Full fetch complete (25751 records). [2025-09-23T20:27:44.198184] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-23T20:27:44.209798] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-23T20:27:44.582949] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-23T20:27:44.583037] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-23T20:27:44.583678] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-23T20:27:44.583741] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-23T20:27:44.584470] [DEBUG] [LOCAL ] NXDT: Trimmed 25751 records to 16417 (keeping 200 days of data) [2025-09-23T20:27:44.681711] [DEBUG] [LOCAL ] NXDT: Primary data saved (16417 records). [2025-09-23T20:27:44.681931] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-23T20:27:44.682059] [INFO ] [MAIN ] Update Progress: 1563/2372 symbols completed. NXDT took 37.2s. Estimated remaining: 1h 47m 30s. Rate: 7.5 symbols/min [2025-09-23T20:27:44.853557] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:44.868753] [DEBUG] [LOCAL ] NXP: Loaded 12323 existing records from primary storage. [2025-09-23T20:27:44.868871] [INFO ] [MAIN ] NXP: Loaded 12323 existing records. [2025-09-23T20:27:45.011472] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-23T20:27:45.055771] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:27:45.056076] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-23T20:27:45.056161] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-23T20:27:45.056895] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-23T20:27:45.056958] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-23T20:27:45.378574] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T20:27:45.446922] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:45.802245] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-23T20:27:46.602172] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-23T20:27:46.819599] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T20:27:46.988633] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T20:27:46.998335] [INFO ] [REMOTE ] NXE: Full fetch complete (76637 records). [2025-09-23T20:27:46.998474] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-23T20:27:47.129095] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T20:27:47.408582] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-23T20:27:47.413842] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-23T20:27:47.413947] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-23T20:27:47.415015] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-23T20:27:47.415204] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-23T20:27:47.416917] [DEBUG] [LOCAL ] NXE: Trimmed 76637 records to 52985 (keeping 200 days of data) [2025-09-23T20:27:47.718304] [DEBUG] [LOCAL ] NXE: Primary data saved (52985 records). [2025-09-23T20:27:47.718443] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-23T20:27:47.718528] [INFO ] [MAIN ] Update Progress: 1564/2372 symbols completed. NXE took 40.2s. Estimated remaining: 1h 47m 19s. Rate: 7.5 symbols/min [2025-09-23T20:27:47.891111] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:47.910935] [DEBUG] [LOCAL ] NXRT: Loaded 18963 existing records from primary storage. [2025-09-23T20:27:47.911077] [INFO ] [MAIN ] NXRT: Loaded 18963 existing records. [2025-09-23T20:27:48.106223] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:27:48.106463] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-23T20:27:48.106513] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-23T20:27:48.107175] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-23T20:27:48.107237] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-23T20:27:48.187272] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T20:27:48.203612] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-23T20:27:48.481200] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:48.983739] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T20:27:49.002138] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-23T20:27:49.802221] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-23T20:27:49.812148] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T20:27:50.602179] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-23T20:27:50.767318] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T20:27:50.964586] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T20:27:51.402227] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-23T20:27:52.202198] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-23T20:27:52.216441] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T20:27:52.761110] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-23T20:27:53.002228] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-23T20:27:53.503022] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T20:27:53.504156] [INFO ] [REMOTE ] NXN: Full fetch complete (3671 records). [2025-09-23T20:27:53.504230] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-23T20:27:53.807381] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-23T20:27:53.930233] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-23T20:27:53.930344] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-23T20:27:53.930543] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-23T20:27:53.930590] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-23T20:27:53.931156] [DEBUG] [LOCAL ] NXN: Trimmed 3671 records to 2336 (keeping 200 days of data) [2025-09-23T20:27:53.948045] [DEBUG] [LOCAL ] NXN: Primary data saved (2336 records). [2025-09-23T20:27:53.948206] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-23T20:27:53.948323] [INFO ] [MAIN ] Update Progress: 1565/2372 symbols completed. NXN took 23.9s. Estimated remaining: 1h 47m 11s. Rate: 7.5 symbols/min [2025-09-23T20:27:54.149865] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:27:54.150145] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-23T20:27:54.150192] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-23T20:27:54.150354] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-23T20:27:54.150398] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-23T20:27:54.150441] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-23T20:27:54.150478] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-23T20:27:54.558342] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:27:54.602266] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-23T20:27:54.729080] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T20:27:55.402242] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-23T20:27:55.520052] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T20:27:56.202201] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-23T20:27:56.332278] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T20:27:57.002255] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-23T20:27:57.326528] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T20:27:57.391838] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-23T20:27:57.802252] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-23T20:27:58.287046] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T20:27:58.602237] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-23T20:27:59.402219] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-23T20:27:59.739410] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T20:27:59.741221] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-23T20:28:00.202293] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-23T20:28:01.002236] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-23T20:28:01.318393] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T20:28:01.477321] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T20:28:01.802259] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-23T20:28:02.602187] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-23T20:28:02.800106] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T20:28:02.951380] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T20:28:03.402248] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-23T20:28:03.795543] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-23T20:28:04.202247] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-23T20:28:05.002205] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-23T20:28:05.106793] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T20:28:05.802204] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-23T20:28:06.123262] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T20:28:06.141012] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T20:28:06.602213] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-23T20:28:07.402210] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-23T20:28:07.755281] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T20:28:07.768277] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T20:28:08.202271] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-23T20:28:09.002249] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-23T20:28:09.062426] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T20:28:09.065895] [INFO ] [REMOTE ] NXJ: Full fetch complete (21243 records). [2025-09-23T20:28:09.066000] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-23T20:28:09.455721] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-23T20:28:09.455844] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-23T20:28:09.456824] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-23T20:28:09.456892] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-23T20:28:09.457783] [DEBUG] [LOCAL ] NXJ: Trimmed 21243 records to 14965 (keeping 200 days of data) [2025-09-23T20:28:09.556024] [DEBUG] [LOCAL ] NXJ: Primary data saved (14965 records). [2025-09-23T20:28:09.556189] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-23T20:28:09.556280] [INFO ] [MAIN ] Update Progress: 1566/2372 symbols completed. NXJ took 39.9s. Estimated remaining: 1h 47m 7s. Rate: 7.5 symbols/min [2025-09-23T20:28:09.740123] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:28:09.797174] [DEBUG] [LOCAL ] NYT: Loaded 49995 existing records from primary storage. [2025-09-23T20:28:09.797346] [INFO ] [MAIN ] NYT: Loaded 49995 existing records. [2025-09-23T20:28:09.808866] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-23T20:28:09.960210] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T20:28:09.992471] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:28:09.992720] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-23T20:28:09.992826] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-23T20:28:09.994321] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-23T20:28:09.994384] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-23T20:28:10.350478] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:28:10.602212] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-23T20:28:11.007390] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T20:28:11.402224] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-23T20:28:12.202181] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-23T20:28:12.289309] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T20:28:12.444687] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T20:28:12.508443] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T20:28:13.002197] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-23T20:28:13.369319] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-23T20:28:13.370300] [INFO ] [REMOTE ] NYC: Full fetch complete (1915 records). [2025-09-23T20:28:13.370369] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-23T20:28:13.569043] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-23T20:28:13.569255] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:28:13.569304] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:28:13.569372] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-23T20:28:13.569440] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-23T20:28:13.569477] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-23T20:28:13.569542] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-23T20:28:13.569659] [INFO ] [MAIN ] Update Progress: 1567/2372 symbols completed. NYC took 19.6s. Estimated remaining: 1h 46m 57s. Rate: 7.5 symbols/min [2025-09-23T20:28:13.802424] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-23T20:28:13.826905] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:28:13.876719] [DEBUG] [LOCAL ] NZF: Loaded 29077 existing records from primary storage. [2025-09-23T20:28:13.876895] [INFO ] [MAIN ] NZF: Loaded 29077 existing records. [2025-09-23T20:28:14.122691] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:28:14.123115] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-23T20:28:14.123188] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-23T20:28:14.124544] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-23T20:28:14.124629] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-23T20:28:14.607422] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-23T20:28:14.667569] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:28:15.081083] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T20:28:15.402215] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-23T20:28:16.202218] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-23T20:28:16.341777] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T20:28:16.407237] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T20:28:17.002220] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-23T20:28:17.051255] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T20:28:17.802208] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-23T20:28:18.602184] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-23T20:28:18.738463] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T20:28:18.787266] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T20:28:18.790955] [INFO ] [REMOTE ] NXRT: Full fetch complete (25075 records). [2025-09-23T20:28:18.791146] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-23T20:28:19.165090] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-23T20:28:19.165176] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-23T20:28:19.165775] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-23T20:28:19.165837] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-23T20:28:19.166485] [DEBUG] [LOCAL ] NXRT: Trimmed 25075 records to 19024 (keeping 200 days of data) [2025-09-23T20:28:19.284696] [DEBUG] [LOCAL ] NXRT: Primary data saved (19024 records). [2025-09-23T20:28:19.284852] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-23T20:28:19.284940] [INFO ] [MAIN ] Update Progress: 1568/2372 symbols completed. NXRT took 31.6s. Estimated remaining: 1h 46m 47s. Rate: 7.5 symbols/min [2025-09-23T20:28:19.407381] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-23T20:28:19.464488] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:28:19.464931] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-23T20:28:19.473767] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T20:28:19.472594] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-23T20:28:19.477606] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-23T20:28:19.477760] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-23T20:28:19.477871] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-23T20:28:19.477936] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-23T20:28:19.846302] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:28:20.202214] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-23T20:28:20.969786] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T20:28:21.002162] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-23T20:28:21.070164] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T20:28:21.073081] [INFO ] [REMOTE ] NXP: Full fetch complete (16705 records). [2025-09-23T20:28:21.073168] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-23T20:28:21.442478] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-23T20:28:21.442590] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-23T20:28:21.443009] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-23T20:28:21.443070] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-23T20:28:21.443626] [DEBUG] [LOCAL ] NXP: Trimmed 16705 records to 12323 (keeping 200 days of data) [2025-09-23T20:28:21.518955] [DEBUG] [LOCAL ] NXP: Primary data saved (12323 records). [2025-09-23T20:28:21.519092] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-23T20:28:21.519179] [INFO ] [MAIN ] Update Progress: 1569/2372 symbols completed. NXP took 36.8s. Estimated remaining: 1h 46m 37s. Rate: 7.5 symbols/min [2025-09-23T20:28:21.688685] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:28:21.744354] [DEBUG] [LOCAL ] OBDC: Loaded 51650 existing records from primary storage. [2025-09-23T20:28:21.744511] [INFO ] [MAIN ] OBDC: Loaded 51650 existing records. [2025-09-23T20:28:21.812672] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-23T20:28:21.942582] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:28:21.942865] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-23T20:28:21.942913] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-23T20:28:21.944662] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-23T20:28:21.944725] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-23T20:28:22.326590] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:28:22.328701] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T20:28:22.602204] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-23T20:28:23.402203] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-23T20:28:23.694487] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T20:28:24.202213] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-23T20:28:24.556513] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-23T20:28:24.726080] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T20:28:25.002240] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-23T20:28:25.802224] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-23T20:28:26.146893] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-23T20:28:26.602272] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-23T20:28:27.355609] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-23T20:28:27.370223] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T20:28:27.402140] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-23T20:28:28.202235] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-23T20:28:28.424879] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T20:28:28.496987] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T20:28:29.002196] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-23T20:28:29.802217] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-23T20:28:30.360749] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T20:28:30.489201] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-23T20:28:30.602172] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-23T20:28:31.209351] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T20:28:31.402173] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-23T20:28:32.202175] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-23T20:28:32.598689] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T20:28:33.002165] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-23T20:28:33.256199] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T20:28:33.565992] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T20:28:33.802195] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-23T20:28:34.478512] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T20:28:34.602210] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-23T20:28:34.691275] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-23T20:28:35.402214] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-23T20:28:36.202177] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-23T20:28:36.521132] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-23T20:28:36.739191] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T20:28:37.002225] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-23T20:28:37.781860] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T20:28:37.802149] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-23T20:28:38.308082] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T20:28:38.313514] [INFO ] [REMOTE ] NZF: Full fetch complete (43726 records). [2025-09-23T20:28:38.313640] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-23T20:28:38.607374] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-23T20:28:38.732420] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-23T20:28:38.732509] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-23T20:28:38.733348] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-23T20:28:38.733415] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-23T20:28:38.734477] [DEBUG] [LOCAL ] NZF: Trimmed 43726 records to 29085 (keeping 200 days of data) [2025-09-23T20:28:38.923321] [DEBUG] [LOCAL ] NZF: Primary data saved (29085 records). [2025-09-23T20:28:38.923457] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-23T20:28:38.923546] [INFO ] [MAIN ] Update Progress: 1570/2372 symbols completed. NZF took 25.4s. Estimated remaining: 1h 46m 33s. Rate: 7.5 symbols/min [2025-09-23T20:28:39.123812] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:28:39.146739] [DEBUG] [LOCAL ] OBK: Loaded 16315 existing records from primary storage. [2025-09-23T20:28:39.146889] [INFO ] [MAIN ] OBK: Loaded 16315 existing records. [2025-09-23T20:28:39.349891] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:28:39.350400] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-23T20:28:39.350597] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-23T20:28:39.351315] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-23T20:28:39.351496] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-23T20:28:39.412019] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-23T20:28:39.590760] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T20:28:39.812092] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:28:40.202174] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-23T20:28:40.528427] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T20:28:41.002194] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-23T20:28:41.321198] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T20:28:41.802250] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-23T20:28:42.262600] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-23T20:28:42.602275] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-23T20:28:42.654603] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T20:28:43.094369] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T20:28:43.402259] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-23T20:28:44.202271] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-23T20:28:45.002196] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-23T20:28:45.219944] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-23T20:28:45.234521] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T20:28:45.276908] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-23T20:28:45.802294] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-23T20:28:46.522696] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T20:28:46.602210] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-23T20:28:47.402264] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-23T20:28:47.547370] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T20:28:47.555567] [INFO ] [REMOTE ] NYT: Full fetch complete (72088 records). [2025-09-23T20:28:47.555766] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-23T20:28:47.963262] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-23T20:28:47.963344] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-23T20:28:47.964348] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-23T20:28:47.964443] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-23T20:28:47.965940] [DEBUG] [LOCAL ] NYT: Trimmed 72088 records to 49929 (keeping 200 days of data) [2025-09-23T20:28:48.202380] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-23T20:28:48.284113] [DEBUG] [LOCAL ] NYT: Primary data saved (49929 records). [2025-09-23T20:28:48.284308] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-23T20:28:48.284498] [INFO ] [MAIN ] Update Progress: 1571/2372 symbols completed. NYT took 38.7s. Estimated remaining: 1h 46m 26s. Rate: 7.5 symbols/min [2025-09-23T20:28:48.484212] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:28:48.541116] [DEBUG] [LOCAL ] OC: Loaded 44772 existing records from primary storage. [2025-09-23T20:28:48.541307] [INFO ] [MAIN ] OC: Loaded 44772 existing records. [2025-09-23T20:28:48.772611] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:28:48.773106] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-23T20:28:48.773246] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-23T20:28:48.775055] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-23T20:28:48.775137] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-23T20:28:49.147467] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:28:49.147945] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-23T20:28:49.190618] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T20:28:49.191488] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T20:28:49.244848] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-23T20:28:49.802197] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-23T20:28:50.602222] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-23T20:28:50.909495] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T20:28:51.030488] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T20:28:51.402237] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-23T20:28:52.202178] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-23T20:28:52.230247] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T20:28:52.241027] [INFO ] [REMOTE ] OBDC: Full fetch complete (74836 records). [2025-09-23T20:28:52.241211] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-23T20:28:52.579508] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T20:28:52.690249] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-23T20:28:52.690357] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-23T20:28:52.692289] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-23T20:28:52.692400] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-23T20:28:52.696578] [DEBUG] [LOCAL ] OBDC: Trimmed 74836 records to 51652 (keeping 200 days of data) [2025-09-23T20:28:53.008523] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-23T20:28:53.033200] [DEBUG] [LOCAL ] OBDC: Primary data saved (51652 records). [2025-09-23T20:28:53.033315] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-23T20:28:53.033448] [INFO ] [MAIN ] Update Progress: 1572/2372 symbols completed. OBDC took 31.5s. Estimated remaining: 1h 46m 16s. Rate: 7.5 symbols/min [2025-09-23T20:28:53.202508] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:28:53.213830] [DEBUG] [LOCAL ] OCFT: Loaded 8957 existing records from primary storage. [2025-09-23T20:28:53.213951] [INFO ] [MAIN ] OCFT: Loaded 8957 existing records. [2025-09-23T20:28:53.397612] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:28:53.397917] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-23T20:28:53.397981] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-23T20:28:53.398363] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-23T20:28:53.398423] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-23T20:28:53.755934] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:28:53.802194] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-23T20:28:54.464145] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T20:28:54.602215] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-23T20:28:54.674537] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T20:28:54.804723] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-23T20:28:55.402260] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-23T20:28:55.617249] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T20:28:56.202276] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-23T20:28:57.002235] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-23T20:28:57.033203] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T20:28:57.613590] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T20:28:57.802211] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-23T20:28:58.602265] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-23T20:28:58.723491] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T20:28:58.906958] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-23T20:28:59.402221] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-23T20:29:00.207464] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-23T20:29:00.220533] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T20:29:01.002272] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-23T20:29:01.396774] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T20:29:01.802168] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-23T20:29:01.983254] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-23T20:29:02.005921] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T20:29:02.602252] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-23T20:29:03.402233] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-23T20:29:03.641372] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T20:29:04.202270] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-23T20:29:04.360560] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T20:29:04.595841] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-23T20:29:04.604276] [INFO ] [REMOTE ] O: Full fetch complete (77557 records). [2025-09-23T20:29:04.604416] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-23T20:29:04.816860] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T20:29:04.824033] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T20:29:04.824953] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:29:04.827963] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:29:04.828048] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-23T20:29:04.828130] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-23T20:29:04.828181] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-23T20:29:04.828262] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-23T20:29:04.828363] [INFO ] [MAIN ] Update Progress: 1573/2372 symbols completed. O took 45.5s. Estimated remaining: 1h 46m 10s. Rate: 7.5 symbols/min [2025-09-23T20:29:05.003763] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:29:05.003875] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-23T20:29:05.018297] [DEBUG] [LOCAL ] ODC: Loaded 8551 existing records from primary storage. [2025-09-23T20:29:05.018452] [INFO ] [MAIN ] ODC: Loaded 8551 existing records. [2025-09-23T20:29:05.195638] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:29:05.195896] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-23T20:29:05.195945] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-23T20:29:05.196458] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-23T20:29:05.196519] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-23T20:29:05.567758] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:29:05.802194] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-23T20:29:06.602241] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-23T20:29:06.730623] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T20:29:06.775760] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T20:29:06.780793] [INFO ] [REMOTE ] OBK: Full fetch complete (24103 records). [2025-09-23T20:29:06.780871] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-23T20:29:07.148420] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-23T20:29:07.148522] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-23T20:29:07.149160] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-23T20:29:07.149224] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-23T20:29:07.149949] [DEBUG] [LOCAL ] OBK: Trimmed 24103 records to 16316 (keeping 200 days of data) [2025-09-23T20:29:07.265373] [DEBUG] [LOCAL ] OBK: Primary data saved (16316 records). [2025-09-23T20:29:07.265783] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-23T20:29:07.265943] [INFO ] [MAIN ] Update Progress: 1574/2372 symbols completed. OBK took 28.3s. Estimated remaining: 1h 45m 60s. Rate: 7.5 symbols/min [2025-09-23T20:29:07.407990] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-23T20:29:07.446310] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:29:07.448301] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T20:29:07.479436] [DEBUG] [LOCAL ] ODV: Loaded 25269 existing records from primary storage. [2025-09-23T20:29:07.479578] [INFO ] [MAIN ] ODV: Loaded 25269 existing records. [2025-09-23T20:29:07.654880] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:29:07.655224] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-23T20:29:07.655306] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-23T20:29:07.656418] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-23T20:29:07.656478] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-23T20:29:08.005670] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:29:08.202170] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-23T20:29:09.002184] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-23T20:29:09.043521] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T20:29:09.215571] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T20:29:09.802161] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-23T20:29:09.869003] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T20:29:10.602243] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-23T20:29:11.402224] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-23T20:29:11.419817] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T20:29:11.519048] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T20:29:11.949436] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-23T20:29:12.202233] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-23T20:29:13.002197] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-23T20:29:13.802187] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-23T20:29:13.848457] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T20:29:13.911971] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T20:29:14.602220] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-23T20:29:14.636235] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T20:29:15.402201] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-23T20:29:16.212198] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-23T20:29:16.217777] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T20:29:16.235947] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T20:29:16.240664] [INFO ] [REMOTE ] OC: Full fetch complete (64062 records). [2025-09-23T20:29:16.240784] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-23T20:29:16.645085] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-23T20:29:16.645182] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-23T20:29:16.646244] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-23T20:29:16.646312] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-23T20:29:16.647741] [DEBUG] [LOCAL ] OC: Trimmed 64062 records to 44759 (keeping 200 days of data) [2025-09-23T20:29:16.942297] [DEBUG] [LOCAL ] OC: Primary data saved (44759 records). [2025-09-23T20:29:16.942451] [INFO ] [MAIN ] OC: Full history saved. [2025-09-23T20:29:16.942588] [INFO ] [MAIN ] Update Progress: 1575/2372 symbols completed. OC took 28.7s. Estimated remaining: 1h 45m 53s. Rate: 7.5 symbols/min [2025-09-23T20:29:17.002765] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-23T20:29:17.038042] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T20:29:17.146505] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:29:17.184038] [DEBUG] [LOCAL ] OEC: Loaded 37238 existing records from primary storage. [2025-09-23T20:29:17.184184] [INFO ] [MAIN ] OEC: Loaded 37238 existing records. [2025-09-23T20:29:17.369573] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:29:17.369857] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-23T20:29:17.369906] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-23T20:29:17.371038] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-23T20:29:17.371099] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-23T20:29:17.742505] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:29:17.751131] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T20:29:17.802172] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-23T20:29:18.602200] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-23T20:29:19.402213] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-23T20:29:19.913345] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T20:29:20.048433] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T20:29:20.049926] [INFO ] [REMOTE ] OCFT: Full fetch complete (11854 records). [2025-09-23T20:29:20.050020] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-23T20:29:20.207330] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-23T20:29:20.431208] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-23T20:29:20.431292] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-23T20:29:20.431577] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-23T20:29:20.431637] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-23T20:29:20.432132] [DEBUG] [LOCAL ] OCFT: Trimmed 11854 records to 8974 (keeping 200 days of data) [2025-09-23T20:29:20.480692] [DEBUG] [LOCAL ] OCFT: Primary data saved (8974 records). [2025-09-23T20:29:20.480812] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-23T20:29:20.480925] [INFO ] [MAIN ] Update Progress: 1576/2372 symbols completed. OCFT took 27.4s. Estimated remaining: 1h 45m 42s. Rate: 7.5 symbols/min [2025-09-23T20:29:20.649849] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:29:20.671196] [DEBUG] [LOCAL ] OFG: Loaded 22253 existing records from primary storage. [2025-09-23T20:29:20.671309] [INFO ] [MAIN ] OFG: Loaded 22253 existing records. [2025-09-23T20:29:20.851033] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:29:20.851268] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-23T20:29:20.851315] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-23T20:29:20.852088] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-23T20:29:20.852149] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-23T20:29:21.007307] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-23T20:29:21.238950] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:29:21.671100] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T20:29:21.802167] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-23T20:29:21.878271] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (4.08 seconds). [2025-09-23T20:29:22.082077] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T20:29:22.602217] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-23T20:29:22.774169] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T20:29:23.402170] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-23T20:29:23.676080] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T20:29:24.202239] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-23T20:29:24.254854] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T20:29:25.002343] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-23T20:29:25.447875] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T20:29:25.802256] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-23T20:29:26.227025] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T20:29:26.602220] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-23T20:29:26.926450] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T20:29:27.171462] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T20:29:27.402225] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-23T20:29:28.202248] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-23T20:29:28.789292] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T20:29:29.002224] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-23T20:29:29.308406] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T20:29:29.802225] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-23T20:29:30.463874] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T20:29:30.602244] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-23T20:29:31.143138] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T20:29:31.154924] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T20:29:31.155044] [INFO ] [REMOTE ] ODV: Full fetch complete (31703 records). [2025-09-23T20:29:31.157286] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-23T20:29:31.402206] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-23T20:29:31.547113] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-23T20:29:31.547196] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-23T20:29:31.547992] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-23T20:29:31.548061] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-23T20:29:31.548865] [DEBUG] [LOCAL ] ODV: Trimmed 31703 records to 25476 (keeping 200 days of data) [2025-09-23T20:29:31.698893] [DEBUG] [LOCAL ] ODV: Primary data saved (25476 records). [2025-09-23T20:29:31.699030] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-23T20:29:31.699117] [INFO ] [MAIN ] Update Progress: 1577/2372 symbols completed. ODV took 24.4s. Estimated remaining: 1h 45m 36s. Rate: 7.5 symbols/min [2025-09-23T20:29:31.886361] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:29:31.933511] [DEBUG] [LOCAL ] OGE: Loaded 46509 existing records from primary storage. [2025-09-23T20:29:31.933707] [INFO ] [MAIN ] OGE: Loaded 46509 existing records. [2025-09-23T20:29:32.113727] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:29:32.113990] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-23T20:29:32.114040] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-23T20:29:32.115425] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-23T20:29:32.115488] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-23T20:29:32.208485] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-23T20:29:32.553180] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:29:32.751000] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T20:29:33.002192] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-23T20:29:33.110306] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T20:29:33.802210] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-23T20:29:34.223447] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T20:29:34.602220] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-23T20:29:35.402192] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-23T20:29:35.431390] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T20:29:35.744480] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T20:29:36.202219] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-23T20:29:36.296494] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-23T20:29:37.002210] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-23T20:29:37.743990] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T20:29:37.802165] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-23T20:29:37.815590] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T20:29:38.602252] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-23T20:29:39.333306] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T20:29:39.402167] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-23T20:29:39.472163] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T20:29:39.475503] [INFO ] [REMOTE ] ODC: Full fetch complete (10937 records). [2025-09-23T20:29:39.475588] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-23T20:29:39.838237] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-23T20:29:39.838317] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-23T20:29:39.838595] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-23T20:29:39.838635] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-23T20:29:39.839174] [DEBUG] [LOCAL ] ODC: Trimmed 10937 records to 8589 (keeping 200 days of data) [2025-09-23T20:29:39.895246] [DEBUG] [LOCAL ] ODC: Primary data saved (8589 records). [2025-09-23T20:29:39.895538] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-23T20:29:39.895630] [INFO ] [MAIN ] Update Progress: 1578/2372 symbols completed. ODC took 35.1s. Estimated remaining: 1h 45m 28s. Rate: 7.5 symbols/min [2025-09-23T20:29:40.067960] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:29:40.130113] [DEBUG] [LOCAL ] OGN: Loaded 53122 existing records from primary storage. [2025-09-23T20:29:40.130261] [INFO ] [MAIN ] OGN: Loaded 53122 existing records. [2025-09-23T20:29:40.208409] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-23T20:29:40.316923] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:29:40.317150] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-23T20:29:40.317199] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-23T20:29:40.318552] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-23T20:29:40.318616] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-23T20:29:40.678211] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:29:40.959860] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T20:29:41.002145] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-23T20:29:41.016282] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T20:29:41.802243] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-23T20:29:42.100956] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T20:29:42.602249] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-23T20:29:43.402262] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-23T20:29:43.916032] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-23T20:29:44.202164] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-23T20:29:44.304400] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T20:29:44.927382] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T20:29:45.002215] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-23T20:29:45.662109] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T20:29:45.802154] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-23T20:29:46.179297] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T20:29:46.602394] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-23T20:29:47.402214] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-23T20:29:47.595544] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T20:29:47.636962] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T20:29:48.202208] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-23T20:29:49.013173] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-23T20:29:49.015957] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T20:29:49.802194] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-23T20:29:50.109027] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T20:29:50.112854] [INFO ] [REMOTE ] OFG: Full fetch complete (34548 records). [2025-09-23T20:29:50.112942] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-23T20:29:50.483861] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-23T20:29:50.566453] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-23T20:29:50.566539] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-23T20:29:50.567295] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-23T20:29:50.567363] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-23T20:29:50.568203] [DEBUG] [LOCAL ] OFG: Trimmed 34548 records to 22215 (keeping 200 days of data) [2025-09-23T20:29:50.626616] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-23T20:29:50.710537] [DEBUG] [LOCAL ] OFG: Primary data saved (22215 records). [2025-09-23T20:29:50.710709] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-23T20:29:50.710808] [INFO ] [MAIN ] Update Progress: 1579/2372 symbols completed. OFG took 30.2s. Estimated remaining: 1h 45m 22s. Rate: 7.5 symbols/min [2025-09-23T20:29:50.884794] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:29:50.918573] [DEBUG] [LOCAL ] OGS: Loaded 33911 existing records from primary storage. [2025-09-23T20:29:50.918756] [INFO ] [MAIN ] OGS: Loaded 33911 existing records. [2025-09-23T20:29:51.120450] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:29:51.121000] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-23T20:29:51.121063] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-23T20:29:51.129250] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-23T20:29:51.143330] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-23T20:29:51.144402] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T20:29:51.413397] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-23T20:29:51.533468] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:29:52.202167] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-23T20:29:52.458906] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T20:29:52.795180] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T20:29:53.002259] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-23T20:29:53.468702] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T20:29:53.474867] [INFO ] [REMOTE ] OEC: Full fetch complete (52534 records). [2025-09-23T20:29:53.475004] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-23T20:29:53.816022] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-23T20:29:53.872254] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-23T20:29:53.872357] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-23T20:29:53.873248] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-23T20:29:53.873422] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-23T20:29:53.874794] [DEBUG] [LOCAL ] OEC: Trimmed 52534 records to 37160 (keeping 200 days of data) [2025-09-23T20:29:54.101921] [DEBUG] [LOCAL ] OEC: Primary data saved (37160 records). [2025-09-23T20:29:54.102084] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-23T20:29:54.102174] [INFO ] [MAIN ] Update Progress: 1580/2372 symbols completed. OEC took 37.2s. Estimated remaining: 1h 45m 11s. Rate: 7.5 symbols/min [2025-09-23T20:29:54.279411] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:29:54.331332] [DEBUG] [LOCAL ] OHI: Loaded 52117 existing records from primary storage. [2025-09-23T20:29:54.331488] [INFO ] [MAIN ] OHI: Loaded 52117 existing records. [2025-09-23T20:29:54.514738] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:29:54.514977] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-23T20:29:54.515028] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-23T20:29:54.516292] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-23T20:29:54.516355] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-23T20:29:54.610338] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-23T20:29:54.896311] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:29:54.935787] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T20:29:55.153316] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T20:29:55.402217] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-23T20:29:56.191566] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T20:29:56.202139] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-23T20:29:57.002188] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-23T20:29:57.116141] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T20:29:57.630866] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T20:29:57.802245] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-23T20:29:58.602178] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-23T20:29:58.718106] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T20:29:58.788305] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T20:29:59.402192] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-23T20:30:00.192303] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T20:30:00.202545] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-23T20:30:01.010830] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-23T20:30:01.034947] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T20:30:01.802232] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-23T20:30:02.381392] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-23T20:30:02.602204] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-23T20:30:03.402203] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-23T20:30:03.650192] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-23T20:30:04.202215] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-23T20:30:04.526117] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-23T20:30:05.002233] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-23T20:30:05.113556] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-23T20:30:05.802198] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-23T20:30:06.592341] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (3.19 seconds). [2025-09-23T20:30:06.604872] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-23T20:30:06.741276] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T20:30:06.881159] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T20:30:06.968382] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-09-23T20:30:07.402287] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-23T20:30:08.202217] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-23T20:30:08.429433] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T20:30:08.440622] [INFO ] [REMOTE ] OGN: Full fetch complete (76813 records). [2025-09-23T20:30:08.440850] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-23T20:30:08.889902] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-23T20:30:08.890217] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-23T20:30:08.891395] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-23T20:30:08.891481] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-23T20:30:08.893377] [DEBUG] [LOCAL ] OGN: Trimmed 76813 records to 53127 (keeping 200 days of data) [2025-09-23T20:30:09.008633] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-23T20:30:09.032223] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T20:30:09.270362] [DEBUG] [LOCAL ] OGN: Primary data saved (53127 records). [2025-09-23T20:30:09.270575] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-23T20:30:09.270747] [INFO ] [MAIN ] Update Progress: 1581/2372 symbols completed. OGN took 29.4s. Estimated remaining: 1h 45m 7s. Rate: 7.5 symbols/min [2025-09-23T20:30:09.443804] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:30:09.464968] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T20:30:09.473017] [INFO ] [REMOTE ] OGE: Full fetch complete (66659 records). [2025-09-23T20:30:09.473139] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-23T20:30:09.802865] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-23T20:30:09.802765] [DEBUG] [LOCAL ] OI: Loaded 47398 existing records from primary storage. [2025-09-23T20:30:09.814073] [INFO ] [MAIN ] OI: Loaded 47398 existing records. [2025-09-23T20:30:09.991704] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-23T20:30:10.002543] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-23T20:30:10.012118] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-23T20:30:10.014759] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-23T20:30:10.076714] [DEBUG] [LOCAL ] OGE: Trimmed 66659 records to 46423 (keeping 200 days of data) [2025-09-23T20:30:10.098816] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:30:10.099047] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-23T20:30:10.099097] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-23T20:30:10.100181] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-23T20:30:10.100242] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-23T20:30:10.583498] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:30:10.603322] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-23T20:30:10.772062] [DEBUG] [LOCAL ] OGE: Primary data saved (46423 records). [2025-09-23T20:30:10.772233] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-23T20:30:10.772357] [INFO ] [MAIN ] Update Progress: 1582/2372 symbols completed. OGE took 39.1s. Estimated remaining: 1h 44m 56s. Rate: 7.5 symbols/min [2025-09-23T20:30:10.962736] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:30:10.979300] [DEBUG] [LOCAL ] OIA: Loaded 13892 existing records from primary storage. [2025-09-23T20:30:10.979458] [INFO ] [MAIN ] OIA: Loaded 13892 existing records. [2025-09-23T20:30:11.169608] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:30:11.170340] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-23T20:30:11.170615] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-23T20:30:11.182251] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-23T20:30:11.187705] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-23T20:30:11.270237] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-23T20:30:11.420268] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-23T20:30:11.403091] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T20:30:11.620521] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:30:12.202211] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-23T20:30:12.340070] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T20:30:13.002204] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-23T20:30:13.146164] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T20:30:13.575961] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T20:30:13.802176] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-23T20:30:14.568191] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T20:30:14.602233] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-23T20:30:15.402201] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-23T20:30:15.521273] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T20:30:15.704702] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T20:30:16.202203] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-23T20:30:17.007347] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-23T20:30:17.034395] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T20:30:17.802236] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-23T20:30:18.073828] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T20:30:18.602195] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-23T20:30:19.238487] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-23T20:30:19.402201] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-23T20:30:19.979581] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T20:30:19.985118] [INFO ] [REMOTE ] OGS: Full fetch complete (47856 records). [2025-09-23T20:30:19.985237] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-23T20:30:20.215228] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-23T20:30:20.400798] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-23T20:30:20.428164] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-23T20:30:20.428252] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-23T20:30:20.429070] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-23T20:30:20.429134] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-23T20:30:20.430162] [DEBUG] [LOCAL ] OGS: Trimmed 47856 records to 33914 (keeping 200 days of data) [2025-09-23T20:30:20.636053] [DEBUG] [LOCAL ] OGS: Primary data saved (33914 records). [2025-09-23T20:30:20.636190] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-23T20:30:20.636275] [INFO ] [MAIN ] Update Progress: 1583/2372 symbols completed. OGS took 29.9s. Estimated remaining: 1h 44m 49s. Rate: 7.5 symbols/min [2025-09-23T20:30:20.806828] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:30:20.846895] [DEBUG] [LOCAL ] OII: Loaded 43007 existing records from primary storage. [2025-09-23T20:30:20.847032] [INFO ] [MAIN ] OII: Loaded 43007 existing records. [2025-09-23T20:30:21.007699] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-23T20:30:21.031499] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:30:21.031707] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-23T20:30:21.031763] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-23T20:30:21.032687] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-23T20:30:21.032751] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-23T20:30:21.409694] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T20:30:21.415217] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:30:21.465611] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T20:30:21.802197] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-23T20:30:22.602196] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-23T20:30:22.729494] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T20:30:23.006573] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T20:30:23.402207] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-23T20:30:24.202183] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-23T20:30:24.472607] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T20:30:25.002155] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-23T20:30:25.400719] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T20:30:25.465022] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T20:30:25.802204] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-23T20:30:26.602212] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-23T20:30:26.748274] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T20:30:26.759670] [INFO ] [REMOTE ] OHI: Full fetch complete (75100 records). [2025-09-23T20:30:26.759911] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-23T20:30:27.225932] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-23T20:30:27.226068] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-23T20:30:27.227438] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-23T20:30:27.227513] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-23T20:30:27.229553] [DEBUG] [LOCAL ] OHI: Trimmed 75100 records to 52107 (keeping 200 days of data) [2025-09-23T20:30:27.420853] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-23T20:30:27.492577] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T20:30:27.609069] [DEBUG] [LOCAL ] OHI: Primary data saved (52107 records). [2025-09-23T20:30:27.609232] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-23T20:30:27.609321] [INFO ] [MAIN ] Update Progress: 1584/2372 symbols completed. OHI took 33.5s. Estimated remaining: 1h 44m 40s. Rate: 7.5 symbols/min [2025-09-23T20:30:27.783596] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:30:27.821537] [DEBUG] [LOCAL ] OIS: Loaded 40688 existing records from primary storage. [2025-09-23T20:30:27.821709] [INFO ] [MAIN ] OIS: Loaded 40688 existing records. [2025-09-23T20:30:28.033173] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:30:28.033596] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-23T20:30:28.033688] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-23T20:30:28.034615] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-23T20:30:28.034711] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-23T20:30:28.233106] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-23T20:30:28.320361] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T20:30:28.469236] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:30:28.476703] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T20:30:29.002269] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-23T20:30:29.802204] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-23T20:30:29.961798] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T20:30:30.028956] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T20:30:30.602198] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-23T20:30:31.334065] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T20:30:31.402219] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-23T20:30:32.202187] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-23T20:30:32.379213] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T20:30:32.935723] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T20:30:33.002182] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-23T20:30:33.150566] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T20:30:33.802210] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-23T20:30:34.476215] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T20:30:34.602233] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-23T20:30:35.402262] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-23T20:30:35.568243] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T20:30:35.834468] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T20:30:36.202179] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-23T20:30:36.286131] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T20:30:37.002198] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-23T20:30:37.804991] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-23T20:30:37.824780] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T20:30:37.850474] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T20:30:38.602256] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-23T20:30:39.402191] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-23T20:30:39.541944] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T20:30:39.553204] [INFO ] [REMOTE ] OI: Full fetch complete (68314 records). [2025-09-23T20:30:39.553372] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-23T20:30:39.951794] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-23T20:30:39.951928] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-23T20:30:39.953060] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-23T20:30:39.953189] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-23T20:30:39.965840] [DEBUG] [LOCAL ] OI: Trimmed 68314 records to 47375 (keeping 200 days of data) [2025-09-23T20:30:39.984141] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T20:30:40.202435] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-23T20:30:40.277474] [DEBUG] [LOCAL ] OI: Primary data saved (47375 records). [2025-09-23T20:30:40.277998] [INFO ] [MAIN ] OI: Full history saved. [2025-09-23T20:30:40.278522] [INFO ] [MAIN ] Update Progress: 1585/2372 symbols completed. OI took 31.0s. Estimated remaining: 1h 44m 35s. Rate: 7.5 symbols/min [2025-09-23T20:30:40.465944] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:30:40.523876] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-23T20:30:40.524059] [INFO ] [MAIN ] OKE: Loaded 53536 existing records. [2025-09-23T20:30:40.706558] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:30:40.706826] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-23T20:30:40.706886] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-23T20:30:40.708015] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-23T20:30:40.708080] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-23T20:30:41.005442] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-23T20:30:41.072616] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:30:41.193874] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T20:30:41.325057] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T20:30:41.802220] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-23T20:30:42.563973] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T20:30:42.602154] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-23T20:30:43.402183] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-23T20:30:43.691823] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T20:30:44.202166] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-23T20:30:44.320012] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T20:30:44.368071] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T20:30:44.371107] [INFO ] [REMOTE ] OIA: Full fetch complete (21122 records). [2025-09-23T20:30:44.371316] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-23T20:30:44.762765] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-23T20:30:44.762882] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-23T20:30:44.763347] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-23T20:30:44.763440] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-23T20:30:44.764146] [DEBUG] [LOCAL ] OIA: Trimmed 21122 records to 14010 (keeping 200 days of data) [2025-09-23T20:30:44.858194] [DEBUG] [LOCAL ] OIA: Primary data saved (14010 records). [2025-09-23T20:30:44.858334] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-23T20:30:44.858508] [INFO ] [MAIN ] Update Progress: 1586/2372 symbols completed. OIA took 34.1s. Estimated remaining: 1h 44m 25s. Rate: 7.5 symbols/min [2025-09-23T20:30:45.008450] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-23T20:30:45.036048] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:30:45.102510] [DEBUG] [LOCAL ] OKLO: Loaded 53819 existing records from primary storage. [2025-09-23T20:30:45.102689] [INFO ] [MAIN ] OKLO: Loaded 53819 existing records. [2025-09-23T20:30:45.285104] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:30:45.285371] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-23T20:30:45.285429] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-23T20:30:45.287201] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-09-23T20:30:45.287283] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-23T20:30:45.653620] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:30:45.802166] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-23T20:30:46.098174] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T20:30:46.587910] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T20:30:46.602144] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-23T20:30:47.402278] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-23T20:30:48.178276] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T20:30:48.202151] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-23T20:30:48.487552] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-23T20:30:49.002153] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-23T20:30:49.191044] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T20:30:49.511219] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T20:30:49.520264] [INFO ] [REMOTE ] OIS: Full fetch complete (56988 records). [2025-09-23T20:30:49.520389] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-23T20:30:49.807307] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-23T20:30:49.921497] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-23T20:30:49.921581] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-23T20:30:49.922534] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-23T20:30:49.922602] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-23T20:30:49.923881] [DEBUG] [LOCAL ] OIS: Trimmed 56988 records to 40687 (keeping 200 days of data) [2025-09-23T20:30:50.152080] [DEBUG] [LOCAL ] OIS: Primary data saved (40687 records). [2025-09-23T20:30:50.152206] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-23T20:30:50.152329] [INFO ] [MAIN ] Update Progress: 1587/2372 symbols completed. OIS took 22.5s. Estimated remaining: 1h 44m 16s. Rate: 7.5 symbols/min [2025-09-23T20:30:50.322029] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:30:50.377211] [DEBUG] [LOCAL ] OLN: Loaded 51738 existing records from primary storage. [2025-09-23T20:30:50.377354] [INFO ] [MAIN ] OLN: Loaded 51738 existing records. [2025-09-23T20:30:50.564953] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:30:50.565549] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-23T20:30:50.565619] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-23T20:30:50.567026] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-23T20:30:50.567088] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-23T20:30:50.610610] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-23T20:30:50.935760] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:30:51.402170] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-23T20:30:51.489275] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T20:30:51.571331] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-23T20:30:52.202167] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-23T20:30:52.690478] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T20:30:52.887059] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T20:30:53.002194] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-23T20:30:53.802221] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-23T20:30:54.602287] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-23T20:30:54.693020] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-23T20:30:54.730906] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T20:30:54.942265] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T20:30:55.402229] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-23T20:30:56.202234] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-23T20:30:56.515589] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T20:30:56.732539] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T20:30:57.002212] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-23T20:30:57.802365] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-23T20:30:57.896102] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T20:30:58.602206] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-23T20:30:58.771836] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T20:30:59.402173] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-23T20:30:59.863761] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-23T20:31:00.167344] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T20:31:00.202151] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-23T20:31:00.951457] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T20:31:01.002147] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-23T20:31:01.520717] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T20:31:01.527686] [INFO ] [REMOTE ] OII: Full fetch complete (62135 records). [2025-09-23T20:31:01.527810] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-23T20:31:01.807338] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-23T20:31:01.971089] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-23T20:31:01.971199] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-23T20:31:01.972128] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-23T20:31:01.972195] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-23T20:31:01.973942] [DEBUG] [LOCAL ] OII: Trimmed 62135 records to 42945 (keeping 200 days of data) [2025-09-23T20:31:02.252810] [DEBUG] [LOCAL ] OII: Primary data saved (42945 records). [2025-09-23T20:31:02.252970] [INFO ] [MAIN ] OII: Full history saved. [2025-09-23T20:31:02.253111] [INFO ] [MAIN ] Update Progress: 1588/2372 symbols completed. OII took 41.6s. Estimated remaining: 1h 44m 10s. Rate: 7.5 symbols/min [2025-09-23T20:31:02.431496] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:02.444395] [DEBUG] [LOCAL ] OLP: Loaded 9647 existing records from primary storage. [2025-09-23T20:31:02.444545] [INFO ] [MAIN ] OLP: Loaded 9647 existing records. [2025-09-23T20:31:02.604802] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-23T20:31:02.629359] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:02.630914] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-23T20:31:02.630991] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-23T20:31:02.631673] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-23T20:31:02.631739] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-23T20:31:03.028483] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-23T20:31:03.034218] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:03.402392] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-23T20:31:04.017366] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-23T20:31:04.202204] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-23T20:31:05.002178] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-23T20:31:05.222355] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-23T20:31:05.422710] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-23T20:31:05.641949] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T20:31:05.802144] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-23T20:31:05.905182] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T20:31:06.602226] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-23T20:31:07.402933] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-23T20:31:07.402851] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T20:31:08.149334] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T20:31:08.202190] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-23T20:31:09.002244] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-23T20:31:09.089531] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T20:31:09.802186] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-23T20:31:10.205006] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-09-23T20:31:10.607510] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-23T20:31:10.639228] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T20:31:11.402258] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-23T20:31:11.754152] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-23T20:31:11.763248] [INFO ] [REMOTE ] OKE: Full fetch complete (77484 records). [2025-09-23T20:31:11.763415] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-23T20:31:12.169508] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-23T20:31:12.169606] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-23T20:31:12.170637] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-23T20:31:12.170770] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-23T20:31:12.172412] [DEBUG] [LOCAL ] OKE: Trimmed 77484 records to 53536 (keeping 200 days of data) [2025-09-23T20:31:12.235007] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-23T20:31:12.518267] [DEBUG] [LOCAL ] OKE: Primary data saved (53536 records). [2025-09-23T20:31:12.518430] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-23T20:31:12.518534] [INFO ] [MAIN ] Update Progress: 1589/2372 symbols completed. OKE took 32.2s. Estimated remaining: 1h 44m 3s. Rate: 7.5 symbols/min [2025-09-23T20:31:12.691703] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:12.745841] [DEBUG] [LOCAL ] OMC: Loaded 53293 existing records from primary storage. [2025-09-23T20:31:12.746005] [INFO ] [MAIN ] OMC: Loaded 53293 existing records. [2025-09-23T20:31:12.937410] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:12.937759] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-23T20:31:12.937819] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-23T20:31:12.939005] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-23T20:31:12.939069] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-23T20:31:13.252359] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T20:31:13.311343] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-23T20:31:13.388016] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:13.390628] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-23T20:31:13.400254] [INFO ] [REMOTE ] OLN: Full fetch complete (74470 records). [2025-09-23T20:31:13.400531] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-23T20:31:13.674584] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (3.07 seconds). [2025-09-23T20:31:13.808005] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-23T20:31:13.858571] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-23T20:31:13.858672] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-23T20:31:13.859698] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-23T20:31:13.859761] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-23T20:31:13.861185] [DEBUG] [LOCAL ] OLN: Trimmed 74470 records to 51742 (keeping 200 days of data) [2025-09-23T20:31:14.188507] [DEBUG] [LOCAL ] OLN: Primary data saved (51742 records). [2025-09-23T20:31:14.188691] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-23T20:31:14.188797] [INFO ] [MAIN ] Update Progress: 1590/2372 symbols completed. OLN took 24.0s. Estimated remaining: 1h 43m 52s. Rate: 7.5 symbols/min [2025-09-23T20:31:14.355088] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T20:31:14.376550] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:14.419702] [DEBUG] [LOCAL ] OMF: Loaded 46269 existing records from primary storage. [2025-09-23T20:31:14.419847] [INFO ] [MAIN ] OMF: Loaded 46269 existing records. [2025-09-23T20:31:14.597129] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:14.597360] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-23T20:31:14.597408] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-23T20:31:14.598524] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-23T20:31:14.598584] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-23T20:31:14.609946] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-23T20:31:14.956977] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:15.402246] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-23T20:31:15.741325] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T20:31:15.743017] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T20:31:16.202217] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-23T20:31:17.002219] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-23T20:31:17.783585] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T20:31:17.788375] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T20:31:17.802137] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-23T20:31:18.025115] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-23T20:31:18.602204] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-23T20:31:19.309992] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T20:31:19.330455] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T20:31:19.402211] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-23T20:31:20.202215] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-23T20:31:21.002313] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-23T20:31:21.122036] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T20:31:21.802222] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-23T20:31:21.886777] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T20:31:22.602236] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-23T20:31:23.119601] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-09-23T20:31:23.304483] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T20:31:23.402156] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-23T20:31:23.544856] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T20:31:23.959915] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T20:31:23.962233] [INFO ] [REMOTE ] OLP: Full fetch complete (13963 records). [2025-09-23T20:31:23.962304] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-23T20:31:24.208713] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-23T20:31:24.334169] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-23T20:31:24.334250] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-23T20:31:24.334567] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-23T20:31:24.334606] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-23T20:31:24.335096] [DEBUG] [LOCAL ] OLP: Trimmed 13963 records to 9720 (keeping 200 days of data) [2025-09-23T20:31:24.396915] [DEBUG] [LOCAL ] OLP: Primary data saved (9720 records). [2025-09-23T20:31:24.397060] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-23T20:31:24.397147] [INFO ] [MAIN ] Update Progress: 1591/2372 symbols completed. OLP took 22.1s. Estimated remaining: 1h 43m 45s. Rate: 7.5 symbols/min [2025-09-23T20:31:24.576041] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:24.619041] [DEBUG] [LOCAL ] OMI: Loaded 45856 existing records from primary storage. [2025-09-23T20:31:24.619189] [INFO ] [MAIN ] OMI: Loaded 45856 existing records. [2025-09-23T20:31:24.793824] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:24.794082] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-23T20:31:24.794135] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-23T20:31:24.794992] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-23T20:31:24.795052] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-23T20:31:25.010740] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-23T20:31:25.145809] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:25.802209] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-23T20:31:25.929630] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T20:31:26.487027] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T20:31:26.602199] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-23T20:31:27.402242] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-23T20:31:28.202273] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-23T20:31:28.324230] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T20:31:28.417768] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-23T20:31:28.848952] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T20:31:29.002187] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-23T20:31:29.802224] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-23T20:31:30.026420] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T20:31:30.499282] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T20:31:30.602166] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-23T20:31:31.275387] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T20:31:31.402143] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-23T20:31:32.202228] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-23T20:31:32.480319] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T20:31:32.889323] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T20:31:32.898249] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-09-23T20:31:32.898391] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-23T20:31:32.899172] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:31:32.899282] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:31:32.899376] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:31:32.899472] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-23T20:31:32.899555] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-23T20:31:32.899609] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-23T20:31:32.900206] [DEBUG] [LOCAL ] OKLO: Deleted derivative data file. [2025-09-23T20:31:32.900316] [INFO ] [MAIN ] Update Progress: 1592/2372 symbols completed. OKLO took 48.0s. Estimated remaining: 1h 43m 37s. Rate: 7.5 symbols/min [2025-09-23T20:31:33.004868] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-23T20:31:33.082491] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:33.112678] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T20:31:33.126137] [DEBUG] [LOCAL ] ONIT: Loaded 7805 existing records from primary storage. [2025-09-23T20:31:33.126249] [INFO ] [MAIN ] ONIT: Loaded 7805 existing records. [2025-09-23T20:31:33.362898] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:33.363169] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-23T20:31:33.363227] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-23T20:31:33.363637] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-23T20:31:33.363736] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-23T20:31:33.727317] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:33.802193] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-23T20:31:34.602188] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-23T20:31:34.901926] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T20:31:35.109381] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-23T20:31:35.402225] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-23T20:31:35.569715] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T20:31:36.142357] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T20:31:36.202221] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-23T20:31:37.002250] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-23T20:31:37.013411] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T20:31:37.802217] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-23T20:31:38.602185] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-23T20:31:38.786306] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T20:31:39.402222] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-23T20:31:39.715185] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T20:31:39.899536] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T20:31:39.969800] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T20:31:40.202195] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-23T20:31:41.002213] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-23T20:31:41.802210] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-23T20:31:41.865304] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T20:31:41.886550] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T20:31:42.602232] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-23T20:31:43.048765] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T20:31:43.402180] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-23T20:31:43.410060] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T20:31:44.202218] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-23T20:31:45.002218] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-23T20:31:45.207899] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T20:31:45.774930] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T20:31:45.802145] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-23T20:31:46.078633] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T20:31:46.304086] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T20:31:46.602196] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-23T20:31:47.402191] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-23T20:31:48.202447] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-23T20:31:48.224058] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T20:31:48.335619] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T20:31:49.002219] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-23T20:31:49.802171] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-23T20:31:49.929189] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T20:31:50.415859] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T20:31:50.424902] [INFO ] [REMOTE ] OMC: Full fetch complete (76814 records). [2025-09-23T20:31:50.425043] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-23T20:31:50.602592] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-23T20:31:50.822087] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-23T20:31:50.822168] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-23T20:31:50.823172] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-23T20:31:50.823236] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-23T20:31:50.824681] [DEBUG] [LOCAL ] OMC: Trimmed 76814 records to 53294 (keeping 200 days of data) [2025-09-23T20:31:51.159757] [DEBUG] [LOCAL ] OMC: Primary data saved (53294 records). [2025-09-23T20:31:51.159903] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-23T20:31:51.159989] [INFO ] [MAIN ] Update Progress: 1593/2372 symbols completed. OMC took 38.6s. Estimated remaining: 1h 43m 34s. Rate: 7.5 symbols/min [2025-09-23T20:31:51.332605] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:51.363514] [DEBUG] [LOCAL ] ONL: Loaded 32082 existing records from primary storage. [2025-09-23T20:31:51.363662] [INFO ] [MAIN ] ONL: Loaded 32082 existing records. [2025-09-23T20:31:51.406843] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-23T20:31:51.548961] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:51.549266] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-23T20:31:51.549382] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-23T20:31:51.558363] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-23T20:31:51.573092] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-23T20:31:51.668314] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T20:31:51.976356] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:52.202191] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-23T20:31:52.251499] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T20:31:52.254123] [INFO ] [REMOTE ] ONIT: Full fetch complete (11276 records). [2025-09-23T20:31:52.254282] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-23T20:31:52.448027] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T20:31:52.573964] [INFO ] [REMOTE ] OMF: Full fetch complete (66583 records). [2025-09-23T20:31:52.593193] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-23T20:31:52.791797] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-23T20:31:52.797541] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-23T20:31:52.808331] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-23T20:31:52.823935] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-23T20:31:52.865708] [DEBUG] [LOCAL ] ONIT: Trimmed 11276 records to 7783 (keeping 200 days of data) [2025-09-23T20:31:53.007199] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-23T20:31:53.121635] [DEBUG] [LOCAL ] ONIT: Primary data saved (7783 records). [2025-09-23T20:31:53.142822] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-23T20:31:53.159062] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-23T20:31:53.159212] [INFO ] [MAIN ] Update Progress: 1594/2372 symbols completed. ONIT took 20.3s. Estimated remaining: 1h 43m 23s. Rate: 7.5 symbols/min [2025-09-23T20:31:53.159540] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-23T20:31:53.160624] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-23T20:31:53.160755] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-23T20:31:53.272570] [DEBUG] [LOCAL ] OMF: Trimmed 66583 records to 46272 (keeping 200 days of data) [2025-09-23T20:31:53.402726] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:53.680038] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-09-23T20:31:53.684764] [INFO ] [MAIN ] ONON: Loaded 53613 existing records. [2025-09-23T20:31:53.690806] [DEBUG] [LOCAL ] OMF: Primary data saved (46272 records). [2025-09-23T20:31:53.726617] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-23T20:31:53.763391] [INFO ] [MAIN ] Update Progress: 1595/2372 symbols completed. OMF took 39.6s. Estimated remaining: 1h 43m 12s. Rate: 7.5 symbols/min [2025-09-23T20:31:54.006732] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:54.012256] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-23T20:31:54.012413] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-23T20:31:54.038924] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-23T20:31:54.062615] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-23T20:31:54.093058] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:54.275484] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-23T20:31:54.365690] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-23T20:31:54.373667] [DEBUG] [LOCAL ] ONTF: Loaded 23020 existing records from primary storage. [2025-09-23T20:31:54.392670] [INFO ] [MAIN ] ONTF: Loaded 23020 existing records. [2025-09-23T20:31:54.431185] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T20:31:54.604692] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-23T20:31:54.769278] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:54.769450] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:54.770104] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-23T20:31:54.770157] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-23T20:31:54.770785] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-23T20:31:54.770847] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-23T20:31:55.135795] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:55.402223] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-23T20:31:55.997777] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T20:31:56.062498] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T20:31:56.070984] [INFO ] [REMOTE ] OMI: Full fetch complete (63750 records). [2025-09-23T20:31:56.071105] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-23T20:31:56.219170] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-23T20:31:56.321838] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T20:31:56.492710] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-23T20:31:56.492801] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-23T20:31:56.493899] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-23T20:31:56.493985] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-23T20:31:56.495419] [DEBUG] [LOCAL ] OMI: Trimmed 63750 records to 45856 (keeping 200 days of data) [2025-09-23T20:31:56.748023] [DEBUG] [LOCAL ] OMI: Primary data saved (45856 records). [2025-09-23T20:31:56.748155] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-23T20:31:56.748243] [INFO ] [MAIN ] Update Progress: 1596/2372 symbols completed. OMI took 32.4s. Estimated remaining: 1h 43m 2s. Rate: 7.5 symbols/min [2025-09-23T20:31:56.918001] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:31:56.961265] [DEBUG] [LOCAL ] ONTO: Loaded 46581 existing records from primary storage. [2025-09-23T20:31:56.961406] [INFO ] [MAIN ] ONTO: Loaded 46581 existing records. [2025-09-23T20:31:57.007400] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-23T20:31:57.143166] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:31:57.143425] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-23T20:31:57.143473] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-23T20:31:57.144899] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-23T20:31:57.144960] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-23T20:31:57.503737] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:31:57.802251] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-23T20:31:58.168686] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T20:31:58.434344] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-23T20:31:58.602223] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-23T20:31:59.168986] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T20:31:59.239191] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T20:31:59.402214] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-23T20:32:00.202283] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-23T20:32:00.387534] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T20:32:01.002266] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-23T20:32:01.782695] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T20:32:01.802157] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-23T20:32:02.602182] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-23T20:32:03.160236] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-23T20:32:03.214093] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T20:32:03.402264] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-23T20:32:03.478792] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T20:32:04.202197] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-23T20:32:04.885821] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T20:32:05.002165] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-23T20:32:05.454969] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T20:32:05.802189] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-23T20:32:06.473126] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T20:32:06.602162] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-23T20:32:06.965422] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T20:32:07.402245] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-23T20:32:07.950183] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T20:32:08.202192] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-23T20:32:09.002192] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-23T20:32:09.279265] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T20:32:09.439794] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T20:32:09.802179] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-23T20:32:10.276951] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T20:32:10.602211] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-23T20:32:11.402156] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-23T20:32:11.837525] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T20:32:11.840133] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-23T20:32:11.859434] [INFO ] [REMOTE ] ONL: Full fetch complete (43648 records). [2025-09-23T20:32:11.859627] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-23T20:32:12.212622] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-23T20:32:12.261063] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-23T20:32:12.261134] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-23T20:32:12.262233] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-23T20:32:12.262298] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-23T20:32:12.263400] [DEBUG] [LOCAL ] ONL: Trimmed 43648 records to 31829 (keeping 200 days of data) [2025-09-23T20:32:12.457195] [DEBUG] [LOCAL ] ONL: Primary data saved (31829 records). [2025-09-23T20:32:12.457339] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-23T20:32:12.457428] [INFO ] [MAIN ] Update Progress: 1597/2372 symbols completed. ONL took 21.3s. Estimated remaining: 1h 42m 57s. Rate: 7.5 symbols/min [2025-09-23T20:32:12.618376] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T20:32:13.002194] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-23T20:32:13.802169] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-23T20:32:14.027063] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T20:32:14.105112] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T20:32:14.602204] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-23T20:32:15.402227] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-23T20:32:15.688761] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T20:32:15.693758] [INFO ] [REMOTE ] ONTF: Full fetch complete (31924 records). [2025-09-23T20:32:15.693895] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-23T20:32:16.094814] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-23T20:32:16.094921] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-23T20:32:16.095758] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-23T20:32:16.095824] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-23T20:32:16.096768] [DEBUG] [LOCAL ] ONTF: Trimmed 31924 records to 23025 (keeping 200 days of data) [2025-09-23T20:32:16.209433] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-23T20:32:16.225077] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-23T20:32:16.270433] [DEBUG] [LOCAL ] ONTF: Primary data saved (23025 records). [2025-09-23T20:32:16.270566] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-23T20:32:16.270670] [INFO ] [MAIN ] Update Progress: 1598/2372 symbols completed. ONTF took 22.5s. Estimated remaining: 1h 42m 47s. Rate: 7.5 symbols/min [2025-09-23T20:32:17.087270] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T20:32:17.097000] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-23T20:32:18.143204] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-23T20:32:18.155368] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-23T20:32:18.526187] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T20:32:18.602242] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-23T20:32:20.401616] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T20:32:20.414475] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-23T20:32:20.451858] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-23T20:32:20.463806] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-23T20:32:22.225214] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T20:32:22.236102] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-23T20:32:22.510215] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T20:32:22.523395] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-23T20:32:24.059332] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T20:32:24.070813] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-23T20:32:24.603463] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T20:32:24.616366] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-23T20:32:25.861983] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T20:32:25.872430] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-23T20:32:26.771319] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-23T20:32:26.783624] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-23T20:32:27.631705] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T20:32:27.641393] [INFO ] [REMOTE ] ONTO: Full fetch complete (65550 records). [2025-09-23T20:32:27.641584] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-23T20:32:28.072364] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-23T20:32:28.072453] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-23T20:32:28.073375] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-23T20:32:28.073440] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-23T20:32:28.074842] [DEBUG] [LOCAL ] ONTO: Trimmed 65550 records to 46626 (keeping 200 days of data) [2025-09-23T20:32:28.365891] [DEBUG] [LOCAL ] ONTO: Primary data saved (46626 records). [2025-09-23T20:32:28.366157] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-23T20:32:28.366256] [INFO ] [MAIN ] Update Progress: 1599/2372 symbols completed. ONTO took 31.6s. Estimated remaining: 1h 42m 41s. Rate: 7.5 symbols/min [2025-09-23T20:32:28.795344] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-23T20:32:28.804556] [INFO ] [REMOTE ] ONON: Full fetch complete (77560 records). [2025-09-23T20:32:28.804761] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-23T20:32:29.229094] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-23T20:32:29.229229] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-23T20:32:29.230328] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-23T20:32:29.230397] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-23T20:32:29.232040] [DEBUG] [LOCAL ] ONON: Trimmed 77560 records to 53613 (keeping 200 days of data) [2025-09-23T20:32:29.577177] [DEBUG] [LOCAL ] ONON: Primary data saved (53613 records). [2025-09-23T20:32:29.577335] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-23T20:32:29.577423] [INFO ] [MAIN ] Update Progress: 1600/2372 symbols completed. ONON took 36.4s. Estimated remaining: 1h 42m 30s. Rate: 7.5 symbols/min [2025-09-23T20:32:30.274863] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:32:30.320023] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:32:30.317457] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:32:30.319055] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:32:30.341350] [DEBUG] [LOCAL ] OPP: Loaded 11679 existing records from primary storage. [2025-09-23T20:32:30.341494] [INFO ] [MAIN ] OPP: Loaded 11679 existing records. [2025-09-23T20:32:30.387946] [DEBUG] [LOCAL ] OOMA: Loaded 19185 existing records from primary storage. [2025-09-23T20:32:30.409413] [INFO ] [MAIN ] OOMA: Loaded 19185 existing records. [2025-09-23T20:32:30.455548] [DEBUG] [LOCAL ] OPAD: Loaded 19413 existing records from primary storage. [2025-09-23T20:32:30.461378] [INFO ] [MAIN ] OPAD: Loaded 19413 existing records. [2025-09-23T20:32:30.757196] [DEBUG] [LOCAL ] OPFI: Loaded 46680 existing records from primary storage. [2025-09-23T20:32:30.773231] [INFO ] [MAIN ] OPFI: Loaded 46680 existing records. [2025-09-23T20:32:31.054430] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:32:31.068208] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-23T20:32:31.068338] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:32:30.994613] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:32:31.087089] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-23T20:32:31.091391] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-23T20:32:31.097046] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-23T20:32:31.107529] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-23T20:32:31.097175] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-23T20:32:31.112879] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-23T20:32:31.118073] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-23T20:32:31.157192] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-23T20:32:31.183165] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-23T20:32:31.150891] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-23T20:32:31.244732] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-23T20:32:31.318759] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:32:31.456848] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-23T20:32:31.462154] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-23T20:32:31.558130] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-23T20:32:31.641438] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-23T20:32:32.418594] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:32:32.422606] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:32:32.488303] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-23T20:32:32.460763] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-23T20:32:32.687478] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:32:32.688120] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-23T20:32:32.772886] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:32:32.773214] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-23T20:32:33.407077] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T20:32:33.409367] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-23T20:32:33.656579] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T20:32:33.661144] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-23T20:32:33.906428] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T20:32:33.908610] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-23T20:32:33.996087] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T20:32:34.000480] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-23T20:32:34.253320] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T20:32:34.261569] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-23T20:32:34.272812] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T20:32:34.276730] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-23T20:32:34.546125] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T20:32:34.548140] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-23T20:32:34.698546] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T20:32:34.701794] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-23T20:32:35.270604] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T20:32:35.297097] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T20:32:35.308637] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T20:32:35.402191] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-23T20:32:35.982405] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T20:32:36.202167] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-23T20:32:36.246857] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T20:32:37.002213] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-23T20:32:37.191283] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T20:32:37.634680] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T20:32:37.802219] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-23T20:32:38.602221] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-23T20:32:39.063555] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T20:32:39.402239] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-23T20:32:40.202201] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-23T20:32:40.233136] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T20:32:40.478594] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T20:32:41.002219] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-23T20:32:41.044164] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T20:32:41.650908] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T20:32:41.802235] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-23T20:32:42.498024] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T20:32:42.602208] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-23T20:32:43.402191] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-23T20:32:43.953494] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T20:32:44.202195] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-23T20:32:45.007346] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-23T20:32:45.027855] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T20:32:45.252866] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T20:32:45.802265] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-23T20:32:45.914891] [DEBUG] [REMOTE ] OPP: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-23T20:32:45.915241] [WARN ] [REMOTE ] OPP: No data returned for month 2025-08 [2025-09-23T20:32:46.602213] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-23T20:32:46.882101] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T20:32:47.402206] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-23T20:32:48.202179] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-23T20:32:48.328914] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T20:32:48.511985] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T20:32:49.002209] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-23T20:32:49.802183] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-23T20:32:49.832834] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T20:32:49.835264] [INFO ] [REMOTE ] OPP: Full fetch complete (15855 records). [2025-09-23T20:32:49.835372] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-23T20:32:50.023460] [WARN ] [VALIDATOR ] OPP: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T20:32:50.023853] [FATAL] [MAIN ] OPP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:32:50.023940] [WARN ] [MAIN ] OPP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:32:50.024026] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-23T20:32:50.024149] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-09-23T20:32:50.024221] [INFO ] [LOCAL ] OPP: Starting deletion of derivative data. [2025-09-23T20:32:50.024833] [DEBUG] [LOCAL ] OPP: Deleted derivative data file. [2025-09-23T20:32:50.024933] [INFO ] [MAIN ] Update Progress: 1601/2372 symbols completed. OPP took 20.4s. Estimated remaining: 1h 42m 28s. Rate: 7.5 symbols/min [2025-09-23T20:32:50.208205] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:32:50.208566] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-23T20:32:50.208716] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-23T20:32:50.208860] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-23T20:32:50.208905] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-23T20:32:50.208948] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-23T20:32:50.208982] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-23T20:32:50.587932] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:32:50.599696] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T20:32:50.604023] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-23T20:32:50.628822] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-23T20:32:50.637889] [INFO ] [REMOTE ] OPAD: Full fetch complete (22858 records). [2025-09-23T20:32:50.637985] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-23T20:32:51.012513] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-23T20:32:51.012600] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-23T20:32:51.013150] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-23T20:32:51.013211] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-23T20:32:51.013903] [DEBUG] [LOCAL ] OPAD: Trimmed 22858 records to 19745 (keeping 200 days of data) [2025-09-23T20:32:51.127120] [DEBUG] [LOCAL ] OPAD: Primary data saved (19745 records). [2025-09-23T20:32:51.127266] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-23T20:32:51.127354] [INFO ] [MAIN ] Update Progress: 1602/2372 symbols completed. OPAD took 21.5s. Estimated remaining: 1h 42m 17s. Rate: 7.5 symbols/min [2025-09-23T20:32:51.299075] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:32:51.342880] [DEBUG] [LOCAL ] OR: Loaded 45994 existing records from primary storage. [2025-09-23T20:32:51.343023] [INFO ] [MAIN ] OR: Loaded 45994 existing records. [2025-09-23T20:32:51.407318] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-23T20:32:51.547239] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:32:51.552669] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T20:32:51.554691] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-23T20:32:51.554754] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-23T20:32:51.556092] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-23T20:32:51.556154] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-23T20:32:51.954691] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:32:52.202217] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-23T20:32:53.002228] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-23T20:32:53.242932] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T20:32:53.654282] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T20:32:53.712435] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T20:32:53.802177] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-23T20:32:54.602194] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-23T20:32:55.312379] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T20:32:55.339392] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T20:32:55.402224] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-23T20:32:56.165322] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T20:32:56.202237] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-23T20:32:57.002237] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-23T20:32:57.033273] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T20:32:57.802212] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-23T20:32:58.127320] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T20:32:58.359571] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T20:32:58.602210] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-23T20:32:59.402207] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-23T20:33:00.179664] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T20:33:00.202193] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-23T20:33:01.002266] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-23T20:33:01.177070] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T20:33:01.223855] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-23T20:33:01.802231] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-23T20:33:02.602235] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-23T20:33:03.402207] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-23T20:33:03.483883] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-23T20:33:04.162551] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T20:33:04.202217] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-23T20:33:04.234933] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-23T20:33:05.002210] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-23T20:33:05.169114] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T20:33:05.622385] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T20:33:05.802243] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-23T20:33:05.865868] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T20:33:06.436517] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T20:33:06.439008] [INFO ] [REMOTE ] OPY: Full fetch complete (10050 records). [2025-09-23T20:33:06.439099] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-23T20:33:06.612821] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-23T20:33:06.639335] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T20:33:06.641963] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:33:06.642048] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:33:06.642128] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-23T20:33:06.642262] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-23T20:33:06.642323] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-23T20:33:06.642369] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-23T20:33:06.642460] [INFO ] [MAIN ] Update Progress: 1603/2372 symbols completed. OPY took 16.6s. Estimated remaining: 1h 42m 13s. Rate: 7.5 symbols/min [2025-09-23T20:33:06.817753] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:06.861560] [DEBUG] [LOCAL ] ORA: Loaded 32632 existing records from primary storage. [2025-09-23T20:33:06.861735] [INFO ] [MAIN ] ORA: Loaded 32632 existing records. [2025-09-23T20:33:07.037202] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:33:07.037437] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-23T20:33:07.037484] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-23T20:33:07.038910] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-23T20:33:07.038973] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-23T20:33:07.388988] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:07.402139] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-23T20:33:08.202146] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-23T20:33:08.540965] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-23T20:33:08.703259] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T20:33:09.002218] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-23T20:33:09.688913] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T20:33:09.802177] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-23T20:33:10.056450] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T20:33:10.060573] [INFO ] [REMOTE ] OOMA: Full fetch complete (26474 records). [2025-09-23T20:33:10.060719] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-23T20:33:10.436663] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-23T20:33:10.436759] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-23T20:33:10.437416] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-23T20:33:10.437513] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-23T20:33:10.438569] [DEBUG] [LOCAL ] OOMA: Trimmed 26474 records to 19147 (keeping 200 days of data) [2025-09-23T20:33:10.574505] [DEBUG] [LOCAL ] OOMA: Primary data saved (19147 records). [2025-09-23T20:33:10.574780] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-23T20:33:10.575010] [INFO ] [MAIN ] Update Progress: 1604/2372 symbols completed. OOMA took 41.0s. Estimated remaining: 1h 42m 3s. Rate: 7.5 symbols/min [2025-09-23T20:33:10.610116] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-23T20:33:10.768221] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:10.840333] [DEBUG] [LOCAL ] ORC: Loaded 52290 existing records from primary storage. [2025-09-23T20:33:10.840529] [INFO ] [MAIN ] ORC: Loaded 52290 existing records. [2025-09-23T20:33:11.022099] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:33:11.022493] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-23T20:33:11.022674] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-23T20:33:11.024012] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-23T20:33:11.024091] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-23T20:33:11.347706] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T20:33:11.410245] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-23T20:33:11.450350] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:11.972162] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T20:33:12.202201] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-23T20:33:13.002237] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-23T20:33:13.122992] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T20:33:13.130971] [INFO ] [REMOTE ] OPFI: Full fetch complete (67405 records). [2025-09-23T20:33:13.131141] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-23T20:33:13.521674] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-23T20:33:13.521766] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-23T20:33:13.522706] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-23T20:33:13.522769] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-23T20:33:13.526846] [DEBUG] [LOCAL ] OPFI: Trimmed 67405 records to 46651 (keeping 200 days of data) [2025-09-23T20:33:13.764196] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T20:33:13.815874] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-23T20:33:13.841007] [DEBUG] [LOCAL ] OPFI: Primary data saved (46651 records). [2025-09-23T20:33:13.841160] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-23T20:33:13.841357] [INFO ] [MAIN ] Update Progress: 1605/2372 symbols completed. OPFI took 44.3s. Estimated remaining: 1h 41m 52s. Rate: 7.5 symbols/min [2025-09-23T20:33:14.022465] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:14.022742] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-23T20:33:14.022805] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-23T20:33:14.022956] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-23T20:33:14.023012] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-23T20:33:14.023081] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-23T20:33:14.023117] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-23T20:33:14.393990] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:14.602178] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-23T20:33:14.962247] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-23T20:33:15.402288] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-23T20:33:15.931275] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-23T20:33:16.202205] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-23T20:33:17.002201] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-23T20:33:17.127768] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-23T20:33:17.802174] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-23T20:33:18.201749] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T20:33:18.602225] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-23T20:33:19.456543] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (4.05 seconds). [2025-09-23T20:33:19.468625] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-23T20:33:19.578569] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T20:33:20.002719] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T20:33:20.202213] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-23T20:33:20.465762] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-09-23T20:33:21.002200] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-23T20:33:21.802253] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-23T20:33:21.948063] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T20:33:22.001944] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-23T20:33:22.602173] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-23T20:33:23.348533] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-23T20:33:23.402144] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-23T20:33:24.136590] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-23T20:33:24.202186] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-23T20:33:25.002273] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-23T20:33:25.355131] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-23T20:33:25.530175] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-23T20:33:25.802187] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-23T20:33:25.897739] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T20:33:25.908354] [INFO ] [REMOTE ] OR: Full fetch complete (64925 records). [2025-09-23T20:33:25.908515] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-23T20:33:26.308345] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-23T20:33:26.308440] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-23T20:33:26.309547] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-23T20:33:26.309618] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-23T20:33:26.311104] [DEBUG] [LOCAL ] OR: Trimmed 64925 records to 45995 (keeping 200 days of data) [2025-09-23T20:33:26.575513] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T20:33:26.607423] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-23T20:33:26.629478] [DEBUG] [LOCAL ] OR: Primary data saved (45995 records). [2025-09-23T20:33:26.629624] [INFO ] [MAIN ] OR: Full history saved. [2025-09-23T20:33:26.629759] [INFO ] [MAIN ] Update Progress: 1606/2372 symbols completed. OR took 35.5s. Estimated remaining: 1h 41m 47s. Rate: 7.5 symbols/min [2025-09-23T20:33:26.809220] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:26.809423] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-23T20:33:26.809478] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-23T20:33:26.809742] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-23T20:33:26.809813] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-23T20:33:26.809897] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-23T20:33:26.809972] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-23T20:33:27.170918] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:27.402208] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-23T20:33:28.180562] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-23T20:33:28.202140] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-23T20:33:28.967145] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T20:33:29.002145] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-23T20:33:29.089007] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-23T20:33:29.802167] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-23T20:33:29.881862] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T20:33:30.398864] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T20:33:30.407522] [INFO ] [REMOTE ] ORA: Full fetch complete (49343 records). [2025-09-23T20:33:30.407684] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-23T20:33:30.607319] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-23T20:33:30.824990] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-23T20:33:30.825084] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-23T20:33:30.826006] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-23T20:33:30.826070] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-23T20:33:30.829022] [DEBUG] [LOCAL ] ORA: Trimmed 49343 records to 32612 (keeping 200 days of data) [2025-09-23T20:33:31.059118] [DEBUG] [LOCAL ] ORA: Primary data saved (32612 records). [2025-09-23T20:33:31.059297] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-23T20:33:31.059482] [INFO ] [MAIN ] Update Progress: 1607/2372 symbols completed. ORA took 24.4s. Estimated remaining: 1h 41m 37s. Rate: 7.5 symbols/min [2025-09-23T20:33:31.264944] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:31.305842] [DEBUG] [LOCAL ] ORN: Loaded 31755 existing records from primary storage. [2025-09-23T20:33:31.306709] [INFO ] [MAIN ] ORN: Loaded 31755 existing records. [2025-09-23T20:33:31.411952] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-23T20:33:31.499249] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:33:31.499622] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-23T20:33:31.499707] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-23T20:33:31.501071] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-23T20:33:31.501137] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-23T20:33:31.889290] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:32.202259] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-23T20:33:32.384976] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-23T20:33:32.619029] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-23T20:33:33.002181] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-23T20:33:33.176421] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T20:33:33.249393] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T20:33:33.802251] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-23T20:33:34.602240] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-23T20:33:35.203636] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-23T20:33:35.402240] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-23T20:33:35.651158] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T20:33:35.730327] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T20:33:36.202197] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-23T20:33:37.002235] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-23T20:33:37.533981] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T20:33:37.802187] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-23T20:33:37.956095] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-23T20:33:38.408094] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T20:33:38.602190] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-23T20:33:38.985157] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T20:33:39.402282] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-23T20:33:40.202214] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-23T20:33:40.319215] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T20:33:41.002237] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-23T20:33:41.802243] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-23T20:33:42.042030] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-23T20:33:42.086823] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T20:33:42.409370] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T20:33:42.602242] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-23T20:33:43.402252] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-23T20:33:44.081008] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-23T20:33:44.202235] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-23T20:33:44.533614] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T20:33:45.002229] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-23T20:33:45.802267] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-23T20:33:46.278719] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T20:33:46.288297] [INFO ] [REMOTE ] ORC: Full fetch complete (75130 records). [2025-09-23T20:33:46.288452] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-23T20:33:46.693913] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (4.09 seconds). [2025-09-23T20:33:46.772621] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-23T20:33:46.772827] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-23T20:33:46.774025] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-23T20:33:46.774206] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-23T20:33:46.776586] [DEBUG] [LOCAL ] ORC: Trimmed 75130 records to 52307 (keeping 200 days of data) [2025-09-23T20:33:46.776460] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-23T20:33:46.913761] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-23T20:33:47.078301] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T20:33:47.183281] [DEBUG] [LOCAL ] ORC: Primary data saved (52307 records). [2025-09-23T20:33:47.183440] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-23T20:33:47.183531] [INFO ] [MAIN ] Update Progress: 1608/2372 symbols completed. ORC took 36.6s. Estimated remaining: 1h 41m 33s. Rate: 7.5 symbols/min [2025-09-23T20:33:47.354052] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:47.408469] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-23T20:33:47.411452] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-23T20:33:47.411723] [INFO ] [MAIN ] OSCR: Loaded 53722 existing records. [2025-09-23T20:33:47.594419] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:33:47.594728] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-23T20:33:47.594795] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-23T20:33:47.596365] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-23T20:33:47.596425] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-23T20:33:47.945208] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:48.202232] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-23T20:33:49.002207] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-23T20:33:49.398967] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-23T20:33:49.551331] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-23T20:33:49.686964] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T20:33:49.802197] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-23T20:33:50.602163] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-23T20:33:51.110885] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-23T20:33:51.261995] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T20:33:51.354823] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T20:33:51.363769] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-09-23T20:33:51.364038] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-23T20:33:51.367356] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:33:51.367472] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:33:51.367530] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:33:51.367601] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-23T20:33:51.367722] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-23T20:33:51.367792] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-23T20:33:51.367861] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-23T20:33:51.367937] [INFO ] [MAIN ] Update Progress: 1609/2372 symbols completed. ORCL took 37.5s. Estimated remaining: 1h 41m 23s. Rate: 7.5 symbols/min [2025-09-23T20:33:51.407362] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-23T20:33:51.564604] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:51.564849] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-23T20:33:51.564896] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-23T20:33:51.565043] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-23T20:33:51.565088] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-23T20:33:51.565130] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-23T20:33:51.565163] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-23T20:33:51.941766] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:52.202201] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-23T20:33:53.002174] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-23T20:33:53.480183] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-23T20:33:53.802158] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-23T20:33:53.906465] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T20:33:54.602169] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-23T20:33:55.039062] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T20:33:55.402156] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-23T20:33:55.754053] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T20:33:55.792485] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T20:33:55.798047] [INFO ] [REMOTE ] ORN: Full fetch complete (45752 records). [2025-09-23T20:33:55.798139] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-23T20:33:56.188019] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-23T20:33:56.188120] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-23T20:33:56.188929] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-23T20:33:56.189007] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-23T20:33:56.190203] [DEBUG] [LOCAL ] ORN: Trimmed 45752 records to 31707 (keeping 200 days of data) [2025-09-23T20:33:56.235463] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-23T20:33:56.372342] [DEBUG] [LOCAL ] ORN: Primary data saved (31707 records). [2025-09-23T20:33:56.372477] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-23T20:33:56.372619] [INFO ] [MAIN ] Update Progress: 1610/2372 symbols completed. ORN took 25.3s. Estimated remaining: 1h 41m 14s. Rate: 7.5 symbols/min [2025-09-23T20:33:56.548125] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:56.548333] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-23T20:33:56.548388] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-23T20:33:56.548564] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-23T20:33:56.548632] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-23T20:33:56.548744] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-23T20:33:56.548819] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-23T20:33:56.934481] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:56.959547] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T20:33:57.002156] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-23T20:33:57.802234] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-23T20:33:58.061368] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:33:58.061703] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-23T20:33:58.480626] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-23T20:33:58.602155] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-23T20:33:58.682994] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T20:33:58.691036] [INFO ] [REMOTE ] ORI: Full fetch complete (70125 records). [2025-09-23T20:33:58.691150] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-23T20:33:58.886605] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T20:33:58.887391] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:33:58.887468] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:33:58.887544] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-23T20:33:58.887678] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-23T20:33:58.887761] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-23T20:33:58.887862] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-23T20:33:58.887938] [INFO ] [MAIN ] Update Progress: 1611/2372 symbols completed. ORI took 32.3s. Estimated remaining: 1h 41m 3s. Rate: 7.5 symbols/min [2025-09-23T20:33:59.055031] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:33:59.111527] [DEBUG] [LOCAL ] OTIS: Loaded 52715 existing records from primary storage. [2025-09-23T20:33:59.111695] [INFO ] [MAIN ] OTIS: Loaded 52715 existing records. [2025-09-23T20:33:59.291309] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:33:59.291613] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-23T20:33:59.291717] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-23T20:33:59.293378] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-23T20:33:59.293443] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-23T20:33:59.407293] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-23T20:33:59.652744] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:33:59.701306] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:33:59.701619] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-23T20:34:00.202200] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-23T20:34:00.478207] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:34:00.478539] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-23T20:34:00.685507] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-23T20:34:01.002198] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-23T20:34:01.263716] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:34:01.264046] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-23T20:34:01.802221] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-23T20:34:02.602213] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-23T20:34:02.875429] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:34:02.875795] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-23T20:34:03.402169] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-23T20:34:03.436197] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T20:34:04.202253] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-23T20:34:04.465476] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:34:04.465907] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-23T20:34:05.002206] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-23T20:34:05.802191] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-23T20:34:05.878243] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-23T20:34:06.602185] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-23T20:34:06.795407] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T20:34:06.809314] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T20:34:07.402259] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-23T20:34:08.202251] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-23T20:34:08.432699] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T20:34:09.002192] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-23T20:34:09.566699] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-23T20:34:09.704966] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T20:34:09.802159] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-23T20:34:10.602198] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-23T20:34:10.837832] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T20:34:11.402203] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-23T20:34:12.063824] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T20:34:12.207466] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-23T20:34:12.214027] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-23T20:34:13.002220] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-23T20:34:13.236057] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T20:34:13.577346] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T20:34:13.802221] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-23T20:34:13.856847] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T20:34:14.602260] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-23T20:34:15.402201] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-23T20:34:16.202258] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-23T20:34:16.379368] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T20:34:16.530819] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-23T20:34:16.815372] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-23T20:34:17.002202] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-23T20:34:17.456433] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T20:34:17.802206] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-23T20:34:18.602198] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-23T20:34:19.014479] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-23T20:34:19.402239] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-23T20:34:20.046827] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-23T20:34:20.056001] [INFO ] [REMOTE ] OSCR: Full fetch complete (77478 records). [2025-09-23T20:34:20.056138] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-23T20:34:20.206822] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-23T20:34:20.461558] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-23T20:34:20.461786] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-23T20:34:20.463090] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-23T20:34:20.463300] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-23T20:34:20.488496] [DEBUG] [LOCAL ] OSCR: Trimmed 77478 records to 53722 (keeping 200 days of data) [2025-09-23T20:34:20.505388] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T20:34:20.554029] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T20:34:20.607065] [INFO ] [REMOTE ] OTF: Full fetch complete (8384 records). [2025-09-23T20:34:20.608878] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-23T20:34:20.808590] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-23T20:34:20.809374] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:34:20.810092] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:34:20.810734] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-23T20:34:20.811420] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-23T20:34:20.811779] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-23T20:34:20.812840] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-23T20:34:20.812932] [INFO ] [MAIN ] Update Progress: 1612/2372 symbols completed. OTF took 24.4s. Estimated remaining: 1h 41m 2s. Rate: 7.5 symbols/min [2025-09-23T20:34:21.009430] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:34:21.004804] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-23T20:34:21.152575] [DEBUG] [LOCAL ] OUT: Loaded 48126 existing records from primary storage. [2025-09-23T20:34:21.153287] [INFO ] [MAIN ] OUT: Loaded 48126 existing records. [2025-09-23T20:34:21.350059] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:34:21.352456] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-23T20:34:21.352917] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-23T20:34:21.355469] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-23T20:34:21.356086] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-23T20:34:21.847105] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:34:21.848173] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-23T20:34:21.866033] [DEBUG] [LOCAL ] OSCR: Primary data saved (53722 records). [2025-09-23T20:34:21.866296] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-23T20:34:21.866427] [INFO ] [MAIN ] Update Progress: 1613/2372 symbols completed. OSCR took 34.7s. Estimated remaining: 1h 40m 51s. Rate: 7.5 symbols/min [2025-09-23T20:34:22.047629] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:34:22.103707] [DEBUG] [LOCAL ] OVV: Loaded 53516 existing records from primary storage. [2025-09-23T20:34:22.104040] [INFO ] [MAIN ] OVV: Loaded 53516 existing records. [2025-09-23T20:34:22.253304] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-23T20:34:22.346374] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:34:22.346617] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-23T20:34:22.346746] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-23T20:34:22.348171] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-23T20:34:22.348232] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-23T20:34:22.604761] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-23T20:34:22.721421] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:34:22.747366] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T20:34:23.402240] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-23T20:34:23.815589] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T20:34:24.202268] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-23T20:34:24.505910] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T20:34:25.002221] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-23T20:34:25.474684] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T20:34:25.684370] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T20:34:25.802248] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-23T20:34:26.602301] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-23T20:34:26.779971] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T20:34:26.787319] [INFO ] [REMOTE ] OSK: Full fetch complete (61579 records). [2025-09-23T20:34:26.787454] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-23T20:34:26.980095] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T20:34:26.980802] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:34:26.980876] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:34:26.980952] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-23T20:34:26.981023] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-23T20:34:26.981060] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-23T20:34:26.981100] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-23T20:34:26.981166] [INFO ] [MAIN ] Update Progress: 1614/2372 symbols completed. OSK took 35.6s. Estimated remaining: 1h 40m 41s. Rate: 7.5 symbols/min [2025-09-23T20:34:27.160169] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:34:27.225697] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-23T20:34:27.225846] [INFO ] [MAIN ] OWL: Loaded 53555 existing records. [2025-09-23T20:34:27.405826] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-23T20:34:27.412032] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:34:27.412593] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-23T20:34:27.412670] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-23T20:34:27.414337] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-23T20:34:27.414398] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-23T20:34:27.838351] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:34:27.840561] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T20:34:28.202154] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-23T20:34:28.346352] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T20:34:29.002255] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-23T20:34:29.080104] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T20:34:29.807319] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-23T20:34:29.820056] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T20:34:30.282902] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T20:34:30.602220] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-23T20:34:31.303047] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T20:34:31.402158] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-23T20:34:32.202187] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-23T20:34:32.562047] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-23T20:34:33.002159] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-23T20:34:33.193324] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T20:34:33.802253] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-23T20:34:34.177505] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-23T20:34:34.602209] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-23T20:34:34.961666] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T20:34:35.401439] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T20:34:35.412282] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-23T20:34:36.207341] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-23T20:34:36.235178] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T20:34:36.918570] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T20:34:37.002201] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-23T20:34:37.802200] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-23T20:34:38.020048] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T20:34:38.029173] [INFO ] [REMOTE ] OTIS: Full fetch complete (75797 records). [2025-09-23T20:34:38.029354] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-23T20:34:38.423162] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-23T20:34:38.423252] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-23T20:34:38.424321] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-23T20:34:38.424392] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-23T20:34:38.425999] [DEBUG] [LOCAL ] OTIS: Trimmed 75797 records to 52712 (keeping 200 days of data) [2025-09-23T20:34:38.621301] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-23T20:34:38.782860] [DEBUG] [LOCAL ] OTIS: Primary data saved (52712 records). [2025-09-23T20:34:38.783000] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-23T20:34:38.783084] [INFO ] [MAIN ] Update Progress: 1615/2372 symbols completed. OTIS took 39.9s. Estimated remaining: 1h 40m 35s. Rate: 7.5 symbols/min [2025-09-23T20:34:38.957797] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:34:38.989027] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-23T20:34:39.006124] [DEBUG] [LOCAL ] OWLT: Loaded 8904 existing records from primary storage. [2025-09-23T20:34:39.006244] [INFO ] [MAIN ] OWLT: Loaded 8904 existing records. [2025-09-23T20:34:39.193448] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:34:39.193972] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-23T20:34:39.194154] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-23T20:34:39.204045] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-23T20:34:39.219257] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-23T20:34:39.298765] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T20:34:39.407393] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-23T20:34:39.589450] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:34:40.202171] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-23T20:34:40.279728] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T20:34:41.002234] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-23T20:34:41.395742] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T20:34:41.802243] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-23T20:34:41.878666] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T20:34:42.560602] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T20:34:42.602203] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-23T20:34:42.965907] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-23T20:34:43.393224] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T20:34:43.402195] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-23T20:34:44.090542] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T20:34:44.202241] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-23T20:34:44.960388] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T20:34:45.002170] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-23T20:34:45.657923] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T20:34:45.802293] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-23T20:34:46.602213] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-23T20:34:47.402196] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-23T20:34:47.663013] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T20:34:48.078225] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T20:34:48.202212] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-23T20:34:48.345446] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T20:34:49.002224] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-23T20:34:49.123193] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T20:34:49.802280] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-23T20:34:50.602193] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-23T20:34:50.882730] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T20:34:51.402262] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-23T20:34:51.617839] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T20:34:51.627559] [INFO ] [REMOTE ] OVV: Full fetch complete (77300 records). [2025-09-23T20:34:51.627808] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-23T20:34:52.037024] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-23T20:34:52.037127] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-23T20:34:52.059702] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-23T20:34:52.059804] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-23T20:34:52.062138] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T20:34:52.071161] [INFO ] [REMOTE ] OUT: Full fetch complete (69093 records). [2025-09-23T20:34:52.071372] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-23T20:34:52.071767] [DEBUG] [LOCAL ] OVV: Trimmed 77300 records to 53516 (keeping 200 days of data) [2025-09-23T20:34:52.221473] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-23T20:34:52.626625] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-23T20:34:52.629682] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-23T20:34:52.636067] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-23T20:34:52.636162] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-23T20:34:52.728769] [DEBUG] [LOCAL ] OUT: Trimmed 69093 records to 48091 (keeping 200 days of data) [2025-09-23T20:34:52.975226] [DEBUG] [LOCAL ] OVV: Primary data saved (53516 records). [2025-09-23T20:34:52.976278] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-23T20:34:52.976681] [INFO ] [MAIN ] Update Progress: 1616/2372 symbols completed. OVV took 31.1s. Estimated remaining: 1h 40m 30s. Rate: 7.5 symbols/min [2025-09-23T20:34:53.173386] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:34:53.286239] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T20:34:53.291404] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-23T20:34:53.322509] [DEBUG] [LOCAL ] OXM: Loaded 33539 existing records from primary storage. [2025-09-23T20:34:53.323881] [INFO ] [MAIN ] OXM: Loaded 33539 existing records. [2025-09-23T20:34:53.561399] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:34:53.565625] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-23T20:34:53.565122] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-23T20:34:53.566300] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-23T20:34:53.578909] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-23T20:34:53.579948] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-23T20:34:53.809460] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-23T20:34:53.957492] [DEBUG] [LOCAL ] OUT: Primary data saved (48091 records). [2025-09-23T20:34:53.963680] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-23T20:34:53.969051] [INFO ] [MAIN ] Update Progress: 1617/2372 symbols completed. OUT took 33.2s. Estimated remaining: 1h 40m 19s. Rate: 7.5 symbols/min [2025-09-23T20:34:54.086128] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:34:54.116018] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T20:34:54.231040] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:34:54.231207] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-23T20:34:54.231245] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-23T20:34:54.231395] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-23T20:34:54.231440] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-23T20:34:54.231486] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-23T20:34:54.231520] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-23T20:34:54.593680] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:34:54.602157] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-23T20:34:55.402221] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-23T20:34:55.688105] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-23T20:34:56.202237] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-23T20:34:56.238280] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T20:34:56.240571] [INFO ] [REMOTE ] OWLT: Full fetch complete (11653 records). [2025-09-23T20:34:56.240663] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-23T20:34:56.629216] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-23T20:34:56.629395] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-23T20:34:56.629751] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-23T20:34:56.629813] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-23T20:34:56.630325] [DEBUG] [LOCAL ] OWLT: Trimmed 11653 records to 8989 (keeping 200 days of data) [2025-09-23T20:34:56.681364] [DEBUG] [LOCAL ] OWLT: Primary data saved (8989 records). [2025-09-23T20:34:56.681505] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-23T20:34:56.681597] [INFO ] [MAIN ] Update Progress: 1618/2372 symbols completed. OWLT took 17.9s. Estimated remaining: 1h 40m 8s. Rate: 7.5 symbols/min [2025-09-23T20:34:56.852237] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:34:56.907866] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-23T20:34:56.908097] [INFO ] [MAIN ] PAAS: Loaded 53603 existing records. [2025-09-23T20:34:57.007385] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-23T20:34:57.104769] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:34:57.105027] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-23T20:34:57.105078] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-23T20:34:57.106841] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-23T20:34:57.106906] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-23T20:34:57.493486] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:34:57.610734] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-09-23T20:34:57.802212] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-23T20:34:58.180703] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T20:34:58.307234] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T20:34:58.602258] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-23T20:34:59.402205] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-23T20:34:59.632242] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T20:34:59.886163] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-23T20:35:00.202197] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-23T20:35:01.002269] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-23T20:35:01.814745] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-23T20:35:01.855864] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-23T20:35:02.602196] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-23T20:35:02.941985] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-23T20:35:02.955407] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-23T20:35:02.984889] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T20:35:03.402196] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-23T20:35:04.202212] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-23T20:35:04.551720] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T20:35:05.004104] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-23T20:35:05.011781] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T20:35:05.802189] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-23T20:35:06.602183] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-23T20:35:06.837445] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-23T20:35:06.907494] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T20:35:06.917089] [INFO ] [REMOTE ] OWL: Full fetch complete (77519 records). [2025-09-23T20:35:06.917303] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-23T20:35:07.219680] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T20:35:07.384052] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-23T20:35:07.384163] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-23T20:35:07.385270] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-23T20:35:07.385382] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-23T20:35:07.387454] [DEBUG] [LOCAL ] OWL: Trimmed 77519 records to 53555 (keeping 200 days of data) [2025-09-23T20:35:07.453210] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-23T20:35:07.782272] [DEBUG] [LOCAL ] OWL: Primary data saved (53555 records). [2025-09-23T20:35:07.782699] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-23T20:35:07.783041] [INFO ] [MAIN ] Update Progress: 1619/2372 symbols completed. OWL took 40.8s. Estimated remaining: 1h 40m 2s. Rate: 7.5 symbols/min [2025-09-23T20:35:07.965497] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:35:07.978898] [DEBUG] [LOCAL ] PAC: Loaded 11560 existing records from primary storage. [2025-09-23T20:35:07.978999] [INFO ] [MAIN ] PAC: Loaded 11560 existing records. [2025-09-23T20:35:08.161816] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:35:08.162490] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-23T20:35:08.162616] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-23T20:35:08.163379] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-23T20:35:08.163445] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-23T20:35:08.217454] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-23T20:35:08.552037] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:35:08.612084] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-23T20:35:08.650697] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T20:35:09.002195] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-23T20:35:09.802206] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-23T20:35:10.055679] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T20:35:10.602253] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-23T20:35:10.965416] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-23T20:35:11.402184] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-23T20:35:11.426187] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T20:35:11.877704] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T20:35:12.202215] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-23T20:35:13.002244] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-23T20:35:13.802268] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-23T20:35:13.917764] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T20:35:14.054792] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-23T20:35:14.337987] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-23T20:35:14.602201] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-23T20:35:15.295265] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T20:35:15.359393] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T20:35:15.402216] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-23T20:35:16.202194] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-23T20:35:17.002202] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-23T20:35:17.698962] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T20:35:17.802176] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-23T20:35:18.004250] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-23T20:35:18.602169] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-23T20:35:18.804579] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T20:35:19.160208] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-23T20:35:19.310679] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T20:35:19.402166] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-23T20:35:20.202166] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-23T20:35:20.309594] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T20:35:21.002215] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-23T20:35:21.647531] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T20:35:21.654571] [INFO ] [REMOTE ] OXM: Full fetch complete (46194 records). [2025-09-23T20:35:21.660053] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-23T20:35:21.665128] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T20:35:21.807312] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-23T20:35:22.146242] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-23T20:35:22.146364] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-23T20:35:22.147496] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-23T20:35:22.147564] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-23T20:35:22.148763] [DEBUG] [LOCAL ] OXM: Trimmed 46194 records to 33516 (keeping 200 days of data) [2025-09-23T20:35:22.380293] [DEBUG] [LOCAL ] OXM: Primary data saved (33516 records). [2025-09-23T20:35:22.380447] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-23T20:35:22.380552] [INFO ] [MAIN ] Update Progress: 1620/2372 symbols completed. OXM took 29.4s. Estimated remaining: 1h 39m 57s. Rate: 7.5 symbols/min [2025-09-23T20:35:22.568964] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:35:22.605244] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-23T20:35:22.607678] [DEBUG] [LOCAL ] PACK: Loaded 32100 existing records from primary storage. [2025-09-23T20:35:22.607908] [INFO ] [MAIN ] PACK: Loaded 32100 existing records. [2025-09-23T20:35:22.825666] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:35:22.831444] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T20:35:22.831102] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-23T20:35:22.834580] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-23T20:35:22.836386] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-23T20:35:22.836470] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-23T20:35:23.191211] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:35:23.402188] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-23T20:35:24.202228] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-23T20:35:24.491343] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T20:35:24.868881] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-23T20:35:25.002209] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-23T20:35:25.802187] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-23T20:35:26.416326] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-23T20:35:26.602194] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-23T20:35:26.758852] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T20:35:27.116749] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-23T20:35:27.402219] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-23T20:35:28.202303] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-23T20:35:29.002236] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-23T20:35:29.107754] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-23T20:35:29.450296] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T20:35:29.527868] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T20:35:29.738984] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T20:35:29.741310] [INFO ] [REMOTE ] PAC: Full fetch complete (16400 records). [2025-09-23T20:35:29.741400] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-23T20:35:29.807290] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-23T20:35:30.120022] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-23T20:35:30.120136] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-23T20:35:30.120543] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-23T20:35:30.120585] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-23T20:35:30.121144] [DEBUG] [LOCAL ] PAC: Trimmed 16400 records to 11545 (keeping 200 days of data) [2025-09-23T20:35:30.205703] [DEBUG] [LOCAL ] PAC: Primary data saved (11545 records). [2025-09-23T20:35:30.205847] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-23T20:35:30.205978] [INFO ] [MAIN ] Update Progress: 1621/2372 symbols completed. PAC took 22.4s. Estimated remaining: 1h 39m 49s. Rate: 7.5 symbols/min [2025-09-23T20:35:30.375027] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:35:30.418948] [DEBUG] [LOCAL ] PACS: Loaded 34010 existing records from primary storage. [2025-09-23T20:35:30.419100] [INFO ] [MAIN ] PACS: Loaded 34010 existing records. [2025-09-23T20:35:30.595038] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:35:30.595319] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-23T20:35:30.595467] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-23T20:35:30.596503] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-23T20:35:30.596567] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-23T20:35:30.607760] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-23T20:35:30.971944] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:35:30.989330] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T20:35:31.402201] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-23T20:35:32.202173] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-23T20:35:32.576708] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T20:35:32.590616] [INFO ] [REMOTE ] PAAS: Full fetch complete (77369 records). [2025-09-23T20:35:32.590831] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-23T20:35:33.016540] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-23T20:35:33.046139] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-23T20:35:33.046240] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-23T20:35:33.047300] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-23T20:35:33.047368] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-23T20:35:33.049323] [DEBUG] [LOCAL ] PAAS: Trimmed 77369 records to 53603 (keeping 200 days of data) [2025-09-23T20:35:33.422381] [DEBUG] [LOCAL ] PAAS: Primary data saved (53603 records). [2025-09-23T20:35:33.422871] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-23T20:35:33.423053] [INFO ] [MAIN ] Update Progress: 1622/2372 symbols completed. PAAS took 36.7s. Estimated remaining: 1h 39m 39s. Rate: 7.5 symbols/min [2025-09-23T20:35:33.616460] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:35:33.646080] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T20:35:33.696279] [DEBUG] [LOCAL ] PAG: Loaded 21984 existing records from primary storage. [2025-09-23T20:35:33.697277] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-23T20:35:33.697560] [INFO ] [MAIN ] PAG: Loaded 21984 existing records. [2025-09-23T20:35:33.770743] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-23T20:35:33.783927] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-23T20:35:33.848238] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-23T20:35:34.047221] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:35:34.067160] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-23T20:35:34.084112] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-23T20:35:34.106064] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-23T20:35:34.109385] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-23T20:35:34.109084] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T20:35:34.155246] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:35:34.182076] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:35:34.193449] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-23T20:35:34.218626] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-23T20:35:34.221158] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-23T20:35:34.226973] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-23T20:35:34.237432] [INFO ] [MAIN ] Update Progress: 1623/2372 symbols completed. OXY took 40.3s. Estimated remaining: 1h 39m 28s. Rate: 7.5 symbols/min [2025-09-23T20:35:34.718025] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:35:34.685943] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:35:34.718986] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-23T20:35:34.754229] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T20:35:34.813560] [DEBUG] [LOCAL ] PAGS: Loaded 52686 existing records from primary storage. [2025-09-23T20:35:34.813742] [INFO ] [MAIN ] PAGS: Loaded 52686 existing records. [2025-09-23T20:35:34.992068] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:35:34.992375] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-23T20:35:34.992430] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-23T20:35:34.994016] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-23T20:35:34.994079] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-23T20:35:35.361997] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:35:35.402176] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-23T20:35:35.433550] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T20:35:36.051924] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T20:35:36.202203] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-23T20:35:36.697832] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T20:35:37.002250] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-23T20:35:37.736032] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T20:35:37.802218] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-23T20:35:38.602276] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-23T20:35:39.038196] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T20:35:39.255219] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T20:35:39.402160] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-23T20:35:39.952991] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T20:35:40.202219] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-23T20:35:40.899133] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T20:35:41.002159] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-23T20:35:41.268329] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T20:35:41.802199] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-23T20:35:41.950853] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T20:35:42.602237] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-23T20:35:42.921156] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T20:35:43.402192] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-23T20:35:43.443069] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T20:35:44.202221] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-23T20:35:45.002216] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-23T20:35:45.475373] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-23T20:35:45.802195] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-23T20:35:46.070753] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T20:35:46.602219] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-23T20:35:47.402262] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-23T20:35:48.249920] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-09-23T20:35:48.257748] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-23T20:35:48.348103] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T20:35:48.427538] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-23T20:35:49.002192] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-23T20:35:49.427348] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T20:35:49.786357] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T20:35:49.802149] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-23T20:35:50.609246] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-23T20:35:50.625168] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T20:35:50.938588] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T20:35:51.402208] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-23T20:35:52.202204] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-23T20:35:52.234409] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T20:35:52.832311] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T20:35:53.002202] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-23T20:35:53.311040] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T20:35:53.317202] [INFO ] [REMOTE ] PACK: Full fetch complete (43338 records). [2025-09-23T20:35:53.317304] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-23T20:35:53.820677] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-23T20:35:53.820817] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-23T20:35:53.822299] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-23T20:35:53.822414] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-23T20:35:53.815822] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-23T20:35:53.825931] [DEBUG] [LOCAL ] PACK: Trimmed 43338 records to 32065 (keeping 200 days of data) [2025-09-23T20:35:54.139442] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T20:35:54.157487] [DEBUG] [LOCAL ] PACK: Primary data saved (32065 records). [2025-09-23T20:35:54.157699] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-23T20:35:54.157848] [INFO ] [MAIN ] Update Progress: 1624/2372 symbols completed. PACK took 31.8s. Estimated remaining: 1h 39m 25s. Rate: 7.5 symbols/min [2025-09-23T20:35:54.429904] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:35:54.436755] [DEBUG] [LOCAL ] PAI: Loaded 2709 existing records from primary storage. [2025-09-23T20:35:54.436902] [INFO ] [MAIN ] PAI: Loaded 2709 existing records. [2025-09-23T20:35:54.607422] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-23T20:35:54.654032] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:35:54.654457] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-23T20:35:54.654530] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-23T20:35:54.654918] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-23T20:35:54.654996] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-23T20:35:55.048973] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:35:55.402189] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-23T20:35:55.445245] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T20:35:55.452446] [INFO ] [REMOTE ] PACS: Full fetch complete (50776 records). [2025-09-23T20:35:55.452567] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-23T20:35:55.865383] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-23T20:35:55.865517] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-23T20:35:55.866553] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-23T20:35:55.875067] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-23T20:35:55.882685] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T20:35:55.889391] [DEBUG] [LOCAL ] PACS: Trimmed 50776 records to 34079 (keeping 200 days of data) [2025-09-23T20:35:56.090428] [DEBUG] [LOCAL ] PACS: Primary data saved (34079 records). [2025-09-23T20:35:56.090578] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-23T20:35:56.090707] [INFO ] [MAIN ] Update Progress: 1625/2372 symbols completed. PACS took 25.9s. Estimated remaining: 1h 39m 14s. Rate: 7.5 symbols/min [2025-09-23T20:35:56.208750] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-23T20:35:56.276955] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:35:56.277144] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-23T20:35:56.277200] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-23T20:35:56.277344] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-23T20:35:56.277387] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-23T20:35:56.277429] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-23T20:35:56.277461] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-23T20:35:56.655324] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:35:57.002224] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-23T20:35:57.065228] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T20:35:57.117177] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T20:35:57.245414] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:35:57.245771] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-23T20:35:57.802197] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-23T20:35:58.429335] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T20:35:58.602198] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-23T20:35:59.249004] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T20:35:59.402181] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-23T20:36:00.202221] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-23T20:36:00.465810] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T20:36:00.469326] [INFO ] [REMOTE ] PAG: Full fetch complete (29899 records). [2025-09-23T20:36:00.469443] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-23T20:36:00.847628] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-23T20:36:00.847747] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-23T20:36:00.848478] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-23T20:36:00.848542] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-23T20:36:00.849485] [DEBUG] [LOCAL ] PAG: Trimmed 29899 records to 21938 (keeping 200 days of data) [2025-09-23T20:36:00.989773] [DEBUG] [LOCAL ] PAG: Primary data saved (21938 records). [2025-09-23T20:36:00.989914] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-23T20:36:00.990028] [INFO ] [MAIN ] Update Progress: 1626/2372 symbols completed. PAG took 27.6s. Estimated remaining: 1h 39m 5s. Rate: 7.5 symbols/min [2025-09-23T20:36:01.012122] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-23T20:36:01.205974] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:36:01.212101] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T20:36:01.246141] [DEBUG] [LOCAL ] PAM: Loaded 27892 existing records from primary storage. [2025-09-23T20:36:01.246304] [INFO ] [MAIN ] PAM: Loaded 27892 existing records. [2025-09-23T20:36:01.492149] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:36:01.492430] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-23T20:36:01.492481] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-23T20:36:01.493271] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-23T20:36:01.493333] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-23T20:36:01.811024] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-23T20:36:01.852906] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:36:02.602198] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-23T20:36:03.226811] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:36:03.227425] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-23T20:36:03.382345] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T20:36:03.402194] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-23T20:36:04.202265] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-23T20:36:04.575532] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:36:04.575888] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-23T20:36:04.876727] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T20:36:05.002178] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-23T20:36:05.173505] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (4.16 seconds). [2025-09-23T20:36:05.802198] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-23T20:36:06.246357] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-23T20:36:06.602211] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-23T20:36:06.639579] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T20:36:07.145860] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T20:36:07.402204] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-23T20:36:07.656488] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:36:07.656919] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-23T20:36:08.202222] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-23T20:36:08.722373] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T20:36:09.002197] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-23T20:36:09.802205] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-23T20:36:10.470414] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T20:36:10.493044] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T20:36:10.602226] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-23T20:36:11.402205] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-23T20:36:11.688929] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:36:11.689301] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-23T20:36:12.020111] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T20:36:12.202193] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-23T20:36:12.465569] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:36:12.465930] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-23T20:36:13.002249] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-23T20:36:13.802190] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-23T20:36:14.602185] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-23T20:36:14.784758] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T20:36:14.847924] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T20:36:15.033568] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T20:36:15.035083] [INFO ] [REMOTE ] PAI: Full fetch complete (4134 records). [2025-09-23T20:36:15.035152] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-23T20:36:15.397729] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-23T20:36:15.397813] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-23T20:36:15.397952] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-23T20:36:15.397990] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-23T20:36:15.398346] [DEBUG] [LOCAL ] PAI: Trimmed 4134 records to 2707 (keeping 200 days of data) [2025-09-23T20:36:15.407830] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-23T20:36:15.417954] [DEBUG] [LOCAL ] PAI: Primary data saved (2707 records). [2025-09-23T20:36:15.418034] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-23T20:36:15.418108] [INFO ] [MAIN ] Update Progress: 1627/2372 symbols completed. PAI took 21.3s. Estimated remaining: 1h 38m 60s. Rate: 7.5 symbols/min [2025-09-23T20:36:15.589449] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:36:15.620765] [DEBUG] [LOCAL ] PAR: Loaded 32523 existing records from primary storage. [2025-09-23T20:36:15.620949] [INFO ] [MAIN ] PAR: Loaded 32523 existing records. [2025-09-23T20:36:15.796557] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:36:15.796816] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-23T20:36:15.796933] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-23T20:36:15.797737] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-23T20:36:15.797799] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-23T20:36:16.156568] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:36:16.202185] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-23T20:36:16.772208] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T20:36:17.002228] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-23T20:36:17.802200] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-23T20:36:17.834376] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T20:36:18.173544] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T20:36:18.602215] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-23T20:36:18.858438] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:36:18.858793] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-23T20:36:19.402226] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-23T20:36:19.689666] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T20:36:20.202239] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-23T20:36:20.465775] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:36:20.466114] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-23T20:36:20.978335] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T20:36:21.002138] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-23T20:36:21.802197] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-23T20:36:22.404095] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T20:36:22.602216] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-23T20:36:23.373387] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T20:36:23.402186] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-23T20:36:23.764459] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T20:36:24.202284] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-23T20:36:25.002315] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-23T20:36:25.226788] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T20:36:25.237254] [INFO ] [REMOTE ] PAGS: Full fetch complete (76326 records). [2025-09-23T20:36:25.237483] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-23T20:36:25.665887] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-23T20:36:25.666021] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-23T20:36:25.667155] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-23T20:36:25.667248] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-23T20:36:25.689757] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T20:36:25.697026] [DEBUG] [LOCAL ] PAGS: Trimmed 76326 records to 52684 (keeping 200 days of data) [2025-09-23T20:36:25.802261] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-23T20:36:25.960483] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T20:36:26.067580] [DEBUG] [LOCAL ] PAGS: Primary data saved (52684 records). [2025-09-23T20:36:26.067762] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-23T20:36:26.067862] [INFO ] [MAIN ] Update Progress: 1628/2372 symbols completed. PAGS took 51.8s. Estimated remaining: 1h 38m 53s. Rate: 7.5 symbols/min [2025-09-23T20:36:26.247535] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:36:26.299510] [DEBUG] [LOCAL ] PARR: Loaded 48356 existing records from primary storage. [2025-09-23T20:36:26.299724] [INFO ] [MAIN ] PARR: Loaded 48356 existing records. [2025-09-23T20:36:26.479345] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:36:26.479715] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-23T20:36:26.479777] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-23T20:36:26.480908] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-23T20:36:26.480973] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-23T20:36:26.607286] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-23T20:36:26.849800] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:36:26.998190] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:36:26.998528] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-23T20:36:27.230577] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T20:36:27.402212] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-23T20:36:28.202212] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-23T20:36:28.764714] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T20:36:29.002196] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-23T20:36:29.802180] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-23T20:36:29.950689] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T20:36:30.030529] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T20:36:30.602201] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-23T20:36:30.876925] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T20:36:30.883955] [INFO ] [REMOTE ] PAM: Full fetch complete (41956 records). [2025-09-23T20:36:30.884089] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-23T20:36:31.264891] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-23T20:36:31.264976] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-23T20:36:31.265817] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-23T20:36:31.265880] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-23T20:36:31.266855] [DEBUG] [LOCAL ] PAM: Trimmed 41956 records to 27935 (keeping 200 days of data) [2025-09-23T20:36:31.410832] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-23T20:36:31.440430] [DEBUG] [LOCAL ] PAM: Primary data saved (27935 records). [2025-09-23T20:36:31.440576] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-23T20:36:31.440732] [INFO ] [MAIN ] Update Progress: 1629/2372 symbols completed. PAM took 30.5s. Estimated remaining: 1h 38m 44s. Rate: 7.5 symbols/min [2025-09-23T20:36:31.609972] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:36:31.665158] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-23T20:36:31.665365] [INFO ] [MAIN ] PATH: Loaded 53678 existing records. [2025-09-23T20:36:31.849579] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:36:31.850095] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-23T20:36:31.850170] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-23T20:36:31.851472] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-23T20:36:31.851535] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-23T20:36:31.926120] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T20:36:31.942523] [INFO ] [REMOTE ] PAII: Full fetch complete (80 records). [2025-09-23T20:36:31.956500] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-23T20:36:32.207296] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-23T20:36:32.355620] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T20:36:32.407744] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 10 unique days, need 200 days [2025-09-23T20:36:32.438369] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:36:32.447428] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:36:32.469894] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-23T20:36:32.478479] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-23T20:36:32.473008] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:36:32.478591] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-23T20:36:32.479327] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-23T20:36:32.479776] [INFO ] [MAIN ] Update Progress: 1630/2372 symbols completed. PAII took 36.4s. Estimated remaining: 1h 38m 33s. Rate: 7.5 symbols/min [2025-09-23T20:36:32.650052] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:36:32.672846] [DEBUG] [LOCAL ] PAXS: Loaded 21101 existing records from primary storage. [2025-09-23T20:36:32.673005] [INFO ] [MAIN ] PAXS: Loaded 21101 existing records. [2025-09-23T20:36:32.849865] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:36:32.850120] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-23T20:36:32.850169] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-23T20:36:32.851508] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-23T20:36:32.851580] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-23T20:36:33.026115] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-23T20:36:33.228632] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:36:33.576041] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T20:36:33.802176] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-23T20:36:34.602257] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-23T20:36:35.241034] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T20:36:35.402169] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-23T20:36:35.672826] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-23T20:36:36.202190] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-23T20:36:36.370230] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T20:36:36.920738] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T20:36:37.002269] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-23T20:36:37.802233] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-23T20:36:38.510207] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T20:36:38.609345] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-23T20:36:38.641056] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-23T20:36:39.092758] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T20:36:39.402260] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-23T20:36:39.808783] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T20:36:40.202201] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-23T20:36:41.002307] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-23T20:36:41.241531] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T20:36:41.314322] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T20:36:41.321508] [INFO ] [REMOTE ] PAR: Full fetch complete (47114 records). [2025-09-23T20:36:41.321682] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-23T20:36:41.712590] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-23T20:36:41.712741] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-23T20:36:41.713719] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-23T20:36:41.713792] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-23T20:36:41.715187] [DEBUG] [LOCAL ] PAR: Trimmed 47114 records to 32612 (keeping 200 days of data) [2025-09-23T20:36:41.809729] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-23T20:36:41.931638] [DEBUG] [LOCAL ] PAR: Primary data saved (32612 records). [2025-09-23T20:36:41.931823] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-23T20:36:41.931934] [INFO ] [MAIN ] Update Progress: 1631/2372 symbols completed. PAR took 26.5s. Estimated remaining: 1h 38m 26s. Rate: 7.5 symbols/min [2025-09-23T20:36:42.063291] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T20:36:42.124354] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:36:42.161997] [DEBUG] [LOCAL ] PAY: Loaded 38308 existing records from primary storage. [2025-09-23T20:36:42.162135] [INFO ] [MAIN ] PAY: Loaded 38308 existing records. [2025-09-23T20:36:42.338662] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:36:42.338923] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-23T20:36:42.338978] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-23T20:36:42.339883] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-23T20:36:42.339943] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-23T20:36:42.610256] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-23T20:36:42.700897] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:36:43.402163] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-23T20:36:43.764492] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T20:36:44.113324] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-23T20:36:44.202222] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-23T20:36:44.525070] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T20:36:45.002201] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-23T20:36:45.411441] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T20:36:45.802234] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-23T20:36:46.602226] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-23T20:36:46.984266] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T20:36:47.357555] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-23T20:36:47.402237] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-23T20:36:47.685962] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T20:36:48.202207] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-23T20:36:49.002185] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-23T20:36:49.138418] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T20:36:49.191718] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T20:36:49.802220] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-23T20:36:50.602202] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-23T20:36:51.154721] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T20:36:51.303939] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-23T20:36:51.402201] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-23T20:36:52.202176] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-23T20:36:52.343453] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T20:36:52.876276] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T20:36:53.002203] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-23T20:36:53.086987] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T20:36:53.802192] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-23T20:36:54.602191] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-23T20:36:55.250383] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T20:36:55.311779] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T20:36:55.374991] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T20:36:55.402151] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-23T20:36:56.202190] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-23T20:36:56.949998] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T20:36:57.002154] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-23T20:36:57.802200] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-23T20:36:58.047246] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T20:36:58.533878] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T20:36:58.602162] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-23T20:36:58.928764] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T20:36:58.932371] [INFO ] [REMOTE ] PAXS: Full fetch complete (31403 records). [2025-09-23T20:36:58.932458] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-23T20:36:59.309396] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-23T20:36:59.309540] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-23T20:36:59.310219] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-23T20:36:59.310281] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-23T20:36:59.311086] [DEBUG] [LOCAL ] PAXS: Trimmed 31403 records to 21016 (keeping 200 days of data) [2025-09-23T20:36:59.404521] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-23T20:36:59.442990] [DEBUG] [LOCAL ] PAXS: Primary data saved (21016 records). [2025-09-23T20:36:59.443124] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-23T20:36:59.443238] [INFO ] [MAIN ] Update Progress: 1632/2372 symbols completed. PAXS took 27.0s. Estimated remaining: 1h 38m 22s. Rate: 7.5 symbols/min [2025-09-23T20:36:59.625508] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:36:59.665748] [DEBUG] [LOCAL ] PAYC: Loaded 36350 existing records from primary storage. [2025-09-23T20:36:59.665901] [INFO ] [MAIN ] PAYC: Loaded 36350 existing records. [2025-09-23T20:36:59.851199] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:36:59.851471] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-23T20:36:59.851518] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-23T20:36:59.852432] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-23T20:36:59.852491] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-23T20:37:00.210274] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-23T20:37:00.266482] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:00.290263] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T20:37:01.002250] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-23T20:37:01.640572] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-23T20:37:01.802170] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-23T20:37:02.074995] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T20:37:02.571137] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T20:37:02.602141] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-23T20:37:03.402199] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-23T20:37:03.947314] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T20:37:04.202247] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-23T20:37:04.241128] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T20:37:04.250375] [INFO ] [REMOTE ] PAY: Full fetch complete (53244 records). [2025-09-23T20:37:04.250546] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-23T20:37:04.855052] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-23T20:37:04.855271] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-23T20:37:04.856611] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-23T20:37:04.856787] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-23T20:37:04.877427] [DEBUG] [LOCAL ] PAY: Trimmed 53244 records to 38383 (keeping 200 days of data) [2025-09-23T20:37:04.897475] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T20:37:04.915284] [INFO ] [REMOTE ] PARR: Full fetch complete (68558 records). [2025-09-23T20:37:04.915753] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-23T20:37:05.015140] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-23T20:37:05.591090] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-23T20:37:05.591815] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-23T20:37:05.593258] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-23T20:37:05.593667] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-23T20:37:05.652094] [DEBUG] [LOCAL ] PARR: Trimmed 68558 records to 48351 (keeping 200 days of data) [2025-09-23T20:37:05.908632] [DEBUG] [LOCAL ] PAY: Primary data saved (38383 records). [2025-09-23T20:37:05.910728] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-23T20:37:05.912623] [INFO ] [MAIN ] Update Progress: 1633/2372 symbols completed. PAY took 24.0s. Estimated remaining: 1h 38m 13s. Rate: 7.5 symbols/min [2025-09-23T20:37:06.111926] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:37:06.203009] [DEBUG] [LOCAL ] PARR: Primary data saved (48351 records). [2025-09-23T20:37:06.203973] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-23T20:37:06.204112] [INFO ] [MAIN ] Update Progress: 1634/2372 symbols completed. PARR took 40.1s. Estimated remaining: 1h 38m 2s. Rate: 7.5 symbols/min [2025-09-23T20:37:06.203789] [DEBUG] [LOCAL ] PB: Loaded 41351 existing records from primary storage. [2025-09-23T20:37:06.204434] [INFO ] [MAIN ] PB: Loaded 41351 existing records. [2025-09-23T20:37:06.532454] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:37:06.579033] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:37:06.579403] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-23T20:37:06.579505] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-23T20:37:06.580870] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-23T20:37:06.581497] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-23T20:37:06.691014] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-23T20:37:06.735975] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-23T20:37:06.790078] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T20:37:06.836204] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-23T20:37:06.933520] [DEBUG] [LOCAL ] PBA: Loaded 48983 existing records from primary storage. [2025-09-23T20:37:06.955186] [INFO ] [MAIN ] PBA: Loaded 48983 existing records. [2025-09-23T20:37:07.240344] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:07.269033] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:37:07.269280] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-23T20:37:07.269329] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-23T20:37:07.270485] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-23T20:37:07.270547] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-23T20:37:07.417582] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-23T20:37:07.661568] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:08.202264] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-23T20:37:08.517595] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T20:37:08.597565] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T20:37:09.002284] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-23T20:37:09.133960] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-23T20:37:09.143151] [INFO ] [REMOTE ] PATH: Full fetch complete (77765 records). [2025-09-23T20:37:09.143301] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-23T20:37:09.555983] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-23T20:37:09.556075] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-23T20:37:09.557250] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-23T20:37:09.557320] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-23T20:37:09.558928] [DEBUG] [LOCAL ] PATH: Trimmed 77765 records to 53678 (keeping 200 days of data) [2025-09-23T20:37:09.804619] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-23T20:37:09.930970] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T20:37:09.960022] [DEBUG] [LOCAL ] PATH: Primary data saved (53678 records). [2025-09-23T20:37:09.960199] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-23T20:37:09.960436] [INFO ] [MAIN ] Update Progress: 1635/2372 symbols completed. PATH took 38.5s. Estimated remaining: 1h 37m 52s. Rate: 7.5 symbols/min [2025-09-23T20:37:10.134192] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:37:10.187806] [DEBUG] [LOCAL ] PBF: Loaded 53091 existing records from primary storage. [2025-09-23T20:37:10.187952] [INFO ] [MAIN ] PBF: Loaded 53091 existing records. [2025-09-23T20:37:10.366176] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:37:10.366421] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-23T20:37:10.366481] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-23T20:37:10.367695] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-23T20:37:10.367755] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-23T20:37:10.609541] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-23T20:37:10.739711] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:10.760635] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T20:37:10.944567] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T20:37:11.402222] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-23T20:37:12.202205] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-23T20:37:12.509459] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T20:37:13.002226] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-23T20:37:13.116834] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T20:37:13.270477] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T20:37:13.802179] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-23T20:37:14.602202] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-23T20:37:14.735984] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T20:37:15.369577] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T20:37:15.402249] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-23T20:37:16.044038] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T20:37:16.202232] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-23T20:37:16.894372] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T20:37:17.002194] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-23T20:37:17.456350] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T20:37:17.802211] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-23T20:37:18.422026] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T20:37:18.602208] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-23T20:37:19.402229] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-23T20:37:19.499250] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T20:37:20.202230] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-23T20:37:20.457478] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T20:37:20.777973] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T20:37:21.002214] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-23T20:37:21.498345] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T20:37:21.802197] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-23T20:37:22.602230] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-23T20:37:22.793300] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T20:37:23.274488] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T20:37:23.402153] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-23T20:37:23.858569] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T20:37:24.202280] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-23T20:37:24.984323] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T20:37:25.002157] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-23T20:37:25.646004] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T20:37:25.802207] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-23T20:37:26.602257] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-23T20:37:26.654516] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T20:37:27.402162] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-23T20:37:27.749169] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-23T20:37:28.113759] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T20:37:28.202239] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-23T20:37:28.952038] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T20:37:28.959227] [INFO ] [REMOTE ] PAYC: Full fetch complete (52771 records). [2025-09-23T20:37:28.959423] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-23T20:37:29.007398] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-23T20:37:29.350580] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-23T20:37:29.350692] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-23T20:37:29.351530] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-23T20:37:29.351668] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-23T20:37:29.354862] [DEBUG] [LOCAL ] PAYC: Trimmed 52771 records to 36312 (keeping 200 days of data) [2025-09-23T20:37:29.623386] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T20:37:29.644851] [DEBUG] [LOCAL ] PAYC: Primary data saved (36312 records). [2025-09-23T20:37:29.645034] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-23T20:37:29.645326] [INFO ] [MAIN ] Update Progress: 1636/2372 symbols completed. PAYC took 30.2s. Estimated remaining: 1h 37m 49s. Rate: 7.5 symbols/min [2025-09-23T20:37:29.815670] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-23T20:37:29.819035] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:37:29.857292] [DEBUG] [LOCAL ] PBH: Loaded 31557 existing records from primary storage. [2025-09-23T20:37:29.857430] [INFO ] [MAIN ] PBH: Loaded 31557 existing records. [2025-09-23T20:37:30.034023] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:37:30.034266] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-23T20:37:30.034316] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-23T20:37:30.035078] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-23T20:37:30.035156] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-23T20:37:30.395677] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:30.602155] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-23T20:37:31.020387] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-23T20:37:31.397627] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T20:37:31.406682] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-23T20:37:31.458949] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T20:37:32.202202] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-23T20:37:33.002256] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-23T20:37:33.330328] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T20:37:33.762302] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T20:37:33.772367] [INFO ] [REMOTE ] PB: Full fetch complete (57868 records). [2025-09-23T20:37:33.772525] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-23T20:37:33.807403] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-23T20:37:34.162130] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-23T20:37:34.162235] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-23T20:37:34.163381] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-23T20:37:34.163453] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-23T20:37:34.164950] [DEBUG] [LOCAL ] PB: Trimmed 57868 records to 41376 (keeping 200 days of data) [2025-09-23T20:37:34.454675] [DEBUG] [LOCAL ] PB: Primary data saved (41376 records). [2025-09-23T20:37:34.455035] [INFO ] [MAIN ] PB: Full history saved. [2025-09-23T20:37:34.455215] [INFO ] [MAIN ] Update Progress: 1637/2372 symbols completed. PB took 28.5s. Estimated remaining: 1h 37m 40s. Rate: 7.5 symbols/min [2025-09-23T20:37:34.602304] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-23T20:37:34.887422] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T20:37:35.116768] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T20:37:35.402204] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-23T20:37:36.202272] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-23T20:37:36.339565] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T20:37:36.522298] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T20:37:37.002230] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-23T20:37:37.699665] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T20:37:37.802260] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-23T20:37:38.602194] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-23T20:37:38.855668] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T20:37:39.053599] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T20:37:39.402249] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-23T20:37:40.006793] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T20:37:40.016540] [INFO ] [REMOTE ] PBF: Full fetch complete (76567 records). [2025-09-23T20:37:40.016702] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-23T20:37:40.211491] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-23T20:37:40.421683] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-23T20:37:40.421788] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-23T20:37:40.422968] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-23T20:37:40.423038] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-23T20:37:40.424682] [DEBUG] [LOCAL ] PBF: Trimmed 76567 records to 53092 (keeping 200 days of data) [2025-09-23T20:37:40.555212] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T20:37:40.793793] [DEBUG] [LOCAL ] PBF: Primary data saved (53092 records). [2025-09-23T20:37:40.793936] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-23T20:37:40.794034] [INFO ] [MAIN ] Update Progress: 1638/2372 symbols completed. PBF took 30.8s. Estimated remaining: 1h 37m 31s. Rate: 7.5 symbols/min [2025-09-23T20:37:41.002213] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-23T20:37:41.881709] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T20:37:41.893158] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-23T20:37:42.009598] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T20:37:42.602255] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-23T20:37:43.871343] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T20:37:43.880373] [INFO ] [REMOTE ] PBA: Full fetch complete (71509 records). [2025-09-23T20:37:43.880497] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-23T20:37:44.309590] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-23T20:37:44.310783] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T20:37:44.316592] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-23T20:37:44.317753] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-23T20:37:44.318087] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-23T20:37:44.318178] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-23T20:37:44.320927] [DEBUG] [LOCAL ] PBA: Trimmed 71509 records to 48964 (keeping 200 days of data) [2025-09-23T20:37:44.634096] [DEBUG] [LOCAL ] PBA: Primary data saved (48964 records). [2025-09-23T20:37:44.634228] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-23T20:37:44.634344] [INFO ] [MAIN ] Update Progress: 1639/2372 symbols completed. PBA took 38.4s. Estimated remaining: 1h 37m 21s. Rate: 7.5 symbols/min [2025-09-23T20:37:46.941013] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-23T20:37:46.948574] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-23T20:37:48.474925] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T20:37:48.483355] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-23T20:37:50.026458] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T20:37:50.033158] [INFO ] [REMOTE ] PBH: Full fetch complete (42794 records). [2025-09-23T20:37:50.033258] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-23T20:37:50.446267] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-23T20:37:50.446351] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-23T20:37:50.447220] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-23T20:37:50.447289] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-23T20:37:50.448334] [DEBUG] [LOCAL ] PBH: Trimmed 42794 records to 31622 (keeping 200 days of data) [2025-09-23T20:37:50.642252] [DEBUG] [LOCAL ] PBH: Primary data saved (31622 records). [2025-09-23T20:37:50.642380] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-23T20:37:50.642482] [INFO ] [MAIN ] Update Progress: 1640/2372 symbols completed. PBH took 21.0s. Estimated remaining: 1h 37m 13s. Rate: 7.5 symbols/min [2025-09-23T20:37:51.164984] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:37:51.252636] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:37:51.323533] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:37:51.358686] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:37:51.377620] [DEBUG] [LOCAL ] PBT: Loaded 17357 existing records from primary storage. [2025-09-23T20:37:51.377855] [INFO ] [MAIN ] PBT: Loaded 17357 existing records. [2025-09-23T20:37:51.413601] [DEBUG] [LOCAL ] PCF: Loaded 8638 existing records from primary storage. [2025-09-23T20:37:51.438544] [INFO ] [MAIN ] PCF: Loaded 8638 existing records. [2025-09-23T20:37:51.788438] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:37:51.824713] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-23T20:37:51.825638] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:37:51.825832] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-23T20:37:51.827367] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-23T20:37:51.827536] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-23T20:37:51.827292] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-09-23T20:37:51.828210] [DEBUG] [LOCAL ] PBI: Loaded 50061 existing records from primary storage. [2025-09-23T20:37:51.828341] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-23T20:37:51.828482] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-23T20:37:51.834404] [INFO ] [MAIN ] PBR: Loaded 53713 existing records. [2025-09-23T20:37:51.840085] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-23T20:37:51.834198] [INFO ] [MAIN ] PBI: Loaded 50061 existing records. [2025-09-23T20:37:51.869194] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-23T20:37:52.534480] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:37:52.611072] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:37:52.669932] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-23T20:37:52.679508] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-23T20:37:52.684978] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-23T20:37:52.684879] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-23T20:37:52.735029] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-23T20:37:52.752639] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-23T20:37:52.758002] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-23T20:37:52.799989] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-23T20:37:53.087608] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:53.126304] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-23T20:37:53.290958] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:53.344268] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-23T20:37:53.741628] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:53.742843] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-23T20:37:53.763375] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:37:53.763821] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-23T20:37:54.718990] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T20:37:54.722970] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-23T20:37:54.892668] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T20:37:54.897437] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-23T20:37:55.499252] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T20:37:55.512434] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-23T20:37:55.705562] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T20:37:55.708689] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-23T20:37:55.766401] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T20:37:55.777809] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-23T20:37:56.004139] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T20:37:56.008567] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-23T20:37:56.598387] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T20:37:56.602128] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-23T20:37:57.586495] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T20:37:57.593636] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-23T20:37:57.903487] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T20:37:57.907985] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-23T20:37:57.955666] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-23T20:37:57.971175] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-23T20:37:58.882604] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T20:37:58.885638] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-23T20:37:59.179367] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (3.40 seconds). [2025-09-23T20:37:59.195462] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-23T20:37:59.462288] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T20:37:59.466394] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-23T20:37:59.716578] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T20:37:59.719041] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-23T20:38:00.282945] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-23T20:38:00.295634] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-23T20:38:00.312133] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T20:38:00.637063] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T20:38:01.002212] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-23T20:38:01.401778] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-23T20:38:01.802282] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-23T20:38:02.139877] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T20:38:02.260326] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T20:38:02.602190] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-23T20:38:02.681898] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T20:38:03.402252] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-23T20:38:03.991697] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T20:38:04.202216] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-23T20:38:04.436227] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T20:38:05.002237] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-23T20:38:05.484546] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T20:38:05.802201] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-23T20:38:06.602169] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-23T20:38:06.663920] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T20:38:06.666573] [INFO ] [REMOTE ] PCF: Full fetch complete (14435 records). [2025-09-23T20:38:06.666686] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-23T20:38:07.038343] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-23T20:38:07.038505] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-23T20:38:07.038914] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-23T20:38:07.038994] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-23T20:38:07.039788] [DEBUG] [LOCAL ] PCF: Trimmed 14435 records to 8660 (keeping 200 days of data) [2025-09-23T20:38:07.114066] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-23T20:38:07.136894] [DEBUG] [LOCAL ] PCF: Primary data saved (8660 records). [2025-09-23T20:38:07.137012] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-23T20:38:07.137090] [INFO ] [MAIN ] Update Progress: 1641/2372 symbols completed. PCF took 16.5s. Estimated remaining: 1h 37m 8s. Rate: 7.5 symbols/min [2025-09-23T20:38:07.313964] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:38:07.314212] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-23T20:38:07.314268] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-23T20:38:07.314381] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-23T20:38:07.314419] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-23T20:38:07.314460] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-23T20:38:07.314494] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-23T20:38:07.409188] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-23T20:38:07.679553] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:38:07.751581] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T20:38:08.202217] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-23T20:38:09.002196] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-23T20:38:09.802150] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-23T20:38:09.893975] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-23T20:38:10.194531] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-23T20:38:10.602154] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-23T20:38:10.617785] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T20:38:10.940039] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T20:38:11.402259] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-23T20:38:12.202222] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-23T20:38:12.493252] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-23T20:38:13.002199] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-23T20:38:13.552521] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-23T20:38:13.802189] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-23T20:38:14.045579] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T20:38:14.602238] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-23T20:38:15.354595] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-23T20:38:15.402184] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-23T20:38:15.605554] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T20:38:16.202169] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-23T20:38:16.380629] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T20:38:17.002220] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-23T20:38:17.457531] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-23T20:38:17.656670] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T20:38:17.802230] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-23T20:38:18.602166] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-23T20:38:19.007762] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-23T20:38:19.402193] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-23T20:38:19.477712] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T20:38:20.202220] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-23T20:38:20.647077] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-23T20:38:20.659607] [INFO ] [REMOTE ] PBR: Full fetch complete (77777 records). [2025-09-23T20:38:20.659819] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-23T20:38:21.012050] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-23T20:38:21.083217] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-23T20:38:21.083414] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-23T20:38:21.084730] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-23T20:38:21.094586] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-23T20:38:21.113983] [DEBUG] [LOCAL ] PBR: Trimmed 77777 records to 53713 (keeping 200 days of data) [2025-09-23T20:38:21.116117] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T20:38:21.460972] [DEBUG] [LOCAL ] PBR: Primary data saved (53713 records). [2025-09-23T20:38:21.461153] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-23T20:38:21.461254] [INFO ] [MAIN ] Update Progress: 1642/2372 symbols completed. PBR took 30.8s. Estimated remaining: 1h 37m 3s. Rate: 7.5 symbols/min [2025-09-23T20:38:21.640206] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:38:21.648839] [DEBUG] [LOCAL ] PCM: Loaded 6779 existing records from primary storage. [2025-09-23T20:38:21.648942] [INFO ] [MAIN ] PCM: Loaded 6779 existing records. [2025-09-23T20:38:21.804718] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-23T20:38:21.834978] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:38:21.836084] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-23T20:38:21.836134] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-23T20:38:21.836472] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-23T20:38:21.836532] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-23T20:38:22.232434] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:38:22.242961] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T20:38:22.247046] [INFO ] [REMOTE ] PBT: Full fetch complete (25348 records). [2025-09-23T20:38:22.247229] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-23T20:38:22.579539] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-23T20:38:22.604033] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-23T20:38:22.687234] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-23T20:38:22.687314] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-23T20:38:22.687844] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-23T20:38:22.688264] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-23T20:38:22.689084] [DEBUG] [LOCAL ] PBT: Trimmed 25348 records to 17399 (keeping 200 days of data) [2025-09-23T20:38:22.805534] [DEBUG] [LOCAL ] PBT: Primary data saved (17399 records). [2025-09-23T20:38:22.805705] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-23T20:38:22.805803] [INFO ] [MAIN ] Update Progress: 1643/2372 symbols completed. PBT took 32.2s. Estimated remaining: 1h 36m 52s. Rate: 7.5 symbols/min [2025-09-23T20:38:22.982396] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:38:23.007157] [DEBUG] [LOCAL ] PCN: Loaded 24213 existing records from primary storage. [2025-09-23T20:38:23.007338] [INFO ] [MAIN ] PCN: Loaded 24213 existing records. [2025-09-23T20:38:23.196800] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:38:23.197048] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-23T20:38:23.197097] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-23T20:38:23.197985] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-23T20:38:23.198047] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-23T20:38:23.411520] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-23T20:38:23.608941] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:38:23.612440] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T20:38:23.621691] [INFO ] [REMOTE ] PBI: Full fetch complete (71906 records). [2025-09-23T20:38:23.621874] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-23T20:38:23.755524] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T20:38:24.026244] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-23T20:38:24.026340] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-23T20:38:24.027391] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-23T20:38:24.027464] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-23T20:38:24.029062] [DEBUG] [LOCAL ] PBI: Trimmed 71906 records to 50044 (keeping 200 days of data) [2025-09-23T20:38:24.204380] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-23T20:38:24.336234] [DEBUG] [LOCAL ] PBI: Primary data saved (50044 records). [2025-09-23T20:38:24.336380] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-23T20:38:24.336464] [INFO ] [MAIN ] Update Progress: 1644/2372 symbols completed. PBI took 33.7s. Estimated remaining: 1h 36m 41s. Rate: 7.5 symbols/min [2025-09-23T20:38:24.514789] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:38:24.560099] [DEBUG] [LOCAL ] PCOR: Loaded 48114 existing records from primary storage. [2025-09-23T20:38:24.560250] [INFO ] [MAIN ] PCOR: Loaded 48114 existing records. [2025-09-23T20:38:24.736486] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:38:24.736743] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-23T20:38:24.736798] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-23T20:38:24.738410] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-23T20:38:24.738471] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-23T20:38:25.009283] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-23T20:38:25.092235] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:38:25.456626] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T20:38:25.562996] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-23T20:38:25.802199] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-23T20:38:25.991206] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T20:38:26.602292] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-23T20:38:27.279753] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T20:38:27.402167] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-23T20:38:27.719067] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T20:38:28.202210] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-23T20:38:28.713797] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T20:38:29.002225] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-23T20:38:29.308484] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T20:38:29.802191] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-23T20:38:30.602226] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-23T20:38:30.989265] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T20:38:31.026899] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T20:38:31.329560] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T20:38:31.402201] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-23T20:38:32.202192] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-23T20:38:32.499447] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T20:38:32.964069] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T20:38:33.002155] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-23T20:38:33.802230] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-23T20:38:33.858100] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-23T20:38:34.602264] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-23T20:38:34.975706] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T20:38:35.402237] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-23T20:38:36.202242] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-23T20:38:36.365132] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T20:38:36.716390] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T20:38:37.002865] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-23T20:38:37.016730] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T20:38:37.802216] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-23T20:38:38.338068] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T20:38:38.603614] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-23T20:38:38.608053] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T20:38:38.617856] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-09-23T20:38:38.618110] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-23T20:38:38.619273] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:38:38.619432] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:38:38.619501] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:38:38.619575] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-23T20:38:38.619677] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-23T20:38:38.619736] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-23T20:38:38.619809] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-09-23T20:38:38.619914] [INFO ] [MAIN ] Update Progress: 1645/2372 symbols completed. PCG took 31.5s. Estimated remaining: 1h 36m 36s. Rate: 7.5 symbols/min [2025-09-23T20:38:38.796944] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:38:38.809065] [DEBUG] [LOCAL ] PCQ: Loaded 11973 existing records from primary storage. [2025-09-23T20:38:38.809198] [INFO ] [MAIN ] PCQ: Loaded 11973 existing records. [2025-09-23T20:38:38.989059] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:38:38.989349] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-23T20:38:38.989401] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-23T20:38:38.989889] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-23T20:38:38.989948] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-23T20:38:39.344448] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:38:39.402200] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-23T20:38:39.814699] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T20:38:40.202196] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-23T20:38:40.635285] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T20:38:41.002188] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-23T20:38:41.456682] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T20:38:41.802211] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-23T20:38:42.141336] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T20:38:42.602207] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-23T20:38:42.992474] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T20:38:42.997380] [INFO ] [REMOTE ] PCN: Full fetch complete (33869 records). [2025-09-23T20:38:42.997464] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-23T20:38:43.390725] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-23T20:38:43.390490] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T20:38:43.390966] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-23T20:38:43.394080] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-23T20:38:43.394500] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-23T20:38:43.395490] [DEBUG] [LOCAL ] PCN: Trimmed 33869 records to 24269 (keeping 200 days of data) [2025-09-23T20:38:43.447360] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-23T20:38:43.550579] [DEBUG] [LOCAL ] PCN: Primary data saved (24269 records). [2025-09-23T20:38:43.550767] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-23T20:38:43.550870] [INFO ] [MAIN ] Update Progress: 1646/2372 symbols completed. PCN took 20.7s. Estimated remaining: 1h 36m 27s. Rate: 7.5 symbols/min [2025-09-23T20:38:43.729391] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:38:43.776479] [DEBUG] [LOCAL ] PD: Loaded 47862 existing records from primary storage. [2025-09-23T20:38:43.776634] [INFO ] [MAIN ] PD: Loaded 47862 existing records. [2025-09-23T20:38:43.967620] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:38:43.967922] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-23T20:38:43.967972] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-23T20:38:43.969292] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-23T20:38:43.969382] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-23T20:38:44.211066] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-23T20:38:44.379851] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:38:45.002190] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-23T20:38:45.268328] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T20:38:45.298166] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T20:38:45.802195] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-23T20:38:46.376856] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T20:38:46.602201] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-23T20:38:47.238600] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T20:38:47.402207] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-23T20:38:47.494672] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T20:38:48.202197] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-23T20:38:48.998414] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T20:38:49.006924] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-23T20:38:49.189892] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T20:38:49.773462] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T20:38:49.802246] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-23T20:38:50.602196] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-23T20:38:51.375779] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T20:38:51.402161] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-23T20:38:51.508072] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T20:38:52.202194] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-23T20:38:52.735078] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T20:38:53.002192] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-23T20:38:53.500103] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T20:38:53.589240] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T20:38:53.802187] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-23T20:38:54.586296] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T20:38:54.602256] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-23T20:38:55.317201] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T20:38:55.319572] [INFO ] [REMOTE ] PCM: Full fetch complete (10426 records). [2025-09-23T20:38:55.319676] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-23T20:38:55.407419] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-23T20:38:55.688289] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-23T20:38:55.688370] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-23T20:38:55.688679] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-23T20:38:55.688740] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-23T20:38:55.689235] [DEBUG] [LOCAL ] PCM: Trimmed 10426 records to 6808 (keeping 200 days of data) [2025-09-23T20:38:55.729511] [DEBUG] [LOCAL ] PCM: Primary data saved (6808 records). [2025-09-23T20:38:55.729655] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-23T20:38:55.729766] [INFO ] [MAIN ] Update Progress: 1647/2372 symbols completed. PCM took 34.3s. Estimated remaining: 1h 36m 21s. Rate: 7.5 symbols/min [2025-09-23T20:38:55.897201] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:38:55.897429] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-23T20:38:55.897471] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-23T20:38:55.897575] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-23T20:38:55.897613] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-23T20:38:55.897690] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-23T20:38:55.897767] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-23T20:38:56.204335] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-23T20:38:56.257963] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:38:56.271570] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T20:38:57.002235] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-23T20:38:57.802225] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-23T20:38:57.977639] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T20:38:58.191983] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-23T20:38:58.602198] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-23T20:38:58.647639] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T20:38:59.402213] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-23T20:39:00.202170] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-23T20:39:00.317785] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T20:39:01.005876] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-23T20:39:01.012549] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T20:39:01.344015] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-23T20:39:01.802249] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-23T20:39:02.602155] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-23T20:39:02.942788] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T20:39:03.402250] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-23T20:39:03.981305] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T20:39:04.202189] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-23T20:39:04.803197] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-23T20:39:04.811412] [INFO ] [REMOTE ] PCOR: Full fetch complete (69701 records). [2025-09-23T20:39:04.811534] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-23T20:39:05.008579] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-23T20:39:05.209862] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-23T20:39:05.209942] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-23T20:39:05.210999] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-23T20:39:05.211064] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-23T20:39:05.212452] [DEBUG] [LOCAL ] PCOR: Trimmed 69701 records to 48183 (keeping 200 days of data) [2025-09-23T20:39:05.272680] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T20:39:05.496917] [DEBUG] [LOCAL ] PCOR: Primary data saved (48183 records). [2025-09-23T20:39:05.497056] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-23T20:39:05.497142] [INFO ] [MAIN ] Update Progress: 1648/2372 symbols completed. PCOR took 41.2s. Estimated remaining: 1h 36m 14s. Rate: 7.5 symbols/min [2025-09-23T20:39:05.673108] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:39:05.721744] [DEBUG] [LOCAL ] PDI: Loaded 50242 existing records from primary storage. [2025-09-23T20:39:05.721884] [INFO ] [MAIN ] PDI: Loaded 50242 existing records. [2025-09-23T20:39:05.803035] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-23T20:39:05.910206] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:39:05.910488] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-23T20:39:05.910539] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-23T20:39:05.911867] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-23T20:39:05.911930] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-23T20:39:06.050162] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T20:39:06.148508] [INFO ] [REMOTE ] PCQ: Full fetch complete (17418 records). [2025-09-23T20:39:06.176559] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-23T20:39:06.409346] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:39:06.405944] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T20:39:06.602426] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-23T20:39:06.629532] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (3.23 seconds). [2025-09-23T20:39:06.721224] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-23T20:39:06.721304] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-23T20:39:06.721760] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-23T20:39:06.721826] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-23T20:39:06.722359] [DEBUG] [LOCAL ] PCQ: Trimmed 17418 records to 11979 (keeping 200 days of data) [2025-09-23T20:39:06.794268] [DEBUG] [LOCAL ] PCQ: Primary data saved (11979 records). [2025-09-23T20:39:06.794416] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-23T20:39:06.794511] [INFO ] [MAIN ] Update Progress: 1649/2372 symbols completed. PCQ took 28.2s. Estimated remaining: 1h 36m 3s. Rate: 7.5 symbols/min [2025-09-23T20:39:06.960757] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:39:06.996976] [DEBUG] [LOCAL ] PDM: Loaded 39828 existing records from primary storage. [2025-09-23T20:39:06.997123] [INFO ] [MAIN ] PDM: Loaded 39828 existing records. [2025-09-23T20:39:07.166246] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-23T20:39:07.179862] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:39:07.180029] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-23T20:39:07.180076] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-23T20:39:07.181088] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-23T20:39:07.181150] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-23T20:39:07.407352] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-23T20:39:07.540425] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:39:08.202248] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-23T20:39:09.002279] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-23T20:39:09.479888] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T20:39:09.520413] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-23T20:39:09.686076] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T20:39:09.802154] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-23T20:39:10.602189] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-23T20:39:11.402196] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-23T20:39:11.484829] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T20:39:11.800040] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T20:39:12.202170] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-23T20:39:12.275124] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T20:39:13.002239] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-23T20:39:13.651902] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T20:39:13.802215] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-23T20:39:14.602216] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-23T20:39:14.721410] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T20:39:15.402163] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-23T20:39:15.827409] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-23T20:39:16.202249] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-23T20:39:16.663736] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T20:39:17.002219] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-23T20:39:17.311148] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-23T20:39:17.746156] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T20:39:17.746929] [INFO ] [REMOTE ] PDCC: Full fetch complete (1323 records). [2025-09-23T20:39:17.746998] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-23T20:39:17.809503] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-23T20:39:17.932518] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-23T20:39:17.932874] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:39:17.932952] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:39:17.942282] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-23T20:39:17.955979] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-23T20:39:17.958668] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-23T20:39:17.958761] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-23T20:39:17.960306] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-23T20:39:17.959423] [INFO ] [MAIN ] Update Progress: 1650/2372 symbols completed. PDCC took 22.2s. Estimated remaining: 1h 35m 56s. Rate: 7.5 symbols/min [2025-09-23T20:39:18.144967] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:39:18.178790] [DEBUG] [LOCAL ] PDO: Loaded 31798 existing records from primary storage. [2025-09-23T20:39:18.178924] [INFO ] [MAIN ] PDO: Loaded 31798 existing records. [2025-09-23T20:39:18.355206] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:39:18.355518] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-23T20:39:18.355574] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-23T20:39:18.356467] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-23T20:39:18.356531] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-23T20:39:18.609357] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-23T20:39:18.720130] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:39:19.402169] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-23T20:39:19.689897] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T20:39:19.698522] [INFO ] [REMOTE ] PD: Full fetch complete (67528 records). [2025-09-23T20:39:19.698694] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-23T20:39:20.089359] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-23T20:39:20.089455] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-23T20:39:20.090429] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-23T20:39:20.090507] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-23T20:39:20.092019] [DEBUG] [LOCAL ] PD: Trimmed 67528 records to 47890 (keeping 200 days of data) [2025-09-23T20:39:20.202218] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-23T20:39:20.383046] [DEBUG] [LOCAL ] PD: Primary data saved (47890 records). [2025-09-23T20:39:20.383177] [INFO ] [MAIN ] PD: Full history saved. [2025-09-23T20:39:20.383259] [INFO ] [MAIN ] Update Progress: 1651/2372 symbols completed. PD took 36.8s. Estimated remaining: 1h 35m 46s. Rate: 7.5 symbols/min [2025-09-23T20:39:20.578219] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:39:20.594103] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-23T20:39:20.620268] [DEBUG] [LOCAL ] PDS: Loaded 18281 existing records from primary storage. [2025-09-23T20:39:20.620578] [INFO ] [MAIN ] PDS: Loaded 18281 existing records. [2025-09-23T20:39:20.803791] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:39:20.804138] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-23T20:39:20.804225] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-23T20:39:20.813069] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-23T20:39:20.826449] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-23T20:39:20.896582] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T20:39:21.003730] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-23T20:39:21.209795] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:39:21.807503] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-23T20:39:21.815689] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T20:39:22.252287] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T20:39:22.602236] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-23T20:39:23.071107] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T20:39:23.402208] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-23T20:39:23.955225] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T20:39:24.202174] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-23T20:39:24.398567] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T20:39:25.002190] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-23T20:39:25.586447] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T20:39:25.802233] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-23T20:39:26.048581] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T20:39:26.602208] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-23T20:39:27.243403] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T20:39:27.402265] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-23T20:39:28.189062] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T20:39:28.202146] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-23T20:39:28.501348] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T20:39:29.002234] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-23T20:39:29.802197] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-23T20:39:29.961122] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T20:39:30.449756] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T20:39:30.602164] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-23T20:39:31.315263] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T20:39:31.402200] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-23T20:39:31.822060] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T20:39:32.202249] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-23T20:39:32.381105] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T20:39:33.002231] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-23T20:39:33.204776] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T20:39:33.802208] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-23T20:39:34.506741] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T20:39:34.602262] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-23T20:39:35.348147] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T20:39:35.402166] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-23T20:39:35.713662] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T20:39:36.202206] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-23T20:39:37.002197] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-23T20:39:37.168866] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T20:39:37.545418] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T20:39:37.802204] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-23T20:39:38.065282] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T20:39:38.511858] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T20:39:38.602153] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-23T20:39:39.402219] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-23T20:39:39.616478] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T20:39:40.202192] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-23T20:39:40.565898] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T20:39:40.572925] [INFO ] [REMOTE ] PDM: Full fetch complete (57259 records). [2025-09-23T20:39:40.573040] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-23T20:39:40.961943] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-23T20:39:40.962028] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-23T20:39:40.962885] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-23T20:39:40.962947] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-23T20:39:40.964235] [DEBUG] [LOCAL ] PDM: Trimmed 57259 records to 39851 (keeping 200 days of data) [2025-09-23T20:39:41.011609] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-23T20:39:41.207967] [DEBUG] [LOCAL ] PDM: Primary data saved (39851 records). [2025-09-23T20:39:41.208166] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-23T20:39:41.208357] [INFO ] [MAIN ] Update Progress: 1652/2372 symbols completed. PDM took 34.4s. Estimated remaining: 1h 35m 43s. Rate: 7.5 symbols/min [2025-09-23T20:39:41.390050] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:39:41.412255] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T20:39:41.432445] [DEBUG] [LOCAL ] PDT: Loaded 17373 existing records from primary storage. [2025-09-23T20:39:41.432568] [INFO ] [MAIN ] PDT: Loaded 17373 existing records. [2025-09-23T20:39:41.611893] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:39:41.612207] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-23T20:39:41.612286] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-23T20:39:41.613054] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-23T20:39:41.613140] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-23T20:39:41.800664] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T20:39:41.813736] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-23T20:39:41.880361] [INFO ] [REMOTE ] PDS: Full fetch complete (25680 records). [2025-09-23T20:39:41.901694] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-23T20:39:42.208305] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:39:42.557333] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-23T20:39:42.557458] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-23T20:39:42.558679] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-23T20:39:42.558778] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-23T20:39:42.560731] [DEBUG] [LOCAL ] PDS: Trimmed 25680 records to 18197 (keeping 200 days of data) [2025-09-23T20:39:42.639240] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-23T20:39:42.749142] [DEBUG] [LOCAL ] PDS: Primary data saved (18197 records). [2025-09-23T20:39:42.749363] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-23T20:39:42.749526] [INFO ] [MAIN ] Update Progress: 1653/2372 symbols completed. PDS took 22.4s. Estimated remaining: 1h 35m 33s. Rate: 7.5 symbols/min [2025-09-23T20:39:43.057417] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:39:43.084308] [DEBUG] [LOCAL ] PDX: Loaded 14466 existing records from primary storage. [2025-09-23T20:39:43.084530] [INFO ] [MAIN ] PDX: Loaded 14466 existing records. [2025-09-23T20:39:43.291909] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:39:43.292380] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-23T20:39:43.292776] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-23T20:39:43.293926] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-23T20:39:43.294054] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-23T20:39:43.404592] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-23T20:39:43.532063] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T20:39:43.734206] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:39:44.101781] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T20:39:44.202211] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-23T20:39:44.897199] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T20:39:45.002204] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-23T20:39:45.099451] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T20:39:45.802210] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-23T20:39:45.948109] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T20:39:46.602224] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-23T20:39:47.402276] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-23T20:39:47.710964] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-23T20:39:48.029558] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T20:39:48.202192] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-23T20:39:48.465841] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T20:39:49.002211] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-23T20:39:49.101120] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T20:39:49.802164] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-23T20:39:50.174719] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T20:39:50.602183] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-23T20:39:50.896308] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T20:39:50.905544] [INFO ] [REMOTE ] PDO: Full fetch complete (48141 records). [2025-09-23T20:39:50.905819] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-23T20:39:51.335494] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-23T20:39:51.335674] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-23T20:39:51.336830] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-23T20:39:51.336961] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-23T20:39:51.340221] [DEBUG] [LOCAL ] PDO: Trimmed 48141 records to 31798 (keeping 200 days of data) [2025-09-23T20:39:51.403592] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-23T20:39:51.582242] [DEBUG] [LOCAL ] PDO: Primary data saved (31798 records). [2025-09-23T20:39:51.582472] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-23T20:39:51.582794] [INFO ] [MAIN ] Update Progress: 1654/2372 symbols completed. PDO took 33.6s. Estimated remaining: 1h 35m 25s. Rate: 7.5 symbols/min [2025-09-23T20:39:51.728051] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T20:39:51.795755] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:39:51.863273] [DEBUG] [LOCAL ] PEB: Loaded 50729 existing records from primary storage. [2025-09-23T20:39:51.863513] [INFO ] [MAIN ] PEB: Loaded 50729 existing records. [2025-09-23T20:39:52.066845] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:39:52.067544] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-23T20:39:52.067733] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-23T20:39:52.068960] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-23T20:39:52.069044] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-23T20:39:52.202207] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-23T20:39:52.203895] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T20:39:52.569720] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:39:53.002275] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-23T20:39:53.802231] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-23T20:39:54.142207] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T20:39:54.156355] [INFO ] [REMOTE ] PDI: Full fetch complete (73081 records). [2025-09-23T20:39:54.156520] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-23T20:39:54.304021] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T20:39:54.594931] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-23T20:39:54.595153] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-23T20:39:54.596375] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-23T20:39:54.596505] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-23T20:39:54.598671] [DEBUG] [LOCAL ] PDI: Trimmed 73081 records to 50218 (keeping 200 days of data) [2025-09-23T20:39:54.602282] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-23T20:39:54.932268] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T20:39:54.953145] [DEBUG] [LOCAL ] PDI: Primary data saved (50218 records). [2025-09-23T20:39:54.953300] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-23T20:39:54.953414] [INFO ] [MAIN ] Update Progress: 1655/2372 symbols completed. PDI took 49.5s. Estimated remaining: 1h 35m 15s. Rate: 7.5 symbols/min [2025-09-23T20:39:55.120832] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:39:55.121036] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-23T20:39:55.121072] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-23T20:39:55.121276] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-23T20:39:55.121321] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-23T20:39:55.121362] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-23T20:39:55.121397] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-23T20:39:55.407586] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-23T20:39:55.494067] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:39:56.202239] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-23T20:39:56.304423] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T20:39:56.352019] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T20:39:57.002193] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-23T20:39:57.802212] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-23T20:39:58.118136] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T20:39:58.152817] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T20:39:58.602264] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-23T20:39:58.726785] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T20:39:59.402283] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-23T20:40:00.202201] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-23T20:40:00.430878] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T20:40:00.496708] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T20:40:00.965995] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T20:40:01.002144] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-23T20:40:01.802206] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-23T20:40:01.883947] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T20:40:02.602247] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-23T20:40:02.768046] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T20:40:03.402231] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-23T20:40:04.202186] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-23T20:40:04.313344] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T20:40:05.002423] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-23T20:40:05.134206] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T20:40:05.134672] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T20:40:05.149062] [INFO ] [REMOTE ] PDX: Full fetch complete (24677 records). [2025-09-23T20:40:05.149277] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-23T20:40:05.577299] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-23T20:40:05.577394] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-23T20:40:05.578044] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-23T20:40:05.578106] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-23T20:40:05.578748] [DEBUG] [LOCAL ] PDX: Trimmed 24677 records to 14342 (keeping 200 days of data) [2025-09-23T20:40:05.670285] [DEBUG] [LOCAL ] PDX: Primary data saved (14342 records). [2025-09-23T20:40:05.670441] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-23T20:40:05.670551] [INFO ] [MAIN ] Update Progress: 1656/2372 symbols completed. PDX took 22.9s. Estimated remaining: 1h 35m 8s. Rate: 7.5 symbols/min [2025-09-23T20:40:05.810949] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-23T20:40:05.846242] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:40:05.890526] [DEBUG] [LOCAL ] PEN: Loaded 30535 existing records from primary storage. [2025-09-23T20:40:05.890737] [INFO ] [MAIN ] PEN: Loaded 30535 existing records. [2025-09-23T20:40:06.042550] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T20:40:06.073398] [INFO ] [REMOTE ] PDT: Full fetch complete (25071 records). [2025-09-23T20:40:06.083069] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-23T20:40:06.086932] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:40:06.129427] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-23T20:40:06.166675] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-23T20:40:06.187385] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-23T20:40:06.187507] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-23T20:40:06.617396] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-23T20:40:06.742217] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-23T20:40:06.754121] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-23T20:40:06.754824] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-23T20:40:06.754954] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-23T20:40:06.814077] [DEBUG] [LOCAL ] PDT: Trimmed 25071 records to 17267 (keeping 200 days of data) [2025-09-23T20:40:06.835103] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:40:06.957562] [DEBUG] [LOCAL ] PDT: Primary data saved (17267 records). [2025-09-23T20:40:06.957748] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-23T20:40:06.957859] [INFO ] [MAIN ] Update Progress: 1657/2372 symbols completed. PDT took 25.7s. Estimated remaining: 1h 34m 57s. Rate: 7.5 symbols/min [2025-09-23T20:40:07.130351] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:40:07.143762] [DEBUG] [LOCAL ] PEO: Loaded 10828 existing records from primary storage. [2025-09-23T20:40:07.143886] [INFO ] [MAIN ] PEO: Loaded 10828 existing records. [2025-09-23T20:40:07.338676] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:40:07.339707] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-23T20:40:07.339765] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-23T20:40:07.340619] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-23T20:40:07.340725] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-23T20:40:07.412596] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-23T20:40:07.759705] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:40:07.762471] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T20:40:08.208041] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-23T20:40:08.230151] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T20:40:08.433425] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T20:40:09.002230] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-23T20:40:09.802254] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-23T20:40:09.945613] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T20:40:10.602172] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-23T20:40:10.679036] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T20:40:10.976724] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T20:40:11.402202] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-23T20:40:12.185971] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T20:40:12.202136] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-23T20:40:13.002243] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-23T20:40:13.368636] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-23T20:40:13.619135] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T20:40:13.802259] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-23T20:40:14.407718] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T20:40:14.602301] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-23T20:40:15.217024] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T20:40:15.402259] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-23T20:40:16.202184] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-23T20:40:16.379073] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T20:40:16.413764] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T20:40:17.002218] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-23T20:40:17.689156] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T20:40:17.709687] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T20:40:17.802162] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-23T20:40:18.602195] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-23T20:40:19.331221] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T20:40:19.402176] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-23T20:40:19.494451] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T20:40:20.202222] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-23T20:40:20.997032] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T20:40:21.004054] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-23T20:40:21.802156] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-23T20:40:22.084066] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-23T20:40:22.596633] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T20:40:22.607140] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-23T20:40:22.684539] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T20:40:23.402253] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-23T20:40:24.202207] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-23T20:40:24.663101] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T20:40:24.696182] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T20:40:25.002204] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-23T20:40:25.473560] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T20:40:25.802263] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-23T20:40:26.602175] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-23T20:40:26.722801] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T20:40:26.949677] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-23T20:40:27.402268] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-23T20:40:27.841725] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T20:40:27.851737] [INFO ] [REMOTE ] PEG: Full fetch complete (76279 records). [2025-09-23T20:40:27.852056] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-23T20:40:27.852978] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:40:27.853067] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:40:27.853110] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:40:27.853148] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-23T20:40:27.853206] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-23T20:40:27.853240] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-23T20:40:27.853305] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-09-23T20:40:27.853402] [INFO ] [MAIN ] Update Progress: 1658/2372 symbols completed. PEG took 32.9s. Estimated remaining: 1h 34m 55s. Rate: 7.5 symbols/min [2025-09-23T20:40:28.063211] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:40:28.065281] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T20:40:28.079154] [INFO ] [REMOTE ] PEB: Full fetch complete (72763 records). [2025-09-23T20:40:28.079342] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-23T20:40:28.195204] [DEBUG] [LOCAL ] PERF: Loaded 13989 existing records from primary storage. [2025-09-23T20:40:28.207503] [INFO ] [MAIN ] PERF: Loaded 13989 existing records. [2025-09-23T20:40:28.212717] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-23T20:40:28.617639] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:40:28.628178] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-23T20:40:28.646350] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-23T20:40:28.680521] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-23T20:40:28.685887] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-23T20:40:28.735446] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-23T20:40:28.746952] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-23T20:40:28.774014] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-23T20:40:28.795700] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-23T20:40:28.833399] [DEBUG] [LOCAL ] PEB: Trimmed 72763 records to 50733 (keeping 200 days of data) [2025-09-23T20:40:29.029304] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-23T20:40:29.165000] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:40:29.190813] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T20:40:29.389098] [DEBUG] [LOCAL ] PEB: Primary data saved (50733 records). [2025-09-23T20:40:29.389238] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-23T20:40:29.389323] [INFO ] [MAIN ] Update Progress: 1659/2372 symbols completed. PEB took 37.8s. Estimated remaining: 1h 34m 44s. Rate: 7.5 symbols/min [2025-09-23T20:40:29.559801] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:40:29.559951] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-23T20:40:29.559989] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-23T20:40:29.560134] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-23T20:40:29.560178] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-23T20:40:29.560225] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-23T20:40:29.560261] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-23T20:40:29.807457] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-23T20:40:29.923995] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:40:30.420428] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T20:40:30.602240] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-23T20:40:30.994800] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T20:40:31.402268] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-23T20:40:31.568956] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T20:40:31.573694] [INFO ] [REMOTE ] PEN: Full fetch complete (43957 records). [2025-09-23T20:40:31.573797] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-23T20:40:31.947980] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-23T20:40:31.948067] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-23T20:40:31.948854] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-23T20:40:31.948916] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-23T20:40:31.949924] [DEBUG] [LOCAL ] PEN: Trimmed 43957 records to 30520 (keeping 200 days of data) [2025-09-23T20:40:32.142595] [DEBUG] [LOCAL ] PEN: Primary data saved (30520 records). [2025-09-23T20:40:32.142993] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-23T20:40:32.143141] [INFO ] [MAIN ] Update Progress: 1660/2372 symbols completed. PEN took 26.5s. Estimated remaining: 1h 34m 34s. Rate: 7.5 symbols/min [2025-09-23T20:40:32.207685] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-23T20:40:32.288699] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T20:40:32.340017] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:40:32.349187] [DEBUG] [LOCAL ] PFD: Loaded 5143 existing records from primary storage. [2025-09-23T20:40:32.349330] [INFO ] [MAIN ] PFD: Loaded 5143 existing records. [2025-09-23T20:40:32.507443] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:40:32.533755] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-23T20:40:32.538458] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:40:32.539289] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-23T20:40:32.539343] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-23T20:40:32.539623] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-23T20:40:32.539720] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-23T20:40:32.917334] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:40:33.002202] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-23T20:40:33.802165] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-23T20:40:34.126016] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T20:40:34.340540] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T20:40:34.602207] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-23T20:40:34.871459] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:40:34.871816] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-23T20:40:35.402222] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-23T20:40:36.202179] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-23T20:40:36.518503] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T20:40:37.002202] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-23T20:40:37.093144] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T20:40:37.802182] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-23T20:40:37.849619] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T20:40:38.602203] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-23T20:40:38.904859] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T20:40:39.402277] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-23T20:40:39.430804] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T20:40:39.433729] [INFO ] [REMOTE ] PEO: Full fetch complete (16404 records). [2025-09-23T20:40:39.433841] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-23T20:40:39.679721] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:40:39.729415] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-23T20:40:39.825934] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-23T20:40:39.826048] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-23T20:40:39.826528] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-23T20:40:39.826589] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-23T20:40:39.827145] [DEBUG] [LOCAL ] PEO: Trimmed 16404 records to 10835 (keeping 200 days of data) [2025-09-23T20:40:39.899128] [DEBUG] [LOCAL ] PEO: Primary data saved (10835 records). [2025-09-23T20:40:39.899286] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-23T20:40:39.899381] [INFO ] [MAIN ] Update Progress: 1661/2372 symbols completed. PEO took 32.9s. Estimated remaining: 1h 34m 26s. Rate: 7.5 symbols/min [2025-09-23T20:40:40.067558] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:40:40.067817] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-23T20:40:40.067874] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-23T20:40:40.068021] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-23T20:40:40.068063] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-23T20:40:40.068104] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-23T20:40:40.068137] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-23T20:40:40.208497] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-23T20:40:40.431964] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:40:40.562837] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:40:40.563204] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-23T20:40:41.002208] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-23T20:40:41.254405] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:40:41.254756] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-23T20:40:41.802222] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-23T20:40:42.602213] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-23T20:40:43.224374] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T20:40:43.402196] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-23T20:40:44.156842] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T20:40:44.202189] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-23T20:40:44.359274] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-23T20:40:44.740293] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T20:40:45.002231] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-23T20:40:45.802200] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-23T20:40:46.222237] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:40:46.222676] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-23T20:40:46.602200] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-23T20:40:47.023450] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:40:47.023808] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-23T20:40:47.402170] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-23T20:40:47.501120] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-23T20:40:48.035672] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T20:40:48.202228] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-23T20:40:49.002947] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-23T20:40:49.005622] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T20:40:49.802195] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-23T20:40:50.602222] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-23T20:40:50.782266] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T20:40:51.402223] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-23T20:40:51.691583] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T20:40:52.182526] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-23T20:40:52.202155] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-23T20:40:52.641102] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-23T20:40:52.933449] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T20:40:53.002238] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-23T20:40:53.802262] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-23T20:40:54.584977] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T20:40:54.591788] [INFO ] [REMOTE ] PEW: Full fetch complete (15450 records). [2025-09-23T20:40:54.591960] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-23T20:40:54.607394] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-23T20:40:54.816068] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 49 unique days, need 200 days [2025-09-23T20:40:54.816395] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:40:54.816467] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:40:54.816539] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-23T20:40:54.816606] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-23T20:40:54.816666] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-23T20:40:54.816735] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-23T20:40:54.816797] [INFO ] [MAIN ] Update Progress: 1662/2372 symbols completed. PEW took 25.4s. Estimated remaining: 1h 34m 21s. Rate: 7.5 symbols/min [2025-09-23T20:40:54.999096] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:40:55.045261] [DEBUG] [LOCAL ] PFGC: Loaded 47028 existing records from primary storage. [2025-09-23T20:40:55.045442] [INFO ] [MAIN ] PFGC: Loaded 47028 existing records. [2025-09-23T20:40:55.226335] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:40:55.226605] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-23T20:40:55.226678] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-23T20:40:55.228038] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-23T20:40:55.228100] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-23T20:40:55.409788] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-23T20:40:55.587792] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:40:55.950168] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T20:40:55.966313] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T20:40:56.202236] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-23T20:40:56.606340] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-09-23T20:40:56.912972] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T20:40:57.002262] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-23T20:40:57.802218] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-23T20:40:58.094113] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T20:40:58.585356] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T20:40:58.602139] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-23T20:40:59.402162] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-23T20:40:59.439413] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T20:41:00.202224] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-23T20:41:00.897762] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T20:41:00.899401] [INFO ] [REMOTE ] PFD: Full fetch complete (7357 records). [2025-09-23T20:41:00.899470] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-23T20:41:01.007421] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-23T20:41:01.278980] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-23T20:41:01.279069] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-23T20:41:01.279316] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-23T20:41:01.279357] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-23T20:41:01.279831] [DEBUG] [LOCAL ] PFD: Trimmed 7357 records to 5136 (keeping 200 days of data) [2025-09-23T20:41:01.313040] [DEBUG] [LOCAL ] PFD: Primary data saved (5136 records). [2025-09-23T20:41:01.313188] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-23T20:41:01.313321] [INFO ] [MAIN ] Update Progress: 1663/2372 symbols completed. PFD took 29.2s. Estimated remaining: 1h 34m 12s. Rate: 7.5 symbols/min [2025-09-23T20:41:01.511395] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:01.521002] [DEBUG] [LOCAL ] PFH: Loaded 6912 existing records from primary storage. [2025-09-23T20:41:01.521125] [INFO ] [MAIN ] PFH: Loaded 6912 existing records. [2025-09-23T20:41:01.717772] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:41:01.718063] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-23T20:41:01.718129] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-23T20:41:01.718613] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-23T20:41:01.718723] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-23T20:41:01.804445] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-23T20:41:02.148868] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:41:02.180098] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-23T20:41:02.503512] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T20:41:02.506280] [INFO ] [REMOTE ] PERF: Full fetch complete (21966 records). [2025-09-23T20:41:02.506455] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-23T20:41:02.607398] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-23T20:41:02.950062] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-23T20:41:02.964810] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-23T20:41:02.965143] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-23T20:41:02.965894] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-23T20:41:02.965974] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-23T20:41:02.967307] [DEBUG] [LOCAL ] PERF: Trimmed 21966 records to 14019 (keeping 200 days of data) [2025-09-23T20:41:03.050496] [DEBUG] [LOCAL ] PERF: Primary data saved (14019 records). [2025-09-23T20:41:03.050664] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-23T20:41:03.050776] [INFO ] [MAIN ] Update Progress: 1664/2372 symbols completed. PERF took 35.2s. Estimated remaining: 1h 34m 2s. Rate: 7.5 symbols/min [2025-09-23T20:41:03.229980] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:03.245020] [DEBUG] [LOCAL ] PFL: Loaded 13814 existing records from primary storage. [2025-09-23T20:41:03.245151] [INFO ] [MAIN ] PFL: Loaded 13814 existing records. [2025-09-23T20:41:03.411987] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-23T20:41:03.436448] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:41:03.437935] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-23T20:41:03.438030] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-23T20:41:03.438541] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-23T20:41:03.438607] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-23T20:41:03.762971] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T20:41:03.831483] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:41:04.202226] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-23T20:41:04.917199] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T20:41:04.990472] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T20:41:05.002150] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-23T20:41:05.591737] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T20:41:05.802212] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-23T20:41:06.602232] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-23T20:41:07.115208] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T20:41:07.340522] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-23T20:41:07.402253] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-23T20:41:08.202211] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-23T20:41:09.002171] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-23T20:41:09.126385] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T20:41:09.802250] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-23T20:41:09.849432] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-23T20:41:10.250463] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T20:41:10.306861] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T20:41:10.602197] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-23T20:41:11.402244] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-23T20:41:12.202244] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-23T20:41:13.002183] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-23T20:41:13.101598] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T20:41:13.262475] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-23T20:41:13.286384] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T20:41:13.523691] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T20:41:13.802269] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-23T20:41:14.602243] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-23T20:41:14.701667] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T20:41:15.402234] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-23T20:41:16.202203] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-23T20:41:16.254013] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T20:41:16.565238] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T20:41:17.002219] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-23T20:41:17.722715] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T20:41:17.802217] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-23T20:41:18.602251] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-23T20:41:18.638397] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T20:41:18.798308] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-23T20:41:19.237420] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T20:41:19.402249] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-23T20:41:20.136844] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T20:41:20.202244] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-23T20:41:21.002180] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-23T20:41:21.320143] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T20:41:21.802208] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-23T20:41:22.602160] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-23T20:41:22.913991] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T20:41:23.362423] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T20:41:23.402253] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-23T20:41:23.738070] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-23T20:41:24.202363] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-23T20:41:24.542801] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T20:41:24.545899] [INFO ] [REMOTE ] PFL: Full fetch complete (20170 records). [2025-09-23T20:41:24.545978] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-23T20:41:24.950247] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-23T20:41:24.950326] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-23T20:41:24.950780] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-23T20:41:24.950843] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-23T20:41:24.951404] [DEBUG] [LOCAL ] PFL: Trimmed 20170 records to 13823 (keeping 200 days of data) [2025-09-23T20:41:25.009746] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-23T20:41:25.034490] [DEBUG] [LOCAL ] PFL: Primary data saved (13823 records). [2025-09-23T20:41:25.034590] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-23T20:41:25.034693] [INFO ] [MAIN ] Update Progress: 1665/2372 symbols completed. PFL took 22.0s. Estimated remaining: 1h 33m 60s. Rate: 7.5 symbols/min [2025-09-23T20:41:25.203188] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:25.244014] [DEBUG] [LOCAL ] PFLT: Loaded 43652 existing records from primary storage. [2025-09-23T20:41:25.244181] [INFO ] [MAIN ] PFLT: Loaded 43652 existing records. [2025-09-23T20:41:25.425230] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:41:25.425558] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-23T20:41:25.425664] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-23T20:41:25.427165] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-23T20:41:25.427227] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-23T20:41:25.794136] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:41:25.807270] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-23T20:41:25.824059] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T20:41:26.041364] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T20:41:26.049937] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-09-23T20:41:26.050070] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-23T20:41:26.050963] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:41:26.051051] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:41:26.051094] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:41:26.051168] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-23T20:41:26.051233] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-23T20:41:26.051269] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-23T20:41:26.051307] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-09-23T20:41:26.051363] [INFO ] [MAIN ] Update Progress: 1666/2372 symbols completed. PFE took 46.2s. Estimated remaining: 1h 33m 49s. Rate: 7.5 symbols/min [2025-09-23T20:41:26.237011] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:26.237182] [DEBUG] [LOCAL ] PFN: No existing data file found in primary storage. [2025-09-23T20:41:26.237221] [WARN ] [MAIN ] PFN: No existing data found, performing full refresh instead. [2025-09-23T20:41:26.237370] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-23T20:41:26.237413] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-23T20:41:26.237457] [DEBUG] [LOCAL ] PFN: No primary data file found to delete. [2025-09-23T20:41:26.237491] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-23T20:41:26.608812] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-23T20:41:26.608704] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:41:27.212070] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T20:41:27.213825] [INFO ] [REMOTE ] PFH: Full fetch complete (10679 records). [2025-09-23T20:41:27.213896] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-23T20:41:27.409664] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-23T20:41:27.611460] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-23T20:41:27.612084] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-23T20:41:27.612366] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-23T20:41:27.613209] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T20:41:27.613294] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-23T20:41:27.622825] [DEBUG] [LOCAL ] PFH: Trimmed 10679 records to 6888 (keeping 200 days of data) [2025-09-23T20:41:27.663808] [DEBUG] [LOCAL ] PFH: Primary data saved (6888 records). [2025-09-23T20:41:27.663927] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-23T20:41:27.664022] [INFO ] [MAIN ] Update Progress: 1667/2372 symbols completed. PFH took 26.4s. Estimated remaining: 1h 33m 38s. Rate: 7.5 symbols/min [2025-09-23T20:41:27.839216] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:27.847348] [DEBUG] [LOCAL ] PFO: Loaded 5850 existing records from primary storage. [2025-09-23T20:41:27.847516] [INFO ] [MAIN ] PFO: Loaded 5850 existing records. [2025-09-23T20:41:28.025858] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:41:28.026080] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-23T20:41:28.026127] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-23T20:41:28.026429] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-23T20:41:28.026488] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-23T20:41:28.208333] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-23T20:41:28.384267] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:41:28.842748] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T20:41:29.002251] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-23T20:41:29.802223] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-23T20:41:29.862449] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T20:41:29.923411] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T20:41:30.602327] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-23T20:41:31.252272] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T20:41:31.375240] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T20:41:31.402158] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-23T20:41:32.202221] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-23T20:41:33.002253] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-23T20:41:33.056358] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T20:41:33.628533] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-23T20:41:33.802189] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-23T20:41:33.909975] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T20:41:34.607329] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-23T20:41:34.619964] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T20:41:35.402215] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-23T20:41:36.036317] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T20:41:36.202539] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-23T20:41:36.312407] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T20:41:36.601413] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T20:41:37.002241] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-23T20:41:37.705930] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T20:41:37.802230] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-23T20:41:38.602229] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-23T20:41:39.353487] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T20:41:39.402165] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-23T20:41:39.676045] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T20:41:40.029115] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T20:41:40.202190] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-23T20:41:41.002193] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-23T20:41:41.345581] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T20:41:41.802207] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-23T20:41:42.602187] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-23T20:41:42.922111] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-23T20:41:43.104443] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T20:41:43.402194] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-23T20:41:44.101172] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T20:41:44.167796] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T20:41:44.175982] [INFO ] [REMOTE ] PFGC: Full fetch complete (67199 records). [2025-09-23T20:41:44.176114] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-23T20:41:44.207406] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-23T20:41:44.614411] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-23T20:41:44.614505] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-23T20:41:44.615715] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-23T20:41:44.615802] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-23T20:41:44.617423] [DEBUG] [LOCAL ] PFGC: Trimmed 67199 records to 46970 (keeping 200 days of data) [2025-09-23T20:41:44.914978] [DEBUG] [LOCAL ] PFGC: Primary data saved (46970 records). [2025-09-23T20:41:44.915211] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-23T20:41:44.915340] [INFO ] [MAIN ] Update Progress: 1668/2372 symbols completed. PFGC took 50.1s. Estimated remaining: 1h 33m 34s. Rate: 7.5 symbols/min [2025-09-23T20:41:45.007434] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-23T20:41:45.118900] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:45.154141] [DEBUG] [LOCAL ] PFS: Loaded 35756 existing records from primary storage. [2025-09-23T20:41:45.154283] [INFO ] [MAIN ] PFS: Loaded 35756 existing records. [2025-09-23T20:41:45.349407] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:41:45.349990] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-23T20:41:45.364275] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-23T20:41:45.365302] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T20:41:45.370624] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-23T20:41:45.370733] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-23T20:41:45.808031] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-23T20:41:45.815065] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:41:46.602262] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-23T20:41:46.630193] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T20:41:46.804691] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T20:41:47.402215] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-23T20:41:47.494345] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T20:41:48.202231] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-23T20:41:48.395542] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T20:41:48.398021] [INFO ] [REMOTE ] PFO: Full fetch complete (7851 records). [2025-09-23T20:41:48.398098] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-23T20:41:48.772296] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-23T20:41:48.772383] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-23T20:41:48.772616] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-23T20:41:48.772683] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-23T20:41:48.773110] [DEBUG] [LOCAL ] PFO: Trimmed 7851 records to 5868 (keeping 200 days of data) [2025-09-23T20:41:48.807449] [DEBUG] [LOCAL ] PFO: Primary data saved (5868 records). [2025-09-23T20:41:48.807557] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-23T20:41:48.807665] [INFO ] [MAIN ] Update Progress: 1669/2372 symbols completed. PFO took 21.1s. Estimated remaining: 1h 33m 24s. Rate: 7.5 symbols/min [2025-09-23T20:41:48.981091] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:49.002977] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-23T20:41:49.016388] [DEBUG] [LOCAL ] PFSI: Loaded 28855 existing records from primary storage. [2025-09-23T20:41:49.016532] [INFO ] [MAIN ] PFSI: Loaded 28855 existing records. [2025-09-23T20:41:49.209464] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:41:49.209819] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-23T20:41:49.209870] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-23T20:41:49.211041] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-23T20:41:49.211103] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-23T20:41:49.534261] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T20:41:49.595680] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:41:49.802215] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-23T20:41:50.602217] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-23T20:41:50.651259] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T20:41:50.954526] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T20:41:51.402242] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-23T20:41:51.770468] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T20:41:52.202210] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-23T20:41:52.400612] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T20:41:53.002283] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-23T20:41:53.645129] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T20:41:53.802240] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-23T20:41:54.343791] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T20:41:54.602189] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-23T20:41:55.145821] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T20:41:55.402194] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-23T20:41:55.498029] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T20:41:56.202242] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-23T20:41:57.002198] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-23T20:41:57.128698] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T20:41:57.142100] [INFO ] [REMOTE ] PFLT: Full fetch complete (63223 records). [2025-09-23T20:41:57.148007] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T20:41:57.147581] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-23T20:41:57.152767] [INFO ] [REMOTE ] PFN: Full fetch complete (30608 records). [2025-09-23T20:41:57.197559] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-23T20:41:57.811211] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-23T20:41:57.977156] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-23T20:41:57.977021] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-23T20:41:57.977294] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-23T20:41:57.977414] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-23T20:41:57.978401] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-23T20:41:57.979015] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-23T20:41:57.978815] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-23T20:41:57.979422] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-23T20:41:57.981141] [DEBUG] [LOCAL ] PFLT: Trimmed 63223 records to 43594 (keeping 200 days of data) [2025-09-23T20:41:57.981997] [DEBUG] [LOCAL ] PFN: Trimmed 30608 records to 21604 (keeping 200 days of data) [2025-09-23T20:41:57.999005] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T20:41:58.242788] [DEBUG] [LOCAL ] PFN: Primary data saved (21604 records). [2025-09-23T20:41:58.243772] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-23T20:41:58.244671] [INFO ] [MAIN ] Update Progress: 1670/2372 symbols completed. PFN took 32.2s. Estimated remaining: 1h 33m 17s. Rate: 7.5 symbols/min [2025-09-23T20:41:58.438798] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:58.440026] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-23T20:41:58.440124] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-23T20:41:58.441189] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-23T20:41:58.441562] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-23T20:41:58.441942] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-23T20:41:58.442536] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-23T20:41:58.607632] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-23T20:41:58.942850] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:41:58.983924] [DEBUG] [LOCAL ] PFLT: Primary data saved (43594 records). [2025-09-23T20:41:58.984055] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-23T20:41:58.984139] [INFO ] [MAIN ] Update Progress: 1671/2372 symbols completed. PFLT took 33.9s. Estimated remaining: 1h 33m 6s. Rate: 7.5 symbols/min [2025-09-23T20:41:59.178976] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:41:59.202923] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T20:41:59.213238] [DEBUG] [LOCAL ] PGP: Loaded 5449 existing records from primary storage. [2025-09-23T20:41:59.213936] [INFO ] [MAIN ] PGP: Loaded 5449 existing records. [2025-09-23T20:41:59.413206] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-23T20:41:59.419779] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:41:59.420230] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-23T20:41:59.421697] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-23T20:41:59.422043] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-23T20:41:59.422125] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-23T20:41:59.802591] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:42:00.202223] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-23T20:42:00.316494] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T20:42:01.002177] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-23T20:42:01.159193] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T20:42:01.752411] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-23T20:42:01.802176] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-23T20:42:02.556546] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T20:42:02.602248] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-23T20:42:03.402203] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-23T20:42:04.202258] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-23T20:42:05.947121] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-23T20:42:05.949010] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-23T20:42:06.870447] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-23T20:42:06.876135] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-23T20:42:07.137773] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (5.34 seconds). [2025-09-23T20:42:07.149255] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-23T20:42:07.490695] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T20:42:07.492717] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-23T20:42:07.750625] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (5.15 seconds). [2025-09-23T20:42:07.903225] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T20:42:08.150109] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T20:42:08.202151] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-23T20:42:09.002287] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-23T20:42:09.183509] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-23T20:42:09.696706] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T20:42:09.790833] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T20:42:09.802135] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-23T20:42:10.279611] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T20:42:10.602207] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-23T20:42:11.402217] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-23T20:42:12.202233] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-23T20:42:12.412022] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T20:42:12.537178] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T20:42:12.917767] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T20:42:13.002215] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-23T20:42:13.802189] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-23T20:42:14.449895] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T20:42:14.602231] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-23T20:42:15.402216] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-23T20:42:16.202204] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-23T20:42:16.476837] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T20:42:16.482771] [INFO ] [REMOTE ] PFSI: Full fetch complete (40592 records). [2025-09-23T20:42:16.482876] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-23T20:42:16.905745] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-23T20:42:16.906474] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-23T20:42:16.907401] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-23T20:42:16.907579] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-23T20:42:16.908967] [DEBUG] [LOCAL ] PFSI: Trimmed 40592 records to 28853 (keeping 200 days of data) [2025-09-23T20:42:17.051763] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (3.25 seconds). [2025-09-23T20:42:17.067734] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-23T20:42:17.086114] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T20:42:17.129711] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T20:42:17.206376] [DEBUG] [LOCAL ] PFSI: Primary data saved (28853 records). [2025-09-23T20:42:17.206519] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-23T20:42:17.206633] [INFO ] [MAIN ] Update Progress: 1672/2372 symbols completed. PFSI took 28.4s. Estimated remaining: 1h 33m 2s. Rate: 7.5 symbols/min [2025-09-23T20:42:17.394187] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:42:17.394379] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-23T20:42:17.394436] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-23T20:42:17.394601] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-23T20:42:17.394669] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-23T20:42:17.394736] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-23T20:42:17.394774] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-23T20:42:17.795822] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:42:17.802169] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-23T20:42:18.602193] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-23T20:42:19.407395] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-23T20:42:19.423585] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-23T20:42:19.633591] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T20:42:19.736838] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T20:42:19.871956] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T20:42:19.873706] [INFO ] [REMOTE ] PGP: Full fetch complete (7935 records). [2025-09-23T20:42:19.873807] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-23T20:42:20.207366] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-23T20:42:20.274312] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-23T20:42:20.274401] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-23T20:42:20.274700] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-23T20:42:20.274805] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-23T20:42:20.276263] [DEBUG] [LOCAL ] PGP: Trimmed 7935 records to 5468 (keeping 200 days of data) [2025-09-23T20:42:20.316127] [DEBUG] [LOCAL ] PGP: Primary data saved (5468 records). [2025-09-23T20:42:20.316236] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-23T20:42:20.316448] [INFO ] [MAIN ] Update Progress: 1673/2372 symbols completed. PGP took 21.3s. Estimated remaining: 1h 32m 52s. Rate: 7.5 symbols/min [2025-09-23T20:42:20.498333] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:42:20.559211] [DEBUG] [LOCAL ] PGRE: Loaded 46338 existing records from primary storage. [2025-09-23T20:42:20.559359] [INFO ] [MAIN ] PGRE: Loaded 46338 existing records. [2025-09-23T20:42:20.740525] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:42:20.740821] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-23T20:42:20.740904] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-23T20:42:20.742107] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-23T20:42:20.742194] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-23T20:42:21.007363] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-23T20:42:21.101922] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:42:21.802192] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-23T20:42:22.198121] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T20:42:22.602234] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-23T20:42:23.240428] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-23T20:42:23.402162] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-23T20:42:23.457121] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T20:42:24.202191] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-23T20:42:24.338470] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T20:42:25.002244] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-23T20:42:25.248548] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T20:42:25.802193] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-23T20:42:26.126957] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-23T20:42:26.540064] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T20:42:26.602207] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-23T20:42:27.402210] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-23T20:42:27.506217] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T20:42:28.130074] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T20:42:28.202198] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-23T20:42:29.002212] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-23T20:42:29.475820] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-23T20:42:29.807319] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-23T20:42:29.829459] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T20:42:30.602195] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-23T20:42:31.093398] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-23T20:42:31.127435] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T20:42:31.402198] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-23T20:42:32.208016] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-23T20:42:32.217075] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T20:42:32.228689] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-09-23T20:42:32.228960] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-23T20:42:32.234950] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:42:32.235118] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:42:32.235211] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:42:32.235305] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-23T20:42:32.235419] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-23T20:42:32.235477] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-23T20:42:32.235577] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-09-23T20:42:32.235705] [INFO ] [MAIN ] Update Progress: 1674/2372 symbols completed. PG took 34.0s. Estimated remaining: 1h 32m 46s. Rate: 7.5 symbols/min [2025-09-23T20:42:32.421607] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:42:32.461250] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T20:42:32.476338] [DEBUG] [LOCAL ] PGZ: Loaded 5402 existing records from primary storage. [2025-09-23T20:42:32.476635] [INFO ] [MAIN ] PGZ: Loaded 5402 existing records. [2025-09-23T20:42:32.659575] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:42:32.659936] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-23T20:42:32.659995] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-23T20:42:32.660627] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-23T20:42:32.660732] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-23T20:42:33.016713] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-23T20:42:33.022949] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:42:33.266218] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T20:42:33.273118] [INFO ] [REMOTE ] PFS: Full fetch complete (51540 records). [2025-09-23T20:42:33.273263] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-23T20:42:33.669562] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-23T20:42:33.669694] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-23T20:42:33.670575] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-23T20:42:33.670669] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-23T20:42:33.672327] [DEBUG] [LOCAL ] PFS: Trimmed 51540 records to 35755 (keeping 200 days of data) [2025-09-23T20:42:33.802502] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-23T20:42:33.922912] [DEBUG] [LOCAL ] PFS: Primary data saved (35755 records). [2025-09-23T20:42:33.923073] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-23T20:42:33.923172] [INFO ] [MAIN ] Update Progress: 1675/2372 symbols completed. PFS took 49.0s. Estimated remaining: 1h 32m 35s. Rate: 7.5 symbols/min [2025-09-23T20:42:34.113666] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:42:34.166798] [DEBUG] [LOCAL ] PH: Loaded 39033 existing records from primary storage. [2025-09-23T20:42:34.166948] [INFO ] [MAIN ] PH: Loaded 39033 existing records. [2025-09-23T20:42:34.355591] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:42:34.355949] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-23T20:42:34.356002] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-23T20:42:34.357042] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-23T20:42:34.357104] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-23T20:42:34.635772] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-23T20:42:34.648252] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T20:42:34.760172] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:42:34.793492] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T20:42:35.402212] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-23T20:42:36.202167] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-23T20:42:36.422404] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T20:42:37.002165] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-23T20:42:37.375260] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T20:42:37.461536] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T20:42:37.802272] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-23T20:42:38.316677] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T20:42:38.602228] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-23T20:42:38.642092] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T20:42:39.402235] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-23T20:42:40.036778] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T20:42:40.202197] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-23T20:42:40.746556] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T20:42:40.891701] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T20:42:41.002266] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-23T20:42:41.802255] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-23T20:42:42.575612] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T20:42:42.602146] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-23T20:42:43.402159] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-23T20:42:43.498414] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T20:42:43.822037] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T20:42:44.202184] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-23T20:42:44.324466] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T20:42:44.592200] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T20:42:44.602721] [INFO ] [REMOTE ] PGR: Full fetch complete (76220 records). [2025-09-23T20:42:44.602901] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-23T20:42:44.603779] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:42:44.603878] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:42:44.603922] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:42:44.603963] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-23T20:42:44.604096] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-23T20:42:44.604152] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-23T20:42:44.604223] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-09-23T20:42:44.604309] [INFO ] [MAIN ] Update Progress: 1676/2372 symbols completed. PGR took 27.4s. Estimated remaining: 1h 32m 29s. Rate: 7.5 symbols/min [2025-09-23T20:42:44.795488] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:42:44.809245] [DEBUG] [LOCAL ] PHD: Loaded 9661 existing records from primary storage. [2025-09-23T20:42:44.809387] [INFO ] [MAIN ] PHD: Loaded 9661 existing records. [2025-09-23T20:42:44.999004] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:42:44.999253] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-23T20:42:44.999301] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-23T20:42:44.999960] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-23T20:42:45.000022] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-23T20:42:45.011042] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-23T20:42:45.403085] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:42:45.802223] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-23T20:42:46.602190] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-23T20:42:46.743879] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T20:42:46.774260] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T20:42:47.064526] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T20:42:47.402195] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-23T20:42:48.202260] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-23T20:42:48.224949] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T20:42:48.840069] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T20:42:49.002225] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-23T20:42:49.736917] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T20:42:49.802183] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-23T20:42:50.569529] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T20:42:50.602158] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-23T20:42:51.402200] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-23T20:42:51.447959] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T20:42:52.202204] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-23T20:42:53.002168] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-23T20:42:53.109357] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T20:42:53.117637] [INFO ] [REMOTE ] PGRE: Full fetch complete (63365 records). [2025-09-23T20:42:53.117791] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-23T20:42:53.190423] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T20:42:53.521354] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-23T20:42:53.521442] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-23T20:42:53.522375] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-23T20:42:53.522442] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-23T20:42:53.526175] [DEBUG] [LOCAL ] PGRE: Trimmed 63365 records to 46370 (keeping 200 days of data) [2025-09-23T20:42:53.798137] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T20:42:53.802180] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-23T20:42:53.814064] [DEBUG] [LOCAL ] PGRE: Primary data saved (46370 records). [2025-09-23T20:42:53.814234] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-23T20:42:53.814347] [INFO ] [MAIN ] Update Progress: 1677/2372 symbols completed. PGRE took 33.5s. Estimated remaining: 1h 32m 21s. Rate: 7.5 symbols/min [2025-09-23T20:42:54.602269] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-23T20:42:55.262025] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T20:42:55.263972] [INFO ] [REMOTE ] PGZ: Full fetch complete (8977 records). [2025-09-23T20:42:55.264399] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-23T20:42:55.404912] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-23T20:42:55.651935] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-23T20:42:55.652131] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-23T20:42:55.652482] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-23T20:42:55.652562] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-23T20:42:55.679094] [DEBUG] [LOCAL ] PGZ: Trimmed 8977 records to 5388 (keeping 200 days of data) [2025-09-23T20:42:55.683139] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T20:42:55.726534] [DEBUG] [LOCAL ] PGZ: Primary data saved (5388 records). [2025-09-23T20:42:55.726734] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-23T20:42:55.726845] [INFO ] [MAIN ] Update Progress: 1678/2372 symbols completed. PGZ took 23.5s. Estimated remaining: 1h 32m 11s. Rate: 7.5 symbols/min [2025-09-23T20:42:56.202264] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-23T20:42:56.261858] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T20:42:57.002320] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-23T20:42:57.771157] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T20:42:57.802223] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-23T20:42:57.824529] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T20:42:58.602311] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-23T20:42:59.638845] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T20:42:59.649962] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-23T20:42:59.663094] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T20:43:00.202255] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-23T20:43:01.156615] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T20:43:01.160060] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-23T20:43:01.381796] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T20:43:01.802259] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-23T20:43:02.057734] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T20:43:02.060809] [INFO ] [REMOTE ] PHD: Full fetch complete (13820 records). [2025-09-23T20:43:02.060935] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-23T20:43:02.450614] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-23T20:43:02.450733] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-23T20:43:02.451062] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-23T20:43:02.451123] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-23T20:43:02.451772] [DEBUG] [LOCAL ] PHD: Trimmed 13820 records to 9688 (keeping 200 days of data) [2025-09-23T20:43:02.514758] [DEBUG] [LOCAL ] PHD: Primary data saved (9688 records). [2025-09-23T20:43:02.514931] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-23T20:43:02.515027] [INFO ] [MAIN ] Update Progress: 1679/2372 symbols completed. PHD took 17.9s. Estimated remaining: 1h 32m 2s. Rate: 7.5 symbols/min [2025-09-23T20:43:03.489421] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T20:43:03.498961] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-23T20:43:05.075430] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T20:43:05.083408] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-23T20:43:06.857959] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T20:43:06.865838] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-23T20:43:08.452044] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T20:43:08.464888] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-23T20:43:09.987469] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T20:43:09.994588] [INFO ] [REMOTE ] PH: Full fetch complete (56728 records). [2025-09-23T20:43:09.994856] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-23T20:43:10.439441] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-23T20:43:10.439549] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-23T20:43:10.440696] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-23T20:43:10.440761] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-23T20:43:10.442531] [DEBUG] [LOCAL ] PH: Trimmed 56728 records to 38934 (keeping 200 days of data) [2025-09-23T20:43:10.699228] [DEBUG] [LOCAL ] PH: Primary data saved (38934 records). [2025-09-23T20:43:10.699395] [INFO ] [MAIN ] PH: Full history saved. [2025-09-23T20:43:10.699487] [INFO ] [MAIN ] Update Progress: 1680/2372 symbols completed. PH took 36.8s. Estimated remaining: 1h 31m 54s. Rate: 7.5 symbols/min [2025-09-23T20:43:11.403576] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:43:11.457615] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:43:11.475239] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:43:11.479378] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:43:11.498074] [DEBUG] [LOCAL ] PHI: Loaded 15014 existing records from primary storage. [2025-09-23T20:43:11.498212] [INFO ] [MAIN ] PHI: Loaded 15014 existing records. [2025-09-23T20:43:11.653284] [DEBUG] [LOCAL ] PHK: Loaded 26488 existing records from primary storage. [2025-09-23T20:43:11.659206] [INFO ] [MAIN ] PHK: Loaded 26488 existing records. [2025-09-23T20:43:11.828722] [DEBUG] [LOCAL ] PHIN: Loaded 33369 existing records from primary storage. [2025-09-23T20:43:11.861858] [INFO ] [MAIN ] PHIN: Loaded 33369 existing records. [2025-09-23T20:43:11.828154] [DEBUG] [LOCAL ] PHG: Loaded 46232 existing records from primary storage. [2025-09-23T20:43:11.903724] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:43:11.914184] [INFO ] [MAIN ] PHG: Loaded 46232 existing records. [2025-09-23T20:43:12.144106] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-23T20:43:12.154732] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-23T20:43:12.169023] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:43:12.185135] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-23T20:43:12.239969] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-23T20:43:12.316695] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-23T20:43:12.321234] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:43:12.340735] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-23T20:43:12.385810] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-23T20:43:12.385970] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:43:12.405400] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-23T20:43:12.410932] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-23T20:43:12.416316] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-23T20:43:12.411069] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-23T20:43:12.421708] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-23T20:43:12.437308] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-23T20:43:12.520023] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-23T20:43:12.495752] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-23T20:43:12.562304] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-23T20:43:13.571419] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:43:13.670426] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-23T20:43:13.774717] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:43:13.834337] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-23T20:43:13.892896] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:43:13.886905] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:43:13.893985] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-23T20:43:13.893639] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-23T20:43:15.250315] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T20:43:15.254188] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-23T20:43:15.335983] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T20:43:15.343449] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-23T20:43:15.567905] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T20:43:15.577205] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-23T20:43:15.632851] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T20:43:15.639031] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-23T20:43:15.857896] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T20:43:15.861129] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-23T20:43:16.285953] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T20:43:16.292257] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-23T20:43:16.412384] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T20:43:16.415541] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-23T20:43:16.711768] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T20:43:16.718159] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-23T20:43:16.847743] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T20:43:16.856290] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-23T20:43:17.299723] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T20:43:17.306890] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-23T20:43:17.447293] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T20:43:17.451062] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-23T20:43:17.560829] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T20:43:17.802307] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-23T20:43:18.474438] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T20:43:18.602236] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-23T20:43:18.911561] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T20:43:18.963890] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T20:43:19.061028] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-23T20:43:19.218537] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T20:43:19.402226] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-23T20:43:20.061812] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T20:43:20.202183] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-23T20:43:20.922242] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T20:43:21.002224] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-23T20:43:21.802169] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-23T20:43:22.058140] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T20:43:22.602294] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-23T20:43:23.402218] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-23T20:43:23.437621] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T20:43:23.480288] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T20:43:23.484754] [INFO ] [REMOTE ] PHI: Full fetch complete (20664 records). [2025-09-23T20:43:23.484879] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-23T20:43:23.877594] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-23T20:43:23.877757] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-23T20:43:23.878569] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-23T20:43:23.878616] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-23T20:43:23.879549] [DEBUG] [LOCAL ] PHI: Trimmed 20664 records to 14960 (keeping 200 days of data) [2025-09-23T20:43:23.991330] [DEBUG] [LOCAL ] PHI: Primary data saved (14960 records). [2025-09-23T20:43:23.991547] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-23T20:43:23.991690] [INFO ] [MAIN ] Update Progress: 1681/2372 symbols completed. PHI took 13.3s. Estimated remaining: 1h 31m 49s. Rate: 7.5 symbols/min [2025-09-23T20:43:24.185758] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:43:24.186032] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-23T20:43:24.186074] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-23T20:43:24.186302] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-23T20:43:24.186383] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-23T20:43:24.186441] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-23T20:43:24.186477] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-23T20:43:24.209067] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-23T20:43:24.594254] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:43:24.653564] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T20:43:25.002243] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-23T20:43:25.802204] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-23T20:43:26.066971] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T20:43:26.134609] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T20:43:26.602243] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-23T20:43:26.930298] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T20:43:27.402195] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-23T20:43:28.202223] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-23T20:43:28.319858] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T20:43:29.002273] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-23T20:43:29.208085] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T20:43:29.273398] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T20:43:29.802212] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-23T20:43:30.478143] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T20:43:30.602203] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-23T20:43:31.293783] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T20:43:31.402273] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-23T20:43:32.067433] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T20:43:32.202274] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-23T20:43:33.002225] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-23T20:43:33.224263] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T20:43:33.410557] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T20:43:33.802208] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-23T20:43:33.944033] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T20:43:34.602265] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-23T20:43:35.402193] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-23T20:43:35.569638] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T20:43:36.202243] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-23T20:43:36.335244] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T20:43:36.341849] [INFO ] [REMOTE ] PHIN: Full fetch complete (48219 records). [2025-09-23T20:43:36.342225] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-23T20:43:36.782888] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-23T20:43:36.815286] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-23T20:43:36.815610] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-23T20:43:36.817119] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-23T20:43:36.817215] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-23T20:43:36.819368] [DEBUG] [LOCAL ] PHIN: Trimmed 48219 records to 33279 (keeping 200 days of data) [2025-09-23T20:43:37.006502] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-23T20:43:37.035639] [DEBUG] [LOCAL ] PHIN: Primary data saved (33279 records). [2025-09-23T20:43:37.035862] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-23T20:43:37.038283] [INFO ] [MAIN ] Update Progress: 1682/2372 symbols completed. PHIN took 26.3s. Estimated remaining: 1h 31m 43s. Rate: 7.5 symbols/min [2025-09-23T20:43:37.229189] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:43:37.275320] [DEBUG] [LOCAL ] PHR: Loaded 37361 existing records from primary storage. [2025-09-23T20:43:37.275545] [INFO ] [MAIN ] PHR: Loaded 37361 existing records. [2025-09-23T20:43:37.467901] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:43:37.468302] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-23T20:43:37.468497] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-23T20:43:37.469748] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-23T20:43:37.469819] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-23T20:43:37.764878] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T20:43:37.793472] [INFO ] [REMOTE ] PHG: Full fetch complete (65722 records). [2025-09-23T20:43:37.804245] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-23T20:43:37.809607] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-23T20:43:37.900531] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:43:38.288434] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-23T20:43:38.288560] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-23T20:43:38.290013] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-23T20:43:38.290092] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-23T20:43:38.292137] [DEBUG] [LOCAL ] PHG: Trimmed 65722 records to 46196 (keeping 200 days of data) [2025-09-23T20:43:38.585463] [DEBUG] [LOCAL ] PHG: Primary data saved (46196 records). [2025-09-23T20:43:38.585617] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-23T20:43:38.585742] [INFO ] [MAIN ] Update Progress: 1683/2372 symbols completed. PHG took 27.9s. Estimated remaining: 1h 31m 32s. Rate: 7.5 symbols/min [2025-09-23T20:43:38.619328] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-23T20:43:38.772295] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:43:38.789816] [DEBUG] [LOCAL ] PHT: Loaded 15339 existing records from primary storage. [2025-09-23T20:43:38.789955] [INFO ] [MAIN ] PHT: Loaded 15339 existing records. [2025-09-23T20:43:38.982365] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:43:38.982997] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-23T20:43:38.983125] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-23T20:43:38.984063] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-23T20:43:38.984136] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-23T20:43:39.101486] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-23T20:43:39.359965] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T20:43:39.412581] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-23T20:43:39.446593] [INFO ] [REMOTE ] PHT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:43:39.908689] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T20:43:40.202241] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-23T20:43:41.002199] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-12. [2025-09-23T20:43:41.335044] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-23T20:43:41.362374] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T20:43:41.756529] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T20:43:41.802247] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-01. [2025-09-23T20:43:42.602354] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T20:43:42.602457] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-23T20:43:43.402246] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-23T20:43:44.020579] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T20:43:44.203325] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-23T20:43:44.205911] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T20:43:45.002231] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-23T20:43:45.802170] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-23T20:43:46.063597] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T20:43:46.106330] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T20:43:46.602196] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-23T20:43:46.695672] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T20:43:47.402199] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-23T20:43:47.498499] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T20:43:48.202227] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-23T20:43:49.002268] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-23T20:43:49.180081] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T20:43:49.247045] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T20:43:49.802220] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-23T20:43:50.536214] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T20:43:50.602205] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-23T20:43:50.708837] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T20:43:50.714079] [INFO ] [REMOTE ] PHK: Full fetch complete (39310 records). [2025-09-23T20:43:50.714199] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-23T20:43:51.104458] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-23T20:43:51.104557] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-23T20:43:51.105320] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-23T20:43:51.105409] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-23T20:43:51.106409] [DEBUG] [LOCAL ] PHK: Trimmed 39310 records to 26466 (keeping 200 days of data) [2025-09-23T20:43:51.266335] [DEBUG] [LOCAL ] PHK: Primary data saved (26466 records). [2025-09-23T20:43:51.266476] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-23T20:43:51.266567] [INFO ] [MAIN ] Update Progress: 1684/2372 symbols completed. PHK took 40.6s. Estimated remaining: 1h 31m 26s. Rate: 7.5 symbols/min [2025-09-23T20:43:51.407428] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-23T20:43:51.469574] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:43:51.518425] [DEBUG] [LOCAL ] PII: Loaded 49284 existing records from primary storage. [2025-09-23T20:43:51.518581] [INFO ] [MAIN ] PII: Loaded 49284 existing records. [2025-09-23T20:43:51.714028] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:43:51.714277] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-23T20:43:51.714325] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-23T20:43:51.715906] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-23T20:43:51.715970] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-23T20:43:52.132634] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:43:52.142683] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T20:43:52.175757] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T20:43:52.202168] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-23T20:43:53.002296] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-23T20:43:53.802178] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-23T20:43:54.209425] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-23T20:43:54.247761] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T20:43:54.602215] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-23T20:43:55.402167] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-23T20:43:55.586244] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T20:43:55.727765] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T20:43:56.202284] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-23T20:43:56.570463] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T20:43:57.002174] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-23T20:43:57.161889] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T20:43:57.802239] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-23T20:43:58.602202] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-23T20:43:58.969013] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T20:43:59.363553] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T20:43:59.402185] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-23T20:44:00.202213] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-23T20:44:00.547257] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-23T20:44:00.881694] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T20:44:01.002164] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-23T20:44:01.357612] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T20:44:01.360824] [INFO ] [REMOTE ] PHT: Full fetch complete (19490 records). [2025-09-23T20:44:01.360903] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-23T20:44:01.742425] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-23T20:44:01.742512] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-23T20:44:01.742970] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-23T20:44:01.743066] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-23T20:44:01.743822] [DEBUG] [LOCAL ] PHT: Trimmed 19490 records to 15501 (keeping 200 days of data) [2025-09-23T20:44:01.819208] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-23T20:44:01.853875] [DEBUG] [LOCAL ] PHT: Primary data saved (15501 records). [2025-09-23T20:44:01.854051] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-23T20:44:01.854147] [INFO ] [MAIN ] Update Progress: 1685/2372 symbols completed. PHT took 23.3s. Estimated remaining: 1h 31m 19s. Rate: 7.5 symbols/min [2025-09-23T20:44:02.039316] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:02.047039] [DEBUG] [LOCAL ] PIM: Loaded 4732 existing records from primary storage. [2025-09-23T20:44:02.047196] [INFO ] [MAIN ] PIM: Loaded 4732 existing records. [2025-09-23T20:44:02.245404] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:02.246001] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-23T20:44:02.246086] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-23T20:44:02.246396] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-23T20:44:02.246480] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-23T20:44:02.603691] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-23T20:44:02.653177] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:02.681738] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T20:44:02.716848] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T20:44:02.726480] [INFO ] [REMOTE ] PHM: Full fetch complete (74705 records). [2025-09-23T20:44:02.726753] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-23T20:44:02.727849] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:44:02.727970] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:44:02.728016] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:44:02.728068] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-23T20:44:02.728132] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-23T20:44:02.728169] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-23T20:44:02.728233] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-09-23T20:44:02.728324] [INFO ] [MAIN ] Update Progress: 1686/2372 symbols completed. PHM took 38.7s. Estimated remaining: 1h 31m 8s. Rate: 7.5 symbols/min [2025-09-23T20:44:02.908246] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:02.923440] [DEBUG] [LOCAL ] PINE: Loaded 14270 existing records from primary storage. [2025-09-23T20:44:02.923558] [INFO ] [MAIN ] PINE: Loaded 14270 existing records. [2025-09-23T20:44:03.106634] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:03.106934] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-23T20:44:03.106984] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-23T20:44:03.107595] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-23T20:44:03.107691] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-23T20:44:03.407398] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-23T20:44:03.471758] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:04.202164] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-23T20:44:04.328095] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T20:44:04.392322] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T20:44:05.002190] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-23T20:44:05.613451] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T20:44:05.802174] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-23T20:44:05.864326] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T20:44:05.872401] [INFO ] [REMOTE ] PHR: Full fetch complete (52272 records). [2025-09-23T20:44:05.872519] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-23T20:44:06.259780] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-23T20:44:06.259940] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-23T20:44:06.260801] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-23T20:44:06.260869] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-23T20:44:06.261959] [DEBUG] [LOCAL ] PHR: Trimmed 52272 records to 37465 (keeping 200 days of data) [2025-09-23T20:44:06.457490] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T20:44:06.489828] [DEBUG] [LOCAL ] PHR: Primary data saved (37465 records). [2025-09-23T20:44:06.489953] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-23T20:44:06.490049] [INFO ] [MAIN ] Update Progress: 1687/2372 symbols completed. PHR took 29.5s. Estimated remaining: 1h 30m 59s. Rate: 7.5 symbols/min [2025-09-23T20:44:06.607396] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-23T20:44:06.666399] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:06.720209] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-23T20:44:06.720356] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-09-23T20:44:06.923441] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:06.923748] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-23T20:44:06.923806] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-23T20:44:06.925481] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-23T20:44:06.925549] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-23T20:44:07.295293] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:07.402203] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-23T20:44:07.640977] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T20:44:08.202251] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-23T20:44:09.002169] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-23T20:44:09.203749] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T20:44:09.560527] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-23T20:44:09.802240] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-23T20:44:10.602254] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-23T20:44:10.749380] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T20:44:10.970775] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T20:44:11.402221] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-23T20:44:11.998468] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T20:44:12.202218] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-23T20:44:12.638901] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T20:44:12.834938] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T20:44:13.002192] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-23T20:44:13.658539] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T20:44:13.802218] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-23T20:44:14.602233] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-23T20:44:15.402178] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-23T20:44:15.798218] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T20:44:16.025591] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T20:44:16.202185] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-23T20:44:16.636046] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-23T20:44:17.002226] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-23T20:44:17.259215] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T20:44:17.441810] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T20:44:17.802237] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-23T20:44:18.602237] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-23T20:44:18.856426] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T20:44:19.402196] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-23T20:44:20.202205] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-23T20:44:20.311058] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T20:44:20.432333] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T20:44:20.637084] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T20:44:21.002207] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-23T20:44:21.802198] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-23T20:44:22.602180] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-23T20:44:22.764934] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T20:44:22.803781] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T20:44:23.402197] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-23T20:44:24.166451] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T20:44:24.168779] [INFO ] [REMOTE ] PIM: Full fetch complete (6576 records). [2025-09-23T20:44:24.168882] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-23T20:44:24.207354] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-23T20:44:24.556783] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-23T20:44:24.556985] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-23T20:44:24.557199] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-23T20:44:24.557309] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-23T20:44:24.557931] [DEBUG] [LOCAL ] PIM: Trimmed 6576 records to 4751 (keeping 200 days of data) [2025-09-23T20:44:24.586999] [DEBUG] [LOCAL ] PIM: Primary data saved (4751 records). [2025-09-23T20:44:24.587150] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-23T20:44:24.587242] [INFO ] [MAIN ] Update Progress: 1688/2372 symbols completed. PIM took 22.7s. Estimated remaining: 1h 30m 55s. Rate: 7.5 symbols/min [2025-09-23T20:44:24.762065] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:24.796939] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-23T20:44:24.820518] [DEBUG] [LOCAL ] PIPR: Loaded 15261 existing records from primary storage. [2025-09-23T20:44:24.820677] [INFO ] [MAIN ] PIPR: Loaded 15261 existing records. [2025-09-23T20:44:25.003047] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-23T20:44:25.002879] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:25.004520] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-23T20:44:25.004604] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-23T20:44:25.005456] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-23T20:44:25.005531] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-23T20:44:25.381209] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:25.393114] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T20:44:25.802237] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-23T20:44:26.602179] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-23T20:44:26.662375] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T20:44:26.886151] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T20:44:27.243225] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T20:44:27.402201] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-23T20:44:28.202169] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-23T20:44:28.287360] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T20:44:28.290797] [INFO ] [REMOTE ] PINE: Full fetch complete (21100 records). [2025-09-23T20:44:28.290884] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-23T20:44:28.725277] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-23T20:44:28.725440] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-23T20:44:28.726508] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-23T20:44:28.726571] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-23T20:44:28.727370] [DEBUG] [LOCAL ] PINE: Trimmed 21100 records to 14232 (keeping 200 days of data) [2025-09-23T20:44:28.826586] [DEBUG] [LOCAL ] PINE: Primary data saved (14232 records). [2025-09-23T20:44:28.826766] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-23T20:44:28.826898] [INFO ] [MAIN ] Update Progress: 1689/2372 symbols completed. PINE took 26.1s. Estimated remaining: 1h 30m 45s. Rate: 7.5 symbols/min [2025-09-23T20:44:29.017043] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-23T20:44:29.022697] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:29.048402] [DEBUG] [LOCAL ] PJT: Loaded 22637 existing records from primary storage. [2025-09-23T20:44:29.048586] [INFO ] [MAIN ] PJT: Loaded 22637 existing records. [2025-09-23T20:44:29.250814] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:29.251061] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-23T20:44:29.251125] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-23T20:44:29.252053] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-23T20:44:29.252160] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-23T20:44:29.662898] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:29.802236] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-23T20:44:30.389062] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-23T20:44:30.602213] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-23T20:44:30.648205] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T20:44:30.773900] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T20:44:31.402199] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-23T20:44:32.202168] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-23T20:44:32.525569] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T20:44:32.812980] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-23T20:44:33.002176] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-23T20:44:33.163332] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T20:44:33.802209] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-23T20:44:34.570435] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T20:44:34.588131] [INFO ] [REMOTE ] PII: Full fetch complete (71122 records). [2025-09-23T20:44:34.589025] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T20:44:34.592449] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-23T20:44:34.607374] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-23T20:44:34.999168] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-23T20:44:34.999259] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-23T20:44:35.000331] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-23T20:44:35.000439] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-23T20:44:35.003200] [DEBUG] [LOCAL ] PII: Trimmed 71122 records to 49253 (keeping 200 days of data) [2025-09-23T20:44:35.340401] [DEBUG] [LOCAL ] PII: Primary data saved (49253 records). [2025-09-23T20:44:35.340683] [INFO ] [MAIN ] PII: Full history saved. [2025-09-23T20:44:35.340937] [INFO ] [MAIN ] Update Progress: 1690/2372 symbols completed. PII took 44.1s. Estimated remaining: 1h 30m 37s. Rate: 7.5 symbols/min [2025-09-23T20:44:35.413560] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-23T20:44:35.540319] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:35.603638] [DEBUG] [LOCAL ] PK: Loaded 52893 existing records from primary storage. [2025-09-23T20:44:35.603821] [INFO ] [MAIN ] PK: Loaded 52893 existing records. [2025-09-23T20:44:35.791847] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:35.792248] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-23T20:44:35.792356] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-23T20:44:35.793995] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-23T20:44:35.794078] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-23T20:44:35.958090] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T20:44:36.208079] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-23T20:44:36.207948] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:36.593457] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T20:44:37.002236] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-23T20:44:37.467872] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T20:44:37.802241] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-23T20:44:38.506733] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T20:44:38.602252] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-23T20:44:38.774585] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T20:44:39.402202] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-23T20:44:40.202187] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-23T20:44:40.296933] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T20:44:41.002193] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-23T20:44:41.065031] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T20:44:41.193789] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T20:44:41.802217] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-23T20:44:42.602267] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-23T20:44:42.837096] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T20:44:43.247739] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T20:44:43.402180] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-23T20:44:43.709876] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T20:44:44.202212] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-23T20:44:45.002204] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-23T20:44:45.304074] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T20:44:45.481096] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T20:44:45.802230] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-23T20:44:46.602171] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-23T20:44:46.790101] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T20:44:47.084569] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-23T20:44:47.402317] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-23T20:44:48.202267] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-23T20:44:48.334736] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T20:44:48.975685] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T20:44:49.002159] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-23T20:44:49.079116] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T20:44:49.088260] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-09-23T20:44:49.088457] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-23T20:44:49.491375] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-23T20:44:49.491474] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-23T20:44:49.492568] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-23T20:44:49.492658] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-23T20:44:49.498074] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 53693 (keeping 200 days of data) [2025-09-23T20:44:49.805589] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-23T20:44:49.854150] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-09-23T20:44:49.854336] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-23T20:44:49.854505] [INFO ] [MAIN ] Update Progress: 1691/2372 symbols completed. PINS took 43.4s. Estimated remaining: 1h 30m 31s. Rate: 7.5 symbols/min [2025-09-23T20:44:50.029226] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:50.046425] [DEBUG] [LOCAL ] PKE: Loaded 12499 existing records from primary storage. [2025-09-23T20:44:50.046556] [INFO ] [MAIN ] PKE: Loaded 12499 existing records. [2025-09-23T20:44:50.236012] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:50.241635] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-23T20:44:50.250041] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-23T20:44:50.251429] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T20:44:50.251537] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-23T20:44:50.257116] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-23T20:44:50.619207] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-23T20:44:50.625908] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:51.402189] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-23T20:44:51.606220] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T20:44:51.749624] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T20:44:52.202218] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-23T20:44:52.220619] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T20:44:53.002202] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-23T20:44:53.260238] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T20:44:53.802225] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-23T20:44:54.602214] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-23T20:44:54.688046] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T20:44:54.694261] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T20:44:55.194018] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T20:44:55.196999] [INFO ] [REMOTE ] PIPR: Full fetch complete (20378 records). [2025-09-23T20:44:55.197083] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-23T20:44:55.411716] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-23T20:44:55.591415] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-23T20:44:55.591505] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-23T20:44:55.591967] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-23T20:44:55.592027] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-23T20:44:55.593282] [DEBUG] [LOCAL ] PIPR: Trimmed 20378 records to 15253 (keeping 200 days of data) [2025-09-23T20:44:55.705061] [DEBUG] [LOCAL ] PIPR: Primary data saved (15253 records). [2025-09-23T20:44:55.705207] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-23T20:44:55.705293] [INFO ] [MAIN ] Update Progress: 1692/2372 symbols completed. PIPR took 31.1s. Estimated remaining: 1h 30m 23s. Rate: 7.5 symbols/min [2025-09-23T20:44:55.880094] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:55.948898] [DEBUG] [LOCAL ] PKG: Loaded 39360 existing records from primary storage. [2025-09-23T20:44:55.949076] [INFO ] [MAIN ] PKG: Loaded 39360 existing records. [2025-09-23T20:44:56.154363] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:56.155995] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-23T20:44:56.156051] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-23T20:44:56.158826] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-23T20:44:56.158888] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-23T20:44:56.213778] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-23T20:44:56.516429] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:57.002233] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-23T20:44:57.201955] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T20:44:57.461030] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T20:44:57.634087] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T20:44:57.637305] [INFO ] [REMOTE ] PJT: Full fetch complete (32121 records). [2025-09-23T20:44:57.637392] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-23T20:44:57.811856] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-23T20:44:58.013027] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-23T20:44:58.013105] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-23T20:44:58.013786] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-23T20:44:58.013847] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-23T20:44:58.015133] [DEBUG] [LOCAL ] PJT: Trimmed 32121 records to 22543 (keeping 200 days of data) [2025-09-23T20:44:58.173498] [DEBUG] [LOCAL ] PJT: Primary data saved (22543 records). [2025-09-23T20:44:58.173633] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-23T20:44:58.173776] [INFO ] [MAIN ] Update Progress: 1693/2372 symbols completed. PJT took 29.3s. Estimated remaining: 1h 30m 12s. Rate: 7.5 symbols/min [2025-09-23T20:44:58.341087] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:44:58.365400] [DEBUG] [LOCAL ] PKST: Loaded 19390 existing records from primary storage. [2025-09-23T20:44:58.365578] [INFO ] [MAIN ] PKST: Loaded 19390 existing records. [2025-09-23T20:44:58.545867] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:44:58.546120] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-23T20:44:58.546168] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-23T20:44:58.546863] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-23T20:44:58.546934] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-23T20:44:58.608714] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-23T20:44:58.962514] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:44:59.402169] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-23T20:44:59.474544] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T20:44:59.479822] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T20:45:00.202244] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-23T20:45:00.327686] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T20:45:00.983383] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T20:45:01.002154] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-23T20:45:01.802259] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-23T20:45:02.067591] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T20:45:02.602205] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-23T20:45:03.402254] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-23T20:45:04.202200] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-23T20:45:04.690482] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-23T20:45:05.002186] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-23T20:45:05.177600] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T20:45:05.230479] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (3.43 seconds). [2025-09-23T20:45:05.374539] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T20:45:05.802177] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-23T20:45:05.899145] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T20:45:06.602160] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-23T20:45:06.955100] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T20:45:07.402182] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-23T20:45:07.449390] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T20:45:08.202211] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-23T20:45:08.713191] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T20:45:09.002253] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-23T20:45:09.413337] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T20:45:09.802236] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-23T20:45:10.602180] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-23T20:45:10.828259] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T20:45:10.837213] [INFO ] [REMOTE ] PK: Full fetch complete (76373 records). [2025-09-23T20:45:10.837376] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-23T20:45:11.229960] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T20:45:11.258588] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-23T20:45:11.259011] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-23T20:45:11.260041] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-23T20:45:11.260106] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-23T20:45:11.261480] [DEBUG] [LOCAL ] PK: Trimmed 76373 records to 52884 (keeping 200 days of data) [2025-09-23T20:45:11.436827] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-23T20:45:11.591665] [DEBUG] [LOCAL ] PK: Primary data saved (52884 records). [2025-09-23T20:45:11.591829] [INFO ] [MAIN ] PK: Full history saved. [2025-09-23T20:45:11.591944] [INFO ] [MAIN ] Update Progress: 1694/2372 symbols completed. PK took 36.3s. Estimated remaining: 1h 30m 7s. Rate: 7.5 symbols/min [2025-09-23T20:45:11.776815] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:45:11.803307] [DEBUG] [LOCAL ] PKX: Loaded 25251 existing records from primary storage. [2025-09-23T20:45:11.803451] [INFO ] [MAIN ] PKX: Loaded 25251 existing records. [2025-09-23T20:45:11.990961] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:45:11.991193] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-23T20:45:11.991242] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-23T20:45:11.991980] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-23T20:45:11.992044] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-23T20:45:12.207250] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-23T20:45:12.360497] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:45:12.396712] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T20:45:12.569863] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T20:45:13.002193] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-23T20:45:13.678271] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T20:45:13.802184] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-23T20:45:14.602195] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-23T20:45:15.402178] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-23T20:45:15.729443] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-23T20:45:16.159067] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T20:45:16.202167] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-23T20:45:16.294431] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T20:45:16.350234] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T20:45:16.353078] [INFO ] [REMOTE ] PKE: Full fetch complete (16867 records). [2025-09-23T20:45:16.353150] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-23T20:45:16.720287] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-23T20:45:16.720367] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-23T20:45:16.720749] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-23T20:45:16.720808] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-23T20:45:16.721331] [DEBUG] [LOCAL ] PKE: Trimmed 16867 records to 12563 (keeping 200 days of data) [2025-09-23T20:45:16.802775] [DEBUG] [LOCAL ] PKE: Primary data saved (12563 records). [2025-09-23T20:45:16.802924] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-23T20:45:16.803011] [INFO ] [MAIN ] Update Progress: 1695/2372 symbols completed. PKE took 26.9s. Estimated remaining: 1h 29m 57s. Rate: 7.5 symbols/min [2025-09-23T20:45:16.975273] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:45:16.987596] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T20:45:17.002174] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-23T20:45:17.041477] [DEBUG] [LOCAL ] PL: Loaded 53112 existing records from primary storage. [2025-09-23T20:45:17.041627] [INFO ] [MAIN ] PL: Loaded 53112 existing records. [2025-09-23T20:45:17.219182] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:45:17.219417] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-23T20:45:17.219467] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-23T20:45:17.220528] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-23T20:45:17.220589] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-23T20:45:17.583545] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:45:17.802176] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-23T20:45:18.090853] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T20:45:18.602249] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-23T20:45:19.402158] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-23T20:45:19.719434] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T20:45:19.852402] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T20:45:20.067212] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T20:45:20.070935] [INFO ] [REMOTE ] PKST: Full fetch complete (29711 records). [2025-09-23T20:45:20.071016] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-23T20:45:20.210419] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-23T20:45:20.441293] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-23T20:45:20.441367] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-23T20:45:20.441981] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-23T20:45:20.442042] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-23T20:45:20.442760] [DEBUG] [LOCAL ] PKST: Trimmed 29711 records to 19320 (keeping 200 days of data) [2025-09-23T20:45:20.556708] [DEBUG] [LOCAL ] PKST: Primary data saved (19320 records). [2025-09-23T20:45:20.556847] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-23T20:45:20.556928] [INFO ] [MAIN ] Update Progress: 1696/2372 symbols completed. PKST took 22.4s. Estimated remaining: 1h 29m 48s. Rate: 7.5 symbols/min [2025-09-23T20:45:20.728216] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:45:20.789687] [DEBUG] [LOCAL ] PLD: Loaded 53488 existing records from primary storage. [2025-09-23T20:45:20.789828] [INFO ] [MAIN ] PLD: Loaded 53488 existing records. [2025-09-23T20:45:20.966709] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:45:20.966973] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-23T20:45:20.967031] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-23T20:45:20.968322] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-23T20:45:20.968385] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-23T20:45:21.007392] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-23T20:45:21.328841] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:45:21.802193] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-23T20:45:22.391801] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T20:45:22.457236] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-23T20:45:22.602168] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-23T20:45:23.402169] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-23T20:45:23.568085] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T20:45:23.855119] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T20:45:24.202250] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-23T20:45:25.007745] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-23T20:45:25.018307] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T20:45:25.802267] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-23T20:45:26.537378] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-23T20:45:26.590671] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T20:45:26.602219] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-23T20:45:27.402202] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-23T20:45:27.752800] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T20:45:28.142725] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T20:45:28.202171] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-23T20:45:28.275665] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T20:45:29.002201] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-23T20:45:29.802245] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-23T20:45:29.862376] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T20:45:30.602205] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-23T20:45:31.156070] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-23T20:45:31.402190] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-23T20:45:31.719995] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-23T20:45:31.800991] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T20:45:32.202197] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-23T20:45:32.308793] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T20:45:33.002184] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-23T20:45:33.802221] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-23T20:45:33.974533] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T20:45:34.246563] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T20:45:34.602256] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-23T20:45:35.402289] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-23T20:45:35.664217] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T20:45:36.068767] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T20:45:36.076197] [INFO ] [REMOTE ] PKG: Full fetch complete (57413 records). [2025-09-23T20:45:36.076343] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-23T20:45:36.207298] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-23T20:45:36.478127] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-23T20:45:36.478230] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-23T20:45:36.479173] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-23T20:45:36.479235] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-23T20:45:36.480468] [DEBUG] [LOCAL ] PKG: Trimmed 57413 records to 39286 (keeping 200 days of data) [2025-09-23T20:45:36.733239] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T20:45:36.755564] [DEBUG] [LOCAL ] PKG: Primary data saved (39286 records). [2025-09-23T20:45:36.755757] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-23T20:45:36.755853] [INFO ] [MAIN ] Update Progress: 1697/2372 symbols completed. PKG took 41.1s. Estimated remaining: 1h 29m 43s. Rate: 7.5 symbols/min [2025-09-23T20:45:36.935832] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:45:36.983426] [DEBUG] [LOCAL ] PLNT: Loaded 48488 existing records from primary storage. [2025-09-23T20:45:36.983691] [INFO ] [MAIN ] PLNT: Loaded 48488 existing records. [2025-09-23T20:45:37.007459] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-23T20:45:37.174913] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:45:37.175154] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-23T20:45:37.175258] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-23T20:45:37.176295] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-23T20:45:37.176357] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-23T20:45:37.541819] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:45:37.802254] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-23T20:45:38.228685] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T20:45:38.602195] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-23T20:45:39.125121] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-23T20:45:39.402191] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-23T20:45:39.452673] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T20:45:40.202269] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-23T20:45:40.664814] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T20:45:40.669401] [INFO ] [REMOTE ] PKX: Full fetch complete (37970 records). [2025-09-23T20:45:40.669490] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-23T20:45:40.881856] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-23T20:45:41.012193] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-23T20:45:41.108828] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-23T20:45:41.108922] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-23T20:45:41.109776] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-23T20:45:41.109842] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-23T20:45:41.110891] [DEBUG] [LOCAL ] PKX: Trimmed 37970 records to 25093 (keeping 200 days of data) [2025-09-23T20:45:41.266112] [DEBUG] [LOCAL ] PKX: Primary data saved (25093 records). [2025-09-23T20:45:41.266250] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-23T20:45:41.266338] [INFO ] [MAIN ] Update Progress: 1698/2372 symbols completed. PKX took 29.7s. Estimated remaining: 1h 29m 34s. Rate: 7.5 symbols/min [2025-09-23T20:45:41.435299] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:45:41.456130] [DEBUG] [LOCAL ] PLOW: Loaded 20572 existing records from primary storage. [2025-09-23T20:45:41.456280] [INFO ] [MAIN ] PLOW: Loaded 20572 existing records. [2025-09-23T20:45:41.644425] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:45:41.644874] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-23T20:45:41.644953] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-23T20:45:41.645738] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-23T20:45:41.645814] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-23T20:45:41.814031] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-23T20:45:42.045106] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:45:42.078895] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T20:45:42.602229] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-23T20:45:43.363095] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-23T20:45:43.402146] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-23T20:45:43.683504] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-23T20:45:44.202244] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-23T20:45:44.253077] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T20:45:45.002214] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-23T20:45:45.556667] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-23T20:45:45.802194] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-23T20:45:45.942365] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T20:45:46.568567] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T20:45:46.602162] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-23T20:45:47.072958] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T20:45:47.402206] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-23T20:45:48.202176] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-23T20:45:48.594687] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T20:45:48.923937] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-23T20:45:48.933221] [INFO ] [REMOTE ] PL: Full fetch complete (76944 records). [2025-09-23T20:45:48.933359] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-23T20:45:49.007424] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-23T20:45:49.343634] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-23T20:45:49.343775] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-23T20:45:49.344938] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-23T20:45:49.345004] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-23T20:45:49.346545] [DEBUG] [LOCAL ] PL: Trimmed 76944 records to 53113 (keeping 200 days of data) [2025-09-23T20:45:49.648810] [DEBUG] [LOCAL ] PL: Primary data saved (53113 records). [2025-09-23T20:45:49.648951] [INFO ] [MAIN ] PL: Full history saved. [2025-09-23T20:45:49.649051] [INFO ] [MAIN ] Update Progress: 1699/2372 symbols completed. PL took 32.8s. Estimated remaining: 1h 29m 26s. Rate: 7.5 symbols/min [2025-09-23T20:45:49.803383] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-23T20:45:49.827767] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:45:49.840711] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T20:45:49.876915] [DEBUG] [LOCAL ] PLYM: Loaded 33185 existing records from primary storage. [2025-09-23T20:45:49.877064] [INFO ] [MAIN ] PLYM: Loaded 33185 existing records. [2025-09-23T20:45:50.061829] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:45:50.088766] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-23T20:45:50.088934] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-23T20:45:50.091431] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T20:45:50.091502] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-23T20:45:50.101843] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-23T20:45:50.467426] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:45:50.602245] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-23T20:45:51.402221] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-23T20:45:51.898400] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T20:45:51.977182] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T20:45:52.202216] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-23T20:45:52.439591] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T20:45:53.002202] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-23T20:45:53.802189] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-23T20:45:53.936733] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T20:45:53.945886] [INFO ] [REMOTE ] PLD: Full fetch complete (77428 records). [2025-09-23T20:45:53.946023] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-23T20:45:54.350919] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-23T20:45:54.351004] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-23T20:45:54.352018] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-23T20:45:54.352084] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-23T20:45:54.353665] [DEBUG] [LOCAL ] PLD: Trimmed 77428 records to 53484 (keeping 200 days of data) [2025-09-23T20:45:54.603777] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-23T20:45:54.729681] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T20:45:54.746690] [DEBUG] [LOCAL ] PLD: Primary data saved (53484 records). [2025-09-23T20:45:54.746814] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-23T20:45:54.746892] [INFO ] [MAIN ] Update Progress: 1700/2372 symbols completed. PLD took 34.2s. Estimated remaining: 1h 29m 17s. Rate: 7.5 symbols/min [2025-09-23T20:45:54.938180] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:45:54.936557] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T20:45:54.942970] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-23T20:45:54.943029] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-23T20:45:54.943179] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-23T20:45:54.943222] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-23T20:45:54.943264] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-23T20:45:54.943297] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-23T20:45:55.334365] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:45:55.402148] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-23T20:45:55.977057] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T20:45:56.202200] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-23T20:45:57.002171] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-23T20:45:57.123558] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T20:45:57.802249] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-23T20:45:57.956241] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T20:45:57.992292] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T20:45:58.602254] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-23T20:45:59.402242] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-23T20:45:59.570532] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T20:45:59.766114] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T20:46:00.202239] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-23T20:46:00.712204] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T20:46:01.002184] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-23T20:46:01.566851] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T20:46:01.802156] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-23T20:46:02.205402] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T20:46:02.602224] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-23T20:46:03.402228] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-23T20:46:03.434198] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T20:46:04.020274] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T20:46:04.202205] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-23T20:46:05.002183] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-23T20:46:05.191481] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T20:46:05.544211] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T20:46:05.802227] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-23T20:46:05.870247] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T20:46:06.602205] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-23T20:46:06.901919] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T20:46:07.402205] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-23T20:46:07.660123] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T20:46:08.161901] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T20:46:08.169492] [INFO ] [REMOTE ] PLNT: Full fetch complete (69756 records). [2025-09-23T20:46:08.169616] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-23T20:46:08.170322] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:46:08.170408] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:46:08.170451] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:46:08.170489] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-23T20:46:08.170560] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-09-23T20:46:08.170617] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-09-23T20:46:08.171268] [DEBUG] [LOCAL ] PLNT: Deleted derivative data file. [2025-09-23T20:46:08.171383] [INFO ] [MAIN ] Update Progress: 1701/2372 symbols completed. PLNT took 31.4s. Estimated remaining: 1h 29m 11s. Rate: 7.5 symbols/min [2025-09-23T20:46:08.207368] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-23T20:46:08.346900] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:46:08.367081] [DEBUG] [LOCAL ] PML: Loaded 20451 existing records from primary storage. [2025-09-23T20:46:08.367213] [INFO ] [MAIN ] PML: Loaded 20451 existing records. [2025-09-23T20:46:08.564004] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:46:08.564304] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-23T20:46:08.564384] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-23T20:46:08.565254] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-23T20:46:08.565326] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-23T20:46:08.917783] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:46:09.002186] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-23T20:46:09.802245] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-23T20:46:10.464121] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T20:46:10.608943] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-23T20:46:10.628894] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-23T20:46:10.975227] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T20:46:10.978365] [INFO ] [REMOTE ] PLOW: Full fetch complete (28792 records). [2025-09-23T20:46:10.978482] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-23T20:46:11.345355] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-23T20:46:11.345441] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-23T20:46:11.346040] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-23T20:46:11.346101] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-23T20:46:11.346836] [DEBUG] [LOCAL ] PLOW: Trimmed 28792 records to 20551 (keeping 200 days of data) [2025-09-23T20:46:11.408154] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-23T20:46:11.476151] [DEBUG] [LOCAL ] PLOW: Primary data saved (20551 records). [2025-09-23T20:46:11.476274] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-23T20:46:11.476353] [INFO ] [MAIN ] Update Progress: 1702/2372 symbols completed. PLOW took 30.2s. Estimated remaining: 1h 29m 1s. Rate: 7.5 symbols/min [2025-09-23T20:46:11.652610] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:46:11.663935] [DEBUG] [LOCAL ] PMM: Loaded 10544 existing records from primary storage. [2025-09-23T20:46:11.664045] [INFO ] [MAIN ] PMM: Loaded 10544 existing records. [2025-09-23T20:46:11.845026] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:46:11.845320] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-23T20:46:11.845417] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-23T20:46:11.846023] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-23T20:46:11.846089] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-23T20:46:12.209457] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T20:46:12.216676] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-23T20:46:12.241023] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:46:12.597275] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T20:46:13.002243] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-23T20:46:13.802199] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-23T20:46:14.324430] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-23T20:46:14.359537] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T20:46:14.429316] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T20:46:14.602214] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-23T20:46:15.402214] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-23T20:46:16.159199] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T20:46:16.202214] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-23T20:46:17.002196] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-23T20:46:17.179639] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T20:46:17.614826] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-23T20:46:17.802200] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-23T20:46:18.301163] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T20:46:18.310944] [INFO ] [REMOTE ] PLYM: Full fetch complete (46507 records). [2025-09-23T20:46:18.311057] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-23T20:46:18.607384] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-23T20:46:18.704537] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-23T20:46:18.704628] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-23T20:46:18.705504] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-23T20:46:18.705570] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-23T20:46:18.707052] [DEBUG] [LOCAL ] PLYM: Trimmed 46507 records to 33267 (keeping 200 days of data) [2025-09-23T20:46:18.918903] [DEBUG] [LOCAL ] PLYM: Primary data saved (33267 records). [2025-09-23T20:46:18.919057] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-23T20:46:18.919180] [INFO ] [MAIN ] Update Progress: 1703/2372 symbols completed. PLYM took 29.3s. Estimated remaining: 1h 28m 53s. Rate: 7.5 symbols/min [2025-09-23T20:46:19.087606] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:46:19.100604] [DEBUG] [LOCAL ] PMO: Loaded 10536 existing records from primary storage. [2025-09-23T20:46:19.100758] [INFO ] [MAIN ] PMO: Loaded 10536 existing records. [2025-09-23T20:46:19.279895] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:46:19.280182] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-23T20:46:19.280243] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-23T20:46:19.280677] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-23T20:46:19.280738] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-23T20:46:19.407371] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-23T20:46:19.648054] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:46:19.833057] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T20:46:20.006880] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T20:46:20.202196] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-23T20:46:20.414121] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T20:46:21.002246] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-23T20:46:21.802179] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-23T20:46:22.061866] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T20:46:22.255447] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T20:46:22.602222] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-23T20:46:22.883298] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T20:46:23.402200] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-23T20:46:23.927260] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T20:46:24.136198] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T20:46:24.202195] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-23T20:46:25.002173] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-23T20:46:25.024253] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T20:46:25.802230] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-23T20:46:26.602173] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-23T20:46:26.868833] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T20:46:27.061082] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-23T20:46:27.402233] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-23T20:46:27.451239] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T20:46:28.202220] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-23T20:46:28.492678] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T20:46:29.002207] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-23T20:46:29.125525] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T20:46:29.771856] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T20:46:29.780479] [INFO ] [REMOTE ] PM: Full fetch complete (77313 records). [2025-09-23T20:46:29.780674] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-23T20:46:29.784671] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:46:29.784806] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:46:29.784883] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:46:29.784965] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-23T20:46:29.785087] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-23T20:46:29.785145] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-23T20:46:29.785191] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-09-23T20:46:29.785307] [INFO ] [MAIN ] Update Progress: 1704/2372 symbols completed. PM took 35.0s. Estimated remaining: 1h 28m 46s. Rate: 7.5 symbols/min [2025-09-23T20:46:29.807310] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-23T20:46:29.969138] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:46:30.015013] [DEBUG] [LOCAL ] PMT: Loaded 40323 existing records from primary storage. [2025-09-23T20:46:30.015169] [INFO ] [MAIN ] PMT: Loaded 40323 existing records. [2025-09-23T20:46:30.194172] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:46:30.194408] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-23T20:46:30.194456] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-23T20:46:30.196189] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-23T20:46:30.196251] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-23T20:46:30.568577] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:46:30.602221] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-23T20:46:30.819842] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T20:46:31.402247] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-23T20:46:31.831022] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T20:46:32.202234] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-23T20:46:33.002185] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-23T20:46:33.071732] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T20:46:33.085441] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T20:46:33.802154] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-23T20:46:34.039966] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T20:46:34.602252] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-23T20:46:35.408037] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-23T20:46:35.412969] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T20:46:35.834613] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T20:46:36.187816] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T20:46:36.202147] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-23T20:46:37.002206] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-23T20:46:37.033631] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T20:46:37.802176] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-23T20:46:38.019149] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T20:46:38.024329] [INFO ] [REMOTE ] PML: Full fetch complete (29542 records). [2025-09-23T20:46:38.024429] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-23T20:46:38.405526] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-23T20:46:38.405610] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-23T20:46:38.406245] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-23T20:46:38.406335] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-23T20:46:38.407152] [DEBUG] [LOCAL ] PML: Trimmed 29542 records to 20499 (keeping 200 days of data) [2025-09-23T20:46:38.550929] [DEBUG] [LOCAL ] PML: Primary data saved (20499 records). [2025-09-23T20:46:38.551230] [INFO ] [MAIN ] PML: Full history saved. [2025-09-23T20:46:38.551428] [INFO ] [MAIN ] Update Progress: 1705/2372 symbols completed. PML took 30.4s. Estimated remaining: 1h 28m 39s. Rate: 7.5 symbols/min [2025-09-23T20:46:38.608495] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-23T20:46:38.673080] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T20:46:38.746926] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:46:38.747119] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-23T20:46:38.747174] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-23T20:46:38.747315] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-23T20:46:38.747358] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-23T20:46:38.747399] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-23T20:46:38.747445] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-23T20:46:39.127136] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:46:39.402236] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-23T20:46:40.058311] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T20:46:40.202205] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-23T20:46:40.214408] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T20:46:41.002197] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-23T20:46:41.802334] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-23T20:46:41.836752] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T20:46:41.865925] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T20:46:42.352875] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T20:46:42.356280] [INFO ] [REMOTE ] PMM: Full fetch complete (18244 records). [2025-09-23T20:46:42.356374] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-23T20:46:42.607433] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-23T20:46:42.739035] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-23T20:46:42.739113] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-23T20:46:42.739622] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-23T20:46:42.739726] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-23T20:46:42.740736] [DEBUG] [LOCAL ] PMM: Trimmed 18244 records to 10568 (keeping 200 days of data) [2025-09-23T20:46:42.812092] [DEBUG] [LOCAL ] PMM: Primary data saved (10568 records). [2025-09-23T20:46:42.812229] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-23T20:46:42.812385] [INFO ] [MAIN ] Update Progress: 1706/2372 symbols completed. PMM took 31.3s. Estimated remaining: 1h 28m 29s. Rate: 7.5 symbols/min [2025-09-23T20:46:42.983931] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:46:42.984118] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-23T20:46:42.984173] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-23T20:46:42.984316] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-23T20:46:42.984360] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-23T20:46:42.984403] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-23T20:46:42.984436] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-23T20:46:43.063333] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T20:46:43.356569] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:46:43.402213] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-23T20:46:44.202219] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-23T20:46:44.609397] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T20:46:45.002211] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-23T20:46:45.802245] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-23T20:46:45.903763] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:46:45.904301] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-23T20:46:46.602175] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-23T20:46:46.707362] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T20:46:46.922469] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T20:46:46.957046] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-23T20:46:47.402215] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-23T20:46:48.202245] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-23T20:46:48.690243] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T20:46:49.007300] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-23T20:46:49.020175] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T20:46:49.392851] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-23T20:46:49.802223] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-23T20:46:50.602197] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-23T20:46:51.399290] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T20:46:51.407207] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-23T20:46:51.416806] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T20:46:51.803120] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T20:46:52.202236] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-23T20:46:53.002195] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-23T20:46:53.807300] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-23T20:46:53.825977] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T20:46:53.845428] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T20:46:54.204316] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T20:46:54.602208] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-23T20:46:55.402167] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-23T20:46:55.468660] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T20:46:55.470573] [INFO ] [REMOTE ] PMO: Full fetch complete (17376 records). [2025-09-23T20:46:55.470676] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-23T20:46:55.767401] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T20:46:55.880487] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-23T20:46:55.880600] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-23T20:46:55.881090] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-23T20:46:55.881156] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-23T20:46:55.882091] [DEBUG] [LOCAL ] PMO: Trimmed 17376 records to 10393 (keeping 200 days of data) [2025-09-23T20:46:55.953635] [DEBUG] [LOCAL ] PMO: Primary data saved (10393 records). [2025-09-23T20:46:55.953838] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-23T20:46:55.954022] [INFO ] [MAIN ] Update Progress: 1707/2372 symbols completed. PMO took 37.0s. Estimated remaining: 1h 28m 23s. Rate: 7.5 symbols/min [2025-09-23T20:46:56.137787] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:46:56.137983] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-23T20:46:56.138023] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-23T20:46:56.138252] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-23T20:46:56.138308] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-23T20:46:56.138379] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-23T20:46:56.138415] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-23T20:46:56.207432] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-23T20:46:56.505530] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:46:56.548130] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:46:56.548460] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-23T20:46:57.002201] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-23T20:46:57.248464] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:46:57.248878] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-23T20:46:57.802220] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-23T20:46:58.181105] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-23T20:46:58.182122] [INFO ] [REMOTE ] PMTU: Full fetch complete (1209 records). [2025-09-23T20:46:58.182206] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-23T20:46:58.376506] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-23T20:46:58.376760] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:46:58.376828] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:46:58.376901] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-23T20:46:58.376965] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-23T20:46:58.377011] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-23T20:46:58.377088] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-23T20:46:58.377168] [INFO ] [MAIN ] Update Progress: 1708/2372 symbols completed. PMTU took 19.8s. Estimated remaining: 1h 28m 13s. Rate: 7.5 symbols/min [2025-09-23T20:46:58.543677] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:46:58.543885] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-23T20:46:58.543939] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-23T20:46:58.544079] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-23T20:46:58.544120] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-23T20:46:58.544161] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-23T20:46:58.544193] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-23T20:46:58.607333] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-23T20:46:58.978223] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:46:59.402191] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-23T20:47:00.202279] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-23T20:47:00.869551] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-23T20:47:01.002195] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-23T20:47:01.260690] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:47:01.261017] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-23T20:47:01.802949] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-23T20:47:01.810544] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-23T20:47:02.131966] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:47:02.132286] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-23T20:47:02.602193] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-23T20:47:02.926332] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-23T20:47:02.932834] [INFO ] [REMOTE ] PMT: Full fetch complete (58165 records). [2025-09-23T20:47:02.932959] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-23T20:47:03.312549] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-23T20:47:03.312634] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-23T20:47:03.313592] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-23T20:47:03.313679] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-23T20:47:03.314927] [DEBUG] [LOCAL ] PMT: Trimmed 58165 records to 40341 (keeping 200 days of data) [2025-09-23T20:47:03.413529] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-23T20:47:03.577145] [DEBUG] [LOCAL ] PMT: Primary data saved (40341 records). [2025-09-23T20:47:03.577286] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-23T20:47:03.577371] [INFO ] [MAIN ] Update Progress: 1709/2372 symbols completed. PMT took 33.8s. Estimated remaining: 1h 28m 4s. Rate: 7.5 symbols/min [2025-09-23T20:47:03.743695] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:47:03.753002] [DEBUG] [LOCAL ] PNI: Loaded 6722 existing records from primary storage. [2025-09-23T20:47:03.753123] [INFO ] [MAIN ] PNI: Loaded 6722 existing records. [2025-09-23T20:47:03.927860] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:47:03.928123] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-23T20:47:03.928172] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-23T20:47:03.928773] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-23T20:47:03.928836] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-23T20:47:04.207279] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-23T20:47:04.306836] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:47:04.303433] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T20:47:04.451052] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T20:47:04.508855] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:47:04.509145] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-23T20:47:05.002197] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-23T20:47:05.802192] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-23T20:47:06.417743] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T20:47:06.602182] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-23T20:47:06.740513] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T20:47:06.870010] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:47:06.870333] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-23T20:47:07.402189] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-23T20:47:08.202269] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-23T20:47:09.002244] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-23T20:47:09.204377] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T20:47:09.299736] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T20:47:09.746775] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T20:47:09.802202] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-23T20:47:10.602205] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-23T20:47:10.853015] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:47:10.853378] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-23T20:47:11.402168] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-23T20:47:11.865221] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-23T20:47:12.051539] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T20:47:12.202176] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-23T20:47:13.002196] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-23T20:47:13.554609] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T20:47:13.802188] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-23T20:47:14.602193] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-23T20:47:15.110674] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T20:47:15.209017] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T20:47:15.402220] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-23T20:47:15.858811] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-23T20:47:16.202156] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-23T20:47:16.359009] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T20:47:17.002238] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-23T20:47:17.780097] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T20:47:17.802132] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-23T20:47:18.055313] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-23T20:47:18.277188] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T20:47:18.602249] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-23T20:47:19.230131] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T20:47:19.402226] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-23T20:47:20.202197] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-23T20:47:20.859462] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T20:47:21.002747] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-23T20:47:21.448428] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T20:47:21.520568] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T20:47:21.802202] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-23T20:47:22.602214] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-23T20:47:22.673736] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T20:47:22.988318] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T20:47:22.989509] [INFO ] [REMOTE ] PMTW: Full fetch complete (3654 records). [2025-09-23T20:47:22.989580] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-23T20:47:23.175916] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-23T20:47:23.176147] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:47:23.176196] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:47:23.176237] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-23T20:47:23.176297] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-23T20:47:23.176333] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-23T20:47:23.176394] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-23T20:47:23.176477] [INFO ] [MAIN ] Update Progress: 1710/2372 symbols completed. PMTW took 27.2s. Estimated remaining: 1h 28m 0s. Rate: 7.5 symbols/min [2025-09-23T20:47:23.355959] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:47:23.403307] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-23T20:47:23.406051] [DEBUG] [LOCAL ] PNNT: Loaded 32871 existing records from primary storage. [2025-09-23T20:47:23.406128] [INFO ] [MAIN ] PNNT: Loaded 32871 existing records. [2025-09-23T20:47:23.588071] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:47:23.588344] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-23T20:47:23.588421] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-23T20:47:23.589517] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-23T20:47:23.589581] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-23T20:47:23.957370] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:47:24.101401] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T20:47:24.202199] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-23T20:47:25.002240] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-23T20:47:25.658590] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T20:47:25.658278] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T20:47:25.802195] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-23T20:47:26.602198] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-23T20:47:27.005411] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T20:47:27.007826] [INFO ] [REMOTE ] PMTV: Full fetch complete (6100 records). [2025-09-23T20:47:27.008138] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-23T20:47:27.169765] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T20:47:27.245380] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 152 unique days, need 200 days [2025-09-23T20:47:27.245614] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:47:27.245706] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:47:27.245780] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-23T20:47:27.245850] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-23T20:47:27.245887] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-23T20:47:27.245926] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-23T20:47:27.246021] [INFO ] [MAIN ] Update Progress: 1711/2372 symbols completed. PMTV took 44.4s. Estimated remaining: 1h 27m 51s. Rate: 7.5 symbols/min [2025-09-23T20:47:27.406606] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-23T20:47:27.417796] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:47:27.418998] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-23T20:47:27.419064] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-23T20:47:27.419220] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-23T20:47:27.419265] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-23T20:47:27.419331] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-23T20:47:27.419365] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-23T20:47:27.780107] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:47:28.202185] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-23T20:47:28.790862] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T20:47:29.002308] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-23T20:47:29.802201] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-23T20:47:29.898315] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T20:47:30.602230] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-23T20:47:31.402308] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-23T20:47:31.576061] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-23T20:47:31.678324] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T20:47:32.202262] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-23T20:47:32.832222] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T20:47:32.987086] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T20:47:33.002176] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-23T20:47:33.047495] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-23T20:47:33.782981] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T20:47:33.792823] [INFO ] [REMOTE ] PNC: Full fetch complete (75164 records). [2025-09-23T20:47:33.793086] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-23T20:47:33.794252] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:47:33.794405] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:47:33.794451] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:47:33.794496] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-23T20:47:33.794570] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-23T20:47:33.794610] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-23T20:47:33.794684] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-09-23T20:47:33.794783] [INFO ] [MAIN ] Update Progress: 1712/2372 symbols completed. PNC took 35.4s. Estimated remaining: 1h 27m 42s. Rate: 7.5 symbols/min [2025-09-23T20:47:33.807374] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-23T20:47:34.001936] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:47:34.059145] [DEBUG] [LOCAL ] PNW: Loaded 45967 existing records from primary storage. [2025-09-23T20:47:34.059376] [INFO ] [MAIN ] PNW: Loaded 45967 existing records. [2025-09-23T20:47:34.270117] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:47:34.270445] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-23T20:47:34.270515] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-23T20:47:34.272531] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-23T20:47:34.272906] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-23T20:47:34.607476] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-23T20:47:34.647939] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:47:35.402234] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-23T20:47:35.441521] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T20:47:35.444183] [INFO ] [REMOTE ] PNI: Full fetch complete (9974 records). [2025-09-23T20:47:35.444494] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-23T20:47:35.575186] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T20:47:35.845144] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-23T20:47:35.845236] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-23T20:47:35.845511] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-23T20:47:35.845571] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-23T20:47:35.846056] [DEBUG] [LOCAL ] PNI: Trimmed 9974 records to 6709 (keeping 200 days of data) [2025-09-23T20:47:35.886953] [DEBUG] [LOCAL ] PNI: Primary data saved (6709 records). [2025-09-23T20:47:35.887108] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-23T20:47:35.887198] [INFO ] [MAIN ] Update Progress: 1713/2372 symbols completed. PNI took 32.3s. Estimated remaining: 1h 27m 32s. Rate: 7.5 symbols/min [2025-09-23T20:47:36.061907] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:47:36.062130] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-09-23T20:47:36.062180] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-09-23T20:47:36.062378] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-23T20:47:36.062431] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-23T20:47:36.062475] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-09-23T20:47:36.062507] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-23T20:47:36.211767] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-23T20:47:36.426863] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:47:37.002166] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-23T20:47:37.187523] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T20:47:37.805544] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-23T20:47:37.810069] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T20:47:38.602168] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-23T20:47:38.769517] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T20:47:39.402223] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-23T20:47:39.528036] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T20:47:39.589565] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T20:47:40.202289] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-23T20:47:41.003283] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T20:47:41.003407] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-23T20:47:41.362704] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T20:47:41.802217] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-23T20:47:42.371739] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T20:47:42.602250] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-23T20:47:43.402177] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-23T20:47:43.670935] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T20:47:43.752219] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T20:47:44.202203] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-23T20:47:44.444428] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T20:47:45.002203] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-23T20:47:45.802165] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-23T20:47:45.859187] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T20:47:46.476339] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T20:47:46.602166] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-23T20:47:47.118724] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T20:47:47.402254] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-23T20:47:48.036982] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T20:47:48.202207] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-23T20:47:49.002172] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-23T20:47:49.222680] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T20:47:49.523124] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T20:47:49.802267] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-23T20:47:50.602242] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-23T20:47:50.755421] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T20:47:51.402189] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-23T20:47:51.562625] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T20:47:52.046035] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T20:47:52.202223] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-23T20:47:53.002181] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-23T20:47:53.172946] [DEBUG] [REMOTE ] POR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-23T20:47:53.173288] [WARN ] [REMOTE ] POR: No data returned for month 2025-05 [2025-09-23T20:47:53.200968] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T20:47:53.802181] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-23T20:47:54.067579] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T20:47:54.602208] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-23T20:47:55.157237] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T20:47:55.163030] [INFO ] [REMOTE ] PNNT: Full fetch complete (47243 records). [2025-09-23T20:47:55.163123] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-23T20:47:55.411322] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-23T20:47:55.564114] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-23T20:47:55.581467] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-23T20:47:55.582473] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-23T20:47:55.583122] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-23T20:47:55.583846] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T20:47:55.591888] [INFO ] [REMOTE ] PNR: Full fetch complete (68917 records). [2025-09-23T20:47:55.592026] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-23T20:47:55.592493] [DEBUG] [LOCAL ] PNNT: Trimmed 47243 records to 32872 (keeping 200 days of data) [2025-09-23T20:47:55.592948] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:47:55.593478] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:47:55.593548] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:47:55.593616] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-23T20:47:55.593750] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-23T20:47:55.594044] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-23T20:47:55.594143] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-09-23T20:47:55.594211] [INFO ] [MAIN ] Update Progress: 1714/2372 symbols completed. PNR took 28.3s. Estimated remaining: 1h 27m 29s. Rate: 7.5 symbols/min [2025-09-23T20:47:55.853741] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:47:55.969554] [DEBUG] [LOCAL ] POST: Loaded 38990 existing records from primary storage. [2025-09-23T20:47:55.970471] [INFO ] [MAIN ] POST: Loaded 38990 existing records. [2025-09-23T20:47:56.165864] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:47:56.167259] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-23T20:47:56.168171] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-23T20:47:56.170596] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-23T20:47:56.171240] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-23T20:47:56.203228] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-23T20:47:56.299179] [DEBUG] [LOCAL ] PNNT: Primary data saved (32872 records). [2025-09-23T20:47:56.322813] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-23T20:47:56.333331] [INFO ] [MAIN ] Update Progress: 1715/2372 symbols completed. PNNT took 33.2s. Estimated remaining: 1h 27m 18s. Rate: 7.5 symbols/min [2025-09-23T20:47:56.725404] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:47:56.731720] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:47:56.786166] [DEBUG] [LOCAL ] PPG: Loaded 50700 existing records from primary storage. [2025-09-23T20:47:56.786317] [INFO ] [MAIN ] PPG: Loaded 50700 existing records. [2025-09-23T20:47:56.964686] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:47:56.965035] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-23T20:47:56.965092] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-23T20:47:56.966326] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-23T20:47:56.966431] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-23T20:47:57.008809] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-23T20:47:57.357554] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:47:57.359400] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T20:47:57.570082] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T20:47:57.802235] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-23T20:47:58.183386] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T20:47:58.602198] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-23T20:47:59.402199] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-23T20:47:59.537674] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T20:47:59.648832] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T20:48:00.202211] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-23T20:48:01.002167] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-23T20:48:01.110668] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T20:48:01.802205] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-23T20:48:02.240150] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-23T20:48:02.518493] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T20:48:02.602173] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-23T20:48:03.402212] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-23T20:48:04.202186] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-23T20:48:04.662719] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-23T20:48:04.765148] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-23T20:48:05.002195] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-23T20:48:05.740813] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T20:48:05.748624] [INFO ] [REMOTE ] PNW: Full fetch complete (66221 records). [2025-09-23T20:48:05.748877] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-23T20:48:05.806407] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-23T20:48:06.169533] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-23T20:48:06.200288] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-23T20:48:06.200373] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-23T20:48:06.201372] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-23T20:48:06.201452] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-23T20:48:06.203037] [DEBUG] [LOCAL ] PNW: Trimmed 66221 records to 45908 (keeping 200 days of data) [2025-09-23T20:48:06.465174] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T20:48:06.529129] [DEBUG] [LOCAL ] PNW: Primary data saved (45908 records). [2025-09-23T20:48:06.529274] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-23T20:48:06.529364] [INFO ] [MAIN ] Update Progress: 1716/2372 symbols completed. PNW took 32.7s. Estimated remaining: 1h 27m 11s. Rate: 7.5 symbols/min [2025-09-23T20:48:06.607277] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-23T20:48:06.705222] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:48:06.705447] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-23T20:48:06.705504] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-23T20:48:06.705684] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-23T20:48:06.705741] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-23T20:48:06.705787] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-23T20:48:06.705822] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-23T20:48:07.097192] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:48:07.402186] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-23T20:48:07.497757] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T20:48:07.506159] [INFO ] [REMOTE ] POR: Full fetch complete (61379 records). [2025-09-23T20:48:07.506296] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-23T20:48:07.710785] [WARN ] [VALIDATOR ] POR: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T20:48:07.711487] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:48:07.711558] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:48:07.711630] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-23T20:48:07.711748] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-09-23T20:48:07.711798] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-09-23T20:48:07.711841] [DEBUG] [LOCAL ] POR: No derivative data file found to delete. [2025-09-23T20:48:07.711905] [INFO ] [MAIN ] Update Progress: 1717/2372 symbols completed. POR took 31.8s. Estimated remaining: 1h 27m 0s. Rate: 7.5 symbols/min [2025-09-23T20:48:08.202173] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-23T20:48:08.462061] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T20:48:08.595606] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T20:48:09.002260] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-23T20:48:09.802213] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-23T20:48:09.983996] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T20:48:10.602267] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-23T20:48:10.744771] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T20:48:11.240961] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T20:48:11.402234] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-23T20:48:12.202176] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-23T20:48:12.377176] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T20:48:13.002164] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-23T20:48:13.046760] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T20:48:13.802180] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-23T20:48:14.032011] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T20:48:14.353284] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T20:48:14.602210] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-23T20:48:15.050869] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T20:48:15.402193] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-23T20:48:16.202230] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-23T20:48:16.492310] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T20:48:17.002170] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-23T20:48:17.344173] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T20:48:17.377012] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T20:48:17.385258] [INFO ] [REMOTE ] POST: Full fetch complete (55707 records). [2025-09-23T20:48:17.385457] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-23T20:48:17.799598] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-23T20:48:17.799706] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-23T20:48:17.800604] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-23T20:48:17.800689] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-23T20:48:17.801846] [DEBUG] [LOCAL ] POST: Trimmed 55707 records to 38936 (keeping 200 days of data) [2025-09-23T20:48:17.802265] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-23T20:48:18.052101] [DEBUG] [LOCAL ] POST: Primary data saved (38936 records). [2025-09-23T20:48:18.052265] [INFO ] [MAIN ] POST: Full history saved. [2025-09-23T20:48:18.052358] [INFO ] [MAIN ] Update Progress: 1718/2372 symbols completed. POST took 22.5s. Estimated remaining: 1h 26m 53s. Rate: 7.5 symbols/min [2025-09-23T20:48:18.584291] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T20:48:18.602145] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-23T20:48:19.278894] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T20:48:19.402151] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-23T20:48:20.430085] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T20:48:20.441332] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-23T20:48:22.266981] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-09-23T20:48:22.277259] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-23T20:48:23.196383] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-23T20:48:23.207270] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-23T20:48:24.261112] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T20:48:24.272344] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-23T20:48:24.780368] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T20:48:24.793112] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-23T20:48:25.814557] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T20:48:25.825914] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-23T20:48:26.631854] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T20:48:26.643206] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-23T20:48:27.417509] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T20:48:27.426940] [INFO ] [REMOTE ] PPL: Full fetch complete (77027 records). [2025-09-23T20:48:27.427093] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-23T20:48:27.427866] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:48:27.427956] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:48:27.428021] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:48:27.428093] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-23T20:48:27.428163] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-23T20:48:27.428202] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-23T20:48:27.428280] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-09-23T20:48:27.428363] [INFO ] [MAIN ] Update Progress: 1719/2372 symbols completed. PPL took 20.9s. Estimated remaining: 1h 26m 46s. Rate: 7.5 symbols/min [2025-09-23T20:48:27.528180] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T20:48:27.536687] [INFO ] [REMOTE ] PPG: Full fetch complete (73757 records). [2025-09-23T20:48:27.536840] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-23T20:48:27.932924] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-23T20:48:27.933011] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-23T20:48:27.934010] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-23T20:48:27.934101] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-23T20:48:27.935576] [DEBUG] [LOCAL ] PPG: Trimmed 73757 records to 50698 (keeping 200 days of data) [2025-09-23T20:48:28.256416] [DEBUG] [LOCAL ] PPG: Primary data saved (50698 records). [2025-09-23T20:48:28.256577] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-23T20:48:28.258831] [INFO ] [MAIN ] Update Progress: 1720/2372 symbols completed. PPG took 31.9s. Estimated remaining: 1h 26m 35s. Rate: 7.5 symbols/min [2025-09-23T20:48:28.845703] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:48:28.881769] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:48:28.926464] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:48:28.973740] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:48:28.973947] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-23T20:48:28.974148] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-23T20:48:28.974545] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-23T20:48:28.974588] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-23T20:48:28.974630] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-23T20:48:28.974700] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-23T20:48:29.112335] [DEBUG] [LOCAL ] PPT: Loaded 20406 existing records from primary storage. [2025-09-23T20:48:29.178669] [INFO ] [MAIN ] PPT: Loaded 20406 existing records. [2025-09-23T20:48:29.339151] [DEBUG] [LOCAL ] PRA: Loaded 34733 existing records from primary storage. [2025-09-23T20:48:29.384343] [INFO ] [MAIN ] PRA: Loaded 34733 existing records. [2025-09-23T20:48:29.658297] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-23T20:48:29.658486] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:48:29.685764] [INFO ] [MAIN ] PR: Loaded 53609 existing records. [2025-09-23T20:48:29.707087] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-23T20:48:29.731347] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-23T20:48:29.803103] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-23T20:48:29.852548] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-23T20:48:29.836428] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:48:29.903456] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-23T20:48:29.969164] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:48:30.074383] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-23T20:48:30.096628] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-23T20:48:30.144376] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-23T20:48:30.162339] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-23T20:48:30.193320] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:48:30.250998] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-23T20:48:30.296315] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-23T20:48:30.339216] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-23T20:48:30.339323] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-23T20:48:30.598920] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-23T20:48:30.689140] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-23T20:48:30.780121] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:48:30.825802] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-23T20:48:31.300582] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:48:31.321886] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-23T20:48:31.326428] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:48:31.328495] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-23T20:48:31.474477] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T20:48:31.477190] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-23T20:48:32.146098] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T20:48:32.147542] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-23T20:48:32.435444] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T20:48:32.440355] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-23T20:48:32.540854] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T20:48:32.547253] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-23T20:48:32.670487] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T20:48:32.720349] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T20:48:33.002208] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-23T20:48:33.560834] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T20:48:33.599310] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T20:48:33.609977] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T20:48:33.802210] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-23T20:48:34.602180] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-23T20:48:34.845881] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T20:48:34.973233] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T20:48:35.402190] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-23T20:48:36.202207] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-23T20:48:36.832292] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T20:48:36.915591] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T20:48:37.002201] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-23T20:48:37.802210] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-23T20:48:38.307524] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T20:48:38.602210] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-23T20:48:38.640856] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T20:48:39.402198] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-23T20:48:40.202156] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-23T20:48:40.505300] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T20:48:40.864272] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T20:48:41.002214] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-23T20:48:41.125257] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T20:48:41.483785] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T20:48:41.485165] [INFO ] [REMOTE ] PRCS: Full fetch complete (3781 records). [2025-09-23T20:48:41.485250] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-23T20:48:41.673040] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-23T20:48:41.673264] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:48:41.673330] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:48:41.673399] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-23T20:48:41.673480] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-23T20:48:41.673533] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-23T20:48:41.673577] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-23T20:48:41.673634] [INFO ] [MAIN ] Update Progress: 1721/2372 symbols completed. PRCS took 13.4s. Estimated remaining: 1h 26m 29s. Rate: 7.5 symbols/min [2025-09-23T20:48:41.812817] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-23T20:48:41.849628] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:48:41.890005] [DEBUG] [LOCAL ] PRG: Loaded 30223 existing records from primary storage. [2025-09-23T20:48:41.890178] [INFO ] [MAIN ] PRG: Loaded 30223 existing records. [2025-09-23T20:48:42.072214] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:48:42.072443] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-23T20:48:42.072491] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-23T20:48:42.073514] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-23T20:48:42.073574] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-23T20:48:42.454244] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:48:42.602227] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-23T20:48:43.274719] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T20:48:43.402154] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-23T20:48:43.954061] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T20:48:44.202214] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-23T20:48:44.932104] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T20:48:45.002236] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-23T20:48:45.802207] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-23T20:48:46.083954] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T20:48:46.085045] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T20:48:46.602254] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-23T20:48:46.807772] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T20:48:47.323734] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T20:48:47.402150] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-23T20:48:48.202195] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-23T20:48:48.609731] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T20:48:49.002205] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-23T20:48:49.802180] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-23T20:48:50.127275] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T20:48:50.212884] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T20:48:50.602151] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-23T20:48:50.626161] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T20:48:50.631185] [INFO ] [REMOTE ] PRA: Full fetch complete (43399 records). [2025-09-23T20:48:50.631319] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-23T20:48:51.033029] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-23T20:48:51.033203] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-23T20:48:51.034141] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-23T20:48:51.034258] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-23T20:48:51.040380] [DEBUG] [LOCAL ] PRA: Trimmed 43399 records to 34870 (keeping 200 days of data) [2025-09-23T20:48:51.270089] [DEBUG] [LOCAL ] PRA: Primary data saved (34870 records). [2025-09-23T20:48:51.270241] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-23T20:48:51.270487] [INFO ] [MAIN ] Update Progress: 1722/2372 symbols completed. PRA took 23.0s. Estimated remaining: 1h 26m 22s. Rate: 7.5 symbols/min [2025-09-23T20:48:51.411505] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-23T20:48:51.445898] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:48:51.494820] [DEBUG] [LOCAL ] PRGO: Loaded 46912 existing records from primary storage. [2025-09-23T20:48:51.494971] [INFO ] [MAIN ] PRGO: Loaded 46912 existing records. [2025-09-23T20:48:51.694614] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:48:51.695074] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-23T20:48:51.695188] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-23T20:48:51.696780] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-23T20:48:51.696857] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-23T20:48:52.066255] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:48:52.202207] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-23T20:48:52.581028] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T20:48:52.633763] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T20:48:53.002247] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-23T20:48:53.802181] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-23T20:48:53.889706] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T20:48:54.574414] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T20:48:54.602233] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-23T20:48:54.960349] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T20:48:55.402212] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-23T20:48:56.202186] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-23T20:48:56.471988] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T20:48:56.691995] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T20:48:57.002188] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-23T20:48:57.709079] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T20:48:57.802191] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-23T20:48:58.602179] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-23T20:48:58.690383] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T20:48:59.360830] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T20:48:59.402274] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-23T20:49:00.105535] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T20:49:00.202148] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-23T20:49:01.002182] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-23T20:49:01.333443] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T20:49:01.771819] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T20:49:01.802268] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-23T20:49:02.500508] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T20:49:02.602222] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-23T20:49:03.402223] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-23T20:49:03.689474] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T20:49:03.963793] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T20:49:04.202190] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-23T20:49:05.002171] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-23T20:49:05.205387] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T20:49:05.802279] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-23T20:49:06.012135] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T20:49:06.024663] [INFO ] [REMOTE ] PR: Full fetch complete (77593 records). [2025-09-23T20:49:06.024936] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-23T20:49:06.285615] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T20:49:06.516505] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-23T20:49:06.516638] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-23T20:49:06.518246] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-23T20:49:06.518319] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-23T20:49:06.521069] [DEBUG] [LOCAL ] PR: Trimmed 77593 records to 53609 (keeping 200 days of data) [2025-09-23T20:49:06.623088] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-23T20:49:06.878557] [DEBUG] [LOCAL ] PR: Primary data saved (53609 records). [2025-09-23T20:49:06.878869] [INFO ] [MAIN ] PR: Full history saved. [2025-09-23T20:49:06.878995] [INFO ] [MAIN ] Update Progress: 1723/2372 symbols completed. PR took 38.6s. Estimated remaining: 1h 26m 17s. Rate: 7.5 symbols/min [2025-09-23T20:49:07.112138] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:49:07.121186] [DEBUG] [LOCAL ] PRH: Loaded 4919 existing records from primary storage. [2025-09-23T20:49:07.121350] [INFO ] [MAIN ] PRH: Loaded 4919 existing records. [2025-09-23T20:49:07.306154] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:49:07.306506] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-23T20:49:07.306563] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-23T20:49:07.307098] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-23T20:49:07.307215] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-23T20:49:07.406723] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-23T20:49:07.686717] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:49:07.717443] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T20:49:08.142794] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T20:49:08.162217] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T20:49:08.202157] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-23T20:49:09.002222] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-23T20:49:09.492951] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T20:49:09.723607] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T20:49:09.728088] [INFO ] [REMOTE ] PPT: Full fetch complete (29194 records). [2025-09-23T20:49:09.728214] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-23T20:49:09.807446] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-23T20:49:10.135446] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-23T20:49:10.135577] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-23T20:49:10.136625] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-23T20:49:10.136710] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-23T20:49:10.138891] [DEBUG] [LOCAL ] PPT: Trimmed 29194 records to 20146 (keeping 200 days of data) [2025-09-23T20:49:10.292473] [DEBUG] [LOCAL ] PPT: Primary data saved (20146 records). [2025-09-23T20:49:10.292624] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-23T20:49:10.292803] [INFO ] [MAIN ] Update Progress: 1724/2372 symbols completed. PPT took 42.0s. Estimated remaining: 1h 26m 7s. Rate: 7.5 symbols/min [2025-09-23T20:49:10.475928] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:49:10.499431] [DEBUG] [LOCAL ] PRI: Loaded 18382 existing records from primary storage. [2025-09-23T20:49:10.499584] [INFO ] [MAIN ] PRI: Loaded 18382 existing records. [2025-09-23T20:49:10.607435] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-23T20:49:10.692113] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:49:10.692383] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-23T20:49:10.692433] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-23T20:49:10.693289] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-23T20:49:10.693352] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-23T20:49:11.091932] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:49:11.106135] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T20:49:11.113638] [INFO ] [REMOTE ] PRG: Full fetch complete (44028 records). [2025-09-23T20:49:11.113771] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-23T20:49:11.403917] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-23T20:49:11.462516] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T20:49:11.516720] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-23T20:49:11.516843] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-23T20:49:11.517795] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-23T20:49:11.517859] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-23T20:49:11.520903] [DEBUG] [LOCAL ] PRG: Trimmed 44028 records to 30129 (keeping 200 days of data) [2025-09-23T20:49:11.722585] [DEBUG] [LOCAL ] PRG: Primary data saved (30129 records). [2025-09-23T20:49:11.722771] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-23T20:49:11.722892] [INFO ] [MAIN ] Update Progress: 1725/2372 symbols completed. PRG took 30.0s. Estimated remaining: 1h 25m 57s. Rate: 7.5 symbols/min [2025-09-23T20:49:11.895137] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:49:11.946348] [DEBUG] [LOCAL ] PRIM: Loaded 44558 existing records from primary storage. [2025-09-23T20:49:11.946540] [INFO ] [MAIN ] PRIM: Loaded 44558 existing records. [2025-09-23T20:49:12.127582] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:49:12.127907] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-23T20:49:12.127956] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-23T20:49:12.129584] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-23T20:49:12.129676] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-23T20:49:12.207626] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-23T20:49:12.519023] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:49:12.926118] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T20:49:13.002201] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-23T20:49:13.246082] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T20:49:13.802236] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-23T20:49:14.087609] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T20:49:14.602196] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-23T20:49:15.092187] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T20:49:15.347549] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T20:49:15.402204] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-23T20:49:16.202208] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-23T20:49:16.965624] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T20:49:17.002162] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-23T20:49:17.056692] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T20:49:17.802213] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-23T20:49:18.602242] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-23T20:49:18.645738] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T20:49:18.670104] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T20:49:19.402239] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-23T20:49:20.202210] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-23T20:49:20.333747] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T20:49:20.877812] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T20:49:21.002270] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-23T20:49:21.246694] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T20:49:21.802242] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-23T20:49:22.602159] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-23T20:49:22.689602] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T20:49:22.698006] [INFO ] [REMOTE ] PRGO: Full fetch complete (68331 records). [2025-09-23T20:49:22.698127] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-23T20:49:23.047371] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T20:49:23.123883] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-23T20:49:23.123977] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-23T20:49:23.124960] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-23T20:49:23.125024] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-23T20:49:23.126568] [DEBUG] [LOCAL ] PRGO: Trimmed 68331 records to 46900 (keeping 200 days of data) [2025-09-23T20:49:23.403166] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-23T20:49:23.434188] [DEBUG] [LOCAL ] PRGO: Primary data saved (46900 records). [2025-09-23T20:49:23.434405] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-23T20:49:23.434522] [INFO ] [MAIN ] Update Progress: 1726/2372 symbols completed. PRGO took 32.2s. Estimated remaining: 1h 25m 50s. Rate: 7.5 symbols/min [2025-09-23T20:49:23.691624] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:49:23.743238] [DEBUG] [LOCAL ] PRKS: Loaded 42728 existing records from primary storage. [2025-09-23T20:49:23.743409] [INFO ] [MAIN ] PRKS: Loaded 42728 existing records. [2025-09-23T20:49:24.057720] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:49:24.058082] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-23T20:49:24.058156] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-23T20:49:24.059679] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-23T20:49:24.059760] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-23T20:49:24.209440] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-23T20:49:24.243282] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T20:49:24.304320] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T20:49:24.696413] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:49:25.002174] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-23T20:49:25.521023] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T20:49:25.735686] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T20:49:25.802155] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-23T20:49:26.432261] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T20:49:26.602188] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-23T20:49:27.245365] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T20:49:27.402193] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-23T20:49:28.202188] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-23T20:49:28.948161] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T20:49:29.002211] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-23T20:49:29.406028] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T20:49:29.802206] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-23T20:49:30.602179] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-23T20:49:30.697015] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T20:49:30.748283] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T20:49:31.256118] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T20:49:31.402198] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-23T20:49:32.202210] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-23T20:49:32.498905] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T20:49:33.002192] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-23T20:49:33.798913] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T20:49:33.807924] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-23T20:49:33.845455] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T20:49:34.359762] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T20:49:34.360980] [INFO ] [REMOTE ] PRH: Full fetch complete (7717 records). [2025-09-23T20:49:34.361070] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-23T20:49:34.607356] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-23T20:49:34.724606] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-23T20:49:34.724717] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-23T20:49:34.724982] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-23T20:49:34.725024] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-23T20:49:34.725496] [DEBUG] [LOCAL ] PRH: Trimmed 7717 records to 4901 (keeping 200 days of data) [2025-09-23T20:49:34.755878] [DEBUG] [LOCAL ] PRH: Primary data saved (4901 records). [2025-09-23T20:49:34.755962] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-23T20:49:34.756042] [INFO ] [MAIN ] Update Progress: 1727/2372 symbols completed. PRH took 27.9s. Estimated remaining: 1h 25m 43s. Rate: 7.5 symbols/min [2025-09-23T20:49:34.924323] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:49:34.944513] [DEBUG] [LOCAL ] PRLB: Loaded 20804 existing records from primary storage. [2025-09-23T20:49:34.944665] [INFO ] [MAIN ] PRLB: Loaded 20804 existing records. [2025-09-23T20:49:35.120525] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:49:35.120789] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-23T20:49:35.120842] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-23T20:49:35.121586] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-23T20:49:35.121685] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-23T20:49:35.403585] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-23T20:49:35.492005] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:49:35.635538] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T20:49:35.639005] [INFO ] [REMOTE ] PRI: Full fetch complete (25649 records). [2025-09-23T20:49:35.639083] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-23T20:49:36.004095] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-23T20:49:36.004175] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-23T20:49:36.004722] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-23T20:49:36.004785] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-23T20:49:36.005483] [DEBUG] [LOCAL ] PRI: Trimmed 25649 records to 18430 (keeping 200 days of data) [2025-09-23T20:49:36.118570] [DEBUG] [LOCAL ] PRI: Primary data saved (18430 records). [2025-09-23T20:49:36.118734] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-23T20:49:36.118870] [INFO ] [MAIN ] Update Progress: 1728/2372 symbols completed. PRI took 25.8s. Estimated remaining: 1h 25m 33s. Rate: 7.5 symbols/min [2025-09-23T20:49:36.209976] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-23T20:49:36.295410] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:49:36.346457] [DEBUG] [LOCAL ] PRM: Loaded 44595 existing records from primary storage. [2025-09-23T20:49:36.346698] [INFO ] [MAIN ] PRM: Loaded 44595 existing records. [2025-09-23T20:49:36.530146] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:49:36.530422] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-23T20:49:36.530474] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-23T20:49:36.531793] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-23T20:49:36.531857] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-23T20:49:36.892374] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:49:37.002237] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-23T20:49:37.073743] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T20:49:37.315177] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T20:49:37.802249] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-23T20:49:38.606736] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-23T20:49:38.608889] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T20:49:39.282500] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T20:49:39.402148] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-23T20:49:40.201408] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T20:49:40.209384] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-23T20:49:40.677815] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T20:49:40.685728] [INFO ] [REMOTE ] PRIM: Full fetch complete (63324 records). [2025-09-23T20:49:40.685879] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-23T20:49:41.007369] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-23T20:49:41.079846] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-23T20:49:41.079919] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-23T20:49:41.080886] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-23T20:49:41.080952] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-23T20:49:41.082234] [DEBUG] [LOCAL ] PRIM: Trimmed 63324 records to 44524 (keeping 200 days of data) [2025-09-23T20:49:41.348181] [DEBUG] [LOCAL ] PRIM: Primary data saved (44524 records). [2025-09-23T20:49:41.348309] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-23T20:49:41.348391] [INFO ] [MAIN ] Update Progress: 1729/2372 symbols completed. PRIM took 29.6s. Estimated remaining: 1h 25m 24s. Rate: 7.5 symbols/min [2025-09-23T20:49:41.516935] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:49:41.569096] [DEBUG] [LOCAL ] PRMB: Loaded 53164 existing records from primary storage. [2025-09-23T20:49:41.569238] [INFO ] [MAIN ] PRMB: Loaded 53164 existing records. [2025-09-23T20:49:41.751070] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:49:41.751385] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-23T20:49:41.752185] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-23T20:49:41.753767] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-23T20:49:41.753828] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-23T20:49:41.817080] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-23T20:49:42.130306] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:49:42.140813] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T20:49:42.602253] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-23T20:49:42.650216] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T20:49:42.886023] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T20:49:43.402224] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-23T20:49:44.202194] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-23T20:49:44.356155] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T20:49:44.956285] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T20:49:45.002155] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-23T20:49:45.462518] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T20:49:45.802172] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-23T20:49:46.602223] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-23T20:49:46.869216] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T20:49:47.402208] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-23T20:49:47.495947] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T20:49:47.953227] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T20:49:48.202182] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-23T20:49:48.663266] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T20:49:48.929127] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T20:49:49.002150] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-23T20:49:49.802230] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-23T20:49:50.237215] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T20:49:50.602250] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-23T20:49:51.280733] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T20:49:51.402216] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-23T20:49:52.080419] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T20:49:52.202210] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-23T20:49:52.748576] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T20:49:53.002217] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-23T20:49:53.802183] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-23T20:49:53.836709] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T20:49:54.602218] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-23T20:49:54.704451] [DEBUG] [REMOTE ] PRKS: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-23T20:49:54.704803] [WARN ] [REMOTE ] PRKS: No data returned for month 2025-08 [2025-09-23T20:49:54.891854] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T20:49:55.402193] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-23T20:49:55.466806] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T20:49:56.202193] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-23T20:49:56.932435] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T20:49:56.940316] [INFO ] [REMOTE ] PRKS: Full fetch complete (54442 records). [2025-09-23T20:49:56.940454] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-23T20:49:57.007480] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-23T20:49:57.139176] [WARN ] [VALIDATOR ] PRKS: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T20:49:57.139897] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:49:57.139986] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:49:57.140080] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-23T20:49:57.140190] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-09-23T20:49:57.140244] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-09-23T20:49:57.140856] [DEBUG] [LOCAL ] PRKS: Deleted derivative data file. [2025-09-23T20:49:57.140967] [INFO ] [MAIN ] Update Progress: 1730/2372 symbols completed. PRKS took 33.7s. Estimated remaining: 1h 25m 19s. Rate: 7.5 symbols/min [2025-09-23T20:49:57.346113] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:49:57.361236] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T20:49:57.400062] [DEBUG] [LOCAL ] PRO: Loaded 37483 existing records from primary storage. [2025-09-23T20:49:57.400202] [INFO ] [MAIN ] PRO: Loaded 37483 existing records. [2025-09-23T20:49:57.579902] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:49:57.580130] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-23T20:49:57.580185] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-23T20:49:57.581170] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-23T20:49:57.581231] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-23T20:49:57.807365] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-23T20:49:57.942966] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:49:58.568237] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T20:49:58.602144] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-23T20:49:59.402181] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-23T20:49:59.741787] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T20:50:00.202180] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-23T20:50:00.245391] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T20:50:00.324353] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T20:50:01.002208] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-23T20:50:01.802185] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-23T20:50:02.213532] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T20:50:02.602180] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-23T20:50:02.805458] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T20:50:03.137357] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T20:50:03.402235] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-23T20:50:04.202229] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-23T20:50:04.429381] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T20:50:05.002209] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-23T20:50:05.182313] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T20:50:05.190524] [INFO ] [REMOTE ] PRM: Full fetch complete (64244 records). [2025-09-23T20:50:05.190740] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-23T20:50:05.290026] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T20:50:05.604261] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-23T20:50:05.604337] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-23T20:50:05.605252] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-23T20:50:05.605315] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-23T20:50:05.606596] [DEBUG] [LOCAL ] PRM: Trimmed 64244 records to 44606 (keeping 200 days of data) [2025-09-23T20:50:05.806202] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-23T20:50:05.867697] [DEBUG] [LOCAL ] PRM: Primary data saved (44606 records). [2025-09-23T20:50:05.867837] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-23T20:50:05.867933] [INFO ] [MAIN ] Update Progress: 1731/2372 symbols completed. PRM took 29.7s. Estimated remaining: 1h 25m 11s. Rate: 7.5 symbols/min [2025-09-23T20:50:06.058708] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:50:06.061287] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-23T20:50:06.061191] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T20:50:06.061464] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-23T20:50:06.068069] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-23T20:50:06.068538] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-23T20:50:06.068599] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-23T20:50:06.068635] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-23T20:50:06.415102] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:50:06.602144] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-23T20:50:06.981243] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:50:06.981581] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-23T20:50:07.015312] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T20:50:07.402258] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-23T20:50:08.202197] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-23T20:50:09.002202] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-23T20:50:09.283195] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T20:50:09.325277] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T20:50:09.808964] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-23T20:50:09.813284] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T20:50:10.602206] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-23T20:50:10.865976] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T20:50:11.402211] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-23T20:50:12.202225] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-23T20:50:12.281440] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T20:50:12.501444] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T20:50:13.002247] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-23T20:50:13.336083] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T20:50:13.802259] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-23T20:50:14.597106] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T20:50:14.606554] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-23T20:50:14.609219] [INFO ] [REMOTE ] PRMB: Full fetch complete (76063 records). [2025-09-23T20:50:14.609826] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-23T20:50:14.663603] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T20:50:15.067377] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-23T20:50:15.067531] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-23T20:50:15.068943] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-23T20:50:15.069018] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-23T20:50:15.071186] [DEBUG] [LOCAL ] PRMB: Trimmed 76063 records to 53179 (keeping 200 days of data) [2025-09-23T20:50:15.413527] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-23T20:50:15.445124] [DEBUG] [LOCAL ] PRMB: Primary data saved (53179 records). [2025-09-23T20:50:15.445336] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-23T20:50:15.445515] [INFO ] [MAIN ] Update Progress: 1732/2372 symbols completed. PRMB took 34.1s. Estimated remaining: 1h 25m 4s. Rate: 7.5 symbols/min [2025-09-23T20:50:15.639695] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:50:15.649360] [DEBUG] [LOCAL ] PRT: Loaded 5343 existing records from primary storage. [2025-09-23T20:50:15.649575] [INFO ] [MAIN ] PRT: Loaded 5343 existing records. [2025-09-23T20:50:15.861054] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:50:15.861414] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-23T20:50:15.861470] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-23T20:50:15.862051] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-23T20:50:15.862160] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-23T20:50:16.204574] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-23T20:50:16.280736] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:50:16.311892] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T20:50:16.415601] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T20:50:16.955019] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T20:50:16.960150] [INFO ] [REMOTE ] PRLB: Full fetch complete (31042 records). [2025-09-23T20:50:16.960387] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-23T20:50:17.007499] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-23T20:50:17.537929] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-23T20:50:17.538036] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-23T20:50:17.538995] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-23T20:50:17.539139] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-23T20:50:17.540402] [DEBUG] [LOCAL ] PRLB: Trimmed 31042 records to 20739 (keeping 200 days of data) [2025-09-23T20:50:17.677189] [DEBUG] [LOCAL ] PRLB: Primary data saved (20739 records). [2025-09-23T20:50:17.677370] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-23T20:50:17.677477] [INFO ] [MAIN ] Update Progress: 1733/2372 symbols completed. PRLB took 42.9s. Estimated remaining: 1h 24m 54s. Rate: 7.5 symbols/min [2025-09-23T20:50:17.807407] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-23T20:50:17.864891] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:50:17.929802] [DEBUG] [LOCAL ] PRU: Loaded 51519 existing records from primary storage. [2025-09-23T20:50:17.930023] [INFO ] [MAIN ] PRU: Loaded 51519 existing records. [2025-09-23T20:50:18.134461] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:50:18.134960] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-23T20:50:18.135023] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-23T20:50:18.137053] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-23T20:50:18.137123] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-23T20:50:18.508388] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T20:50:18.562325] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:50:18.602257] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-23T20:50:19.047439] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T20:50:19.402223] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-23T20:50:20.197048] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T20:50:20.202137] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-23T20:50:20.446047] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T20:50:21.002252] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-23T20:50:21.056952] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T20:50:21.802226] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-23T20:50:22.602207] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-23T20:50:22.739738] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T20:50:22.973750] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T20:50:23.377529] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T20:50:23.402192] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-23T20:50:24.182948] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T20:50:24.202224] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-23T20:50:25.002190] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-23T20:50:25.668173] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-23T20:50:25.732762] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T20:50:25.802224] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-23T20:50:26.602248] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-23T20:50:27.402182] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-23T20:50:27.626220] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T20:50:27.795489] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T20:50:27.857755] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T20:50:28.202204] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-23T20:50:29.002197] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-23T20:50:29.802283] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-23T20:50:30.212812] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T20:50:30.239416] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T20:50:30.602260] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-23T20:50:31.408058] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-23T20:50:31.413045] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T20:50:31.831818] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T20:50:32.086784] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T20:50:32.202195] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-23T20:50:33.002242] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-23T20:50:33.749942] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T20:50:33.749768] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T20:50:33.802143] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-23T20:50:34.444811] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T20:50:34.602203] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-23T20:50:35.402212] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-23T20:50:36.128294] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T20:50:36.135513] [INFO ] [REMOTE ] PRO: Full fetch complete (51256 records). [2025-09-23T20:50:36.135676] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-23T20:50:36.205290] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-23T20:50:36.557092] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T20:50:36.560608] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-23T20:50:36.561209] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-23T20:50:36.562213] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-23T20:50:36.562329] [INFO ] [REMOTE ] PRSU: Full fetch complete (31872 records). [2025-09-23T20:50:36.562497] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-23T20:50:36.562593] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-23T20:50:36.664747] [DEBUG] [LOCAL ] PRO: Trimmed 51256 records to 37644 (keeping 200 days of data) [2025-09-23T20:50:36.837802] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T20:50:36.840571] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:50:36.841594] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:50:36.842038] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-23T20:50:36.842457] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-23T20:50:36.842809] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-23T20:50:36.843228] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-23T20:50:36.844427] [INFO ] [MAIN ] Update Progress: 1734/2372 symbols completed. PRSU took 31.0s. Estimated remaining: 1h 24m 50s. Rate: 7.5 symbols/min [2025-09-23T20:50:37.008932] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-23T20:50:37.028843] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:50:37.030152] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-23T20:50:37.030626] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-23T20:50:37.030916] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-23T20:50:37.031014] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-23T20:50:37.032854] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-23T20:50:37.033809] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-23T20:50:37.539994] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:50:37.559956] [DEBUG] [LOCAL ] PRO: Primary data saved (37644 records). [2025-09-23T20:50:37.560053] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-23T20:50:37.560142] [INFO ] [MAIN ] Update Progress: 1735/2372 symbols completed. PRO took 40.4s. Estimated remaining: 1h 24m 39s. Rate: 7.5 symbols/min [2025-09-23T20:50:37.757807] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:50:37.762877] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T20:50:37.765101] [INFO ] [REMOTE ] PRT: Full fetch complete (9169 records). [2025-09-23T20:50:37.765174] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-23T20:50:37.807872] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-23T20:50:38.093861] [DEBUG] [LOCAL ] PSA: Loaded 41908 existing records from primary storage. [2025-09-23T20:50:38.109532] [INFO ] [MAIN ] PSA: Loaded 41908 existing records. [2025-09-23T20:50:38.263147] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-23T20:50:38.284881] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-23T20:50:38.290305] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-23T20:50:38.300623] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-23T20:50:38.353400] [DEBUG] [LOCAL ] PRT: Trimmed 9169 records to 5306 (keeping 200 days of data) [2025-09-23T20:50:38.359542] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:50:38.360905] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-23T20:50:38.361178] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-23T20:50:38.360760] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T20:50:38.374544] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-23T20:50:38.374732] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-23T20:50:38.533443] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-23T20:50:38.629522] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-23T20:50:38.646114] [DEBUG] [LOCAL ] PRT: Primary data saved (5306 records). [2025-09-23T20:50:38.693034] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-23T20:50:38.702154] [INFO ] [MAIN ] Update Progress: 1736/2372 symbols completed. PRT took 23.3s. Estimated remaining: 1h 24m 29s. Rate: 7.5 symbols/min [2025-09-23T20:50:38.986773] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:50:39.005235] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:50:39.016928] [DEBUG] [LOCAL ] PSBD: Loaded 6859 existing records from primary storage. [2025-09-23T20:50:39.017054] [INFO ] [MAIN ] PSBD: Loaded 6859 existing records. [2025-09-23T20:50:39.206931] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:50:39.207239] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-23T20:50:39.207295] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-23T20:50:39.207631] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-23T20:50:39.207729] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-23T20:50:39.298103] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T20:50:39.402256] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-23T20:50:39.590722] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:50:39.889564] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T20:50:40.202189] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-23T20:50:40.866297] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T20:50:41.002208] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-23T20:50:41.802212] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-23T20:50:42.207420] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T20:50:42.602190] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-23T20:50:42.690568] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T20:50:42.994828] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-23T20:50:43.402222] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-23T20:50:43.857478] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T20:50:44.202208] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-23T20:50:44.973605] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T20:50:45.002145] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-23T20:50:45.613749] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T20:50:45.802193] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-23T20:50:46.181419] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T20:50:46.602207] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-23T20:50:47.280607] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T20:50:47.402202] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-23T20:50:48.087134] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T20:50:48.202199] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-23T20:50:48.584285] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T20:50:49.002196] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-23T20:50:49.394821] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-23T20:50:49.802236] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-23T20:50:50.543531] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T20:50:50.602226] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-23T20:50:51.402239] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-23T20:50:51.416544] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T20:50:52.202256] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-23T20:50:52.491156] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-23T20:50:52.492099] [INFO ] [REMOTE ] PRVS: Full fetch complete (1243 records). [2025-09-23T20:50:52.492204] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-23T20:50:52.705263] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-23T20:50:52.705479] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:50:52.705550] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:50:52.705634] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-23T20:50:52.705760] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-23T20:50:52.705836] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-23T20:50:52.705896] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-23T20:50:52.705980] [INFO ] [MAIN ] Update Progress: 1737/2372 symbols completed. PRVS took 15.9s. Estimated remaining: 1h 24m 23s. Rate: 7.5 symbols/min [2025-09-23T20:50:52.902429] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:50:52.913364] [DEBUG] [LOCAL ] PSF: Loaded 6776 existing records from primary storage. [2025-09-23T20:50:52.913512] [INFO ] [MAIN ] PSF: Loaded 6776 existing records. [2025-09-23T20:50:53.007380] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-23T20:50:53.128056] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:50:53.128410] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-23T20:50:53.128632] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-23T20:50:53.129133] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-23T20:50:53.129195] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-23T20:50:53.580706] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:50:53.582691] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-23T20:50:53.793910] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T20:50:53.802129] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-23T20:50:54.572544] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T20:50:54.602192] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-23T20:50:55.314425] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T20:50:55.316324] [INFO ] [REMOTE ] PSBD: Full fetch complete (9186 records). [2025-09-23T20:50:55.316397] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-23T20:50:55.407293] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-23T20:50:55.681541] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-23T20:50:55.681617] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-23T20:50:55.681859] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-23T20:50:55.681924] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-23T20:50:55.682416] [DEBUG] [LOCAL ] PSBD: Trimmed 9186 records to 6903 (keeping 200 days of data) [2025-09-23T20:50:55.731919] [DEBUG] [LOCAL ] PSBD: Primary data saved (6903 records). [2025-09-23T20:50:55.732261] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-23T20:50:55.732629] [INFO ] [MAIN ] Update Progress: 1738/2372 symbols completed. PSBD took 17.0s. Estimated remaining: 1h 24m 13s. Rate: 7.5 symbols/min [2025-09-23T20:50:55.906373] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:50:55.957857] [DEBUG] [LOCAL ] PSFE: Loaded 30551 existing records from primary storage. [2025-09-23T20:50:55.958043] [INFO ] [MAIN ] PSFE: Loaded 30551 existing records. [2025-09-23T20:50:56.137806] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:50:56.138072] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-23T20:50:56.138142] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-23T20:50:56.139078] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-23T20:50:56.139149] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-23T20:50:56.204348] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-23T20:50:56.263223] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T20:50:56.578869] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:50:57.002219] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-23T20:50:57.802256] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-23T20:50:57.947424] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T20:50:58.003916] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T20:50:58.472052] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T20:50:58.602206] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-23T20:50:59.402163] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-23T20:50:59.767934] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T20:51:00.202218] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-23T20:51:01.002206] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-23T20:51:01.309107] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-23T20:51:01.548434] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T20:51:01.802271] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-23T20:51:02.602217] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-23T20:51:03.267468] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T20:51:03.402236] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-23T20:51:04.202289] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-23T20:51:04.553287] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (3.55 seconds). [2025-09-23T20:51:05.002301] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-23T20:51:05.674536] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-09-23T20:51:05.802186] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-23T20:51:06.098448] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T20:51:06.320847] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-09-23T20:51:06.602239] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-23T20:51:06.928355] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-23T20:51:07.188418] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T20:51:07.402205] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-23T20:51:07.859385] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T20:51:08.202205] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-23T20:51:08.651611] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T20:51:08.805123] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T20:51:08.835399] [INFO ] [REMOTE ] PRU: Full fetch complete (74288 records). [2025-09-23T20:51:08.835847] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-23T20:51:09.007133] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-23T20:51:09.542191] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-23T20:51:09.542375] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-23T20:51:09.544403] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-23T20:51:09.544489] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-23T20:51:09.546846] [DEBUG] [LOCAL ] PRU: Trimmed 74288 records to 51508 (keeping 200 days of data) [2025-09-23T20:51:09.829679] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-23T20:51:09.867622] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T20:51:09.973545] [DEBUG] [LOCAL ] PRU: Primary data saved (51508 records). [2025-09-23T20:51:09.973737] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-23T20:51:09.973933] [INFO ] [MAIN ] Update Progress: 1739/2372 symbols completed. PRU took 52.3s. Estimated remaining: 1h 24m 8s. Rate: 7.5 symbols/min [2025-09-23T20:51:10.160715] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:51:10.212140] [DEBUG] [LOCAL ] PSN: Loaded 46289 existing records from primary storage. [2025-09-23T20:51:10.212304] [INFO ] [MAIN ] PSN: Loaded 46289 existing records. [2025-09-23T20:51:10.399330] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:51:10.399578] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-23T20:51:10.399639] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-23T20:51:10.400843] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-23T20:51:10.400906] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-23T20:51:10.607590] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-23T20:51:10.771152] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:51:11.351158] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T20:51:11.402148] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-23T20:51:12.202176] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-23T20:51:12.490494] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T20:51:12.778922] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T20:51:12.854558] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T20:51:13.002185] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-23T20:51:13.802202] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-23T20:51:14.602178] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-23T20:51:14.642356] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T20:51:15.402237] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-23T20:51:15.607929] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T20:51:16.202214] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-23T20:51:16.584478] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-23T20:51:16.659532] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T20:51:17.002240] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-23T20:51:17.679496] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T20:51:17.802199] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-23T20:51:18.326329] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T20:51:18.345500] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T20:51:18.602193] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-23T20:51:19.402202] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-23T20:51:20.203056] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T20:51:20.204947] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T20:51:20.217172] [INFO ] [REMOTE ] PSF: Full fetch complete (9613 records). [2025-09-23T20:51:20.202583] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-23T20:51:20.219185] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-23T20:51:20.592821] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-23T20:51:20.592982] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-23T20:51:20.593274] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-23T20:51:20.593316] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-23T20:51:20.593787] [DEBUG] [LOCAL ] PSF: Trimmed 9613 records to 6766 (keeping 200 days of data) [2025-09-23T20:51:20.639350] [DEBUG] [LOCAL ] PSF: Primary data saved (6766 records). [2025-09-23T20:51:20.639487] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-23T20:51:20.639587] [INFO ] [MAIN ] Update Progress: 1740/2372 symbols completed. PSF took 27.9s. Estimated remaining: 1h 24m 1s. Rate: 7.5 symbols/min [2025-09-23T20:51:20.810975] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:51:20.867137] [DEBUG] [LOCAL ] PSO: Loaded 37585 existing records from primary storage. [2025-09-23T20:51:20.867316] [INFO ] [MAIN ] PSO: Loaded 37585 existing records. [2025-09-23T20:51:21.012519] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-23T20:51:21.055081] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:51:21.060625] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-23T20:51:21.061749] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-23T20:51:21.063111] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-23T20:51:21.063172] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-23T20:51:21.439559] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:51:21.452427] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T20:51:21.458121] [INFO ] [REMOTE ] PSFE: Full fetch complete (43223 records). [2025-09-23T20:51:21.458258] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-23T20:51:21.809552] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-23T20:51:21.854729] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-23T20:51:21.854825] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-23T20:51:21.855734] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-23T20:51:21.855800] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-23T20:51:21.858696] [DEBUG] [LOCAL ] PSFE: Trimmed 43223 records to 30507 (keeping 200 days of data) [2025-09-23T20:51:22.050474] [DEBUG] [LOCAL ] PSFE: Primary data saved (30507 records). [2025-09-23T20:51:22.050638] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-23T20:51:22.050810] [INFO ] [MAIN ] Update Progress: 1741/2372 symbols completed. PSFE took 26.3s. Estimated remaining: 1h 23m 50s. Rate: 7.5 symbols/min [2025-09-23T20:51:22.242108] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:51:22.279067] [DEBUG] [LOCAL ] PSQH: Loaded 34454 existing records from primary storage. [2025-09-23T20:51:22.279218] [INFO ] [MAIN ] PSQH: Loaded 34454 existing records. [2025-09-23T20:51:22.471863] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:51:22.472364] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-23T20:51:22.472423] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-23T20:51:22.473318] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-23T20:51:22.473380] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-23T20:51:22.607366] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-23T20:51:22.885775] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:51:22.904848] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T20:51:22.940595] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T20:51:23.402208] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-23T20:51:24.202212] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-23T20:51:24.353405] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T20:51:25.002221] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-23T20:51:25.553296] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-23T20:51:25.600879] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T20:51:25.802192] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-23T20:51:26.602204] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-23T20:51:26.690937] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T20:51:27.189434] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T20:51:27.402203] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-23T20:51:28.202252] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-23T20:51:28.452964] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T20:51:28.881667] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T20:51:29.002237] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-23T20:51:29.427546] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T20:51:29.802217] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-23T20:51:30.522685] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T20:51:30.602244] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-23T20:51:31.402231] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-23T20:51:31.457536] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T20:51:31.466809] [INFO ] [REMOTE ] PSA: Full fetch complete (59068 records). [2025-09-23T20:51:31.467246] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-23T20:51:31.896626] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-23T20:51:31.896748] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-23T20:51:31.897678] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-23T20:51:31.897741] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-23T20:51:31.898976] [DEBUG] [LOCAL ] PSA: Trimmed 59068 records to 41914 (keeping 200 days of data) [2025-09-23T20:51:32.029807] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T20:51:32.205282] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-23T20:51:32.212480] [DEBUG] [LOCAL ] PSA: Primary data saved (41914 records). [2025-09-23T20:51:32.212620] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-23T20:51:32.212771] [INFO ] [MAIN ] Update Progress: 1742/2372 symbols completed. PSA took 54.7s. Estimated remaining: 1h 23m 43s. Rate: 7.5 symbols/min [2025-09-23T20:51:32.390096] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:51:32.462036] [DEBUG] [LOCAL ] PSTG: Loaded 52848 existing records from primary storage. [2025-09-23T20:51:32.462194] [INFO ] [MAIN ] PSTG: Loaded 52848 existing records. [2025-09-23T20:51:32.640755] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:51:32.641013] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-23T20:51:32.641063] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-23T20:51:32.642296] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-23T20:51:32.642360] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-23T20:51:33.004684] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-23T20:51:33.008662] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:51:33.226567] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T20:51:33.738999] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T20:51:33.802258] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-23T20:51:34.402062] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T20:51:34.602199] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-23T20:51:34.947577] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T20:51:35.402234] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-23T20:51:36.135548] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T20:51:36.202189] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-23T20:51:37.002162] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-23T20:51:37.199370] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T20:51:37.556240] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T20:51:37.802217] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-23T20:51:38.121282] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T20:51:38.602233] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-23T20:51:39.402207] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-23T20:51:39.619122] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T20:51:40.182000] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T20:51:40.202147] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-23T20:51:41.002172] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-23T20:51:41.046254] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T20:51:41.714283] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T20:51:41.802182] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-23T20:51:42.586625] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T20:51:42.602141] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-23T20:51:43.064025] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T20:51:43.070162] [INFO ] [REMOTE ] PSO: Full fetch complete (51751 records). [2025-09-23T20:51:43.070260] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-23T20:51:43.407381] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-23T20:51:43.450332] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-23T20:51:43.450407] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-23T20:51:43.451386] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-23T20:51:43.451450] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-23T20:51:43.452611] [DEBUG] [LOCAL ] PSO: Trimmed 51751 records to 37473 (keeping 200 days of data) [2025-09-23T20:51:43.702499] [DEBUG] [LOCAL ] PSO: Primary data saved (37473 records). [2025-09-23T20:51:43.702638] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-23T20:51:43.702779] [INFO ] [MAIN ] Update Progress: 1743/2372 symbols completed. PSO took 23.1s. Estimated remaining: 1h 23m 36s. Rate: 7.5 symbols/min [2025-09-23T20:51:43.877959] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:51:43.899422] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T20:51:43.907572] [INFO ] [REMOTE ] PSN: Full fetch complete (66831 records). [2025-09-23T20:51:43.907764] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-23T20:51:44.071385] [DEBUG] [LOCAL ] PSTL: Loaded 20481 existing records from primary storage. [2025-09-23T20:51:44.095967] [INFO ] [MAIN ] PSTL: Loaded 20481 existing records. [2025-09-23T20:51:44.212900] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-23T20:51:44.472137] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:51:44.508418] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-23T20:51:44.508514] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-23T20:51:44.508631] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-23T20:51:44.508774] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-23T20:51:44.509807] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-23T20:51:44.509856] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-23T20:51:44.509962] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-23T20:51:44.541527] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-23T20:51:44.624062] [DEBUG] [LOCAL ] PSN: Trimmed 66831 records to 46265 (keeping 200 days of data) [2025-09-23T20:51:44.976805] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:51:45.048940] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-23T20:51:45.117141] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T20:51:45.189756] [DEBUG] [LOCAL ] PSN: Primary data saved (46265 records). [2025-09-23T20:51:45.189903] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-23T20:51:45.190018] [INFO ] [MAIN ] Update Progress: 1744/2372 symbols completed. PSN took 35.2s. Estimated remaining: 1h 23m 26s. Rate: 7.5 symbols/min [2025-09-23T20:51:45.360013] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:51:45.415084] [DEBUG] [LOCAL ] PSX: Loaded 53126 existing records from primary storage. [2025-09-23T20:51:45.415255] [INFO ] [MAIN ] PSX: Loaded 53126 existing records. [2025-09-23T20:51:45.589500] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:51:45.589804] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-23T20:51:45.589856] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-23T20:51:45.591117] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-23T20:51:45.591178] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-23T20:51:45.813929] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-23T20:51:45.958185] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:51:46.185879] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-23T20:51:46.280872] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T20:51:46.602215] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-23T20:51:47.308445] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T20:51:47.402205] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-23T20:51:48.202167] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-23T20:51:48.465022] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T20:51:49.004699] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-23T20:51:49.008028] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T20:51:49.367473] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T20:51:49.802208] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-23T20:51:50.450455] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T20:51:50.602169] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-23T20:51:50.939557] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T20:51:51.402202] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-23T20:51:52.136250] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T20:51:52.202181] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-23T20:51:53.002191] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-23T20:51:53.427729] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T20:51:53.455501] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T20:51:53.802208] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-23T20:51:54.602170] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-23T20:51:54.668384] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T20:51:54.675547] [INFO ] [REMOTE ] PSQH: Full fetch complete (53873 records). [2025-09-23T20:51:54.675855] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-23T20:51:55.067478] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-23T20:51:55.067568] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-23T20:51:55.068482] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-23T20:51:55.068545] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-23T20:51:55.069630] [DEBUG] [LOCAL ] PSQH: Trimmed 53873 records to 34606 (keeping 200 days of data) [2025-09-23T20:51:55.269754] [DEBUG] [LOCAL ] PSQH: Primary data saved (34606 records). [2025-09-23T20:51:55.269912] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-23T20:51:55.270004] [INFO ] [MAIN ] Update Progress: 1745/2372 symbols completed. PSQH took 33.2s. Estimated remaining: 1h 23m 19s. Rate: 7.5 symbols/min [2025-09-23T20:51:55.409959] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-23T20:51:55.444153] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:51:55.462095] [DEBUG] [LOCAL ] PTA: Loaded 14962 existing records from primary storage. [2025-09-23T20:51:55.462224] [INFO ] [MAIN ] PTA: Loaded 14962 existing records. [2025-09-23T20:51:55.668059] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:51:55.668561] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-23T20:51:55.668718] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-23T20:51:55.669278] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-23T20:51:55.669343] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-23T20:51:55.939425] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T20:51:56.083320] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-23T20:51:56.176598] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:51:56.202149] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-23T20:51:57.002265] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-23T20:51:57.053797] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T20:51:57.084006] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T20:51:57.802163] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-23T20:51:58.142265] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T20:51:58.602194] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-23T20:51:58.848502] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T20:51:59.402251] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-23T20:52:00.202223] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-23T20:52:00.408754] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T20:52:00.459236] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T20:52:01.002183] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-23T20:52:01.817072] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-23T20:52:01.847984] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T20:52:02.607570] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-23T20:52:02.613476] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T20:52:02.931863] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T20:52:03.402206] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-23T20:52:03.465890] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T20:52:04.202196] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-23T20:52:05.002228] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-23T20:52:05.388267] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T20:52:05.708942] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T20:52:05.802188] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-23T20:52:05.877331] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T20:52:06.502429] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T20:52:06.602160] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-23T20:52:07.402169] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-23T20:52:07.695044] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T20:52:08.202196] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-23T20:52:09.002206] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-23T20:52:09.068857] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T20:52:09.072948] [INFO ] [REMOTE ] PSTL: Full fetch complete (29597 records). [2025-09-23T20:52:09.073035] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-23T20:52:09.463957] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-23T20:52:09.464112] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-23T20:52:09.464975] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-23T20:52:09.465056] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-23T20:52:09.466293] [DEBUG] [LOCAL ] PSTL: Trimmed 29597 records to 20441 (keeping 200 days of data) [2025-09-23T20:52:09.587242] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-23T20:52:09.598156] [INFO ] [REMOTE ] PSTG: Full fetch complete (76545 records). [2025-09-23T20:52:09.599086] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-23T20:52:09.781572] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T20:52:09.811444] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-23T20:52:10.054796] [DEBUG] [LOCAL ] PSTL: Primary data saved (20441 records). [2025-09-23T20:52:10.077259] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-23T20:52:10.077445] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-23T20:52:10.077588] [INFO ] [MAIN ] Update Progress: 1746/2372 symbols completed. PSTL took 26.4s. Estimated remaining: 1h 23m 13s. Rate: 7.5 symbols/min [2025-09-23T20:52:10.109532] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-23T20:52:10.149728] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-23T20:52:10.171734] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-23T20:52:10.229055] [DEBUG] [LOCAL ] PSTG: Trimmed 76545 records to 52848 (keeping 200 days of data) [2025-09-23T20:52:10.255838] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:52:10.382504] [DEBUG] [LOCAL ] PTY: Loaded 37378 existing records from primary storage. [2025-09-23T20:52:10.383191] [INFO ] [MAIN ] PTY: Loaded 37378 existing records. [2025-09-23T20:52:10.579081] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:52:10.580264] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-23T20:52:10.580596] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-23T20:52:10.582048] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-23T20:52:10.582124] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-23T20:52:10.613045] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-23T20:52:11.057267] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:52:11.161882] [DEBUG] [LOCAL ] PSTG: Primary data saved (52848 records). [2025-09-23T20:52:11.162040] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-23T20:52:11.162131] [INFO ] [MAIN ] Update Progress: 1747/2372 symbols completed. PSTG took 38.9s. Estimated remaining: 1h 23m 3s. Rate: 7.5 symbols/min [2025-09-23T20:52:11.336470] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:52:11.379547] [DEBUG] [LOCAL ] PUK: Loaded 44939 existing records from primary storage. [2025-09-23T20:52:11.379729] [INFO ] [MAIN ] PUK: Loaded 44939 existing records. [2025-09-23T20:52:11.410583] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-23T20:52:11.574561] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:52:11.575396] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-23T20:52:11.575791] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-23T20:52:11.577207] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-23T20:52:11.577274] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-23T20:52:11.670334] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T20:52:11.968428] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T20:52:12.007335] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:52:12.202267] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-23T20:52:13.002244] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-23T20:52:13.151441] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T20:52:13.803318] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-23T20:52:13.810762] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T20:52:14.040440] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T20:52:14.602201] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-23T20:52:15.290349] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T20:52:15.402205] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-23T20:52:15.862896] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T20:52:16.202219] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-23T20:52:16.518874] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T20:52:17.002181] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-23T20:52:17.802194] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-23T20:52:17.888337] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T20:52:18.602215] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-23T20:52:18.754082] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T20:52:18.757281] [INFO ] [REMOTE ] PTA: Full fetch complete (23437 records). [2025-09-23T20:52:18.757360] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-23T20:52:19.139727] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-23T20:52:19.139888] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-23T20:52:19.140494] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-23T20:52:19.140580] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-23T20:52:19.141775] [DEBUG] [LOCAL ] PTA: Trimmed 23437 records to 14961 (keeping 200 days of data) [2025-09-23T20:52:19.248552] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-23T20:52:19.289419] [DEBUG] [LOCAL ] PTA: Primary data saved (14961 records). [2025-09-23T20:52:19.289597] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-23T20:52:19.289722] [INFO ] [MAIN ] Update Progress: 1748/2372 symbols completed. PTA took 24.0s. Estimated remaining: 1h 22m 55s. Rate: 7.5 symbols/min [2025-09-23T20:52:19.407327] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-23T20:52:19.459998] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:52:19.505729] [DEBUG] [LOCAL ] PUMP: Loaded 49447 existing records from primary storage. [2025-09-23T20:52:19.505930] [INFO ] [MAIN ] PUMP: Loaded 49447 existing records. [2025-09-23T20:52:19.680573] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:52:19.680867] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-23T20:52:19.680922] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-23T20:52:19.681926] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-23T20:52:19.681988] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-23T20:52:20.046809] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:52:20.184483] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T20:52:20.202140] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-23T20:52:21.002259] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-23T20:52:21.527371] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-23T20:52:21.802242] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-23T20:52:21.954823] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T20:52:22.176192] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T20:52:22.602256] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-23T20:52:23.402182] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-23T20:52:23.497621] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T20:52:24.202181] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-23T20:52:24.489619] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T20:52:25.002190] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-23T20:52:25.229816] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T20:52:25.373264] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T20:52:25.802198] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-23T20:52:26.584044] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T20:52:26.593414] [INFO ] [REMOTE ] PSX: Full fetch complete (77044 records). [2025-09-23T20:52:26.593605] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-23T20:52:26.607413] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-23T20:52:27.009117] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-23T20:52:27.009247] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-23T20:52:27.010823] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-23T20:52:27.010894] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-23T20:52:27.012942] [DEBUG] [LOCAL ] PSX: Trimmed 77044 records to 53130 (keeping 200 days of data) [2025-09-23T20:52:27.362368] [DEBUG] [LOCAL ] PSX: Primary data saved (53130 records). [2025-09-23T20:52:27.362526] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-23T20:52:27.362628] [INFO ] [MAIN ] Update Progress: 1749/2372 symbols completed. PSX took 42.2s. Estimated remaining: 1h 22m 47s. Rate: 7.5 symbols/min [2025-09-23T20:52:27.425919] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-23T20:52:27.540592] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:52:27.577214] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T20:52:27.634998] [DEBUG] [LOCAL ] PVH: Loaded 50466 existing records from primary storage. [2025-09-23T20:52:27.635176] [INFO ] [MAIN ] PVH: Loaded 50466 existing records. [2025-09-23T20:52:27.832923] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:52:27.833222] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-23T20:52:27.833272] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-23T20:52:27.834345] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-23T20:52:27.834405] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-23T20:52:28.203721] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:52:28.203837] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-23T20:52:28.230639] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T20:52:29.002256] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-23T20:52:29.163493] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T20:52:29.807328] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-23T20:52:29.826681] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T20:52:30.602236] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-23T20:52:31.173958] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-23T20:52:31.304732] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T20:52:31.402155] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-23T20:52:32.142901] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T20:52:32.202157] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-23T20:52:33.002194] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-23T20:52:33.163577] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T20:52:33.802203] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-23T20:52:33.975315] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T20:52:34.130037] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T20:52:34.602209] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-23T20:52:35.191346] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T20:52:35.402187] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-23T20:52:36.166207] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T20:52:36.202206] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-23T20:52:37.002174] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-23T20:52:37.028039] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T20:52:37.036057] [INFO ] [REMOTE ] PUK: Full fetch complete (65078 records). [2025-09-23T20:52:37.036294] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-23T20:52:37.424213] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-23T20:52:37.424295] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-23T20:52:37.425272] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-23T20:52:37.425335] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-23T20:52:37.426708] [DEBUG] [LOCAL ] PUK: Trimmed 65078 records to 44922 (keeping 200 days of data) [2025-09-23T20:52:37.701954] [DEBUG] [LOCAL ] PUK: Primary data saved (44922 records). [2025-09-23T20:52:37.702089] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-23T20:52:37.702172] [INFO ] [MAIN ] Update Progress: 1750/2372 symbols completed. PUK took 26.5s. Estimated remaining: 1h 22m 40s. Rate: 7.5 symbols/min [2025-09-23T20:52:37.804419] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-23T20:52:37.884128] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:52:37.916370] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T20:52:37.916611] [DEBUG] [LOCAL ] PVL: Loaded 4716 existing records from primary storage. [2025-09-23T20:52:37.916882] [INFO ] [MAIN ] PVL: Loaded 4716 existing records. [2025-09-23T20:52:38.101436] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:52:38.101736] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-23T20:52:38.101790] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-23T20:52:38.102059] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-23T20:52:38.102118] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-23T20:52:38.457785] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:52:38.602148] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-23T20:52:38.676913] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T20:52:38.951849] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T20:52:39.209749] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T20:52:39.402241] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-23T20:52:40.202215] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-23T20:52:41.002205] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-23T20:52:41.116129] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T20:52:41.701617] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T20:52:41.802209] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-23T20:52:42.061879] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T20:52:42.602206] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-23T20:52:43.218784] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T20:52:43.402210] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-23T20:52:44.185319] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T20:52:44.202136] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-23T20:52:44.879936] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T20:52:45.002183] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-23T20:52:45.802164] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-23T20:52:46.061479] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T20:52:46.602185] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-23T20:52:46.794034] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T20:52:46.878090] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T20:52:46.885213] [INFO ] [REMOTE ] PTY: Full fetch complete (53807 records). [2025-09-23T20:52:46.885412] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-23T20:52:47.215497] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T20:52:47.297362] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-23T20:52:47.297454] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-23T20:52:47.298418] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-23T20:52:47.298505] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-23T20:52:47.299839] [DEBUG] [LOCAL ] PTY: Trimmed 53807 records to 37388 (keeping 200 days of data) [2025-09-23T20:52:47.402976] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-23T20:52:47.541638] [DEBUG] [LOCAL ] PTY: Primary data saved (37388 records). [2025-09-23T20:52:47.541930] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-23T20:52:47.542053] [INFO ] [MAIN ] Update Progress: 1751/2372 symbols completed. PTY took 37.5s. Estimated remaining: 1h 22m 33s. Rate: 7.5 symbols/min [2025-09-23T20:52:47.717439] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:52:47.766514] [DEBUG] [LOCAL ] PWR: Loaded 47457 existing records from primary storage. [2025-09-23T20:52:47.766703] [INFO ] [MAIN ] PWR: Loaded 47457 existing records. [2025-09-23T20:52:47.945799] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:52:47.946092] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-23T20:52:47.946165] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-23T20:52:47.947296] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-23T20:52:47.947359] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-23T20:52:48.068273] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T20:52:48.212097] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-23T20:52:48.384533] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:52:48.933673] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T20:52:49.002188] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-23T20:52:49.608923] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T20:52:49.802211] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-23T20:52:50.602270] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-23T20:52:51.412705] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-23T20:52:51.418195] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T20:52:51.427123] [INFO ] [REMOTE ] PUMP: Full fetch complete (71656 records). [2025-09-23T20:52:51.427255] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-23T20:52:51.826728] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-23T20:52:51.826831] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-23T20:52:51.827864] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-23T20:52:51.827987] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-23T20:52:51.829437] [DEBUG] [LOCAL ] PUMP: Trimmed 71656 records to 49448 (keeping 200 days of data) [2025-09-23T20:52:52.109855] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T20:52:52.124317] [DEBUG] [LOCAL ] PUMP: Primary data saved (49448 records). [2025-09-23T20:52:52.124447] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-23T20:52:52.124548] [INFO ] [MAIN ] Update Progress: 1752/2372 symbols completed. PUMP took 32.8s. Estimated remaining: 1h 22m 23s. Rate: 7.5 symbols/min [2025-09-23T20:52:52.207423] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-23T20:52:52.303226] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:52:52.340957] [DEBUG] [LOCAL ] PX: Loaded 34678 existing records from primary storage. [2025-09-23T20:52:52.341122] [INFO ] [MAIN ] PX: Loaded 34678 existing records. [2025-09-23T20:52:52.535143] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:52:52.535698] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-23T20:52:52.536003] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-23T20:52:52.537041] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-23T20:52:52.537124] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-23T20:52:52.906889] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-23T20:52:52.961554] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:52:52.984932] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T20:52:53.002164] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-23T20:52:53.802270] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-23T20:52:54.453195] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T20:52:54.542377] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T20:52:54.602229] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-23T20:52:55.402205] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-23T20:52:56.202233] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-23T20:52:56.309578] [DEBUG] [REMOTE ] PX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-23T20:52:56.309984] [WARN ] [REMOTE ] PX: No data returned for month 2025-01 [2025-09-23T20:52:56.586414] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T20:52:57.002233] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-23T20:52:57.171877] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T20:52:57.617096] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T20:52:57.802231] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-23T20:52:58.602191] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-23T20:52:59.212265] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T20:52:59.402206] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-23T20:53:00.202247] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-23T20:53:00.551240] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T20:53:01.002224] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-23T20:53:01.505249] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T20:53:01.672551] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T20:53:01.674108] [INFO ] [REMOTE ] PVL: Full fetch complete (7577 records). [2025-09-23T20:53:01.674178] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-23T20:53:01.807273] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-23T20:53:02.080410] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-23T20:53:02.081223] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-23T20:53:02.082038] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T20:53:02.082307] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-23T20:53:02.089744] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-23T20:53:02.090670] [DEBUG] [LOCAL ] PVL: Trimmed 7577 records to 4739 (keeping 200 days of data) [2025-09-23T20:53:02.119607] [DEBUG] [LOCAL ] PVL: Primary data saved (4739 records). [2025-09-23T20:53:02.119786] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-23T20:53:02.119885] [INFO ] [MAIN ] Update Progress: 1753/2372 symbols completed. PVL took 24.4s. Estimated remaining: 1h 22m 16s. Rate: 7.5 symbols/min [2025-09-23T20:53:02.293254] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:53:02.350883] [DEBUG] [LOCAL ] QBTS: Loaded 53746 existing records from primary storage. [2025-09-23T20:53:02.351046] [INFO ] [MAIN ] QBTS: Loaded 53746 existing records. [2025-09-23T20:53:02.530037] [WARN ] [MAIN ] QBTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:53:02.530355] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-23T20:53:02.530413] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-23T20:53:02.532670] [DEBUG] [LOCAL ] QBTS: Deleted primary data file. [2025-09-23T20:53:02.532738] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-23T20:53:02.609319] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-23T20:53:02.895708] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:53:03.402169] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-23T20:53:03.672424] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T20:53:04.202155] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-23T20:53:04.377005] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T20:53:04.385508] [INFO ] [REMOTE ] PVH: Full fetch complete (70767 records). [2025-09-23T20:53:04.385722] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-23T20:53:04.835178] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T20:53:04.867020] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-23T20:53:04.867343] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-23T20:53:04.868383] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-23T20:53:04.868608] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-23T20:53:04.873013] [DEBUG] [LOCAL ] PVH: Trimmed 70767 records to 50472 (keeping 200 days of data) [2025-09-23T20:53:05.004060] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-23T20:53:05.195891] [DEBUG] [LOCAL ] PVH: Primary data saved (50472 records). [2025-09-23T20:53:05.196031] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-23T20:53:05.196121] [INFO ] [MAIN ] Update Progress: 1754/2372 symbols completed. PVH took 37.8s. Estimated remaining: 1h 22m 6s. Rate: 7.5 symbols/min [2025-09-23T20:53:05.376247] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:53:05.408330] [DEBUG] [LOCAL ] QD: Loaded 28012 existing records from primary storage. [2025-09-23T20:53:05.408490] [INFO ] [MAIN ] QD: Loaded 28012 existing records. [2025-09-23T20:53:05.587621] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:53:05.587900] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-23T20:53:05.587982] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-23T20:53:05.588635] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-23T20:53:05.588741] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-23T20:53:05.811441] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-23T20:53:05.956412] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:53:06.117905] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-23T20:53:06.602229] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-23T20:53:06.920438] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T20:53:07.402172] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-23T20:53:07.466690] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-23T20:53:07.983560] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T20:53:08.202248] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-23T20:53:08.994570] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T20:53:09.002845] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-23T20:53:09.802198] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-23T20:53:10.129191] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T20:53:10.602255] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-23T20:53:11.340300] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T20:53:11.402469] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-23T20:53:11.742933] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-23T20:53:12.202211] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-23T20:53:12.516358] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T20:53:12.554219] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-23T20:53:13.002226] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-23T20:53:13.802226] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-23T20:53:13.986838] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T20:53:14.602173] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-23T20:53:14.738671] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-23T20:53:15.402200] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-23T20:53:15.566636] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T20:53:15.768298] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T20:53:15.773877] [INFO ] [REMOTE ] PX: Full fetch complete (46025 records). [2025-09-23T20:53:15.774025] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-23T20:53:15.968417] [WARN ] [VALIDATOR ] PX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T20:53:15.968973] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:53:15.969057] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:53:15.969107] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-23T20:53:15.969191] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-09-23T20:53:15.969249] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-09-23T20:53:15.969787] [DEBUG] [LOCAL ] PX: Deleted derivative data file. [2025-09-23T20:53:15.969949] [INFO ] [MAIN ] Update Progress: 1755/2372 symbols completed. PX took 23.8s. Estimated remaining: 1h 21m 59s. Rate: 7.5 symbols/min [2025-09-23T20:53:16.142894] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:53:16.200768] [DEBUG] [LOCAL ] QGEN: Loaded 49200 existing records from primary storage. [2025-09-23T20:53:16.200954] [INFO ] [MAIN ] QGEN: Loaded 49200 existing records. [2025-09-23T20:53:16.212225] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-23T20:53:16.385237] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:53:16.385540] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-23T20:53:16.385593] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-23T20:53:16.387233] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-23T20:53:16.387296] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-23T20:53:16.758321] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:53:17.002226] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-23T20:53:17.682558] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T20:53:17.802224] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-23T20:53:18.198970] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-09-23T20:53:18.602187] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-23T20:53:18.841332] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T20:53:19.218237] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T20:53:19.402202] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-23T20:53:20.202194] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-23T20:53:21.002200] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-23T20:53:21.178782] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T20:53:21.395681] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-23T20:53:21.802155] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-23T20:53:21.837604] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T20:53:22.317878] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T20:53:22.602215] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-23T20:53:23.402197] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-23T20:53:24.202189] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-23T20:53:24.263628] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T20:53:24.272445] [INFO ] [REMOTE ] PWR: Full fetch complete (68992 records). [2025-09-23T20:53:24.272745] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-23T20:53:24.733629] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-23T20:53:24.733778] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-23T20:53:24.735254] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-23T20:53:24.735453] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-23T20:53:24.773085] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-23T20:53:24.771254] [DEBUG] [LOCAL ] PWR: Trimmed 68992 records to 47387 (keeping 200 days of data) [2025-09-23T20:53:25.023230] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-23T20:53:25.153375] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T20:53:25.156080] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T20:53:25.179729] [DEBUG] [LOCAL ] PWR: Primary data saved (47387 records). [2025-09-23T20:53:25.180204] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-23T20:53:25.180385] [INFO ] [MAIN ] Update Progress: 1756/2372 symbols completed. PWR took 37.6s. Estimated remaining: 1h 21m 52s. Rate: 7.5 symbols/min [2025-09-23T20:53:25.347829] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:53:25.406679] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-23T20:53:25.406862] [INFO ] [MAIN ] QS: Loaded 53742 existing records. [2025-09-23T20:53:25.589805] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:53:25.590125] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-23T20:53:25.590189] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-23T20:53:25.591376] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-23T20:53:25.591457] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-23T20:53:25.807408] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-23T20:53:26.010752] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:53:26.602241] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-23T20:53:27.402184] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-23T20:53:27.626476] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T20:53:27.742500] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-23T20:53:28.135239] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T20:53:28.202170] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-23T20:53:29.002216] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-23T20:53:29.134469] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-23T20:53:29.489844] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T20:53:29.802221] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-23T20:53:30.589626] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T20:53:30.602139] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-23T20:53:31.402223] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-23T20:53:32.202200] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-23T20:53:32.445209] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T20:53:32.650502] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-23T20:53:33.002175] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-23T20:53:33.608806] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T20:53:33.805028] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-23T20:53:33.811354] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-23T20:53:34.602232] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-23T20:53:34.947822] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T20:53:34.953617] [INFO ] [REMOTE ] QD: Full fetch complete (40759 records). [2025-09-23T20:53:34.953797] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-23T20:53:35.363584] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-23T20:53:35.363897] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-23T20:53:35.364771] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-23T20:53:35.364889] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-23T20:53:35.366278] [DEBUG] [LOCAL ] QD: Trimmed 40759 records to 28013 (keeping 200 days of data) [2025-09-23T20:53:35.422442] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-23T20:53:35.498339] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-23T20:53:35.586916] [DEBUG] [LOCAL ] QD: Primary data saved (28013 records). [2025-09-23T20:53:35.587068] [INFO ] [MAIN ] QD: Full history saved. [2025-09-23T20:53:35.587158] [INFO ] [MAIN ] Update Progress: 1757/2372 symbols completed. QD took 30.4s. Estimated remaining: 1h 21m 45s. Rate: 7.5 symbols/min [2025-09-23T20:53:36.202274] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-23T20:53:36.852701] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-23T20:53:37.004606] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-23T20:53:37.009114] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T20:53:37.019006] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-09-23T20:53:37.019211] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-23T20:53:37.021046] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:53:37.021214] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:53:37.021275] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:53:37.021341] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-23T20:53:37.021415] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-23T20:53:37.021468] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-23T20:53:37.022110] [DEBUG] [LOCAL ] QBTS: Deleted derivative data file. [2025-09-23T20:53:37.022266] [INFO ] [MAIN ] Update Progress: 1758/2372 symbols completed. QBTS took 34.9s. Estimated remaining: 1h 21m 34s. Rate: 7.5 symbols/min [2025-09-23T20:53:37.479090] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-23T20:53:37.802305] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-23T20:53:39.223549] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-23T20:53:39.236001] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-23T20:53:39.314920] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T20:53:39.402184] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-23T20:53:41.177087] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T20:53:41.189981] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-23T20:53:41.515721] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-23T20:53:41.527451] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-23T20:53:42.988218] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T20:53:42.999417] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-23T20:53:43.769843] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-23T20:53:43.781379] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-23T20:53:44.614747] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T20:53:44.624052] [INFO ] [REMOTE ] QGEN: Full fetch complete (69958 records). [2025-09-23T20:53:44.624253] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-23T20:53:45.057519] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-23T20:53:45.057863] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-23T20:53:45.059139] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-23T20:53:45.059205] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-23T20:53:45.060705] [DEBUG] [LOCAL ] QGEN: Trimmed 69958 records to 49152 (keeping 200 days of data) [2025-09-23T20:53:45.370679] [DEBUG] [LOCAL ] QGEN: Primary data saved (49152 records). [2025-09-23T20:53:45.370835] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-23T20:53:45.370976] [INFO ] [MAIN ] Update Progress: 1759/2372 symbols completed. QGEN took 29.4s. Estimated remaining: 1h 21m 27s. Rate: 7.5 symbols/min [2025-09-23T20:53:46.057995] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-23T20:53:46.070266] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-23T20:53:48.842329] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-23T20:53:48.854534] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-23T20:53:51.423738] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-23T20:53:51.435625] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-23T20:53:53.976315] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-23T20:53:53.986523] [INFO ] [REMOTE ] QS: Full fetch complete (77883 records). [2025-09-23T20:53:53.986791] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-23T20:53:54.401876] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-23T20:53:54.401978] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-23T20:53:54.403157] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-23T20:53:54.403229] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-23T20:53:54.404878] [DEBUG] [LOCAL ] QS: Trimmed 77883 records to 53742 (keeping 200 days of data) [2025-09-23T20:53:54.724348] [DEBUG] [LOCAL ] QS: Primary data saved (53742 records). [2025-09-23T20:53:54.724503] [INFO ] [MAIN ] QS: Full history saved. [2025-09-23T20:53:54.724626] [INFO ] [MAIN ] Update Progress: 1760/2372 symbols completed. QS took 29.5s. Estimated remaining: 1h 21m 19s. Rate: 7.5 symbols/min [2025-09-23T20:53:55.299077] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:53:55.454551] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:53:55.470967] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:53:55.474904] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:53:55.493444] [DEBUG] [LOCAL ] QVCC: Loaded 9000 existing records from primary storage. [2025-09-23T20:53:55.493752] [INFO ] [MAIN ] QVCC: Loaded 9000 existing records. [2025-09-23T20:53:55.611196] [DEBUG] [LOCAL ] QUAD: Loaded 23909 existing records from primary storage. [2025-09-23T20:53:55.636728] [INFO ] [MAIN ] QUAD: Loaded 23909 existing records. [2025-09-23T20:53:55.800172] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:53:55.860259] [DEBUG] [LOCAL ] QTWO: Loaded 39065 existing records from primary storage. [2025-09-23T20:53:55.860510] [INFO ] [MAIN ] QTWO: Loaded 39065 existing records. [2025-09-23T20:53:55.858930] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-23T20:53:55.866519] [DEBUG] [LOCAL ] QSR: Loaded 52408 existing records from primary storage. [2025-09-23T20:53:55.965616] [INFO ] [MAIN ] QSR: Loaded 52408 existing records. [2025-09-23T20:53:55.965526] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-23T20:53:56.063404] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-23T20:53:56.112532] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-23T20:53:56.248006] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:53:56.340950] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-23T20:53:56.437900] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-23T20:53:56.480694] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-23T20:53:56.442915] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:53:56.513001] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-23T20:53:56.516755] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:53:56.517403] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-23T20:53:56.516609] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-23T20:53:56.538735] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-23T20:53:56.605586] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-23T20:53:56.593144] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-23T20:53:56.656839] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-23T20:53:56.700396] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-23T20:53:56.700237] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-23T20:53:57.221249] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:53:57.335302] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-23T20:53:57.883788] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:53:57.940308] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:53:57.980727] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-23T20:53:57.959870] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-23T20:53:57.988792] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:53:57.990494] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-23T20:53:58.525192] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T20:53:58.527925] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-23T20:53:59.173878] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T20:53:59.176032] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-23T20:53:59.278819] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T20:53:59.285877] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-23T20:53:59.387973] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T20:53:59.397521] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-23T20:53:59.450882] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T20:53:59.462185] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-23T20:53:59.551754] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T20:53:59.553314] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-23T20:54:00.381054] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T20:54:00.386282] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-23T20:54:00.451332] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T20:54:00.454509] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-23T20:54:00.619518] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T20:54:00.628245] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-23T20:54:00.854973] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T20:54:00.866287] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-23T20:54:00.952215] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T20:54:00.954933] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-23T20:54:01.229412] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T20:54:01.236494] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-23T20:54:01.647745] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T20:54:01.651041] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-23T20:54:02.578317] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T20:54:02.587897] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-23T20:54:02.642502] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T20:54:02.656877] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T20:54:02.657483] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-23T20:54:02.660957] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-23T20:54:03.166064] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-23T20:54:03.176759] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-23T20:54:04.209915] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T20:54:04.212549] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-23T20:54:04.654015] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T20:54:04.661175] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-23T20:54:05.246539] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T20:54:05.250439] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-23T20:54:05.255281] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T20:54:05.267627] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-23T20:54:05.509772] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-09-23T20:54:05.802293] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-23T20:54:06.017053] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T20:54:06.026482] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T20:54:06.038583] [INFO ] [REMOTE ] QVCC: Full fetch complete (11946 records). [2025-09-23T20:54:06.038837] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-23T20:54:06.607522] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-23T20:54:06.621145] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-23T20:54:06.621294] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-23T20:54:06.622008] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-23T20:54:06.622079] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-23T20:54:06.623357] [DEBUG] [LOCAL ] QVCC: Trimmed 11946 records to 8951 (keeping 200 days of data) [2025-09-23T20:54:06.699595] [DEBUG] [LOCAL ] QVCC: Primary data saved (8951 records). [2025-09-23T20:54:06.699860] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-23T20:54:06.699992] [INFO ] [MAIN ] Update Progress: 1761/2372 symbols completed. QVCC took 12.0s. Estimated remaining: 1h 21m 13s. Rate: 7.5 symbols/min [2025-09-23T20:54:06.930443] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:54:06.939215] [DEBUG] [LOCAL ] QVCD: Loaded 4556 existing records from primary storage. [2025-09-23T20:54:06.939629] [INFO ] [MAIN ] QVCD: Loaded 4556 existing records. [2025-09-23T20:54:07.106196] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T20:54:07.220993] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:54:07.221689] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-23T20:54:07.221818] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-23T20:54:07.222427] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-23T20:54:07.222506] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-23T20:54:07.402568] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-23T20:54:07.545441] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T20:54:07.713366] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:54:07.714965] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T20:54:08.202208] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-23T20:54:09.002179] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-23T20:54:09.544874] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-23T20:54:09.594040] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T20:54:09.787378] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T20:54:09.802154] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-23T20:54:10.602209] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-23T20:54:11.121217] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T20:54:11.263333] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-23T20:54:11.402199] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-23T20:54:12.202191] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-23T20:54:12.835690] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T20:54:13.002259] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-23T20:54:13.272236] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T20:54:13.802250] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-23T20:54:14.602306] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-23T20:54:15.326891] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-23T20:54:15.402176] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-23T20:54:15.848370] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T20:54:16.202256] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-23T20:54:16.300376] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-23T20:54:16.708088] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T20:54:16.819567] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T20:54:16.830997] [INFO ] [REMOTE ] QTWO: Full fetch complete (57223 records). [2025-09-23T20:54:16.831113] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-23T20:54:17.007298] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-23T20:54:17.216235] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-23T20:54:17.216320] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-23T20:54:17.217234] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-23T20:54:17.217299] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-23T20:54:17.218489] [DEBUG] [LOCAL ] QTWO: Trimmed 57223 records to 39083 (keeping 200 days of data) [2025-09-23T20:54:17.455607] [DEBUG] [LOCAL ] QTWO: Primary data saved (39083 records). [2025-09-23T20:54:17.455805] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-23T20:54:17.455925] [INFO ] [MAIN ] Update Progress: 1762/2372 symbols completed. QTWO took 22.7s. Estimated remaining: 1h 21m 6s. Rate: 7.5 symbols/min [2025-09-23T20:54:17.625462] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:54:17.679279] [DEBUG] [LOCAL ] QXO: Loaded 53160 existing records from primary storage. [2025-09-23T20:54:17.679445] [INFO ] [MAIN ] QXO: Loaded 53160 existing records. [2025-09-23T20:54:17.807325] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-23T20:54:17.859740] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:54:17.859938] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-23T20:54:17.859984] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-23T20:54:17.861610] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-23T20:54:17.861695] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-23T20:54:18.225730] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:54:18.269879] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T20:54:18.281280] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T20:54:18.602204] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-23T20:54:19.402187] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-23T20:54:20.202239] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-23T20:54:20.355111] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T20:54:20.969094] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T20:54:20.973252] [INFO ] [REMOTE ] QUAD: Full fetch complete (35019 records). [2025-09-23T20:54:20.973354] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-23T20:54:21.007537] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-23T20:54:21.451509] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-23T20:54:21.455690] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-23T20:54:21.457982] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-23T20:54:21.460025] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-23T20:54:21.459912] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T20:54:21.474181] [DEBUG] [LOCAL ] QUAD: Trimmed 35019 records to 23844 (keeping 200 days of data) [2025-09-23T20:54:21.628888] [DEBUG] [LOCAL ] QUAD: Primary data saved (23844 records). [2025-09-23T20:54:21.629108] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-23T20:54:21.629235] [INFO ] [MAIN ] Update Progress: 1763/2372 symbols completed. QUAD took 26.9s. Estimated remaining: 1h 20m 56s. Rate: 7.5 symbols/min [2025-09-23T20:54:21.808366] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-23T20:54:21.813829] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:54:21.851769] [DEBUG] [LOCAL ] R: Loaded 29636 existing records from primary storage. [2025-09-23T20:54:21.851986] [INFO ] [MAIN ] R: Loaded 29636 existing records. [2025-09-23T20:54:22.069087] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:54:22.069420] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-23T20:54:22.069471] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-23T20:54:22.070566] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-23T20:54:22.070631] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-23T20:54:22.448767] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:54:22.602237] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-23T20:54:22.737763] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T20:54:23.273330] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T20:54:23.402214] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-23T20:54:23.538503] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T20:54:24.202221] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-23T20:54:24.831559] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T20:54:25.002229] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-23T20:54:25.042349] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T20:54:25.802236] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-23T20:54:26.453310] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T20:54:26.602285] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-23T20:54:26.788157] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T20:54:26.797559] [INFO ] [REMOTE ] QSR: Full fetch complete (75803 records). [2025-09-23T20:54:26.797733] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-23T20:54:27.201237] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-23T20:54:27.201355] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-23T20:54:27.202789] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-23T20:54:27.202938] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-23T20:54:27.205230] [DEBUG] [LOCAL ] QSR: Trimmed 75803 records to 52407 (keeping 200 days of data) [2025-09-23T20:54:27.318299] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T20:54:27.408759] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-23T20:54:27.547987] [DEBUG] [LOCAL ] QSR: Primary data saved (52407 records). [2025-09-23T20:54:27.548137] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-23T20:54:27.548226] [INFO ] [MAIN ] Update Progress: 1764/2372 symbols completed. QSR took 32.8s. Estimated remaining: 1h 20m 48s. Rate: 7.5 symbols/min [2025-09-23T20:54:27.719261] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:54:27.741528] [DEBUG] [LOCAL ] RA: Loaded 21611 existing records from primary storage. [2025-09-23T20:54:27.741687] [INFO ] [MAIN ] RA: Loaded 21611 existing records. [2025-09-23T20:54:27.923916] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:54:27.924221] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-23T20:54:27.924275] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-23T20:54:27.925123] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-23T20:54:27.925183] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-23T20:54:28.030128] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T20:54:28.042602] [INFO ] [REMOTE ] QVCD: Full fetch complete (6131 records). [2025-09-23T20:54:28.053014] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-23T20:54:28.207365] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-23T20:54:28.627944] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:54:28.692771] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-23T20:54:28.692851] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-23T20:54:28.693037] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-23T20:54:28.693074] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-23T20:54:28.693454] [DEBUG] [LOCAL ] QVCD: Trimmed 6131 records to 4486 (keeping 200 days of data) [2025-09-23T20:54:28.720232] [DEBUG] [LOCAL ] QVCD: Primary data saved (4486 records). [2025-09-23T20:54:28.720316] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-23T20:54:28.720394] [INFO ] [MAIN ] Update Progress: 1765/2372 symbols completed. QVCD took 22.0s. Estimated remaining: 1h 20m 37s. Rate: 7.5 symbols/min [2025-09-23T20:54:28.891863] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:54:28.924766] [DEBUG] [LOCAL ] RACE: Loaded 32934 existing records from primary storage. [2025-09-23T20:54:28.924928] [INFO ] [MAIN ] RACE: Loaded 32934 existing records. [2025-09-23T20:54:29.007466] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-23T20:54:29.112463] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:54:29.112799] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-23T20:54:29.112861] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-23T20:54:29.114085] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-23T20:54:29.114147] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-23T20:54:29.483345] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:54:29.563377] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T20:54:29.802206] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-23T20:54:30.417006] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T20:54:30.602251] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-23T20:54:31.009072] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T20:54:31.402245] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-23T20:54:32.202203] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-23T20:54:32.245513] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T20:54:32.280174] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T20:54:33.002256] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-23T20:54:33.642196] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T20:54:33.802227] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-23T20:54:34.153939] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T20:54:34.602216] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-23T20:54:35.402225] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-23T20:54:35.702604] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T20:54:36.202216] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-23T20:54:36.269829] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T20:54:36.343478] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T20:54:37.002239] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-23T20:54:37.802265] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-23T20:54:38.121458] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T20:54:38.602202] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-23T20:54:38.837926] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T20:54:39.328477] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T20:54:39.402206] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-23T20:54:39.778062] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T20:54:40.202207] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-23T20:54:41.002199] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-23T20:54:41.167013] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T20:54:41.219169] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T20:54:41.802213] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-23T20:54:42.612849] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-23T20:54:42.621260] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T20:54:43.393860] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T20:54:43.402140] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-23T20:54:44.202199] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-23T20:54:44.281102] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T20:54:44.951924] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T20:54:45.002222] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-23T20:54:45.615747] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T20:54:45.802251] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-23T20:54:46.602239] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-23T20:54:46.961283] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T20:54:47.103482] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T20:54:47.402218] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-23T20:54:47.913309] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T20:54:48.202231] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-23T20:54:49.002205] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-23T20:54:49.238977] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T20:54:49.358434] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T20:54:49.747590] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T20:54:49.802223] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-23T20:54:50.602226] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-23T20:54:51.402219] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-23T20:54:51.677986] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T20:54:51.687265] [INFO ] [REMOTE ] QXO: Full fetch complete (75457 records). [2025-09-23T20:54:51.687405] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-23T20:54:51.848512] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T20:54:52.127028] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-23T20:54:52.127116] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-23T20:54:52.128184] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-23T20:54:52.128273] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-23T20:54:52.129806] [DEBUG] [LOCAL ] QXO: Trimmed 75457 records to 53175 (keeping 200 days of data) [2025-09-23T20:54:52.213616] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-23T20:54:52.467342] [DEBUG] [LOCAL ] QXO: Primary data saved (53175 records). [2025-09-23T20:54:52.467495] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-23T20:54:52.467584] [INFO ] [MAIN ] Update Progress: 1766/2372 symbols completed. QXO took 35.0s. Estimated remaining: 1h 20m 35s. Rate: 7.5 symbols/min [2025-09-23T20:54:52.651143] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:54:52.691133] [DEBUG] [LOCAL ] RAMP: Loaded 37700 existing records from primary storage. [2025-09-23T20:54:52.691359] [INFO ] [MAIN ] RAMP: Loaded 37700 existing records. [2025-09-23T20:54:52.891950] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:54:52.910991] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-23T20:54:52.911760] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-23T20:54:52.912861] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T20:54:52.919527] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-23T20:54:52.920234] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-23T20:54:53.008807] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-23T20:54:53.288710] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:54:53.471887] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T20:54:53.802216] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-23T20:54:54.359997] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T20:54:54.602219] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-23T20:54:55.010253] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T20:54:55.402242] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-23T20:54:55.786357] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T20:54:55.792143] [INFO ] [REMOTE ] RACE: Full fetch complete (47659 records). [2025-09-23T20:54:55.792284] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-23T20:54:56.206611] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-23T20:54:56.223929] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-23T20:54:56.224049] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-23T20:54:56.225041] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-23T20:54:56.225108] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-23T20:54:56.226738] [DEBUG] [LOCAL ] RACE: Trimmed 47659 records to 32926 (keeping 200 days of data) [2025-09-23T20:54:56.434426] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T20:54:56.459827] [DEBUG] [LOCAL ] RACE: Primary data saved (32926 records). [2025-09-23T20:54:56.459947] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-23T20:54:56.460028] [INFO ] [MAIN ] Update Progress: 1767/2372 symbols completed. RACE took 27.7s. Estimated remaining: 1h 20m 25s. Rate: 7.5 symbols/min [2025-09-23T20:54:56.654260] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:54:56.699060] [DEBUG] [LOCAL ] RBA: Loaded 46015 existing records from primary storage. [2025-09-23T20:54:56.699264] [INFO ] [MAIN ] RBA: Loaded 46015 existing records. [2025-09-23T20:54:56.886533] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:54:56.886927] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-23T20:54:56.886983] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-23T20:54:56.889462] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-23T20:54:56.889526] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-23T20:54:57.007294] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-23T20:54:57.253966] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:54:57.450921] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T20:54:57.455846] [INFO ] [REMOTE ] R: Full fetch complete (41883 records). [2025-09-23T20:54:57.456018] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-23T20:54:57.808532] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-23T20:54:57.859170] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-23T20:54:57.859251] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-23T20:54:57.860047] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-23T20:54:57.860109] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-23T20:54:57.861081] [DEBUG] [LOCAL ] R: Trimmed 41883 records to 29518 (keeping 200 days of data) [2025-09-23T20:54:58.044977] [DEBUG] [LOCAL ] R: Primary data saved (29518 records). [2025-09-23T20:54:58.045114] [INFO ] [MAIN ] R: Full history saved. [2025-09-23T20:54:58.045201] [INFO ] [MAIN ] Update Progress: 1768/2372 symbols completed. R took 36.4s. Estimated remaining: 1h 20m 15s. Rate: 7.5 symbols/min [2025-09-23T20:54:58.231964] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:54:58.250095] [DEBUG] [LOCAL ] RBC: Loaded 15130 existing records from primary storage. [2025-09-23T20:54:58.250239] [INFO ] [MAIN ] RBC: Loaded 15130 existing records. [2025-09-23T20:54:58.494058] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:54:58.494543] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-23T20:54:58.494617] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-23T20:54:58.495384] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-23T20:54:58.495561] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-23T20:54:58.639115] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-23T20:54:58.672104] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T20:54:59.056145] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T20:54:59.145565] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:54:59.402224] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-23T20:55:00.202199] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-23T20:55:00.261488] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T20:55:00.460799] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T20:55:00.464442] [INFO ] [REMOTE ] RA: Full fetch complete (31797 records). [2025-09-23T20:55:00.464519] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-23T20:55:00.848221] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-23T20:55:00.848319] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-23T20:55:00.849227] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-23T20:55:00.849293] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-23T20:55:00.850349] [DEBUG] [LOCAL ] RA: Trimmed 31797 records to 21578 (keeping 200 days of data) [2025-09-23T20:55:00.988373] [DEBUG] [LOCAL ] RA: Primary data saved (21578 records). [2025-09-23T20:55:00.988510] [INFO ] [MAIN ] RA: Full history saved. [2025-09-23T20:55:00.988607] [INFO ] [MAIN ] Update Progress: 1769/2372 symbols completed. RA took 33.4s. Estimated remaining: 1h 20m 6s. Rate: 7.5 symbols/min [2025-09-23T20:55:01.009955] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-23T20:55:01.174473] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:55:01.231083] [DEBUG] [LOCAL ] RBLX: Loaded 53721 existing records from primary storage. [2025-09-23T20:55:01.231242] [INFO ] [MAIN ] RBLX: Loaded 53721 existing records. [2025-09-23T20:55:01.416190] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:55:01.416624] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-23T20:55:01.416718] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-23T20:55:01.419678] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-23T20:55:01.419747] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-23T20:55:01.617937] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T20:55:01.804513] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-23T20:55:01.830841] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:55:02.485078] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T20:55:02.602204] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-23T20:55:02.969745] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T20:55:03.402205] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-23T20:55:03.946893] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T20:55:04.202219] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-23T20:55:05.002198] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-23T20:55:05.752460] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-23T20:55:05.792057] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T20:55:05.802135] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-23T20:55:05.994702] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T20:55:06.602192] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-23T20:55:07.402201] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-23T20:55:07.443301] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T20:55:08.202208] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-23T20:55:08.821013] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-23T20:55:09.002178] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-23T20:55:09.181051] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T20:55:09.707558] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T20:55:09.802203] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-23T20:55:10.602203] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-23T20:55:11.245507] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T20:55:11.359123] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-23T20:55:11.402147] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-23T20:55:12.099449] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T20:55:12.202163] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-23T20:55:13.002209] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-23T20:55:13.577536] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-23T20:55:13.802327] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-23T20:55:13.945271] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T20:55:14.001057] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T20:55:14.602203] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-23T20:55:15.402308] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-23T20:55:16.076552] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-23T20:55:16.119556] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T20:55:16.202223] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-23T20:55:16.647673] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T20:55:17.002229] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-23T20:55:17.802225] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-23T20:55:18.049093] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T20:55:18.602225] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-23T20:55:18.659631] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-23T20:55:18.974385] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T20:55:18.980894] [INFO ] [REMOTE ] RAMP: Full fetch complete (53144 records). [2025-09-23T20:55:18.981005] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-23T20:55:19.391803] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-23T20:55:19.391919] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-23T20:55:19.392811] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-23T20:55:19.392874] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-23T20:55:19.394083] [DEBUG] [LOCAL ] RAMP: Trimmed 53144 records to 37720 (keeping 200 days of data) [2025-09-23T20:55:19.402200] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-23T20:55:19.624547] [DEBUG] [LOCAL ] RAMP: Primary data saved (37720 records). [2025-09-23T20:55:19.624738] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-23T20:55:19.624837] [INFO ] [MAIN ] Update Progress: 1770/2372 symbols completed. RAMP took 27.2s. Estimated remaining: 1h 20m 1s. Rate: 7.5 symbols/min [2025-09-23T20:55:19.798965] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:55:19.806474] [DEBUG] [LOCAL ] RBOT: Loaded 5044 existing records from primary storage. [2025-09-23T20:55:19.806589] [INFO ] [MAIN ] RBOT: Loaded 5044 existing records. [2025-09-23T20:55:20.006474] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:55:20.007291] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-23T20:55:20.007514] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-23T20:55:20.007980] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-23T20:55:20.008053] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-23T20:55:20.208560] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-23T20:55:20.346360] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T20:55:20.432098] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:55:21.002204] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-23T20:55:21.468713] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T20:55:21.577724] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T20:55:21.614150] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-23T20:55:21.802436] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-23T20:55:22.602257] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-23T20:55:22.639460] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T20:55:23.402201] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-23T20:55:24.202178] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-23T20:55:24.338522] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T20:55:24.536529] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T20:55:24.679943] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T20:55:25.002231] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-23T20:55:25.682034] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T20:55:25.802187] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-23T20:55:26.602287] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-23T20:55:26.878762] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T20:55:27.402197] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-23T20:55:28.202248] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-23T20:55:28.358988] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T20:55:28.404986] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T20:55:29.002265] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-23T20:55:29.802223] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-23T20:55:30.476040] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T20:55:30.485791] [INFO ] [REMOTE ] RBA: Full fetch complete (65344 records). [2025-09-23T20:55:30.485927] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-23T20:55:30.582426] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T20:55:30.609521] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-23T20:55:30.952155] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-23T20:55:30.987237] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-23T20:55:30.987543] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-23T20:55:30.988922] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-23T20:55:30.989068] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-23T20:55:30.991248] [DEBUG] [LOCAL ] RBA: Trimmed 65344 records to 45974 (keeping 200 days of data) [2025-09-23T20:55:31.306219] [DEBUG] [LOCAL ] RBA: Primary data saved (45974 records). [2025-09-23T20:55:31.306393] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-23T20:55:31.306558] [INFO ] [MAIN ] Update Progress: 1771/2372 symbols completed. RBA took 34.8s. Estimated remaining: 1h 19m 54s. Rate: 7.5 symbols/min [2025-09-23T20:55:31.409455] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-23T20:55:31.504094] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:55:31.560072] [DEBUG] [LOCAL ] RBRK: Loaded 53104 existing records from primary storage. [2025-09-23T20:55:31.560236] [INFO ] [MAIN ] RBRK: Loaded 53104 existing records. [2025-09-23T20:55:31.785818] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:55:31.787774] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T20:55:31.791744] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-23T20:55:31.791843] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-23T20:55:31.793874] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-23T20:55:31.793979] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-23T20:55:32.161895] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:55:32.202204] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-23T20:55:33.002236] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-23T20:55:33.608025] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T20:55:33.802172] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-23T20:55:34.124676] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-23T20:55:34.251987] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T20:55:34.323241] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T20:55:34.602285] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-23T20:55:35.402245] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-23T20:55:35.412778] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T20:55:36.202239] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-23T20:55:37.002233] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-23T20:55:37.802235] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-23T20:55:37.840495] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T20:55:37.861188] [INFO ] [REMOTE ] RBC: Full fetch complete (21925 records). [2025-09-23T20:55:37.876638] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-23T20:55:37.885283] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-23T20:55:37.998827] [INFO ] [REMOTE ] RBLX: Full fetch complete (77782 records). [2025-09-23T20:55:38.003142] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-23T20:55:38.642746] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-23T20:55:38.647287] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-23T20:55:38.648698] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-23T20:55:38.649860] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-23T20:55:38.649509] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T20:55:38.701805] [DEBUG] [LOCAL ] RBC: Trimmed 21925 records to 15141 (keeping 200 days of data) [2025-09-23T20:55:38.702220] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-23T20:55:38.751379] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-23T20:55:38.804321] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-23T20:55:38.804731] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-23T20:55:38.805583] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-23T20:55:38.805666] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-23T20:55:38.807367] [DEBUG] [LOCAL ] RBLX: Trimmed 77782 records to 53719 (keeping 200 days of data) [2025-09-23T20:55:39.236298] [DEBUG] [LOCAL ] RBLX: Primary data saved (53719 records). [2025-09-23T20:55:39.237239] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-23T20:55:39.237823] [INFO ] [MAIN ] Update Progress: 1772/2372 symbols completed. RBLX took 38.2s. Estimated remaining: 1h 19m 46s. Rate: 7.5 symbols/min [2025-09-23T20:55:39.424417] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:55:39.420604] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-23T20:55:39.429597] [DEBUG] [LOCAL ] RBC: Primary data saved (15141 records). [2025-09-23T20:55:39.429757] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-23T20:55:39.429912] [INFO ] [MAIN ] Update Progress: 1773/2372 symbols completed. RBC took 41.4s. Estimated remaining: 1h 19m 36s. Rate: 7.5 symbols/min [2025-09-23T20:55:39.535956] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T20:55:39.552284] [INFO ] [REMOTE ] RBOT: Full fetch complete (8686 records). [2025-09-23T20:55:39.610636] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-23T20:55:39.613847] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:55:39.614125] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-23T20:55:39.614346] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-23T20:55:39.614544] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-23T20:55:39.614599] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-23T20:55:39.638123] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-23T20:55:39.658161] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-23T20:55:39.874725] [DEBUG] [LOCAL ] RC: Loaded 49018 existing records from primary storage. [2025-09-23T20:55:39.880228] [INFO ] [MAIN ] RC: Loaded 49018 existing records. [2025-09-23T20:55:40.536243] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:55:40.609211] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-23T20:55:40.626976] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-23T20:55:40.626880] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:55:40.666327] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-23T20:55:40.676789] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-23T20:55:40.676969] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-23T20:55:40.717351] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-23T20:55:40.798269] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-23T20:55:40.818777] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-23T20:55:40.822571] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-23T20:55:40.844493] [DEBUG] [LOCAL ] RBOT: Trimmed 8686 records to 5060 (keeping 200 days of data) [2025-09-23T20:55:41.038711] [DEBUG] [LOCAL ] RBOT: Primary data saved (5060 records). [2025-09-23T20:55:41.056789] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-23T20:55:41.057815] [INFO ] [MAIN ] Update Progress: 1774/2372 symbols completed. RBOT took 21.4s. Estimated remaining: 1h 19m 26s. Rate: 7.5 symbols/min [2025-09-23T20:55:41.223242] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:55:41.226297] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-23T20:55:41.233025] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-23T20:55:41.345611] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:55:41.346093] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-23T20:55:41.346175] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-23T20:55:41.346467] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-23T20:55:41.346538] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-23T20:55:41.346611] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-23T20:55:41.346798] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-23T20:55:41.503192] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-23T20:55:41.806051] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T20:55:41.805461] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-23T20:55:41.842377] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:55:42.602248] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-23T20:55:43.258843] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T20:55:43.402182] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-23T20:55:43.894690] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-23T20:55:44.202232] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-23T20:55:45.002182] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-23T20:55:45.182411] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T20:55:45.678633] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T20:55:45.802241] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-23T20:55:46.008610] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T20:55:46.592258] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T20:55:46.602219] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-23T20:55:47.402214] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-23T20:55:48.202180] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-23T20:55:48.616680] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T20:55:49.002177] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-23T20:55:49.124307] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T20:55:49.189868] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T20:55:49.802200] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-23T20:55:50.602207] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-23T20:55:51.077125] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-23T20:55:51.371727] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T20:55:51.407309] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-23T20:55:51.422496] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T20:55:52.038372] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T20:55:52.202230] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-23T20:55:52.654743] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T20:55:53.002278] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-23T20:55:53.802200] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-23T20:55:54.602213] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-23T20:55:54.786477] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T20:55:54.921328] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-23T20:55:55.402234] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-23T20:55:55.789270] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T20:55:55.965194] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T20:55:56.202185] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-23T20:55:57.002236] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-23T20:55:57.029197] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T20:55:57.802197] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-23T20:55:58.265157] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T20:55:58.602179] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-23T20:55:58.989328] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-23T20:55:59.003046] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T20:55:59.003918] [INFO ] [REMOTE ] RCB: Full fetch complete (3761 records). [2025-09-23T20:55:59.004255] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-23T20:55:59.186053] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T20:55:59.186306] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:55:59.186376] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:55:59.186447] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-23T20:55:59.186525] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-23T20:55:59.186580] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-23T20:55:59.186658] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-23T20:55:59.186756] [INFO ] [MAIN ] Update Progress: 1775/2372 symbols completed. RCB took 19.8s. Estimated remaining: 1h 19m 21s. Rate: 7.5 symbols/min [2025-09-23T20:55:59.354162] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:55:59.402171] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-23T20:55:59.419552] [DEBUG] [LOCAL ] RCI: Loaded 48837 existing records from primary storage. [2025-09-23T20:55:59.419725] [INFO ] [MAIN ] RCI: Loaded 48837 existing records. [2025-09-23T20:55:59.597677] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:55:59.598035] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-23T20:55:59.598112] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-23T20:55:59.600119] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-23T20:55:59.600182] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-23T20:55:59.953087] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:56:00.202188] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-23T20:56:01.002214] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-23T20:56:01.630048] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T20:56:01.666023] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-23T20:56:01.676496] [INFO ] [REMOTE ] RBRK: Full fetch complete (76519 records). [2025-09-23T20:56:01.676873] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-23T20:56:01.808566] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-23T20:56:02.117735] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T20:56:02.198932] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-23T20:56:02.199062] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-23T20:56:02.200551] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-23T20:56:02.200635] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-23T20:56:02.203331] [DEBUG] [LOCAL ] RBRK: Trimmed 76519 records to 53115 (keeping 200 days of data) [2025-09-23T20:56:02.444043] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T20:56:02.579983] [DEBUG] [LOCAL ] RBRK: Primary data saved (53115 records). [2025-09-23T20:56:02.580159] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-23T20:56:02.580310] [INFO ] [MAIN ] Update Progress: 1776/2372 symbols completed. RBRK took 31.3s. Estimated remaining: 1h 19m 12s. Rate: 7.5 symbols/min [2025-09-23T20:56:02.607334] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-23T20:56:02.756275] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:56:02.756550] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-23T20:56:02.756604] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-23T20:56:02.756776] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-23T20:56:02.756820] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-23T20:56:02.756860] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-23T20:56:02.756892] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-23T20:56:03.141864] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:56:03.402213] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-23T20:56:04.035516] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T20:56:04.105408] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T20:56:04.202157] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-23T20:56:05.002197] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-23T20:56:05.743295] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T20:56:05.800730] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T20:56:05.809780] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-23T20:56:06.602209] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-23T20:56:07.402194] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-23T20:56:07.574108] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T20:56:08.202196] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-23T20:56:08.476474] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T20:56:08.649498] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T20:56:09.002250] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-23T20:56:09.389238] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-23T20:56:09.662363] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T20:56:09.663829] [INFO ] [REMOTE ] RCD: Full fetch complete (6825 records). [2025-09-23T20:56:09.663900] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-23T20:56:09.807386] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-23T20:56:09.847023] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-23T20:56:09.847232] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:56:09.847298] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:56:09.847346] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-23T20:56:09.847400] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-23T20:56:09.847434] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-23T20:56:09.847472] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-23T20:56:09.847544] [INFO ] [MAIN ] Update Progress: 1777/2372 symbols completed. RCD took 28.8s. Estimated remaining: 1h 19m 3s. Rate: 7.5 symbols/min [2025-09-23T20:56:10.020975] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:56:10.045194] [DEBUG] [LOCAL ] RCS: Loaded 11483 existing records from primary storage. [2025-09-23T20:56:10.045332] [INFO ] [MAIN ] RCS: Loaded 11483 existing records. [2025-09-23T20:56:10.235078] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:56:10.235344] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-23T20:56:10.235427] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-23T20:56:10.235984] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-23T20:56:10.236053] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-23T20:56:10.603050] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-23T20:56:10.602969] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:56:11.402171] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-23T20:56:11.900005] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-23T20:56:12.202184] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-23T20:56:12.699299] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T20:56:12.799946] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-23T20:56:13.002229] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-23T20:56:13.790883] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T20:56:13.802085] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-23T20:56:14.111808] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T20:56:14.602258] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-23T20:56:15.290628] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T20:56:15.402169] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-23T20:56:16.016769] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-23T20:56:16.202164] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-23T20:56:16.290811] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T20:56:17.002264] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-23T20:56:17.802245] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-23T20:56:18.400126] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T20:56:18.443571] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T20:56:18.463980] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T20:56:18.602232] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-23T20:56:19.402196] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-23T20:56:20.202323] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-23T20:56:20.671082] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T20:56:21.002241] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-23T20:56:21.282695] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T20:56:21.802250] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-23T20:56:21.858904] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T20:56:21.897777] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T20:56:22.602210] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-23T20:56:23.396241] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T20:56:23.402143] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-23T20:56:23.528888] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T20:56:24.202264] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-23T20:56:24.264117] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T20:56:25.002214] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-23T20:56:25.802227] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-23T20:56:25.846194] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T20:56:25.951989] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T20:56:26.602288] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-23T20:56:27.402209] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-23T20:56:27.445835] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T20:56:27.448487] [INFO ] [REMOTE ] RCS: Full fetch complete (19219 records). [2025-09-23T20:56:27.448578] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-23T20:56:27.860575] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-23T20:56:27.860729] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-23T20:56:27.861375] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-23T20:56:27.861479] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-23T20:56:27.862584] [DEBUG] [LOCAL ] RCS: Trimmed 19219 records to 11498 (keeping 200 days of data) [2025-09-23T20:56:27.945463] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-23T20:56:27.976462] [DEBUG] [LOCAL ] RCS: Primary data saved (11498 records). [2025-09-23T20:56:27.976581] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-23T20:56:27.976702] [INFO ] [MAIN ] Update Progress: 1778/2372 symbols completed. RCS took 18.1s. Estimated remaining: 1h 18m 59s. Rate: 7.5 symbols/min [2025-09-23T20:56:28.149806] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:56:28.197721] [DEBUG] [LOCAL ] RCUS: Loaded 42754 existing records from primary storage. [2025-09-23T20:56:28.197909] [INFO ] [MAIN ] RCUS: Loaded 42754 existing records. [2025-09-23T20:56:28.209463] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-23T20:56:28.391889] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:56:28.392134] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-23T20:56:28.392183] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-23T20:56:28.393431] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-23T20:56:28.393523] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-23T20:56:28.746730] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:56:29.002200] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-23T20:56:29.084796] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T20:56:29.802178] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-23T20:56:29.978590] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T20:56:29.987232] [INFO ] [REMOTE ] RC: Full fetch complete (70808 records). [2025-09-23T20:56:29.987357] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-23T20:56:30.388937] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-23T20:56:30.389158] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-23T20:56:30.390239] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-23T20:56:30.390307] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-23T20:56:30.391866] [DEBUG] [LOCAL ] RC: Trimmed 70808 records to 48995 (keeping 200 days of data) [2025-09-23T20:56:30.602377] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-23T20:56:30.641297] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T20:56:30.726021] [DEBUG] [LOCAL ] RC: Primary data saved (48995 records). [2025-09-23T20:56:30.726195] [INFO ] [MAIN ] RC: Full history saved. [2025-09-23T20:56:30.726297] [INFO ] [MAIN ] Update Progress: 1779/2372 symbols completed. RC took 51.5s. Estimated remaining: 1h 18m 49s. Rate: 7.5 symbols/min [2025-09-23T20:56:30.908209] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:56:30.967488] [DEBUG] [LOCAL ] RDDT: Loaded 53783 existing records from primary storage. [2025-09-23T20:56:30.967719] [INFO ] [MAIN ] RDDT: Loaded 53783 existing records. [2025-09-23T20:56:31.148116] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:56:31.148377] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-23T20:56:31.148426] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-23T20:56:31.149596] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-23T20:56:31.149682] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-23T20:56:31.403765] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-23T20:56:31.512817] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:56:31.773737] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T20:56:32.202248] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-23T20:56:32.826872] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T20:56:32.917948] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T20:56:33.002226] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-23T20:56:33.554422] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T20:56:33.802195] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-23T20:56:34.567481] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T20:56:34.602213] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-23T20:56:35.106236] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T20:56:35.114569] [INFO ] [REMOTE ] RCI: Full fetch complete (70541 records). [2025-09-23T20:56:35.114798] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-23T20:56:35.408483] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-23T20:56:35.507783] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-23T20:56:35.507878] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-23T20:56:35.508908] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-23T20:56:35.508973] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-23T20:56:35.510416] [DEBUG] [LOCAL ] RCI: Trimmed 70541 records to 48781 (keeping 200 days of data) [2025-09-23T20:56:35.852152] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T20:56:35.870153] [DEBUG] [LOCAL ] RCI: Primary data saved (48781 records). [2025-09-23T20:56:35.870321] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-23T20:56:35.870412] [INFO ] [MAIN ] Update Progress: 1780/2372 symbols completed. RCI took 36.7s. Estimated remaining: 1h 18m 40s. Rate: 7.5 symbols/min [2025-09-23T20:56:36.045155] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:56:36.088043] [DEBUG] [LOCAL ] RDN: Loaded 45213 existing records from primary storage. [2025-09-23T20:56:36.088196] [INFO ] [MAIN ] RDN: Loaded 45213 existing records. [2025-09-23T20:56:36.207358] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-23T20:56:36.268310] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:56:36.268542] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-23T20:56:36.268588] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-23T20:56:36.269709] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-23T20:56:36.269769] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-23T20:56:36.626614] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:56:37.002256] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-23T20:56:37.802272] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-23T20:56:37.841456] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-23T20:56:37.955400] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T20:56:38.602166] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-23T20:56:39.070979] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-23T20:56:39.350022] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T20:56:39.402153] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-23T20:56:40.202207] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-23T20:56:40.859377] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-23T20:56:40.926842] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T20:56:40.935258] [INFO ] [REMOTE ] RCL: Full fetch complete (75092 records). [2025-09-23T20:56:40.935449] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-23T20:56:40.936498] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T20:56:40.936603] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:56:40.936679] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:56:40.936737] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-23T20:56:40.936799] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-23T20:56:40.936834] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-23T20:56:40.936920] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-09-23T20:56:40.936999] [INFO ] [MAIN ] Update Progress: 1781/2372 symbols completed. RCL took 38.4s. Estimated remaining: 1h 18m 31s. Rate: 7.5 symbols/min [2025-09-23T20:56:41.003518] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-23T20:56:41.141138] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:56:41.169170] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T20:56:41.227068] [DEBUG] [LOCAL ] RDW: Loaded 52001 existing records from primary storage. [2025-09-23T20:56:41.227240] [INFO ] [MAIN ] RDW: Loaded 52001 existing records. [2025-09-23T20:56:41.416102] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:56:41.416375] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-23T20:56:41.416424] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-23T20:56:41.417539] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-23T20:56:41.417601] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-23T20:56:41.779548] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:56:41.802152] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-23T20:56:42.602161] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-23T20:56:42.700004] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T20:56:43.402197] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-23T20:56:43.728599] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T20:56:44.202217] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-23T20:56:45.002218] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-23T20:56:45.050072] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T20:56:45.161724] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-23T20:56:45.802206] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-23T20:56:46.244579] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T20:56:46.602242] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-23T20:56:46.706429] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T20:56:47.402191] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-23T20:56:48.202185] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-23T20:56:48.228906] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T20:56:48.418307] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-23T20:56:49.002191] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-23T20:56:49.100796] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T20:56:49.802212] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-23T20:56:50.225382] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-23T20:56:50.264839] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T20:56:50.602214] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-23T20:56:51.402230] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-23T20:56:51.592736] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T20:56:52.202215] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-23T20:56:53.002197] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-23T20:56:53.189844] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-23T20:56:53.281340] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T20:56:53.718788] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T20:56:53.726014] [INFO ] [REMOTE ] RCUS: Full fetch complete (60359 records). [2025-09-23T20:56:53.726170] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-23T20:56:53.807682] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-23T20:56:54.126587] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-23T20:56:54.126715] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-23T20:56:54.127689] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-23T20:56:54.127755] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-23T20:56:54.129128] [DEBUG] [LOCAL ] RCUS: Trimmed 60359 records to 42758 (keeping 200 days of data) [2025-09-23T20:56:54.376412] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T20:56:54.416056] [DEBUG] [LOCAL ] RCUS: Primary data saved (42758 records). [2025-09-23T20:56:54.416202] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-23T20:56:54.416294] [INFO ] [MAIN ] Update Progress: 1782/2372 symbols completed. RCUS took 26.4s. Estimated remaining: 1h 18m 25s. Rate: 7.5 symbols/min [2025-09-23T20:56:54.590717] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:56:54.602200] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-23T20:56:54.640480] [DEBUG] [LOCAL ] RDY: Loaded 46850 existing records from primary storage. [2025-09-23T20:56:54.640638] [INFO ] [MAIN ] RDY: Loaded 46850 existing records. [2025-09-23T20:56:54.838206] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:56:54.838473] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-23T20:56:54.838524] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-23T20:56:54.839932] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-23T20:56:54.839996] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-23T20:56:55.200844] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:56:55.410340] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-23T20:56:55.437531] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T20:56:56.202218] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-23T20:56:57.002169] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-23T20:56:57.040164] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T20:56:57.266080] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-23T20:56:57.802160] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-23T20:56:57.877357] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T20:56:58.383195] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T20:56:58.602204] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-23T20:56:59.402194] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-23T20:56:59.794548] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T20:57:00.202203] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-23T20:57:01.002190] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-23T20:57:01.143195] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-23T20:57:01.700677] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-23T20:57:01.802191] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-23T20:57:02.176448] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T20:57:02.602194] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-23T20:57:03.402176] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-23T20:57:03.795587] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-09-23T20:57:04.202214] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-23T20:57:05.411144] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-23T20:57:05.422428] [INFO ] [REMOTE ] RDN: Full fetch complete (65758 records). [2025-09-23T20:57:05.422680] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-23T20:57:06.117784] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (4.32 seconds). [2025-09-23T20:57:06.117996] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-23T20:57:06.126711] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-23T20:57:06.132583] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-23T20:57:06.134023] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-23T20:57:06.145703] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-23T20:57:06.170854] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-23T20:57:06.185067] [DEBUG] [LOCAL ] RDN: Trimmed 65758 records to 45255 (keeping 200 days of data) [2025-09-23T20:57:06.187919] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-23T20:57:06.363625] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-23T20:57:06.570318] [DEBUG] [LOCAL ] RDN: Primary data saved (45255 records). [2025-09-23T20:57:06.570460] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-23T20:57:06.570554] [INFO ] [MAIN ] Update Progress: 1783/2372 symbols completed. RDN took 30.7s. Estimated remaining: 1h 18m 19s. Rate: 7.5 symbols/min [2025-09-23T20:57:06.602611] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-23T20:57:06.777285] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:57:06.823370] [DEBUG] [LOCAL ] RELX: Loaded 47843 existing records from primary storage. [2025-09-23T20:57:06.823532] [INFO ] [MAIN ] RELX: Loaded 47843 existing records. [2025-09-23T20:57:07.001018] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:57:07.001363] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-23T20:57:07.001428] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-23T20:57:07.002726] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-23T20:57:07.002792] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-23T20:57:07.353496] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:57:07.402166] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-23T20:57:07.628900] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T20:57:08.202182] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-23T20:57:08.712968] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-23T20:57:09.002211] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-23T20:57:09.064447] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T20:57:09.110533] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-23T20:57:09.802168] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-23T20:57:09.977983] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T20:57:10.602211] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-23T20:57:10.966340] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T20:57:10.975266] [INFO ] [REMOTE ] RDW: Full fetch complete (74331 records). [2025-09-23T20:57:10.975433] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-23T20:57:11.364233] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-23T20:57:11.364321] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-23T20:57:11.365741] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-23T20:57:11.365834] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-23T20:57:11.367833] [DEBUG] [LOCAL ] RDW: Trimmed 74331 records to 52003 (keeping 200 days of data) [2025-09-23T20:57:11.416410] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-23T20:57:11.679390] [DEBUG] [LOCAL ] RDW: Primary data saved (52003 records). [2025-09-23T20:57:11.679546] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-23T20:57:11.679635] [INFO ] [MAIN ] Update Progress: 1784/2372 symbols completed. RDW took 30.7s. Estimated remaining: 1h 18m 10s. Rate: 7.5 symbols/min [2025-09-23T20:57:11.855304] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:57:11.892907] [DEBUG] [LOCAL ] RERE: Loaded 41004 existing records from primary storage. [2025-09-23T20:57:11.893104] [INFO ] [MAIN ] RERE: Loaded 41004 existing records. [2025-09-23T20:57:12.071103] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:57:12.071336] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-23T20:57:12.071383] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-23T20:57:12.072335] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-23T20:57:12.072395] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-23T20:57:12.465789] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:57:12.469904] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-23T20:57:12.473102] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T20:57:12.511798] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-23T20:57:12.521175] [INFO ] [REMOTE ] RDDT: Full fetch complete (77890 records). [2025-09-23T20:57:12.521352] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-23T20:57:12.939487] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-23T20:57:12.939591] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-23T20:57:12.940768] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-23T20:57:12.940838] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-23T20:57:12.942485] [DEBUG] [LOCAL ] RDDT: Trimmed 77890 records to 53784 (keeping 200 days of data) [2025-09-23T20:57:13.006486] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-23T20:57:13.209504] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T20:57:13.316233] [DEBUG] [LOCAL ] RDDT: Primary data saved (53784 records). [2025-09-23T20:57:13.316383] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-23T20:57:13.316473] [INFO ] [MAIN ] Update Progress: 1785/2372 symbols completed. RDDT took 42.6s. Estimated remaining: 1h 17m 60s. Rate: 7.5 symbols/min [2025-09-23T20:57:13.485336] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:57:13.528933] [DEBUG] [LOCAL ] RES: Loaded 47534 existing records from primary storage. [2025-09-23T20:57:13.529083] [INFO ] [MAIN ] RES: Loaded 47534 existing records. [2025-09-23T20:57:13.714683] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:57:13.715217] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-23T20:57:13.715293] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-23T20:57:13.737737] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-23T20:57:13.747578] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-23T20:57:13.786801] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T20:57:13.810849] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-23T20:57:14.146418] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:57:14.544365] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T20:57:14.602230] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-23T20:57:15.402199] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-23T20:57:16.202281] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-23T20:57:16.448480] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-23T20:57:16.816012] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-23T20:57:16.866038] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T20:57:17.002247] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-23T20:57:17.802177] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-23T20:57:17.971147] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T20:57:18.602170] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-23T20:57:18.686040] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T20:57:19.122105] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T20:57:19.402241] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-23T20:57:20.202201] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-23T20:57:20.338591] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T20:57:20.879986] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T20:57:21.002217] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-23T20:57:21.802183] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-23T20:57:21.919406] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T20:57:22.079033] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T20:57:22.602200] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-23T20:57:23.384234] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T20:57:23.402159] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-23T20:57:24.004348] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T20:57:24.202234] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-23T20:57:24.946139] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T20:57:24.953485] [INFO ] [REMOTE ] RDY: Full fetch complete (69056 records). [2025-09-23T20:57:24.953720] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-23T20:57:25.007351] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-23T20:57:25.378064] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-23T20:57:25.378187] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-23T20:57:25.379408] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-23T20:57:25.379480] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-23T20:57:25.380954] [DEBUG] [LOCAL ] RDY: Trimmed 69056 records to 46799 (keeping 200 days of data) [2025-09-23T20:57:25.675086] [DEBUG] [LOCAL ] RDY: Primary data saved (46799 records). [2025-09-23T20:57:25.675225] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-23T20:57:25.675309] [INFO ] [MAIN ] Update Progress: 1786/2372 symbols completed. RDY took 31.3s. Estimated remaining: 1h 17m 53s. Rate: 7.5 symbols/min [2025-09-23T20:57:25.811865] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-23T20:57:25.878588] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:57:25.881757] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T20:57:25.931372] [DEBUG] [LOCAL ] REVG: Loaded 41123 existing records from primary storage. [2025-09-23T20:57:25.931564] [INFO ] [MAIN ] REVG: Loaded 41123 existing records. [2025-09-23T20:57:26.108151] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:57:26.108453] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-23T20:57:26.108504] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-23T20:57:26.109458] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-23T20:57:26.109522] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-23T20:57:26.479256] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:57:26.602178] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-23T20:57:26.840777] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T20:57:27.402211] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-23T20:57:27.619611] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T20:57:28.026710] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T20:57:28.202184] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-23T20:57:29.007293] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-23T20:57:29.023200] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T20:57:29.511708] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T20:57:29.802201] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-23T20:57:30.602212] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-23T20:57:31.065067] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-23T20:57:31.402172] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-23T20:57:31.732974] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T20:57:32.178518] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T20:57:32.202151] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-23T20:57:33.002198] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-23T20:57:33.234009] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T20:57:33.559361] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T20:57:33.802202] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-23T20:57:34.602211] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-23T20:57:34.666482] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T20:57:35.402231] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-23T20:57:35.525020] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T20:57:35.537392] [INFO ] [REMOTE ] RERE: Full fetch complete (57458 records). [2025-09-23T20:57:35.537577] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-23T20:57:35.935048] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-23T20:57:35.935129] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-23T20:57:35.936148] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-23T20:57:35.936245] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-23T20:57:35.939879] [DEBUG] [LOCAL ] RERE: Trimmed 57458 records to 41049 (keeping 200 days of data) [2025-09-23T20:57:36.181576] [DEBUG] [LOCAL ] RERE: Primary data saved (41049 records). [2025-09-23T20:57:36.181745] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-23T20:57:36.181932] [INFO ] [MAIN ] Update Progress: 1787/2372 symbols completed. RERE took 24.5s. Estimated remaining: 1h 17m 46s. Rate: 7.5 symbols/min [2025-09-23T20:57:36.226187] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-23T20:57:36.369436] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:57:36.411020] [DEBUG] [LOCAL ] REX: Loaded 13909 existing records from primary storage. [2025-09-23T20:57:36.411958] [INFO ] [MAIN ] REX: Loaded 13909 existing records. [2025-09-23T20:57:36.413355] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T20:57:36.521099] [INFO ] [REMOTE ] RELX: Full fetch complete (66970 records). [2025-09-23T20:57:36.523704] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-23T20:57:36.690193] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:57:36.701116] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-23T20:57:36.715121] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-23T20:57:36.718768] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-23T20:57:36.719144] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-23T20:57:37.327612] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T20:57:37.334879] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-23T20:57:37.347577] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-23T20:57:37.349382] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-23T20:57:37.355086] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-23T20:57:37.355010] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-23T20:57:37.422293] [DEBUG] [LOCAL ] RELX: Trimmed 66970 records to 47846 (keeping 200 days of data) [2025-09-23T20:57:37.472743] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:57:37.785057] [DEBUG] [LOCAL ] RELX: Primary data saved (47846 records). [2025-09-23T20:57:37.785261] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-23T20:57:37.785568] [INFO ] [MAIN ] Update Progress: 1788/2372 symbols completed. RELX took 31.2s. Estimated remaining: 1h 17m 36s. Rate: 7.5 symbols/min [2025-09-23T20:57:37.819037] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-23T20:57:38.018506] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:57:38.019775] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T20:57:38.092243] [DEBUG] [LOCAL ] REXR: Loaded 52060 existing records from primary storage. [2025-09-23T20:57:38.092425] [INFO ] [MAIN ] REXR: Loaded 52060 existing records. [2025-09-23T20:57:38.274559] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:57:38.274821] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-23T20:57:38.274916] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-23T20:57:38.276073] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-23T20:57:38.276133] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-23T20:57:38.614215] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-23T20:57:38.725613] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:57:38.848775] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T20:57:38.977094] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T20:57:39.402250] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-23T20:57:40.113532] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T20:57:40.202164] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-23T20:57:41.002180] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-23T20:57:41.051383] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T20:57:41.802208] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-23T20:57:41.871539] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T20:57:42.092001] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T20:57:42.602208] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-23T20:57:43.402222] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-23T20:57:43.492985] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T20:57:43.847202] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T20:57:43.858689] [INFO ] [REMOTE ] RES: Full fetch complete (68917 records). [2025-09-23T20:57:43.858818] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-23T20:57:44.204141] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-23T20:57:44.286860] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-23T20:57:44.287048] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-23T20:57:44.288188] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-23T20:57:44.288306] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-23T20:57:44.289820] [DEBUG] [LOCAL ] RES: Trimmed 68917 records to 47526 (keeping 200 days of data) [2025-09-23T20:57:44.476904] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T20:57:44.595853] [DEBUG] [LOCAL ] RES: Primary data saved (47526 records). [2025-09-23T20:57:44.596015] [INFO ] [MAIN ] RES: Full history saved. [2025-09-23T20:57:44.596134] [INFO ] [MAIN ] Update Progress: 1789/2372 symbols completed. RES took 31.3s. Estimated remaining: 1h 17m 28s. Rate: 7.5 symbols/min [2025-09-23T20:57:44.780394] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:57:44.834510] [DEBUG] [LOCAL ] REZI: Loaded 46841 existing records from primary storage. [2025-09-23T20:57:44.834959] [INFO ] [MAIN ] REZI: Loaded 46841 existing records. [2025-09-23T20:57:45.020079] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-23T20:57:45.034514] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:57:45.035757] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-23T20:57:45.035833] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-23T20:57:45.037241] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-23T20:57:45.037308] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-23T20:57:45.409403] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:57:45.802275] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-23T20:57:46.147758] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-23T20:57:46.198728] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T20:57:46.602222] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-23T20:57:47.402294] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T20:57:47.402480] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-23T20:57:48.202235] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-23T20:57:48.343087] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T20:57:48.551379] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T20:57:49.002236] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-23T20:57:49.438238] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T20:57:49.802201] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-23T20:57:50.490096] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T20:57:50.602189] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-23T20:57:51.370712] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T20:57:51.402149] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-23T20:57:52.114405] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T20:57:52.202198] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-23T20:57:53.007635] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-23T20:57:53.032592] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T20:57:53.747208] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T20:57:53.792303] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T20:57:53.802135] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-23T20:57:54.602192] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-23T20:57:54.804245] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T20:57:55.402210] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-23T20:57:56.207323] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-23T20:57:56.224372] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T20:57:56.930455] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T20:57:57.002201] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-23T20:57:57.568022] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T20:57:57.802227] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-23T20:57:58.602194] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-23T20:57:58.654167] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T20:57:58.686432] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T20:57:59.402198] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-23T20:58:00.207532] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-23T20:58:00.232542] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T20:58:01.002187] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-23T20:58:01.167515] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T20:58:01.802198] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-23T20:58:01.896545] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T20:58:01.906437] [INFO ] [REMOTE ] REVG: Full fetch complete (58425 records). [2025-09-23T20:58:01.906689] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-23T20:58:02.317001] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-23T20:58:02.317131] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-23T20:58:02.318153] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-23T20:58:02.318217] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-23T20:58:02.319618] [DEBUG] [LOCAL ] REVG: Trimmed 58425 records to 41044 (keeping 200 days of data) [2025-09-23T20:58:02.578247] [DEBUG] [LOCAL ] REVG: Primary data saved (41044 records). [2025-09-23T20:58:02.578386] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-23T20:58:02.578507] [INFO ] [MAIN ] Update Progress: 1790/2372 symbols completed. REVG took 36.9s. Estimated remaining: 1h 17m 23s. Rate: 7.5 symbols/min [2025-09-23T20:58:02.602694] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-23T20:58:02.765717] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:58:02.828957] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-23T20:58:02.829139] [INFO ] [MAIN ] RF: Loaded 53630 existing records. [2025-09-23T20:58:03.063322] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:58:03.065889] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-23T20:58:03.076684] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-23T20:58:03.077212] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-23T20:58:03.079079] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-23T20:58:03.079146] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-23T20:58:03.407120] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-23T20:58:03.453335] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T20:58:03.461821] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:58:03.538903] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T20:58:04.202250] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-23T20:58:04.998429] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T20:58:05.002271] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-23T20:58:05.802230] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-23T20:58:06.169611] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T20:58:06.602184] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-23T20:58:06.753879] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T20:58:07.344975] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T20:58:07.367629] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T20:58:07.371224] [INFO ] [REMOTE ] REX: Full fetch complete (21124 records). [2025-09-23T20:58:07.371297] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-23T20:58:07.407404] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-23T20:58:07.735736] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-23T20:58:07.735816] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-23T20:58:07.736216] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-23T20:58:07.736254] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-23T20:58:07.736875] [DEBUG] [LOCAL ] REX: Trimmed 21124 records to 13957 (keeping 200 days of data) [2025-09-23T20:58:07.826843] [DEBUG] [LOCAL ] REX: Primary data saved (13957 records). [2025-09-23T20:58:07.826975] [INFO ] [MAIN ] REX: Full history saved. [2025-09-23T20:58:07.827078] [INFO ] [MAIN ] Update Progress: 1791/2372 symbols completed. REX took 31.6s. Estimated remaining: 1h 17m 14s. Rate: 7.5 symbols/min [2025-09-23T20:58:07.995044] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:58:08.007557] [DEBUG] [LOCAL ] RFI: Loaded 10479 existing records from primary storage. [2025-09-23T20:58:08.007695] [INFO ] [MAIN ] RFI: Loaded 10479 existing records. [2025-09-23T20:58:08.187081] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:58:08.187297] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-23T20:58:08.187347] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-23T20:58:08.187934] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-23T20:58:08.187995] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-23T20:58:08.208384] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-23T20:58:08.540421] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:58:09.002220] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-23T20:58:09.452872] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-23T20:58:09.802170] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-23T20:58:09.893183] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T20:58:10.149154] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T20:58:10.602269] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-23T20:58:11.402209] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-23T20:58:11.611753] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T20:58:12.040250] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T20:58:12.202185] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-23T20:58:12.450910] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T20:58:13.002220] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-23T20:58:13.802253] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-23T20:58:13.830891] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T20:58:14.085375] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T20:58:14.602216] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-23T20:58:15.302400] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T20:58:15.314276] [INFO ] [REMOTE ] REZI: Full fetch complete (65551 records). [2025-09-23T20:58:15.314466] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-23T20:58:15.407379] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-23T20:58:15.721614] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-23T20:58:15.721730] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-23T20:58:15.722896] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-23T20:58:15.722977] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-23T20:58:15.724491] [DEBUG] [LOCAL ] REZI: Trimmed 65551 records to 46870 (keeping 200 days of data) [2025-09-23T20:58:16.013761] [DEBUG] [LOCAL ] REZI: Primary data saved (46870 records). [2025-09-23T20:58:16.013909] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-23T20:58:16.014058] [INFO ] [MAIN ] Update Progress: 1792/2372 symbols completed. REZI took 31.4s. Estimated remaining: 1h 17m 6s. Rate: 7.5 symbols/min [2025-09-23T20:58:16.191524] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:58:16.203973] [DEBUG] [LOCAL ] RFL: Loaded 10857 existing records from primary storage. [2025-09-23T20:58:16.203687] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-23T20:58:16.205104] [INFO ] [MAIN ] RFL: Loaded 10857 existing records. [2025-09-23T20:58:16.331219] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T20:58:16.430001] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T20:58:16.443828] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:58:16.444766] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-23T20:58:16.444823] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-23T20:58:16.445028] [INFO ] [REMOTE ] REXR: Full fetch complete (75099 records). [2025-09-23T20:58:16.445177] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-23T20:58:16.445349] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-23T20:58:16.445520] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-23T20:58:17.018204] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-23T20:58:17.271258] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-23T20:58:17.277067] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-23T20:58:17.288348] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-23T20:58:17.288479] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-23T20:58:17.312876] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:58:17.314009] [DEBUG] [LOCAL ] REXR: Trimmed 75099 records to 52083 (keeping 200 days of data) [2025-09-23T20:58:17.668521] [DEBUG] [LOCAL ] REXR: Primary data saved (52083 records). [2025-09-23T20:58:17.668878] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-23T20:58:17.669021] [INFO ] [MAIN ] Update Progress: 1793/2372 symbols completed. REXR took 39.9s. Estimated remaining: 1h 16m 56s. Rate: 7.5 symbols/min [2025-09-23T20:58:17.822388] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-23T20:58:17.859683] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:58:17.867776] [DEBUG] [LOCAL ] RFM: Loaded 4119 existing records from primary storage. [2025-09-23T20:58:17.867935] [INFO ] [MAIN ] RFM: Loaded 4119 existing records. [2025-09-23T20:58:17.992834] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T20:58:18.070991] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:58:18.071422] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-23T20:58:18.071552] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-23T20:58:18.071990] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-23T20:58:18.072050] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-23T20:58:18.362482] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T20:58:18.497234] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:58:18.504273] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-23T20:58:18.602152] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-23T20:58:19.228335] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-23T20:58:19.402176] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-23T20:58:20.009691] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T20:58:20.202223] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-23T20:58:21.002248] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-23T20:58:21.049920] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T20:58:21.794000] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T20:58:21.802164] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-23T20:58:22.547639] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T20:58:22.602165] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-23T20:58:23.402204] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-23T20:58:24.202204] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-23T20:58:24.325675] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T20:58:24.449689] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-23T20:58:24.962082] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T20:58:25.002211] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-23T20:58:25.802211] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-23T20:58:25.830631] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T20:58:26.602248] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-23T20:58:27.402170] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-23T20:58:27.654992] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-23T20:58:27.684873] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T20:58:27.770059] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-23T20:58:28.202205] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-23T20:58:28.756507] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T20:58:29.002211] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-23T20:58:29.601881] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T20:58:29.802217] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-23T20:58:30.602211] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-23T20:58:30.659113] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T20:58:31.402212] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-23T20:58:31.724246] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T20:58:31.955306] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T20:58:31.957512] [INFO ] [REMOTE ] RFI: Full fetch complete (15773 records). [2025-09-23T20:58:31.957587] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-23T20:58:32.207337] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-23T20:58:32.326160] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-23T20:58:32.326240] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-23T20:58:32.326634] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-23T20:58:32.326712] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-23T20:58:32.327335] [DEBUG] [LOCAL ] RFI: Trimmed 15773 records to 10473 (keeping 200 days of data) [2025-09-23T20:58:32.397609] [DEBUG] [LOCAL ] RFI: Primary data saved (10473 records). [2025-09-23T20:58:32.397782] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-23T20:58:32.397873] [INFO ] [MAIN ] Update Progress: 1794/2372 symbols completed. RFI took 24.6s. Estimated remaining: 1h 16m 50s. Rate: 7.5 symbols/min [2025-09-23T20:58:32.570498] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:58:32.580879] [DEBUG] [LOCAL ] RFMZ: Loaded 8608 existing records from primary storage. [2025-09-23T20:58:32.581008] [INFO ] [MAIN ] RFMZ: Loaded 8608 existing records. [2025-09-23T20:58:32.761543] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:58:32.761830] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-23T20:58:32.761881] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-23T20:58:32.762264] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-23T20:58:32.762332] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-23T20:58:33.007325] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-23T20:58:33.126969] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:58:33.802238] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-23T20:58:33.928770] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T20:58:34.354448] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T20:58:34.421162] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T20:58:34.602197] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-23T20:58:35.402249] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-23T20:58:35.466767] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T20:58:35.770728] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T20:58:36.202228] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-23T20:58:36.803537] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T20:58:37.002212] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-23T20:58:37.671121] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T20:58:37.802214] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-23T20:58:38.602196] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-23T20:58:38.771045] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T20:58:38.774947] [INFO ] [REMOTE ] RFL: Full fetch complete (12769 records). [2025-09-23T20:58:38.775078] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-23T20:58:39.187326] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-23T20:58:39.187477] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-23T20:58:39.187859] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-23T20:58:39.187921] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-23T20:58:39.188464] [DEBUG] [LOCAL ] RFL: Trimmed 12769 records to 10923 (keeping 200 days of data) [2025-09-23T20:58:39.254760] [DEBUG] [LOCAL ] RFL: Primary data saved (10923 records). [2025-09-23T20:58:39.254912] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-23T20:58:39.255001] [INFO ] [MAIN ] Update Progress: 1795/2372 symbols completed. RFL took 23.2s. Estimated remaining: 1h 16m 42s. Rate: 7.5 symbols/min [2025-09-23T20:58:39.404698] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-23T20:58:39.426481] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:58:39.458973] [DEBUG] [LOCAL ] RGA: Loaded 30179 existing records from primary storage. [2025-09-23T20:58:39.459143] [INFO ] [MAIN ] RGA: Loaded 30179 existing records. [2025-09-23T20:58:39.636808] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:58:39.637059] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-23T20:58:39.637108] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-23T20:58:39.638245] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-23T20:58:39.638307] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-23T20:58:39.933753] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T20:58:40.017162] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:58:40.202170] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-23T20:58:40.605880] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-23T20:58:40.847342] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T20:58:40.848970] [INFO ] [REMOTE ] RFM: Full fetch complete (6005 records). [2025-09-23T20:58:40.849045] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-23T20:58:41.002698] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-23T20:58:41.233602] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-23T20:58:41.233715] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-23T20:58:41.233929] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-23T20:58:41.233970] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-23T20:58:41.234371] [DEBUG] [LOCAL ] RFM: Trimmed 6005 records to 4145 (keeping 200 days of data) [2025-09-23T20:58:41.261261] [DEBUG] [LOCAL ] RFM: Primary data saved (4145 records). [2025-09-23T20:58:41.261388] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-23T20:58:41.261479] [INFO ] [MAIN ] Update Progress: 1796/2372 symbols completed. RFM took 23.6s. Estimated remaining: 1h 16m 32s. Rate: 7.5 symbols/min [2025-09-23T20:58:41.449018] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:58:41.471234] [DEBUG] [LOCAL ] RGR: Loaded 20285 existing records from primary storage. [2025-09-23T20:58:41.471446] [INFO ] [MAIN ] RGR: Loaded 20285 existing records. [2025-09-23T20:58:41.666081] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:58:41.666359] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-23T20:58:41.666409] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-23T20:58:41.667007] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-23T20:58:41.667069] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-23T20:58:41.807423] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-23T20:58:42.050464] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:58:42.435803] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T20:58:42.602194] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-23T20:58:43.105116] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T20:58:43.402205] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-23T20:58:43.658881] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T20:58:43.667851] [INFO ] [REMOTE ] RF: Full fetch complete (77621 records). [2025-09-23T20:58:43.667991] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-23T20:58:44.067635] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-23T20:58:44.067770] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-23T20:58:44.068903] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-23T20:58:44.068966] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-23T20:58:44.070465] [DEBUG] [LOCAL ] RF: Trimmed 77621 records to 53630 (keeping 200 days of data) [2025-09-23T20:58:44.202311] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-23T20:58:44.420784] [DEBUG] [LOCAL ] RF: Primary data saved (53630 records). [2025-09-23T20:58:44.420945] [INFO ] [MAIN ] RF: Full history saved. [2025-09-23T20:58:44.421034] [INFO ] [MAIN ] Update Progress: 1797/2372 symbols completed. RF took 41.8s. Estimated remaining: 1h 16m 22s. Rate: 7.5 symbols/min [2025-09-23T20:58:44.565782] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T20:58:45.002205] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-23T20:58:45.493623] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T20:58:45.802234] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-23T20:58:45.834464] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T20:58:46.357907] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T20:58:46.602240] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-23T20:58:47.402230] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-23T20:58:48.037038] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T20:58:48.202174] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-23T20:58:48.485707] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T20:58:49.002295] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-23T20:58:49.786888] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T20:58:49.811253] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-23T20:58:49.817595] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T20:58:50.602361] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-23T20:58:50.886461] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T20:58:51.402216] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-23T20:58:52.171082] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T20:58:52.202250] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-23T20:58:52.361174] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T20:58:53.002228] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-23T20:58:53.612513] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T20:58:53.741840] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T20:58:53.802240] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-23T20:58:54.602216] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-23T20:58:55.193862] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T20:58:55.377929] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T20:58:55.402242] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-23T20:58:56.202177] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-23T20:58:56.246764] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T20:58:57.002201] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-23T20:58:57.264338] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T20:58:57.527790] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T20:58:57.529985] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12944 records). [2025-09-23T20:58:57.530055] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-23T20:58:57.807294] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-23T20:58:57.893395] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-23T20:58:57.893477] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-23T20:58:57.893842] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-23T20:58:57.893904] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-23T20:58:57.894398] [DEBUG] [LOCAL ] RFMZ: Trimmed 12944 records to 8678 (keeping 200 days of data) [2025-09-23T20:58:57.948524] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8678 records). [2025-09-23T20:58:57.948694] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-23T20:58:57.948800] [INFO ] [MAIN ] Update Progress: 1798/2372 symbols completed. RFMZ took 25.6s. Estimated remaining: 1h 16m 16s. Rate: 7.5 symbols/min [2025-09-23T20:58:58.602221] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-23T20:58:58.953716] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T20:58:59.402240] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-23T20:58:59.507060] [DEBUG] [REMOTE ] RGR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-23T20:58:59.507541] [WARN ] [REMOTE ] RGR: No data returned for month 2025-05 [2025-09-23T20:58:59.854857] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T20:59:00.202251] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-23T20:59:01.002283] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-23T20:59:01.528614] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T20:59:01.802227] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-23T20:59:02.232182] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T20:59:02.602195] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-23T20:59:02.953943] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T20:59:03.402333] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-23T20:59:03.781937] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T20:59:04.202214] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-23T20:59:04.768385] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T20:59:04.773971] [INFO ] [REMOTE ] RGA: Full fetch complete (45648 records). [2025-09-23T20:59:04.774077] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-23T20:59:05.152934] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-23T20:59:05.153015] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-23T20:59:05.153904] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-23T20:59:05.153966] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-23T20:59:05.155046] [DEBUG] [LOCAL ] RGA: Trimmed 45648 records to 30163 (keeping 200 days of data) [2025-09-23T20:59:05.349638] [DEBUG] [LOCAL ] RGA: Primary data saved (30163 records). [2025-09-23T20:59:05.349795] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-23T20:59:05.349880] [INFO ] [MAIN ] Update Progress: 1799/2372 symbols completed. RGA took 26.1s. Estimated remaining: 1h 16m 8s. Rate: 7.5 symbols/min [2025-09-23T20:59:05.412483] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T20:59:05.417562] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-23T20:59:06.574911] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T20:59:06.579234] [INFO ] [REMOTE ] RGR: Full fetch complete (24954 records). [2025-09-23T20:59:06.579314] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-23T20:59:06.765363] [WARN ] [VALIDATOR ] RGR: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T20:59:06.765793] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:59:06.765865] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:59:06.765933] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-23T20:59:06.766016] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-09-23T20:59:06.766085] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-09-23T20:59:06.766583] [DEBUG] [LOCAL ] RGR: Deleted derivative data file. [2025-09-23T20:59:06.766733] [INFO ] [MAIN ] Update Progress: 1800/2372 symbols completed. RGR took 25.5s. Estimated remaining: 1h 15m 58s. Rate: 7.5 symbols/min [2025-09-23T20:59:07.439847] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:07.442824] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:07.443627] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:07.492886] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:07.493706] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-23T20:59:07.494069] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-23T20:59:07.494287] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-23T20:59:07.496623] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-23T20:59:07.496736] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-23T20:59:07.496843] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-23T20:59:07.535073] [DEBUG] [LOCAL ] RGT: Loaded 2903 existing records from primary storage. [2025-09-23T20:59:07.564027] [INFO ] [MAIN ] RGT: Loaded 2903 existing records. [2025-09-23T20:59:07.930361] [DEBUG] [LOCAL ] RH: Loaded 47705 existing records from primary storage. [2025-09-23T20:59:07.988562] [DEBUG] [LOCAL ] RHI: Loaded 49247 existing records from primary storage. [2025-09-23T20:59:08.008067] [INFO ] [MAIN ] RH: Loaded 47705 existing records. [2025-09-23T20:59:08.057189] [INFO ] [MAIN ] RHI: Loaded 49247 existing records. [2025-09-23T20:59:08.113701] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:59:08.263290] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-23T20:59:08.288414] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-23T20:59:08.311754] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-23T20:59:08.341966] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-23T20:59:08.349857] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:08.360602] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-23T20:59:08.593585] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:59:08.612977] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-23T20:59:08.658859] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-23T20:59:08.662745] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:59:08.670029] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-23T20:59:08.680548] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-23T20:59:08.680619] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-23T20:59:08.697457] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-23T20:59:08.760743] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-23T20:59:08.760892] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-23T20:59:08.760605] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:59:08.805833] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-23T20:59:08.942770] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-09-23T20:59:09.353070] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T20:59:09.417694] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-09-23T20:59:09.442756] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-02. [2025-09-23T20:59:09.532277] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:09.554940] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-23T20:59:09.700513] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:09.716395] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-23T20:59:09.720740] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:09.802180] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-23T20:59:10.009397] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T20:59:10.093633] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T20:59:10.602260] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-23T20:59:11.128168] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T20:59:11.342694] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T20:59:11.402182] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-23T20:59:11.457402] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T20:59:12.040484] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T20:59:12.202197] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-23T20:59:13.002225] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-23T20:59:13.802257] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-23T20:59:13.836930] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T20:59:14.467981] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-23T20:59:14.602199] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-23T20:59:14.633239] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T20:59:15.402201] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-23T20:59:16.109075] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T20:59:16.202245] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-23T20:59:17.002160] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-23T20:59:17.035904] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T20:59:17.602141] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T20:59:17.802172] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-23T20:59:18.191566] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T20:59:18.323851] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T20:59:18.602202] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-03. [2025-09-23T20:59:19.402173] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-23T20:59:19.694670] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T20:59:20.202281] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-04. [2025-09-23T20:59:20.963558] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T20:59:21.002172] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-23T20:59:21.194937] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T20:59:21.802207] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-23T20:59:22.523374] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T20:59:22.602176] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-05. [2025-09-23T20:59:22.646551] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T20:59:23.171981] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T20:59:23.402233] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-23T20:59:23.859374] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T20:59:24.202207] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-23T20:59:25.002251] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-06. [2025-09-23T20:59:25.802186] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-23T20:59:25.827437] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T20:59:26.294442] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T20:59:26.365594] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T20:59:26.602222] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-23T20:59:27.402217] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-07. [2025-09-23T20:59:28.202261] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-23T20:59:28.296705] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T20:59:28.315626] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-23T20:59:29.002232] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-23T20:59:29.500632] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T20:59:29.501769] [INFO ] [REMOTE ] RGT: Full fetch complete (4156 records). [2025-09-23T20:59:29.501840] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-23T20:59:29.807291] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-08. [2025-09-23T20:59:29.878759] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-23T20:59:29.878954] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-23T20:59:29.879194] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-23T20:59:29.879238] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-23T20:59:29.879791] [DEBUG] [LOCAL ] RGT: Trimmed 4156 records to 2879 (keeping 200 days of data) [2025-09-23T20:59:29.899192] [DEBUG] [LOCAL ] RGT: Primary data saved (2879 records). [2025-09-23T20:59:29.899352] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-23T20:59:29.899448] [INFO ] [MAIN ] Update Progress: 1801/2372 symbols completed. RGT took 23.1s. Estimated remaining: 1h 15m 55s. Rate: 7.5 symbols/min [2025-09-23T20:59:30.077088] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:30.118835] [DEBUG] [LOCAL ] RHP: Loaded 41809 existing records from primary storage. [2025-09-23T20:59:30.119145] [INFO ] [MAIN ] RHP: Loaded 41809 existing records. [2025-09-23T20:59:30.302226] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T20:59:30.351060] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:59:30.352066] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-23T20:59:30.352212] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-23T20:59:30.353712] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-23T20:59:30.353781] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-23T20:59:30.607372] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-23T20:59:30.735021] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T20:59:30.740805] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:31.402423] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-23T20:59:32.202212] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-09. [2025-09-23T20:59:32.644601] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T20:59:32.936377] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T20:59:33.002141] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-23T20:59:33.031957] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T20:59:33.034095] [INFO ] [REMOTE ] RHLD: Full fetch complete (11449 records). [2025-09-23T20:59:33.034184] [DEBUG] [VALIDATOR ] RHLD: Validating primary data. [2025-09-23T20:59:33.222049] [WARN ] [VALIDATOR ] RHLD: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-09-23T20:59:33.222378] [FATAL] [MAIN ] RHLD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T20:59:33.222473] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T20:59:33.222565] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-23T20:59:33.222712] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-23T20:59:33.222797] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-23T20:59:33.222937] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-23T20:59:33.223079] [INFO ] [MAIN ] Update Progress: 1802/2372 symbols completed. RHLD took 26.5s. Estimated remaining: 1h 15m 45s. Rate: 7.5 symbols/min [2025-09-23T20:59:33.417348] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:33.474918] [DEBUG] [LOCAL ] RIG: Loaded 53669 existing records from primary storage. [2025-09-23T20:59:33.475074] [INFO ] [MAIN ] RIG: Loaded 53669 existing records. [2025-09-23T20:59:33.658072] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:59:33.658345] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-23T20:59:33.658394] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-23T20:59:33.660075] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-23T20:59:33.660137] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-23T20:59:33.807366] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-23T20:59:34.037178] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:34.452609] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T20:59:34.602216] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-23T20:59:35.402192] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-23T20:59:35.818321] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-23T20:59:35.894001] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T20:59:36.202207] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-23T20:59:37.002220] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-23T20:59:37.539137] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-23T20:59:37.802202] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-23T20:59:37.992229] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T20:59:38.448744] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T20:59:38.602258] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-23T20:59:39.402167] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-23T20:59:39.599675] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T20:59:40.202169] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-23T20:59:40.342568] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T20:59:41.002221] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-23T20:59:41.347255] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T20:59:41.802217] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-23T20:59:42.032086] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T20:59:42.602286] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-23T20:59:42.715862] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T20:59:43.280587] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T20:59:43.402153] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-23T20:59:44.202218] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-23T20:59:44.342417] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T20:59:45.002248] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-23T20:59:45.446844] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-23T20:59:45.802237] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-23T20:59:45.868670] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T20:59:45.876994] [INFO ] [REMOTE ] RHI: Full fetch complete (69671 records). [2025-09-23T20:59:45.877154] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-23T20:59:46.301215] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-23T20:59:46.301726] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-23T20:59:46.302976] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-23T20:59:46.303079] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-23T20:59:46.315444] [DEBUG] [LOCAL ] RHI: Trimmed 69671 records to 49275 (keeping 200 days of data) [2025-09-23T20:59:46.332347] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T20:59:46.612887] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-23T20:59:46.647518] [DEBUG] [LOCAL ] RHI: Primary data saved (49275 records). [2025-09-23T20:59:46.647634] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-23T20:59:46.647783] [INFO ] [MAIN ] Update Progress: 1803/2372 symbols completed. RHI took 39.9s. Estimated remaining: 1h 15m 39s. Rate: 7.5 symbols/min [2025-09-23T20:59:46.821031] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:46.821207] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-09-23T20:59:46.821263] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-09-23T20:59:46.821421] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-23T20:59:46.821479] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-23T20:59:46.821549] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-09-23T20:59:46.821585] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-23T20:59:47.201512] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:47.402186] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-23T20:59:47.846080] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T20:59:48.209149] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-23T20:59:48.214999] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T20:59:48.759032] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T20:59:48.769705] [INFO ] [REMOTE ] RH: Full fetch complete (65596 records). [2025-09-23T20:59:48.769841] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-23T20:59:49.009093] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-23T20:59:49.177207] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-23T20:59:49.177300] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-23T20:59:49.178380] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-23T20:59:49.178507] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-23T20:59:49.180314] [DEBUG] [LOCAL ] RH: Trimmed 65596 records to 47705 (keeping 200 days of data) [2025-09-23T20:59:49.491431] [DEBUG] [LOCAL ] RH: Primary data saved (47705 records). [2025-09-23T20:59:49.491607] [INFO ] [MAIN ] RH: Full history saved. [2025-09-23T20:59:49.491784] [INFO ] [MAIN ] Update Progress: 1804/2372 symbols completed. RH took 42.7s. Estimated remaining: 1h 15m 30s. Rate: 7.5 symbols/min [2025-09-23T20:59:49.678702] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:49.740097] [DEBUG] [LOCAL ] RITM: Loaded 52818 existing records from primary storage. [2025-09-23T20:59:49.740250] [INFO ] [MAIN ] RITM: Loaded 52818 existing records. [2025-09-23T20:59:49.812901] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-23T20:59:49.930058] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:59:49.930396] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-23T20:59:49.930454] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-23T20:59:49.931906] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-23T20:59:49.931985] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-23T20:59:50.297829] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:50.338229] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-23T20:59:50.602240] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-23T20:59:51.131497] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T20:59:51.397616] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T20:59:51.405790] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-23T20:59:52.202220] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-23T20:59:52.438732] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T20:59:53.002160] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-23T20:59:53.064038] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T20:59:53.266713] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T20:59:53.275134] [INFO ] [REMOTE ] RHP: Full fetch complete (57976 records). [2025-09-23T20:59:53.275243] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-23T20:59:53.729606] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-23T20:59:53.729742] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-23T20:59:53.730779] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-23T20:59:53.730843] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-23T20:59:53.732320] [DEBUG] [LOCAL ] RHP: Trimmed 57976 records to 41815 (keeping 200 days of data) [2025-09-23T20:59:53.817454] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-23T20:59:54.040619] [DEBUG] [LOCAL ] RHP: Primary data saved (41815 records). [2025-09-23T20:59:54.040933] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-23T20:59:54.041121] [INFO ] [MAIN ] Update Progress: 1805/2372 symbols completed. RHP took 24.1s. Estimated remaining: 1h 15m 21s. Rate: 7.5 symbols/min [2025-09-23T20:59:54.212438] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T20:59:54.229722] [DEBUG] [LOCAL ] RIV: Loaded 11847 existing records from primary storage. [2025-09-23T20:59:54.229877] [INFO ] [MAIN ] RIV: Loaded 11847 existing records. [2025-09-23T20:59:54.405927] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T20:59:54.406258] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-23T20:59:54.406322] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-23T20:59:54.407058] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-23T20:59:54.407134] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-23T20:59:54.614444] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-23T20:59:54.775600] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T20:59:55.157578] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T20:59:55.402192] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-23T20:59:56.024736] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-23T20:59:56.202174] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-23T20:59:56.654382] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-23T20:59:57.002169] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-23T20:59:57.368803] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T20:59:57.659799] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T20:59:57.802167] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-23T20:59:58.602225] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-23T20:59:58.887421] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T20:59:59.402170] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-23T20:59:59.549608] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T20:59:59.743574] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T21:00:00.202215] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-23T21:00:01.002212] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-23T21:00:01.805587] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-23T21:00:01.902432] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-23T21:00:02.250251] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T21:00:02.421327] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-23T21:00:02.432719] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-09-23T21:00:02.432964] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-23T21:00:02.609881] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-23T21:00:02.893935] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-23T21:00:02.894040] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-23T21:00:02.895233] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-23T21:00:02.895299] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-23T21:00:02.900101] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 53669 (keeping 200 days of data) [2025-09-23T21:00:03.246222] [DEBUG] [LOCAL ] RIG: Primary data saved (53669 records). [2025-09-23T21:00:03.246376] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-23T21:00:03.246510] [INFO ] [MAIN ] Update Progress: 1806/2372 symbols completed. RIG took 30.0s. Estimated remaining: 1h 15m 13s. Rate: 7.5 symbols/min [2025-09-23T21:00:03.416504] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-23T21:00:03.419941] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:00:03.473011] [DEBUG] [LOCAL ] RJF: Loaded 47125 existing records from primary storage. [2025-09-23T21:00:03.473185] [INFO ] [MAIN ] RJF: Loaded 47125 existing records. [2025-09-23T21:00:03.654116] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:00:03.654391] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-23T21:00:03.654440] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-23T21:00:03.656957] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-23T21:00:03.657022] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-23T21:00:04.019902] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:00:04.202343] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-23T21:00:05.486247] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-23T21:00:05.489637] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-23T21:00:05.567738] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (3.76 seconds). [2025-09-23T21:00:05.802209] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-23T21:00:06.139427] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T21:00:06.602182] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-23T21:00:06.729705] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-23T21:00:06.781225] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (4.17 seconds). [2025-09-23T21:00:07.402280] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-23T21:00:07.541112] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T21:00:07.672369] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T21:00:08.202211] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-23T21:00:09.008366] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-23T21:00:09.036758] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T21:00:09.055916] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T21:00:09.802235] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-23T21:00:10.602239] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-23T21:00:10.794414] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T21:00:11.402194] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-23T21:00:11.429890] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T21:00:11.510315] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T21:00:12.202240] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-23T21:00:13.002189] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-23T21:00:13.111487] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-23T21:00:13.257795] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T21:00:13.802293] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-23T21:00:14.602209] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-23T21:00:14.838490] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T21:00:15.402264] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-23T21:00:16.202206] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-23T21:00:16.583279] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-23T21:00:16.765802] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-23T21:00:17.002193] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-23T21:00:17.649397] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-23T21:00:17.802228] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-23T21:00:18.562240] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-23T21:00:18.602177] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-23T21:00:18.656319] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T21:00:19.402236] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-23T21:00:19.489010] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T21:00:19.653782] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T21:00:19.658179] [INFO ] [REMOTE ] RIV: Full fetch complete (17255 records). [2025-09-23T21:00:19.658257] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-23T21:00:20.049469] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-23T21:00:20.049838] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-23T21:00:20.050451] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-23T21:00:20.050515] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-23T21:00:20.051262] [DEBUG] [LOCAL ] RIV: Trimmed 17255 records to 11908 (keeping 200 days of data) [2025-09-23T21:00:20.133116] [DEBUG] [LOCAL ] RIV: Primary data saved (11908 records). [2025-09-23T21:00:20.133278] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-23T21:00:20.133445] [INFO ] [MAIN ] Update Progress: 1807/2372 symbols completed. RIV took 26.1s. Estimated remaining: 1h 15m 8s. Rate: 7.5 symbols/min [2025-09-23T21:00:20.207372] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-23T21:00:20.321902] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:00:20.385155] [DEBUG] [LOCAL ] RKT: Loaded 53721 existing records from primary storage. [2025-09-23T21:00:20.385321] [INFO ] [MAIN ] RKT: Loaded 53721 existing records. [2025-09-23T21:00:20.582339] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:00:20.582733] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-23T21:00:20.582798] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-23T21:00:20.584825] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-23T21:00:20.584888] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-23T21:00:21.045974] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-23T21:00:21.051679] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:00:21.090151] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T21:00:21.592163] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T21:00:21.802229] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-23T21:00:22.602231] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-23T21:00:23.105433] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-23T21:00:23.402282] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-23T21:00:23.570014] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T21:00:24.202189] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-23T21:00:24.418545] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T21:00:24.427628] [INFO ] [REMOTE ] RITM: Full fetch complete (76538 records). [2025-09-23T21:00:24.427805] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-23T21:00:24.849206] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-23T21:00:24.849309] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-23T21:00:24.850472] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-23T21:00:24.850543] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-23T21:00:24.852197] [DEBUG] [LOCAL ] RITM: Trimmed 76538 records to 52820 (keeping 200 days of data) [2025-09-23T21:00:25.042823] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-23T21:00:25.114299] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T21:00:25.125460] [INFO ] [REMOTE ] RIO: Full fetch complete (77351 records). [2025-09-23T21:00:25.126119] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-23T21:00:25.562921] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-23T21:00:25.563295] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-23T21:00:25.564633] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-23T21:00:25.565020] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-23T21:00:25.569726] [DEBUG] [LOCAL ] RIO: Trimmed 77351 records to 53394 (keeping 200 days of data) [2025-09-23T21:00:25.829485] [DEBUG] [LOCAL ] RITM: Primary data saved (52820 records). [2025-09-23T21:00:25.838447] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-23T21:00:25.839145] [INFO ] [MAIN ] Update Progress: 1808/2372 symbols completed. RITM took 36.3s. Estimated remaining: 1h 14m 59s. Rate: 7.5 symbols/min [2025-09-23T21:00:25.971274] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T21:00:26.012862] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-23T21:00:26.095184] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:00:26.212876] [DEBUG] [LOCAL ] RL: Loaded 41735 existing records from primary storage. [2025-09-23T21:00:26.213598] [INFO ] [MAIN ] RL: Loaded 41735 existing records. [2025-09-23T21:00:26.418390] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:00:26.424062] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-23T21:00:26.424174] [DEBUG] [LOCAL ] RIO: Primary data saved (53394 records). [2025-09-23T21:00:26.424289] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-23T21:00:26.424434] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-23T21:00:26.424674] [INFO ] [MAIN ] Update Progress: 1809/2372 symbols completed. RIO took 39.8s. Estimated remaining: 1h 14m 49s. Rate: 7.5 symbols/min [2025-09-23T21:00:26.436387] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-23T21:00:26.494314] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-23T21:00:26.730519] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:00:26.899965] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T21:00:27.022763] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:00:27.016989] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-23T21:00:27.034321] [DEBUG] [LOCAL ] RLI: Loaded 33263 existing records from primary storage. [2025-09-23T21:00:27.034409] [INFO ] [MAIN ] RLI: Loaded 33263 existing records. [2025-09-23T21:00:27.214843] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:00:27.215088] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-23T21:00:27.215136] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-23T21:00:27.216171] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-23T21:00:27.216242] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-23T21:00:27.421222] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-23T21:00:27.570319] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:00:27.924981] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-23T21:00:28.202207] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-23T21:00:28.843102] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T21:00:28.850893] [INFO ] [REMOTE ] RJF: Full fetch complete (68287 records). [2025-09-23T21:00:28.851034] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-23T21:00:29.007196] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-23T21:00:29.246993] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-23T21:00:29.247085] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-23T21:00:29.248097] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-23T21:00:29.248163] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-23T21:00:29.249799] [DEBUG] [LOCAL ] RJF: Trimmed 68287 records to 47092 (keeping 200 days of data) [2025-09-23T21:00:29.554670] [DEBUG] [LOCAL ] RJF: Primary data saved (47092 records). [2025-09-23T21:00:29.554813] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-23T21:00:29.557456] [INFO ] [MAIN ] Update Progress: 1810/2372 symbols completed. RJF took 26.3s. Estimated remaining: 1h 14m 39s. Rate: 7.5 symbols/min [2025-09-23T21:00:29.732050] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:00:29.758823] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-23T21:00:29.802181] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-23T21:00:29.818073] [DEBUG] [LOCAL ] RLJ: Loaded 48288 existing records from primary storage. [2025-09-23T21:00:29.818234] [INFO ] [MAIN ] RLJ: Loaded 48288 existing records. [2025-09-23T21:00:30.002538] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:00:30.002845] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-23T21:00:30.002897] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-23T21:00:30.004081] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-23T21:00:30.004145] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-23T21:00:30.357148] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:00:30.604220] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-23T21:00:30.607565] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-23T21:00:31.193610] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T21:00:31.402314] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-23T21:00:32.099377] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-23T21:00:32.202198] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-23T21:00:32.352020] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T21:00:32.763206] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T21:00:33.002256] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-23T21:00:33.504533] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T21:00:33.802274] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-23T21:00:34.602250] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-23T21:00:34.674902] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T21:00:35.260575] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T21:00:35.402205] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-23T21:00:35.547113] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T21:00:36.202226] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-23T21:00:36.652197] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T21:00:37.002203] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-23T21:00:37.765787] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T21:00:37.802204] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-23T21:00:38.429123] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T21:00:38.602211] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-23T21:00:39.402178] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-23T21:00:39.590355] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T21:00:40.202232] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-23T21:00:40.462678] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T21:00:40.980639] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:00:41.002149] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-23T21:00:41.802170] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-23T21:00:42.082699] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T21:00:42.602199] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-23T21:00:43.201123] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T21:00:43.327612] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T21:00:43.402150] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-23T21:00:44.039427] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T21:00:44.202194] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-23T21:00:44.395831] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T21:00:45.002198] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-23T21:00:45.802177] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-23T21:00:45.892153] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T21:00:46.602200] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-23T21:00:46.773109] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T21:00:47.237114] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T21:00:47.402186] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-23T21:00:48.202213] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-23T21:00:48.406348] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T21:00:49.002243] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-23T21:00:49.069982] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T21:00:49.775114] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T21:00:49.802200] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-23T21:00:50.602164] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-23T21:00:50.979749] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T21:00:51.044463] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T21:00:51.402249] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-23T21:00:51.936676] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T21:00:52.202206] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-23T21:00:52.741138] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T21:00:52.747158] [INFO ] [REMOTE ] RLI: Full fetch complete (46097 records). [2025-09-23T21:00:52.747297] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-23T21:00:53.007484] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-23T21:00:53.133034] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-23T21:00:53.133139] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-23T21:00:53.134036] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-23T21:00:53.134099] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-23T21:00:53.135144] [DEBUG] [LOCAL ] RLI: Trimmed 46097 records to 33304 (keeping 200 days of data) [2025-09-23T21:00:53.339154] [DEBUG] [LOCAL ] RLI: Primary data saved (33304 records). [2025-09-23T21:00:53.339304] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-23T21:00:53.339394] [INFO ] [MAIN ] Update Progress: 1811/2372 symbols completed. RLI took 26.9s. Estimated remaining: 1h 14m 36s. Rate: 7.5 symbols/min [2025-09-23T21:00:53.510454] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:00:53.523078] [DEBUG] [LOCAL ] RLTY: Loaded 11142 existing records from primary storage. [2025-09-23T21:00:53.523199] [INFO ] [MAIN ] RLTY: Loaded 11142 existing records. [2025-09-23T21:00:53.699694] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:00:53.699964] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-23T21:00:53.700012] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-23T21:00:53.700505] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-23T21:00:53.700565] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-23T21:00:53.803783] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-23T21:00:54.069484] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:00:54.564051] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-23T21:00:54.602271] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-23T21:00:54.667613] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T21:00:54.675237] [INFO ] [REMOTE ] RL: Full fetch complete (59951 records). [2025-09-23T21:00:54.675512] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-23T21:00:55.279082] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-23T21:00:55.279212] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-23T21:00:55.281205] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-23T21:00:55.281308] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-23T21:00:55.283374] [DEBUG] [LOCAL ] RL: Trimmed 59951 records to 41590 (keeping 200 days of data) [2025-09-23T21:00:55.408314] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-23T21:00:55.644264] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T21:00:55.710479] [DEBUG] [LOCAL ] RL: Primary data saved (41590 records). [2025-09-23T21:00:55.710622] [INFO ] [MAIN ] RL: Full history saved. [2025-09-23T21:00:55.710753] [INFO ] [MAIN ] Update Progress: 1812/2372 symbols completed. RL took 29.8s. Estimated remaining: 1h 14m 27s. Rate: 7.5 symbols/min [2025-09-23T21:00:55.887329] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:00:55.930446] [DEBUG] [LOCAL ] RLX: Loaded 48160 existing records from primary storage. [2025-09-23T21:00:55.930624] [INFO ] [MAIN ] RLX: Loaded 48160 existing records. [2025-09-23T21:00:56.126594] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:00:56.139275] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T21:00:56.138869] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-23T21:00:56.143631] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-23T21:00:56.144840] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-23T21:00:56.144906] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-23T21:00:56.212882] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-23T21:00:56.521108] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:00:57.003780] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-23T21:00:57.013530] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-23T21:00:57.802158] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-23T21:00:57.989410] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T21:00:58.602236] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-23T21:00:58.820473] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T21:00:59.402183] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-23T21:00:59.604593] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T21:00:59.687721] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T21:00:59.697124] [INFO ] [REMOTE ] RKT: Full fetch complete (77342 records). [2025-09-23T21:00:59.697287] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-23T21:01:00.098844] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-23T21:01:00.098960] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-23T21:01:00.100226] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-23T21:01:00.100290] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-23T21:01:00.101847] [DEBUG] [LOCAL ] RKT: Trimmed 77342 records to 53721 (keeping 200 days of data) [2025-09-23T21:01:00.203442] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-23T21:01:00.442973] [DEBUG] [LOCAL ] RKT: Primary data saved (53721 records). [2025-09-23T21:01:00.443182] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-23T21:01:00.443296] [INFO ] [MAIN ] Update Progress: 1813/2372 symbols completed. RKT took 40.3s. Estimated remaining: 1h 14m 18s. Rate: 7.5 symbols/min [2025-09-23T21:01:00.620114] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:00.629982] [DEBUG] [LOCAL ] RM: Loaded 7663 existing records from primary storage. [2025-09-23T21:01:00.630118] [INFO ] [MAIN ] RM: Loaded 7663 existing records. [2025-09-23T21:01:00.812686] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:00.812973] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-23T21:01:00.813023] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-23T21:01:00.813424] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-23T21:01:00.813484] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-23T21:01:01.028405] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-23T21:01:01.185337] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:01.246455] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T21:01:01.333551] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T21:01:01.802253] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-23T21:01:02.602248] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-23T21:01:02.763171] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T21:01:02.784350] [INFO ] [REMOTE ] RLJ: Full fetch complete (69211 records). [2025-09-23T21:01:02.784632] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-23T21:01:02.786477] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T21:01:03.218470] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-23T21:01:03.218573] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-23T21:01:03.219933] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-23T21:01:03.220006] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-23T21:01:03.221546] [DEBUG] [LOCAL ] RLJ: Trimmed 69211 records to 48245 (keeping 200 days of data) [2025-09-23T21:01:03.410631] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-23T21:01:03.441238] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T21:01:03.535324] [DEBUG] [LOCAL ] RLJ: Primary data saved (48245 records). [2025-09-23T21:01:03.535515] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-23T21:01:03.535620] [INFO ] [MAIN ] Update Progress: 1814/2372 symbols completed. RLJ took 34.0s. Estimated remaining: 1h 14m 8s. Rate: 7.5 symbols/min [2025-09-23T21:01:03.719255] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:03.741435] [DEBUG] [LOCAL ] RMAX: Loaded 21874 existing records from primary storage. [2025-09-23T21:01:03.741591] [INFO ] [MAIN ] RMAX: Loaded 21874 existing records. [2025-09-23T21:01:03.931432] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:03.931744] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-23T21:01:03.931803] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-23T21:01:03.932406] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-23T21:01:03.932468] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-23T21:01:04.207547] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-23T21:01:04.308882] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:05.002170] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-23T21:01:05.061429] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T21:01:05.123972] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T21:01:05.802170] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-23T21:01:05.884033] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T21:01:06.602179] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-23T21:01:06.681953] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T21:01:07.402171] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-23T21:01:07.623617] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T21:01:08.000099] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T21:01:08.202229] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-23T21:01:09.002212] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-23T21:01:09.051393] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T21:01:09.596710] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T21:01:09.802218] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-23T21:01:10.602201] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-23T21:01:11.402229] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-23T21:01:11.503573] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T21:01:11.610770] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T21:01:12.114720] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T21:01:12.202203] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-23T21:01:13.002208] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-23T21:01:13.802252] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-23T21:01:13.891980] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T21:01:13.892331] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T21:01:14.434036] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T21:01:14.602246] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-23T21:01:15.402302] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-23T21:01:15.941384] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T21:01:15.945091] [INFO ] [REMOTE ] RLTY: Full fetch complete (18176 records). [2025-09-23T21:01:15.945218] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-23T21:01:16.207322] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-23T21:01:16.352955] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-23T21:01:16.353335] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-23T21:01:16.354048] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-23T21:01:16.354225] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-23T21:01:16.401028] [DEBUG] [LOCAL ] RLTY: Trimmed 18176 records to 11117 (keeping 200 days of data) [2025-09-23T21:01:16.404878] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T21:01:16.498618] [DEBUG] [LOCAL ] RLTY: Primary data saved (11117 records). [2025-09-23T21:01:16.498826] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-23T21:01:16.498943] [INFO ] [MAIN ] Update Progress: 1815/2372 symbols completed. RLTY took 23.2s. Estimated remaining: 1h 14m 2s. Rate: 7.5 symbols/min [2025-09-23T21:01:16.680621] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:16.734058] [DEBUG] [LOCAL ] RMD: Loaded 42401 existing records from primary storage. [2025-09-23T21:01:16.734256] [INFO ] [MAIN ] RMD: Loaded 42401 existing records. [2025-09-23T21:01:16.918865] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:16.919201] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-23T21:01:16.919257] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-23T21:01:16.920636] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-23T21:01:16.920730] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-23T21:01:17.011786] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-23T21:01:17.055724] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T21:01:17.350969] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:17.802231] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-23T21:01:18.498950] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T21:01:18.602202] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-23T21:01:18.771763] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T21:01:19.402296] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-23T21:01:19.987307] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T21:01:20.202214] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-23T21:01:20.288353] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T21:01:21.002208] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-23T21:01:21.802173] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-23T21:01:21.943297] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T21:01:22.602239] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-23T21:01:22.808595] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T21:01:22.823062] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T21:01:23.402210] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-23T21:01:24.202246] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-23T21:01:24.232990] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T21:01:24.286603] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T21:01:25.002244] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-23T21:01:25.802223] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-23T21:01:25.852676] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T21:01:26.354921] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T21:01:26.363595] [INFO ] [REMOTE ] RLX: Full fetch complete (70331 records). [2025-09-23T21:01:26.363765] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-23T21:01:26.607355] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-23T21:01:26.787695] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T21:01:26.815445] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-23T21:01:26.816019] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-23T21:01:26.817180] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-23T21:01:26.817270] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-23T21:01:26.818781] [DEBUG] [LOCAL ] RLX: Trimmed 70331 records to 48163 (keeping 200 days of data) [2025-09-23T21:01:27.108702] [DEBUG] [LOCAL ] RLX: Primary data saved (48163 records). [2025-09-23T21:01:27.108874] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-23T21:01:27.108982] [INFO ] [MAIN ] Update Progress: 1816/2372 symbols completed. RLX took 31.4s. Estimated remaining: 1h 13m 54s. Rate: 7.5 symbols/min [2025-09-23T21:01:27.286624] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:27.294056] [DEBUG] [LOCAL ] RMI: Loaded 4662 existing records from primary storage. [2025-09-23T21:01:27.294160] [INFO ] [MAIN ] RMI: Loaded 4662 existing records. [2025-09-23T21:01:27.407371] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-23T21:01:27.493573] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:27.493867] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-23T21:01:27.493916] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-23T21:01:27.494242] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-23T21:01:27.494303] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-23T21:01:27.861403] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:28.145736] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T21:01:28.148313] [INFO ] [REMOTE ] RM: Full fetch complete (11568 records). [2025-09-23T21:01:28.148406] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-23T21:01:28.207278] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-23T21:01:28.541680] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-23T21:01:28.541929] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-23T21:01:28.542354] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-23T21:01:28.542438] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-23T21:01:28.543209] [DEBUG] [LOCAL ] RM: Trimmed 11568 records to 7685 (keeping 200 days of data) [2025-09-23T21:01:28.614003] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T21:01:28.634961] [DEBUG] [LOCAL ] RM: Primary data saved (7685 records). [2025-09-23T21:01:28.635097] [INFO ] [MAIN ] RM: Full history saved. [2025-09-23T21:01:28.635185] [INFO ] [MAIN ] Update Progress: 1817/2372 symbols completed. RM took 28.2s. Estimated remaining: 1h 13m 45s. Rate: 7.5 symbols/min [2025-09-23T21:01:28.762003] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T21:01:28.819128] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:28.832869] [DEBUG] [LOCAL ] RMM: Loaded 10264 existing records from primary storage. [2025-09-23T21:01:28.832997] [INFO ] [MAIN ] RMM: Loaded 10264 existing records. [2025-09-23T21:01:29.006245] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-23T21:01:29.041487] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:29.041858] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-23T21:01:29.041911] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-23T21:01:29.042312] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-23T21:01:29.042376] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-23T21:01:29.433137] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:29.802201] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-23T21:01:30.602171] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-23T21:01:30.635191] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T21:01:30.963670] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T21:01:31.116242] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-23T21:01:31.402216] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-23T21:01:32.178703] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T21:01:32.202147] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-23T21:01:33.002173] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-23T21:01:33.024046] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T21:01:33.802195] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-23T21:01:34.602221] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-23T21:01:34.648513] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T21:01:34.912420] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-23T21:01:35.179330] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T21:01:35.402205] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-23T21:01:36.202162] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-23T21:01:36.587343] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T21:01:36.786728] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T21:01:37.002212] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-23T21:01:37.802214] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-23T21:01:38.144625] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T21:01:38.450942] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T21:01:38.602176] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-23T21:01:39.402236] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-23T21:01:39.664230] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T21:01:40.044135] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T21:01:40.202190] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-23T21:01:40.871122] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T21:01:41.002219] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-23T21:01:41.520084] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T21:01:41.802212] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-23T21:01:42.602178] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-23T21:01:42.755916] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T21:01:43.402225] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-23T21:01:43.963617] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T21:01:44.202172] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-23T21:01:44.667414] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T21:01:45.002215] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-23T21:01:45.602499] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T21:01:45.802171] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-23T21:01:45.876517] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T21:01:46.432565] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T21:01:46.602202] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-23T21:01:47.402246] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-23T21:01:47.936569] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T21:01:48.202289] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-23T21:01:48.228527] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T21:01:49.002196] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-23T21:01:49.694728] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T21:01:49.696531] [INFO ] [REMOTE ] RMI: Full fetch complete (6367 records). [2025-09-23T21:01:49.696615] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-23T21:01:49.807116] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-23T21:01:50.069004] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-23T21:01:50.069103] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-23T21:01:50.069376] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-23T21:01:50.069450] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-23T21:01:50.070099] [DEBUG] [LOCAL ] RMI: Trimmed 6367 records to 4682 (keeping 200 days of data) [2025-09-23T21:01:50.117434] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T21:01:50.134421] [DEBUG] [LOCAL ] RMI: Primary data saved (4682 records). [2025-09-23T21:01:50.134526] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-23T21:01:50.134622] [INFO ] [MAIN ] Update Progress: 1818/2372 symbols completed. RMI took 23.0s. Estimated remaining: 1h 13m 41s. Rate: 7.5 symbols/min [2025-09-23T21:01:50.302279] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:50.308693] [DEBUG] [LOCAL ] RMMZ: Loaded 4827 existing records from primary storage. [2025-09-23T21:01:50.308785] [INFO ] [MAIN ] RMMZ: Loaded 4827 existing records. [2025-09-23T21:01:50.484660] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:50.484952] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-23T21:01:50.485016] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-23T21:01:50.485325] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-23T21:01:50.485424] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-23T21:01:50.607257] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-23T21:01:50.855096] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:50.864348] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T21:01:51.402203] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-23T21:01:52.202187] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-23T21:01:52.344804] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T21:01:52.352464] [INFO ] [REMOTE ] RMD: Full fetch complete (60925 records). [2025-09-23T21:01:52.352616] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-23T21:01:52.672228] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T21:01:52.701372] [INFO ] [REMOTE ] RMAX: Full fetch complete (29707 records). [2025-09-23T21:01:52.712925] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-23T21:01:52.914535] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-23T21:01:52.923757] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-23T21:01:52.928894] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-23T21:01:52.929488] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-23T21:01:52.986552] [DEBUG] [LOCAL ] RMD: Trimmed 60925 records to 42314 (keeping 200 days of data) [2025-09-23T21:01:53.018056] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-23T21:01:53.228469] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T21:01:53.374772] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-23T21:01:53.375676] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-23T21:01:53.377166] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-23T21:01:53.377250] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-23T21:01:53.388020] [DEBUG] [LOCAL ] RMAX: Trimmed 29707 records to 21919 (keeping 200 days of data) [2025-09-23T21:01:53.676342] [DEBUG] [LOCAL ] RMAX: Primary data saved (21919 records). [2025-09-23T21:01:53.678228] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-23T21:01:53.679349] [INFO ] [MAIN ] Update Progress: 1819/2372 symbols completed. RMAX took 50.1s. Estimated remaining: 1h 13m 31s. Rate: 7.5 symbols/min [2025-09-23T21:01:53.679475] [DEBUG] [LOCAL ] RMD: Primary data saved (42314 records). [2025-09-23T21:01:53.746311] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-23T21:01:53.777623] [INFO ] [MAIN ] Update Progress: 1820/2372 symbols completed. RMD took 37.3s. Estimated remaining: 1h 13m 21s. Rate: 7.5 symbols/min [2025-09-23T21:01:53.811318] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-23T21:01:53.971581] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:54.054463] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T21:01:54.057459] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:54.085743] [DEBUG] [LOCAL ] RMT: Loaded 17603 existing records from primary storage. [2025-09-23T21:01:54.086017] [INFO ] [MAIN ] RMT: Loaded 17603 existing records. [2025-09-23T21:01:54.304975] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:54.306768] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-23T21:01:54.306897] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-23T21:01:54.307954] [DEBUG] [LOCAL ] RNG: Loaded 48169 existing records from primary storage. [2025-09-23T21:01:54.308177] [INFO ] [MAIN ] RNG: Loaded 48169 existing records. [2025-09-23T21:01:54.340748] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-23T21:01:54.373013] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-23T21:01:54.622929] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-23T21:01:54.708691] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:54.749704] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-23T21:01:54.763936] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-23T21:01:54.778209] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T21:01:54.793719] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-23T21:01:54.805605] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-23T21:01:55.063190] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:55.325996] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:55.402183] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-23T21:01:55.618905] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T21:01:55.622700] [INFO ] [REMOTE ] RMM: Full fetch complete (14844 records). [2025-09-23T21:01:55.622781] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-23T21:01:56.027898] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-23T21:01:56.027975] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-23T21:01:56.028389] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-23T21:01:56.028495] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-23T21:01:56.029065] [DEBUG] [LOCAL ] RMM: Trimmed 14844 records to 10370 (keeping 200 days of data) [2025-09-23T21:01:56.102350] [DEBUG] [LOCAL ] RMM: Primary data saved (10370 records). [2025-09-23T21:01:56.102479] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-23T21:01:56.102612] [INFO ] [MAIN ] Update Progress: 1821/2372 symbols completed. RMM took 27.5s. Estimated remaining: 1h 13m 11s. Rate: 7.5 symbols/min [2025-09-23T21:01:56.211850] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-23T21:01:56.296943] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:01:56.323019] [DEBUG] [LOCAL ] RNGR: Loaded 20420 existing records from primary storage. [2025-09-23T21:01:56.323171] [INFO ] [MAIN ] RNGR: Loaded 20420 existing records. [2025-09-23T21:01:56.511515] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:01:56.511936] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-23T21:01:56.512010] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-23T21:01:56.512614] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-23T21:01:56.512731] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-23T21:01:56.738618] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T21:01:56.899951] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:01:57.007080] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-23T21:01:57.019966] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T21:01:57.802205] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-23T21:01:58.529705] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T21:01:58.602162] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-23T21:01:59.402242] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-23T21:02:00.085409] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T21:02:00.153769] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T21:02:00.202234] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-23T21:02:00.734747] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-09-23T21:02:01.002196] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-23T21:02:01.159127] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T21:02:01.802182] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-23T21:02:02.181435] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T21:02:02.602241] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-23T21:02:03.259153] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T21:02:03.362827] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T21:02:03.402200] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-23T21:02:04.202239] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-23T21:02:05.002202] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-23T21:02:05.056592] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T21:02:05.104512] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T21:02:05.445468] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-23T21:02:05.802217] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-23T21:02:06.428029] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T21:02:06.602236] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-23T21:02:07.402231] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-23T21:02:07.836359] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T21:02:08.074863] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T21:02:08.202230] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-23T21:02:09.002204] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-23T21:02:09.673609] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T21:02:09.802219] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-23T21:02:09.968941] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T21:02:10.602180] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-23T21:02:10.919007] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T21:02:11.402202] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-23T21:02:11.758159] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T21:02:12.202213] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-23T21:02:12.588146] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T21:02:13.002294] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-23T21:02:13.724014] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T21:02:13.802203] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-23T21:02:14.363859] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T21:02:14.365149] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7203 records). [2025-09-23T21:02:14.365254] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-23T21:02:14.612273] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-23T21:02:14.798249] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-23T21:02:14.798334] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-23T21:02:14.798561] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-23T21:02:14.798631] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-23T21:02:14.799661] [DEBUG] [LOCAL ] RMMZ: Trimmed 7203 records to 4843 (keeping 200 days of data) [2025-09-23T21:02:14.831762] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4843 records). [2025-09-23T21:02:14.831904] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-23T21:02:14.832073] [INFO ] [MAIN ] Update Progress: 1822/2372 symbols completed. RMMZ took 24.7s. Estimated remaining: 1h 13m 7s. Rate: 7.5 symbols/min [2025-09-23T21:02:15.010417] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:02:15.035589] [DEBUG] [LOCAL ] RNP: Loaded 15794 existing records from primary storage. [2025-09-23T21:02:15.035860] [INFO ] [MAIN ] RNP: Loaded 15794 existing records. [2025-09-23T21:02:15.254556] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T21:02:15.260860] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:02:15.267469] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-23T21:02:15.268268] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-23T21:02:15.269014] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-23T21:02:15.269115] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-23T21:02:15.407324] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-23T21:02:15.691551] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:02:15.857147] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T21:02:16.202229] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-23T21:02:17.002190] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-23T21:02:17.175852] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:02:17.221274] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T21:02:17.802198] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-23T21:02:18.165472] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T21:02:18.602240] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-23T21:02:18.881072] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T21:02:19.402247] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-23T21:02:20.205096] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-23T21:02:20.218914] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T21:02:20.233734] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T21:02:21.002263] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-23T21:02:21.276937] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T21:02:21.802522] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-23T21:02:22.588553] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T21:02:22.602151] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-23T21:02:23.154036] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T21:02:23.402246] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-23T21:02:24.202201] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-23T21:02:24.351416] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T21:02:24.370815] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T21:02:24.374981] [INFO ] [REMOTE ] RMT: Full fetch complete (25548 records). [2025-09-23T21:02:24.375069] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-23T21:02:24.761028] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-23T21:02:24.761110] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-23T21:02:24.761739] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-23T21:02:24.761802] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-23T21:02:24.762463] [DEBUG] [LOCAL ] RMT: Trimmed 25548 records to 17581 (keeping 200 days of data) [2025-09-23T21:02:24.877730] [DEBUG] [LOCAL ] RMT: Primary data saved (17581 records). [2025-09-23T21:02:24.877878] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-23T21:02:24.877998] [INFO ] [MAIN ] Update Progress: 1823/2372 symbols completed. RMT took 31.2s. Estimated remaining: 1h 12m 59s. Rate: 7.5 symbols/min [2025-09-23T21:02:25.012420] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-23T21:02:25.082173] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:02:25.084335] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T21:02:25.088544] [INFO ] [REMOTE ] RNGR: Full fetch complete (28457 records). [2025-09-23T21:02:25.088706] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-23T21:02:25.419481] [DEBUG] [LOCAL ] RNR: Loaded 34514 existing records from primary storage. [2025-09-23T21:02:25.425350] [INFO ] [MAIN ] RNR: Loaded 34514 existing records. [2025-09-23T21:02:25.671434] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-23T21:02:25.698422] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-23T21:02:25.706300] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-23T21:02:25.706509] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-23T21:02:25.706427] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:02:25.707038] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-23T21:02:25.707246] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-23T21:02:25.708098] [DEBUG] [LOCAL ] RNGR: Trimmed 28457 records to 20429 (keeping 200 days of data) [2025-09-23T21:02:25.708686] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-23T21:02:25.708777] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-23T21:02:25.875608] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-23T21:02:26.157922] [DEBUG] [LOCAL ] RNGR: Primary data saved (20429 records). [2025-09-23T21:02:26.170917] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-23T21:02:26.189405] [INFO ] [MAIN ] Update Progress: 1824/2372 symbols completed. RNGR took 30.1s. Estimated remaining: 1h 12m 49s. Rate: 7.5 symbols/min [2025-09-23T21:02:26.504934] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:02:26.447092] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T21:02:26.573422] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:02:26.611793] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-23T21:02:26.614534] [DEBUG] [LOCAL ] RNST: Loaded 37229 existing records from primary storage. [2025-09-23T21:02:26.614620] [INFO ] [MAIN ] RNST: Loaded 37229 existing records. [2025-09-23T21:02:26.812350] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:02:26.812745] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-23T21:02:26.812804] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-23T21:02:26.813824] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-23T21:02:26.813886] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-23T21:02:27.193164] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:02:27.402219] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-23T21:02:27.726085] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T21:02:27.795032] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T21:02:28.202212] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-23T21:02:29.002215] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-23T21:02:29.035917] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T21:02:29.234693] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T21:02:29.802210] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-23T21:02:30.220635] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T21:02:30.234182] [INFO ] [REMOTE ] RNG: Full fetch complete (69519 records). [2025-09-23T21:02:30.234405] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-23T21:02:30.603742] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-23T21:02:30.645898] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-23T21:02:30.646110] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-23T21:02:30.647295] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-23T21:02:30.647470] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-23T21:02:30.661191] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-23T21:02:30.660198] [DEBUG] [LOCAL ] RNG: Trimmed 69519 records to 48166 (keeping 200 days of data) [2025-09-23T21:02:30.971152] [DEBUG] [LOCAL ] RNG: Primary data saved (48166 records). [2025-09-23T21:02:30.971577] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-23T21:02:30.971717] [INFO ] [MAIN ] Update Progress: 1825/2372 symbols completed. RNG took 37.2s. Estimated remaining: 1h 12m 40s. Rate: 7.5 symbols/min [2025-09-23T21:02:31.156600] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:02:31.182185] [DEBUG] [LOCAL ] ROG: Loaded 23190 existing records from primary storage. [2025-09-23T21:02:31.182334] [INFO ] [MAIN ] ROG: Loaded 23190 existing records. [2025-09-23T21:02:31.370323] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:02:31.370629] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-23T21:02:31.370713] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-23T21:02:31.371797] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-23T21:02:31.371860] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-23T21:02:31.407486] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-23T21:02:31.758160] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:02:32.042258] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T21:02:32.202200] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-23T21:02:32.536437] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T21:02:33.002240] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-23T21:02:33.802241] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-23T21:02:33.872940] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T21:02:34.009060] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T21:02:34.602218] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-23T21:02:35.272142] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T21:02:35.402196] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-23T21:02:35.693599] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T21:02:36.202277] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-23T21:02:37.002251] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-23T21:02:37.037818] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T21:02:37.740689] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T21:02:37.802181] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-23T21:02:38.064689] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T21:02:38.602259] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-23T21:02:39.355972] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T21:02:39.402196] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-23T21:02:40.202197] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-23T21:02:40.373770] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T21:02:40.552389] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T21:02:41.002436] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-23T21:02:41.802440] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-23T21:02:41.808302] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T21:02:42.602169] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-23T21:02:42.738612] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T21:02:42.763056] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T21:02:42.765865] [INFO ] [REMOTE ] RNP: Full fetch complete (23405 records). [2025-09-23T21:02:42.766018] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-23T21:02:43.140492] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-23T21:02:43.140571] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-23T21:02:43.141172] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-23T21:02:43.141238] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-23T21:02:43.141993] [DEBUG] [LOCAL ] RNP: Trimmed 23405 records to 15782 (keeping 200 days of data) [2025-09-23T21:02:43.256336] [DEBUG] [LOCAL ] RNP: Primary data saved (15782 records). [2025-09-23T21:02:43.256480] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-23T21:02:43.256594] [INFO ] [MAIN ] Update Progress: 1826/2372 symbols completed. RNP took 28.4s. Estimated remaining: 1h 12m 34s. Rate: 7.5 symbols/min [2025-09-23T21:02:43.405047] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-23T21:02:43.462584] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:02:43.522121] [DEBUG] [LOCAL ] ROK: Loaded 43991 existing records from primary storage. [2025-09-23T21:02:43.522291] [INFO ] [MAIN ] ROK: Loaded 43991 existing records. [2025-09-23T21:02:43.737168] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:02:43.738246] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T21:02:43.742491] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-23T21:02:43.742551] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-23T21:02:43.743669] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-23T21:02:43.743734] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-23T21:02:44.149224] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:02:44.202169] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-23T21:02:44.977409] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T21:02:45.002172] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-23T21:02:45.802167] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-23T21:02:45.902537] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T21:02:46.452166] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T21:02:46.602178] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-23T21:02:46.908136] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T21:02:47.402217] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-23T21:02:48.049515] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T21:02:48.202190] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-23T21:02:48.940614] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T21:02:49.002253] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-23T21:02:49.741238] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T21:02:49.802168] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-23T21:02:50.602186] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-23T21:02:50.669535] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T21:02:50.875208] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T21:02:51.402216] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-23T21:02:52.121042] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T21:02:52.202253] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-23T21:02:52.550866] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T21:02:53.002192] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-23T21:02:53.802164] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-23T21:02:54.001859] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T21:02:54.473993] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T21:02:54.602229] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-23T21:02:55.214100] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T21:02:55.402219] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-23T21:02:56.202239] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-23T21:02:56.436059] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T21:02:56.526860] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T21:02:57.002243] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-23T21:02:57.598375] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T21:02:57.604439] [INFO ] [REMOTE ] RNST: Full fetch complete (52807 records). [2025-09-23T21:02:57.604552] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-23T21:02:57.810740] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-23T21:02:58.007552] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-23T21:02:58.007679] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-23T21:02:58.008764] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-23T21:02:58.008959] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-23T21:02:58.010442] [DEBUG] [LOCAL ] RNST: Trimmed 52807 records to 37214 (keeping 200 days of data) [2025-09-23T21:02:58.248390] [DEBUG] [LOCAL ] RNST: Primary data saved (37214 records). [2025-09-23T21:02:58.248524] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-23T21:02:58.248607] [INFO ] [MAIN ] Update Progress: 1827/2372 symbols completed. RNST took 32.1s. Estimated remaining: 1h 12m 28s. Rate: 7.5 symbols/min [2025-09-23T21:02:58.357087] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T21:02:58.442395] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:02:58.494563] [DEBUG] [LOCAL ] ROL: Loaded 50278 existing records from primary storage. [2025-09-23T21:02:58.494741] [INFO ] [MAIN ] ROL: Loaded 50278 existing records. [2025-09-23T21:02:58.607324] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-23T21:02:58.678278] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:02:58.678506] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-23T21:02:58.678562] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-23T21:02:58.679689] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-23T21:02:58.679751] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-23T21:02:59.048835] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:02:59.402164] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-23T21:02:59.799747] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-23T21:02:59.950251] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T21:02:59.956599] [INFO ] [REMOTE ] RNR: Full fetch complete (51307 records). [2025-09-23T21:02:59.956954] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-23T21:03:00.207442] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-23T21:03:00.374748] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-23T21:03:00.374875] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-23T21:03:00.376194] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-23T21:03:00.376326] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-23T21:03:00.377844] [DEBUG] [LOCAL ] RNR: Trimmed 51307 records to 34369 (keeping 200 days of data) [2025-09-23T21:03:00.499051] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T21:03:00.621818] [DEBUG] [LOCAL ] RNR: Primary data saved (34369 records). [2025-09-23T21:03:00.622001] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-23T21:03:00.623584] [INFO ] [MAIN ] Update Progress: 1828/2372 symbols completed. RNR took 35.7s. Estimated remaining: 1h 12m 18s. Rate: 7.5 symbols/min [2025-09-23T21:03:00.793893] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:03:00.840251] [DEBUG] [LOCAL ] RPM: Loaded 41138 existing records from primary storage. [2025-09-23T21:03:00.840396] [INFO ] [MAIN ] RPM: Loaded 41138 existing records. [2025-09-23T21:03:01.015861] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-23T21:03:01.022071] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:03:01.023288] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-23T21:03:01.023339] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-23T21:03:01.024367] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-23T21:03:01.024432] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-23T21:03:01.392549] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:03:01.802246] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-23T21:03:02.468461] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-23T21:03:02.593316] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T21:03:02.602152] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-23T21:03:03.402208] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-23T21:03:04.202229] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-23T21:03:04.680893] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-09-23T21:03:04.945405] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-23T21:03:05.002184] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-23T21:03:05.802218] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-23T21:03:05.861199] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-23T21:03:05.961145] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T21:03:06.090751] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T21:03:06.094457] [INFO ] [REMOTE ] ROG: Full fetch complete (30611 records). [2025-09-23T21:03:06.094580] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-23T21:03:06.486023] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-23T21:03:06.486140] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-23T21:03:06.487110] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-23T21:03:06.487180] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-23T21:03:06.488414] [DEBUG] [LOCAL ] ROG: Trimmed 30611 records to 23161 (keeping 200 days of data) [2025-09-23T21:03:06.608131] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-23T21:03:06.637366] [DEBUG] [LOCAL ] ROG: Primary data saved (23161 records). [2025-09-23T21:03:06.637578] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-23T21:03:06.637817] [INFO ] [MAIN ] Update Progress: 1829/2372 symbols completed. ROG took 35.7s. Estimated remaining: 1h 12m 10s. Rate: 7.5 symbols/min [2025-09-23T21:03:06.818151] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:03:06.840169] [DEBUG] [LOCAL ] RPT: Loaded 19586 existing records from primary storage. [2025-09-23T21:03:06.840419] [INFO ] [MAIN ] RPT: Loaded 19586 existing records. [2025-09-23T21:03:07.023315] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:03:07.023755] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-23T21:03:07.023815] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-23T21:03:07.024447] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-23T21:03:07.024510] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-23T21:03:07.402247] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:03:07.402434] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-23T21:03:07.460208] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T21:03:08.202300] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-23T21:03:08.371339] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T21:03:08.758413] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T21:03:09.002232] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-23T21:03:09.276116] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T21:03:09.802241] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-23T21:03:10.518942] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T21:03:10.602194] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-23T21:03:10.885491] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T21:03:11.402203] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-23T21:03:12.152985] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T21:03:12.202209] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-23T21:03:13.002160] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-23T21:03:13.110823] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T21:03:13.802231] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-23T21:03:14.201770] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T21:03:14.602223] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-23T21:03:15.402217] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-23T21:03:15.450004] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-23T21:03:15.887024] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T21:03:15.897785] [INFO ] [REMOTE ] ROK: Full fetch complete (63458 records). [2025-09-23T21:03:15.897977] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-23T21:03:16.203054] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-23T21:03:16.316454] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T21:03:16.316023] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-23T21:03:16.320756] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-23T21:03:16.322284] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-23T21:03:16.322690] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-23T21:03:16.324210] [DEBUG] [LOCAL ] ROK: Trimmed 63458 records to 44010 (keeping 200 days of data) [2025-09-23T21:03:16.611271] [DEBUG] [LOCAL ] ROK: Primary data saved (44010 records). [2025-09-23T21:03:16.611410] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-23T21:03:16.611498] [INFO ] [MAIN ] Update Progress: 1830/2372 symbols completed. ROK took 33.4s. Estimated remaining: 1h 12m 2s. Rate: 7.5 symbols/min [2025-09-23T21:03:16.783446] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:03:16.813787] [DEBUG] [LOCAL ] RQI: Loaded 29114 existing records from primary storage. [2025-09-23T21:03:16.813952] [INFO ] [MAIN ] RQI: Loaded 29114 existing records. [2025-09-23T21:03:16.994963] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:03:16.995330] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-23T21:03:16.995426] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-23T21:03:16.996335] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-23T21:03:16.996399] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-23T21:03:17.026635] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-23T21:03:17.359407] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:03:17.390729] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T21:03:17.620292] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T21:03:17.802192] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-23T21:03:18.230137] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T21:03:18.602193] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-23T21:03:19.280918] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T21:03:19.404631] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-23T21:03:19.406884] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T21:03:20.202252] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-23T21:03:21.002233] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-23T21:03:21.200939] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T21:03:21.802216] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-23T21:03:21.859370] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T21:03:22.457890] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T21:03:22.602154] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-23T21:03:22.833498] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T21:03:23.402249] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-23T21:03:23.885800] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T21:03:24.202198] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-23T21:03:24.317831] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T21:03:25.002308] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-23T21:03:25.545823] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T21:03:25.802200] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-23T21:03:26.602295] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-23T21:03:27.092313] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T21:03:27.264021] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-23T21:03:27.402324] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-23T21:03:28.202194] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-23T21:03:28.319134] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T21:03:29.002219] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-23T21:03:29.288159] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T21:03:29.380169] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T21:03:29.768978] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T21:03:29.802178] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-23T21:03:30.602239] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-23T21:03:30.758536] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T21:03:30.761890] [INFO ] [REMOTE ] RPT: Full fetch complete (28734 records). [2025-09-23T21:03:30.761979] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-23T21:03:31.144101] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-23T21:03:31.144175] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-23T21:03:31.144815] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-23T21:03:31.144875] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-23T21:03:31.145603] [DEBUG] [LOCAL ] RPT: Trimmed 28734 records to 19669 (keeping 200 days of data) [2025-09-23T21:03:31.263232] [DEBUG] [LOCAL ] RPT: Primary data saved (19669 records). [2025-09-23T21:03:31.263409] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-23T21:03:31.263515] [INFO ] [MAIN ] Update Progress: 1831/2372 symbols completed. RPT took 24.6s. Estimated remaining: 1h 11m 56s. Rate: 7.5 symbols/min [2025-09-23T21:03:31.407508] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-23T21:03:31.440638] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:03:31.495407] [DEBUG] [LOCAL ] RRC: Loaded 52775 existing records from primary storage. [2025-09-23T21:03:31.495579] [INFO ] [MAIN ] RRC: Loaded 52775 existing records. [2025-09-23T21:03:31.680836] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:03:31.681079] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-23T21:03:31.681127] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-23T21:03:31.682336] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-23T21:03:31.682399] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-23T21:03:32.042421] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T21:03:32.085165] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:03:32.202202] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-23T21:03:33.002300] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-23T21:03:33.244086] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T21:03:33.802213] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-23T21:03:34.018535] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T21:03:34.602236] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-23T21:03:34.648740] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T21:03:35.144717] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T21:03:35.153074] [INFO ] [REMOTE ] ROL: Full fetch complete (72575 records). [2025-09-23T21:03:35.153205] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-23T21:03:35.407336] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-23T21:03:35.550513] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-23T21:03:35.550594] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-23T21:03:35.551612] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-23T21:03:35.551697] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-23T21:03:35.553091] [DEBUG] [LOCAL ] ROL: Trimmed 72575 records to 50275 (keeping 200 days of data) [2025-09-23T21:03:35.700014] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T21:03:35.894078] [DEBUG] [LOCAL ] ROL: Primary data saved (50275 records). [2025-09-23T21:03:35.894219] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-23T21:03:35.894308] [INFO ] [MAIN ] Update Progress: 1832/2372 symbols completed. ROL took 37.6s. Estimated remaining: 1h 11m 47s. Rate: 7.5 symbols/min [2025-09-23T21:03:36.068404] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:03:36.116872] [DEBUG] [LOCAL ] RRX: Loaded 41123 existing records from primary storage. [2025-09-23T21:03:36.117067] [INFO ] [MAIN ] RRX: Loaded 41123 existing records. [2025-09-23T21:03:36.207322] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-23T21:03:36.296800] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:03:36.297040] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-23T21:03:36.297088] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-23T21:03:36.298111] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-23T21:03:36.298172] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-23T21:03:36.671513] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:03:37.002207] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-23T21:03:37.362678] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-23T21:03:37.464333] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T21:03:37.802200] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-23T21:03:38.534876] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T21:03:38.602149] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-23T21:03:39.155099] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T21:03:39.402208] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-23T21:03:40.169075] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T21:03:40.202152] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-23T21:03:40.714796] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T21:03:40.721127] [INFO ] [REMOTE ] RPM: Full fetch complete (58650 records). [2025-09-23T21:03:40.721245] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-23T21:03:41.011344] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-23T21:03:41.138905] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-23T21:03:41.138993] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-23T21:03:41.140028] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-23T21:03:41.140092] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-23T21:03:41.141366] [DEBUG] [LOCAL ] RPM: Trimmed 58650 records to 41108 (keeping 200 days of data) [2025-09-23T21:03:41.407298] [DEBUG] [LOCAL ] RPM: Primary data saved (41108 records). [2025-09-23T21:03:41.407446] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-23T21:03:41.408380] [INFO ] [MAIN ] Update Progress: 1833/2372 symbols completed. RPM took 40.8s. Estimated remaining: 1h 11m 39s. Rate: 7.5 symbols/min [2025-09-23T21:03:41.592622] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:03:41.620902] [DEBUG] [LOCAL ] RS: Loaded 25645 existing records from primary storage. [2025-09-23T21:03:41.621040] [INFO ] [MAIN ] RS: Loaded 25645 existing records. [2025-09-23T21:03:41.802244] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-23T21:03:41.807691] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:03:41.809370] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-23T21:03:41.809480] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-23T21:03:41.822207] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-23T21:03:41.836892] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-23T21:03:41.873366] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T21:03:42.206489] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:03:42.415879] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T21:03:42.424518] [INFO ] [REMOTE ] RQI: Full fetch complete (43167 records). [2025-09-23T21:03:42.424768] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-23T21:03:42.603200] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-23T21:03:42.803941] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-23T21:03:42.804045] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-23T21:03:42.804857] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-23T21:03:42.804921] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-23T21:03:42.806095] [DEBUG] [LOCAL ] RQI: Trimmed 43167 records to 29075 (keeping 200 days of data) [2025-09-23T21:03:42.983504] [DEBUG] [LOCAL ] RQI: Primary data saved (29075 records). [2025-09-23T21:03:42.983680] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-23T21:03:42.983787] [INFO ] [MAIN ] Update Progress: 1834/2372 symbols completed. RQI took 26.4s. Estimated remaining: 1h 11m 29s. Rate: 7.5 symbols/min [2025-09-23T21:03:43.183261] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:03:43.190303] [DEBUG] [LOCAL ] RSF: Loaded 4117 existing records from primary storage. [2025-09-23T21:03:43.190416] [INFO ] [MAIN ] RSF: Loaded 4117 existing records. [2025-09-23T21:03:43.405589] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-23T21:03:43.405438] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:03:43.407423] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-23T21:03:43.407631] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-23T21:03:43.408116] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-23T21:03:43.408206] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-23T21:03:43.741985] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T21:03:43.826089] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:03:44.202196] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-23T21:03:44.290447] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T21:03:45.002166] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-23T21:03:45.152986] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T21:03:45.802208] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-23T21:03:46.175459] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T21:03:46.412961] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T21:03:46.602224] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-23T21:03:46.778120] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T21:03:47.270814] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T21:03:47.402211] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-23T21:03:48.202220] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-23T21:03:48.853089] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T21:03:49.002177] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-23T21:03:49.802181] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-23T21:03:50.110842] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T21:03:50.329197] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T21:03:50.465007] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T21:03:50.602157] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-23T21:03:51.402251] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-23T21:03:52.202234] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-23T21:03:52.356429] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T21:03:52.802490] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T21:03:52.862050] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T21:03:53.002227] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-23T21:03:53.802210] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-23T21:03:54.602198] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-23T21:03:54.887477] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-23T21:03:55.232245] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T21:03:55.345129] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T21:03:55.402158] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-23T21:03:56.202227] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-23T21:03:57.007424] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-23T21:03:57.026858] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T21:03:57.740601] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T21:03:57.802166] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-23T21:03:58.079690] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T21:03:58.521544] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T21:03:58.602230] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-23T21:03:59.402201] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-23T21:04:00.202214] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-23T21:04:00.329753] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T21:04:01.002174] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-23T21:04:01.058521] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T21:04:01.074548] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T21:04:01.802317] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-23T21:04:02.207860] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T21:04:02.602247] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-23T21:04:03.367886] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T21:04:03.374829] [INFO ] [REMOTE ] RRX: Full fetch complete (57924 records). [2025-09-23T21:04:03.374959] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-23T21:04:03.408309] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-23T21:04:03.782824] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-23T21:04:03.782915] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-23T21:04:03.783928] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-23T21:04:03.783994] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-23T21:04:03.785294] [DEBUG] [LOCAL ] RRX: Trimmed 57924 records to 41114 (keeping 200 days of data) [2025-09-23T21:04:04.074822] [DEBUG] [LOCAL ] RRX: Primary data saved (41114 records). [2025-09-23T21:04:04.075016] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-23T21:04:04.075216] [INFO ] [MAIN ] Update Progress: 1835/2372 symbols completed. RRX took 28.2s. Estimated remaining: 1h 11m 25s. Rate: 7.5 symbols/min [2025-09-23T21:04:04.207299] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-23T21:04:04.253627] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:04.315491] [DEBUG] [LOCAL ] RSG: Loaded 47449 existing records from primary storage. [2025-09-23T21:04:04.315724] [INFO ] [MAIN ] RSG: Loaded 47449 existing records. [2025-09-23T21:04:04.511055] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:04:04.511478] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-23T21:04:04.511605] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-23T21:04:04.513572] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-23T21:04:04.513670] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-23T21:04:04.676401] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T21:04:04.670975] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-23T21:04:04.787718] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T21:04:04.980063] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:04:05.002278] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-23T21:04:05.802206] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-23T21:04:06.332180] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T21:04:06.334105] [INFO ] [REMOTE ] RSF: Full fetch complete (5590 records). [2025-09-23T21:04:06.334210] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-23T21:04:06.607302] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-23T21:04:06.713230] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-23T21:04:06.713335] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-23T21:04:06.713682] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-23T21:04:06.713779] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-23T21:04:06.714684] [DEBUG] [LOCAL ] RSF: Trimmed 5590 records to 4128 (keeping 200 days of data) [2025-09-23T21:04:06.744182] [DEBUG] [LOCAL ] RSF: Primary data saved (4128 records). [2025-09-23T21:04:06.744310] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-23T21:04:06.744446] [INFO ] [MAIN ] Update Progress: 1836/2372 symbols completed. RSF took 23.8s. Estimated remaining: 1h 11m 15s. Rate: 7.5 symbols/min [2025-09-23T21:04:06.957712] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:06.954406] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-23T21:04:06.968609] [INFO ] [REMOTE ] RRC: Full fetch complete (76261 records). [2025-09-23T21:04:06.968771] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-23T21:04:07.316928] [DEBUG] [LOCAL ] RSI: Loaded 47135 existing records from primary storage. [2025-09-23T21:04:07.332965] [INFO ] [MAIN ] RSI: Loaded 47135 existing records. [2025-09-23T21:04:07.408074] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-23T21:04:07.517128] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-23T21:04:07.531272] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-23T21:04:07.539007] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-23T21:04:07.545085] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-23T21:04:07.630103] [DEBUG] [LOCAL ] RRC: Trimmed 76261 records to 52776 (keeping 200 days of data) [2025-09-23T21:04:07.666395] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:04:07.667404] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-23T21:04:07.667545] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-23T21:04:07.669776] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-23T21:04:07.678477] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-23T21:04:07.838382] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T21:04:08.207763] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-23T21:04:08.358337] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:04:08.457261] [DEBUG] [LOCAL ] RRC: Primary data saved (52776 records). [2025-09-23T21:04:08.457490] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-23T21:04:08.457603] [INFO ] [MAIN ] Update Progress: 1837/2372 symbols completed. RRC took 37.2s. Estimated remaining: 1h 11m 5s. Rate: 7.5 symbols/min [2025-09-23T21:04:09.002312] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-23T21:04:09.193144] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T21:04:09.665412] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T21:04:09.802207] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-23T21:04:10.606348] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-23T21:04:10.610291] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T21:04:11.402176] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-23T21:04:11.576579] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T21:04:11.692575] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T21:04:12.202179] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-23T21:04:13.002170] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-23T21:04:13.134063] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T21:04:13.802163] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-23T21:04:13.854388] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T21:04:13.858904] [INFO ] [REMOTE ] RS: Full fetch complete (39451 records). [2025-09-23T21:04:13.859010] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-23T21:04:14.254988] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-23T21:04:14.277546] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-23T21:04:14.277766] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-23T21:04:14.278534] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-23T21:04:14.278607] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-23T21:04:14.280156] [DEBUG] [LOCAL ] RS: Trimmed 39451 records to 25564 (keeping 200 days of data) [2025-09-23T21:04:14.450563] [DEBUG] [LOCAL ] RS: Primary data saved (25564 records). [2025-09-23T21:04:14.450725] [INFO ] [MAIN ] RS: Full history saved. [2025-09-23T21:04:14.450878] [INFO ] [MAIN ] Update Progress: 1838/2372 symbols completed. RS took 33.0s. Estimated remaining: 1h 10m 57s. Rate: 7.5 symbols/min [2025-09-23T21:04:14.602221] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-23T21:04:15.306930] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T21:04:15.402158] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-23T21:04:16.365629] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T21:04:16.375522] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-23T21:04:17.275832] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T21:04:17.286632] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-23T21:04:18.347573] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T21:04:18.358187] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-23T21:04:18.963971] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T21:04:18.974087] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-23T21:04:20.183688] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T21:04:20.193716] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-23T21:04:20.285261] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T21:04:20.295160] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-23T21:04:21.842229] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T21:04:21.851869] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-23T21:04:21.942691] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T21:04:21.952697] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-23T21:04:23.659077] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T21:04:23.670320] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-23T21:04:23.795099] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T21:04:23.806139] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-23T21:04:25.404530] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T21:04:25.415108] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-23T21:04:25.511372] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T21:04:25.521301] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-23T21:04:27.085139] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T21:04:27.093860] [INFO ] [REMOTE ] RSI: Full fetch complete (69473 records). [2025-09-23T21:04:27.094021] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-23T21:04:27.418660] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T21:04:27.469855] [INFO ] [REMOTE ] RSG: Full fetch complete (67850 records). [2025-09-23T21:04:27.480429] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-23T21:04:27.665077] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-23T21:04:27.670309] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-23T21:04:27.671414] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-23T21:04:27.673908] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-23T21:04:27.728165] [DEBUG] [LOCAL ] RSI: Trimmed 69473 records to 47111 (keeping 200 days of data) [2025-09-23T21:04:28.081432] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-23T21:04:28.082689] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-23T21:04:28.084041] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-23T21:04:28.084141] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-23T21:04:28.096178] [DEBUG] [LOCAL ] RSG: Trimmed 67850 records to 47458 (keeping 200 days of data) [2025-09-23T21:04:28.522723] [DEBUG] [LOCAL ] RSI: Primary data saved (47111 records). [2025-09-23T21:04:28.524016] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-23T21:04:28.526807] [INFO ] [MAIN ] Update Progress: 1839/2372 symbols completed. RSI took 21.8s. Estimated remaining: 1h 10m 50s. Rate: 7.5 symbols/min [2025-09-23T21:04:28.571524] [DEBUG] [LOCAL ] RSG: Primary data saved (47458 records). [2025-09-23T21:04:28.571634] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-23T21:04:28.571793] [INFO ] [MAIN ] Update Progress: 1840/2372 symbols completed. RSG took 24.5s. Estimated remaining: 1h 10m 40s. Rate: 7.5 symbols/min [2025-09-23T21:04:29.201443] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:29.228959] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:29.253399] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:29.277603] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:29.345896] [DEBUG] [LOCAL ] RSKD: Loaded 34175 existing records from primary storage. [2025-09-23T21:04:29.346405] [INFO ] [MAIN ] RSKD: Loaded 34175 existing records. [2025-09-23T21:04:29.429042] [DEBUG] [LOCAL ] RTO: Loaded 40406 existing records from primary storage. [2025-09-23T21:04:29.449020] [INFO ] [MAIN ] RTO: Loaded 40406 existing records. [2025-09-23T21:04:29.462262] [DEBUG] [LOCAL ] RVLV: Loaded 47877 existing records from primary storage. [2025-09-23T21:04:29.481794] [INFO ] [MAIN ] RVLV: Loaded 47877 existing records. [2025-09-23T21:04:29.506718] [DEBUG] [LOCAL ] RTX: Loaded 53710 existing records from primary storage. [2025-09-23T21:04:29.627739] [INFO ] [MAIN ] RTX: Loaded 53710 existing records. [2025-09-23T21:04:30.003167] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:04:30.013485] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:04:30.054012] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-23T21:04:30.054129] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-23T21:04:30.110460] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-23T21:04:30.115717] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-23T21:04:30.127033] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-23T21:04:30.160778] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-23T21:04:30.160868] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:04:30.136771] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:04:30.156835] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-23T21:04:30.190995] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-23T21:04:30.172390] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-23T21:04:30.207055] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-23T21:04:30.230160] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-23T21:04:30.245666] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-23T21:04:30.301872] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-23T21:04:30.317451] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-23T21:04:30.344976] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-23T21:04:30.414699] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-23T21:04:31.482444] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:04:31.625890] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:04:31.622873] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-23T21:04:31.659537] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:04:31.656613] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-23T21:04:31.687028] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-23T21:04:31.691351] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:04:31.692162] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-23T21:04:33.039927] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T21:04:33.047098] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-23T21:04:33.383156] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T21:04:33.392624] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-23T21:04:33.435443] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T21:04:33.445085] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-23T21:04:34.246582] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-23T21:04:34.257366] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-23T21:04:34.335638] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T21:04:34.342341] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-23T21:04:34.574628] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T21:04:34.583337] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-23T21:04:34.958129] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T21:04:34.967325] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-23T21:04:35.278940] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T21:04:35.284969] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-23T21:04:36.022987] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T21:04:36.030952] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-23T21:04:36.061559] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T21:04:36.202142] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-23T21:04:36.593045] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T21:04:36.774349] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T21:04:37.002258] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-23T21:04:37.807104] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-23T21:04:37.809732] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T21:04:37.921681] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T21:04:37.967734] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T21:04:38.602194] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-23T21:04:39.256165] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T21:04:39.402204] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-23T21:04:40.202187] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-23T21:04:40.567678] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T21:04:41.001866] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T21:04:41.011491] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-23T21:04:41.802220] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-23T21:04:41.901451] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T21:04:42.349091] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T21:04:42.602193] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-23T21:04:43.402202] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-23T21:04:43.934240] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T21:04:44.202279] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-23T21:04:44.356816] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T21:04:44.473514] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T21:04:45.002197] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-23T21:04:45.802271] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-23T21:04:46.302220] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T21:04:46.411563] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T21:04:46.602201] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-23T21:04:46.832640] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T21:04:47.402244] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-23T21:04:48.202253] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-23T21:04:48.293233] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T21:04:49.002209] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-23T21:04:49.480512] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-23T21:04:49.802232] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-23T21:04:49.848718] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T21:04:50.305691] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T21:04:50.602330] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-23T21:04:51.402216] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-23T21:04:51.949230] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T21:04:52.070002] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T21:04:52.202219] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-23T21:04:52.975927] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T21:04:52.984691] [INFO ] [REMOTE ] RVLV: Full fetch complete (68836 records). [2025-09-23T21:04:52.984814] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-23T21:04:53.007360] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-23T21:04:53.436271] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-23T21:04:53.436400] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-23T21:04:53.437671] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-23T21:04:53.437754] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-23T21:04:53.440059] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T21:04:53.452976] [DEBUG] [LOCAL ] RVLV: Trimmed 68836 records to 47858 (keeping 200 days of data) [2025-09-23T21:04:53.744127] [DEBUG] [LOCAL ] RVLV: Primary data saved (47858 records). [2025-09-23T21:04:53.744300] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-23T21:04:53.744394] [INFO ] [MAIN ] Update Progress: 1841/2372 symbols completed. RVLV took 25.2s. Estimated remaining: 1h 10m 37s. Rate: 7.5 symbols/min [2025-09-23T21:04:53.813904] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-23T21:04:53.924998] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:53.954250] [DEBUG] [LOCAL ] RVT: Loaded 27209 existing records from primary storage. [2025-09-23T21:04:53.954421] [INFO ] [MAIN ] RVT: Loaded 27209 existing records. [2025-09-23T21:04:54.133272] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:04:54.133546] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-23T21:04:54.133594] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-23T21:04:54.134729] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-23T21:04:54.134789] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-23T21:04:54.496523] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:04:54.602171] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-23T21:04:54.771919] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T21:04:54.883520] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T21:04:55.402196] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-23T21:04:55.604202] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T21:04:56.202252] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-23T21:04:56.768567] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T21:04:56.775035] [INFO ] [REMOTE ] RSKD: Full fetch complete (48451 records). [2025-09-23T21:04:56.775237] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-23T21:04:57.010891] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-23T21:04:57.175683] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-23T21:04:57.175778] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-23T21:04:57.176614] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-23T21:04:57.176689] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-23T21:04:57.178529] [DEBUG] [LOCAL ] RSKD: Trimmed 48451 records to 34054 (keeping 200 days of data) [2025-09-23T21:04:57.375477] [DEBUG] [LOCAL ] RSKD: Primary data saved (34054 records). [2025-09-23T21:04:57.375633] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-23T21:04:57.375780] [INFO ] [MAIN ] Update Progress: 1842/2372 symbols completed. RSKD took 28.8s. Estimated remaining: 1h 10m 28s. Rate: 7.5 symbols/min [2025-09-23T21:04:57.556269] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:57.581222] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T21:04:57.633123] [DEBUG] [LOCAL ] RVTY: Loaded 47584 existing records from primary storage. [2025-09-23T21:04:57.633295] [INFO ] [MAIN ] RVTY: Loaded 47584 existing records. [2025-09-23T21:04:57.807510] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-23T21:04:57.812699] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:04:57.813686] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-23T21:04:57.813761] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-23T21:04:57.815078] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-23T21:04:57.815141] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-23T21:04:58.190555] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:04:58.208987] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T21:04:58.602194] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-23T21:04:59.031485] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T21:04:59.038036] [INFO ] [REMOTE ] RTO: Full fetch complete (58370 records). [2025-09-23T21:04:59.038143] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-23T21:04:59.407349] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-23T21:04:59.426787] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-23T21:04:59.426876] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-23T21:04:59.427855] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-23T21:04:59.427921] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-23T21:04:59.429342] [DEBUG] [LOCAL ] RTO: Trimmed 58370 records to 40294 (keeping 200 days of data) [2025-09-23T21:04:59.685294] [DEBUG] [LOCAL ] RTO: Primary data saved (40294 records). [2025-09-23T21:04:59.685478] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-23T21:04:59.685594] [INFO ] [MAIN ] Update Progress: 1843/2372 symbols completed. RTO took 31.1s. Estimated remaining: 1h 10m 18s. Rate: 7.5 symbols/min [2025-09-23T21:04:59.857509] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:04:59.903886] [DEBUG] [LOCAL ] RWT: Loaded 40595 existing records from primary storage. [2025-09-23T21:04:59.904119] [INFO ] [MAIN ] RWT: Loaded 40595 existing records. [2025-09-23T21:05:00.084925] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:05:00.085242] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-23T21:05:00.085295] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-23T21:05:00.086404] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-23T21:05:00.086469] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-23T21:05:00.203922] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-23T21:05:00.505323] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T21:05:00.537081] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:05:00.624192] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T21:05:01.002216] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-23T21:05:01.802245] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-23T21:05:02.365113] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-23T21:05:02.374936] [INFO ] [REMOTE ] RTX: Full fetch complete (77729 records). [2025-09-23T21:05:02.375083] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-23T21:05:02.555007] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T21:05:02.609689] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-23T21:05:02.818663] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-23T21:05:02.818799] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-23T21:05:02.819954] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-23T21:05:02.820022] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-23T21:05:02.821575] [DEBUG] [LOCAL ] RTX: Trimmed 77729 records to 53710 (keeping 200 days of data) [2025-09-23T21:05:03.176525] [DEBUG] [LOCAL ] RTX: Primary data saved (53710 records). [2025-09-23T21:05:03.176702] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-23T21:05:03.177791] [INFO ] [MAIN ] Update Progress: 1844/2372 symbols completed. RTX took 34.6s. Estimated remaining: 1h 10m 9s. Rate: 7.5 symbols/min [2025-09-23T21:05:03.362788] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:05:03.362981] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-23T21:05:03.363075] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-23T21:05:03.363198] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-23T21:05:03.363268] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-23T21:05:03.363366] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-23T21:05:03.363442] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-23T21:05:03.411713] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-23T21:05:03.752886] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T21:05:03.792765] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:05:04.021757] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T21:05:04.202216] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-23T21:05:04.853214] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T21:05:05.002327] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-23T21:05:05.807449] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-23T21:05:05.810524] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T21:05:06.266687] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-23T21:05:06.271638] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T21:05:06.602278] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-23T21:05:07.402198] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-23T21:05:07.811825] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T21:05:07.946849] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T21:05:08.202235] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-23T21:05:09.002249] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-23T21:05:09.483467] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T21:05:09.802202] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-23T21:05:09.851010] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T21:05:10.602245] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-23T21:05:11.179730] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T21:05:11.402233] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-23T21:05:12.202202] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-23T21:05:12.385472] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T21:05:12.719203] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T21:05:12.856205] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T21:05:13.002245] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-23T21:05:13.802250] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-23T21:05:14.454626] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T21:05:14.602227] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-23T21:05:15.161482] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-23T21:05:15.403439] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-23T21:05:15.403317] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T21:05:16.202208] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-23T21:05:16.707457] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T21:05:16.707334] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T21:05:17.002192] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-23T21:05:17.436670] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T21:05:17.802209] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-23T21:05:18.198888] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T21:05:18.602230] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-23T21:05:19.402200] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-23T21:05:20.007863] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T21:05:20.202235] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-23T21:05:20.385697] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T21:05:21.002221] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-23T21:05:21.537925] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T21:05:21.539178] [INFO ] [REMOTE ] RWTN: Full fetch complete (3168 records). [2025-09-23T21:05:21.539254] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-23T21:05:21.743129] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-23T21:05:21.743685] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:05:21.743757] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:05:21.743807] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-23T21:05:21.743869] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-23T21:05:21.743905] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-23T21:05:21.743959] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-23T21:05:21.744057] [INFO ] [MAIN ] Update Progress: 1845/2372 symbols completed. RWTN took 18.6s. Estimated remaining: 1h 10m 4s. Rate: 7.5 symbols/min [2025-09-23T21:05:21.803201] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-23T21:05:21.940113] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:05:21.940503] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-23T21:05:21.940564] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-23T21:05:21.940765] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-23T21:05:21.940815] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-23T21:05:21.940891] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-23T21:05:21.940937] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-23T21:05:22.291447] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-23T21:05:22.393900] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:05:22.602255] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-23T21:05:23.081480] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T21:05:23.087119] [INFO ] [REMOTE ] RVT: Full fetch complete (40123 records). [2025-09-23T21:05:23.087234] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-23T21:05:23.407425] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-23T21:05:23.493919] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-23T21:05:23.494110] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-23T21:05:23.495445] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-23T21:05:23.495527] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-23T21:05:23.497165] [DEBUG] [LOCAL ] RVT: Trimmed 40123 records to 27148 (keeping 200 days of data) [2025-09-23T21:05:23.694001] [DEBUG] [LOCAL ] RVT: Primary data saved (27148 records). [2025-09-23T21:05:23.694207] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-23T21:05:23.694328] [INFO ] [MAIN ] Update Progress: 1846/2372 symbols completed. RVT took 29.9s. Estimated remaining: 1h 9m 54s. Rate: 7.5 symbols/min [2025-09-23T21:05:23.881788] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:05:23.882036] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-23T21:05:23.882074] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-23T21:05:23.882233] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-23T21:05:23.882277] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-23T21:05:23.882317] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-23T21:05:23.882352] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-23T21:05:23.993875] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T21:05:24.211502] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-23T21:05:24.286377] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:05:24.356623] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T21:05:25.002249] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-23T21:05:25.010760] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T21:05:25.802200] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-23T21:05:26.302157] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T21:05:26.548856] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T21:05:26.602206] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-23T21:05:27.083317] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T21:05:27.402216] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-23T21:05:27.672804] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:05:27.673285] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-23T21:05:28.202228] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-23T21:05:28.602859] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T21:05:29.002235] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-23T21:05:29.802253] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-23T21:05:30.602253] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-23T21:05:30.702572] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T21:05:31.346021] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T21:05:31.370551] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T21:05:31.402161] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-23T21:05:32.202185] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-23T21:05:32.859522] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T21:05:33.002193] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-23T21:05:33.113115] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T21:05:33.337768] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-23T21:05:33.802239] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-23T21:05:34.263520] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T21:05:34.602229] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-23T21:05:35.402238] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-23T21:05:36.202238] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-23T21:05:36.281295] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T21:05:36.574238] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T21:05:36.591220] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T21:05:37.002251] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-23T21:05:37.628924] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T21:05:37.802198] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-23T21:05:38.602202] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-23T21:05:39.138926] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T21:05:39.402229] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-23T21:05:39.467090] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T21:05:39.476097] [INFO ] [REMOTE ] RVTY: Full fetch complete (66402 records). [2025-09-23T21:05:39.476305] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-23T21:05:39.891620] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-23T21:05:39.891745] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-23T21:05:39.892794] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-23T21:05:39.892859] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-23T21:05:39.894462] [DEBUG] [LOCAL ] RVTY: Trimmed 66402 records to 47580 (keeping 200 days of data) [2025-09-23T21:05:40.209789] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-23T21:05:40.213849] [DEBUG] [LOCAL ] RVTY: Primary data saved (47580 records). [2025-09-23T21:05:40.214013] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-23T21:05:40.214125] [INFO ] [MAIN ] Update Progress: 1847/2372 symbols completed. RVTY took 42.8s. Estimated remaining: 1h 9m 49s. Rate: 7.5 symbols/min [2025-09-23T21:05:40.387727] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:05:40.433319] [DEBUG] [LOCAL ] RXO: Loaded 47790 existing records from primary storage. [2025-09-23T21:05:40.433495] [INFO ] [MAIN ] RXO: Loaded 47790 existing records. [2025-09-23T21:05:40.613185] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:05:40.613449] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-23T21:05:40.613499] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-23T21:05:40.614858] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-23T21:05:40.614922] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-23T21:05:40.759156] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-23T21:05:41.002886] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-23T21:05:41.007269] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:05:41.056187] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T21:05:41.063761] [INFO ] [REMOTE ] RWT: Full fetch complete (58592 records). [2025-09-23T21:05:41.063942] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-23T21:05:41.476463] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-23T21:05:41.476557] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-23T21:05:41.477500] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-23T21:05:41.477570] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-23T21:05:41.478964] [DEBUG] [LOCAL ] RWT: Trimmed 58592 records to 40723 (keeping 200 days of data) [2025-09-23T21:05:41.730211] [DEBUG] [LOCAL ] RWT: Primary data saved (40723 records). [2025-09-23T21:05:41.730391] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-23T21:05:41.730550] [INFO ] [MAIN ] Update Progress: 1848/2372 symbols completed. RWT took 42.0s. Estimated remaining: 1h 9m 39s. Rate: 7.5 symbols/min [2025-09-23T21:05:41.815994] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T21:05:41.807377] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-23T21:05:41.938228] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:05:41.989242] [DEBUG] [LOCAL ] RY: Loaded 47940 existing records from primary storage. [2025-09-23T21:05:41.989387] [INFO ] [MAIN ] RY: Loaded 47940 existing records. [2025-09-23T21:05:42.180062] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:05:42.180327] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-23T21:05:42.180375] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-23T21:05:42.181868] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-23T21:05:42.181929] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-23T21:05:42.574661] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:05:42.602159] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-23T21:05:43.403371] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-23T21:05:43.405781] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T21:05:43.953023] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T21:05:44.207329] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-23T21:05:44.227122] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T21:05:44.734004] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T21:05:45.002216] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-23T21:05:45.802285] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-23T21:05:46.571018] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T21:05:46.572795] [INFO ] [REMOTE ] RWTP: Full fetch complete (4452 records). [2025-09-23T21:05:46.572889] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-23T21:05:46.607195] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-23T21:05:46.771937] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T21:05:46.815445] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 163 unique days, need 200 days [2025-09-23T21:05:46.815722] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:05:46.815794] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:05:46.815866] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-23T21:05:46.815953] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-23T21:05:46.816008] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-23T21:05:46.816064] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-23T21:05:46.816153] [INFO ] [MAIN ] Update Progress: 1849/2372 symbols completed. RWTP took 23.1s. Estimated remaining: 1h 9m 30s. Rate: 7.5 symbols/min [2025-09-23T21:05:46.987479] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:05:47.022933] [DEBUG] [LOCAL ] RYAM: Loaded 35308 existing records from primary storage. [2025-09-23T21:05:47.023090] [INFO ] [MAIN ] RYAM: Loaded 35308 existing records. [2025-09-23T21:05:47.208017] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:05:47.208458] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-23T21:05:47.208516] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-23T21:05:47.209639] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-23T21:05:47.209745] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-23T21:05:47.410861] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-23T21:05:47.575088] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:05:48.202212] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-23T21:05:48.473188] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-23T21:05:49.002199] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-23T21:05:49.045583] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T21:05:49.213036] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T21:05:49.802198] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-23T21:05:50.602235] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-23T21:05:50.691541] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T21:05:51.402506] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-23T21:05:51.459857] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T21:05:51.870099] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T21:05:52.202181] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-23T21:05:53.002173] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-23T21:05:53.401878] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T21:05:53.450564] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T21:05:53.802280] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-23T21:05:54.602211] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-23T21:05:54.784074] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T21:05:55.402180] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-23T21:05:55.592638] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T21:05:56.082321] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T21:05:56.202251] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-23T21:05:56.770176] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T21:05:57.002239] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-23T21:05:57.641058] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T21:05:57.812455] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-23T21:05:57.817844] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T21:05:58.449785] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T21:05:58.451244] [INFO ] [REMOTE ] RWTO: Full fetch complete (4779 records). [2025-09-23T21:05:58.451314] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-23T21:05:58.628425] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-23T21:05:58.635952] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T21:05:58.636315] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:05:58.637294] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:05:58.637369] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-23T21:05:58.637446] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-23T21:05:58.637513] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-23T21:05:58.637563] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-23T21:05:58.637627] [INFO ] [MAIN ] Update Progress: 1850/2372 symbols completed. RWTO took 36.9s. Estimated remaining: 1h 9m 23s. Rate: 7.5 symbols/min [2025-09-23T21:05:58.815676] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:05:58.866001] [DEBUG] [LOCAL ] RYAN: Loaded 44061 existing records from primary storage. [2025-09-23T21:05:58.866217] [INFO ] [MAIN ] RYAN: Loaded 44061 existing records. [2025-09-23T21:05:59.048940] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:05:59.049242] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-23T21:05:59.049292] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-23T21:05:59.050724] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-23T21:05:59.050786] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-23T21:05:59.411410] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-23T21:05:59.417281] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:06:00.202217] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-23T21:06:00.244346] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T21:06:01.002178] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-23T21:06:01.224545] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T21:06:01.802277] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-23T21:06:02.122874] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T21:06:02.602175] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-23T21:06:02.874806] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T21:06:03.402254] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-23T21:06:04.202218] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-23T21:06:05.319638] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T21:06:05.328097] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-23T21:06:05.456176] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (3.65 seconds). [2025-09-23T21:06:05.534503] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T21:06:05.802209] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-23T21:06:06.049172] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (3.45 seconds). [2025-09-23T21:06:06.296978] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T21:06:06.602225] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-23T21:06:07.145146] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T21:06:07.402201] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-23T21:06:07.967970] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T21:06:08.202180] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-23T21:06:08.406877] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T21:06:09.002272] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-23T21:06:09.570009] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T21:06:09.578682] [INFO ] [REMOTE ] RY: Full fetch complete (68550 records). [2025-09-23T21:06:09.578810] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-23T21:06:09.807356] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-23T21:06:09.979147] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-23T21:06:09.979243] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-23T21:06:09.980377] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-23T21:06:09.980484] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-23T21:06:09.981858] [DEBUG] [LOCAL ] RY: Trimmed 68550 records to 47921 (keeping 200 days of data) [2025-09-23T21:06:10.282263] [DEBUG] [LOCAL ] RY: Primary data saved (47921 records). [2025-09-23T21:06:10.282402] [INFO ] [MAIN ] RY: Full history saved. [2025-09-23T21:06:10.284344] [INFO ] [MAIN ] Update Progress: 1851/2372 symbols completed. RY took 28.6s. Estimated remaining: 1h 9m 16s. Rate: 7.5 symbols/min [2025-09-23T21:06:10.469847] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:06:10.496797] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T21:06:10.521815] [DEBUG] [LOCAL ] RYI: Loaded 21599 existing records from primary storage. [2025-09-23T21:06:10.521978] [INFO ] [MAIN ] RYI: Loaded 21599 existing records. [2025-09-23T21:06:10.607284] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-23T21:06:10.723782] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:06:10.724096] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-23T21:06:10.724187] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-23T21:06:10.724924] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-23T21:06:10.724984] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-23T21:06:11.082327] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:06:11.402176] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-23T21:06:11.519226] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T21:06:12.131996] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T21:06:12.140902] [INFO ] [REMOTE ] RYAM: Full fetch complete (48720 records). [2025-09-23T21:06:12.141050] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-23T21:06:12.207339] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-23T21:06:12.543731] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-23T21:06:12.543880] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-23T21:06:12.544766] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-23T21:06:12.544835] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-23T21:06:12.546116] [DEBUG] [LOCAL ] RYAM: Trimmed 48720 records to 35249 (keeping 200 days of data) [2025-09-23T21:06:12.748952] [DEBUG] [LOCAL ] RYAM: Primary data saved (35249 records). [2025-09-23T21:06:12.749094] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-23T21:06:12.749242] [INFO ] [MAIN ] Update Progress: 1852/2372 symbols completed. RYAM took 25.9s. Estimated remaining: 1h 9m 7s. Rate: 7.5 symbols/min [2025-09-23T21:06:12.929163] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:06:12.982792] [DEBUG] [LOCAL ] RYN: Loaded 45734 existing records from primary storage. [2025-09-23T21:06:12.982944] [INFO ] [MAIN ] RYN: Loaded 45734 existing records. [2025-09-23T21:06:13.014226] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-23T21:06:13.199847] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T21:06:13.200013] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:06:13.210483] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-23T21:06:13.210579] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-23T21:06:13.211925] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-23T21:06:13.211996] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-23T21:06:13.605295] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:06:13.802266] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-23T21:06:14.059280] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T21:06:14.232253] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T21:06:14.602254] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-23T21:06:15.402176] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-23T21:06:15.490931] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T21:06:15.501079] [INFO ] [REMOTE ] RXO: Full fetch complete (67951 records). [2025-09-23T21:06:15.501267] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-23T21:06:15.936498] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-23T21:06:15.936781] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-23T21:06:15.938872] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-23T21:06:15.939019] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-23T21:06:15.957722] [DEBUG] [LOCAL ] RXO: Trimmed 67951 records to 47792 (keeping 200 days of data) [2025-09-23T21:06:15.973713] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T21:06:16.203742] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-23T21:06:16.276553] [DEBUG] [LOCAL ] RXO: Primary data saved (47792 records). [2025-09-23T21:06:16.276718] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-23T21:06:16.276907] [INFO ] [MAIN ] Update Progress: 1853/2372 symbols completed. RXO took 36.1s. Estimated remaining: 1h 8m 58s. Rate: 7.5 symbols/min [2025-09-23T21:06:16.451489] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:06:16.460353] [DEBUG] [LOCAL ] RZB: Loaded 6288 existing records from primary storage. [2025-09-23T21:06:16.460477] [INFO ] [MAIN ] RZB: Loaded 6288 existing records. [2025-09-23T21:06:16.654904] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:06:16.655665] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-23T21:06:16.655910] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-23T21:06:16.656450] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-23T21:06:16.656548] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-23T21:06:16.807135] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T21:06:17.007424] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-23T21:06:17.094783] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:06:17.578505] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T21:06:17.802258] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-23T21:06:17.915306] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T21:06:18.524953] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T21:06:18.602205] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-23T21:06:19.402214] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-23T21:06:19.767402] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T21:06:19.850053] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T21:06:20.202286] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-23T21:06:21.002253] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-23T21:06:21.491747] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T21:06:21.646678] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T21:06:21.802258] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-23T21:06:22.602177] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-23T21:06:22.857316] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T21:06:23.402195] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-23T21:06:24.010000] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T21:06:24.011917] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T21:06:24.202143] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-23T21:06:25.002244] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-23T21:06:25.802174] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-23T21:06:25.834801] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T21:06:26.030880] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T21:06:26.239391] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-23T21:06:26.602226] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-23T21:06:27.402267] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-23T21:06:28.202207] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-23T21:06:28.359492] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T21:06:29.002229] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-23T21:06:29.802252] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-23T21:06:29.949200] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-23T21:06:29.970062] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T21:06:30.602277] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-23T21:06:31.265445] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T21:06:31.307385] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T21:06:31.328159] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T21:06:31.402172] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-23T21:06:32.101714] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T21:06:32.202204] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-23T21:06:33.002194] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-23T21:06:33.810312] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-23T21:06:33.815323] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T21:06:34.274183] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T21:06:34.283305] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T21:06:34.602194] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-23T21:06:35.402209] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-23T21:06:36.202195] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-23T21:06:36.269464] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T21:06:36.271057] [INFO ] [REMOTE ] RZB: Full fetch complete (8821 records). [2025-09-23T21:06:36.271244] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-23T21:06:36.596067] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T21:06:36.689717] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-23T21:06:36.689814] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-23T21:06:36.690060] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-23T21:06:36.690100] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-23T21:06:36.690580] [DEBUG] [LOCAL ] RZB: Trimmed 8821 records to 6275 (keeping 200 days of data) [2025-09-23T21:06:36.732783] [DEBUG] [LOCAL ] RZB: Primary data saved (6275 records). [2025-09-23T21:06:36.732944] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-23T21:06:36.733097] [INFO ] [MAIN ] Update Progress: 1854/2372 symbols completed. RZB took 20.5s. Estimated remaining: 1h 8m 53s. Rate: 7.5 symbols/min [2025-09-23T21:06:36.903548] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:06:36.914427] [DEBUG] [LOCAL ] RZC: Loaded 6799 existing records from primary storage. [2025-09-23T21:06:36.914567] [INFO ] [MAIN ] RZC: Loaded 6799 existing records. [2025-09-23T21:06:37.007679] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-23T21:06:37.117131] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:06:37.117429] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-23T21:06:37.117505] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-23T21:06:37.117853] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-23T21:06:37.117913] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-23T21:06:37.500095] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:06:37.802220] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-23T21:06:37.882266] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T21:06:38.242560] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T21:06:38.602216] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-23T21:06:39.165013] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T21:06:39.402205] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-23T21:06:40.202193] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-23T21:06:40.259228] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T21:06:41.002240] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-23T21:06:41.068901] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T21:06:41.077360] [INFO ] [REMOTE ] RYAN: Full fetch complete (63464 records). [2025-09-23T21:06:41.077498] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-23T21:06:41.258899] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T21:06:41.507759] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-23T21:06:41.507860] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-23T21:06:41.508914] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-23T21:06:41.508989] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-23T21:06:41.510775] [DEBUG] [LOCAL ] RYAN: Trimmed 63464 records to 44116 (keeping 200 days of data) [2025-09-23T21:06:41.802594] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-23T21:06:41.845120] [DEBUG] [LOCAL ] RYAN: Primary data saved (44116 records). [2025-09-23T21:06:41.845282] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-23T21:06:41.845511] [INFO ] [MAIN ] Update Progress: 1855/2372 symbols completed. RYAN took 43.2s. Estimated remaining: 1h 8m 44s. Rate: 7.5 symbols/min [2025-09-23T21:06:42.021320] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:06:42.082523] [DEBUG] [LOCAL ] S: Loaded 53545 existing records from primary storage. [2025-09-23T21:06:42.082712] [INFO ] [MAIN ] S: Loaded 53545 existing records. [2025-09-23T21:06:42.259127] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:06:42.259457] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-23T21:06:42.259507] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-23T21:06:42.260832] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-23T21:06:42.260893] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-23T21:06:42.641478] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:06:42.635498] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-23T21:06:42.755584] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T21:06:42.760252] [INFO ] [REMOTE ] RYI: Full fetch complete (32454 records). [2025-09-23T21:06:42.760360] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-23T21:06:43.130186] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-23T21:06:43.130275] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-23T21:06:43.130952] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-23T21:06:43.131014] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-23T21:06:43.133151] [DEBUG] [LOCAL ] RYI: Trimmed 32454 records to 21555 (keeping 200 days of data) [2025-09-23T21:06:43.274337] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T21:06:43.324693] [DEBUG] [LOCAL ] RYI: Primary data saved (21555 records). [2025-09-23T21:06:43.324824] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-23T21:06:43.324926] [INFO ] [MAIN ] Update Progress: 1856/2372 symbols completed. RYI took 33.0s. Estimated remaining: 1h 8m 35s. Rate: 7.5 symbols/min [2025-09-23T21:06:43.407432] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-23T21:06:43.507276] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:06:43.574394] [DEBUG] [LOCAL ] SA: Loaded 43072 existing records from primary storage. [2025-09-23T21:06:43.574576] [INFO ] [MAIN ] SA: Loaded 43072 existing records. [2025-09-23T21:06:43.756085] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:06:43.756455] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-23T21:06:43.756512] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-23T21:06:43.758097] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-23T21:06:43.758160] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-23T21:06:44.116615] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:06:44.202170] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-23T21:06:44.445051] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T21:06:44.453057] [INFO ] [REMOTE ] RYN: Full fetch complete (64574 records). [2025-09-23T21:06:44.453193] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-23T21:06:44.844023] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-23T21:06:44.844106] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-23T21:06:44.845056] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-23T21:06:44.845119] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-23T21:06:44.846401] [DEBUG] [LOCAL ] RYN: Trimmed 64574 records to 45711 (keeping 200 days of data) [2025-09-23T21:06:45.031015] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-23T21:06:45.137863] [DEBUG] [LOCAL ] RYN: Primary data saved (45711 records). [2025-09-23T21:06:45.137996] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-23T21:06:45.138092] [INFO ] [MAIN ] Update Progress: 1857/2372 symbols completed. RYN took 32.4s. Estimated remaining: 1h 8m 25s. Rate: 7.5 symbols/min [2025-09-23T21:06:45.303478] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:06:45.314870] [DEBUG] [LOCAL ] SABA: Loaded 9221 existing records from primary storage. [2025-09-23T21:06:45.314988] [INFO ] [MAIN ] SABA: Loaded 9221 existing records. [2025-09-23T21:06:45.493507] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:06:45.494026] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-23T21:06:45.494128] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-23T21:06:45.494531] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-23T21:06:45.494592] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-23T21:06:45.864227] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:06:45.870927] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-23T21:06:45.872820] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T21:06:45.900093] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T21:06:45.939043] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-23T21:06:46.602215] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-23T21:06:46.977389] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T21:06:47.402207] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-23T21:06:48.202289] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-23T21:06:48.653727] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-23T21:06:48.994333] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T21:06:49.010282] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-23T21:06:49.029869] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T21:06:49.802196] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-23T21:06:50.602170] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-23T21:06:50.673422] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T21:06:50.919832] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-23T21:06:51.402231] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-23T21:06:51.412025] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T21:06:52.202211] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-23T21:06:52.239908] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T21:06:52.981076] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T21:06:53.002190] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-23T21:06:53.802230] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-23T21:06:54.602232] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-23T21:06:54.704118] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T21:06:55.230734] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-23T21:06:55.402200] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-23T21:06:55.797010] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T21:06:55.917246] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T21:06:56.202191] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-23T21:06:57.002169] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-23T21:06:57.121744] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T21:06:57.802181] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-23T21:06:58.602236] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-23T21:06:59.049321] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-23T21:06:59.274899] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T21:06:59.376947] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T21:06:59.402135] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-23T21:07:00.202180] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-23T21:07:00.951066] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T21:07:01.002164] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-23T21:07:01.045972] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T21:07:01.802240] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-23T21:07:02.602211] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-23T21:07:03.081749] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-23T21:07:03.402181] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-23T21:07:03.417526] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T21:07:03.444402] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T21:07:04.202211] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-23T21:07:05.002173] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-23T21:07:05.037551] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T21:07:05.550520] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-23T21:07:05.799575] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T21:07:05.802132] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-23T21:07:06.550612] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T21:07:06.602160] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-23T21:07:07.268023] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T21:07:07.269583] [INFO ] [REMOTE ] RZC: Full fetch complete (9902 records). [2025-09-23T21:07:07.269676] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-23T21:07:07.410620] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-23T21:07:07.656354] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-23T21:07:07.656448] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-23T21:07:07.656743] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-23T21:07:07.656803] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-23T21:07:07.657233] [DEBUG] [LOCAL ] RZC: Trimmed 9902 records to 6778 (keeping 200 days of data) [2025-09-23T21:07:07.698249] [DEBUG] [LOCAL ] RZC: Primary data saved (6778 records). [2025-09-23T21:07:07.698358] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-23T21:07:07.698444] [INFO ] [MAIN ] Update Progress: 1858/2372 symbols completed. RZC took 31.0s. Estimated remaining: 1h 8m 21s. Rate: 7.5 symbols/min [2025-09-23T21:07:07.865094] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:07:07.902315] [DEBUG] [LOCAL ] SAFE: Loaded 30287 existing records from primary storage. [2025-09-23T21:07:07.902478] [INFO ] [MAIN ] SAFE: Loaded 30287 existing records. [2025-09-23T21:07:08.078803] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:07:08.081011] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-23T21:07:08.081061] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-23T21:07:08.081845] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-23T21:07:08.081904] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-23T21:07:08.207421] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-23T21:07:08.454896] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:07:09.002253] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-23T21:07:09.807283] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-23T21:07:09.832098] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-23T21:07:09.914095] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T21:07:10.406922] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T21:07:10.519250] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T21:07:10.521744] [INFO ] [REMOTE ] SABA: Full fetch complete (15535 records). [2025-09-23T21:07:10.521823] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-23T21:07:10.607311] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-23T21:07:10.890308] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-23T21:07:10.890392] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-23T21:07:10.890757] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-23T21:07:10.890817] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-23T21:07:10.891300] [DEBUG] [LOCAL ] SABA: Trimmed 15535 records to 9229 (keeping 200 days of data) [2025-09-23T21:07:10.946032] [DEBUG] [LOCAL ] SABA: Primary data saved (9229 records). [2025-09-23T21:07:10.946162] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-23T21:07:10.946246] [INFO ] [MAIN ] Update Progress: 1859/2372 symbols completed. SABA took 25.8s. Estimated remaining: 1h 8m 12s. Rate: 7.5 symbols/min [2025-09-23T21:07:11.117551] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:07:11.143306] [DEBUG] [LOCAL ] SAH: Loaded 22148 existing records from primary storage. [2025-09-23T21:07:11.143477] [INFO ] [MAIN ] SAH: Loaded 22148 existing records. [2025-09-23T21:07:11.322878] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:07:11.323113] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-23T21:07:11.323160] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-23T21:07:11.323969] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-23T21:07:11.324029] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-23T21:07:11.407320] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-23T21:07:11.678259] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:07:12.202220] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-23T21:07:12.817572] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T21:07:12.943992] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-23T21:07:13.002154] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-23T21:07:13.807308] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-23T21:07:13.824720] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T21:07:14.602273] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-23T21:07:14.791270] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T21:07:15.127281] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-23T21:07:15.136404] [INFO ] [REMOTE ] S: Full fetch complete (77556 records). [2025-09-23T21:07:15.136542] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-23T21:07:15.403477] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-23T21:07:15.561821] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T21:07:15.561933] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-23T21:07:15.565678] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-23T21:07:15.567104] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-23T21:07:15.567194] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-23T21:07:15.568891] [DEBUG] [LOCAL ] S: Trimmed 77556 records to 53545 (keeping 200 days of data) [2025-09-23T21:07:15.911758] [DEBUG] [LOCAL ] S: Primary data saved (53545 records). [2025-09-23T21:07:15.911935] [INFO ] [MAIN ] S: Full history saved. [2025-09-23T21:07:15.912069] [INFO ] [MAIN ] Update Progress: 1860/2372 symbols completed. S took 34.1s. Estimated remaining: 1h 8m 3s. Rate: 7.5 symbols/min [2025-09-23T21:07:16.098905] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:07:16.099067] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-23T21:07:16.099104] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-23T21:07:16.099249] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-23T21:07:16.099291] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-23T21:07:16.099333] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-23T21:07:16.099365] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-23T21:07:16.209830] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-23T21:07:16.499335] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:07:16.781067] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T21:07:17.002214] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-23T21:07:17.318920] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T21:07:17.495369] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T21:07:17.802260] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-23T21:07:18.182162] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T21:07:18.602272] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-23T21:07:19.402206] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-23T21:07:19.801312] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T21:07:19.850954] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T21:07:20.202180] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-23T21:07:20.566955] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-23T21:07:21.002172] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-23T21:07:21.384714] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-23T21:07:21.802223] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-23T21:07:22.185794] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T21:07:22.602249] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-23T21:07:23.402199] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-23T21:07:23.767187] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-23T21:07:24.103849] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T21:07:24.202189] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-23T21:07:25.002245] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-23T21:07:25.603618] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T21:07:25.777216] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T21:07:25.802175] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-23T21:07:26.602207] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-23T21:07:27.089224] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T21:07:27.402235] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-23T21:07:27.855803] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T21:07:28.202213] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-23T21:07:28.757676] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T21:07:29.002282] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-23T21:07:29.662822] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T21:07:29.802212] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-23T21:07:30.409617] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T21:07:30.417981] [INFO ] [REMOTE ] SA: Full fetch complete (61796 records). [2025-09-23T21:07:30.418156] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-23T21:07:30.613910] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-23T21:07:30.875895] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-23T21:07:30.875996] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-23T21:07:30.877032] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-23T21:07:30.877101] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-23T21:07:30.878702] [DEBUG] [LOCAL ] SA: Trimmed 61796 records to 43119 (keeping 200 days of data) [2025-09-23T21:07:31.095165] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T21:07:31.137156] [DEBUG] [LOCAL ] SA: Primary data saved (43119 records). [2025-09-23T21:07:31.137377] [INFO ] [MAIN ] SA: Full history saved. [2025-09-23T21:07:31.137632] [INFO ] [MAIN ] Update Progress: 1861/2372 symbols completed. SA took 47.8s. Estimated remaining: 1h 7m 57s. Rate: 7.5 symbols/min [2025-09-23T21:07:31.310586] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T21:07:31.336864] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:07:31.360427] [DEBUG] [LOCAL ] SAM: Loaded 21661 existing records from primary storage. [2025-09-23T21:07:31.360626] [INFO ] [MAIN ] SAM: Loaded 21661 existing records. [2025-09-23T21:07:31.412686] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-23T21:07:31.544050] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:07:31.544337] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-23T21:07:31.544389] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-23T21:07:31.545072] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-23T21:07:31.545133] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-23T21:07:31.901616] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:07:32.202181] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-23T21:07:32.621193] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T21:07:32.626629] [INFO ] [REMOTE ] SAFE: Full fetch complete (45050 records). [2025-09-23T21:07:32.626755] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-23T21:07:33.013216] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-23T21:07:33.067110] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-23T21:07:33.067195] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-23T21:07:33.068073] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-23T21:07:33.068136] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-23T21:07:33.069199] [DEBUG] [LOCAL ] SAFE: Trimmed 45050 records to 30333 (keeping 200 days of data) [2025-09-23T21:07:33.174091] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T21:07:33.267747] [DEBUG] [LOCAL ] SAFE: Primary data saved (30333 records). [2025-09-23T21:07:33.267885] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-23T21:07:33.267990] [INFO ] [MAIN ] Update Progress: 1862/2372 symbols completed. SAFE took 25.6s. Estimated remaining: 1h 7m 47s. Rate: 7.5 symbols/min [2025-09-23T21:07:33.439791] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:07:33.450966] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T21:07:33.493010] [DEBUG] [LOCAL ] SAN: Loaded 53019 existing records from primary storage. [2025-09-23T21:07:33.493180] [INFO ] [MAIN ] SAN: Loaded 53019 existing records. [2025-09-23T21:07:33.670995] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:07:33.671268] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-23T21:07:33.671317] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-23T21:07:33.672448] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-23T21:07:33.672511] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-23T21:07:33.814965] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-23T21:07:34.034479] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:07:34.259920] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T21:07:34.260684] [INFO ] [REMOTE ] SAJ: Full fetch complete (931 records). [2025-09-23T21:07:34.260752] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-23T21:07:34.441914] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-23T21:07:34.442108] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:07:34.442154] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:07:34.442262] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-23T21:07:34.442346] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-23T21:07:34.442381] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-23T21:07:34.442420] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-23T21:07:34.442493] [INFO ] [MAIN ] Update Progress: 1863/2372 symbols completed. SAJ took 18.5s. Estimated remaining: 1h 7m 38s. Rate: 7.5 symbols/min [2025-09-23T21:07:34.613902] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:07:34.610059] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-23T21:07:34.663791] [DEBUG] [LOCAL ] SAND: Loaded 51786 existing records from primary storage. [2025-09-23T21:07:34.663937] [INFO ] [MAIN ] SAND: Loaded 51786 existing records. [2025-09-23T21:07:34.842918] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:07:34.843183] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-23T21:07:34.843244] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-23T21:07:34.844539] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-23T21:07:34.844600] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-23T21:07:35.195173] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:07:35.402183] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-23T21:07:35.763018] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T21:07:36.202235] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-23T21:07:37.002209] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-23T21:07:37.094910] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T21:07:37.695585] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T21:07:37.802193] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-23T21:07:38.209993] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T21:07:38.602246] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-23T21:07:39.402218] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-23T21:07:39.505428] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T21:07:39.528731] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T21:07:40.202278] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-23T21:07:41.002274] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-23T21:07:41.268915] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-23T21:07:41.373936] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T21:07:41.802215] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-23T21:07:42.257723] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T21:07:42.602239] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-23T21:07:43.402219] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-23T21:07:43.633876] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T21:07:43.700312] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T21:07:44.202218] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-23T21:07:44.600897] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T21:07:45.002263] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-23T21:07:45.411754] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T21:07:45.802178] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-23T21:07:46.607297] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-23T21:07:46.624589] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T21:07:46.745615] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T21:07:46.748974] [INFO ] [REMOTE ] SAH: Full fetch complete (30365 records). [2025-09-23T21:07:46.749060] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-23T21:07:47.118627] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-23T21:07:47.118745] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-23T21:07:47.119368] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-23T21:07:47.119411] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-23T21:07:47.120286] [DEBUG] [LOCAL ] SAH: Trimmed 30365 records to 22127 (keeping 200 days of data) [2025-09-23T21:07:47.255179] [DEBUG] [LOCAL ] SAH: Primary data saved (22127 records). [2025-09-23T21:07:47.255309] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-23T21:07:47.255414] [INFO ] [MAIN ] Update Progress: 1864/2372 symbols completed. SAH took 36.3s. Estimated remaining: 1h 7m 31s. Rate: 7.5 symbols/min [2025-09-23T21:07:47.410953] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-23T21:07:47.437340] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:07:47.460909] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T21:07:47.499791] [DEBUG] [LOCAL ] SAP: Loaded 50093 existing records from primary storage. [2025-09-23T21:07:47.499943] [INFO ] [MAIN ] SAP: Loaded 50093 existing records. [2025-09-23T21:07:47.681941] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:07:47.682219] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-23T21:07:47.682270] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-23T21:07:47.683780] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-23T21:07:47.683847] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-23T21:07:48.056813] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:07:48.202234] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-23T21:07:49.002328] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-23T21:07:49.337629] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T21:07:49.802253] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-23T21:07:49.900293] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T21:07:50.024541] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T21:07:50.602259] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-23T21:07:51.402281] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-23T21:07:51.455164] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T21:07:52.202167] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-23T21:07:52.384983] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T21:07:53.002272] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-23T21:07:53.789780] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-23T21:07:53.802261] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-23T21:07:54.188766] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T21:07:54.464564] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-23T21:07:54.602211] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-23T21:07:55.402265] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-23T21:07:55.648969] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T21:07:56.085933] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T21:07:56.202228] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-23T21:07:57.002252] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-23T21:07:57.387843] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T21:07:57.802241] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-23T21:07:58.204470] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-23T21:07:58.608383] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-23T21:07:58.611321] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T21:07:59.402259] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-23T21:07:59.479142] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T21:07:59.813184] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T21:07:59.817525] [INFO ] [REMOTE ] SAM: Full fetch complete (30318 records). [2025-09-23T21:07:59.817606] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-23T21:08:00.198948] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-23T21:08:00.199032] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-23T21:08:00.199637] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-23T21:08:00.199717] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-23T21:08:00.200452] [DEBUG] [LOCAL ] SAM: Trimmed 30318 records to 21593 (keeping 200 days of data) [2025-09-23T21:08:00.202231] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-23T21:08:00.336630] [DEBUG] [LOCAL ] SAM: Primary data saved (21593 records). [2025-09-23T21:08:00.336796] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-23T21:08:00.336904] [INFO ] [MAIN ] Update Progress: 1865/2372 symbols completed. SAM took 29.2s. Estimated remaining: 1h 7m 24s. Rate: 7.5 symbols/min [2025-09-23T21:08:00.512820] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:08:00.530088] [DEBUG] [LOCAL ] SAR: Loaded 16175 existing records from primary storage. [2025-09-23T21:08:00.530255] [INFO ] [MAIN ] SAR: Loaded 16175 existing records. [2025-09-23T21:08:00.715343] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:08:00.715840] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-23T21:08:00.715896] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-23T21:08:00.716431] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-23T21:08:00.716496] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-23T21:08:01.007469] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-23T21:08:01.082007] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:08:01.416472] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T21:08:01.802260] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-23T21:08:02.126081] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-23T21:08:02.602194] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-23T21:08:02.677955] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T21:08:02.718096] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T21:08:03.402276] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-23T21:08:04.202237] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-23T21:08:04.820008] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T21:08:05.002189] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-23T21:08:05.074082] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T21:08:05.599328] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T21:08:05.802256] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-23T21:08:06.602240] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-23T21:08:07.024474] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-23T21:08:07.402320] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-23T21:08:07.973557] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-23T21:08:07.983058] [INFO ] [REMOTE ] SAND: Full fetch complete (74308 records). [2025-09-23T21:08:07.983297] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-23T21:08:08.228730] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-23T21:08:08.410881] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-23T21:08:08.411026] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-23T21:08:08.412234] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-23T21:08:08.412304] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-23T21:08:08.414089] [DEBUG] [LOCAL ] SAND: Trimmed 74308 records to 51790 (keeping 200 days of data) [2025-09-23T21:08:08.734114] [DEBUG] [LOCAL ] SAND: Primary data saved (51790 records). [2025-09-23T21:08:08.734253] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-23T21:08:08.734339] [INFO ] [MAIN ] Update Progress: 1866/2372 symbols completed. SAND took 34.3s. Estimated remaining: 1h 7m 16s. Rate: 7.5 symbols/min [2025-09-23T21:08:08.869118] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T21:08:08.935721] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:08:08.981003] [DEBUG] [LOCAL ] SARO: Loaded 48810 existing records from primary storage. [2025-09-23T21:08:08.981168] [INFO ] [MAIN ] SARO: Loaded 48810 existing records. [2025-09-23T21:08:09.012326] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-23T21:08:09.165358] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:08:09.165852] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-23T21:08:09.165910] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-23T21:08:09.167055] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-23T21:08:09.167119] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-23T21:08:09.531929] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:08:09.564188] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-09-23T21:08:09.802261] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-23T21:08:10.602270] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-23T21:08:10.762033] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T21:08:10.900238] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-23T21:08:10.910478] [INFO ] [REMOTE ] SAN: Full fetch complete (76180 records). [2025-09-23T21:08:10.910776] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-23T21:08:11.320918] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-23T21:08:11.321049] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-23T21:08:11.322301] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-23T21:08:11.322387] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-23T21:08:11.324288] [DEBUG] [LOCAL ] SAN: Trimmed 76180 records to 53020 (keeping 200 days of data) [2025-09-23T21:08:11.408078] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-23T21:08:11.441194] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T21:08:11.680054] [DEBUG] [LOCAL ] SAN: Primary data saved (53020 records). [2025-09-23T21:08:11.680199] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-23T21:08:11.680284] [INFO ] [MAIN ] Update Progress: 1867/2372 symbols completed. SAN took 38.4s. Estimated remaining: 1h 7m 7s. Rate: 7.5 symbols/min [2025-09-23T21:08:11.861374] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:08:11.861595] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-23T21:08:11.861676] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-23T21:08:11.861886] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-23T21:08:11.861941] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-23T21:08:11.861987] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-23T21:08:11.862020] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-23T21:08:12.205801] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-23T21:08:12.234254] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:08:12.271447] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T21:08:12.562053] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T21:08:13.002191] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-23T21:08:13.802165] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-23T21:08:14.180877] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T21:08:14.264297] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T21:08:14.389268] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T21:08:14.602212] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-23T21:08:14.974465] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-23T21:08:15.402263] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-23T21:08:16.202272] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-23T21:08:16.910174] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T21:08:17.002195] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-23T21:08:17.802243] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-23T21:08:18.229183] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T21:08:18.269525] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-23T21:08:18.441537] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T21:08:18.602229] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-23T21:08:19.402250] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-23T21:08:19.800357] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T21:08:20.202177] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-23T21:08:20.292413] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T21:08:21.002201] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-23T21:08:21.605207] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T21:08:21.802210] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-23T21:08:22.602162] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-23T21:08:22.709056] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-23T21:08:22.717780] [INFO ] [REMOTE ] SAP: Full fetch complete (71643 records). [2025-09-23T21:08:22.717905] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-23T21:08:23.126121] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-23T21:08:23.126225] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-23T21:08:23.127353] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-23T21:08:23.127422] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-23T21:08:23.132019] [DEBUG] [LOCAL ] SAP: Trimmed 71643 records to 50089 (keeping 200 days of data) [2025-09-23T21:08:23.408624] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-23T21:08:23.448208] [DEBUG] [LOCAL ] SAP: Primary data saved (50089 records). [2025-09-23T21:08:23.448329] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-23T21:08:23.449772] [INFO ] [MAIN ] Update Progress: 1868/2372 symbols completed. SAP took 36.2s. Estimated remaining: 1h 7m 0s. Rate: 7.5 symbols/min [2025-09-23T21:08:23.637900] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:08:23.638232] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-23T21:08:23.638288] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-23T21:08:23.638533] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-23T21:08:23.638602] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-23T21:08:23.638701] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-23T21:08:23.638747] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-23T21:08:24.008710] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T21:08:24.014875] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:08:24.096415] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-23T21:08:24.202167] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-23T21:08:24.611394] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T21:08:25.002155] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-23T21:08:25.097500] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-23T21:08:25.802202] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-23T21:08:26.074953] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T21:08:26.602233] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-23T21:08:27.402215] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-23T21:08:27.438739] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T21:08:27.712686] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T21:08:27.863705] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-23T21:08:28.202182] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-23T21:08:28.592863] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T21:08:29.002196] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-23T21:08:29.386110] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T21:08:29.802200] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-23T21:08:30.602191] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-23T21:08:31.402226] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-23T21:08:31.505699] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T21:08:31.669146] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T21:08:31.787117] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T21:08:32.202265] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-23T21:08:32.606197] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T21:08:33.002264] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-23T21:08:33.802191] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-23T21:08:33.956391] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T21:08:33.959800] [INFO ] [REMOTE ] SAR: Full fetch complete (22422 records). [2025-09-23T21:08:33.959892] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-23T21:08:34.238940] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T21:08:34.266743] [INFO ] [REMOTE ] SAT: Full fetch complete (1605 records). [2025-09-23T21:08:34.266939] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-23T21:08:34.482323] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-23T21:08:34.497941] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-23T21:08:34.517913] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-23T21:08:34.518019] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-23T21:08:34.556680] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-23T21:08:34.557205] [DEBUG] [LOCAL ] SAR: Trimmed 22422 records to 16084 (keeping 200 days of data) [2025-09-23T21:08:34.557342] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:08:34.557520] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:08:34.558507] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-23T21:08:34.558969] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-23T21:08:34.559032] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-23T21:08:34.559091] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-23T21:08:34.559183] [INFO ] [MAIN ] Update Progress: 1869/2372 symbols completed. SAT took 22.9s. Estimated remaining: 1h 6m 53s. Rate: 7.5 symbols/min [2025-09-23T21:08:34.638786] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-23T21:08:34.829991] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:08:34.831065] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-23T21:08:34.831381] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-23T21:08:34.832204] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-23T21:08:34.832926] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-23T21:08:34.834359] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-23T21:08:34.834750] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-23T21:08:35.058336] [DEBUG] [LOCAL ] SAR: Primary data saved (16084 records). [2025-09-23T21:08:35.091198] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-23T21:08:35.091026] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-23T21:08:35.149464] [INFO ] [MAIN ] Update Progress: 1870/2372 symbols completed. SAR took 34.8s. Estimated remaining: 1h 6m 43s. Rate: 7.5 symbols/min [2025-09-23T21:08:35.385098] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:08:35.407249] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-23T21:08:35.457469] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:08:35.500443] [DEBUG] [LOCAL ] SB: Loaded 33353 existing records from primary storage. [2025-09-23T21:08:35.500592] [INFO ] [MAIN ] SB: Loaded 33353 existing records. [2025-09-23T21:08:35.676248] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:08:35.676543] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-23T21:08:35.676599] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-23T21:08:35.677518] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-23T21:08:35.677580] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-23T21:08:35.940107] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T21:08:36.038080] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:08:36.202159] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-23T21:08:37.002247] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-23T21:08:37.802219] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-23T21:08:38.328798] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T21:08:38.570945] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-23T21:08:38.602164] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-23T21:08:39.402257] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-23T21:08:39.533070] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-23T21:08:39.730925] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T21:08:39.778890] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T21:08:40.202224] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-23T21:08:41.002221] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-23T21:08:41.484683] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T21:08:41.801946] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T21:08:41.809269] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-23T21:08:41.810993] [INFO ] [REMOTE ] SARO: Full fetch complete (69005 records). [2025-09-23T21:08:41.811084] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-23T21:08:42.210435] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-23T21:08:42.210540] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-23T21:08:42.211805] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-23T21:08:42.211911] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-23T21:08:42.216122] [DEBUG] [LOCAL ] SARO: Trimmed 69005 records to 48800 (keeping 200 days of data) [2025-09-23T21:08:42.511561] [DEBUG] [LOCAL ] SARO: Primary data saved (48800 records). [2025-09-23T21:08:42.511713] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-23T21:08:42.511855] [INFO ] [MAIN ] Update Progress: 1871/2372 symbols completed. SARO took 33.8s. Estimated remaining: 1h 6m 35s. Rate: 7.5 symbols/min [2025-09-23T21:08:42.610024] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-23T21:08:42.683778] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:08:42.683934] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-23T21:08:42.683988] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-23T21:08:42.684126] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-23T21:08:42.684169] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-23T21:08:42.684211] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-23T21:08:42.684259] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-23T21:08:43.069957] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:08:43.070078] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T21:08:43.352627] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T21:08:43.402156] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-23T21:08:44.202199] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-23T21:08:44.472186] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:08:44.472608] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-23T21:08:44.928028] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T21:08:45.002189] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-23T21:08:45.802259] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-23T21:08:46.191844] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-23T21:08:46.582298] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T21:08:46.602173] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-23T21:08:46.986611] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-23T21:08:46.987418] [INFO ] [REMOTE ] SAY: Full fetch complete (1441 records). [2025-09-23T21:08:46.987505] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-23T21:08:46.988086] [FATAL] [VALIDATOR ] SAY: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:08:46.988201] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:08:46.988295] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:08:46.988379] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-23T21:08:46.988445] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-23T21:08:46.988495] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-23T21:08:46.988565] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-23T21:08:46.988695] [INFO ] [MAIN ] Update Progress: 1872/2372 symbols completed. SAY took 23.5s. Estimated remaining: 1h 6m 26s. Rate: 7.5 symbols/min [2025-09-23T21:08:47.170867] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:08:47.259996] [DEBUG] [LOCAL ] SBH: Loaded 49833 existing records from primary storage. [2025-09-23T21:08:47.260241] [INFO ] [MAIN ] SBH: Loaded 49833 existing records. [2025-09-23T21:08:47.410566] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-23T21:08:47.457594] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:08:47.457843] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-23T21:08:47.457905] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-23T21:08:47.458957] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-23T21:08:47.459021] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-23T21:08:47.833316] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:08:47.863622] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:08:47.863954] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-23T21:08:48.202188] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-23T21:08:48.591230] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T21:08:49.002229] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-23T21:08:49.394818] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T21:08:49.802214] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-23T21:08:50.602253] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-23T21:08:51.191298] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T21:08:51.223594] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T21:08:51.402229] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-23T21:08:52.202237] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-23T21:08:52.461478] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:08:52.461899] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-23T21:08:52.886062] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T21:08:53.002199] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-23T21:08:53.802217] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-23T21:08:54.065487] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:08:54.065856] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-23T21:08:54.514967] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T21:08:54.602199] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-23T21:08:54.856700] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:08:54.857083] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-23T21:08:55.402260] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-23T21:08:56.202185] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-23T21:08:56.458225] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:08:56.458565] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-23T21:08:57.002165] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-23T21:08:57.178843] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T21:08:57.253566] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:08:57.253927] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-23T21:08:57.802206] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-23T21:08:58.602262] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-23T21:08:59.402173] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-23T21:08:59.516718] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T21:08:59.970031] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T21:08:59.969767] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T21:09:00.202197] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-23T21:09:00.639664] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T21:09:01.002258] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-23T21:09:01.802225] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-23T21:09:02.485099] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T21:09:02.602196] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-23T21:09:02.776094] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T21:09:03.238826] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T21:09:03.402216] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-23T21:09:04.117796] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T21:09:04.119178] [INFO ] [REMOTE ] SBDS: Full fetch complete (1105 records). [2025-09-23T21:09:04.119249] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-23T21:09:04.207269] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-23T21:09:04.326872] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 43 unique days, need 200 days [2025-09-23T21:09:04.327083] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:09:04.327132] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:09:04.327193] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-23T21:09:04.327254] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-23T21:09:04.327289] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-23T21:09:04.327328] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-23T21:09:04.327403] [INFO ] [MAIN ] Update Progress: 1873/2372 symbols completed. SBDS took 21.8s. Estimated remaining: 1h 6m 21s. Rate: 7.5 symbols/min [2025-09-23T21:09:04.515594] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:04.530474] [DEBUG] [LOCAL ] SBI: Loaded 7763 existing records from primary storage. [2025-09-23T21:09:04.530622] [INFO ] [MAIN ] SBI: Loaded 7763 existing records. [2025-09-23T21:09:04.727956] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:09:04.728622] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-23T21:09:04.728700] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-23T21:09:04.729360] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-23T21:09:04.729704] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-23T21:09:05.007276] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-23T21:09:05.099215] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:09:05.802176] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-23T21:09:05.986057] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T21:09:06.288493] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T21:09:06.293971] [INFO ] [REMOTE ] SB: Full fetch complete (50584 records). [2025-09-23T21:09:06.294075] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-23T21:09:06.607099] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-23T21:09:06.632604] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T21:09:06.718105] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-23T21:09:06.718238] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-23T21:09:06.719568] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-23T21:09:06.719638] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-23T21:09:06.720875] [DEBUG] [LOCAL ] SB: Trimmed 50584 records to 33273 (keeping 200 days of data) [2025-09-23T21:09:06.927769] [DEBUG] [LOCAL ] SB: Primary data saved (33273 records). [2025-09-23T21:09:06.927922] [INFO ] [MAIN ] SB: Full history saved. [2025-09-23T21:09:06.928084] [INFO ] [MAIN ] Update Progress: 1874/2372 symbols completed. SB took 31.7s. Estimated remaining: 1h 6m 11s. Rate: 7.5 symbols/min [2025-09-23T21:09:07.109800] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:07.119934] [DEBUG] [LOCAL ] SBR: Loaded 7156 existing records from primary storage. [2025-09-23T21:09:07.120049] [INFO ] [MAIN ] SBR: Loaded 7156 existing records. [2025-09-23T21:09:07.383661] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:09:07.383907] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-23T21:09:07.383977] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-23T21:09:07.384384] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-23T21:09:07.384452] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-23T21:09:07.407383] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-23T21:09:07.772618] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:09:07.890817] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T21:09:08.202161] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-23T21:09:08.411593] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T21:09:08.582250] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T21:09:09.002231] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-23T21:09:09.802212] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-23T21:09:09.868207] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T21:09:10.602259] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-23T21:09:11.402240] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-23T21:09:11.854298] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T21:09:11.907681] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T21:09:12.202196] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-23T21:09:12.301088] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-23T21:09:12.910419] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T21:09:13.002245] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-23T21:09:13.798239] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T21:09:13.802133] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-23T21:09:14.602159] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-23T21:09:14.723959] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T21:09:15.402185] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-23T21:09:16.188700] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T21:09:16.212843] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-23T21:09:16.218409] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T21:09:16.901546] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T21:09:17.002241] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-23T21:09:17.799951] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T21:09:17.802205] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-23T21:09:18.549793] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T21:09:18.602158] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-23T21:09:19.269811] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T21:09:19.402195] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-23T21:09:20.202240] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-23T21:09:21.002211] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-23T21:09:21.129533] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T21:09:21.158165] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T21:09:21.305159] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-23T21:09:21.305960] [INFO ] [REMOTE ] SAZ: Full fetch complete (1809 records). [2025-09-23T21:09:21.306030] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-23T21:09:21.485792] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T21:09:21.485973] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:09:21.486043] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:09:21.486114] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-23T21:09:21.486180] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-23T21:09:21.486217] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-23T21:09:21.486272] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-23T21:09:21.486364] [INFO ] [MAIN ] Update Progress: 1875/2372 symbols completed. SAZ took 46.9s. Estimated remaining: 1h 6m 5s. Rate: 7.5 symbols/min [2025-09-23T21:09:21.653240] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:21.727780] [DEBUG] [LOCAL ] SBS: Loaded 49482 existing records from primary storage. [2025-09-23T21:09:21.727925] [INFO ] [MAIN ] SBS: Loaded 49482 existing records. [2025-09-23T21:09:21.807340] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-23T21:09:21.907522] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:09:21.907866] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-23T21:09:21.907923] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-23T21:09:21.909039] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-23T21:09:21.909100] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-23T21:09:22.259443] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:09:22.602248] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-23T21:09:23.402218] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-23T21:09:23.430924] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:09:23.903434] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T21:09:24.169126] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T21:09:24.202200] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-23T21:09:24.894792] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T21:09:24.897205] [INFO ] [REMOTE ] SBI: Full fetch complete (10719 records). [2025-09-23T21:09:24.897365] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-23T21:09:25.007567] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-23T21:09:25.472940] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-23T21:09:25.473040] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-23T21:09:25.473392] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-23T21:09:25.473489] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-23T21:09:25.474358] [DEBUG] [LOCAL ] SBI: Trimmed 10719 records to 7771 (keeping 200 days of data) [2025-09-23T21:09:25.545698] [DEBUG] [LOCAL ] SBI: Primary data saved (7771 records). [2025-09-23T21:09:25.545865] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-23T21:09:25.545978] [INFO ] [MAIN ] Update Progress: 1876/2372 symbols completed. SBI took 21.2s. Estimated remaining: 1h 5m 56s. Rate: 7.5 symbols/min [2025-09-23T21:09:25.768828] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:25.785268] [DEBUG] [LOCAL ] SBSI: Loaded 14714 existing records from primary storage. [2025-09-23T21:09:25.785447] [INFO ] [MAIN ] SBSI: Loaded 14714 existing records. [2025-09-23T21:09:25.807360] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-23T21:09:25.990070] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:09:25.990391] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-23T21:09:25.990451] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-23T21:09:25.990996] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-23T21:09:25.991060] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-23T21:09:26.380997] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:09:26.602203] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-23T21:09:26.787156] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T21:09:27.402182] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-23T21:09:27.592953] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T21:09:27.624540] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T21:09:27.633773] [INFO ] [REMOTE ] SBH: Full fetch complete (72797 records). [2025-09-23T21:09:27.633942] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-23T21:09:28.059026] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T21:09:28.058742] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-23T21:09:28.059194] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-23T21:09:28.062671] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-23T21:09:28.062749] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-23T21:09:28.064113] [DEBUG] [LOCAL ] SBH: Trimmed 72797 records to 49832 (keeping 200 days of data) [2025-09-23T21:09:28.241889] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-23T21:09:28.383189] [DEBUG] [LOCAL ] SBH: Primary data saved (49832 records). [2025-09-23T21:09:28.383376] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-23T21:09:28.383504] [INFO ] [MAIN ] Update Progress: 1877/2372 symbols completed. SBH took 41.4s. Estimated remaining: 1h 5m 47s. Rate: 7.5 symbols/min [2025-09-23T21:09:29.002193] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-23T21:09:29.247231] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T21:09:29.778172] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T21:09:29.802142] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-23T21:09:30.564379] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T21:09:30.602156] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-23T21:09:31.402239] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-23T21:09:31.426785] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T21:09:32.202182] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-23T21:09:33.010202] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-23T21:09:33.021379] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T21:09:33.020803] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T21:09:33.033711] [INFO ] [REMOTE ] SBR: Full fetch complete (11011 records). [2025-09-23T21:09:33.034969] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-23T21:09:33.405242] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-23T21:09:33.405329] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-23T21:09:33.405660] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-23T21:09:33.405724] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-23T21:09:33.406188] [DEBUG] [LOCAL ] SBR: Trimmed 11011 records to 7181 (keeping 200 days of data) [2025-09-23T21:09:33.450608] [DEBUG] [LOCAL ] SBR: Primary data saved (7181 records). [2025-09-23T21:09:33.450752] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-23T21:09:33.450844] [INFO ] [MAIN ] Update Progress: 1878/2372 symbols completed. SBR took 26.5s. Estimated remaining: 1h 5m 38s. Rate: 7.5 symbols/min [2025-09-23T21:09:33.802174] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-23T21:09:33.911034] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T21:09:34.602193] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-23T21:09:35.465266] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T21:09:35.474634] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-23T21:09:35.711488] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T21:09:36.202193] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-23T21:09:37.054309] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:09:37.066470] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-23T21:09:37.375129] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T21:09:37.802196] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-23T21:09:38.795305] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T21:09:38.829350] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-23T21:09:38.836726] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:09:39.402317] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-23T21:09:39.873918] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T21:09:40.202179] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-23T21:09:41.182152] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T21:09:41.194206] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-23T21:09:41.217632] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T21:09:41.802312] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-23T21:09:42.938866] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T21:09:42.949045] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-23T21:09:42.982871] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T21:09:43.402228] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-23T21:09:44.319560] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T21:09:44.322618] [INFO ] [REMOTE ] SBSI: Full fetch complete (21097 records). [2025-09-23T21:09:44.322727] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-23T21:09:44.701119] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-23T21:09:44.701231] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-23T21:09:44.701854] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-23T21:09:44.702029] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-23T21:09:44.702974] [DEBUG] [LOCAL ] SBSI: Trimmed 21097 records to 14715 (keeping 200 days of data) [2025-09-23T21:09:44.801887] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T21:09:44.814945] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-23T21:09:44.840914] [DEBUG] [LOCAL ] SBSI: Primary data saved (14715 records). [2025-09-23T21:09:44.841028] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-23T21:09:44.841121] [INFO ] [MAIN ] Update Progress: 1879/2372 symbols completed. SBSI took 19.3s. Estimated remaining: 1h 5m 31s. Rate: 7.5 symbols/min [2025-09-23T21:09:46.653982] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T21:09:46.664943] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-23T21:09:48.427268] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T21:09:48.435887] [INFO ] [REMOTE ] SBS: Full fetch complete (70164 records). [2025-09-23T21:09:48.436032] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-23T21:09:48.846329] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-23T21:09:48.846851] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-23T21:09:48.848495] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-23T21:09:48.848569] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-23T21:09:48.850477] [DEBUG] [LOCAL ] SBS: Trimmed 70164 records to 49477 (keeping 200 days of data) [2025-09-23T21:09:49.158050] [DEBUG] [LOCAL ] SBS: Primary data saved (49477 records). [2025-09-23T21:09:49.158202] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-23T21:09:49.158306] [INFO ] [MAIN ] Update Progress: 1880/2372 symbols completed. SBS took 27.7s. Estimated remaining: 1h 5m 22s. Rate: 7.5 symbols/min [2025-09-23T21:09:49.795828] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:49.786828] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:49.885448] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:49.904257] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:49.904885] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-23T21:09:49.904981] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-23T21:09:49.906320] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-23T21:09:49.906488] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-23T21:09:49.906560] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-23T21:09:49.906603] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-23T21:09:50.028731] [DEBUG] [LOCAL ] SCD: Loaded 12603 existing records from primary storage. [2025-09-23T21:09:50.040386] [INFO ] [MAIN ] SCD: Loaded 12603 existing records. [2025-09-23T21:09:50.312849] [DEBUG] [LOCAL ] SBSW: Loaded 52946 existing records from primary storage. [2025-09-23T21:09:50.330677] [INFO ] [MAIN ] SBSW: Loaded 52946 existing records. [2025-09-23T21:09:50.553297] [DEBUG] [LOCAL ] SCCO: Loaded 49398 existing records from primary storage. [2025-09-23T21:09:50.587921] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:09:50.629926] [INFO ] [MAIN ] SCCO: Loaded 49398 existing records. [2025-09-23T21:09:50.681224] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-23T21:09:50.694638] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:09:50.730100] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-23T21:09:50.753812] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-23T21:09:50.853934] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-23T21:09:50.854107] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-23T21:09:50.862480] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:09:50.884325] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-23T21:09:50.909580] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-23T21:09:50.949479] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-23T21:09:50.966438] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-23T21:09:51.136437] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:09:51.158619] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-23T21:09:51.173163] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T21:09:51.195294] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-23T21:09:51.201515] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-23T21:09:51.251601] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-23T21:09:51.267386] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-23T21:09:51.827047] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:09:51.876442] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-23T21:09:51.900453] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:09:51.896729] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T21:09:51.938826] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-23T21:09:51.958777] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-23T21:09:52.091282] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:09:52.091635] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-23T21:09:52.397491] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T21:09:52.398386] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-23T21:09:52.733141] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T21:09:52.733051] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T21:09:52.734101] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-23T21:09:52.737088] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-23T21:09:53.015829] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-23T21:09:53.016839] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-23T21:09:53.420796] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T21:09:53.528099] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T21:09:53.788998] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T21:09:53.802147] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-23T21:09:53.874998] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T21:09:54.602219] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-23T21:09:55.402231] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-23T21:09:55.668014] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-23T21:09:55.874773] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T21:09:55.958531] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T21:09:56.202187] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-23T21:09:56.863937] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T21:09:57.002202] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-23T21:09:57.802196] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-23T21:09:58.314076] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T21:09:58.602238] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-23T21:09:58.753618] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T21:09:58.921169] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-23T21:09:58.921997] [INFO ] [REMOTE ] SBXD: Full fetch complete (3082 records). [2025-09-23T21:09:58.922067] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-23T21:09:59.112843] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-23T21:09:59.113068] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:09:59.113140] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:09:59.113210] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-23T21:09:59.113298] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-23T21:09:59.113336] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-23T21:09:59.113375] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-23T21:09:59.113435] [INFO ] [MAIN ] Update Progress: 1881/2372 symbols completed. SBXD took 10.0s. Estimated remaining: 1h 5m 14s. Rate: 7.5 symbols/min [2025-09-23T21:09:59.293726] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:09:59.357342] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-23T21:09:59.357503] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-09-23T21:09:59.409836] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-23T21:09:59.543159] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:09:59.543464] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-23T21:09:59.543516] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-23T21:09:59.544960] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-23T21:09:59.545025] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-23T21:09:59.901717] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:10:00.202190] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-23T21:10:00.308565] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T21:10:01.002218] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-23T21:10:01.802247] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-23T21:10:02.125164] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-23T21:10:02.602182] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-23T21:10:03.081969] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-23T21:10:03.402201] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-23T21:10:03.443433] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T21:10:03.559909] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T21:10:04.202196] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-23T21:10:05.002184] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-23T21:10:05.468262] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-23T21:10:05.802232] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-23T21:10:06.095820] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T21:10:06.602202] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-23T21:10:07.032819] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-23T21:10:07.402180] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-23T21:10:07.502179] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T21:10:08.202194] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-23T21:10:08.475591] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T21:10:08.831274] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T21:10:09.002200] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-23T21:10:09.356934] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T21:10:09.802242] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-23T21:10:10.602281] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-23T21:10:11.402250] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-23T21:10:11.544187] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T21:10:11.636076] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-23T21:10:12.202176] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-23T21:10:12.244597] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T21:10:12.261451] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T21:10:13.002196] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-23T21:10:13.802175] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-23T21:10:14.045478] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T21:10:14.235465] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T21:10:14.602221] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-23T21:10:15.292620] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T21:10:15.402144] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-23T21:10:15.782959] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T21:10:16.202207] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-23T21:10:17.002245] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-23T21:10:17.356559] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T21:10:17.802220] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-23T21:10:17.875414] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T21:10:17.992924] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T21:10:18.602286] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-23T21:10:19.402201] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-23T21:10:19.558871] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T21:10:20.202211] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-23T21:10:20.566869] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T21:10:20.575623] [INFO ] [REMOTE ] SBSW: Full fetch complete (76468 records). [2025-09-23T21:10:20.575785] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-23T21:10:20.968123] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-23T21:10:20.968365] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-23T21:10:20.969505] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-23T21:10:20.969570] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-23T21:10:20.971067] [DEBUG] [LOCAL ] SBSW: Trimmed 76468 records to 52951 (keeping 200 days of data) [2025-09-23T21:10:21.016908] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-23T21:10:21.229888] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T21:10:21.315671] [DEBUG] [LOCAL ] SBSW: Primary data saved (52951 records). [2025-09-23T21:10:21.315803] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-23T21:10:21.315882] [INFO ] [MAIN ] Update Progress: 1882/2372 symbols completed. SBSW took 32.2s. Estimated remaining: 1h 5m 10s. Rate: 7.5 symbols/min [2025-09-23T21:10:21.484471] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:10:21.527261] [DEBUG] [LOCAL ] SCI: Loaded 46690 existing records from primary storage. [2025-09-23T21:10:21.527411] [INFO ] [MAIN ] SCI: Loaded 46690 existing records. [2025-09-23T21:10:21.704740] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:10:21.705043] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-23T21:10:21.705096] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-23T21:10:21.706299] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-23T21:10:21.706361] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-23T21:10:21.809365] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-23T21:10:22.012925] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T21:10:22.022004] [INFO ] [REMOTE ] SCD: Full fetch complete (16171 records). [2025-09-23T21:10:22.028840] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-23T21:10:22.141678] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:10:22.424554] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-23T21:10:22.516212] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-23T21:10:22.516293] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-23T21:10:22.516675] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-23T21:10:22.516736] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-23T21:10:22.517259] [DEBUG] [LOCAL ] SCD: Trimmed 16171 records to 12580 (keeping 200 days of data) [2025-09-23T21:10:22.592498] [DEBUG] [LOCAL ] SCD: Primary data saved (12580 records). [2025-09-23T21:10:22.592626] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-23T21:10:22.592745] [INFO ] [MAIN ] Update Progress: 1883/2372 symbols completed. SCD took 33.4s. Estimated remaining: 1h 5m 0s. Rate: 7.5 symbols/min [2025-09-23T21:10:22.607334] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-23T21:10:22.764869] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:10:22.780298] [DEBUG] [LOCAL ] SCL: Loaded 14740 existing records from primary storage. [2025-09-23T21:10:22.780416] [INFO ] [MAIN ] SCL: Loaded 14740 existing records. [2025-09-23T21:10:22.954501] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:10:22.954777] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-23T21:10:22.954834] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-23T21:10:22.955364] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-23T21:10:22.955457] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-23T21:10:23.314506] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:10:23.402149] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-23T21:10:23.531198] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T21:10:23.539573] [INFO ] [REMOTE ] SCCO: Full fetch complete (70692 records). [2025-09-23T21:10:23.539743] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-23T21:10:23.922149] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-23T21:10:23.922246] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-23T21:10:23.923323] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-23T21:10:23.923386] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-23T21:10:23.924806] [DEBUG] [LOCAL ] SCCO: Trimmed 70692 records to 49382 (keeping 200 days of data) [2025-09-23T21:10:24.203891] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-23T21:10:24.237593] [DEBUG] [LOCAL ] SCCO: Primary data saved (49382 records). [2025-09-23T21:10:24.238180] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-23T21:10:24.238553] [INFO ] [MAIN ] Update Progress: 1884/2372 symbols completed. SCCO took 35.1s. Estimated remaining: 1h 4m 51s. Rate: 7.5 symbols/min [2025-09-23T21:10:24.371829] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T21:10:24.460827] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T21:10:24.469094] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:10:24.494411] [DEBUG] [LOCAL ] SCM: Loaded 19870 existing records from primary storage. [2025-09-23T21:10:24.494578] [INFO ] [MAIN ] SCM: Loaded 19870 existing records. [2025-09-23T21:10:24.671545] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:10:24.671831] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-23T21:10:24.671882] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-23T21:10:24.672586] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-23T21:10:24.672679] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-23T21:10:25.006473] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-23T21:10:25.027256] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:10:25.802208] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-23T21:10:26.162815] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T21:10:26.163246] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T21:10:26.602241] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-23T21:10:26.622601] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T21:10:27.402208] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-23T21:10:27.600169] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T21:10:28.202206] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-23T21:10:29.002177] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-23T21:10:29.227909] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T21:10:29.619702] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T21:10:29.686732] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T21:10:29.802251] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-23T21:10:30.602216] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-23T21:10:31.402164] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-23T21:10:31.483398] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T21:10:31.573969] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T21:10:31.896878] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T21:10:32.202192] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-23T21:10:33.002206] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-23T21:10:33.280269] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T21:10:33.771755] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T21:10:33.785079] [INFO ] [REMOTE ] SCHW: Full fetch complete (77312 records). [2025-09-23T21:10:33.785343] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-23T21:10:33.786414] [FATAL] [VALIDATOR ] SCHW: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:10:33.786556] [FATAL] [MAIN ] SCHW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:10:33.786603] [WARN ] [MAIN ] SCHW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:10:33.786669] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-23T21:10:33.786773] [DEBUG] [LOCAL ] SCHW: No primary data file found to delete. [2025-09-23T21:10:33.786830] [INFO ] [LOCAL ] SCHW: Starting deletion of derivative data. [2025-09-23T21:10:33.787322] [DEBUG] [LOCAL ] SCHW: Deleted derivative data file. [2025-09-23T21:10:33.787435] [INFO ] [MAIN ] Update Progress: 1885/2372 symbols completed. SCHW took 34.7s. Estimated remaining: 1h 4m 43s. Rate: 7.5 symbols/min [2025-09-23T21:10:33.807983] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-23T21:10:33.958979] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:10:34.000818] [DEBUG] [LOCAL ] SCS: Loaded 42997 existing records from primary storage. [2025-09-23T21:10:34.000982] [INFO ] [MAIN ] SCS: Loaded 42997 existing records. [2025-09-23T21:10:34.182021] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:10:34.182324] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-23T21:10:34.182382] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-23T21:10:34.183819] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-23T21:10:34.183885] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-23T21:10:34.585550] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:10:34.602197] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-23T21:10:35.006494] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T21:10:35.402239] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-23T21:10:36.184951] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T21:10:36.202157] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-23T21:10:36.279015] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T21:10:37.002212] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-23T21:10:37.667531] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T21:10:37.802187] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-23T21:10:37.953858] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T21:10:38.602205] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-23T21:10:39.008496] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T21:10:39.402191] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-23T21:10:39.713353] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T21:10:40.202213] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-23T21:10:40.861062] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T21:10:40.935762] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T21:10:40.939103] [INFO ] [REMOTE ] SCL: Full fetch complete (20935 records). [2025-09-23T21:10:40.939185] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-23T21:10:41.007320] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-23T21:10:41.329163] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-23T21:10:41.329278] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-23T21:10:41.329892] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-23T21:10:41.329956] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-23T21:10:41.330613] [DEBUG] [LOCAL ] SCL: Trimmed 20935 records to 14790 (keeping 200 days of data) [2025-09-23T21:10:41.423030] [DEBUG] [LOCAL ] SCL: Primary data saved (14790 records). [2025-09-23T21:10:41.423179] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-23T21:10:41.423267] [INFO ] [MAIN ] Update Progress: 1886/2372 symbols completed. SCL took 18.8s. Estimated remaining: 1h 4m 35s. Rate: 7.5 symbols/min [2025-09-23T21:10:41.591987] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:10:41.622362] [DEBUG] [LOCAL ] SD: Loaded 29064 existing records from primary storage. [2025-09-23T21:10:41.622565] [INFO ] [MAIN ] SD: Loaded 29064 existing records. [2025-09-23T21:10:41.801088] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:10:41.801455] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-23T21:10:41.801535] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-23T21:10:41.802152] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-23T21:10:41.803009] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-23T21:10:41.803106] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-23T21:10:42.183203] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:10:42.322101] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T21:10:42.602222] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-23T21:10:43.402209] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-23T21:10:43.550521] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T21:10:43.942217] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T21:10:44.202179] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-23T21:10:44.564502] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T21:10:45.002199] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-23T21:10:45.378443] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T21:10:45.802237] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-23T21:10:46.056920] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T21:10:46.602249] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-23T21:10:47.363019] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T21:10:47.402148] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-23T21:10:48.202231] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-23T21:10:48.390814] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T21:10:49.004799] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-23T21:10:49.011369] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T21:10:49.057882] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T21:10:49.802243] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-23T21:10:50.162925] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T21:10:50.602252] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-23T21:10:50.726718] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T21:10:51.402212] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-23T21:10:51.948299] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T21:10:52.142075] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T21:10:52.202234] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-23T21:10:53.002211] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-23T21:10:53.253708] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T21:10:53.258548] [INFO ] [REMOTE ] SCM: Full fetch complete (28286 records). [2025-09-23T21:10:53.258822] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-23T21:10:53.763007] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-23T21:10:53.763115] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-23T21:10:53.763764] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-23T21:10:53.763828] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-23T21:10:53.767125] [DEBUG] [LOCAL ] SCM: Trimmed 28286 records to 19814 (keeping 200 days of data) [2025-09-23T21:10:53.818400] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-23T21:10:53.910281] [DEBUG] [LOCAL ] SCM: Primary data saved (19814 records). [2025-09-23T21:10:53.910449] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-23T21:10:53.910542] [INFO ] [MAIN ] Update Progress: 1887/2372 symbols completed. SCM took 29.7s. Estimated remaining: 1h 4m 28s. Rate: 7.5 symbols/min [2025-09-23T21:10:54.088907] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:10:54.102274] [DEBUG] [LOCAL ] SDHC: Loaded 10500 existing records from primary storage. [2025-09-23T21:10:54.102413] [INFO ] [MAIN ] SDHC: Loaded 10500 existing records. [2025-09-23T21:10:54.279554] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:10:54.279835] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-23T21:10:54.279887] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-23T21:10:54.280274] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-23T21:10:54.280335] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-23T21:10:54.585226] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:10:54.602831] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-23T21:10:54.674525] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:10:55.402167] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-23T21:10:55.639282] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-23T21:10:56.202156] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-23T21:10:56.396617] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T21:10:56.548770] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T21:10:57.002242] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-23T21:10:57.784466] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T21:10:57.795785] [INFO ] [REMOTE ] SCS: Full fetch complete (60008 records). [2025-09-23T21:10:57.795976] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-23T21:10:57.808715] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-23T21:10:58.149190] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T21:10:58.220834] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-23T21:10:58.220926] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-23T21:10:58.221971] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-23T21:10:58.222035] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-23T21:10:58.223347] [DEBUG] [LOCAL ] SCS: Trimmed 60008 records to 43081 (keeping 200 days of data) [2025-09-23T21:10:58.489368] [DEBUG] [LOCAL ] SCS: Primary data saved (43081 records). [2025-09-23T21:10:58.489511] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-23T21:10:58.489600] [INFO ] [MAIN ] Update Progress: 1888/2372 symbols completed. SCS took 24.7s. Estimated remaining: 1h 4m 20s. Rate: 7.5 symbols/min [2025-09-23T21:10:58.607259] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-23T21:10:58.672112] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:10:58.684699] [DEBUG] [LOCAL ] SDHY: Loaded 10631 existing records from primary storage. [2025-09-23T21:10:58.684839] [INFO ] [MAIN ] SDHY: Loaded 10631 existing records. [2025-09-23T21:10:58.863359] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:10:58.863606] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-23T21:10:58.863679] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-23T21:10:58.864112] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-23T21:10:58.864172] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-23T21:10:59.246558] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:10:59.335212] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T21:10:59.402150] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-23T21:10:59.601188] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T21:11:00.202253] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-23T21:11:01.002172] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-23T21:11:01.153004] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T21:11:01.402328] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T21:11:01.802175] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-23T21:11:02.010998] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T21:11:02.602210] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-23T21:11:02.674903] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T21:11:03.402247] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-23T21:11:04.003470] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T21:11:04.017712] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T21:11:04.202189] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-23T21:11:05.002205] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-23T21:11:05.539340] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T21:11:05.802230] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-23T21:11:06.564826] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T21:11:06.602230] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-23T21:11:06.769563] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:11:07.402227] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-23T21:11:07.491906] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T21:11:08.120577] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T21:11:08.202178] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-23T21:11:09.002194] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-23T21:11:09.011399] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T21:11:09.802206] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-23T21:11:10.362601] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T21:11:10.602175] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-23T21:11:10.645861] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T21:11:11.402244] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-23T21:11:11.421518] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T21:11:12.202167] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-23T21:11:12.576768] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T21:11:12.583280] [INFO ] [REMOTE ] SD: Full fetch complete (41131 records). [2025-09-23T21:11:12.583548] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-23T21:11:12.929735] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T21:11:13.008529] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-23T21:11:13.009679] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-23T21:11:13.011224] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-23T21:11:13.012595] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-23T21:11:13.012788] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-23T21:11:13.014523] [DEBUG] [LOCAL ] SD: Trimmed 41131 records to 29043 (keeping 200 days of data) [2025-09-23T21:11:13.223473] [DEBUG] [LOCAL ] SD: Primary data saved (29043 records). [2025-09-23T21:11:13.223697] [INFO ] [MAIN ] SD: Full history saved. [2025-09-23T21:11:13.223911] [INFO ] [MAIN ] Update Progress: 1889/2372 symbols completed. SD took 31.8s. Estimated remaining: 1h 4m 13s. Rate: 7.5 symbols/min [2025-09-23T21:11:13.411289] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:11:13.460544] [DEBUG] [LOCAL ] SDRL: Loaded 41998 existing records from primary storage. [2025-09-23T21:11:13.460851] [INFO ] [MAIN ] SDRL: Loaded 41998 existing records. [2025-09-23T21:11:13.649389] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:11:13.649771] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-23T21:11:13.649829] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-23T21:11:13.651258] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-23T21:11:13.651320] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-23T21:11:13.807411] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-23T21:11:13.967627] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T21:11:14.049436] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:11:14.602200] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-23T21:11:15.402204] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-23T21:11:15.437101] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T21:11:16.018880] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T21:11:16.021396] [INFO ] [REMOTE ] SDHY: Full fetch complete (16128 records). [2025-09-23T21:11:16.021539] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-23T21:11:16.209765] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-23T21:11:16.377139] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T21:11:16.461947] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-23T21:11:16.462026] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-23T21:11:16.462552] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-23T21:11:16.462676] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-23T21:11:16.463422] [DEBUG] [LOCAL ] SDHY: Trimmed 16128 records to 10534 (keeping 200 days of data) [2025-09-23T21:11:16.539804] [DEBUG] [LOCAL ] SDHY: Primary data saved (10534 records). [2025-09-23T21:11:16.539983] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-23T21:11:16.540128] [INFO ] [MAIN ] Update Progress: 1890/2372 symbols completed. SDHY took 18.1s. Estimated remaining: 1h 4m 4s. Rate: 7.5 symbols/min [2025-09-23T21:11:16.713717] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:11:16.784897] [DEBUG] [LOCAL ] SE: Loaded 53377 existing records from primary storage. [2025-09-23T21:11:16.785069] [INFO ] [MAIN ] SE: Loaded 53377 existing records. [2025-09-23T21:11:16.965302] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:11:16.965568] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-23T21:11:16.965618] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-23T21:11:16.967062] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-09-23T21:11:16.967142] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-23T21:11:17.012192] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-23T21:11:17.341261] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:11:17.802209] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-23T21:11:17.887830] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T21:11:18.304174] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T21:11:18.602245] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-23T21:11:18.648416] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T21:11:19.401143] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T21:11:19.404038] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-23T21:11:20.202190] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-23T21:11:21.002228] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-23T21:11:21.438759] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-23T21:11:21.697710] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T21:11:21.802197] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-23T21:11:21.934914] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T21:11:22.602162] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-23T21:11:22.678017] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T21:11:22.681364] [INFO ] [REMOTE ] SDHC: Full fetch complete (17015 records). [2025-09-23T21:11:22.681462] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-23T21:11:23.052436] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-23T21:11:23.052583] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-23T21:11:23.052985] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-23T21:11:23.053102] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-23T21:11:23.053635] [DEBUG] [LOCAL ] SDHC: Trimmed 17015 records to 10495 (keeping 200 days of data) [2025-09-23T21:11:23.120615] [DEBUG] [LOCAL ] SDHC: Primary data saved (10495 records). [2025-09-23T21:11:23.120825] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-23T21:11:23.120912] [INFO ] [MAIN ] Update Progress: 1891/2372 symbols completed. SDHC took 29.2s. Estimated remaining: 1h 3m 56s. Rate: 7.5 symbols/min [2025-09-23T21:11:23.296945] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:11:23.354828] [DEBUG] [LOCAL ] SEE: Loaded 48394 existing records from primary storage. [2025-09-23T21:11:23.354996] [INFO ] [MAIN ] SEE: Loaded 48394 existing records. [2025-09-23T21:11:23.411213] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-23T21:11:23.541212] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:11:23.541526] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-23T21:11:23.541591] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-23T21:11:23.543138] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-23T21:11:23.543203] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-23T21:11:23.917388] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:11:24.202224] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-23T21:11:24.573201] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T21:11:25.002171] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-23T21:11:25.088112] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T21:11:25.458842] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T21:11:25.802212] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-23T21:11:26.602240] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-23T21:11:27.146477] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-23T21:11:27.402167] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-23T21:11:27.453083] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T21:11:28.191436] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T21:11:28.199028] [INFO ] [REMOTE ] SCI: Full fetch complete (67179 records). [2025-09-23T21:11:28.199149] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-23T21:11:28.211604] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-23T21:11:28.596279] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-23T21:11:28.596379] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-23T21:11:28.597371] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-23T21:11:28.597436] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-23T21:11:28.599464] [DEBUG] [LOCAL ] SCI: Trimmed 67179 records to 46696 (keeping 200 days of data) [2025-09-23T21:11:28.912803] [DEBUG] [LOCAL ] SCI: Primary data saved (46696 records). [2025-09-23T21:11:28.912938] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-23T21:11:28.913036] [INFO ] [MAIN ] Update Progress: 1892/2372 symbols completed. SCI took 1m 8s. Estimated remaining: 1h 3m 47s. Rate: 7.5 symbols/min [2025-09-23T21:11:29.007259] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-23T21:11:29.118987] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:11:29.143581] [DEBUG] [LOCAL ] SEG: Loaded 13797 existing records from primary storage. [2025-09-23T21:11:29.143810] [INFO ] [MAIN ] SEG: Loaded 13797 existing records. [2025-09-23T21:11:29.370011] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:11:29.371441] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-23T21:11:29.371541] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-23T21:11:29.373159] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-23T21:11:29.373333] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-23T21:11:29.772167] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-23T21:11:29.903456] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-23T21:11:30.006285] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T21:11:30.126307] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:11:30.360328] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T21:11:30.602216] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-23T21:11:31.402227] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-23T21:11:32.082603] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T21:11:32.202186] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-23T21:11:32.387297] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-23T21:11:32.624280] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T21:11:33.002253] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-23T21:11:33.802243] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-23T21:11:33.847673] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T21:11:34.602211] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-23T21:11:34.703769] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T21:11:34.862752] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T21:11:35.402286] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-23T21:11:36.202225] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-23T21:11:36.320134] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T21:11:36.851144] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T21:11:37.002257] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-23T21:11:37.802165] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-23T21:11:37.923161] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T21:11:37.965879] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T21:11:38.602206] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-23T21:11:39.010072] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T21:11:39.402275] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-23T21:11:40.202186] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-23T21:11:40.426813] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T21:11:40.459479] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T21:11:41.002206] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-23T21:11:41.503378] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T21:11:41.655125] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T21:11:41.802201] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-23T21:11:42.602227] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-23T21:11:43.402205] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-23T21:11:43.714268] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-23T21:11:44.202289] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-23T21:11:45.002215] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-23T21:11:45.381402] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T21:11:45.389390] [INFO ] [REMOTE ] SDRL: Full fetch complete (61961 records). [2025-09-23T21:11:45.389596] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-23T21:11:45.519596] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-09-23T21:11:45.573734] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T21:11:45.807363] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-23T21:11:45.879323] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-23T21:11:45.879438] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-23T21:11:45.880573] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-23T21:11:45.880689] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-23T21:11:45.882231] [DEBUG] [LOCAL ] SDRL: Trimmed 61961 records to 41969 (keeping 200 days of data) [2025-09-23T21:11:46.140432] [DEBUG] [LOCAL ] SDRL: Primary data saved (41969 records). [2025-09-23T21:11:46.140577] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-23T21:11:46.140699] [INFO ] [MAIN ] Update Progress: 1893/2372 symbols completed. SDRL took 32.9s. Estimated remaining: 1h 3m 42s. Rate: 7.5 symbols/min [2025-09-23T21:11:46.312178] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:11:46.364759] [DEBUG] [LOCAL ] SEI: Loaded 49644 existing records from primary storage. [2025-09-23T21:11:46.364914] [INFO ] [MAIN ] SEI: Loaded 49644 existing records. [2025-09-23T21:11:46.553335] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:11:46.553596] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-23T21:11:46.553669] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-23T21:11:46.554892] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-23T21:11:46.554955] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-23T21:11:46.622234] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-23T21:11:46.918040] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T21:11:46.954874] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:11:46.985150] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T21:11:47.402241] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-23T21:11:48.202250] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-23T21:11:48.706487] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T21:11:48.766570] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T21:11:49.002167] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-23T21:11:49.159260] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T21:11:49.802265] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-23T21:11:50.602188] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-23T21:11:51.302830] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-23T21:11:51.343710] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T21:11:51.402156] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-23T21:11:51.611269] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T21:11:52.202317] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-23T21:11:52.966043] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T21:11:52.974610] [INFO ] [REMOTE ] SE: Full fetch complete (76682 records). [2025-09-23T21:11:52.974807] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-23T21:11:52.975806] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:11:52.975902] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:11:52.975960] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:11:52.976051] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-23T21:11:52.976133] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-23T21:11:52.976197] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-09-23T21:11:52.976765] [DEBUG] [LOCAL ] SE: Deleted derivative data file. [2025-09-23T21:11:52.976900] [INFO ] [MAIN ] Update Progress: 1894/2372 symbols completed. SE took 36.4s. Estimated remaining: 1h 3m 33s. Rate: 7.5 symbols/min [2025-09-23T21:11:53.007452] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-23T21:11:53.154155] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:11:53.200051] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T21:11:53.249581] [DEBUG] [LOCAL ] SEM: Loaded 42965 existing records from primary storage. [2025-09-23T21:11:53.249753] [INFO ] [MAIN ] SEM: Loaded 42965 existing records. [2025-09-23T21:11:53.425383] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:11:53.425671] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-23T21:11:53.425731] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-23T21:11:53.426792] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-23T21:11:53.426852] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-23T21:11:53.785072] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:11:53.802140] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-23T21:11:53.891678] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T21:11:53.893996] [INFO ] [REMOTE ] SEG: Full fetch complete (19765 records). [2025-09-23T21:11:53.894067] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-23T21:11:54.254808] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-23T21:11:54.254892] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-23T21:11:54.255293] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-23T21:11:54.255332] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-23T21:11:54.256312] [DEBUG] [LOCAL ] SEG: Trimmed 19765 records to 13771 (keeping 200 days of data) [2025-09-23T21:11:54.341165] [DEBUG] [LOCAL ] SEG: Primary data saved (13771 records). [2025-09-23T21:11:54.341319] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-23T21:11:54.341406] [INFO ] [MAIN ] Update Progress: 1895/2372 symbols completed. SEG took 25.4s. Estimated remaining: 1h 3m 24s. Rate: 7.5 symbols/min [2025-09-23T21:11:54.509129] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:11:54.551826] [DEBUG] [LOCAL ] SEMR: Loaded 41647 existing records from primary storage. [2025-09-23T21:11:54.551983] [INFO ] [MAIN ] SEMR: Loaded 41647 existing records. [2025-09-23T21:11:54.607997] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-23T21:11:54.742121] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:11:54.742380] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-23T21:11:54.742433] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-23T21:11:54.743409] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-23T21:11:54.743470] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-23T21:11:55.110394] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:11:55.384921] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T21:11:55.402155] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-23T21:11:56.202153] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-23T21:11:56.378706] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T21:11:56.964620] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T21:11:57.002147] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-23T21:11:57.669501] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T21:11:57.802199] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-23T21:11:58.602205] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-23T21:11:59.045740] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-23T21:11:59.402204] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-23T21:11:59.713019] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T21:11:59.721335] [INFO ] [REMOTE ] SEE: Full fetch complete (69546 records). [2025-09-23T21:11:59.721498] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-23T21:12:00.166710] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-23T21:12:00.166883] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-23T21:12:00.167993] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-23T21:12:00.168080] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-23T21:12:00.190166] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T21:12:00.197882] [DEBUG] [LOCAL ] SEE: Trimmed 69546 records to 48350 (keeping 200 days of data) [2025-09-23T21:12:00.202151] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-23T21:12:00.507778] [DEBUG] [LOCAL ] SEE: Primary data saved (48350 records). [2025-09-23T21:12:00.507933] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-23T21:12:00.508027] [INFO ] [MAIN ] Update Progress: 1896/2372 symbols completed. SEE took 37.4s. Estimated remaining: 1h 3m 15s. Rate: 7.5 symbols/min [2025-09-23T21:12:00.701157] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:12:00.751536] [DEBUG] [LOCAL ] SES: Loaded 51527 existing records from primary storage. [2025-09-23T21:12:00.751717] [INFO ] [MAIN ] SES: Loaded 51527 existing records. [2025-09-23T21:12:00.928537] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:12:00.928890] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-23T21:12:00.928945] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-23T21:12:00.930128] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-23T21:12:00.930189] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-23T21:12:01.007363] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-23T21:12:01.296819] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:12:01.756661] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-23T21:12:01.807278] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-23T21:12:01.825100] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T21:12:02.593364] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T21:12:02.602144] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-23T21:12:03.402202] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-23T21:12:03.982220] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-23T21:12:04.202208] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-23T21:12:04.237925] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T21:12:05.002178] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-23T21:12:05.170911] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T21:12:05.761336] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T21:12:05.802155] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-23T21:12:06.602214] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-23T21:12:06.713157] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T21:12:07.402238] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-23T21:12:08.202167] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-23T21:12:08.276757] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T21:12:08.393556] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-23T21:12:09.002180] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-23T21:12:09.116193] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T21:12:09.580630] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T21:12:09.802201] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-23T21:12:10.602214] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-23T21:12:11.402177] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-23T21:12:11.461566] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-23T21:12:11.776010] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T21:12:11.863783] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T21:12:12.202215] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-23T21:12:13.002161] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-23T21:12:13.040624] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T21:12:13.802175] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-23T21:12:13.943315] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T21:12:14.583395] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T21:12:14.602149] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-23T21:12:15.402190] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-23T21:12:16.202164] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-23T21:12:16.300893] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T21:12:16.597529] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-09-23T21:12:17.002235] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-23T21:12:17.277731] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T21:12:17.287274] [INFO ] [REMOTE ] SEI: Full fetch complete (69597 records). [2025-09-23T21:12:17.287467] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-23T21:12:17.750671] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-23T21:12:17.750901] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-23T21:12:17.752453] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-23T21:12:17.752552] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-23T21:12:17.781962] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T21:12:17.792061] [DEBUG] [LOCAL ] SEI: Trimmed 69597 records to 49651 (keeping 200 days of data) [2025-09-23T21:12:17.853862] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-23T21:12:18.135331] [DEBUG] [LOCAL ] SEI: Primary data saved (49651 records). [2025-09-23T21:12:18.135570] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-23T21:12:18.135753] [INFO ] [MAIN ] Update Progress: 1897/2372 symbols completed. SEI took 32.0s. Estimated remaining: 1h 3m 10s. Rate: 7.5 symbols/min [2025-09-23T21:12:18.322917] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:12:18.371026] [DEBUG] [LOCAL ] SF: Loaded 41888 existing records from primary storage. [2025-09-23T21:12:18.371237] [INFO ] [MAIN ] SF: Loaded 41888 existing records. [2025-09-23T21:12:18.611066] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-23T21:12:18.615044] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T21:12:18.615225] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:12:18.624793] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-23T21:12:18.624862] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-23T21:12:18.626075] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-23T21:12:18.626146] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-23T21:12:19.003486] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:12:19.402200] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-23T21:12:20.202267] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-23T21:12:20.230808] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-23T21:12:21.002191] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-23T21:12:21.949794] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (3.34 seconds). [2025-09-23T21:12:21.962016] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-23T21:12:22.704311] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (3.30 seconds). [2025-09-23T21:12:22.716338] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-23T21:12:23.010865] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-23T21:12:23.402197] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-23T21:12:23.741775] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-23T21:12:23.748503] [INFO ] [REMOTE ] SEM: Full fetch complete (61737 records). [2025-09-23T21:12:23.748676] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-23T21:12:24.150597] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-23T21:12:24.150719] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-23T21:12:24.151635] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-23T21:12:24.151715] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-23T21:12:24.153008] [DEBUG] [LOCAL ] SEM: Trimmed 61737 records to 42958 (keeping 200 days of data) [2025-09-23T21:12:24.418814] [DEBUG] [LOCAL ] SEM: Primary data saved (42958 records). [2025-09-23T21:12:24.418944] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-23T21:12:24.419043] [INFO ] [MAIN ] Update Progress: 1898/2372 symbols completed. SEM took 31.4s. Estimated remaining: 1h 3m 1s. Rate: 7.5 symbols/min [2025-09-23T21:12:24.599244] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:12:24.649685] [DEBUG] [LOCAL ] SFB: Loaded 4042 existing records from primary storage. [2025-09-23T21:12:24.650865] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T21:12:24.647076] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T21:12:24.658233] [INFO ] [MAIN ] SFB: Loaded 4042 existing records. [2025-09-23T21:12:24.678442] [INFO ] [REMOTE ] SEMR: Full fetch complete (58857 records). [2025-09-23T21:12:24.694230] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-23T21:12:24.729588] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-23T21:12:24.978386] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:12:24.999934] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-23T21:12:25.037500] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-23T21:12:25.076956] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-23T21:12:25.132516] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-23T21:12:25.433179] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-23T21:12:25.445845] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-23T21:12:25.471779] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-23T21:12:25.479274] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-23T21:12:25.579472] [DEBUG] [LOCAL ] SEMR: Trimmed 58857 records to 41612 (keeping 200 days of data) [2025-09-23T21:12:25.721802] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (3.76 seconds). [2025-09-23T21:12:25.794015] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:12:25.800843] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-23T21:12:25.806961] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-23T21:12:25.948295] [DEBUG] [LOCAL ] SEMR: Primary data saved (41612 records). [2025-09-23T21:12:25.948455] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-23T21:12:25.948553] [INFO ] [MAIN ] Update Progress: 1899/2372 symbols completed. SEMR took 31.6s. Estimated remaining: 1h 2m 52s. Rate: 7.5 symbols/min [2025-09-23T21:12:26.143370] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:12:26.144699] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T21:12:26.173102] [DEBUG] [LOCAL ] SFBS: Loaded 21276 existing records from primary storage. [2025-09-23T21:12:26.173241] [INFO ] [MAIN ] SFBS: Loaded 21276 existing records. [2025-09-23T21:12:26.291119] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T21:12:26.366488] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:12:26.366791] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-23T21:12:26.366848] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-23T21:12:26.367392] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-23T21:12:26.367453] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-23T21:12:26.609814] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-23T21:12:26.742995] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:12:27.402201] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-23T21:12:28.107126] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T21:12:28.142540] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-23T21:12:28.202191] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-23T21:12:28.251178] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T21:12:29.002228] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-23T21:12:29.802203] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-23T21:12:29.949287] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T21:12:30.100628] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T21:12:30.602245] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-23T21:12:31.125726] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T21:12:31.360696] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T21:12:31.402207] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-23T21:12:32.202229] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-23T21:12:33.002167] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-23T21:12:33.326979] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T21:12:33.483335] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-23T21:12:33.802204] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-23T21:12:34.603553] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-23T21:12:34.603446] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T21:12:34.883317] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T21:12:35.353028] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T21:12:35.402186] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-23T21:12:36.070755] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-23T21:12:36.202203] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-23T21:12:37.002243] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-23T21:12:37.692206] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T21:12:37.802150] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-23T21:12:38.103749] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T21:12:38.602235] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-23T21:12:39.407842] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-23T21:12:39.426257] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T21:12:40.039493] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T21:12:40.202166] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-23T21:12:40.275889] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T21:12:41.002205] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-23T21:12:41.257184] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T21:12:41.265155] [INFO ] [REMOTE ] SES: Full fetch complete (74169 records). [2025-09-23T21:12:41.265307] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-23T21:12:41.266198] [FATAL] [VALIDATOR ] SES: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:12:41.266288] [FATAL] [MAIN ] SES: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:12:41.266333] [WARN ] [MAIN ] SES: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:12:41.266403] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-23T21:12:41.266534] [DEBUG] [LOCAL ] SES: No primary data file found to delete. [2025-09-23T21:12:41.266599] [INFO ] [LOCAL ] SES: Starting deletion of derivative data. [2025-09-23T21:12:41.267124] [DEBUG] [LOCAL ] SES: Deleted derivative data file. [2025-09-23T21:12:41.267255] [INFO ] [MAIN ] Update Progress: 1900/2372 symbols completed. SES took 40.8s. Estimated remaining: 1h 2m 46s. Rate: 7.5 symbols/min [2025-09-23T21:12:41.439956] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:12:41.481210] [DEBUG] [LOCAL ] SFL: Loaded 45361 existing records from primary storage. [2025-09-23T21:12:41.481359] [INFO ] [MAIN ] SFL: Loaded 45361 existing records. [2025-09-23T21:12:41.675439] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:12:41.675742] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-23T21:12:41.675800] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-23T21:12:41.676876] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-23T21:12:41.676940] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-23T21:12:41.815212] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-23T21:12:42.050547] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:12:42.264576] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T21:12:42.543784] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T21:12:42.602251] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-23T21:12:43.233132] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T21:12:43.402191] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-23T21:12:43.919916] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T21:12:44.202264] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-23T21:12:44.701372] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T21:12:44.702465] [INFO ] [REMOTE ] SFB: Full fetch complete (5715 records). [2025-09-23T21:12:44.702536] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-23T21:12:45.016005] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-23T21:12:45.057949] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-23T21:12:45.058039] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-23T21:12:45.058204] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-23T21:12:45.058243] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-23T21:12:45.058720] [DEBUG] [LOCAL ] SFB: Trimmed 5715 records to 4017 (keeping 200 days of data) [2025-09-23T21:12:45.083548] [DEBUG] [LOCAL ] SFB: Primary data saved (4017 records). [2025-09-23T21:12:45.083629] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-23T21:12:45.083739] [INFO ] [MAIN ] Update Progress: 1901/2372 symbols completed. SFB took 20.7s. Estimated remaining: 1h 2m 37s. Rate: 7.5 symbols/min [2025-09-23T21:12:45.250198] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:12:45.302678] [DEBUG] [LOCAL ] SG: Loaded 53458 existing records from primary storage. [2025-09-23T21:12:45.302840] [INFO ] [MAIN ] SG: Loaded 53458 existing records. [2025-09-23T21:12:45.480202] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:12:45.480512] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-23T21:12:45.480566] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-23T21:12:45.482448] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-23T21:12:45.482512] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-23T21:12:45.812785] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-23T21:12:45.835224] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:12:46.589558] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T21:12:46.596843] [INFO ] [REMOTE ] SF: Full fetch complete (59437 records). [2025-09-23T21:12:46.597060] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-23T21:12:46.609324] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-23T21:12:46.996392] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-23T21:12:46.996520] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-23T21:12:46.997621] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-23T21:12:46.997785] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-23T21:12:46.999275] [DEBUG] [LOCAL ] SF: Trimmed 59437 records to 41832 (keeping 200 days of data) [2025-09-23T21:12:47.121221] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T21:12:47.280441] [DEBUG] [LOCAL ] SF: Primary data saved (41832 records). [2025-09-23T21:12:47.280582] [INFO ] [MAIN ] SF: Full history saved. [2025-09-23T21:12:47.280686] [INFO ] [MAIN ] Update Progress: 1902/2372 symbols completed. SF took 29.1s. Estimated remaining: 1h 2m 27s. Rate: 7.5 symbols/min [2025-09-23T21:12:47.407349] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-23T21:12:47.451115] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:12:47.493860] [DEBUG] [LOCAL ] SGHC: Loaded 45611 existing records from primary storage. [2025-09-23T21:12:47.494015] [INFO ] [MAIN ] SGHC: Loaded 45611 existing records. [2025-09-23T21:12:47.671755] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:12:47.672046] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-23T21:12:47.672095] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-23T21:12:47.673243] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-23T21:12:47.673305] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-23T21:12:48.037282] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:12:48.064865] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T21:12:48.202188] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-23T21:12:49.002237] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-23T21:12:49.148773] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T21:12:49.375357] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T21:12:49.802176] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-23T21:12:50.130138] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T21:12:50.602237] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-23T21:12:51.402196] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-23T21:12:51.649520] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T21:12:52.094611] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T21:12:52.202229] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-23T21:12:52.487299] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T21:12:53.002236] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-23T21:12:53.802216] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-23T21:12:54.311057] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-23T21:12:54.602172] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-23T21:12:54.793587] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T21:12:54.858995] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T21:12:55.402193] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-23T21:12:56.202168] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-23T21:12:56.545601] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-23T21:12:56.943379] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T21:12:57.002207] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-23T21:12:57.802197] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-23T21:12:57.955433] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T21:12:58.581629] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:12:58.602157] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-23T21:12:58.946068] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T21:12:59.402199] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-23T21:13:00.202231] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-23T21:13:00.427736] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T21:13:01.009094] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-23T21:13:01.013972] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T21:13:01.291527] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T21:13:01.802197] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-23T21:13:02.463197] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T21:13:02.602209] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-23T21:13:03.389170] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T21:13:03.402164] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-23T21:13:04.190156] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T21:13:04.202140] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-23T21:13:05.002199] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-23T21:13:05.068426] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T21:13:05.802194] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-23T21:13:06.249624] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-23T21:13:06.324335] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T21:13:06.602236] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-23T21:13:06.922904] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T21:13:06.927335] [INFO ] [REMOTE ] SFBS: Full fetch complete (30300 records). [2025-09-23T21:13:06.927421] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-23T21:13:07.318381] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-23T21:13:07.318541] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-23T21:13:07.319327] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-23T21:13:07.319439] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-23T21:13:07.321120] [DEBUG] [LOCAL ] SFBS: Trimmed 30300 records to 21335 (keeping 200 days of data) [2025-09-23T21:13:07.420455] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-23T21:13:07.466031] [DEBUG] [LOCAL ] SFBS: Primary data saved (21335 records). [2025-09-23T21:13:07.466242] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-23T21:13:07.466387] [INFO ] [MAIN ] Update Progress: 1903/2372 symbols completed. SFBS took 41.5s. Estimated remaining: 1h 2m 22s. Rate: 7.5 symbols/min [2025-09-23T21:13:07.638379] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:13:07.638565] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-23T21:13:07.638602] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-23T21:13:07.638780] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-23T21:13:07.638833] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-23T21:13:07.638900] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-23T21:13:07.638939] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-23T21:13:08.014524] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:13:08.202197] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-23T21:13:08.458391] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:13:08.461718] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-23T21:13:08.463715] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T21:13:09.009203] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-23T21:13:09.029660] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T21:13:09.307957] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:13:09.308275] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-23T21:13:09.802203] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-23T21:13:10.602183] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-23T21:13:11.054123] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T21:13:11.402206] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-23T21:13:12.202207] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-23T21:13:12.638867] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T21:13:12.747492] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T21:13:13.002220] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-23T21:13:13.802218] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-23T21:13:13.969994] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T21:13:14.421062] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T21:13:14.437271] [INFO ] [REMOTE ] SFL: Full fetch complete (65390 records). [2025-09-23T21:13:14.437525] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-23T21:13:14.607488] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-23T21:13:15.043767] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-23T21:13:15.043944] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-23T21:13:15.046080] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-23T21:13:15.046186] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-23T21:13:15.048830] [DEBUG] [LOCAL ] SFL: Trimmed 65390 records to 45358 (keeping 200 days of data) [2025-09-23T21:13:15.407100] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-23T21:13:15.430904] [DEBUG] [LOCAL ] SFL: Primary data saved (45358 records). [2025-09-23T21:13:15.431063] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-23T21:13:15.431202] [INFO ] [MAIN ] Update Progress: 1904/2372 symbols completed. SFL took 34.2s. Estimated remaining: 1h 2m 14s. Rate: 7.5 symbols/min [2025-09-23T21:13:15.614492] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:13:15.625816] [DEBUG] [LOCAL ] SGU: Loaded 6675 existing records from primary storage. [2025-09-23T21:13:15.626123] [INFO ] [MAIN ] SGU: Loaded 6675 existing records. [2025-09-23T21:13:15.848739] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-23T21:13:15.854720] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:13:15.867444] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-23T21:13:15.867539] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-23T21:13:15.868453] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-23T21:13:15.868530] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-23T21:13:16.211707] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-23T21:13:16.258562] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:13:16.799824] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-23T21:13:17.002207] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-23T21:13:17.142943] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T21:13:17.155152] [INFO ] [REMOTE ] SGHC: Full fetch complete (63237 records). [2025-09-23T21:13:17.155339] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-23T21:13:17.605557] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-23T21:13:17.605725] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-23T21:13:17.606734] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-23T21:13:17.606799] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-23T21:13:17.609937] [DEBUG] [LOCAL ] SGHC: Trimmed 63237 records to 45684 (keeping 200 days of data) [2025-09-23T21:13:17.803770] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-23T21:13:17.908324] [DEBUG] [LOCAL ] SGHC: Primary data saved (45684 records). [2025-09-23T21:13:17.908516] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-23T21:13:17.908673] [INFO ] [MAIN ] Update Progress: 1905/2372 symbols completed. SGHC took 30.6s. Estimated remaining: 1h 2m 5s. Rate: 7.5 symbols/min [2025-09-23T21:13:18.092255] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:13:18.144533] [DEBUG] [LOCAL ] SHAK: Loaded 49195 existing records from primary storage. [2025-09-23T21:13:18.144749] [INFO ] [MAIN ] SHAK: Loaded 49195 existing records. [2025-09-23T21:13:18.375353] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:13:18.375814] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-23T21:13:18.378483] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-23T21:13:18.380518] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T21:13:18.380567] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-23T21:13:18.391187] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-23T21:13:18.603804] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-23T21:13:18.687436] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T21:13:18.779032] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:13:19.188323] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-23T21:13:19.197442] [INFO ] [REMOTE ] SG: Full fetch complete (77246 records). [2025-09-23T21:13:19.197588] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-23T21:13:19.407332] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-23T21:13:19.608554] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-23T21:13:19.608676] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-23T21:13:19.609817] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-23T21:13:19.609882] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-23T21:13:19.611403] [DEBUG] [LOCAL ] SG: Trimmed 77246 records to 53454 (keeping 200 days of data) [2025-09-23T21:13:19.956090] [DEBUG] [LOCAL ] SG: Primary data saved (53454 records). [2025-09-23T21:13:19.956251] [INFO ] [MAIN ] SG: Full history saved. [2025-09-23T21:13:19.956371] [INFO ] [MAIN ] Update Progress: 1906/2372 symbols completed. SG took 34.9s. Estimated remaining: 1h 1m 55s. Rate: 7.5 symbols/min [2025-09-23T21:13:20.143406] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:13:20.172976] [DEBUG] [LOCAL ] SHCO: Loaded 26179 existing records from primary storage. [2025-09-23T21:13:20.173123] [INFO ] [MAIN ] SHCO: Loaded 26179 existing records. [2025-09-23T21:13:20.207182] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-23T21:13:20.371632] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:13:20.372104] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-23T21:13:20.372177] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-23T21:13:20.373316] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-23T21:13:20.373377] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-23T21:13:20.486854] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T21:13:20.762151] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:13:20.798401] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-23T21:13:21.002195] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-23T21:13:21.802250] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-23T21:13:22.017231] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T21:13:22.602239] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-23T21:13:22.973499] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T21:13:23.048256] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T21:13:23.402184] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-23T21:13:24.123134] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T21:13:24.202170] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-23T21:13:24.875452] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T21:13:25.002196] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-23T21:13:25.566527] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T21:13:25.802199] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-23T21:13:25.933759] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T21:13:26.602267] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-23T21:13:27.358567] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T21:13:27.402149] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-23T21:13:28.037727] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T21:13:28.202202] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-23T21:13:28.912728] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T21:13:29.002259] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-23T21:13:29.449242] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T21:13:29.457815] [INFO ] [REMOTE ] SGI: Full fetch complete (57119 records). [2025-09-23T21:13:29.457925] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-23T21:13:29.658174] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 151 unique days, need 200 days [2025-09-23T21:13:29.658783] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:13:29.658854] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:13:29.658902] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-23T21:13:29.658960] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-23T21:13:29.659004] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-23T21:13:29.659042] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-23T21:13:29.659112] [INFO ] [MAIN ] Update Progress: 1907/2372 symbols completed. SGI took 22.2s. Estimated remaining: 1h 1m 48s. Rate: 7.5 symbols/min [2025-09-23T21:13:29.826238] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-23T21:13:29.829461] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:13:29.892395] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-09-23T21:13:29.892561] [INFO ] [MAIN ] SHEL: Loaded 53672 existing records. [2025-09-23T21:13:30.075792] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:13:30.076020] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-23T21:13:30.076067] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-23T21:13:30.077665] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-23T21:13:30.077726] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-23T21:13:30.440004] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:13:30.504078] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T21:13:30.602166] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-23T21:13:30.849681] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-23T21:13:31.067316] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T21:13:31.402235] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-23T21:13:32.202180] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-23T21:13:33.002159] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-23T21:13:33.333032] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T21:13:33.495916] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-23T21:13:33.513848] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-23T21:13:33.802252] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-23T21:13:34.602250] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-23T21:13:35.402235] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-23T21:13:35.424439] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T21:13:35.460584] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T21:13:36.202235] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-23T21:13:36.743532] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T21:13:36.743851] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T21:13:37.002243] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-23T21:13:37.791755] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T21:13:37.802181] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-23T21:13:38.602244] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-23T21:13:38.702636] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T21:13:39.402257] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-23T21:13:40.202213] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-23T21:13:40.366474] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T21:13:40.763627] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T21:13:40.765912] [INFO ] [REMOTE ] SGU: Full fetch complete (8938 records). [2025-09-23T21:13:40.766028] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-23T21:13:40.908435] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T21:13:41.007823] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-23T21:13:41.216477] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-23T21:13:41.216577] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-23T21:13:41.216934] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-23T21:13:41.216997] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-23T21:13:41.217580] [DEBUG] [LOCAL ] SGU: Trimmed 8938 records to 6650 (keeping 200 days of data) [2025-09-23T21:13:41.262583] [DEBUG] [LOCAL ] SGU: Primary data saved (6650 records). [2025-09-23T21:13:41.262828] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-23T21:13:41.263012] [INFO ] [MAIN ] Update Progress: 1908/2372 symbols completed. SGU took 25.8s. Estimated remaining: 1h 1m 41s. Rate: 7.5 symbols/min [2025-09-23T21:13:41.457378] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:13:41.489733] [DEBUG] [LOCAL ] SHG: Loaded 27156 existing records from primary storage. [2025-09-23T21:13:41.489947] [INFO ] [MAIN ] SHG: Loaded 27156 existing records. [2025-09-23T21:13:41.705789] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:13:41.706126] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-23T21:13:41.706180] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-23T21:13:41.707080] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-23T21:13:41.707146] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-23T21:13:41.807397] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-23T21:13:42.095744] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:13:42.602293] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-23T21:13:42.898992] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T21:13:43.402215] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-23T21:13:43.755605] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T21:13:43.944789] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T21:13:44.202249] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-23T21:13:45.002171] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-23T21:13:45.152364] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T21:13:45.160570] [INFO ] [REMOTE ] SHAK: Full fetch complete (69992 records). [2025-09-23T21:13:45.160742] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-23T21:13:45.561708] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-23T21:13:45.561805] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-23T21:13:45.562897] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-23T21:13:45.562967] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-23T21:13:45.564474] [DEBUG] [LOCAL ] SHAK: Trimmed 69992 records to 49171 (keeping 200 days of data) [2025-09-23T21:13:45.802311] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-23T21:13:45.869433] [DEBUG] [LOCAL ] SHAK: Primary data saved (49171 records). [2025-09-23T21:13:45.869579] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-23T21:13:45.869710] [INFO ] [MAIN ] Update Progress: 1909/2372 symbols completed. SHAK took 28.0s. Estimated remaining: 1h 1m 32s. Rate: 7.5 symbols/min [2025-09-23T21:13:46.048184] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:13:46.093941] [DEBUG] [LOCAL ] SHO: Loaded 49833 existing records from primary storage. [2025-09-23T21:13:46.094106] [INFO ] [MAIN ] SHO: Loaded 49833 existing records. [2025-09-23T21:13:46.280895] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:13:46.291797] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-23T21:13:46.306296] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-23T21:13:46.312803] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-23T21:13:46.312879] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-23T21:13:46.322872] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-23T21:13:46.521951] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T21:13:46.607293] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-23T21:13:46.663273] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T21:13:46.752319] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:13:47.402236] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-23T21:13:48.116543] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T21:13:48.202200] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-23T21:13:49.002159] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-23T21:13:49.238789] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T21:13:49.571001] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T21:13:49.802192] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-23T21:13:50.294311] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T21:13:50.602200] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-23T21:13:51.119997] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T21:13:51.402282] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-23T21:13:51.991590] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T21:13:52.202255] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-23T21:13:52.800105] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T21:13:53.002206] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-23T21:13:53.417803] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T21:13:53.802243] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-23T21:13:53.826397] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T21:13:54.602199] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-23T21:13:55.113604] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T21:13:55.119194] [INFO ] [REMOTE ] SHCO: Full fetch complete (37423 records). [2025-09-23T21:13:55.119312] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-23T21:13:55.412185] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-23T21:13:55.509302] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-23T21:13:55.509428] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-23T21:13:55.510386] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-23T21:13:55.510453] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-23T21:13:55.511473] [DEBUG] [LOCAL ] SHCO: Trimmed 37423 records to 26193 (keeping 200 days of data) [2025-09-23T21:13:55.663408] [DEBUG] [LOCAL ] SHCO: Primary data saved (26193 records). [2025-09-23T21:13:55.663581] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-23T21:13:55.663729] [INFO ] [MAIN ] Update Progress: 1910/2372 symbols completed. SHCO took 35.7s. Estimated remaining: 1h 1m 24s. Rate: 7.5 symbols/min [2025-09-23T21:13:55.863215] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:13:55.864592] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T21:13:55.875896] [DEBUG] [LOCAL ] SHOC: Loaded 3890 existing records from primary storage. [2025-09-23T21:13:55.876018] [INFO ] [MAIN ] SHOC: Loaded 3890 existing records. [2025-09-23T21:13:56.069199] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:13:56.069499] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-23T21:13:56.069552] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-23T21:13:56.069821] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-23T21:13:56.069883] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-23T21:13:56.208943] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-23T21:13:56.468171] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:13:57.002230] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-23T21:13:57.069803] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T21:13:57.802257] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-23T21:13:58.212486] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T21:13:58.322314] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T21:13:58.602194] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-23T21:13:59.250005] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T21:13:59.402254] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-23T21:14:00.202235] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-23T21:14:00.538546] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T21:14:01.002174] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-23T21:14:01.033668] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T21:14:01.111944] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T21:14:01.802215] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-23T21:14:02.474627] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T21:14:02.602200] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-23T21:14:03.143197] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-23T21:14:03.402302] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-23T21:14:04.202218] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-23T21:14:04.411978] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T21:14:04.878625] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T21:14:05.002191] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-23T21:14:05.669326] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-23T21:14:05.672148] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-23T21:14:05.802187] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-23T21:14:06.602219] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-23T21:14:07.402279] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-23T21:14:07.801501] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T21:14:07.935730] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T21:14:07.985348] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-23T21:14:08.202195] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-23T21:14:09.002193] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-23T21:14:09.422081] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T21:14:09.426799] [INFO ] [REMOTE ] SHG: Full fetch complete (41429 records). [2025-09-23T21:14:09.426935] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-23T21:14:09.809723] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-23T21:14:09.812906] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-23T21:14:09.813061] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-23T21:14:09.813988] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-23T21:14:09.814060] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-23T21:14:09.815080] [DEBUG] [LOCAL ] SHG: Trimmed 41429 records to 27061 (keeping 200 days of data) [2025-09-23T21:14:09.983543] [DEBUG] [LOCAL ] SHG: Primary data saved (27061 records). [2025-09-23T21:14:09.983710] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-23T21:14:09.983807] [INFO ] [MAIN ] Update Progress: 1911/2372 symbols completed. SHG took 28.7s. Estimated remaining: 1h 1m 18s. Rate: 7.5 symbols/min [2025-09-23T21:14:10.166227] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:14:10.219987] [DEBUG] [LOCAL ] SHW: Loaded 50514 existing records from primary storage. [2025-09-23T21:14:10.220139] [INFO ] [MAIN ] SHW: Loaded 50514 existing records. [2025-09-23T21:14:10.405793] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:14:10.406078] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-23T21:14:10.406128] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-23T21:14:10.407444] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-23T21:14:10.407507] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-23T21:14:10.608784] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-23T21:14:10.794189] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T21:14:10.817955] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:14:11.233670] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T21:14:11.402248] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-23T21:14:11.749170] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-23T21:14:12.011375] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T21:14:12.202253] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-23T21:14:13.002208] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-23T21:14:13.674866] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T21:14:13.802212] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-23T21:14:14.019460] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T21:14:14.028553] [INFO ] [REMOTE ] SHEL: Full fetch complete (77691 records). [2025-09-23T21:14:14.028757] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-23T21:14:14.435569] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-23T21:14:14.435718] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-23T21:14:14.436793] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-23T21:14:14.436858] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-23T21:14:14.438339] [DEBUG] [LOCAL ] SHEL: Trimmed 77691 records to 53672 (keeping 200 days of data) [2025-09-23T21:14:14.627353] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-23T21:14:14.779527] [DEBUG] [LOCAL ] SHEL: Primary data saved (53672 records). [2025-09-23T21:14:14.779690] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-23T21:14:14.779802] [INFO ] [MAIN ] Update Progress: 1912/2372 symbols completed. SHEL took 45.1s. Estimated remaining: 1h 1m 9s. Rate: 7.5 symbols/min [2025-09-23T21:14:14.973062] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:14:14.973214] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-23T21:14:14.973249] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-23T21:14:14.973388] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-23T21:14:14.973429] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-23T21:14:14.973474] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-23T21:14:14.973505] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-23T21:14:15.239910] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T21:14:15.246501] [INFO ] [REMOTE ] SHOC: Full fetch complete (7496 records). [2025-09-23T21:14:15.263665] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-23T21:14:15.432152] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:14:15.414105] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-23T21:14:15.549025] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T21:14:15.794928] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-23T21:14:15.795007] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-23T21:14:15.795212] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-23T21:14:15.795252] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-23T21:14:15.795691] [DEBUG] [LOCAL ] SHOC: Trimmed 7496 records to 3779 (keeping 200 days of data) [2025-09-23T21:14:15.818357] [DEBUG] [LOCAL ] SHOC: Primary data saved (3779 records). [2025-09-23T21:14:15.818422] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-23T21:14:15.818494] [INFO ] [MAIN ] Update Progress: 1913/2372 symbols completed. SHOC took 20.2s. Estimated remaining: 1h 0m 60s. Rate: 7.5 symbols/min [2025-09-23T21:14:15.992461] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:14:16.033981] [DEBUG] [LOCAL ] SID: Loaded 42208 existing records from primary storage. [2025-09-23T21:14:16.034122] [INFO ] [MAIN ] SID: Loaded 42208 existing records. [2025-09-23T21:14:16.210414] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-23T21:14:16.215946] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:14:16.216923] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-23T21:14:16.216979] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-23T21:14:16.218858] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-23T21:14:16.218920] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-23T21:14:16.585007] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:14:16.683043] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:14:16.683318] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-23T21:14:17.002212] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-23T21:14:17.474909] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-23T21:14:17.802199] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-23T21:14:18.602170] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-23T21:14:18.741826] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T21:14:19.297186] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T21:14:19.402175] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-23T21:14:20.202187] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-23T21:14:20.484568] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T21:14:21.002193] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-23T21:14:21.191411] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T21:14:21.523067] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T21:14:21.802190] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-23T21:14:22.062188] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:14:22.062527] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-23T21:14:22.320892] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T21:14:22.602209] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-23T21:14:23.402216] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-23T21:14:24.202286] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-23T21:14:24.492068] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:14:24.492389] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-23T21:14:24.654495] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-23T21:14:24.719215] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T21:14:24.727665] [INFO ] [REMOTE ] SHO: Full fetch complete (71167 records). [2025-09-23T21:14:24.727806] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-23T21:14:25.007310] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-23T21:14:25.132623] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-23T21:14:25.132737] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-23T21:14:25.133782] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-23T21:14:25.133844] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-23T21:14:25.135300] [DEBUG] [LOCAL ] SHO: Trimmed 71167 records to 49816 (keeping 200 days of data) [2025-09-23T21:14:25.432482] [DEBUG] [LOCAL ] SHO: Primary data saved (49816 records). [2025-09-23T21:14:25.432628] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-23T21:14:25.432766] [INFO ] [MAIN ] Update Progress: 1914/2372 symbols completed. SHO took 39.6s. Estimated remaining: 1h 0m 52s. Rate: 7.5 symbols/min [2025-09-23T21:14:25.607771] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:14:25.662972] [DEBUG] [LOCAL ] SIG: Loaded 46617 existing records from primary storage. [2025-09-23T21:14:25.663223] [INFO ] [MAIN ] SIG: Loaded 46617 existing records. [2025-09-23T21:14:25.817122] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-23T21:14:25.860987] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:14:25.861217] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-23T21:14:25.861265] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-23T21:14:25.862414] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-23T21:14:25.862479] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-23T21:14:26.252727] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:14:26.470808] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T21:14:26.602199] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-23T21:14:26.858509] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:14:26.858888] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-23T21:14:27.402199] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-23T21:14:27.982363] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T21:14:28.202221] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-23T21:14:28.864129] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T21:14:29.002237] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-23T21:14:29.259001] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:14:29.259302] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-23T21:14:29.802202] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-23T21:14:29.845109] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T21:14:30.072684] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:14:30.073024] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-23T21:14:30.602213] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-23T21:14:31.402197] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-23T21:14:32.202174] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-23T21:14:32.228397] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T21:14:33.002216] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-23T21:14:33.199345] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T21:14:33.267009] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:14:33.267401] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-23T21:14:33.802174] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-23T21:14:34.023254] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T21:14:34.602271] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-23T21:14:35.067414] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T21:14:35.402182] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-23T21:14:35.514998] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T21:14:36.202176] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-23T21:14:36.230935] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T21:14:37.002226] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-23T21:14:37.687054] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T21:14:37.802201] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-23T21:14:38.542158] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T21:14:38.602190] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-23T21:14:38.858670] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T21:14:38.861915] [INFO ] [REMOTE ] SI: Full fetch complete (5658 records). [2025-09-23T21:14:38.861986] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-23T21:14:39.062112] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 38 unique days, need 200 days [2025-09-23T21:14:39.062344] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:14:39.062414] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:14:39.062462] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-23T21:14:39.062545] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-23T21:14:39.062599] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-23T21:14:39.062678] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-23T21:14:39.062771] [INFO ] [MAIN ] Update Progress: 1915/2372 symbols completed. SI took 24.3s. Estimated remaining: 1h 0m 45s. Rate: 7.5 symbols/min [2025-09-23T21:14:39.238268] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:14:39.261001] [DEBUG] [LOCAL ] SII: Loaded 23172 existing records from primary storage. [2025-09-23T21:14:39.261162] [INFO ] [MAIN ] SII: Loaded 23172 existing records. [2025-09-23T21:14:39.407400] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-23T21:14:39.448693] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:14:39.448958] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-23T21:14:39.449004] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-23T21:14:39.449681] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-23T21:14:39.449745] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-23T21:14:39.812554] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:14:40.202197] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-23T21:14:40.487232] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T21:14:40.744029] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T21:14:41.002208] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-23T21:14:41.204215] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T21:14:41.802263] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-23T21:14:42.602212] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-23T21:14:42.766948] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T21:14:42.805892] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T21:14:43.208705] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T21:14:43.402201] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-23T21:14:44.202222] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-23T21:14:45.002204] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-23T21:14:45.299499] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T21:14:45.327244] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T21:14:45.802258] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-23T21:14:46.602206] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-23T21:14:46.738236] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T21:14:46.746754] [INFO ] [REMOTE ] SHW: Full fetch complete (73017 records). [2025-09-23T21:14:46.746940] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-23T21:14:47.140495] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-23T21:14:47.140615] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-23T21:14:47.141636] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-23T21:14:47.141719] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-23T21:14:47.143152] [DEBUG] [LOCAL ] SHW: Trimmed 73017 records to 50480 (keeping 200 days of data) [2025-09-23T21:14:47.402358] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-23T21:14:47.500494] [DEBUG] [LOCAL ] SHW: Primary data saved (50480 records). [2025-09-23T21:14:47.503540] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-23T21:14:47.503673] [INFO ] [MAIN ] Update Progress: 1916/2372 symbols completed. SHW took 37.5s. Estimated remaining: 1h 0m 38s. Rate: 7.5 symbols/min [2025-09-23T21:14:47.526788] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T21:14:47.690684] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:14:47.703509] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T21:14:47.735914] [DEBUG] [LOCAL ] SILA: Loaded 31305 existing records from primary storage. [2025-09-23T21:14:47.736050] [INFO ] [MAIN ] SILA: Loaded 31305 existing records. [2025-09-23T21:14:47.910708] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:14:47.910992] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-23T21:14:47.911042] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-23T21:14:47.911896] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-23T21:14:47.911956] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-23T21:14:48.207259] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-23T21:14:48.263986] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:14:49.002225] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-23T21:14:49.184893] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T21:14:49.240793] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T21:14:49.802224] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-23T21:14:50.540804] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T21:14:50.602213] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-23T21:14:50.933158] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T21:14:50.939958] [INFO ] [REMOTE ] SID: Full fetch complete (60858 records). [2025-09-23T21:14:50.940075] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-23T21:14:51.333192] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-23T21:14:51.333271] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-23T21:14:51.334278] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-23T21:14:51.334352] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-23T21:14:51.335701] [DEBUG] [LOCAL ] SID: Trimmed 60858 records to 42227 (keeping 200 days of data) [2025-09-23T21:14:51.418705] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-23T21:14:51.587444] [DEBUG] [LOCAL ] SID: Primary data saved (42227 records). [2025-09-23T21:14:51.587589] [INFO ] [MAIN ] SID: Full history saved. [2025-09-23T21:14:51.587725] [INFO ] [MAIN ] Update Progress: 1917/2372 symbols completed. SID took 35.8s. Estimated remaining: 1h 0m 29s. Rate: 7.5 symbols/min [2025-09-23T21:14:51.895576] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T21:14:52.202239] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-23T21:14:52.849772] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T21:14:53.002177] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-23T21:14:53.561740] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T21:14:53.802274] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-23T21:14:54.564509] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T21:14:54.602173] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-23T21:14:54.817454] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T21:14:55.402214] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-23T21:14:56.202175] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-23T21:14:56.339847] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T21:14:56.406172] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T21:14:57.002195] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-23T21:14:57.132230] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T21:14:57.802212] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-23T21:14:58.426491] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T21:14:58.602170] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-23T21:14:59.228099] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T21:14:59.402159] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-23T21:15:00.033229] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T21:15:00.202186] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-23T21:15:01.002205] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-23T21:15:01.038421] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T21:15:01.046983] [INFO ] [REMOTE ] SIG: Full fetch complete (68327 records). [2025-09-23T21:15:01.047142] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-23T21:15:01.460355] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-23T21:15:01.460441] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-23T21:15:01.461419] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-23T21:15:01.461482] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-23T21:15:01.462865] [DEBUG] [LOCAL ] SIG: Trimmed 68327 records to 46565 (keeping 200 days of data) [2025-09-23T21:15:01.730155] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T21:15:01.784339] [DEBUG] [LOCAL ] SIG: Primary data saved (46565 records). [2025-09-23T21:15:01.784522] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-23T21:15:01.784609] [INFO ] [MAIN ] Update Progress: 1918/2372 symbols completed. SIG took 36.4s. Estimated remaining: 1h 0m 21s. Rate: 7.5 symbols/min [2025-09-23T21:15:01.802154] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-23T21:15:02.197367] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T21:15:02.602200] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-23T21:15:04.134349] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-23T21:15:04.140804] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-23T21:15:05.195102] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-23T21:15:05.200866] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-23T21:15:06.028206] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T21:15:06.035405] [INFO ] [REMOTE ] SILA: Full fetch complete (45309 records). [2025-09-23T21:15:06.035537] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-23T21:15:06.488136] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T21:15:06.487022] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-23T21:15:06.493016] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-23T21:15:06.495072] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-23T21:15:06.495315] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-23T21:15:06.496031] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-23T21:15:06.499778] [DEBUG] [LOCAL ] SILA: Trimmed 45309 records to 31402 (keeping 200 days of data) [2025-09-23T21:15:06.709244] [DEBUG] [LOCAL ] SILA: Primary data saved (31402 records). [2025-09-23T21:15:06.709399] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-23T21:15:06.709554] [INFO ] [MAIN ] Update Progress: 1919/2372 symbols completed. SILA took 19.2s. Estimated remaining: 1h 0m 13s. Rate: 7.5 symbols/min [2025-09-23T21:15:07.689215] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T21:15:07.693257] [INFO ] [REMOTE ] SII: Full fetch complete (29654 records). [2025-09-23T21:15:07.693344] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-23T21:15:08.087001] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-23T21:15:08.087085] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-23T21:15:08.087789] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-23T21:15:08.087852] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-23T21:15:08.088801] [DEBUG] [LOCAL ] SII: Trimmed 29654 records to 23252 (keeping 200 days of data) [2025-09-23T21:15:08.250884] [DEBUG] [LOCAL ] SII: Primary data saved (23252 records). [2025-09-23T21:15:08.251224] [INFO ] [MAIN ] SII: Full history saved. [2025-09-23T21:15:08.251679] [INFO ] [MAIN ] Update Progress: 1920/2372 symbols completed. SII took 29.2s. Estimated remaining: 1h 0m 3s. Rate: 7.5 symbols/min [2025-09-23T21:15:08.826372] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:09.006518] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:09.051426] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:09.097979] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:09.113366] [DEBUG] [LOCAL ] SJT: Loaded 21980 existing records from primary storage. [2025-09-23T21:15:09.113793] [INFO ] [MAIN ] SJT: Loaded 21980 existing records. [2025-09-23T21:15:09.332236] [DEBUG] [LOCAL ] SITE: Loaded 35218 existing records from primary storage. [2025-09-23T21:15:09.343079] [INFO ] [MAIN ] SITE: Loaded 35218 existing records. [2025-09-23T21:15:09.380385] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:09.400102] [DEBUG] [LOCAL ] SITC: Loaded 41544 existing records from primary storage. [2025-09-23T21:15:09.411003] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-23T21:15:09.437796] [INFO ] [MAIN ] SITC: Loaded 41544 existing records. [2025-09-23T21:15:09.437621] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-23T21:15:09.515993] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-23T21:15:09.577251] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-23T21:15:09.594294] [DEBUG] [LOCAL ] SJM: Loaded 50126 existing records from primary storage. [2025-09-23T21:15:09.605225] [INFO ] [MAIN ] SJM: Loaded 50126 existing records. [2025-09-23T21:15:09.901732] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:09.958431] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-23T21:15:09.991533] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-23T21:15:10.016480] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-23T21:15:10.038899] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-23T21:15:10.110775] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:10.315807] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-23T21:15:10.371960] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-23T21:15:10.396353] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:10.400214] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-23T21:15:10.405817] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-23T21:15:10.406155] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-23T21:15:10.447567] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-23T21:15:10.432150] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-23T21:15:10.452992] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-23T21:15:10.621010] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:10.678574] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-23T21:15:11.101856] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:11.131248] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-23T21:15:11.522188] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:11.522953] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-23T21:15:11.543236] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:11.543513] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-23T21:15:12.261862] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T21:15:12.267626] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-23T21:15:12.356127] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T21:15:12.362002] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-23T21:15:12.921890] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T21:15:12.931964] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-23T21:15:13.338232] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T21:15:13.348516] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-23T21:15:13.386372] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T21:15:13.390741] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-23T21:15:13.707226] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T21:15:13.713486] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-23T21:15:15.224479] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T21:15:15.229927] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-23T21:15:15.734455] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-09-23T21:15:15.744871] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-23T21:15:15.875369] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-23T21:15:15.884709] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-23T21:15:15.907317] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-23T21:15:16.202254] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-23T21:15:16.238108] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T21:15:17.002198] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-23T21:15:17.478387] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T21:15:17.551142] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T21:15:17.608493] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T21:15:17.807459] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-23T21:15:17.828542] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:15:18.602256] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-23T21:15:19.383344] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:15:19.402150] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-23T21:15:19.965230] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T21:15:20.202205] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-23T21:15:20.701673] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T21:15:21.002192] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-23T21:15:21.802175] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-23T21:15:21.898888] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T21:15:22.442037] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T21:15:22.602228] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-23T21:15:22.949235] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T21:15:23.402251] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-23T21:15:24.202243] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-23T21:15:24.381290] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T21:15:24.837119] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T21:15:25.002287] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-23T21:15:25.802210] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-23T21:15:26.043915] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T21:15:26.452310] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T21:15:26.602149] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-23T21:15:26.991810] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T21:15:27.402298] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-23T21:15:27.923368] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T21:15:28.202165] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-23T21:15:28.572282] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T21:15:29.002235] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-23T21:15:29.802196] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-23T21:15:30.068572] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T21:15:30.124832] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T21:15:30.130571] [INFO ] [REMOTE ] SJT: Full fetch complete (32243 records). [2025-09-23T21:15:30.130686] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-23T21:15:30.506897] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-23T21:15:30.506979] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-23T21:15:30.507660] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-23T21:15:30.507721] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-23T21:15:30.508496] [DEBUG] [LOCAL ] SJT: Trimmed 32243 records to 22089 (keeping 200 days of data) [2025-09-23T21:15:30.602510] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-23T21:15:30.643284] [DEBUG] [LOCAL ] SJT: Primary data saved (22089 records). [2025-09-23T21:15:30.643416] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-23T21:15:30.643518] [INFO ] [MAIN ] Update Progress: 1921/2372 symbols completed. SJT took 22.4s. Estimated remaining: 59m 58s. Rate: 7.5 symbols/min [2025-09-23T21:15:30.824052] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:30.865177] [DEBUG] [LOCAL ] SKE: Loaded 35517 existing records from primary storage. [2025-09-23T21:15:30.865345] [INFO ] [MAIN ] SKE: Loaded 35517 existing records. [2025-09-23T21:15:31.045787] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:31.046109] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-23T21:15:31.046164] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-23T21:15:31.047173] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-23T21:15:31.047234] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-23T21:15:31.405524] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-23T21:15:31.410582] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:31.495054] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T21:15:32.151335] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T21:15:32.202201] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-23T21:15:33.002254] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-23T21:15:33.118409] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T21:15:33.645066] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T21:15:33.656107] [INFO ] [REMOTE ] SITE: Full fetch complete (49242 records). [2025-09-23T21:15:33.656270] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-23T21:15:33.807409] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-23T21:15:34.038110] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-23T21:15:34.038204] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-23T21:15:34.039108] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-23T21:15:34.039171] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-23T21:15:34.040317] [DEBUG] [LOCAL ] SITE: Trimmed 49242 records to 35140 (keeping 200 days of data) [2025-09-23T21:15:34.257575] [DEBUG] [LOCAL ] SITE: Primary data saved (35140 records). [2025-09-23T21:15:34.257763] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-23T21:15:34.257904] [INFO ] [MAIN ] Update Progress: 1922/2372 symbols completed. SITE took 26.0s. Estimated remaining: 59m 49s. Rate: 7.5 symbols/min [2025-09-23T21:15:34.435796] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:34.446925] [DEBUG] [LOCAL ] SKIL: Loaded 6382 existing records from primary storage. [2025-09-23T21:15:34.447045] [INFO ] [MAIN ] SKIL: Loaded 6382 existing records. [2025-09-23T21:15:34.628836] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:34.628982] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-23T21:15:34.630557] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-23T21:15:34.630712] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-23T21:15:34.631605] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-23T21:15:34.631694] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-23T21:15:34.830598] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T21:15:35.054866] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:35.246633] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T21:15:35.402191] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-23T21:15:36.202162] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-23T21:15:36.413713] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T21:15:36.799723] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T21:15:37.002250] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-23T21:15:37.735964] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T21:15:37.743864] [INFO ] [REMOTE ] SITC: Full fetch complete (60865 records). [2025-09-23T21:15:37.744012] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-23T21:15:37.813757] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-23T21:15:38.143068] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-23T21:15:38.143149] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-23T21:15:38.144081] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-23T21:15:38.144144] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-23T21:15:38.145344] [DEBUG] [LOCAL ] SITC: Trimmed 60865 records to 41556 (keeping 200 days of data) [2025-09-23T21:15:38.404422] [DEBUG] [LOCAL ] SITC: Primary data saved (41556 records). [2025-09-23T21:15:38.404553] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-23T21:15:38.404675] [INFO ] [MAIN ] Update Progress: 1923/2372 symbols completed. SITC took 30.2s. Estimated remaining: 59m 41s. Rate: 7.5 symbols/min [2025-09-23T21:15:38.585896] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:38.603862] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-23T21:15:38.606491] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T21:15:38.627266] [DEBUG] [LOCAL ] SKLZ: Loaded 12006 existing records from primary storage. [2025-09-23T21:15:38.627492] [INFO ] [MAIN ] SKLZ: Loaded 12006 existing records. [2025-09-23T21:15:38.738919] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T21:15:38.818802] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:38.819139] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-23T21:15:38.819195] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-23T21:15:38.819623] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-23T21:15:38.819720] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-23T21:15:39.175753] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:39.402213] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-23T21:15:40.202162] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-23T21:15:40.265702] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T21:15:40.509595] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T21:15:41.002199] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-23T21:15:41.138490] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T21:15:41.802258] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-23T21:15:42.230160] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T21:15:42.345962] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T21:15:42.602217] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-23T21:15:43.402203] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-23T21:15:44.202246] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-23T21:15:44.444168] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T21:15:44.901139] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T21:15:44.920891] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T21:15:45.002201] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-23T21:15:45.802204] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-23T21:15:46.526000] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T21:15:46.602205] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-23T21:15:46.759130] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T21:15:47.402195] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-23T21:15:48.063476] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T21:15:48.094287] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T21:15:48.202181] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-23T21:15:49.002255] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-23T21:15:49.713625] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T21:15:49.802156] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-23T21:15:49.937024] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T21:15:50.602229] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-23T21:15:51.266258] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T21:15:51.354163] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T21:15:51.402210] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-23T21:15:52.036369] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T21:15:52.202225] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-23T21:15:53.002187] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-23T21:15:53.071467] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T21:15:53.802194] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-23T21:15:54.602227] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-23T21:15:54.670436] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T21:15:54.687563] [INFO ] [REMOTE ] SKE: Full fetch complete (50269 records). [2025-09-23T21:15:54.687374] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T21:15:54.687795] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-23T21:15:55.081516] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-23T21:15:55.081627] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-23T21:15:55.082571] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-23T21:15:55.082637] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-23T21:15:55.084019] [DEBUG] [LOCAL ] SKE: Trimmed 50269 records to 35554 (keeping 200 days of data) [2025-09-23T21:15:55.292154] [DEBUG] [LOCAL ] SKE: Primary data saved (35554 records). [2025-09-23T21:15:55.292292] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-23T21:15:55.292390] [INFO ] [MAIN ] Update Progress: 1924/2372 symbols completed. SKE took 24.6s. Estimated remaining: 59m 35s. Rate: 7.5 symbols/min [2025-09-23T21:15:55.407395] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-23T21:15:55.476966] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:55.512138] [DEBUG] [LOCAL ] SKM: Loaded 35277 existing records from primary storage. [2025-09-23T21:15:55.512308] [INFO ] [MAIN ] SKM: Loaded 35277 existing records. [2025-09-23T21:15:55.690063] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:55.690346] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-23T21:15:55.690422] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-23T21:15:55.691404] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-23T21:15:55.691469] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-23T21:15:56.052763] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:56.202257] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-23T21:15:56.312305] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T21:15:56.329303] [INFO ] [REMOTE ] SJM: Full fetch complete (72020 records). [2025-09-23T21:15:56.330405] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-23T21:15:56.331365] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T21:15:56.732152] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-23T21:15:56.732243] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-23T21:15:56.733285] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-23T21:15:56.733354] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-23T21:15:56.734968] [DEBUG] [LOCAL ] SJM: Trimmed 72020 records to 50145 (keeping 200 days of data) [2025-09-23T21:15:57.002221] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-23T21:15:57.071822] [DEBUG] [LOCAL ] SJM: Primary data saved (50145 records). [2025-09-23T21:15:57.071968] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-23T21:15:57.072069] [INFO ] [MAIN ] Update Progress: 1925/2372 symbols completed. SJM took 48.8s. Estimated remaining: 59m 25s. Rate: 7.5 symbols/min [2025-09-23T21:15:57.244129] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:15:57.262238] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T21:15:57.305192] [DEBUG] [LOCAL ] SKT: Loaded 42608 existing records from primary storage. [2025-09-23T21:15:57.305344] [INFO ] [MAIN ] SKT: Loaded 42608 existing records. [2025-09-23T21:15:57.498977] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:15:57.499248] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-23T21:15:57.499298] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-23T21:15:57.500447] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-23T21:15:57.500522] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-23T21:15:57.677586] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T21:15:57.806483] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-23T21:15:57.885856] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:15:58.440436] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T21:15:58.602197] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-23T21:15:59.258892] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T21:15:59.402173] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-23T21:16:00.175190] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T21:16:00.177237] [INFO ] [REMOTE ] SKIL: Full fetch complete (10055 records). [2025-09-23T21:16:00.177310] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-23T21:16:00.207368] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-23T21:16:00.546183] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-23T21:16:00.546309] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-23T21:16:00.546564] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-23T21:16:00.546604] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-23T21:16:00.547057] [DEBUG] [LOCAL ] SKIL: Trimmed 10055 records to 6390 (keeping 200 days of data) [2025-09-23T21:16:00.584356] [DEBUG] [LOCAL ] SKIL: Primary data saved (6390 records). [2025-09-23T21:16:00.584491] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-23T21:16:00.584576] [INFO ] [MAIN ] Update Progress: 1926/2372 symbols completed. SKIL took 26.3s. Estimated remaining: 59m 16s. Rate: 7.5 symbols/min [2025-09-23T21:16:00.754097] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:16:00.795348] [DEBUG] [LOCAL ] SKY: Loaded 37728 existing records from primary storage. [2025-09-23T21:16:00.795530] [INFO ] [MAIN ] SKY: Loaded 37728 existing records. [2025-09-23T21:16:00.975175] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:16:00.975399] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-23T21:16:00.975481] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-23T21:16:00.976394] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-23T21:16:00.976455] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-23T21:16:01.007346] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-23T21:16:01.345357] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:16:01.354943] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T21:16:01.802236] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-23T21:16:02.371801] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T21:16:02.602201] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-23T21:16:02.895851] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T21:16:03.402205] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-23T21:16:03.905811] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T21:16:04.202205] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-23T21:16:04.988310] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T21:16:05.002144] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-23T21:16:05.779861] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:16:05.802184] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-23T21:16:06.188524] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T21:16:06.602287] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-23T21:16:07.377550] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T21:16:07.380411] [INFO ] [REMOTE ] SKLZ: Full fetch complete (19104 records). [2025-09-23T21:16:07.380556] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-23T21:16:07.411016] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-23T21:16:07.519116] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T21:16:07.794979] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-23T21:16:07.795061] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-23T21:16:07.795538] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-23T21:16:07.795599] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-23T21:16:07.796205] [DEBUG] [LOCAL ] SKLZ: Trimmed 19104 records to 11978 (keeping 200 days of data) [2025-09-23T21:16:07.869087] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11978 records). [2025-09-23T21:16:07.869249] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-23T21:16:07.869345] [INFO ] [MAIN ] Update Progress: 1927/2372 symbols completed. SKLZ took 29.5s. Estimated remaining: 59m 8s. Rate: 7.5 symbols/min [2025-09-23T21:16:08.055785] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:16:08.074864] [DEBUG] [LOCAL ] SKYH: Loaded 16593 existing records from primary storage. [2025-09-23T21:16:08.075034] [INFO ] [MAIN ] SKYH: Loaded 16593 existing records. [2025-09-23T21:16:08.214227] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-23T21:16:08.255362] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:16:08.255586] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-23T21:16:08.255634] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-23T21:16:08.256195] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-23T21:16:08.256257] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-23T21:16:08.614079] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:16:08.813726] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T21:16:09.002219] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-23T21:16:09.802221] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-23T21:16:09.850079] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T21:16:09.908879] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T21:16:10.602284] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-23T21:16:11.402196] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-23T21:16:11.554828] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T21:16:12.184892] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T21:16:12.202146] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-23T21:16:12.345893] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T21:16:13.002188] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-23T21:16:13.728297] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T21:16:13.802190] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-23T21:16:14.330890] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T21:16:14.428910] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T21:16:14.602189] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-23T21:16:15.402185] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-23T21:16:15.742276] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T21:16:16.202200] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-23T21:16:16.536519] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T21:16:17.002201] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-23T21:16:17.578690] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T21:16:17.802196] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-23T21:16:18.520486] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T21:16:18.544024] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T21:16:18.602200] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-23T21:16:19.402154] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-23T21:16:19.628511] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T21:16:20.202235] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-23T21:16:20.776594] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T21:16:20.782489] [INFO ] [REMOTE ] SKM: Full fetch complete (48008 records). [2025-09-23T21:16:20.782625] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-23T21:16:21.007324] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-23T21:16:21.168050] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-23T21:16:21.168134] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-23T21:16:21.168961] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-23T21:16:21.169022] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-23T21:16:21.170086] [DEBUG] [LOCAL ] SKM: Trimmed 48008 records to 35200 (keeping 200 days of data) [2025-09-23T21:16:21.390960] [DEBUG] [LOCAL ] SKM: Primary data saved (35200 records). [2025-09-23T21:16:21.391118] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-23T21:16:21.391225] [INFO ] [MAIN ] Update Progress: 1928/2372 symbols completed. SKM took 26.1s. Estimated remaining: 59m 1s. Rate: 7.5 symbols/min [2025-09-23T21:16:21.565128] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:16:21.592516] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T21:16:21.649289] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-23T21:16:21.649430] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-09-23T21:16:21.810586] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-23T21:16:21.833921] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:16:21.835211] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-23T21:16:21.835268] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-23T21:16:21.836530] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-23T21:16:21.836591] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-23T21:16:22.204422] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:16:22.216034] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T21:16:22.602210] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-23T21:16:23.402244] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-23T21:16:23.448963] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T21:16:24.202261] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-23T21:16:24.780426] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T21:16:25.002193] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-23T21:16:25.124553] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T21:16:25.163330] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T21:16:25.802197] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-23T21:16:26.602194] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-23T21:16:26.853435] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T21:16:27.224096] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-23T21:16:27.402214] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-23T21:16:27.909549] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T21:16:28.202237] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-23T21:16:29.002497] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-23T21:16:29.009582] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T21:16:29.802251] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-23T21:16:30.180344] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-23T21:16:30.313756] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T21:16:30.316517] [INFO ] [REMOTE ] SKYH: Full fetch complete (22525 records). [2025-09-23T21:16:30.316595] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-23T21:16:30.317104] [FATAL] [VALIDATOR ] SKYH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:16:30.317188] [FATAL] [MAIN ] SKYH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:16:30.317230] [WARN ] [MAIN ] SKYH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:16:30.317295] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-23T21:16:30.317357] [DEBUG] [LOCAL ] SKYH: No primary data file found to delete. [2025-09-23T21:16:30.317393] [INFO ] [LOCAL ] SKYH: Starting deletion of derivative data. [2025-09-23T21:16:30.317911] [DEBUG] [LOCAL ] SKYH: Deleted derivative data file. [2025-09-23T21:16:30.318016] [INFO ] [MAIN ] Update Progress: 1929/2372 symbols completed. SKYH took 22.4s. Estimated remaining: 58m 54s. Rate: 7.5 symbols/min [2025-09-23T21:16:30.494978] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:16:30.522918] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T21:16:30.567405] [DEBUG] [LOCAL ] SLF: Loaded 39113 existing records from primary storage. [2025-09-23T21:16:30.567573] [INFO ] [MAIN ] SLF: Loaded 39113 existing records. [2025-09-23T21:16:30.607326] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-23T21:16:30.753085] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:16:30.753343] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-23T21:16:30.753389] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-23T21:16:30.754337] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-23T21:16:30.754400] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-23T21:16:31.116962] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:16:31.402234] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-23T21:16:32.186148] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T21:16:32.202149] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-23T21:16:33.002195] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-23T21:16:33.484573] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T21:16:33.802181] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-23T21:16:33.881947] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T21:16:34.176993] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T21:16:34.602232] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-23T21:16:35.402271] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-23T21:16:36.026579] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-23T21:16:36.202177] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-23T21:16:36.205310] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T21:16:36.553960] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T21:16:37.002247] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-23T21:16:37.802255] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-23T21:16:38.455505] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T21:16:38.553273] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T21:16:38.602174] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-23T21:16:39.076323] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T21:16:39.402207] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-23T21:16:40.202202] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-23T21:16:40.689911] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-23T21:16:40.913363] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T21:16:40.920778] [INFO ] [REMOTE ] SKY: Full fetch complete (54881 records). [2025-09-23T21:16:40.920918] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-23T21:16:41.007442] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-23T21:16:41.316029] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-23T21:16:41.316123] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-23T21:16:41.317028] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-23T21:16:41.317117] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-23T21:16:41.318438] [DEBUG] [LOCAL ] SKY: Trimmed 54881 records to 37730 (keeping 200 days of data) [2025-09-23T21:16:41.543381] [DEBUG] [LOCAL ] SKY: Primary data saved (37730 records). [2025-09-23T21:16:41.543530] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-23T21:16:41.543632] [INFO ] [MAIN ] Update Progress: 1930/2372 symbols completed. SKY took 41.0s. Estimated remaining: 58m 46s. Rate: 7.5 symbols/min [2025-09-23T21:16:41.737221] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:16:41.780800] [DEBUG] [LOCAL ] SLG: Loaded 45628 existing records from primary storage. [2025-09-23T21:16:41.780947] [INFO ] [MAIN ] SLG: Loaded 45628 existing records. [2025-09-23T21:16:41.812460] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-23T21:16:41.966788] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T21:16:42.005818] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:16:42.006930] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-23T21:16:42.006981] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-23T21:16:42.008343] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-23T21:16:42.008406] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-23T21:16:42.376165] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:16:42.602204] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-23T21:16:43.293037] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-23T21:16:43.370790] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T21:16:43.378110] [INFO ] [REMOTE ] SKT: Full fetch complete (60024 records). [2025-09-23T21:16:43.378234] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-23T21:16:43.411131] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-23T21:16:43.769673] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-23T21:16:43.769763] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-23T21:16:43.770677] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-23T21:16:43.770738] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-23T21:16:43.772010] [DEBUG] [LOCAL ] SKT: Trimmed 60024 records to 42618 (keeping 200 days of data) [2025-09-23T21:16:44.041959] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T21:16:44.081477] [DEBUG] [LOCAL ] SKT: Primary data saved (42618 records). [2025-09-23T21:16:44.081807] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-23T21:16:44.081994] [INFO ] [MAIN ] Update Progress: 1931/2372 symbols completed. SKT took 47.0s. Estimated remaining: 58m 37s. Rate: 7.5 symbols/min [2025-09-23T21:16:44.204487] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-23T21:16:44.263545] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:16:44.295167] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T21:16:44.337897] [DEBUG] [LOCAL ] SLGN: Loaded 40275 existing records from primary storage. [2025-09-23T21:16:44.338036] [INFO ] [MAIN ] SLGN: Loaded 40275 existing records. [2025-09-23T21:16:44.514762] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:16:44.515048] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-23T21:16:44.515135] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-23T21:16:44.516411] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-23T21:16:44.516472] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-23T21:16:44.867684] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:16:45.002203] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-23T21:16:45.802182] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-23T21:16:46.209495] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-23T21:16:46.218895] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-09-23T21:16:46.219036] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-23T21:16:46.575954] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T21:16:46.615698] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-23T21:16:46.658082] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-23T21:16:46.658194] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-23T21:16:46.659383] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-23T21:16:46.659451] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-23T21:16:46.661546] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-09-23T21:16:47.009270] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-09-23T21:16:47.009463] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-23T21:16:47.009571] [INFO ] [MAIN ] Update Progress: 1932/2372 symbols completed. SLB took 25.6s. Estimated remaining: 58m 28s. Rate: 7.5 symbols/min [2025-09-23T21:16:47.192753] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:16:47.192971] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-23T21:16:47.193027] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-23T21:16:47.193178] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-23T21:16:47.193220] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-23T21:16:47.193307] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-23T21:16:47.193346] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-23T21:16:47.410135] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-23T21:16:47.590162] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:16:47.595278] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T21:16:48.202210] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-23T21:16:48.291766] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T21:16:49.002168] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-23T21:16:49.085835] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T21:16:49.732050] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T21:16:49.802162] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-23T21:16:50.602202] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-23T21:16:50.717725] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T21:16:51.010864] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T21:16:51.036912] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T21:16:51.402243] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-23T21:16:52.202235] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-23T21:16:52.588612] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T21:16:52.961965] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T21:16:53.002221] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-23T21:16:53.802214] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-23T21:16:54.602196] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-23T21:16:54.907373] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T21:16:55.282092] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T21:16:55.309933] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T21:16:55.402183] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-23T21:16:56.202252] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-23T21:16:56.609511] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T21:16:56.959479] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T21:16:57.002241] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-23T21:16:57.456430] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T21:16:57.802190] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-23T21:16:58.602243] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-23T21:16:59.002363] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T21:16:59.402245] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-23T21:16:59.549044] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T21:16:59.741799] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T21:17:00.202202] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-23T21:17:01.002193] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-23T21:17:01.414390] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T21:17:01.802213] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-23T21:17:01.958181] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T21:17:02.602256] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-23T21:17:03.132905] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T21:17:03.184479] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T21:17:03.402283] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-23T21:17:03.784938] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-23T21:17:03.785776] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1053 records). [2025-09-23T21:17:03.785846] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-23T21:17:03.975459] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-23T21:17:03.975688] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:17:03.975760] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:17:03.975837] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-23T21:17:03.975904] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-23T21:17:03.975940] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-23T21:17:03.975996] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-23T21:17:03.976091] [INFO ] [MAIN ] Update Progress: 1933/2372 symbols completed. SLNZ took 17.0s. Estimated remaining: 58m 22s. Rate: 7.5 symbols/min [2025-09-23T21:17:04.150444] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:04.150674] [DEBUG] [LOCAL ] SLQT: No existing data file found in primary storage. [2025-09-23T21:17:04.150729] [WARN ] [MAIN ] SLQT: No existing data found, performing full refresh instead. [2025-09-23T21:17:04.150875] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-23T21:17:04.150917] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-23T21:17:04.150958] [DEBUG] [LOCAL ] SLQT: No primary data file found to delete. [2025-09-23T21:17:04.150988] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-23T21:17:04.212277] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-23T21:17:04.542726] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:05.002246] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-23T21:17:05.802200] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-23T21:17:05.920562] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T21:17:06.337253] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T21:17:06.602242] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-23T21:17:07.402208] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-23T21:17:07.560528] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T21:17:07.696626] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T21:17:08.202209] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-23T21:17:09.011512] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-23T21:17:09.028142] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T21:17:09.802176] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-23T21:17:09.862880] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T21:17:10.528074] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T21:17:10.534456] [INFO ] [REMOTE ] SLF: Full fetch complete (56532 records). [2025-09-23T21:17:10.534583] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-23T21:17:10.607342] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-23T21:17:10.953739] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-23T21:17:10.954019] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-23T21:17:10.955108] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-23T21:17:10.955194] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-23T21:17:10.957095] [DEBUG] [LOCAL ] SLF: Trimmed 56532 records to 39010 (keeping 200 days of data) [2025-09-23T21:17:11.102993] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T21:17:11.268711] [DEBUG] [LOCAL ] SLF: Primary data saved (39010 records). [2025-09-23T21:17:11.269121] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-23T21:17:11.269407] [INFO ] [MAIN ] Update Progress: 1934/2372 symbols completed. SLF took 41.0s. Estimated remaining: 58m 14s. Rate: 7.5 symbols/min [2025-09-23T21:17:11.418047] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-23T21:17:11.459396] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:11.499564] [DEBUG] [LOCAL ] SLVM: Loaded 27918 existing records from primary storage. [2025-09-23T21:17:11.499736] [INFO ] [MAIN ] SLVM: Loaded 27918 existing records. [2025-09-23T21:17:11.686027] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:17:11.686364] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-23T21:17:11.686432] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-23T21:17:11.687196] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-23T21:17:11.687283] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-23T21:17:12.080617] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:12.202195] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-23T21:17:12.309861] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T21:17:12.320398] [INFO ] [REMOTE ] SLG: Full fetch complete (65299 records). [2025-09-23T21:17:12.320589] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-23T21:17:12.722805] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-23T21:17:12.722905] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-23T21:17:12.723902] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-23T21:17:12.723996] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-23T21:17:12.726668] [DEBUG] [LOCAL ] SLG: Trimmed 65299 records to 45568 (keeping 200 days of data) [2025-09-23T21:17:13.002323] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-23T21:17:13.047614] [DEBUG] [LOCAL ] SLG: Primary data saved (45568 records). [2025-09-23T21:17:13.047886] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-23T21:17:13.048043] [INFO ] [MAIN ] Update Progress: 1935/2372 symbols completed. SLG took 31.5s. Estimated remaining: 58m 5s. Rate: 7.5 symbols/min [2025-09-23T21:17:13.236215] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:13.265621] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-23T21:17:13.326141] [DEBUG] [LOCAL ] SM: Loaded 52322 existing records from primary storage. [2025-09-23T21:17:13.326297] [INFO ] [MAIN ] SM: Loaded 52322 existing records. [2025-09-23T21:17:13.510089] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:17:13.510373] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-23T21:17:13.510422] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-23T21:17:13.511739] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-23T21:17:13.511817] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-23T21:17:13.811685] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-23T21:17:13.921342] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:13.926985] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T21:17:14.279403] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T21:17:14.602200] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-23T21:17:15.287951] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T21:17:15.402161] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-23T21:17:15.999609] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T21:17:16.202201] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-23T21:17:17.001308] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T21:17:17.010335] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-23T21:17:17.082535] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T21:17:17.802214] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-23T21:17:18.188438] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T21:17:18.602269] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-23T21:17:19.103094] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T21:17:19.402194] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-23T21:17:19.844379] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T21:17:20.202211] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-23T21:17:21.002215] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-23T21:17:21.229481] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T21:17:21.495256] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T21:17:21.802200] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-23T21:17:22.544600] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T21:17:22.602216] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-23T21:17:23.072923] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T21:17:23.402229] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-23T21:17:24.202250] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-23T21:17:24.274189] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T21:17:24.822873] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T21:17:25.002177] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-23T21:17:25.807287] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-23T21:17:25.821974] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T21:17:26.420336] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T21:17:26.602205] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-23T21:17:26.985345] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T21:17:26.999939] [INFO ] [REMOTE ] SLGN: Full fetch complete (58028 records). [2025-09-23T21:17:27.000213] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-23T21:17:27.407296] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-23T21:17:27.427339] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-23T21:17:27.427412] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-23T21:17:27.428429] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-23T21:17:27.428494] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-23T21:17:27.430122] [DEBUG] [LOCAL ] SLGN: Trimmed 58028 records to 40325 (keeping 200 days of data) [2025-09-23T21:17:27.715728] [DEBUG] [LOCAL ] SLGN: Primary data saved (40325 records). [2025-09-23T21:17:27.715917] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-23T21:17:27.716111] [INFO ] [MAIN ] Update Progress: 1936/2372 symbols completed. SLGN took 43.6s. Estimated remaining: 57m 58s. Rate: 7.5 symbols/min [2025-09-23T21:17:27.847866] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T21:17:27.919852] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:27.916379] [INFO ] [REMOTE ] SLQT: Full fetch complete (63591 records). [2025-09-23T21:17:27.920101] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-23T21:17:27.920170] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-23T21:17:27.920330] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-23T21:17:27.991475] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-23T21:17:28.022002] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-23T21:17:28.024916] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-23T21:17:28.024970] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-23T21:17:28.211782] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-23T21:17:28.685991] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-23T21:17:28.701794] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-23T21:17:28.709337] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-23T21:17:28.709449] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-23T21:17:28.708348] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:28.710860] [DEBUG] [LOCAL ] SLQT: Trimmed 63591 records to 43976 (keeping 200 days of data) [2025-09-23T21:17:28.981751] [DEBUG] [LOCAL ] SLQT: Primary data saved (43976 records). [2025-09-23T21:17:28.982130] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-23T21:17:28.982290] [INFO ] [MAIN ] Update Progress: 1937/2372 symbols completed. SLQT took 25.0s. Estimated remaining: 57m 49s. Rate: 7.5 symbols/min [2025-09-23T21:17:29.007328] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-23T21:17:29.168267] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:29.201688] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T21:17:29.220844] [DEBUG] [LOCAL ] SMBK: Loaded 8224 existing records from primary storage. [2025-09-23T21:17:29.220975] [INFO ] [MAIN ] SMBK: Loaded 8224 existing records. [2025-09-23T21:17:29.367291] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:17:29.406114] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:17:29.382950] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-23T21:17:29.407231] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-23T21:17:29.407290] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-23T21:17:29.407778] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-23T21:17:29.407837] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-23T21:17:29.811961] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-23T21:17:29.801868] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:29.814544] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T21:17:30.602248] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-23T21:17:31.402212] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-23T21:17:31.811391] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T21:17:31.836419] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:17:31.836933] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-23T21:17:32.051891] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T21:17:32.202191] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-23T21:17:33.002271] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-23T21:17:33.802166] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-23T21:17:33.913127] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T21:17:34.086794] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:17:34.087351] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-23T21:17:34.140258] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T21:17:34.602279] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-23T21:17:35.402312] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-23T21:17:36.202216] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-23T21:17:36.411902] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T21:17:36.466368] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:17:36.466666] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-23T21:17:36.565859] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T21:17:37.002197] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-23T21:17:37.802255] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-23T21:17:38.456211] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T21:17:38.602284] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-23T21:17:39.120625] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T21:17:39.402211] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-23T21:17:39.711969] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T21:17:40.202167] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-23T21:17:40.262821] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T21:17:41.002240] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-23T21:17:41.802229] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-23T21:17:42.134520] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T21:17:42.448204] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T21:17:42.509773] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T21:17:42.602179] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-23T21:17:43.402231] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-23T21:17:43.827834] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T21:17:43.836580] [INFO ] [REMOTE ] SLVM: Full fetch complete (39520 records). [2025-09-23T21:17:43.836827] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-23T21:17:44.216863] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-23T21:17:44.233281] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-23T21:17:44.233381] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-23T21:17:44.234178] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-23T21:17:44.234243] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-23T21:17:44.235305] [DEBUG] [LOCAL ] SLVM: Trimmed 39520 records to 27970 (keeping 200 days of data) [2025-09-23T21:17:44.426751] [DEBUG] [LOCAL ] SLVM: Primary data saved (27970 records). [2025-09-23T21:17:44.426902] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-23T21:17:44.427030] [INFO ] [MAIN ] Update Progress: 1938/2372 symbols completed. SLVM took 33.2s. Estimated remaining: 57m 42s. Rate: 7.5 symbols/min [2025-09-23T21:17:44.623756] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:44.641070] [DEBUG] [LOCAL ] SMC: Loaded 11489 existing records from primary storage. [2025-09-23T21:17:44.641239] [INFO ] [MAIN ] SMC: Loaded 11489 existing records. [2025-09-23T21:17:44.902497] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:17:44.903038] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-23T21:17:44.903152] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-23T21:17:44.913353] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-23T21:17:44.929875] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-23T21:17:44.938249] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T21:17:45.002231] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-23T21:17:45.121192] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T21:17:45.330965] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:45.802209] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-23T21:17:46.602299] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-23T21:17:46.764526] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T21:17:46.914496] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-23T21:17:47.402192] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-23T21:17:47.722856] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T21:17:47.975489] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T21:17:48.202202] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-23T21:17:49.002227] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-23T21:17:49.142316] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T21:17:49.802243] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-23T21:17:50.602217] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-23T21:17:50.712438] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T21:17:50.721184] [INFO ] [REMOTE ] SM: Full fetch complete (75189 records). [2025-09-23T21:17:50.721341] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-23T21:17:50.863865] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T21:17:51.131497] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-23T21:17:51.131586] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-23T21:17:51.132704] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-23T21:17:51.132770] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-23T21:17:51.134312] [DEBUG] [LOCAL ] SM: Trimmed 75189 records to 52323 (keeping 200 days of data) [2025-09-23T21:17:51.275684] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T21:17:51.402289] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-23T21:17:51.497944] [DEBUG] [LOCAL ] SM: Primary data saved (52323 records). [2025-09-23T21:17:51.498100] [INFO ] [MAIN ] SM: Full history saved. [2025-09-23T21:17:51.498216] [INFO ] [MAIN ] Update Progress: 1939/2372 symbols completed. SM took 38.4s. Estimated remaining: 57m 34s. Rate: 7.5 symbols/min [2025-09-23T21:17:51.680768] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:51.728428] [DEBUG] [LOCAL ] SMFG: Loaded 48145 existing records from primary storage. [2025-09-23T21:17:51.728578] [INFO ] [MAIN ] SMFG: Loaded 48145 existing records. [2025-09-23T21:17:51.910362] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:17:51.910728] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-23T21:17:51.910792] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-23T21:17:51.912030] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-23T21:17:51.912092] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-23T21:17:52.207402] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-23T21:17:52.287165] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:53.002199] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-23T21:17:53.080483] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T21:17:53.118361] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T21:17:53.782981] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T21:17:53.802148] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-23T21:17:54.341783] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T21:17:54.343533] [INFO ] [REMOTE ] SMBK: Full fetch complete (11821 records). [2025-09-23T21:17:54.343639] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-23T21:17:54.607361] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-23T21:17:54.731081] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-23T21:17:54.731173] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-23T21:17:54.731493] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-23T21:17:54.731532] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-23T21:17:54.732132] [DEBUG] [LOCAL ] SMBK: Trimmed 11821 records to 8249 (keeping 200 days of data) [2025-09-23T21:17:54.789618] [DEBUG] [LOCAL ] SMBK: Primary data saved (8249 records). [2025-09-23T21:17:54.789817] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-23T21:17:54.789959] [INFO ] [MAIN ] Update Progress: 1940/2372 symbols completed. SMBK took 25.8s. Estimated remaining: 57m 25s. Rate: 7.5 symbols/min [2025-09-23T21:17:55.049629] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:55.102842] [DEBUG] [LOCAL ] SMG: Loaded 44060 existing records from primary storage. [2025-09-23T21:17:55.103041] [INFO ] [MAIN ] SMG: Loaded 44060 existing records. [2025-09-23T21:17:55.394843] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:17:55.395205] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-23T21:17:55.395280] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-23T21:17:55.396994] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-23T21:17:55.397073] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-23T21:17:55.412749] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-23T21:17:55.598574] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T21:17:55.943247] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:56.202197] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-23T21:17:57.002210] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-23T21:17:57.115052] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T21:17:57.133452] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T21:17:57.802195] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-23T21:17:58.405071] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T21:17:58.410527] [INFO ] [REMOTE ] SMA: Full fetch complete (29240 records). [2025-09-23T21:17:58.410676] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-23T21:17:58.602163] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-23T21:17:58.602069] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 120 unique days, need 200 days [2025-09-23T21:17:58.603436] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:17:58.603540] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:17:58.603634] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-23T21:17:58.603759] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-23T21:17:58.603926] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-23T21:17:58.603998] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-23T21:17:58.604070] [INFO ] [MAIN ] Update Progress: 1941/2372 symbols completed. SMA took 30.9s. Estimated remaining: 57m 16s. Rate: 7.5 symbols/min [2025-09-23T21:17:58.778986] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:17:58.793777] [DEBUG] [LOCAL ] SMHI: Loaded 14048 existing records from primary storage. [2025-09-23T21:17:58.793885] [INFO ] [MAIN ] SMHI: Loaded 14048 existing records. [2025-09-23T21:17:58.904958] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T21:17:58.985931] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:17:58.986188] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-23T21:17:58.986235] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-23T21:17:58.986713] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-23T21:17:58.986772] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-23T21:17:59.359766] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:17:59.402187] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-23T21:18:00.202216] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-23T21:18:00.664183] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-23T21:18:00.691866] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T21:18:00.762950] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T21:18:01.002204] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-23T21:18:01.802202] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-23T21:18:02.106970] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T21:18:02.602191] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-23T21:18:03.402232] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-23T21:18:04.202229] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-23T21:18:04.680684] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-09-23T21:18:04.762823] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T21:18:04.787321] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-23T21:18:04.978103] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T21:18:05.002148] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-23T21:18:05.596325] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T21:18:05.802195] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-23T21:18:06.602205] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-23T21:18:07.403997] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-23T21:18:07.406254] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T21:18:08.202188] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-23T21:18:08.231721] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T21:18:08.233922] [INFO ] [REMOTE ] SMC: Full fetch complete (16842 records). [2025-09-23T21:18:08.233994] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-23T21:18:08.404380] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T21:18:08.710371] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-23T21:18:08.710526] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-23T21:18:08.710981] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-23T21:18:08.711046] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-23T21:18:08.711628] [DEBUG] [LOCAL ] SMC: Trimmed 16842 records to 11481 (keeping 200 days of data) [2025-09-23T21:18:08.790662] [DEBUG] [LOCAL ] SMC: Primary data saved (11481 records). [2025-09-23T21:18:08.790811] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-23T21:18:08.790945] [INFO ] [MAIN ] Update Progress: 1942/2372 symbols completed. SMC took 24.4s. Estimated remaining: 57m 9s. Rate: 7.5 symbols/min [2025-09-23T21:18:09.019298] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:18:09.015611] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-23T21:18:09.042503] [DEBUG] [LOCAL ] SMP: Loaded 19843 existing records from primary storage. [2025-09-23T21:18:09.042670] [INFO ] [MAIN ] SMP: Loaded 19843 existing records. [2025-09-23T21:18:09.219937] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:18:09.220182] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-23T21:18:09.220232] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-23T21:18:09.220842] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-23T21:18:09.220904] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-23T21:18:09.601849] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:18:09.802198] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-23T21:18:09.882027] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T21:18:10.568362] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T21:18:10.602210] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-23T21:18:10.779530] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T21:18:11.402222] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-23T21:18:11.663362] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T21:18:12.176463] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T21:18:12.202147] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-23T21:18:13.002192] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-23T21:18:13.802194] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-23T21:18:14.602251] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-23T21:18:14.912236] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-23T21:18:14.960406] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T21:18:15.324366] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T21:18:15.402169] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-23T21:18:15.972015] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-09-23T21:18:16.202211] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-23T21:18:16.810927] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T21:18:17.002204] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-23T21:18:17.802167] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-23T21:18:18.115316] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T21:18:18.137923] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T21:18:18.602159] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-23T21:18:18.673093] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T21:18:19.402231] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-23T21:18:20.202278] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-23T21:18:20.345940] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T21:18:20.650666] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T21:18:21.002248] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-23T21:18:21.441990] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T21:18:21.802297] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-23T21:18:21.934532] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T21:18:22.602198] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-23T21:18:23.402180] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-23T21:18:23.666108] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T21:18:24.202218] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-23T21:18:24.854115] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-23T21:18:24.865929] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T21:18:25.002247] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-23T21:18:25.174639] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T21:18:25.752506] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T21:18:25.802206] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-23T21:18:26.602172] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-23T21:18:26.697912] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T21:18:27.402194] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-23T21:18:28.178383] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T21:18:28.202164] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-23T21:18:29.002176] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-23T21:18:29.043062] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T21:18:29.051036] [INFO ] [REMOTE ] SMFG: Full fetch complete (68877 records). [2025-09-23T21:18:29.051156] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-23T21:18:29.449696] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-23T21:18:29.449858] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-23T21:18:29.450960] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-23T21:18:29.451024] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-23T21:18:29.452522] [DEBUG] [LOCAL ] SMFG: Trimmed 68877 records to 48120 (keeping 200 days of data) [2025-09-23T21:18:29.740825] [DEBUG] [LOCAL ] SMFG: Primary data saved (48120 records). [2025-09-23T21:18:29.741053] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-23T21:18:29.741159] [INFO ] [MAIN ] Update Progress: 1943/2372 symbols completed. SMFG took 38.2s. Estimated remaining: 57m 4s. Rate: 7.5 symbols/min [2025-09-23T21:18:29.806140] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-23T21:18:29.921160] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:18:29.934822] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T21:18:29.963401] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T21:18:30.016997] [DEBUG] [LOCAL ] SMR: Loaded 53797 existing records from primary storage. [2025-09-23T21:18:30.017146] [INFO ] [MAIN ] SMR: Loaded 53797 existing records. [2025-09-23T21:18:30.194989] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:18:30.195302] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-23T21:18:30.195359] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-23T21:18:30.196591] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-09-23T21:18:30.196696] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-23T21:18:30.554909] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:18:30.602253] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-23T21:18:30.778679] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T21:18:30.780924] [INFO ] [REMOTE ] SMHI: Full fetch complete (24438 records). [2025-09-23T21:18:30.780997] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-23T21:18:31.141221] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-23T21:18:31.141303] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-23T21:18:31.141833] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-23T21:18:31.141894] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-23T21:18:31.142516] [DEBUG] [LOCAL ] SMHI: Trimmed 24438 records to 13940 (keeping 200 days of data) [2025-09-23T21:18:31.226215] [DEBUG] [LOCAL ] SMHI: Primary data saved (13940 records). [2025-09-23T21:18:31.226359] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-23T21:18:31.226444] [INFO ] [MAIN ] Update Progress: 1944/2372 symbols completed. SMHI took 32.6s. Estimated remaining: 56m 54s. Rate: 7.5 symbols/min [2025-09-23T21:18:31.397798] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:18:31.402216] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-23T21:18:31.441036] [DEBUG] [LOCAL ] SMRT: Loaded 44359 existing records from primary storage. [2025-09-23T21:18:31.441185] [INFO ] [MAIN ] SMRT: Loaded 44359 existing records. [2025-09-23T21:18:31.623163] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:18:31.623504] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-23T21:18:31.623573] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-23T21:18:31.624992] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-23T21:18:31.625055] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-23T21:18:32.024723] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:18:32.123056] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T21:18:32.202170] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-23T21:18:32.570712] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T21:18:33.002198] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-23T21:18:33.803941] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-23T21:18:33.809281] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T21:18:33.812896] [INFO ] [REMOTE ] SMP: Full fetch complete (26103 records). [2025-09-23T21:18:33.812979] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-23T21:18:33.941300] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T21:18:33.969973] [INFO ] [REMOTE ] SMG: Full fetch complete (62632 records). [2025-09-23T21:18:33.988238] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-23T21:18:34.527330] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-23T21:18:34.543542] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-23T21:18:34.552485] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-23T21:18:34.554913] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-23T21:18:34.581792] [DEBUG] [LOCAL ] SMP: Trimmed 26103 records to 19834 (keeping 200 days of data) [2025-09-23T21:18:34.605612] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-23T21:18:34.655280] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-23T21:18:34.655467] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-23T21:18:34.656242] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-23T21:18:34.656314] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-23T21:18:34.742819] [DEBUG] [LOCAL ] SMG: Trimmed 62632 records to 43981 (keeping 200 days of data) [2025-09-23T21:18:34.904329] [DEBUG] [LOCAL ] SMP: Primary data saved (19834 records). [2025-09-23T21:18:34.906069] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-23T21:18:34.906440] [INFO ] [MAIN ] Update Progress: 1945/2372 symbols completed. SMP took 26.1s. Estimated remaining: 56m 45s. Rate: 7.5 symbols/min [2025-09-23T21:18:35.089804] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:18:35.214420] [DEBUG] [LOCAL ] SMWB: Loaded 33043 existing records from primary storage. [2025-09-23T21:18:35.215481] [INFO ] [MAIN ] SMWB: Loaded 33043 existing records. [2025-09-23T21:18:35.416906] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:18:35.418700] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-23T21:18:35.419072] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-23T21:18:35.420810] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-23T21:18:35.421109] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-23T21:18:35.864483] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:18:35.868580] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-23T21:18:35.892689] [DEBUG] [LOCAL ] SMG: Primary data saved (43981 records). [2025-09-23T21:18:35.892823] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-23T21:18:35.892911] [INFO ] [MAIN ] Update Progress: 1946/2372 symbols completed. SMG took 41.1s. Estimated remaining: 56m 36s. Rate: 7.5 symbols/min [2025-09-23T21:18:36.066600] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:18:36.113980] [DEBUG] [LOCAL ] SN: Loaded 49808 existing records from primary storage. [2025-09-23T21:18:36.114129] [INFO ] [MAIN ] SN: Loaded 49808 existing records. [2025-09-23T21:18:36.297132] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:18:36.297361] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-23T21:18:36.297408] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-23T21:18:36.298402] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-23T21:18:36.298463] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-23T21:18:36.696493] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:18:36.698415] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-23T21:18:36.707284] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-23T21:18:36.741492] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.94 seconds). [2025-09-23T21:18:37.002194] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-23T21:18:37.039295] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T21:18:37.802207] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-23T21:18:38.181978] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T21:18:38.602212] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-23T21:18:39.402218] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-23T21:18:39.483072] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T21:18:39.599699] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-23T21:18:40.088179] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T21:18:40.202205] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-23T21:18:40.936349] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T21:18:41.002249] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-23T21:18:41.802239] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-23T21:18:42.602173] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-23T21:18:42.800131] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-23T21:18:42.814482] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T21:18:43.325794] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T21:18:43.402236] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-23T21:18:43.920098] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T21:18:44.202237] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-23T21:18:45.002211] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-23T21:18:45.400089] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T21:18:45.672765] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-23T21:18:45.802234] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-23T21:18:46.602241] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-23T21:18:46.721115] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T21:18:47.402247] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-23T21:18:48.202230] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-23T21:18:48.319308] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-23T21:18:48.356478] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T21:18:49.002208] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-23T21:18:49.104329] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T21:18:49.218415] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T21:18:49.802200] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-23T21:18:50.602213] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-23T21:18:51.315163] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T21:18:51.402169] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-23T21:18:51.831063] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-23T21:18:51.905588] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T21:18:52.202264] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-23T21:18:52.796506] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T21:18:53.002223] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-23T21:18:53.802175] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-23T21:18:54.000310] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T21:18:54.602245] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-23T21:18:55.155614] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T21:18:55.373995] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-23T21:18:55.402152] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-23T21:18:56.202167] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-23T21:18:56.395740] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T21:18:57.002204] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-23T21:18:57.621058] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T21:18:57.802164] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-23T21:18:58.277032] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-23T21:18:58.602183] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-23T21:18:58.890226] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T21:18:59.403574] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T21:18:59.402324] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-23T21:19:00.202202] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-23T21:19:01.002181] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-23T21:19:01.323530] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T21:19:01.369597] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-23T21:19:01.721907] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T21:19:01.729131] [INFO ] [REMOTE ] SMRT: Full fetch complete (62342 records). [2025-09-23T21:19:01.729309] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-23T21:19:01.813215] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-23T21:19:02.175389] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-23T21:19:02.176759] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-23T21:19:02.176632] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T21:19:02.177974] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-23T21:19:02.182909] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-23T21:19:02.183922] [INFO ] [REMOTE ] SMWB: Full fetch complete (50282 records). [2025-09-23T21:19:02.184103] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-23T21:19:02.223519] [DEBUG] [LOCAL ] SMRT: Trimmed 62342 records to 44255 (keeping 200 days of data) [2025-09-23T21:19:02.671420] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-23T21:19:02.691923] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-23T21:19:02.692780] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-23T21:19:02.695735] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-23T21:19:02.696494] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-23T21:19:02.722420] [DEBUG] [LOCAL ] SMWB: Trimmed 50282 records to 32980 (keeping 200 days of data) [2025-09-23T21:19:02.724703] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T21:19:02.736184] [INFO ] [REMOTE ] SMR: Full fetch complete (77584 records). [2025-09-23T21:19:02.738182] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-23T21:19:02.782957] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:19:02.784356] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:19:02.793895] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:19:02.822672] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-23T21:19:02.823390] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-23T21:19:02.824924] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-09-23T21:19:02.827903] [DEBUG] [LOCAL ] SMR: Deleted derivative data file. [2025-09-23T21:19:02.828318] [INFO ] [MAIN ] Update Progress: 1947/2372 symbols completed. SMR took 33.1s. Estimated remaining: 56m 32s. Rate: 7.5 symbols/min [2025-09-23T21:19:03.094816] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:03.136487] [DEBUG] [LOCAL ] SNA: Loaded 26407 existing records from primary storage. [2025-09-23T21:19:03.137688] [INFO ] [MAIN ] SNA: Loaded 26407 existing records. [2025-09-23T21:19:03.333723] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:19:03.368314] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-23T21:19:03.373437] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-23T21:19:03.392406] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-23T21:19:03.393001] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-23T21:19:03.791331] [DEBUG] [LOCAL ] SMRT: Primary data saved (44255 records). [2025-09-23T21:19:03.811151] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-23T21:19:03.815253] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:03.816245] [INFO ] [MAIN ] Update Progress: 1948/2372 symbols completed. SMRT took 32.6s. Estimated remaining: 56m 23s. Rate: 7.5 symbols/min [2025-09-23T21:19:03.816944] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-23T21:19:03.930627] [DEBUG] [LOCAL ] SMWB: Primary data saved (32980 records). [2025-09-23T21:19:03.931123] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-23T21:19:03.936570] [INFO ] [MAIN ] Update Progress: 1949/2372 symbols completed. SMWB took 29.0s. Estimated remaining: 56m 13s. Rate: 7.5 symbols/min [2025-09-23T21:19:04.082150] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:04.176462] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:04.186581] [DEBUG] [LOCAL ] SNDA: Loaded 4685 existing records from primary storage. [2025-09-23T21:19:04.186768] [INFO ] [MAIN ] SNDA: Loaded 4685 existing records. [2025-09-23T21:19:04.403398] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:19:04.418440] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-23T21:19:04.418689] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-23T21:19:04.419513] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-23T21:19:04.419599] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-23T21:19:04.419770] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-09-23T21:19:04.419849] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-23T21:19:04.711560] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T21:19:04.790179] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:19:04.830584] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-23T21:19:04.857892] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-23T21:19:04.882532] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-23T21:19:04.907083] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-23T21:19:04.931057] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-23T21:19:05.114401] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:05.114853] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-23T21:19:05.393982] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:05.396709] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T21:19:05.791457] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-23T21:19:05.802244] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-23T21:19:06.602217] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-23T21:19:06.648802] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T21:19:06.900901] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T21:19:07.402235] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-23T21:19:08.159687] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T21:19:08.202246] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-23T21:19:09.002228] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-23T21:19:09.088079] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-23T21:19:09.333809] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T21:19:09.802197] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-23T21:19:10.602196] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-23T21:19:10.661461] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T21:19:10.786782] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T21:19:11.402194] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-23T21:19:12.085244] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T21:19:12.202246] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-23T21:19:13.002243] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-23T21:19:13.074122] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-23T21:19:13.188116] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T21:19:13.802217] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-23T21:19:14.602209] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-23T21:19:14.767865] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T21:19:14.776678] [INFO ] [REMOTE ] SN: Full fetch complete (70867 records). [2025-09-23T21:19:14.776813] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-23T21:19:15.203179] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-23T21:19:15.203363] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-23T21:19:15.204601] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-23T21:19:15.204772] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-23T21:19:15.223519] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T21:19:15.230200] [DEBUG] [LOCAL ] SN: Trimmed 70867 records to 49836 (keeping 200 days of data) [2025-09-23T21:19:15.422141] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-23T21:19:15.558195] [DEBUG] [LOCAL ] SN: Primary data saved (49836 records). [2025-09-23T21:19:15.558332] [INFO ] [MAIN ] SN: Full history saved. [2025-09-23T21:19:15.558429] [INFO ] [MAIN ] Update Progress: 1950/2372 symbols completed. SN took 39.7s. Estimated remaining: 56m 6s. Rate: 7.5 symbols/min [2025-09-23T21:19:15.757917] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:15.801612] [DEBUG] [LOCAL ] SNDR: Loaded 40586 existing records from primary storage. [2025-09-23T21:19:15.801830] [INFO ] [MAIN ] SNDR: Loaded 40586 existing records. [2025-09-23T21:19:15.986525] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:19:15.986816] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-23T21:19:15.986869] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-23T21:19:15.987809] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-23T21:19:15.987873] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-23T21:19:16.210843] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-23T21:19:16.385166] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:16.683182] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-23T21:19:17.007272] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-23T21:19:17.024826] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T21:19:17.035117] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T21:19:17.802242] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-23T21:19:18.523199] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T21:19:18.550878] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T21:19:18.602191] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-23T21:19:19.241429] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T21:19:19.402242] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-23T21:19:20.098185] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T21:19:20.202191] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-23T21:19:20.847345] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T21:19:20.848748] [INFO ] [REMOTE ] SNDA: Full fetch complete (8584 records). [2025-09-23T21:19:20.848820] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-23T21:19:21.005267] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-23T21:19:21.222533] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-23T21:19:21.222666] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-23T21:19:21.223064] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-23T21:19:21.223140] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-23T21:19:21.224549] [DEBUG] [LOCAL ] SNDA: Trimmed 8584 records to 4700 (keeping 200 days of data) [2025-09-23T21:19:21.256359] [DEBUG] [LOCAL ] SNDA: Primary data saved (4700 records). [2025-09-23T21:19:21.256436] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-23T21:19:21.256555] [INFO ] [MAIN ] Update Progress: 1951/2372 symbols completed. SNDA took 17.3s. Estimated remaining: 55m 57s. Rate: 7.5 symbols/min [2025-09-23T21:19:21.425381] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:21.482098] [DEBUG] [LOCAL ] SNN: Loaded 44348 existing records from primary storage. [2025-09-23T21:19:21.482245] [INFO ] [MAIN ] SNN: Loaded 44348 existing records. [2025-09-23T21:19:21.660085] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:19:21.660385] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-23T21:19:21.660452] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-23T21:19:21.661517] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-23T21:19:21.661589] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-23T21:19:21.809852] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-23T21:19:22.038424] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:22.602248] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-23T21:19:23.402209] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-23T21:19:23.494816] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-23T21:19:23.497193] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T21:19:23.811547] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T21:19:24.202228] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-23T21:19:24.740182] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T21:19:25.002231] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-23T21:19:25.745631] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T21:19:25.802188] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-23T21:19:25.878084] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T21:19:26.602275] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-23T21:19:27.402254] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-23T21:19:27.470735] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T21:19:28.202210] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-23T21:19:28.353558] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T21:19:28.790934] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T21:19:29.002202] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-23T21:19:29.802230] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-23T21:19:29.863140] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T21:19:30.162071] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T21:19:30.602208] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-23T21:19:31.268753] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T21:19:31.402185] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-23T21:19:31.812027] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T21:19:31.816559] [INFO ] [REMOTE ] SNA: Full fetch complete (39211 records). [2025-09-23T21:19:31.816730] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-23T21:19:32.210138] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-23T21:19:32.207698] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-23T21:19:32.210291] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-23T21:19:32.212469] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-23T21:19:32.212591] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-23T21:19:32.215895] [DEBUG] [LOCAL ] SNA: Trimmed 39211 records to 26430 (keeping 200 days of data) [2025-09-23T21:19:32.402442] [DEBUG] [LOCAL ] SNA: Primary data saved (26430 records). [2025-09-23T21:19:32.402593] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-23T21:19:32.402727] [INFO ] [MAIN ] Update Progress: 1952/2372 symbols completed. SNA took 29.6s. Estimated remaining: 55m 50s. Rate: 7.5 symbols/min [2025-09-23T21:19:32.575049] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:32.637172] [DEBUG] [LOCAL ] SNOW: Loaded 53596 existing records from primary storage. [2025-09-23T21:19:32.637344] [INFO ] [MAIN ] SNOW: Loaded 53596 existing records. [2025-09-23T21:19:32.834075] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:19:32.834343] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-23T21:19:32.834392] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-23T21:19:32.835717] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-09-23T21:19:32.835818] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-23T21:19:33.010242] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-23T21:19:33.227993] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T21:19:33.271427] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:33.802214] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-23T21:19:34.433537] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-23T21:19:34.490939] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T21:19:34.602251] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-23T21:19:35.402181] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-23T21:19:35.453917] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T21:19:36.202403] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-23T21:19:36.203424] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T21:19:37.002206] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-23T21:19:37.509718] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T21:19:37.802238] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-23T21:19:37.902373] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-23T21:19:38.609756] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-23T21:19:38.615742] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T21:19:39.402268] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-23T21:19:40.198233] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-23T21:19:40.209334] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-23T21:19:41.002234] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-23T21:19:41.049622] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T21:19:41.119535] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-23T21:19:41.433541] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T21:19:41.802198] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-23T21:19:42.602228] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-23T21:19:43.365626] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T21:19:43.402154] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-23T21:19:44.113716] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T21:19:44.122764] [INFO ] [REMOTE ] SNDR: Full fetch complete (58901 records). [2025-09-23T21:19:44.122948] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-23T21:19:44.206701] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-23T21:19:44.476861] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-23T21:19:44.575255] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-23T21:19:44.575363] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-23T21:19:44.576369] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-23T21:19:44.576435] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-23T21:19:44.577734] [DEBUG] [LOCAL ] SNDR: Trimmed 58901 records to 40672 (keeping 200 days of data) [2025-09-23T21:19:44.850004] [DEBUG] [LOCAL ] SNDR: Primary data saved (40672 records). [2025-09-23T21:19:44.850139] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-23T21:19:44.850266] [INFO ] [MAIN ] Update Progress: 1953/2372 symbols completed. SNDR took 29.3s. Estimated remaining: 55m 43s. Rate: 7.5 symbols/min [2025-09-23T21:19:45.021376] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-23T21:19:45.023962] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:45.083464] [DEBUG] [LOCAL ] SNV: Loaded 48919 existing records from primary storage. [2025-09-23T21:19:45.083776] [INFO ] [MAIN ] SNV: Loaded 48919 existing records. [2025-09-23T21:19:45.325197] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:19:45.325564] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-23T21:19:45.325621] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-23T21:19:45.326891] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-23T21:19:45.326952] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-23T21:19:45.691123] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:45.804903] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-23T21:19:45.811457] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-23T21:19:45.893286] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T21:19:46.602196] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-23T21:19:47.088993] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-23T21:19:47.402188] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-23T21:19:47.537675] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T21:19:48.202245] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-23T21:19:49.002250] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-23T21:19:49.115120] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-23T21:19:49.154393] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T21:19:49.802208] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-23T21:19:50.198629] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T21:19:50.602180] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-23T21:19:50.807010] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T21:19:51.402247] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-23T21:19:51.840513] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-23T21:19:51.854069] [INFO ] [REMOTE ] SNAP: Full fetch complete (77933 records). [2025-09-23T21:19:51.854202] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-23T21:19:52.063296] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T21:19:52.170261] [INFO ] [REMOTE ] SNN: Full fetch complete (62942 records). [2025-09-23T21:19:52.192742] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-23T21:19:52.203920] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-23T21:19:52.478233] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-23T21:19:52.492998] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-23T21:19:52.496076] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-23T21:19:52.496533] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-23T21:19:52.604277] [DEBUG] [LOCAL ] SNAP: Trimmed 77933 records to 53796 (keeping 200 days of data) [2025-09-23T21:19:52.801396] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-23T21:19:52.801589] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-23T21:19:52.828489] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-23T21:19:52.829134] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-23T21:19:52.833733] [DEBUG] [LOCAL ] SNN: Trimmed 62942 records to 44348 (keeping 200 days of data) [2025-09-23T21:19:52.966232] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T21:19:53.002510] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-23T21:19:53.377832] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-09-23T21:19:53.375700] [DEBUG] [LOCAL ] SNN: Primary data saved (44348 records). [2025-09-23T21:19:53.377999] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-23T21:19:53.378102] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-23T21:19:53.378255] [INFO ] [MAIN ] Update Progress: 1954/2372 symbols completed. SNAP took 49.6s. Estimated remaining: 55m 35s. Rate: 7.5 symbols/min [2025-09-23T21:19:53.410290] [INFO ] [MAIN ] Update Progress: 1955/2372 symbols completed. SNN took 32.1s. Estimated remaining: 55m 25s. Rate: 7.5 symbols/min [2025-09-23T21:19:53.723460] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:53.742445] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:19:53.743077] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-09-23T21:19:53.743135] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-09-23T21:19:53.743280] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-23T21:19:53.743323] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-23T21:19:53.743365] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-23T21:19:53.743397] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-23T21:19:54.090713] [DEBUG] [LOCAL ] SNX: Loaded 39681 existing records from primary storage. [2025-09-23T21:19:54.101107] [INFO ] [MAIN ] SNX: Loaded 39681 existing records. [2025-09-23T21:19:54.267636] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:54.283393] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-23T21:19:54.346737] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:19:54.346979] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-23T21:19:54.347030] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-23T21:19:54.349234] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-23T21:19:54.349298] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-23T21:19:54.726904] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:19:54.727382] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-23T21:19:54.824680] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-23T21:19:54.897852] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T21:19:55.402203] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-23T21:19:55.989945] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T21:19:56.164174] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T21:19:56.202156] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-23T21:19:57.002245] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-23T21:19:57.492909] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-23T21:19:57.802182] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-23T21:19:58.103790] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T21:19:58.428832] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T21:19:58.602353] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-23T21:19:59.402253] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-23T21:19:59.512740] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T21:20:00.044351] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T21:20:00.202209] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-23T21:20:01.002256] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-23T21:20:01.799302] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-23T21:20:01.808746] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-23T21:20:02.602192] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-23T21:20:03.752165] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-23T21:20:03.759568] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-23T21:20:04.352447] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T21:20:04.361895] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-23T21:20:04.663158] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (4.46 seconds). [2025-09-23T21:20:05.002200] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-23T21:20:05.645718] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T21:20:05.802240] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-23T21:20:05.903722] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (4.09 seconds). [2025-09-23T21:20:05.964572] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T21:20:06.602255] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-23T21:20:07.177820] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-23T21:20:07.283320] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T21:20:07.402181] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-23T21:20:08.202191] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-23T21:20:08.557304] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T21:20:08.977328] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T21:20:09.002194] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-23T21:20:09.802173] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-23T21:20:10.227184] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T21:20:10.602207] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-23T21:20:10.801906] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-23T21:20:11.104461] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T21:20:11.113309] [INFO ] [REMOTE ] SNV: Full fetch complete (71121 records). [2025-09-23T21:20:11.113450] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-23T21:20:11.407445] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-23T21:20:11.545718] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-23T21:20:11.545820] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-23T21:20:11.547049] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-23T21:20:11.547120] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-23T21:20:11.548809] [DEBUG] [LOCAL ] SNV: Trimmed 71121 records to 48909 (keeping 200 days of data) [2025-09-23T21:20:11.866296] [DEBUG] [LOCAL ] SNV: Primary data saved (48909 records). [2025-09-23T21:20:11.866441] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-23T21:20:11.866545] [INFO ] [MAIN ] Update Progress: 1956/2372 symbols completed. SNV took 27.0s. Estimated remaining: 55m 20s. Rate: 7.5 symbols/min [2025-09-23T21:20:12.058178] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:20:12.098526] [DEBUG] [LOCAL ] SOBO: Loaded 39754 existing records from primary storage. [2025-09-23T21:20:12.098745] [INFO ] [MAIN ] SOBO: Loaded 39754 existing records. [2025-09-23T21:20:12.208744] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-23T21:20:12.299125] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:20:12.299467] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-23T21:20:12.299524] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-23T21:20:12.300453] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-23T21:20:12.300518] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-23T21:20:12.698027] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:20:13.002169] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-23T21:20:13.116962] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-23T21:20:13.350456] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T21:20:13.707417] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T21:20:13.802174] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-23T21:20:14.602198] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-23T21:20:15.402167] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-23T21:20:15.575142] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-23T21:20:16.039219] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-23T21:20:16.202165] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-23T21:20:16.467140] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T21:20:16.477296] [INFO ] [REMOTE ] SNOW: Full fetch complete (77265 records). [2025-09-23T21:20:16.477579] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-23T21:20:16.479108] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:20:16.479247] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:20:16.479322] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:20:16.479422] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-23T21:20:16.479519] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-23T21:20:16.479605] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-09-23T21:20:16.480198] [DEBUG] [LOCAL ] SNOW: Deleted derivative data file. [2025-09-23T21:20:16.480340] [INFO ] [MAIN ] Update Progress: 1957/2372 symbols completed. SNOW took 44.1s. Estimated remaining: 55m 11s. Rate: 7.5 symbols/min [2025-09-23T21:20:16.538611] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-23T21:20:17.002241] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-23T21:20:17.753933] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T21:20:17.802189] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-23T21:20:17.912925] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T21:20:18.602217] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-23T21:20:19.240760] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T21:20:19.402159] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-23T21:20:19.930182] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T21:20:19.937107] [INFO ] [REMOTE ] SNX: Full fetch complete (56507 records). [2025-09-23T21:20:19.937287] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-23T21:20:20.207382] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-23T21:20:20.321966] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-23T21:20:20.322054] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-23T21:20:20.323026] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-23T21:20:20.323092] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-23T21:20:20.324274] [DEBUG] [LOCAL ] SNX: Trimmed 56507 records to 39757 (keeping 200 days of data) [2025-09-23T21:20:20.573449] [DEBUG] [LOCAL ] SNX: Primary data saved (39757 records). [2025-09-23T21:20:20.573771] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-23T21:20:20.573869] [INFO ] [MAIN ] Update Progress: 1958/2372 symbols completed. SNX took 27.2s. Estimated remaining: 55m 2s. Rate: 7.5 symbols/min [2025-09-23T21:20:20.988088] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T21:20:21.002139] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-23T21:20:21.078795] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T21:20:21.087254] [INFO ] [REMOTE ] SO: Full fetch complete (77196 records). [2025-09-23T21:20:21.087408] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-23T21:20:21.088193] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:20:21.088290] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:20:21.088333] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:20:21.088398] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-23T21:20:21.088465] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-23T21:20:21.088501] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-23T21:20:21.088541] [DEBUG] [LOCAL ] SO: No derivative data file found to delete. [2025-09-23T21:20:21.088614] [INFO ] [MAIN ] Update Progress: 1959/2372 symbols completed. SO took 27.6s. Estimated remaining: 54m 53s. Rate: 7.5 symbols/min [2025-09-23T21:20:22.541505] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T21:20:22.550433] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-23T21:20:24.065754] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T21:20:24.074602] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-23T21:20:25.631194] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T21:20:25.640176] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-23T21:20:26.821815] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T21:20:26.830228] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-23T21:20:28.584627] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T21:20:28.593466] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-23T21:20:30.014494] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T21:20:30.020888] [INFO ] [REMOTE ] SOBO: Full fetch complete (58509 records). [2025-09-23T21:20:30.020999] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-23T21:20:30.438610] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-23T21:20:30.438742] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-23T21:20:30.439634] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-23T21:20:30.439713] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-23T21:20:30.440853] [DEBUG] [LOCAL ] SOBO: Trimmed 58509 records to 39661 (keeping 200 days of data) [2025-09-23T21:20:30.687909] [DEBUG] [LOCAL ] SOBO: Primary data saved (39661 records). [2025-09-23T21:20:30.688049] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-23T21:20:30.688135] [INFO ] [MAIN ] Update Progress: 1960/2372 symbols completed. SOBO took 18.8s. Estimated remaining: 54m 45s. Rate: 7.5 symbols/min [2025-09-23T21:20:31.303252] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:20:31.313080] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:20:31.357389] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:20:31.407685] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:20:31.414775] [DEBUG] [LOCAL ] SOJC: Loaded 5096 existing records from primary storage. [2025-09-23T21:20:31.415116] [INFO ] [MAIN ] SOJC: Loaded 5096 existing records. [2025-09-23T21:20:31.468323] [DEBUG] [LOCAL ] SOJD: Loaded 12942 existing records from primary storage. [2025-09-23T21:20:31.486609] [INFO ] [MAIN ] SOJD: Loaded 12942 existing records. [2025-09-23T21:20:31.578359] [DEBUG] [LOCAL ] SOJE: Loaded 9387 existing records from primary storage. [2025-09-23T21:20:31.607369] [INFO ] [MAIN ] SOJE: Loaded 9387 existing records. [2025-09-23T21:20:31.859885] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:20:31.875773] [DEBUG] [LOCAL ] SOC: Loaded 50243 existing records from primary storage. [2025-09-23T21:20:31.915694] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-23T21:20:31.910419] [INFO ] [MAIN ] SOC: Loaded 50243 existing records. [2025-09-23T21:20:31.934493] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-23T21:20:32.005778] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:20:32.058063] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-23T21:20:32.063311] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-23T21:20:32.117150] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-23T21:20:32.155690] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-23T21:20:32.164030] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:20:32.199292] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-23T21:20:32.199461] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-23T21:20:32.205122] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-23T21:20:32.225790] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-23T21:20:32.273665] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-23T21:20:32.437451] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-23T21:20:32.451138] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:20:32.528277] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-23T21:20:32.604465] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-23T21:20:32.686355] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-23T21:20:32.686555] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-23T21:20:33.217014] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:20:33.274468] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-23T21:20:33.543801] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:20:33.560899] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-23T21:20:33.697203] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:20:33.693746] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:20:33.697558] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-23T21:20:33.697819] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-23T21:20:34.229376] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T21:20:34.232097] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-23T21:20:34.518094] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T21:20:34.523638] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-23T21:20:34.743512] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T21:20:34.748272] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-23T21:20:34.963319] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T21:20:34.965935] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-23T21:20:35.283254] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T21:20:35.303201] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T21:20:35.302878] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-23T21:20:35.308123] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-23T21:20:35.569473] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T21:20:35.572220] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-23T21:20:35.592917] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T21:20:35.595143] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-23T21:20:36.018313] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T21:20:36.021547] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-23T21:20:36.346353] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T21:20:36.348486] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-23T21:20:36.373635] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T21:20:36.986186] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T21:20:36.992947] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T21:20:37.002448] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-23T21:20:37.010468] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T21:20:37.802237] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-23T21:20:37.888932] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T21:20:38.602261] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-23T21:20:38.871155] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T21:20:39.402285] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-23T21:20:39.431730] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:20:40.202243] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-23T21:20:40.462309] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T21:20:41.002204] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-23T21:20:41.602068] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T21:20:41.802219] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-23T21:20:41.851741] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T21:20:42.553183] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T21:20:42.602156] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-23T21:20:43.402257] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-23T21:20:43.453739] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T21:20:44.177611] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T21:20:44.202154] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-23T21:20:44.966896] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T21:20:45.002231] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-23T21:20:45.758279] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T21:20:45.802152] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-23T21:20:46.602175] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-23T21:20:46.675482] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T21:20:46.677872] [INFO ] [REMOTE ] SOJE: Full fetch complete (14629 records). [2025-09-23T21:20:46.678056] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-23T21:20:47.113382] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-23T21:20:47.113467] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-23T21:20:47.113914] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-23T21:20:47.113978] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-23T21:20:47.114501] [DEBUG] [LOCAL ] SOJE: Trimmed 14629 records to 9323 (keeping 200 days of data) [2025-09-23T21:20:47.172725] [DEBUG] [LOCAL ] SOJE: Primary data saved (9323 records). [2025-09-23T21:20:47.172918] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-23T21:20:47.173051] [INFO ] [MAIN ] Update Progress: 1961/2372 symbols completed. SOJE took 16.5s. Estimated remaining: 54m 39s. Rate: 7.5 symbols/min [2025-09-23T21:20:47.349423] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:20:47.349665] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-23T21:20:47.349725] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-23T21:20:47.349881] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-23T21:20:47.349925] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-23T21:20:47.349967] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-23T21:20:47.350001] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-23T21:20:47.411690] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-23T21:20:47.647136] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T21:20:47.733012] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:20:48.202226] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-23T21:20:48.813598] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T21:20:49.002210] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-23T21:20:49.173527] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T21:20:49.587929] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T21:20:49.802198] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-23T21:20:50.374739] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T21:20:50.602220] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-23T21:20:51.402212] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-23T21:20:52.202175] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-23T21:20:52.259277] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T21:20:52.317819] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T21:20:52.793262] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T21:20:52.794729] [INFO ] [REMOTE ] SOJC: Full fetch complete (7915 records). [2025-09-23T21:20:52.794800] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-23T21:20:53.007297] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-23T21:20:53.157009] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-23T21:20:53.157085] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-23T21:20:53.157297] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-23T21:20:53.157333] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-23T21:20:53.157766] [DEBUG] [LOCAL ] SOJC: Trimmed 7915 records to 5072 (keeping 200 days of data) [2025-09-23T21:20:53.188044] [DEBUG] [LOCAL ] SOJC: Primary data saved (5072 records). [2025-09-23T21:20:53.188132] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-23T21:20:53.188212] [INFO ] [MAIN ] Update Progress: 1962/2372 symbols completed. SOJC took 22.5s. Estimated remaining: 54m 30s. Rate: 7.5 symbols/min [2025-09-23T21:20:53.293151] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:20:53.309399] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-23T21:20:53.363888] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:20:53.378676] [DEBUG] [LOCAL ] SOL: Loaded 13563 existing records from primary storage. [2025-09-23T21:20:53.378811] [INFO ] [MAIN ] SOL: Loaded 13563 existing records. [2025-09-23T21:20:53.589018] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:20:53.589346] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-23T21:20:53.589400] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-23T21:20:53.589958] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-23T21:20:53.590023] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-23T21:20:53.804870] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-23T21:20:54.140170] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:20:54.602268] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-23T21:20:55.402179] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-23T21:20:55.628743] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T21:20:55.673826] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T21:20:56.176165] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T21:20:56.178424] [INFO ] [REMOTE ] SOJD: Full fetch complete (20186 records). [2025-09-23T21:20:56.178495] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-23T21:20:56.207359] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-23T21:20:56.545023] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-23T21:20:56.545102] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-23T21:20:56.545557] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-23T21:20:56.545618] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-23T21:20:56.546191] [DEBUG] [LOCAL ] SOJD: Trimmed 20186 records to 12955 (keeping 200 days of data) [2025-09-23T21:20:56.628896] [DEBUG] [LOCAL ] SOJD: Primary data saved (12955 records). [2025-09-23T21:20:56.629033] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-23T21:20:56.629131] [INFO ] [MAIN ] Update Progress: 1963/2372 symbols completed. SOJD took 25.9s. Estimated remaining: 54m 21s. Rate: 7.5 symbols/min [2025-09-23T21:20:56.801628] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:20:56.843095] [DEBUG] [LOCAL ] SOLV: Loaded 44184 existing records from primary storage. [2025-09-23T21:20:56.843244] [INFO ] [MAIN ] SOLV: Loaded 44184 existing records. [2025-09-23T21:20:57.007831] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-23T21:20:57.022304] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:20:57.029572] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T21:20:57.029352] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-23T21:20:57.032509] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-23T21:20:57.033725] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-23T21:20:57.033787] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-23T21:20:57.386636] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:20:57.802215] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-23T21:20:58.580302] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T21:20:58.602141] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-23T21:20:58.774498] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T21:20:59.388727] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T21:20:59.402147] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-23T21:21:00.027741] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T21:21:00.202200] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-23T21:21:01.002206] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-23T21:21:01.802214] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-23T21:21:02.128280] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T21:21:02.363833] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T21:21:02.602195] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-23T21:21:03.402203] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-23T21:21:04.202251] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-23T21:21:04.610851] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-23T21:21:04.783974] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-23T21:21:05.002207] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-23T21:21:05.360484] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-23T21:21:05.802163] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-23T21:21:05.842747] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T21:21:05.916383] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T21:21:06.602194] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-23T21:21:07.334761] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T21:21:07.402161] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-23T21:21:07.962988] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T21:21:07.995568] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T21:21:08.202194] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-23T21:21:08.930542] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T21:21:09.002229] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-23T21:21:09.802188] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-23T21:21:10.521446] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T21:21:10.523626] [INFO ] [REMOTE ] SOJF: Full fetch complete (13116 records). [2025-09-23T21:21:10.523814] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-23T21:21:10.606809] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-23T21:21:10.713657] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-09-23T21:21:10.714208] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:21:10.714515] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:21:10.714595] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-23T21:21:10.714732] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-23T21:21:10.714800] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-23T21:21:10.714905] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-23T21:21:10.715008] [INFO ] [MAIN ] Update Progress: 1964/2372 symbols completed. SOJF took 23.5s. Estimated remaining: 54m 15s. Rate: 7.5 symbols/min [2025-09-23T21:21:10.911598] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:21:10.916096] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T21:21:10.925276] [INFO ] [REMOTE ] SOC: Full fetch complete (71273 records). [2025-09-23T21:21:10.925400] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-23T21:21:11.259428] [DEBUG] [LOCAL ] SON: Loaded 42869 existing records from primary storage. [2025-09-23T21:21:11.270226] [INFO ] [MAIN ] SON: Loaded 42869 existing records. [2025-09-23T21:21:11.407891] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-23T21:21:11.471725] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-23T21:21:11.471858] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-23T21:21:11.473184] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-23T21:21:11.489266] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-23T21:21:11.541765] [DEBUG] [LOCAL ] SOC: Trimmed 71273 records to 50247 (keeping 200 days of data) [2025-09-23T21:21:11.562303] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:21:11.562821] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-23T21:21:11.562880] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-23T21:21:11.564169] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-23T21:21:11.564231] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-23T21:21:12.047397] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:21:12.210340] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-23T21:21:12.252367] [DEBUG] [LOCAL ] SOC: Primary data saved (50247 records). [2025-09-23T21:21:12.252531] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-23T21:21:12.252660] [INFO ] [MAIN ] Update Progress: 1965/2372 symbols completed. SOC took 41.6s. Estimated remaining: 54m 5s. Rate: 7.5 symbols/min [2025-09-23T21:21:12.450854] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:21:12.453070] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T21:21:12.513346] [DEBUG] [LOCAL ] SONY: Loaded 53361 existing records from primary storage. [2025-09-23T21:21:12.513558] [INFO ] [MAIN ] SONY: Loaded 53361 existing records. [2025-09-23T21:21:12.695887] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:21:12.696455] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-23T21:21:12.696567] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-23T21:21:12.698033] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-23T21:21:12.698095] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-23T21:21:12.839572] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T21:21:13.007325] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-23T21:21:13.077454] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:21:13.802174] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-23T21:21:14.200429] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-23T21:21:14.487466] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T21:21:14.567210] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T21:21:14.602161] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-23T21:21:15.402219] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-23T21:21:16.202200] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-23T21:21:16.234598] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T21:21:16.849899] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T21:21:17.002160] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-23T21:21:17.054021] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T21:21:17.802196] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-23T21:21:18.582825] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T21:21:18.602187] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-23T21:21:18.840597] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T21:21:19.402199] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-23T21:21:20.202173] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-23T21:21:20.230894] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T21:21:20.564760] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T21:21:21.002173] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-23T21:21:21.302501] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T21:21:21.802224] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-23T21:21:22.365917] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T21:21:22.602155] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-23T21:21:23.097902] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T21:21:23.402249] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-23T21:21:24.202179] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-23T21:21:24.257072] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T21:21:24.265012] [INFO ] [REMOTE ] SOLV: Full fetch complete (63177 records). [2025-09-23T21:21:24.265220] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-23T21:21:24.662508] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-23T21:21:24.662592] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-23T21:21:24.663527] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-23T21:21:24.663589] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-23T21:21:24.664886] [DEBUG] [LOCAL ] SOLV: Trimmed 63177 records to 44106 (keeping 200 days of data) [2025-09-23T21:21:24.938206] [DEBUG] [LOCAL ] SOLV: Primary data saved (44106 records). [2025-09-23T21:21:24.948395] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T21:21:24.947810] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-23T21:21:24.952668] [INFO ] [MAIN ] Update Progress: 1966/2372 symbols completed. SOLV took 28.3s. Estimated remaining: 53m 58s. Rate: 7.5 symbols/min [2025-09-23T21:21:25.002761] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-23T21:21:25.139783] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:21:25.167142] [DEBUG] [LOCAL ] SOR: Loaded 2948 existing records from primary storage. [2025-09-23T21:21:25.177901] [INFO ] [MAIN ] SOR: Loaded 2948 existing records. [2025-09-23T21:21:25.245299] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T21:21:25.376749] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:21:25.377010] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-23T21:21:25.377060] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-23T21:21:25.377404] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-23T21:21:25.377465] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-23T21:21:25.749253] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:21:25.802145] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-23T21:21:25.871163] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T21:21:26.337228] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T21:21:26.602219] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-23T21:21:27.402194] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-23T21:21:28.027793] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T21:21:28.053806] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T21:21:28.202205] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-23T21:21:28.683874] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T21:21:29.002239] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-23T21:21:29.802172] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-23T21:21:29.815083] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T21:21:29.818421] [INFO ] [REMOTE ] SOL: Full fetch complete (21923 records). [2025-09-23T21:21:29.818508] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-23T21:21:30.197360] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-23T21:21:30.197450] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-23T21:21:30.197926] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-23T21:21:30.197985] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-23T21:21:30.198696] [DEBUG] [LOCAL ] SOL: Trimmed 21923 records to 13538 (keeping 200 days of data) [2025-09-23T21:21:30.277377] [DEBUG] [LOCAL ] SOL: Primary data saved (13538 records). [2025-09-23T21:21:30.277504] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-23T21:21:30.277586] [INFO ] [MAIN ] Update Progress: 1967/2372 symbols completed. SOL took 37.1s. Estimated remaining: 53m 50s. Rate: 7.5 symbols/min [2025-09-23T21:21:30.382096] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T21:21:30.451232] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:21:30.460096] [DEBUG] [LOCAL ] SOS: Loaded 7756 existing records from primary storage. [2025-09-23T21:21:30.460184] [INFO ] [MAIN ] SOS: Loaded 7756 existing records. [2025-09-23T21:21:30.607674] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-23T21:21:30.638369] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:21:30.639338] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-23T21:21:30.639388] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-23T21:21:30.639726] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-23T21:21:30.639785] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-23T21:21:31.009991] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:21:31.402209] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-23T21:21:31.984372] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T21:21:32.202192] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-23T21:21:32.276884] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T21:21:33.002215] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-23T21:21:33.281725] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T21:21:33.802222] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-23T21:21:34.602190] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-23T21:21:34.917364] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T21:21:34.932236] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T21:21:35.152855] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T21:21:35.402240] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-23T21:21:36.202243] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-23T21:21:37.002172] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-23T21:21:37.201810] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T21:21:37.413934] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T21:21:37.421748] [INFO ] [REMOTE ] SON: Full fetch complete (61949 records). [2025-09-23T21:21:37.421929] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-23T21:21:37.755942] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T21:21:37.807320] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-23T21:21:37.872955] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-23T21:21:37.873103] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-23T21:21:37.874205] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-23T21:21:37.874287] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-23T21:21:37.881198] [DEBUG] [LOCAL ] SON: Trimmed 61949 records to 42880 (keeping 200 days of data) [2025-09-23T21:21:38.161337] [DEBUG] [LOCAL ] SON: Primary data saved (42880 records). [2025-09-23T21:21:38.161479] [INFO ] [MAIN ] SON: Full history saved. [2025-09-23T21:21:38.161609] [INFO ] [MAIN ] Update Progress: 1968/2372 symbols completed. SON took 27.4s. Estimated remaining: 53m 42s. Rate: 7.5 symbols/min [2025-09-23T21:21:38.361695] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T21:21:38.386729] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:21:38.433048] [DEBUG] [LOCAL ] SPB: Loaded 34211 existing records from primary storage. [2025-09-23T21:21:38.433227] [INFO ] [MAIN ] SPB: Loaded 34211 existing records. [2025-09-23T21:21:38.608598] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-23T21:21:38.635901] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:21:38.636298] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-23T21:21:38.636370] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-23T21:21:38.637385] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-23T21:21:38.637450] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-23T21:21:39.001885] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:21:39.402312] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-23T21:21:40.202241] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-23T21:21:40.563976] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-23T21:21:40.670830] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T21:21:40.783593] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T21:21:41.002248] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-23T21:21:41.476170] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T21:21:41.802228] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-23T21:21:42.426894] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T21:21:42.602206] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-23T21:21:43.402208] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-23T21:21:43.885142] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T21:21:44.202270] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-23T21:21:44.635319] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T21:21:45.002220] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-23T21:21:45.299669] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T21:21:45.802237] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-23T21:21:46.602257] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-23T21:21:46.970070] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T21:21:47.065091] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T21:21:47.177232] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T21:21:47.402187] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-23T21:21:48.202199] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-23T21:21:48.737715] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-23T21:21:49.002266] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-23T21:21:49.433373] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-23T21:21:49.802250] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-23T21:21:50.351192] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T21:21:50.602206] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-23T21:21:51.402285] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-23T21:21:51.697521] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T21:21:51.721494] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T21:21:52.024046] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T21:21:52.202217] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-23T21:21:53.002238] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-23T21:21:53.802199] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-23T21:21:54.010087] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T21:21:54.197216] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-23T21:21:54.214605] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-23T21:21:54.215803] [INFO ] [REMOTE ] SOR: Full fetch complete (4358 records). [2025-09-23T21:21:54.215877] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-23T21:21:54.601695] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-23T21:21:54.601809] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-23T21:21:54.602120] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-23T21:21:54.602186] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-23T21:21:54.602433] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-23T21:21:54.605121] [DEBUG] [LOCAL ] SOR: Trimmed 4358 records to 2927 (keeping 200 days of data) [2025-09-23T21:21:54.626707] [DEBUG] [LOCAL ] SOR: Primary data saved (2927 records). [2025-09-23T21:21:54.626816] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-23T21:21:54.626972] [INFO ] [MAIN ] Update Progress: 1969/2372 symbols completed. SOR took 29.7s. Estimated remaining: 53m 36s. Rate: 7.5 symbols/min [2025-09-23T21:21:54.816061] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:21:54.891615] [DEBUG] [LOCAL ] SPCE: Loaded 49801 existing records from primary storage. [2025-09-23T21:21:54.891816] [INFO ] [MAIN ] SPCE: Loaded 49801 existing records. [2025-09-23T21:21:55.087785] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:21:55.088054] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-23T21:21:55.088106] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-23T21:21:55.089951] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-23T21:21:55.090030] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-23T21:21:55.407322] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-23T21:21:55.496782] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:21:55.997200] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T21:21:56.202195] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-23T21:21:56.598999] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T21:21:56.602713] [INFO ] [REMOTE ] SOS: Full fetch complete (11118 records). [2025-09-23T21:21:56.602813] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-23T21:21:56.970464] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-23T21:21:56.970543] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-23T21:21:56.970877] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-23T21:21:56.970938] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-23T21:21:56.971850] [DEBUG] [LOCAL ] SOS: Trimmed 11118 records to 7951 (keeping 200 days of data) [2025-09-23T21:21:57.003987] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-23T21:21:57.030548] [DEBUG] [LOCAL ] SOS: Primary data saved (7951 records). [2025-09-23T21:21:57.030861] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-23T21:21:57.030962] [INFO ] [MAIN ] Update Progress: 1970/2372 symbols completed. SOS took 26.8s. Estimated remaining: 53m 27s. Rate: 7.5 symbols/min [2025-09-23T21:21:57.202984] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:21:57.214448] [DEBUG] [LOCAL ] SPE: Loaded 6383 existing records from primary storage. [2025-09-23T21:21:57.214545] [INFO ] [MAIN ] SPE: Loaded 6383 existing records. [2025-09-23T21:21:57.391087] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:21:57.391373] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-23T21:21:57.391433] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-23T21:21:57.391886] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-23T21:21:57.391946] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-23T21:21:57.760633] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:21:57.802181] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-23T21:21:57.890180] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T21:21:58.535456] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T21:21:58.602212] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-23T21:21:58.784707] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T21:21:59.389946] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T21:21:59.402199] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-23T21:22:00.202207] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-23T21:22:01.002185] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-23T21:22:01.033169] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T21:22:01.228927] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T21:22:01.238285] [INFO ] [REMOTE ] SONY: Full fetch complete (77217 records). [2025-09-23T21:22:01.238454] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-23T21:22:01.666544] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-23T21:22:01.666663] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-23T21:22:01.667796] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-23T21:22:01.667862] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-23T21:22:01.669396] [DEBUG] [LOCAL ] SONY: Trimmed 77217 records to 53357 (keeping 200 days of data) [2025-09-23T21:22:01.802213] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-23T21:22:02.016425] [DEBUG] [LOCAL ] SONY: Primary data saved (53357 records). [2025-09-23T21:22:02.016872] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-23T21:22:02.016989] [INFO ] [MAIN ] Update Progress: 1971/2372 symbols completed. SONY took 49.8s. Estimated remaining: 53m 18s. Rate: 7.5 symbols/min [2025-09-23T21:22:02.188982] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:22:02.247538] [DEBUG] [LOCAL ] SPG: Loaded 50466 existing records from primary storage. [2025-09-23T21:22:02.247758] [INFO ] [MAIN ] SPG: Loaded 50466 existing records. [2025-09-23T21:22:02.428949] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:22:02.429453] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-23T21:22:02.429519] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-23T21:22:02.436802] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-23T21:22:02.448794] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-23T21:22:02.514366] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T21:22:02.602990] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-23T21:22:02.818512] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:22:03.352106] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T21:22:03.402199] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-23T21:22:03.989104] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T21:22:04.202172] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-23T21:22:04.818989] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T21:22:04.932948] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T21:22:05.002211] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-23T21:22:05.689816] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T21:22:05.802247] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-23T21:22:06.602212] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-23T21:22:07.402162] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-23T21:22:07.633865] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T21:22:08.064545] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T21:22:08.089303] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T21:22:08.202232] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-23T21:22:08.860749] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T21:22:09.002263] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-23T21:22:09.802198] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-23T21:22:10.396341] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T21:22:10.602228] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-23T21:22:11.402178] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-23T21:22:11.525058] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T21:22:11.575097] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T21:22:11.580936] [INFO ] [REMOTE ] SPB: Full fetch complete (47498 records). [2025-09-23T21:22:11.581044] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-23T21:22:11.978002] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-23T21:22:11.978134] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-23T21:22:11.978986] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-23T21:22:11.979047] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-23T21:22:11.980174] [DEBUG] [LOCAL ] SPB: Trimmed 47498 records to 34262 (keeping 200 days of data) [2025-09-23T21:22:12.201901] [DEBUG] [LOCAL ] SPB: Primary data saved (34262 records). [2025-09-23T21:22:12.202045] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-23T21:22:12.202154] [INFO ] [MAIN ] Update Progress: 1972/2372 symbols completed. SPB took 34.0s. Estimated remaining: 53m 10s. Rate: 7.5 symbols/min [2025-09-23T21:22:12.202237] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-23T21:22:12.399357] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:22:12.461284] [DEBUG] [LOCAL ] SPGI: Loaded 45821 existing records from primary storage. [2025-09-23T21:22:12.461460] [INFO ] [MAIN ] SPGI: Loaded 45821 existing records. [2025-09-23T21:22:12.658940] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:22:12.659173] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-23T21:22:12.659221] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-23T21:22:12.660766] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-23T21:22:12.660829] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-23T21:22:13.003253] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-23T21:22:13.023489] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:22:13.097377] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T21:22:13.755296] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T21:22:13.802195] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-23T21:22:13.919689] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T21:22:14.602248] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-23T21:22:15.245632] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T21:22:15.247541] [INFO ] [REMOTE ] SPE: Full fetch complete (10155 records). [2025-09-23T21:22:15.247612] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-23T21:22:15.404958] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-23T21:22:15.617269] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-23T21:22:15.617363] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-23T21:22:15.617717] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-23T21:22:15.617854] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-23T21:22:15.618489] [DEBUG] [LOCAL ] SPE: Trimmed 10155 records to 6367 (keeping 200 days of data) [2025-09-23T21:22:15.673606] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T21:22:15.689974] [DEBUG] [LOCAL ] SPE: Primary data saved (6367 records). [2025-09-23T21:22:15.690065] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-23T21:22:15.690138] [INFO ] [MAIN ] Update Progress: 1973/2372 symbols completed. SPE took 18.7s. Estimated remaining: 53m 2s. Rate: 7.5 symbols/min [2025-09-23T21:22:15.862258] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:22:15.881010] [DEBUG] [LOCAL ] SPH: Loaded 18307 existing records from primary storage. [2025-09-23T21:22:15.881115] [INFO ] [MAIN ] SPH: Loaded 18307 existing records. [2025-09-23T21:22:16.058528] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:22:16.058841] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-23T21:22:16.058902] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-23T21:22:16.059963] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-23T21:22:16.060023] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-23T21:22:16.208755] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-23T21:22:16.417570] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:22:17.002387] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-23T21:22:17.342605] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-23T21:22:17.802170] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-23T21:22:18.055987] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T21:22:18.097515] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T21:22:18.602250] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-23T21:22:19.402220] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-23T21:22:19.792929] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T21:22:20.202173] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-23T21:22:20.344188] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T21:22:21.002245] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-23T21:22:21.228997] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T21:22:21.259000] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T21:22:21.802280] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-23T21:22:22.602439] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-23T21:22:22.899001] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T21:22:23.402184] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-23T21:22:23.697610] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T21:22:24.202235] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-23T21:22:24.660336] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T21:22:25.002198] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-23T21:22:25.197613] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T21:22:25.358284] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T21:22:25.802258] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-23T21:22:26.602172] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-23T21:22:26.736735] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T21:22:27.008370] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T21:22:27.402208] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-23T21:22:28.202229] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-23T21:22:28.349425] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T21:22:29.002238] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-23T21:22:29.407202] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-23T21:22:29.802159] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-23T21:22:29.995604] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T21:22:30.541555] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T21:22:30.563541] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T21:22:30.602173] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-23T21:22:31.402222] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-23T21:22:32.202214] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-23T21:22:32.413009] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T21:22:32.596808] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T21:22:33.002270] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-23T21:22:33.510442] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T21:22:33.802206] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-23T21:22:34.602210] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-23T21:22:34.768704] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T21:22:35.402164] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-23T21:22:35.583522] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T21:22:35.678853] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T21:22:36.202224] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-23T21:22:37.002206] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-23T21:22:37.043700] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T21:22:37.053122] [INFO ] [REMOTE ] SPG: Full fetch complete (72066 records). [2025-09-23T21:22:37.053299] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-23T21:22:37.246446] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T21:22:37.510322] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-23T21:22:37.510416] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-23T21:22:37.511545] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-23T21:22:37.511615] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-23T21:22:37.513230] [DEBUG] [LOCAL ] SPG: Trimmed 72066 records to 50439 (keeping 200 days of data) [2025-09-23T21:22:37.813759] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-23T21:22:37.858230] [DEBUG] [LOCAL ] SPG: Primary data saved (50439 records). [2025-09-23T21:22:37.858383] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-23T21:22:37.858505] [INFO ] [MAIN ] Update Progress: 1974/2372 symbols completed. SPG took 35.8s. Estimated remaining: 52m 56s. Rate: 7.5 symbols/min [2025-09-23T21:22:38.046413] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:22:38.086705] [DEBUG] [LOCAL ] SPHR: Loaded 40118 existing records from primary storage. [2025-09-23T21:22:38.086861] [INFO ] [MAIN ] SPHR: Loaded 40118 existing records. [2025-09-23T21:22:38.289247] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:22:38.289564] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-23T21:22:38.289635] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-23T21:22:38.290662] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-23T21:22:38.290728] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-23T21:22:38.603250] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-23T21:22:38.702990] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:22:38.820504] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-23T21:22:39.402185] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-23T21:22:39.719727] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T21:22:39.915242] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T21:22:40.202201] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-23T21:22:40.907891] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T21:22:41.002199] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-23T21:22:41.802263] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-23T21:22:41.945357] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T21:22:41.953279] [INFO ] [REMOTE ] SPGI: Full fetch complete (66484 records). [2025-09-23T21:22:41.953440] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-23T21:22:42.089361] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T21:22:42.126750] [INFO ] [REMOTE ] SPH: Full fetch complete (28604 records). [2025-09-23T21:22:42.143696] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-23T21:22:42.614475] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-23T21:22:42.638189] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-23T21:22:42.664995] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-23T21:22:42.679201] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-23T21:22:42.684759] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-23T21:22:42.730024] [DEBUG] [LOCAL ] SPGI: Trimmed 66484 records to 45815 (keeping 200 days of data) [2025-09-23T21:22:42.869155] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-23T21:22:42.898527] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-23T21:22:42.899180] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-23T21:22:42.899483] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-23T21:22:42.902732] [DEBUG] [LOCAL ] SPH: Trimmed 28604 records to 18217 (keeping 200 days of data) [2025-09-23T21:22:43.174459] [DEBUG] [LOCAL ] SPH: Primary data saved (18217 records). [2025-09-23T21:22:43.175419] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-23T21:22:43.175841] [INFO ] [MAIN ] Update Progress: 1975/2372 symbols completed. SPH took 27.5s. Estimated remaining: 52m 48s. Rate: 7.5 symbols/min [2025-09-23T21:22:43.370433] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:22:43.449229] [DEBUG] [LOCAL ] SPIR: Loaded 37422 existing records from primary storage. [2025-09-23T21:22:43.450436] [INFO ] [MAIN ] SPIR: Loaded 37422 existing records. [2025-09-23T21:22:43.628834] [DEBUG] [LOCAL ] SPGI: Primary data saved (45815 records). [2025-09-23T21:22:43.652484] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-23T21:22:43.652385] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:22:43.654255] [INFO ] [MAIN ] Update Progress: 1976/2372 symbols completed. SPGI took 31.5s. Estimated remaining: 52m 38s. Rate: 7.5 symbols/min [2025-09-23T21:22:43.666299] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-23T21:22:43.689184] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-23T21:22:43.750483] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-23T21:22:43.790170] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-23T21:22:43.835728] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T21:22:43.934639] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:22:43.970948] [INFO ] [REMOTE ] SPCE: Full fetch complete (72309 records). [2025-09-23T21:22:43.976443] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-23T21:22:44.201367] [DEBUG] [LOCAL ] SPMC: Loaded 5632 existing records from primary storage. [2025-09-23T21:22:44.255166] [INFO ] [MAIN ] SPMC: Loaded 5632 existing records. [2025-09-23T21:22:44.769185] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:22:44.835494] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-23T21:22:44.969580] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:22:45.018118] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-23T21:22:45.027525] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-23T21:22:45.030423] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-23T21:22:45.031626] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-23T21:22:45.031777] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-23T21:22:45.032115] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-23T21:22:45.040099] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-23T21:22:45.041627] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-23T21:22:45.043213] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-23T21:22:45.043328] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-23T21:22:45.087818] [DEBUG] [LOCAL ] SPCE: Trimmed 72309 records to 49829 (keeping 200 days of data) [2025-09-23T21:22:45.525333] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:22:45.526275] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-23T21:22:45.725794] [DEBUG] [LOCAL ] SPCE: Primary data saved (49829 records). [2025-09-23T21:22:45.725947] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-23T21:22:45.726052] [INFO ] [MAIN ] Update Progress: 1977/2372 symbols completed. SPCE took 51.1s. Estimated remaining: 52m 29s. Rate: 7.5 symbols/min [2025-09-23T21:22:45.916814] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:22:45.916974] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-23T21:22:45.917011] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-23T21:22:45.917213] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-23T21:22:45.917266] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-23T21:22:45.917308] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-23T21:22:45.917339] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-23T21:22:46.186980] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T21:22:46.207931] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-23T21:22:46.295004] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T21:22:46.338707] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:22:46.389094] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T21:22:46.602208] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-23T21:22:46.641389] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T21:22:47.402206] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-23T21:22:47.770292] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T21:22:48.148091] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T21:22:48.202234] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-23T21:22:48.985077] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T21:22:49.002201] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-23T21:22:49.651401] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T21:22:49.802247] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-23T21:22:50.149041] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:22:50.149389] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-23T21:22:50.602210] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-23T21:22:50.796456] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:22:50.796849] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-23T21:22:51.402200] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-23T21:22:52.202251] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-23T21:22:52.951876] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T21:22:53.002148] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-23T21:22:53.802269] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-23T21:22:54.602246] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-23T21:23:05.494524] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:23:05.494920] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-23T21:23:05.495390] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-23T21:23:05.536846] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (10.93 seconds). [2025-09-23T21:23:05.539835] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-23T21:23:06.493379] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T21:23:06.495432] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-23T21:23:07.097248] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T21:23:07.099136] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-23T21:23:07.358182] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (14.36 seconds). [2025-09-23T21:23:07.367476] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-23T21:23:07.466955] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T21:23:07.468756] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-23T21:23:07.606544] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:23:07.606814] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-23T21:23:07.607152] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-23T21:23:07.792313] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (15.59 seconds). [2025-09-23T21:23:07.800370] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-23T21:23:07.825586] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:23:07.825892] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-23T21:23:07.826233] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-23T21:23:07.854321] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T21:23:07.855709] [INFO ] [REMOTE ] SPMC: Full fetch complete (8165 records). [2025-09-23T21:23:07.855779] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-23T21:23:08.038768] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:23:08.115381] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-23T21:23:08.138895] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-23T21:23:08.232855] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-23T21:23:08.232936] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-23T21:23:08.233133] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-23T21:23:08.233171] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-23T21:23:08.233568] [DEBUG] [LOCAL ] SPMC: Trimmed 8165 records to 5600 (keeping 200 days of data) [2025-09-23T21:23:08.267755] [DEBUG] [LOCAL ] SPMC: Primary data saved (5600 records). [2025-09-23T21:23:08.267844] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-23T21:23:08.267936] [INFO ] [MAIN ] Update Progress: 1978/2372 symbols completed. SPMC took 24.6s. Estimated remaining: 52m 24s. Rate: 7.5 symbols/min [2025-09-23T21:23:08.383603] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:23:08.410201] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-23T21:23:08.419841] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-23T21:23:08.446619] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:23:08.483963] [DEBUG] [LOCAL ] SPNT: Loaded 34818 existing records from primary storage. [2025-09-23T21:23:08.484099] [INFO ] [MAIN ] SPNT: Loaded 34818 existing records. [2025-09-23T21:23:08.627726] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T21:23:08.684478] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-23T21:23:08.716547] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:23:08.716852] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-23T21:23:08.716931] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-23T21:23:08.717907] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-23T21:23:08.717969] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-23T21:23:08.815466] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T21:23:08.827972] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-23T21:23:09.096931] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:23:09.097330] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-23T21:23:09.135388] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T21:23:09.149081] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-23T21:23:09.279632] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T21:23:09.280820] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-23T21:23:09.572036] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-23T21:23:09.572861] [INFO ] [REMOTE ] SPME: Full fetch complete (652 records). [2025-09-23T21:23:09.572930] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-23T21:23:09.759556] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 47 unique days, need 200 days [2025-09-23T21:23:09.759804] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:23:09.759875] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:23:09.759942] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-23T21:23:09.760006] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-23T21:23:09.760050] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-23T21:23:09.760104] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-23T21:23:09.760217] [INFO ] [MAIN ] Update Progress: 1979/2372 symbols completed. SPME took 24.0s. Estimated remaining: 52m 15s. Rate: 7.5 symbols/min [2025-09-23T21:23:09.934968] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:23:09.988390] [DEBUG] [LOCAL ] SPOT: Loaded 50923 existing records from primary storage. [2025-09-23T21:23:09.988540] [INFO ] [MAIN ] SPOT: Loaded 50923 existing records. [2025-09-23T21:23:10.180231] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:23:10.180791] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-23T21:23:10.197637] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-23T21:23:10.201922] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T21:23:10.209103] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-23T21:23:10.209568] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-23T21:23:10.254311] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-23T21:23:10.615780] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:23:10.624720] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-23T21:23:10.653783] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T21:23:10.663941] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T21:23:10.664592] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-23T21:23:10.675444] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-23T21:23:11.782435] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T21:23:11.793883] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-23T21:23:11.908439] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T21:23:12.202199] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-23T21:23:12.268262] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T21:23:12.822409] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-23T21:23:13.002157] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-23T21:23:13.323450] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T21:23:13.454581] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T21:23:13.802193] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-23T21:23:14.284184] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T21:23:14.602230] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-23T21:23:15.402188] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-23T21:23:15.911376] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-23T21:23:15.993140] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T21:23:16.202236] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-23T21:23:16.821851] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T21:23:17.002282] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-23T21:23:17.331005] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T21:23:17.802261] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-23T21:23:18.383594] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T21:23:18.602211] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-23T21:23:19.393441] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T21:23:19.401570] [INFO ] [REMOTE ] SPHR: Full fetch complete (57585 records). [2025-09-23T21:23:19.401763] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-23T21:23:19.402196] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-23T21:23:19.823286] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-23T21:23:19.823391] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-23T21:23:19.824480] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-23T21:23:19.824548] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-23T21:23:19.826046] [DEBUG] [LOCAL ] SPHR: Trimmed 57585 records to 40190 (keeping 200 days of data) [2025-09-23T21:23:20.079252] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T21:23:20.099628] [DEBUG] [LOCAL ] SPHR: Primary data saved (40190 records). [2025-09-23T21:23:20.100062] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-23T21:23:20.099857] [INFO ] [REMOTE ] SPIR: Full fetch complete (52231 records). [2025-09-23T21:23:20.100270] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-23T21:23:20.100667] [INFO ] [MAIN ] Update Progress: 1980/2372 symbols completed. SPHR took 42.2s. Estimated remaining: 52m 7s. Rate: 7.5 symbols/min [2025-09-23T21:23:20.212453] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-23T21:23:20.480377] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:23:20.697017] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-23T21:23:20.697129] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-23T21:23:20.698025] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-23T21:23:20.698218] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-23T21:23:20.727705] [DEBUG] [LOCAL ] SPIR: Trimmed 52231 records to 37472 (keeping 200 days of data) [2025-09-23T21:23:20.729670] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T21:23:20.806580] [DEBUG] [LOCAL ] SPR: Loaded 41299 existing records from primary storage. [2025-09-23T21:23:20.832391] [INFO ] [MAIN ] SPR: Loaded 41299 existing records. [2025-09-23T21:23:21.004716] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-23T21:23:21.028282] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:23:21.030019] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-23T21:23:21.030408] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-23T21:23:21.032332] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-23T21:23:21.033030] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-23T21:23:21.429697] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:23:21.544676] [DEBUG] [LOCAL ] SPIR: Primary data saved (37472 records). [2025-09-23T21:23:21.544854] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-23T21:23:21.544963] [INFO ] [MAIN ] Update Progress: 1981/2372 symbols completed. SPIR took 38.4s. Estimated remaining: 51m 58s. Rate: 7.5 symbols/min [2025-09-23T21:23:21.713156] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:23:21.723102] [DEBUG] [LOCAL ] SPRU: Loaded 8394 existing records from primary storage. [2025-09-23T21:23:21.723231] [INFO ] [MAIN ] SPRU: Loaded 8394 existing records. [2025-09-23T21:23:21.807433] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-23T21:23:21.913366] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:23:21.913636] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-23T21:23:21.913720] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-23T21:23:21.914072] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-23T21:23:21.914132] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-23T21:23:22.279722] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:23:22.334474] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T21:23:22.449888] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-23T21:23:22.602192] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-23T21:23:23.395012] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T21:23:23.402793] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-23T21:23:23.414058] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T21:23:24.202218] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-23T21:23:24.858843] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T21:23:25.002154] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-23T21:23:25.802212] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-23T21:23:26.358625] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-23T21:23:26.602184] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-23T21:23:26.625164] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T21:23:27.338779] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T21:23:27.402190] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-23T21:23:28.202294] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-23T21:23:28.892123] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T21:23:28.990627] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-23T21:23:29.004665] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-23T21:23:29.010094] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T21:23:29.802231] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-23T21:23:30.397308] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T21:23:30.396686] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T21:23:30.405380] [INFO ] [REMOTE ] SPNT: Full fetch complete (48749 records). [2025-09-23T21:23:30.405545] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-23T21:23:30.607333] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-23T21:23:30.796076] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-23T21:23:30.796171] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-23T21:23:30.797311] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-23T21:23:30.797383] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-23T21:23:30.798836] [DEBUG] [LOCAL ] SPNT: Trimmed 48749 records to 34862 (keeping 200 days of data) [2025-09-23T21:23:31.010477] [DEBUG] [LOCAL ] SPNT: Primary data saved (34862 records). [2025-09-23T21:23:31.010699] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-23T21:23:31.010822] [INFO ] [MAIN ] Update Progress: 1982/2372 symbols completed. SPNT took 22.7s. Estimated remaining: 51m 51s. Rate: 7.5 symbols/min [2025-09-23T21:23:31.195773] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:23:31.201139] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T21:23:31.226227] [DEBUG] [LOCAL ] SPXC: Loaded 23401 existing records from primary storage. [2025-09-23T21:23:31.226359] [INFO ] [MAIN ] SPXC: Loaded 23401 existing records. [2025-09-23T21:23:31.406712] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-23T21:23:31.407045] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:23:31.408178] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-23T21:23:31.408230] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-23T21:23:31.409100] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-23T21:23:31.409165] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-23T21:23:31.791171] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:23:32.202189] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-23T21:23:33.002196] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-23T21:23:33.739287] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-23T21:23:33.741363] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T21:23:33.781163] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:23:33.802150] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-23T21:23:34.602230] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-23T21:23:34.954139] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T21:23:35.402204] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-23T21:23:36.195778] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T21:23:36.205088] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-23T21:23:36.563821] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T21:23:37.002220] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-23T21:23:37.130765] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T21:23:37.802249] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-23T21:23:38.413678] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T21:23:38.602172] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-23T21:23:39.093749] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-23T21:23:39.402170] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-23T21:23:39.426938] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T21:23:40.202255] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-23T21:23:41.002205] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-23T21:23:41.739193] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T21:23:41.802147] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-23T21:23:41.843619] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-23T21:23:42.363289] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T21:23:42.602432] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-23T21:23:43.274258] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T21:23:43.402174] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-23T21:23:43.792784] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T21:23:44.202233] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-23T21:23:44.893054] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T21:23:44.935299] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T21:23:45.002172] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-23T21:23:45.802210] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-23T21:23:46.419368] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T21:23:46.602195] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-23T21:23:47.402183] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-23T21:23:47.409083] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T21:23:47.411461] [INFO ] [REMOTE ] SPRU: Full fetch complete (11341 records). [2025-09-23T21:23:47.411531] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-23T21:23:47.789415] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-23T21:23:47.789525] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-23T21:23:47.789883] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-23T21:23:47.789975] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-23T21:23:47.790709] [DEBUG] [LOCAL ] SPRU: Trimmed 11341 records to 8448 (keeping 200 days of data) [2025-09-23T21:23:47.856144] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-23T21:23:47.880203] [DEBUG] [LOCAL ] SPRU: Primary data saved (8448 records). [2025-09-23T21:23:47.880320] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-23T21:23:47.880451] [INFO ] [MAIN ] Update Progress: 1983/2372 symbols completed. SPRU took 26.3s. Estimated remaining: 51m 44s. Rate: 7.5 symbols/min [2025-09-23T21:23:48.053914] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:23:48.064222] [DEBUG] [LOCAL ] SPXX: Loaded 8971 existing records from primary storage. [2025-09-23T21:23:48.064318] [INFO ] [MAIN ] SPXX: Loaded 8971 existing records. [2025-09-23T21:23:48.207287] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-23T21:23:48.249365] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:23:48.249593] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-23T21:23:48.249665] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-23T21:23:48.250148] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-23T21:23:48.250239] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-23T21:23:48.617089] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:23:49.017729] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-23T21:23:49.032859] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T21:23:49.040453] [INFO ] [REMOTE ] SPR: Full fetch complete (60045 records). [2025-09-23T21:23:49.040580] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-23T21:23:49.423609] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-23T21:23:49.423726] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-23T21:23:49.424677] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-23T21:23:49.424739] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-23T21:23:49.426049] [DEBUG] [LOCAL ] SPR: Trimmed 60045 records to 41283 (keeping 200 days of data) [2025-09-23T21:23:49.688562] [DEBUG] [LOCAL ] SPR: Primary data saved (41283 records). [2025-09-23T21:23:49.688737] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-23T21:23:49.688840] [INFO ] [MAIN ] Update Progress: 1984/2372 symbols completed. SPR took 29.6s. Estimated remaining: 51m 35s. Rate: 7.5 symbols/min [2025-09-23T21:23:49.802271] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-23T21:23:49.849594] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T21:23:49.943566] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:23:49.985309] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T21:23:49.996433] [INFO ] [REMOTE ] SPOT: Full fetch complete (74013 records). [2025-09-23T21:23:49.996749] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-23T21:23:50.229529] [DEBUG] [LOCAL ] SQM: Loaded 48556 existing records from primary storage. [2025-09-23T21:23:50.240457] [INFO ] [MAIN ] SQM: Loaded 48556 existing records. [2025-09-23T21:23:50.612148] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-23T21:23:50.859253] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:23:50.882728] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-23T21:23:50.894776] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-23T21:23:50.938146] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-23T21:23:50.934344] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-23T21:23:50.938537] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-23T21:23:50.941541] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-23T21:23:50.938683] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-23T21:23:50.946925] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-23T21:23:51.062317] [DEBUG] [LOCAL ] SPOT: Trimmed 74013 records to 50860 (keeping 200 days of data) [2025-09-23T21:23:51.470961] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T21:23:51.528348] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:23:51.582854] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T21:23:51.580342] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-23T21:23:51.731604] [DEBUG] [LOCAL ] SPOT: Primary data saved (50860 records). [2025-09-23T21:23:51.731772] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-23T21:23:51.731868] [INFO ] [MAIN ] Update Progress: 1985/2372 symbols completed. SPOT took 42.0s. Estimated remaining: 51m 26s. Rate: 7.5 symbols/min [2025-09-23T21:23:51.901628] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:23:51.931911] [DEBUG] [LOCAL ] SQNS: Loaded 25715 existing records from primary storage. [2025-09-23T21:23:51.932069] [INFO ] [MAIN ] SQNS: Loaded 25715 existing records. [2025-09-23T21:23:52.121453] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:23:52.121728] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-23T21:23:52.121784] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-23T21:23:52.122423] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-23T21:23:52.122483] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-23T21:23:52.207284] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-23T21:23:52.448837] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T21:23:52.521418] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:23:53.002175] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-23T21:23:53.293156] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T21:23:53.539804] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T21:23:53.802200] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-23T21:23:54.602196] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-23T21:23:54.921875] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T21:23:55.402190] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-23T21:23:56.074073] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T21:23:56.202164] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-23T21:23:56.565373] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T21:23:56.931934] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T21:23:57.002194] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-23T21:23:57.802163] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-23T21:23:57.889999] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T21:23:58.602200] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-23T21:23:59.168572] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T21:23:59.410192] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T21:23:59.409104] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-23T21:24:00.202191] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-23T21:24:01.002189] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-23T21:24:01.052899] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T21:24:01.084307] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T21:24:01.697878] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T21:24:01.802226] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-23T21:24:02.602229] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-23T21:24:03.402259] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-23T21:24:04.202212] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-23T21:24:04.221479] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T21:24:04.298624] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-23T21:24:04.852909] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T21:24:05.002219] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-23T21:24:05.802180] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-23T21:24:05.841586] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T21:24:06.087166] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T21:24:06.091747] [INFO ] [REMOTE ] SPXC: Full fetch complete (34027 records). [2025-09-23T21:24:06.091872] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-23T21:24:06.396834] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T21:24:06.500737] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-23T21:24:06.500833] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-23T21:24:06.501591] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-23T21:24:06.501686] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-23T21:24:06.502513] [DEBUG] [LOCAL ] SPXC: Trimmed 34027 records to 23425 (keeping 200 days of data) [2025-09-23T21:24:06.605498] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-23T21:24:06.659848] [DEBUG] [LOCAL ] SPXC: Primary data saved (23425 records). [2025-09-23T21:24:06.660233] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-23T21:24:06.660679] [INFO ] [MAIN ] Update Progress: 1986/2372 symbols completed. SPXC took 35.6s. Estimated remaining: 51m 19s. Rate: 7.5 symbols/min [2025-09-23T21:24:06.835297] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:24:06.877000] [DEBUG] [LOCAL ] SR: Loaded 32752 existing records from primary storage. [2025-09-23T21:24:06.877152] [INFO ] [MAIN ] SR: Loaded 32752 existing records. [2025-09-23T21:24:07.052493] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:24:07.052788] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-23T21:24:07.052849] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-23T21:24:07.053714] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-23T21:24:07.053773] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-23T21:24:07.404975] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-23T21:24:07.404872] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:24:07.414860] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T21:24:08.176909] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T21:24:08.202166] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-23T21:24:09.002197] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-23T21:24:09.186624] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T21:24:09.802254] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-23T21:24:10.226612] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T21:24:10.239273] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T21:24:10.602214] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-23T21:24:11.402193] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-23T21:24:11.969541] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T21:24:12.202251] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-23T21:24:13.002210] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-23T21:24:13.812797] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-23T21:24:13.818097] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-23T21:24:14.602162] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-23T21:24:14.738221] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-23T21:24:14.758254] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T21:24:14.760381] [INFO ] [REMOTE ] SPXX: Full fetch complete (12352 records). [2025-09-23T21:24:14.760464] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-23T21:24:15.139195] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-23T21:24:15.139303] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-23T21:24:15.139636] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-23T21:24:15.139761] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-23T21:24:15.140466] [DEBUG] [LOCAL ] SPXX: Trimmed 12352 records to 8932 (keeping 200 days of data) [2025-09-23T21:24:15.200898] [DEBUG] [LOCAL ] SPXX: Primary data saved (8932 records). [2025-09-23T21:24:15.201034] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-23T21:24:15.201161] [INFO ] [MAIN ] Update Progress: 1987/2372 symbols completed. SPXX took 27.3s. Estimated remaining: 51m 11s. Rate: 7.5 symbols/min [2025-09-23T21:24:15.377816] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:24:15.402232] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-23T21:24:15.446745] [DEBUG] [LOCAL ] SRE: Loaded 53426 existing records from primary storage. [2025-09-23T21:24:15.446915] [INFO ] [MAIN ] SRE: Loaded 53426 existing records. [2025-09-23T21:24:15.631633] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:24:15.631891] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-23T21:24:15.631940] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-23T21:24:15.633209] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-23T21:24:15.633292] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-23T21:24:15.999046] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:24:16.148768] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-23T21:24:16.202152] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-23T21:24:16.244271] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T21:24:16.765044] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T21:24:17.002272] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-23T21:24:17.802227] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-23T21:24:18.098440] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T21:24:18.383679] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T21:24:18.602219] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-23T21:24:19.124746] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T21:24:19.402213] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-23T21:24:20.066924] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T21:24:20.202209] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-23T21:24:20.831938] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T21:24:21.002190] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-23T21:24:21.208503] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T21:24:21.802247] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-23T21:24:22.602223] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-23T21:24:22.762187] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T21:24:23.402227] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-23T21:24:23.438444] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T21:24:24.202249] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-23T21:24:24.987097] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-23T21:24:25.002135] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-23T21:24:25.646483] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T21:24:25.802189] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-23T21:24:25.830766] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-23T21:24:25.838945] [INFO ] [REMOTE ] SQM: Full fetch complete (68856 records). [2025-09-23T21:24:25.839102] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-23T21:24:26.237192] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-23T21:24:26.237368] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-23T21:24:26.238387] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-23T21:24:26.238562] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-23T21:24:26.240424] [DEBUG] [LOCAL ] SQM: Trimmed 68856 records to 48546 (keeping 200 days of data) [2025-09-23T21:24:26.260499] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T21:24:26.267796] [INFO ] [REMOTE ] SQNS: Full fetch complete (31774 records). [2025-09-23T21:24:26.267938] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-23T21:24:26.616942] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-23T21:24:26.893477] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-23T21:24:26.893596] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-23T21:24:26.894402] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-23T21:24:26.915519] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-23T21:24:26.935593] [DEBUG] [LOCAL ] SQNS: Trimmed 31774 records to 25885 (keeping 200 days of data) [2025-09-23T21:24:26.946478] [DEBUG] [LOCAL ] SQM: Primary data saved (48546 records). [2025-09-23T21:24:26.946624] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-23T21:24:26.946808] [INFO ] [MAIN ] Update Progress: 1988/2372 symbols completed. SQM took 37.3s. Estimated remaining: 51m 4s. Rate: 7.5 symbols/min [2025-09-23T21:24:27.218622] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:24:27.239172] [DEBUG] [LOCAL ] SREA: Loaded 10440 existing records from primary storage. [2025-09-23T21:24:27.240498] [INFO ] [MAIN ] SREA: Loaded 10440 existing records. [2025-09-23T21:24:27.443022] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:24:27.447523] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-23T21:24:27.448453] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-23T21:24:27.450715] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-23T21:24:27.452398] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-23T21:24:27.556681] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T21:24:27.684955] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-23T21:24:27.884948] [DEBUG] [LOCAL ] SQNS: Primary data saved (25885 records). [2025-09-23T21:24:27.888822] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-23T21:24:27.889175] [INFO ] [MAIN ] Update Progress: 1989/2372 symbols completed. SQNS took 36.2s. Estimated remaining: 50m 55s. Rate: 7.5 symbols/min [2025-09-23T21:24:27.915413] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:24:28.102063] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:24:28.103193] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T21:24:28.109138] [INFO ] [REMOTE ] SR: Full fetch complete (45935 records). [2025-09-23T21:24:28.109237] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-23T21:24:28.207607] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-23T21:24:28.429076] [DEBUG] [LOCAL ] SRFM: Loaded 35323 existing records from primary storage. [2025-09-23T21:24:28.434844] [INFO ] [MAIN ] SRFM: Loaded 35323 existing records. [2025-09-23T21:24:28.637585] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-23T21:24:28.648080] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-23T21:24:28.654180] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-23T21:24:28.659388] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-23T21:24:28.709311] [DEBUG] [LOCAL ] SR: Trimmed 45935 records to 32853 (keeping 200 days of data) [2025-09-23T21:24:28.715406] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:24:28.716121] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-23T21:24:28.716195] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-23T21:24:28.717032] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-23T21:24:28.717094] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-23T21:24:29.198254] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:24:29.199833] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-23T21:24:29.305108] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T21:24:29.322778] [DEBUG] [LOCAL ] SR: Primary data saved (32853 records). [2025-09-23T21:24:29.322890] [INFO ] [MAIN ] SR: Full history saved. [2025-09-23T21:24:29.322971] [INFO ] [MAIN ] Update Progress: 1990/2372 symbols completed. SR took 22.7s. Estimated remaining: 50m 46s. Rate: 7.5 symbols/min [2025-09-23T21:24:29.521912] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:24:29.524333] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T21:24:29.550499] [DEBUG] [LOCAL ] SRG: Loaded 15896 existing records from primary storage. [2025-09-23T21:24:29.550620] [INFO ] [MAIN ] SRG: Loaded 15896 existing records. [2025-09-23T21:24:29.726706] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:24:29.726947] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-23T21:24:29.726997] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-23T21:24:29.727456] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-23T21:24:29.727515] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-23T21:24:29.807320] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-23T21:24:30.086567] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:24:30.602218] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-23T21:24:30.669880] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T21:24:30.709030] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T21:24:31.402191] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-23T21:24:31.929979] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T21:24:32.202209] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-23T21:24:32.777854] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T21:24:33.002170] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-23T21:24:33.164756] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T21:24:33.742981] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T21:24:33.802190] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-23T21:24:34.602242] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-23T21:24:35.402240] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-23T21:24:35.644450] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T21:24:35.844682] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T21:24:35.968082] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T21:24:36.202222] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-23T21:24:37.002223] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-23T21:24:37.420409] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T21:24:37.802193] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-23T21:24:38.440483] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-23T21:24:38.602255] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-23T21:24:38.906601] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T21:24:39.119445] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T21:24:39.402179] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-23T21:24:40.202207] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-23T21:24:41.002166] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-23T21:24:41.344687] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T21:24:41.344319] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T21:24:41.650695] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T21:24:41.802193] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-23T21:24:42.602264] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-23T21:24:42.959746] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T21:24:43.366790] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T21:24:43.402274] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-23T21:24:44.205524] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-23T21:24:44.210865] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T21:24:45.002204] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-23T21:24:45.802219] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-23T21:24:45.823585] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T21:24:45.883975] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T21:24:46.602279] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-23T21:24:46.883547] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T21:24:47.047779] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T21:24:47.049947] [INFO ] [REMOTE ] SREA: Full fetch complete (15947 records). [2025-09-23T21:24:47.050026] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-23T21:24:47.403813] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-23T21:24:47.434917] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-23T21:24:47.435804] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-23T21:24:47.436205] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-23T21:24:47.436265] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-23T21:24:47.436954] [DEBUG] [LOCAL ] SREA: Trimmed 15947 records to 10410 (keeping 200 days of data) [2025-09-23T21:24:47.506765] [DEBUG] [LOCAL ] SREA: Primary data saved (10410 records). [2025-09-23T21:24:47.506910] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-23T21:24:47.507000] [INFO ] [MAIN ] Update Progress: 1991/2372 symbols completed. SREA took 20.6s. Estimated remaining: 50m 40s. Rate: 7.5 symbols/min [2025-09-23T21:24:47.677831] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:24:47.706021] [DEBUG] [LOCAL ] SRI: Loaded 27710 existing records from primary storage. [2025-09-23T21:24:47.706186] [INFO ] [MAIN ] SRI: Loaded 27710 existing records. [2025-09-23T21:24:47.880487] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:24:47.880792] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-23T21:24:47.880842] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-23T21:24:47.881589] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-23T21:24:47.881679] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-23T21:24:48.207313] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-23T21:24:48.238091] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:24:49.002202] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-23T21:24:49.240535] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T21:24:49.358320] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T21:24:49.802199] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-23T21:24:50.602157] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-23T21:24:50.817349] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T21:24:50.838727] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-23T21:24:51.402188] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-23T21:24:52.082634] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T21:24:52.170344] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T21:24:52.202230] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-23T21:24:53.002258] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-23T21:24:53.350683] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T21:24:53.802201] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-23T21:24:54.552803] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T21:24:54.602156] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-23T21:24:55.402241] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-23T21:24:56.092211] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-23T21:24:56.093145] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T21:24:56.135176] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T21:24:56.144177] [INFO ] [REMOTE ] SRE: Full fetch complete (77279 records). [2025-09-23T21:24:56.144310] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-23T21:24:56.207293] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-23T21:24:56.545258] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-23T21:24:56.545352] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-23T21:24:56.546527] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-23T21:24:56.546596] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-23T21:24:56.548375] [DEBUG] [LOCAL ] SRE: Trimmed 77279 records to 53426 (keeping 200 days of data) [2025-09-23T21:24:56.890518] [DEBUG] [LOCAL ] SRE: Primary data saved (53426 records). [2025-09-23T21:24:56.890671] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-23T21:24:56.890788] [INFO ] [MAIN ] Update Progress: 1992/2372 symbols completed. SRE took 41.7s. Estimated remaining: 50m 32s. Rate: 7.5 symbols/min [2025-09-23T21:24:57.007293] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-23T21:24:57.067808] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:24:57.068172] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-23T21:24:57.068217] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-23T21:24:57.068359] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-23T21:24:57.068401] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-23T21:24:57.068442] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-23T21:24:57.068475] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-23T21:24:57.429806] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T21:24:57.449380] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:24:57.802194] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-23T21:24:58.602188] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-23T21:24:59.083760] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T21:24:59.084724] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T21:24:59.217666] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T21:24:59.402242] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-23T21:25:00.202243] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-23T21:25:01.002172] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-23T21:25:01.402789] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-23T21:25:01.413079] [INFO ] [REMOTE ] SRFM: Full fetch complete (48812 records). [2025-09-23T21:25:01.413321] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-23T21:25:01.550519] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T21:25:01.810038] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-23T21:25:01.875615] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-23T21:25:01.875745] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-23T21:25:01.876727] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-23T21:25:01.876791] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-23T21:25:01.878566] [DEBUG] [LOCAL ] SRFM: Trimmed 48812 records to 35552 (keeping 200 days of data) [2025-09-23T21:25:02.098192] [DEBUG] [LOCAL ] SRFM: Primary data saved (35552 records). [2025-09-23T21:25:02.098352] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-23T21:25:02.098445] [INFO ] [MAIN ] Update Progress: 1993/2372 symbols completed. SRFM took 34.2s. Estimated remaining: 50m 23s. Rate: 7.5 symbols/min [2025-09-23T21:25:02.256276] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T21:25:02.324627] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:25:02.335130] [DEBUG] [LOCAL ] SRV: Loaded 7679 existing records from primary storage. [2025-09-23T21:25:02.335268] [INFO ] [MAIN ] SRV: Loaded 7679 existing records. [2025-09-23T21:25:02.440023] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-23T21:25:02.521095] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:25:02.521350] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-23T21:25:02.521399] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-23T21:25:02.521759] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-23T21:25:02.521820] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-23T21:25:02.607329] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-23T21:25:02.964500] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:25:03.402199] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-23T21:25:03.566565] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T21:25:03.570041] [INFO ] [REMOTE ] SRG: Full fetch complete (25379 records). [2025-09-23T21:25:03.570177] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-23T21:25:03.844199] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T21:25:03.957898] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-23T21:25:03.957989] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-23T21:25:03.958600] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-23T21:25:03.958685] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-23T21:25:03.959540] [DEBUG] [LOCAL ] SRG: Trimmed 25379 records to 15799 (keeping 200 days of data) [2025-09-23T21:25:04.047789] [DEBUG] [LOCAL ] SRG: Primary data saved (15799 records). [2025-09-23T21:25:04.047937] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-23T21:25:04.048022] [INFO ] [MAIN ] Update Progress: 1994/2372 symbols completed. SRG took 34.7s. Estimated remaining: 50m 14s. Rate: 7.5 symbols/min [2025-09-23T21:25:04.202986] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-23T21:25:04.225026] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:25:04.269560] [DEBUG] [LOCAL ] SSB: Loaded 42996 existing records from primary storage. [2025-09-23T21:25:04.269732] [INFO ] [MAIN ] SSB: Loaded 42996 existing records. [2025-09-23T21:25:04.450812] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:25:04.451087] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-23T21:25:04.451139] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-23T21:25:04.452159] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-23T21:25:04.452234] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-23T21:25:04.814383] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:25:05.002219] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-23T21:25:05.546707] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T21:25:05.802246] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-23T21:25:06.109124] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T21:25:06.148237] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T21:25:06.602275] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-23T21:25:07.253611] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T21:25:07.402189] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-23T21:25:07.844234] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-23T21:25:08.202260] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-23T21:25:08.979374] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T21:25:09.002193] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-23T21:25:09.506295] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T21:25:09.802216] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-23T21:25:10.400959] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T21:25:10.602213] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-23T21:25:11.402181] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-23T21:25:11.468877] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T21:25:11.852209] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T21:25:12.202213] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-23T21:25:12.916185] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T21:25:13.002205] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-23T21:25:13.354850] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-23T21:25:13.802223] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-23T21:25:14.602161] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-23T21:25:14.635135] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T21:25:14.960295] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T21:25:15.402181] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-23T21:25:16.202209] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-23T21:25:17.002222] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-23T21:25:17.039513] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T21:25:17.379565] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T21:25:17.554454] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T21:25:17.802233] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-23T21:25:18.602262] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-23T21:25:19.098409] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T21:25:19.138478] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T21:25:19.402182] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-23T21:25:20.202207] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-23T21:25:21.004760] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-23T21:25:21.010312] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T21:25:21.247014] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T21:25:21.530259] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T21:25:21.802201] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-23T21:25:22.600112] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T21:25:22.603485] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-23T21:25:22.605076] [INFO ] [REMOTE ] SRI: Full fetch complete (41716 records). [2025-09-23T21:25:22.605148] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-23T21:25:22.982098] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-23T21:25:22.982183] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-23T21:25:22.983073] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-23T21:25:22.983135] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-23T21:25:22.984054] [DEBUG] [LOCAL ] SRI: Trimmed 41716 records to 27526 (keeping 200 days of data) [2025-09-23T21:25:23.139808] [DEBUG] [LOCAL ] SRI: Primary data saved (27526 records). [2025-09-23T21:25:23.140071] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-23T21:25:23.140171] [INFO ] [MAIN ] Update Progress: 1995/2372 symbols completed. SRI took 35.6s. Estimated remaining: 50m 8s. Rate: 7.5 symbols/min [2025-09-23T21:25:23.308352] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:25:23.331849] [DEBUG] [LOCAL ] SSD: Loaded 22336 existing records from primary storage. [2025-09-23T21:25:23.331986] [INFO ] [MAIN ] SSD: Loaded 22336 existing records. [2025-09-23T21:25:23.407352] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-23T21:25:23.511678] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:25:23.511908] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-23T21:25:23.511956] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-23T21:25:23.512568] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-23T21:25:23.512628] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-23T21:25:23.811475] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T21:25:23.833374] [INFO ] [REMOTE ] SRL: Full fetch complete (1968 records). [2025-09-23T21:25:23.864894] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-23T21:25:23.938151] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:25:24.103050] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-23T21:25:24.103312] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:25:24.103449] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:25:24.103785] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-23T21:25:24.103965] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-23T21:25:24.104035] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-23T21:25:24.104174] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-23T21:25:24.104272] [INFO ] [MAIN ] Update Progress: 1996/2372 symbols completed. SRL took 27.2s. Estimated remaining: 49m 59s. Rate: 7.5 symbols/min [2025-09-23T21:25:24.210941] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-23T21:25:24.318493] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:25:24.345434] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T21:25:24.391835] [DEBUG] [LOCAL ] SSL: Loaded 41162 existing records from primary storage. [2025-09-23T21:25:24.392029] [INFO ] [MAIN ] SSL: Loaded 41162 existing records. [2025-09-23T21:25:24.577949] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:25:24.578240] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-23T21:25:24.578295] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-23T21:25:24.579860] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-23T21:25:24.579923] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-23T21:25:24.951378] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:25:25.002994] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-23T21:25:25.003955] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T21:25:25.802252] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-23T21:25:26.148622] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T21:25:26.602202] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-23T21:25:27.094863] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T21:25:27.096502] [INFO ] [REMOTE ] SRV: Full fetch complete (11574 records). [2025-09-23T21:25:27.096573] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-23T21:25:27.407339] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-23T21:25:27.475846] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-23T21:25:27.476015] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-23T21:25:27.476305] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-23T21:25:27.476376] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-23T21:25:27.477057] [DEBUG] [LOCAL ] SRV: Trimmed 11574 records to 7620 (keeping 200 days of data) [2025-09-23T21:25:27.537702] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T21:25:27.559407] [DEBUG] [LOCAL ] SRV: Primary data saved (7620 records). [2025-09-23T21:25:27.559529] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-23T21:25:27.559610] [INFO ] [MAIN ] Update Progress: 1997/2372 symbols completed. SRV took 25.5s. Estimated remaining: 49m 50s. Rate: 7.5 symbols/min [2025-09-23T21:25:28.202211] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-23T21:25:29.002207] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-23T21:25:29.112270] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T21:25:29.174081] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T21:25:29.802202] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-23T21:25:30.590090] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T21:25:30.602144] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-23T21:25:30.945208] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T21:25:31.402188] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-23T21:25:32.201345] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T21:25:32.211104] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-23T21:25:32.373986] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T21:25:33.002322] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-23T21:25:33.659102] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T21:25:33.802210] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-23T21:25:34.203766] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T21:25:34.602251] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-23T21:25:35.374315] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T21:25:35.402314] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-23T21:25:35.921460] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T21:25:35.930524] [INFO ] [REMOTE ] SSB: Full fetch complete (61107 records). [2025-09-23T21:25:35.930790] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-23T21:25:36.212999] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-23T21:25:36.443088] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-23T21:25:36.443186] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-23T21:25:36.444283] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-23T21:25:36.444351] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-23T21:25:36.446197] [DEBUG] [LOCAL ] SSB: Trimmed 61107 records to 42927 (keeping 200 days of data) [2025-09-23T21:25:36.743536] [DEBUG] [LOCAL ] SSB: Primary data saved (42927 records). [2025-09-23T21:25:36.743758] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-23T21:25:36.743851] [INFO ] [MAIN ] Update Progress: 1998/2372 symbols completed. SSB took 32.7s. Estimated remaining: 49m 43s. Rate: 7.5 symbols/min [2025-09-23T21:25:36.977376] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:25:37.002152] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-23T21:25:37.142129] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T21:25:37.802256] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-23T21:25:38.876859] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T21:25:38.887382] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-23T21:25:39.014174] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T21:25:39.402191] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-23T21:25:40.403303] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T21:25:40.412533] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-23T21:25:40.471638] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T21:25:41.002211] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-23T21:25:41.649781] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T21:25:41.804049] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-23T21:25:41.806190] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T21:25:42.602254] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-23T21:25:43.397704] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T21:25:43.406947] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-23T21:25:43.825572] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T21:25:44.202204] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-23T21:25:44.907414] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T21:25:45.002238] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-23T21:25:45.267078] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T21:25:45.271135] [INFO ] [REMOTE ] SSD: Full fetch complete (32323 records). [2025-09-23T21:25:45.271215] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-23T21:25:45.641001] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-23T21:25:45.641095] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-23T21:25:45.641885] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-23T21:25:45.641949] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-23T21:25:45.642846] [DEBUG] [LOCAL ] SSD: Trimmed 32323 records to 22321 (keeping 200 days of data) [2025-09-23T21:25:45.779633] [DEBUG] [LOCAL ] SSD: Primary data saved (22321 records). [2025-09-23T21:25:45.779790] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-23T21:25:45.779871] [INFO ] [MAIN ] Update Progress: 1999/2372 symbols completed. SSD took 22.6s. Estimated remaining: 49m 35s. Rate: 7.5 symbols/min [2025-09-23T21:25:46.604162] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T21:25:46.611817] [INFO ] [REMOTE ] SSL: Full fetch complete (60362 records). [2025-09-23T21:25:46.611963] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-23T21:25:47.030101] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-23T21:25:47.030182] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-23T21:25:47.031114] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-23T21:25:47.031177] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-23T21:25:47.032382] [DEBUG] [LOCAL ] SSL: Trimmed 60362 records to 41199 (keeping 200 days of data) [2025-09-23T21:25:47.258810] [DEBUG] [LOCAL ] SSL: Primary data saved (41199 records). [2025-09-23T21:25:47.258935] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-23T21:25:47.259013] [INFO ] [MAIN ] Update Progress: 2000/2372 symbols completed. SSL took 23.2s. Estimated remaining: 49m 26s. Rate: 7.5 symbols/min [2025-09-23T21:25:47.849980] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:25:47.826187] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:25:47.965058] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:25:47.992035] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:25:48.002291] [DEBUG] [LOCAL ] SST: Loaded 12280 existing records from primary storage. [2025-09-23T21:25:48.002586] [INFO ] [MAIN ] SST: Loaded 12280 existing records. [2025-09-23T21:25:48.128446] [DEBUG] [LOCAL ] SSTK: Loaded 26778 existing records from primary storage. [2025-09-23T21:25:48.134543] [INFO ] [MAIN ] SSTK: Loaded 26778 existing records. [2025-09-23T21:25:48.275834] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:25:48.293036] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-23T21:25:48.321760] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-23T21:25:48.357600] [DEBUG] [LOCAL ] ST: Loaded 49833 existing records from primary storage. [2025-09-23T21:25:48.361805] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-23T21:25:48.362187] [INFO ] [MAIN ] ST: Loaded 49833 existing records. [2025-09-23T21:25:48.362229] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-23T21:25:48.440393] [DEBUG] [LOCAL ] STAG: Loaded 50044 existing records from primary storage. [2025-09-23T21:25:48.542225] [INFO ] [MAIN ] STAG: Loaded 50044 existing records. [2025-09-23T21:25:48.697468] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:25:48.831560] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-23T21:25:48.913936] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-23T21:25:49.075698] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:25:49.070307] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:25:49.075789] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-23T21:25:49.121855] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-23T21:25:49.132407] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-23T21:25:49.132349] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-23T21:25:49.142218] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-23T21:25:49.163236] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-23T21:25:49.147497] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-23T21:25:49.169052] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-23T21:25:49.239956] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-23T21:25:49.283195] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-23T21:25:49.538802] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:25:49.586034] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-23T21:25:50.373305] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:25:50.328083] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:25:50.373789] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-23T21:25:50.367997] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:25:50.374056] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-23T21:25:50.376027] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-23T21:25:50.948251] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T21:25:50.951470] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-23T21:25:51.709850] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T21:25:51.717132] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-23T21:25:51.822687] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T21:25:51.833098] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-23T21:25:52.020906] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T21:25:52.025677] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-23T21:25:52.171834] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T21:25:52.202150] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-23T21:25:52.631919] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T21:25:52.862574] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T21:25:53.002192] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-23T21:25:53.557452] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T21:25:53.802202] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-23T21:25:53.958904] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T21:25:53.987214] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T21:25:54.602217] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-23T21:25:55.271129] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T21:25:55.402149] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-23T21:25:55.453101] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T21:25:56.202197] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-23T21:25:57.002175] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-23T21:25:57.034997] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:25:57.129875] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T21:25:57.802202] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-23T21:25:58.606024] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-23T21:25:58.611079] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T21:25:59.241027] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T21:25:59.402173] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-23T21:26:00.202168] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-23T21:26:00.314189] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T21:26:00.750985] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T21:26:01.002204] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-23T21:26:01.739284] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T21:26:01.802243] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-23T21:26:02.602183] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-23T21:26:02.642052] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T21:26:02.704156] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T21:26:03.402206] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-23T21:26:04.202217] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-23T21:26:04.273521] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T21:26:04.301200] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T21:26:05.002268] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-23T21:26:05.802220] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-23T21:26:05.903634] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T21:26:06.602283] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-23T21:26:06.916065] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-23T21:26:06.981988] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T21:26:07.402216] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-23T21:26:07.769384] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T21:26:08.202215] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-23T21:26:08.770388] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T21:26:09.002182] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-23T21:26:09.121960] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T21:26:09.802222] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-23T21:26:10.580176] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T21:26:10.602159] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-23T21:26:11.402190] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-23T21:26:11.623972] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T21:26:12.202219] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-23T21:26:12.257128] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T21:26:12.296211] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T21:26:13.002214] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-23T21:26:13.463560] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T21:26:13.802205] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-23T21:26:14.524363] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T21:26:14.546545] [INFO ] [REMOTE ] SST: Full fetch complete (19076 records). [2025-09-23T21:26:14.546932] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-23T21:26:14.581667] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T21:26:14.607398] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-23T21:26:14.653057] [INFO ] [REMOTE ] ST: Full fetch complete (71949 records). [2025-09-23T21:26:14.664344] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-23T21:26:15.244395] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-23T21:26:15.250151] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-23T21:26:15.260988] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-23T21:26:15.266193] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-23T21:26:15.304449] [DEBUG] [LOCAL ] SST: Trimmed 19076 records to 12201 (keeping 200 days of data) [2025-09-23T21:26:15.348615] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-23T21:26:15.348719] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-23T21:26:15.349514] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-23T21:26:15.349559] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-23T21:26:15.376900] [DEBUG] [LOCAL ] ST: Trimmed 71949 records to 49825 (keeping 200 days of data) [2025-09-23T21:26:15.402380] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-23T21:26:15.520403] [DEBUG] [LOCAL ] SST: Primary data saved (12201 records). [2025-09-23T21:26:15.521171] [INFO ] [MAIN ] SST: Full history saved. [2025-09-23T21:26:15.521502] [INFO ] [MAIN ] Update Progress: 2001/2372 symbols completed. SST took 28.3s. Estimated remaining: 49m 21s. Rate: 7.5 symbols/min [2025-09-23T21:26:15.709310] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:26:15.732562] [DEBUG] [LOCAL ] STC: Loaded 17811 existing records from primary storage. [2025-09-23T21:26:15.733184] [INFO ] [MAIN ] STC: Loaded 17811 existing records. [2025-09-23T21:26:15.937832] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:26:15.940919] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-23T21:26:15.941162] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-23T21:26:16.006884] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-23T21:26:16.019149] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-23T21:26:16.019077] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T21:26:16.229866] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-23T21:26:16.471005] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:26:16.543661] [DEBUG] [LOCAL ] ST: Primary data saved (49825 records). [2025-09-23T21:26:16.543822] [INFO ] [MAIN ] ST: Full history saved. [2025-09-23T21:26:16.543914] [INFO ] [MAIN ] Update Progress: 2002/2372 symbols completed. ST took 29.3s. Estimated remaining: 49m 12s. Rate: 7.5 symbols/min [2025-09-23T21:26:16.716250] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:26:16.751708] [DEBUG] [LOCAL ] STE: Loaded 35458 existing records from primary storage. [2025-09-23T21:26:16.751847] [INFO ] [MAIN ] STE: Loaded 35458 existing records. [2025-09-23T21:26:16.933996] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:26:16.934300] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-23T21:26:16.934350] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-23T21:26:16.935784] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-23T21:26:16.935847] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-23T21:26:17.013186] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-23T21:26:17.304841] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:26:17.316165] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T21:26:17.345895] [INFO ] [REMOTE ] SSTK: Full fetch complete (42311 records). [2025-09-23T21:26:17.347697] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-23T21:26:17.347585] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-23T21:26:17.734010] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-23T21:26:17.734106] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-23T21:26:17.734921] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-23T21:26:17.734982] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-23T21:26:17.736060] [DEBUG] [LOCAL ] SSTK: Trimmed 42311 records to 26629 (keeping 200 days of data) [2025-09-23T21:26:17.822156] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-23T21:26:17.902673] [DEBUG] [LOCAL ] SSTK: Primary data saved (26629 records). [2025-09-23T21:26:17.902831] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-23T21:26:17.902924] [INFO ] [MAIN ] Update Progress: 2003/2372 symbols completed. SSTK took 30.6s. Estimated remaining: 49m 3s. Rate: 7.5 symbols/min [2025-09-23T21:26:18.072410] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:26:18.095228] [DEBUG] [LOCAL ] STEL: Loaded 23723 existing records from primary storage. [2025-09-23T21:26:18.095362] [INFO ] [MAIN ] STEL: Loaded 23723 existing records. [2025-09-23T21:26:18.278360] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:26:18.278779] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-23T21:26:18.278839] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-23T21:26:18.279477] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-23T21:26:18.279537] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-23T21:26:18.408611] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T21:26:18.609957] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-23T21:26:18.650714] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:26:19.116082] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T21:26:19.402158] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-23T21:26:19.638564] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T21:26:20.066583] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T21:26:20.202170] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-23T21:26:21.002215] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-23T21:26:21.263080] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T21:26:21.763085] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T21:26:21.802149] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-23T21:26:22.602159] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-23T21:26:22.980113] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T21:26:23.402213] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-23T21:26:23.616381] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T21:26:24.202165] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-23T21:26:24.443112] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T21:26:25.002210] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-23T21:26:25.441875] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T21:26:25.802193] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-23T21:26:26.590783] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T21:26:26.599104] [INFO ] [REMOTE ] STAG: Full fetch complete (71860 records). [2025-09-23T21:26:26.599229] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-23T21:26:26.611110] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-23T21:26:27.026194] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-23T21:26:27.026350] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-23T21:26:27.027703] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-23T21:26:27.027799] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-23T21:26:27.036827] [DEBUG] [LOCAL ] STAG: Trimmed 71860 records to 50045 (keeping 200 days of data) [2025-09-23T21:26:27.054998] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T21:26:27.370969] [DEBUG] [LOCAL ] STAG: Primary data saved (50045 records). [2025-09-23T21:26:27.371250] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-23T21:26:27.371438] [INFO ] [MAIN ] Update Progress: 2004/2372 symbols completed. STAG took 40.1s. Estimated remaining: 48m 55s. Rate: 7.5 symbols/min [2025-09-23T21:26:27.403582] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-23T21:26:27.495899] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T21:26:27.565878] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:26:27.604247] [DEBUG] [LOCAL ] STEM: Loaded 39998 existing records from primary storage. [2025-09-23T21:26:27.604390] [INFO ] [MAIN ] STEM: Loaded 39998 existing records. [2025-09-23T21:26:27.781265] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:26:27.781525] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-23T21:26:27.781574] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-23T21:26:27.782494] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-23T21:26:27.782554] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-23T21:26:28.131000] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:26:28.202151] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-23T21:26:29.002168] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-23T21:26:29.052387] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T21:26:29.802164] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-23T21:26:30.060080] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T21:26:30.183252] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-23T21:26:30.602252] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-23T21:26:31.335711] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T21:26:31.402154] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-23T21:26:31.743077] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T21:26:32.202204] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-23T21:26:32.714952] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T21:26:33.002243] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-23T21:26:33.040740] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T21:26:33.802213] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-23T21:26:34.391349] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T21:26:34.602181] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-23T21:26:35.402175] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-23T21:26:35.733555] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T21:26:36.167015] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-23T21:26:36.202219] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-23T21:26:36.627494] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T21:26:37.002218] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-23T21:26:37.802188] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-23T21:26:37.973921] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T21:26:37.977326] [INFO ] [REMOTE ] STC: Full fetch complete (26206 records). [2025-09-23T21:26:37.977426] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-23T21:26:38.419746] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-23T21:26:38.419941] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-23T21:26:38.420625] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-23T21:26:38.421275] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-23T21:26:38.422242] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-23T21:26:38.434439] [DEBUG] [LOCAL ] STC: Trimmed 26206 records to 17778 (keeping 200 days of data) [2025-09-23T21:26:38.548585] [DEBUG] [LOCAL ] STC: Primary data saved (17778 records). [2025-09-23T21:26:38.548758] [INFO ] [MAIN ] STC: Full history saved. [2025-09-23T21:26:38.548872] [INFO ] [MAIN ] Update Progress: 2005/2372 symbols completed. STC took 23.0s. Estimated remaining: 48m 48s. Rate: 7.5 symbols/min [2025-09-23T21:26:38.612348] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-23T21:26:38.731789] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:26:38.749548] [DEBUG] [LOCAL ] STEW: Loaded 16288 existing records from primary storage. [2025-09-23T21:26:38.749743] [INFO ] [MAIN ] STEW: Loaded 16288 existing records. [2025-09-23T21:26:38.932462] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:26:38.932844] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-23T21:26:38.932944] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-23T21:26:38.938779] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-23T21:26:38.946027] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-23T21:26:38.946731] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T21:26:39.322136] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:26:39.402153] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-23T21:26:40.202165] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-23T21:26:40.423067] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T21:26:40.594599] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-23T21:26:41.002211] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-23T21:26:41.372058] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T21:26:41.802211] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-23T21:26:41.878341] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T21:26:42.602213] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-23T21:26:42.897182] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T21:26:43.070391] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T21:26:43.402180] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-23T21:26:44.202174] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-23T21:26:44.520824] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T21:26:45.002208] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-23T21:26:45.380150] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T21:26:45.802215] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-23T21:26:46.602270] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-23T21:26:46.888799] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T21:26:47.141508] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T21:26:47.148410] [INFO ] [REMOTE ] STE: Full fetch complete (50732 records). [2025-09-23T21:26:47.148683] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-23T21:26:47.411822] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-23T21:26:47.553026] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-23T21:26:47.553336] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-23T21:26:47.554579] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-23T21:26:47.554822] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-23T21:26:47.556422] [DEBUG] [LOCAL ] STE: Trimmed 50732 records to 35424 (keeping 200 days of data) [2025-09-23T21:26:47.666754] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T21:26:47.806022] [DEBUG] [LOCAL ] STE: Primary data saved (35424 records). [2025-09-23T21:26:47.806189] [INFO ] [MAIN ] STE: Full history saved. [2025-09-23T21:26:47.806281] [INFO ] [MAIN ] Update Progress: 2006/2372 symbols completed. STE took 31.3s. Estimated remaining: 48m 40s. Rate: 7.5 symbols/min [2025-09-23T21:26:47.976842] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:26:47.977016] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-23T21:26:47.977052] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-23T21:26:47.977194] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-23T21:26:47.977236] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-23T21:26:47.977276] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-23T21:26:47.977308] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-23T21:26:48.207685] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-23T21:26:48.331859] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:26:49.002181] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-23T21:26:49.267422] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T21:26:49.304136] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T21:26:49.350517] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-23T21:26:49.802214] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-23T21:26:50.602243] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-23T21:26:51.402162] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-23T21:26:51.576504] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T21:26:51.678851] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T21:26:52.202176] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-23T21:26:52.420159] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T21:26:52.424819] [INFO ] [REMOTE ] STEL: Full fetch complete (32168 records). [2025-09-23T21:26:52.424907] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-23T21:26:52.828451] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-23T21:26:52.828537] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-23T21:26:52.829310] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-23T21:26:52.829373] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-23T21:26:52.830174] [DEBUG] [LOCAL ] STEL: Trimmed 32168 records to 23688 (keeping 200 days of data) [2025-09-23T21:26:53.002225] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-23T21:26:53.011184] [DEBUG] [LOCAL ] STEL: Primary data saved (23688 records). [2025-09-23T21:26:53.011284] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-23T21:26:53.011511] [INFO ] [MAIN ] Update Progress: 2007/2372 symbols completed. STEL took 35.1s. Estimated remaining: 48m 32s. Rate: 7.5 symbols/min [2025-09-23T21:26:53.199898] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:26:53.211811] [DEBUG] [LOCAL ] STK: Loaded 9385 existing records from primary storage. [2025-09-23T21:26:53.212108] [INFO ] [MAIN ] STK: Loaded 9385 existing records. [2025-09-23T21:26:53.327588] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T21:26:53.414738] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:26:53.418251] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T21:26:53.419825] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-23T21:26:53.419894] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-23T21:26:53.420271] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-23T21:26:53.420358] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-23T21:26:53.784451] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:26:53.802164] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-23T21:26:54.130042] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T21:26:54.602201] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-23T21:26:55.405623] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-23T21:26:55.407803] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T21:26:56.202167] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-23T21:26:56.346381] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T21:26:56.747293] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T21:26:57.002235] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-23T21:26:57.790892] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T21:26:57.802137] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-23T21:26:58.602208] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-23T21:26:58.711401] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T21:26:58.924682] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-23T21:26:59.402192] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-23T21:27:00.202301] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-23T21:27:00.245844] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T21:27:01.002240] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-23T21:27:01.802196] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-23T21:27:02.211369] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-23T21:27:02.327340] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T21:27:02.602193] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-23T21:27:03.402273] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-23T21:27:04.202242] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-23T21:27:04.301096] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T21:27:04.310989] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-23T21:27:05.002214] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-23T21:27:05.457704] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-23T21:27:05.500443] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T21:27:05.795445] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T21:27:05.802153] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-23T21:27:06.602183] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-23T21:27:06.616481] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T21:27:06.619077] [INFO ] [REMOTE ] STEW: Full fetch complete (22087 records). [2025-09-23T21:27:06.619159] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-23T21:27:06.991543] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-23T21:27:06.991626] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-23T21:27:06.992132] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-23T21:27:06.992205] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-23T21:27:06.993900] [DEBUG] [LOCAL ] STEW: Trimmed 22087 records to 16302 (keeping 200 days of data) [2025-09-23T21:27:07.109457] [DEBUG] [LOCAL ] STEW: Primary data saved (16302 records). [2025-09-23T21:27:07.109851] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-23T21:27:07.110200] [INFO ] [MAIN ] Update Progress: 2008/2372 symbols completed. STEW took 28.6s. Estimated remaining: 48m 25s. Rate: 7.5 symbols/min [2025-09-23T21:27:07.295898] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:07.296179] [DEBUG] [LOCAL ] STLA: No existing data file found in primary storage. [2025-09-23T21:27:07.296230] [WARN ] [MAIN ] STLA: No existing data found, performing full refresh instead. [2025-09-23T21:27:07.296408] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-23T21:27:07.296470] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-23T21:27:07.296560] [DEBUG] [LOCAL ] STLA: No primary data file found to delete. [2025-09-23T21:27:07.296606] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-23T21:27:07.407332] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-23T21:27:07.659745] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:07.794394] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T21:27:07.801316] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T21:27:07.804422] [INFO ] [REMOTE ] STEM: Full fetch complete (62777 records). [2025-09-23T21:27:07.804522] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-23T21:27:08.214614] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-23T21:27:08.217895] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-23T21:27:08.219420] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-23T21:27:08.220706] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-23T21:27:08.220974] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-23T21:27:08.222732] [DEBUG] [LOCAL ] STEM: Trimmed 62777 records to 39892 (keeping 200 days of data) [2025-09-23T21:27:08.477023] [DEBUG] [LOCAL ] STEM: Primary data saved (39892 records). [2025-09-23T21:27:08.477168] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-23T21:27:08.477301] [INFO ] [MAIN ] Update Progress: 2009/2372 symbols completed. STEM took 41.1s. Estimated remaining: 48m 16s. Rate: 7.5 symbols/min [2025-09-23T21:27:08.656882] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:08.719098] [DEBUG] [LOCAL ] STM: Loaded 53588 existing records from primary storage. [2025-09-23T21:27:08.719258] [INFO ] [MAIN ] STM: Loaded 53588 existing records. [2025-09-23T21:27:08.902684] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:27:08.902946] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-23T21:27:08.903001] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-23T21:27:08.904327] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-23T21:27:08.904407] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-23T21:27:09.002251] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-23T21:27:09.028846] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T21:27:09.316143] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:09.802225] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-23T21:27:10.251706] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T21:27:10.602221] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-23T21:27:11.032265] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T21:27:11.033827] [INFO ] [REMOTE ] STG: Full fetch complete (2501 records). [2025-09-23T21:27:11.033954] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-23T21:27:11.240907] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-23T21:27:11.241303] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:27:11.241463] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:27:11.241562] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-23T21:27:11.242062] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-23T21:27:11.242171] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-23T21:27:11.242294] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-23T21:27:11.242409] [INFO ] [MAIN ] Update Progress: 2010/2372 symbols completed. STG took 23.4s. Estimated remaining: 48m 7s. Rate: 7.5 symbols/min [2025-09-23T21:27:11.414048] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-23T21:27:11.450215] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:11.452526] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-23T21:27:11.498771] [DEBUG] [LOCAL ] STN: Loaded 23062 existing records from primary storage. [2025-09-23T21:27:11.498912] [INFO ] [MAIN ] STN: Loaded 23062 existing records. [2025-09-23T21:27:11.674306] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:27:11.674559] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-23T21:27:11.674607] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-23T21:27:11.675328] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-23T21:27:11.675389] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-23T21:27:12.034837] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:12.202201] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-23T21:27:12.218941] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T21:27:13.002258] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-23T21:27:13.802212] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-23T21:27:14.602173] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-23T21:27:14.645754] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T21:27:14.896820] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-23T21:27:15.402213] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-23T21:27:15.546513] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T21:27:15.711519] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-23T21:27:16.202203] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-23T21:27:17.004595] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T21:27:17.002246] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-23T21:27:17.168063] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T21:27:17.497399] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T21:27:17.802252] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-23T21:27:18.602198] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-23T21:27:18.935491] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T21:27:19.401515] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T21:27:19.405025] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-23T21:27:19.405748] [INFO ] [REMOTE ] STK: Full fetch complete (14017 records). [2025-09-23T21:27:19.406847] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-23T21:27:19.816061] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-23T21:27:19.816155] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-23T21:27:19.816494] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-23T21:27:19.816535] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-23T21:27:19.817182] [DEBUG] [LOCAL ] STK: Trimmed 14017 records to 9417 (keeping 200 days of data) [2025-09-23T21:27:19.886405] [DEBUG] [LOCAL ] STK: Primary data saved (9417 records). [2025-09-23T21:27:19.886555] [INFO ] [MAIN ] STK: Full history saved. [2025-09-23T21:27:19.886749] [INFO ] [MAIN ] Update Progress: 2011/2372 symbols completed. STK took 26.9s. Estimated remaining: 47m 59s. Rate: 7.5 symbols/min [2025-09-23T21:27:20.068297] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:20.130720] [DEBUG] [LOCAL ] STNG: Loaded 44049 existing records from primary storage. [2025-09-23T21:27:20.130886] [INFO ] [MAIN ] STNG: Loaded 44049 existing records. [2025-09-23T21:27:20.208864] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-23T21:27:20.333913] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:27:20.334350] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-23T21:27:20.334428] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-23T21:27:20.336132] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-23T21:27:20.336197] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-23T21:27:20.693415] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T21:27:20.754627] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:21.002250] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-23T21:27:21.802197] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-23T21:27:22.072485] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T21:27:22.299124] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T21:27:22.602216] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-23T21:27:23.402202] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-23T21:27:23.741009] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T21:27:23.788823] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T21:27:24.202194] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-23T21:27:25.002217] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-23T21:27:25.802180] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-23T21:27:26.079787] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-23T21:27:26.602172] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-23T21:27:27.001813] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T21:27:27.187878] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-23T21:27:27.257334] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (3.06 seconds). [2025-09-23T21:27:27.402213] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-23T21:27:28.126308] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T21:27:28.202178] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-23T21:27:29.002177] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-23T21:27:29.225545] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T21:27:29.771455] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T21:27:29.802163] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-23T21:27:29.920933] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T21:27:30.602170] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-23T21:27:30.888436] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T21:27:31.402221] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-23T21:27:32.202196] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-23T21:27:32.871591] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-23T21:27:33.002199] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-23T21:27:33.103273] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T21:27:33.154214] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T21:27:33.802195] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-23T21:27:34.602148] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-23T21:27:34.833613] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T21:27:34.837782] [INFO ] [REMOTE ] STN: Full fetch complete (32301 records). [2025-09-23T21:27:34.837869] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-23T21:27:35.106093] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T21:27:35.277020] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-23T21:27:35.277137] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-23T21:27:35.278193] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-23T21:27:35.278265] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-23T21:27:35.279340] [DEBUG] [LOCAL ] STN: Trimmed 32301 records to 23107 (keeping 200 days of data) [2025-09-23T21:27:35.414963] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-23T21:27:35.443791] [DEBUG] [LOCAL ] STN: Primary data saved (23107 records). [2025-09-23T21:27:35.443986] [INFO ] [MAIN ] STN: Full history saved. [2025-09-23T21:27:35.444101] [INFO ] [MAIN ] Update Progress: 2012/2372 symbols completed. STN took 24.2s. Estimated remaining: 47m 52s. Rate: 7.5 symbols/min [2025-09-23T21:27:35.627071] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:35.642205] [DEBUG] [LOCAL ] STRV: Loaded 11643 existing records from primary storage. [2025-09-23T21:27:35.642417] [INFO ] [MAIN ] STRV: Loaded 11643 existing records. [2025-09-23T21:27:35.834775] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:27:35.835130] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-23T21:27:35.835183] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-23T21:27:35.835891] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-23T21:27:35.835956] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-23T21:27:36.212773] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-23T21:27:36.220260] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:36.422905] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T21:27:36.548820] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T21:27:37.002276] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-23T21:27:37.802188] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-23T21:27:37.946898] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T21:27:37.968858] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T21:27:38.602258] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-23T21:27:39.386134] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T21:27:39.402205] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-23T21:27:39.589306] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T21:27:40.202251] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-23T21:27:40.965745] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T21:27:41.002377] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-23T21:27:41.006370] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T21:27:41.802196] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-23T21:27:42.602175] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-23T21:27:43.070048] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-23T21:27:43.402155] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-23T21:27:43.494065] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T21:27:44.202157] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-23T21:27:44.761203] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T21:27:44.781899] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T21:27:45.002190] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-23T21:27:45.692942] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-23T21:27:45.802170] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-23T21:27:46.054137] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T21:27:46.602274] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-23T21:27:47.402175] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-23T21:27:47.426303] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T21:27:47.975685] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-23T21:27:48.202200] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-23T21:27:49.002295] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-23T21:27:49.169754] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T21:27:49.354184] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-23T21:27:49.802212] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-23T21:27:50.602235] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-23T21:27:51.060358] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T21:27:51.069758] [INFO ] [REMOTE ] STLA: Full fetch complete (77530 records). [2025-09-23T21:27:51.069944] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-23T21:27:51.408944] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-23T21:27:51.482613] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-23T21:27:51.482759] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-23T21:27:51.483876] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-23T21:27:51.483939] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-23T21:27:51.485411] [DEBUG] [LOCAL ] STLA: Trimmed 77530 records to 53543 (keeping 200 days of data) [2025-09-23T21:27:51.833446] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T21:27:51.844806] [INFO ] [REMOTE ] STM: Full fetch complete (77524 records). [2025-09-23T21:27:51.845522] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-23T21:27:52.009672] [DEBUG] [LOCAL ] STLA: Primary data saved (53543 records). [2025-09-23T21:27:52.041358] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-23T21:27:52.046611] [INFO ] [MAIN ] Update Progress: 2013/2372 symbols completed. STLA took 44.9s. Estimated remaining: 47m 46s. Rate: 7.5 symbols/min [2025-09-23T21:27:52.342847] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T21:27:52.441871] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-23T21:27:52.474528] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T21:27:52.520434] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:52.524939] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-23T21:27:52.525469] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-23T21:27:52.527287] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-23T21:27:52.527889] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-23T21:27:52.527792] [INFO ] [REMOTE ] STNG: Full fetch complete (64441 records). [2025-09-23T21:27:52.528209] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-23T21:27:52.567263] [DEBUG] [LOCAL ] STM: Trimmed 77524 records to 53587 (keeping 200 days of data) [2025-09-23T21:27:53.011020] [DEBUG] [LOCAL ] STT: Loaded 51136 existing records from primary storage. [2025-09-23T21:27:53.011521] [INFO ] [MAIN ] STT: Loaded 51136 existing records. [2025-09-23T21:27:53.279458] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-23T21:27:53.280354] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-23T21:27:53.293239] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-23T21:27:53.293876] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-23T21:27:53.352422] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T21:27:53.358399] [DEBUG] [LOCAL ] STNG: Trimmed 64441 records to 44048 (keeping 200 days of data) [2025-09-23T21:27:53.359978] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-23T21:27:53.387728] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:27:53.387991] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-23T21:27:53.388042] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-23T21:27:53.389518] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-23T21:27:53.389943] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-23T21:27:54.032495] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:54.034009] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-23T21:27:54.219775] [DEBUG] [LOCAL ] STNG: Primary data saved (44048 records). [2025-09-23T21:27:54.220704] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-23T21:27:54.221147] [INFO ] [MAIN ] Update Progress: 2014/2372 symbols completed. STNG took 34.3s. Estimated remaining: 47m 37s. Rate: 7.5 symbols/min [2025-09-23T21:27:54.234926] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T21:27:54.255821] [INFO ] [REMOTE ] STRV: Full fetch complete (18610 records). [2025-09-23T21:27:54.266421] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-23T21:27:54.576210] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:54.651801] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-23T21:27:54.658351] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-23T21:27:54.736408] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-23T21:27:54.749488] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-23T21:27:54.775402] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-23T21:27:54.794331] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-23T21:27:54.994733] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-23T21:27:54.995710] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-23T21:27:55.007013] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-23T21:27:55.013135] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-23T21:27:55.089010] [DEBUG] [LOCAL ] STRV: Trimmed 18610 records to 11626 (keeping 200 days of data) [2025-09-23T21:27:55.334217] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:55.336359] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-23T21:27:55.346804] [DEBUG] [LOCAL ] STM: Primary data saved (53587 records). [2025-09-23T21:27:55.347866] [INFO ] [MAIN ] STM: Full history saved. [2025-09-23T21:27:55.348258] [INFO ] [MAIN ] Update Progress: 2015/2372 symbols completed. STM took 46.9s. Estimated remaining: 47m 28s. Rate: 7.5 symbols/min [2025-09-23T21:27:55.547016] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:55.548100] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:27:55.549828] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-23T21:27:55.550585] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-09-23T21:27:55.556460] [DEBUG] [LOCAL ] STRV: Primary data saved (11626 records). [2025-09-23T21:27:55.556562] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-23T21:27:55.556682] [INFO ] [MAIN ] Update Progress: 2016/2372 symbols completed. STRV took 20.1s. Estimated remaining: 47m 18s. Rate: 7.5 symbols/min [2025-09-23T21:27:55.688974] [DEBUG] [LOCAL ] STVN: Loaded 26415 existing records from primary storage. [2025-09-23T21:27:55.694785] [INFO ] [MAIN ] STVN: Loaded 26415 existing records. [2025-09-23T21:27:55.817810] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:27:55.876081] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-09-23T21:27:55.879446] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:27:55.963336] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:27:55.964046] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-23T21:27:55.964209] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-23T21:27:55.978155] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-23T21:27:55.978401] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-23T21:27:56.075732] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T21:27:56.209604] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-23T21:27:56.326221] [DEBUG] [LOCAL ] STWD: Loaded 51899 existing records from primary storage. [2025-09-23T21:27:56.348164] [INFO ] [MAIN ] STWD: Loaded 51899 existing records. [2025-09-23T21:27:56.557592] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:56.630385] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:27:56.630691] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-23T21:27:56.630769] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-23T21:27:56.631980] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-23T21:27:56.632043] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-23T21:27:56.987725] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:27:57.002165] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-23T21:27:57.802215] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-02. [2025-09-23T21:27:58.089906] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:27:58.090287] [WARN ] [REMOTE ] STUB: No data returned for month 2025-02 [2025-09-23T21:27:58.144022] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T21:27:58.602171] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-03. [2025-09-23T21:27:58.778726] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T21:27:58.797522] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:27:58.797812] [WARN ] [REMOTE ] STUB: No data returned for month 2025-03 [2025-09-23T21:27:59.402201] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-23T21:28:00.202266] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-23T21:28:00.681122] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T21:28:01.002218] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-23T21:28:01.802210] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-04. [2025-09-23T21:28:02.072006] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T21:28:02.264457] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:28:02.265041] [WARN ] [REMOTE ] STUB: No data returned for month 2025-04 [2025-09-23T21:28:02.283780] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T21:28:02.602265] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-23T21:28:03.402243] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-23T21:28:03.744763] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T21:28:04.202232] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-05. [2025-09-23T21:28:04.406128] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:28:04.406633] [WARN ] [REMOTE ] STUB: No data returned for month 2025-05 [2025-09-23T21:28:04.980570] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T21:28:05.002155] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-23T21:28:05.802200] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-23T21:28:06.602188] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-23T21:28:06.675794] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T21:28:07.402237] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-23T21:28:07.570736] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T21:28:07.824297] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T21:28:08.202254] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-23T21:28:08.822917] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T21:28:09.002236] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-23T21:28:09.802235] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-23T21:28:10.131393] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T21:28:10.602238] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-06. [2025-09-23T21:28:10.806611] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:28:10.806999] [WARN ] [REMOTE ] STUB: No data returned for month 2025-06 [2025-09-23T21:28:10.841085] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T21:28:11.096823] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T21:28:11.402236] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-23T21:28:12.202195] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-07. [2025-09-23T21:28:12.402892] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:28:12.403219] [WARN ] [REMOTE ] STUB: No data returned for month 2025-07 [2025-09-23T21:28:13.002188] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-08. [2025-09-23T21:28:13.216275] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:28:13.218183] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T21:28:13.218264] [WARN ] [REMOTE ] STUB: No data returned for month 2025-08 [2025-09-23T21:28:13.802221] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-23T21:28:14.602251] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-23T21:28:15.402232] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-23T21:28:15.545742] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T21:28:15.776020] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T21:28:16.202191] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-23T21:28:17.002176] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-09. [2025-09-23T21:28:17.116917] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T21:28:17.421925] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T21:28:17.802170] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-23T21:28:17.934632] [INFO ] [REMOTE ] STUB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T21:28:17.938882] [INFO ] [REMOTE ] STUB: Full fetch complete (1785 records). [2025-09-23T21:28:17.938988] [DEBUG] [VALIDATOR ] STUB: Validating primary data. [2025-09-23T21:28:18.115896] [WARN ] [VALIDATOR ] STUB: Validation failed - insufficient historical data. Have 5 unique days, need 200 days [2025-09-23T21:28:18.116085] [FATAL] [MAIN ] STUB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:28:18.116169] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:28:18.116216] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-23T21:28:18.116271] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-23T21:28:18.116305] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-23T21:28:18.116343] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-23T21:28:18.116400] [INFO ] [MAIN ] Update Progress: 2017/2372 symbols completed. STUB took 23.9s. Estimated remaining: 47m 13s. Rate: 7.5 symbols/min [2025-09-23T21:28:18.285482] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:28:18.288831] [DEBUG] [LOCAL ] STXD: Loaded 1330 existing records from primary storage. [2025-09-23T21:28:18.288908] [INFO ] [MAIN ] STXD: Loaded 1330 existing records. [2025-09-23T21:28:18.485299] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:28:18.485613] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-23T21:28:18.485694] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-23T21:28:18.485921] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-23T21:28:18.485981] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-23T21:28:18.607378] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-23T21:28:18.866414] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:28:19.402171] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-23T21:28:19.644373] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T21:28:19.998599] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T21:28:20.136091] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T21:28:20.202198] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-23T21:28:21.002196] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-23T21:28:21.402426] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T21:28:21.520893] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-23T21:28:21.802250] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-23T21:28:22.602232] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-23T21:28:22.950191] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T21:28:22.955464] [INFO ] [REMOTE ] STVN: Full fetch complete (39293 records). [2025-09-23T21:28:22.955573] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-23T21:28:23.335745] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-23T21:28:23.335825] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-23T21:28:23.336628] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-23T21:28:23.336713] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-23T21:28:23.337550] [DEBUG] [LOCAL ] STVN: Trimmed 39293 records to 26321 (keeping 200 days of data) [2025-09-23T21:28:23.425323] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-23T21:28:23.500865] [DEBUG] [LOCAL ] STVN: Primary data saved (26321 records). [2025-09-23T21:28:23.501010] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-23T21:28:23.501115] [INFO ] [MAIN ] Update Progress: 2018/2372 symbols completed. STVN took 28.2s. Estimated remaining: 47m 4s. Rate: 7.5 symbols/min [2025-09-23T21:28:23.675027] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:28:23.679138] [DEBUG] [LOCAL ] STXE: Loaded 2217 existing records from primary storage. [2025-09-23T21:28:23.679237] [INFO ] [MAIN ] STXE: Loaded 2217 existing records. [2025-09-23T21:28:23.862513] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:28:23.862864] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-23T21:28:23.862913] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-23T21:28:23.863077] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-23T21:28:23.863135] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-23T21:28:24.202826] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-23T21:28:24.241448] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:28:24.339787] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T21:28:24.673769] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T21:28:25.002168] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-23T21:28:25.273871] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T21:28:25.802228] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-23T21:28:26.142214] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-23T21:28:26.379177] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T21:28:26.387795] [INFO ] [REMOTE ] STT: Full fetch complete (74593 records). [2025-09-23T21:28:26.387923] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-23T21:28:26.610097] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-23T21:28:26.781834] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-23T21:28:26.781928] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-23T21:28:26.783092] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-23T21:28:26.783163] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-23T21:28:26.784858] [DEBUG] [LOCAL ] STT: Trimmed 74593 records to 51108 (keeping 200 days of data) [2025-09-23T21:28:27.130338] [DEBUG] [LOCAL ] STT: Primary data saved (51108 records). [2025-09-23T21:28:27.130485] [INFO ] [MAIN ] STT: Full history saved. [2025-09-23T21:28:27.130604] [INFO ] [MAIN ] Update Progress: 2019/2372 symbols completed. STT took 35.1s. Estimated remaining: 46m 56s. Rate: 7.5 symbols/min [2025-09-23T21:28:27.240546] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-23T21:28:27.314865] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:28:27.319696] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-23T21:28:27.319796] [INFO ] [MAIN ] STXG: Loaded 2612 existing records. [2025-09-23T21:28:27.407393] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-23T21:28:27.504839] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:28:27.505128] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-23T21:28:27.505184] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-23T21:28:27.505456] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-23T21:28:27.505545] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-23T21:28:27.899746] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:28:27.930480] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T21:28:28.202206] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-23T21:28:28.756233] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T21:28:29.002212] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-23T21:28:29.449055] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T21:28:29.802243] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-23T21:28:30.298131] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T21:28:30.602275] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-23T21:28:31.047929] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-23T21:28:31.402326] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-23T21:28:31.921460] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T21:28:32.202282] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-23T21:28:32.759954] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-23T21:28:33.002261] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-23T21:28:33.584361] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T21:28:33.802190] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-23T21:28:34.371721] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T21:28:34.602194] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-23T21:28:35.093412] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-23T21:28:35.402232] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-23T21:28:35.980385] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T21:28:36.202214] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-23T21:28:36.693578] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-23T21:28:37.002189] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-23T21:28:37.370419] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-23T21:28:37.802192] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-23T21:28:38.277380] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T21:28:38.602242] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-23T21:28:39.028802] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T21:28:39.402224] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-23T21:28:39.898702] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T21:28:39.899685] [INFO ] [REMOTE ] STXE: Full fetch complete (3696 records). [2025-09-23T21:28:39.899756] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-23T21:28:40.207270] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-23T21:28:40.269840] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-23T21:28:40.269941] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-23T21:28:40.270064] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-23T21:28:40.270102] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-23T21:28:40.270492] [DEBUG] [LOCAL ] STXE: Trimmed 3696 records to 2211 (keeping 200 days of data) [2025-09-23T21:28:40.285116] [DEBUG] [LOCAL ] STXE: Primary data saved (2211 records). [2025-09-23T21:28:40.285378] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-23T21:28:40.285482] [INFO ] [MAIN ] Update Progress: 2020/2372 symbols completed. STXE took 16.8s. Estimated remaining: 46m 49s. Rate: 7.5 symbols/min [2025-09-23T21:28:40.464885] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:28:40.468518] [DEBUG] [LOCAL ] STXK: Loaded 1510 existing records from primary storage. [2025-09-23T21:28:40.468600] [INFO ] [MAIN ] STXK: Loaded 1510 existing records. [2025-09-23T21:28:40.651194] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:28:40.651449] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-23T21:28:40.651496] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-23T21:28:40.651771] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-23T21:28:40.651833] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-23T21:28:40.956200] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T21:28:41.007249] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-23T21:28:41.038577] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:28:41.388822] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T21:28:41.802214] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-23T21:28:42.602191] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-23T21:28:43.108897] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-23T21:28:43.402203] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-23T21:28:43.518383] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T21:28:43.842993] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T21:28:44.202250] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-23T21:28:44.650931] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T21:28:45.002216] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-23T21:28:45.430924] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T21:28:45.802206] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-23T21:28:46.602193] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-23T21:28:47.079352] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-23T21:28:47.402250] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-23T21:28:47.447204] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T21:28:47.457353] [INFO ] [REMOTE ] STWD: Full fetch complete (74954 records). [2025-09-23T21:28:47.457667] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-23T21:28:47.796104] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T21:28:47.890813] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-23T21:28:47.890902] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-23T21:28:47.891970] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-23T21:28:47.892057] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-23T21:28:47.893606] [DEBUG] [LOCAL ] STWD: Trimmed 74954 records to 51900 (keeping 200 days of data) [2025-09-23T21:28:48.204483] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-23T21:28:48.227964] [DEBUG] [LOCAL ] STWD: Primary data saved (51900 records). [2025-09-23T21:28:48.228060] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-23T21:28:48.228151] [INFO ] [MAIN ] Update Progress: 2021/2372 symbols completed. STWD took 52.7s. Estimated remaining: 46m 41s. Rate: 7.5 symbols/min [2025-09-23T21:28:48.403414] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:28:48.403583] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-23T21:28:48.403622] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-23T21:28:48.403793] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-23T21:28:48.403837] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-23T21:28:48.403880] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-23T21:28:48.403913] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-23T21:28:48.693200] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-23T21:28:48.782723] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:28:49.002190] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-23T21:28:49.360479] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-23T21:28:49.802209] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-23T21:28:50.147903] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T21:28:50.602199] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-23T21:28:50.996617] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T21:28:51.402189] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-23T21:28:51.743285] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-23T21:28:51.744239] [INFO ] [REMOTE ] STXD: Full fetch complete (2067 records). [2025-09-23T21:28:51.744313] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-23T21:28:52.136278] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-23T21:28:52.136415] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-23T21:28:52.136529] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-23T21:28:52.136570] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-23T21:28:52.136985] [DEBUG] [LOCAL ] STXD: Trimmed 2067 records to 1325 (keeping 200 days of data) [2025-09-23T21:28:52.146337] [DEBUG] [LOCAL ] STXD: Primary data saved (1325 records). [2025-09-23T21:28:52.146448] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-23T21:28:52.146550] [INFO ] [MAIN ] Update Progress: 2022/2372 symbols completed. STXD took 34.0s. Estimated remaining: 46m 32s. Rate: 7.5 symbols/min [2025-09-23T21:28:52.207314] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-23T21:28:52.335772] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:28:52.340201] [DEBUG] [LOCAL ] STXT: Loaded 2590 existing records from primary storage. [2025-09-23T21:28:52.340296] [INFO ] [MAIN ] STXT: Loaded 2590 existing records. [2025-09-23T21:28:52.552453] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:28:52.552778] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-23T21:28:52.552886] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-23T21:28:52.553282] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-23T21:28:52.553368] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-23T21:28:52.719846] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T21:28:52.939606] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:28:53.002161] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-23T21:28:53.568165] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T21:28:53.802192] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-23T21:28:54.488111] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T21:28:54.602202] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-23T21:28:54.958603] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-23T21:28:55.402216] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-23T21:28:55.818806] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T21:28:56.202200] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-23T21:28:56.561835] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-23T21:28:56.562764] [INFO ] [REMOTE ] STXK: Full fetch complete (2432 records). [2025-09-23T21:28:56.562836] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-23T21:28:56.955336] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-23T21:28:56.955426] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-23T21:28:56.955579] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-23T21:28:56.955686] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-23T21:28:56.956206] [DEBUG] [LOCAL ] STXK: Trimmed 2432 records to 1513 (keeping 200 days of data) [2025-09-23T21:28:56.965943] [DEBUG] [LOCAL ] STXK: Primary data saved (1513 records). [2025-09-23T21:28:56.966003] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-23T21:28:56.966076] [INFO ] [MAIN ] Update Progress: 2023/2372 symbols completed. STXK took 16.7s. Estimated remaining: 46m 23s. Rate: 7.5 symbols/min [2025-09-23T21:28:57.007369] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-23T21:28:57.155978] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:28:57.159403] [DEBUG] [LOCAL ] STXV: Loaded 1659 existing records from primary storage. [2025-09-23T21:28:57.159474] [INFO ] [MAIN ] STXV: Loaded 1659 existing records. [2025-09-23T21:28:57.338891] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:28:57.339191] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-23T21:28:57.339241] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-23T21:28:57.339498] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-23T21:28:57.339560] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-23T21:28:57.736592] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:28:57.736840] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T21:28:57.802195] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-23T21:28:58.243727] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T21:28:58.602187] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-23T21:28:59.079207] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T21:28:59.402194] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-23T21:28:59.873197] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T21:29:00.202204] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-23T21:29:00.768922] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T21:29:01.002212] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-23T21:29:01.480506] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-23T21:29:01.802195] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-23T21:29:02.271183] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T21:29:02.602201] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-23T21:29:02.944178] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T21:29:03.402207] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-23T21:29:03.861942] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T21:29:04.202211] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-23T21:29:04.750786] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T21:29:05.002191] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-23T21:29:05.459775] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T21:29:05.802321] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-23T21:29:06.243415] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T21:29:06.602239] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-23T21:29:07.060300] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-23T21:29:07.402312] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-23T21:29:07.855195] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T21:29:07.856524] [INFO ] [REMOTE ] STXT: Full fetch complete (4024 records). [2025-09-23T21:29:07.856604] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-23T21:29:08.207373] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-23T21:29:08.242429] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-23T21:29:08.242566] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-23T21:29:08.242813] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-23T21:29:08.242872] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-23T21:29:08.243273] [DEBUG] [LOCAL ] STXT: Trimmed 4024 records to 2580 (keeping 200 days of data) [2025-09-23T21:29:08.260364] [DEBUG] [LOCAL ] STXT: Primary data saved (2580 records). [2025-09-23T21:29:08.260458] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-23T21:29:08.260549] [INFO ] [MAIN ] Update Progress: 2024/2372 symbols completed. STXT took 16.1s. Estimated remaining: 46m 16s. Rate: 7.5 symbols/min [2025-09-23T21:29:08.435496] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:29:08.506353] [DEBUG] [LOCAL ] STZ: Loaded 52271 existing records from primary storage. [2025-09-23T21:29:08.506611] [INFO ] [MAIN ] STZ: Loaded 52271 existing records. [2025-09-23T21:29:08.696110] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:29:08.701630] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T21:29:08.703975] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-23T21:29:08.704058] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-23T21:29:08.705786] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-23T21:29:08.705852] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-23T21:29:09.007411] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-23T21:29:09.095132] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:29:09.496707] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T21:29:09.802281] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-23T21:29:10.602217] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-23T21:29:11.128677] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T21:29:11.129596] [INFO ] [REMOTE ] STXG: Full fetch complete (4193 records). [2025-09-23T21:29:11.129689] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-23T21:29:11.412008] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-23T21:29:11.535629] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-23T21:29:11.535837] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-23T21:29:11.536027] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-23T21:29:11.536126] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-23T21:29:11.537136] [DEBUG] [LOCAL ] STXG: Trimmed 4193 records to 2595 (keeping 200 days of data) [2025-09-23T21:29:11.555273] [DEBUG] [LOCAL ] STXG: Primary data saved (2595 records). [2025-09-23T21:29:11.555395] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-23T21:29:11.555623] [INFO ] [MAIN ] Update Progress: 2025/2372 symbols completed. STXG took 44.4s. Estimated remaining: 46m 7s. Rate: 7.5 symbols/min [2025-09-23T21:29:11.774022] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:29:11.781968] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-23T21:29:11.782248] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-23T21:29:11.855546] [DEBUG] [LOCAL ] SU: Loaded 53459 existing records from primary storage. [2025-09-23T21:29:11.855769] [INFO ] [MAIN ] SU: Loaded 53459 existing records. [2025-09-23T21:29:12.029613] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:29:12.029868] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-23T21:29:12.029920] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-23T21:29:12.031302] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-23T21:29:12.031364] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-23T21:29:12.209481] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-23T21:29:12.393425] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:29:12.629176] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T21:29:13.002251] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-23T21:29:13.323325] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-23T21:29:13.802250] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-23T21:29:14.157294] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T21:29:14.602307] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-23T21:29:15.402235] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-23T21:29:16.202171] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-23T21:29:16.425915] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T21:29:16.643081] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T21:29:17.002218] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-23T21:29:17.510565] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-23T21:29:17.802204] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-23T21:29:18.602201] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-23T21:29:18.789833] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T21:29:18.953673] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T21:29:19.402165] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-23T21:29:19.819678] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-23T21:29:19.867720] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T21:29:20.202265] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-23T21:29:21.002245] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-23T21:29:21.452356] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T21:29:21.802214] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-23T21:29:22.168269] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-23T21:29:22.169182] [INFO ] [REMOTE ] STXM: Full fetch complete (1444 records). [2025-09-23T21:29:22.169253] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-23T21:29:22.366270] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-23T21:29:22.366537] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:29:22.366632] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:29:22.366819] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-23T21:29:22.367070] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-23T21:29:22.367315] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-23T21:29:22.367413] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-23T21:29:22.367833] [INFO ] [MAIN ] Update Progress: 2026/2372 symbols completed. STXM took 34.1s. Estimated remaining: 45m 60s. Rate: 7.5 symbols/min [2025-09-23T21:29:22.549019] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:29:22.583589] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-23T21:29:22.602149] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-23T21:29:22.640391] [DEBUG] [LOCAL ] SUI: Loaded 42116 existing records from primary storage. [2025-09-23T21:29:22.640556] [INFO ] [MAIN ] SUI: Loaded 42116 existing records. [2025-09-23T21:29:22.824146] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:29:22.824425] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-23T21:29:22.824478] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-23T21:29:22.825565] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-23T21:29:22.825626] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-23T21:29:23.224525] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:29:23.402222] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-23T21:29:24.202283] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-23T21:29:24.632260] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T21:29:24.703233] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T21:29:25.002251] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-23T21:29:25.408427] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-23T21:29:25.802195] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-23T21:29:26.607293] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-23T21:29:26.622447] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T21:29:27.402230] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-23T21:29:27.809204] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T21:29:28.202259] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-23T21:29:28.472808] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T21:29:28.678699] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T21:29:29.002213] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-23T21:29:29.045420] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T21:29:29.802268] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-23T21:29:30.602178] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-23T21:29:30.854778] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T21:29:31.402195] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-23T21:29:31.945826] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-23T21:29:32.159040] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T21:29:32.202225] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-23T21:29:33.002222] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-23T21:29:33.078765] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T21:29:33.805465] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-23T21:29:33.809743] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T21:29:34.246847] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T21:29:34.602232] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-23T21:29:35.275704] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T21:29:35.402171] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-23T21:29:36.146516] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T21:29:36.202150] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-23T21:29:37.011685] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-23T21:29:37.017417] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T21:29:37.434092] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T21:29:37.527937] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T21:29:37.802203] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-23T21:29:38.602236] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-23T21:29:39.402172] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-23T21:29:39.587261] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T21:29:39.758064] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-23T21:29:39.759026] [INFO ] [REMOTE ] STXV: Full fetch complete (2630 records). [2025-09-23T21:29:39.759162] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-23T21:29:40.129814] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-23T21:29:40.129907] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-23T21:29:40.130030] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-23T21:29:40.130148] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-23T21:29:40.130598] [DEBUG] [LOCAL ] STXV: Trimmed 2630 records to 1635 (keeping 200 days of data) [2025-09-23T21:29:40.143287] [DEBUG] [LOCAL ] STXV: Primary data saved (1635 records). [2025-09-23T21:29:40.143354] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-23T21:29:40.143550] [INFO ] [MAIN ] Update Progress: 2027/2372 symbols completed. STXV took 43.2s. Estimated remaining: 45m 53s. Rate: 7.5 symbols/min [2025-09-23T21:29:40.207358] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-23T21:29:40.323276] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:29:40.382833] [DEBUG] [LOCAL ] SUN: Loaded 37290 existing records from primary storage. [2025-09-23T21:29:40.382999] [INFO ] [MAIN ] SUN: Loaded 37290 existing records. [2025-09-23T21:29:40.564191] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:29:40.564475] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-23T21:29:40.564539] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-23T21:29:40.565576] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-23T21:29:40.565672] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-23T21:29:40.946295] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-23T21:29:40.967469] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:29:40.969824] [INFO ] [REMOTE ] STZ: Full fetch complete (75739 records). [2025-09-23T21:29:40.970021] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-23T21:29:41.007264] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-23T21:29:41.383481] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-23T21:29:41.383631] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-23T21:29:41.385013] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-23T21:29:41.385117] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-23T21:29:41.386864] [DEBUG] [LOCAL ] STZ: Trimmed 75739 records to 52274 (keeping 200 days of data) [2025-09-23T21:29:41.747524] [DEBUG] [LOCAL ] STZ: Primary data saved (52274 records). [2025-09-23T21:29:41.747828] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-23T21:29:41.749427] [INFO ] [MAIN ] Update Progress: 2028/2372 symbols completed. STZ took 33.5s. Estimated remaining: 45m 44s. Rate: 7.5 symbols/min [2025-09-23T21:29:41.824568] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-23T21:29:41.928765] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:29:41.955891] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T21:29:42.010875] [DEBUG] [LOCAL ] SUPV: Loaded 47109 existing records from primary storage. [2025-09-23T21:29:42.011045] [INFO ] [MAIN ] SUPV: Loaded 47109 existing records. [2025-09-23T21:29:42.191230] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:29:42.191509] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-23T21:29:42.191555] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-23T21:29:42.192640] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-23T21:29:42.192758] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-23T21:29:42.594441] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:29:42.606677] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-23T21:29:42.613676] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T21:29:43.402224] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-23T21:29:43.665446] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T21:29:44.202192] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-23T21:29:44.328218] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T21:29:44.933941] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T21:29:45.002156] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-23T21:29:45.802169] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-23T21:29:45.879142] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T21:29:46.602160] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-23T21:29:46.604512] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T21:29:47.402181] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-23T21:29:47.486053] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T21:29:48.202168] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-23T21:29:48.273003] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T21:29:48.281775] [INFO ] [REMOTE ] SU: Full fetch complete (77400 records). [2025-09-23T21:29:48.281909] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-23T21:29:48.680311] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-23T21:29:48.680538] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-23T21:29:48.681693] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-23T21:29:48.681765] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-23T21:29:48.683607] [DEBUG] [LOCAL ] SU: Trimmed 77400 records to 53459 (keeping 200 days of data) [2025-09-23T21:29:48.852479] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T21:29:49.022874] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-23T21:29:49.071994] [DEBUG] [LOCAL ] SU: Primary data saved (53459 records). [2025-09-23T21:29:49.072124] [INFO ] [MAIN ] SU: Full history saved. [2025-09-23T21:29:49.072242] [INFO ] [MAIN ] Update Progress: 2029/2372 symbols completed. SU took 37.5s. Estimated remaining: 45m 36s. Rate: 7.5 symbols/min [2025-09-23T21:29:49.246601] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:29:49.295859] [DEBUG] [LOCAL ] SUZ: Loaded 45838 existing records from primary storage. [2025-09-23T21:29:49.296027] [INFO ] [MAIN ] SUZ: Loaded 45838 existing records. [2025-09-23T21:29:49.480109] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:29:49.499852] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T21:29:49.499969] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-23T21:29:49.506889] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-23T21:29:49.507332] [INFO ] [REMOTE ] SUI: Full fetch complete (61109 records). [2025-09-23T21:29:49.507408] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-23T21:29:49.539241] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-23T21:29:49.577396] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-23T21:29:49.838686] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-23T21:29:50.279332] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-23T21:29:50.318352] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-23T21:29:50.319501] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-23T21:29:50.318288] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:29:50.319741] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-23T21:29:50.321462] [DEBUG] [LOCAL ] SUI: Trimmed 61109 records to 42060 (keeping 200 days of data) [2025-09-23T21:29:50.412578] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T21:29:50.602425] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-23T21:29:50.626323] [DEBUG] [LOCAL ] SUI: Primary data saved (42060 records). [2025-09-23T21:29:50.626447] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-23T21:29:50.626571] [INFO ] [MAIN ] Update Progress: 2030/2372 symbols completed. SUI took 28.3s. Estimated remaining: 45m 27s. Rate: 7.5 symbols/min [2025-09-23T21:29:50.796371] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:29:50.837848] [DEBUG] [LOCAL ] SVV: Loaded 39434 existing records from primary storage. [2025-09-23T21:29:50.837993] [INFO ] [MAIN ] SVV: Loaded 39434 existing records. [2025-09-23T21:29:51.011931] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:29:51.012170] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-23T21:29:51.012217] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-23T21:29:51.013126] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-23T21:29:51.013187] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-23T21:29:51.392335] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:29:51.402154] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-23T21:29:51.774611] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-23T21:29:51.864385] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T21:29:52.202213] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-23T21:29:52.802089] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T21:29:53.002244] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-23T21:29:53.551870] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T21:29:53.802256] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-23T21:29:54.568741] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T21:29:54.602140] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-23T21:29:55.402263] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-23T21:29:55.442864] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T21:29:56.093203] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T21:29:56.202251] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-23T21:29:56.904870] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T21:29:57.002232] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-23T21:29:57.729502] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T21:29:57.802221] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-23T21:29:57.912500] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T21:29:58.602195] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-23T21:29:59.048392] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T21:29:59.402234] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-23T21:30:00.202234] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-23T21:30:00.318045] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T21:30:01.002219] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-23T21:30:01.105383] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T21:30:01.697603] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T21:30:01.802272] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-23T21:30:02.602261] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-23T21:30:02.993455] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T21:30:03.402213] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-23T21:30:04.202276] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-23T21:30:04.604938] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-23T21:30:05.002324] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-23T21:30:05.556365] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T21:30:05.639120] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-09-23T21:30:05.802168] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-23T21:30:05.940343] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T21:30:06.338020] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T21:30:06.602429] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-23T21:30:07.155452] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T21:30:07.402269] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-23T21:30:07.977101] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T21:30:08.202243] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-23T21:30:08.575473] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T21:30:09.002254] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-23T21:30:09.802445] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-23T21:30:10.602251] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-23T21:30:10.742548] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T21:30:11.402197] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-23T21:30:11.713626] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T21:30:11.720227] [INFO ] [REMOTE ] SUN: Full fetch complete (54439 records). [2025-09-23T21:30:11.720382] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-23T21:30:12.159468] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-23T21:30:12.159707] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-23T21:30:12.160707] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-23T21:30:12.160777] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-23T21:30:12.161961] [DEBUG] [LOCAL ] SUN: Trimmed 54439 records to 37359 (keeping 200 days of data) [2025-09-23T21:30:12.298996] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T21:30:12.312161] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-23T21:30:12.449186] [DEBUG] [LOCAL ] SUN: Primary data saved (37359 records). [2025-09-23T21:30:12.449529] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-23T21:30:12.449616] [INFO ] [MAIN ] Update Progress: 2031/2372 symbols completed. SUN took 32.3s. Estimated remaining: 45m 21s. Rate: 7.5 symbols/min [2025-09-23T21:30:12.627103] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:30:12.679259] [DEBUG] [LOCAL ] SW: Loaded 53164 existing records from primary storage. [2025-09-23T21:30:12.679404] [INFO ] [MAIN ] SW: Loaded 53164 existing records. [2025-09-23T21:30:12.848626] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T21:30:12.899693] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:30:12.899951] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-23T21:30:12.899999] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-23T21:30:12.901083] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-23T21:30:12.901142] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-23T21:30:13.002690] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-23T21:30:13.277906] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:30:13.577183] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (5.37 seconds). [2025-09-23T21:30:13.802224] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-23T21:30:13.871068] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T21:30:14.277178] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T21:30:14.602199] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-23T21:30:15.402192] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-23T21:30:15.476288] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T21:30:16.202220] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-23T21:30:16.351687] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T21:30:16.490177] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T21:30:17.002223] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-23T21:30:17.757020] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T21:30:17.768894] [INFO ] [REMOTE ] SVV: Full fetch complete (55734 records). [2025-09-23T21:30:17.769091] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-23T21:30:17.809241] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-23T21:30:18.217201] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-23T21:30:18.217304] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-23T21:30:18.218248] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-23T21:30:18.218312] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-23T21:30:18.219637] [DEBUG] [LOCAL ] SVV: Trimmed 55734 records to 39460 (keeping 200 days of data) [2025-09-23T21:30:18.454274] [DEBUG] [LOCAL ] SVV: Primary data saved (39460 records). [2025-09-23T21:30:18.454441] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-23T21:30:18.454533] [INFO ] [MAIN ] Update Progress: 2032/2372 symbols completed. SVV took 27.8s. Estimated remaining: 45m 13s. Rate: 7.5 symbols/min [2025-09-23T21:30:18.608778] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-23T21:30:18.630397] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:30:18.665404] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T21:30:18.723179] [DEBUG] [LOCAL ] SWK: Loaded 52493 existing records from primary storage. [2025-09-23T21:30:18.723357] [INFO ] [MAIN ] SWK: Loaded 52493 existing records. [2025-09-23T21:30:18.901481] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:30:18.902288] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-23T21:30:18.902667] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-23T21:30:18.904035] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-23T21:30:18.904138] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-23T21:30:19.029542] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T21:30:19.063261] [INFO ] [REMOTE ] SUZ: Full fetch complete (67029 records). [2025-09-23T21:30:19.077221] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-23T21:30:19.404753] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-23T21:30:19.502042] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:30:19.739323] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-23T21:30:19.739429] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-23T21:30:19.740522] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-23T21:30:19.740586] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-23T21:30:19.741893] [DEBUG] [LOCAL ] SUZ: Trimmed 67029 records to 45817 (keeping 200 days of data) [2025-09-23T21:30:20.006241] [DEBUG] [LOCAL ] SUZ: Primary data saved (45817 records). [2025-09-23T21:30:20.006373] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-23T21:30:20.006457] [INFO ] [MAIN ] Update Progress: 2033/2372 symbols completed. SUZ took 30.9s. Estimated remaining: 45m 4s. Rate: 7.5 symbols/min [2025-09-23T21:30:20.177281] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:30:20.207499] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-23T21:30:20.208819] [DEBUG] [LOCAL ] SWX: Loaded 31356 existing records from primary storage. [2025-09-23T21:30:20.209608] [INFO ] [MAIN ] SWX: Loaded 31356 existing records. [2025-09-23T21:30:20.390111] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:30:20.390420] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-23T21:30:20.390470] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-23T21:30:20.391276] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-23T21:30:20.391338] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-23T21:30:20.688979] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T21:30:20.735177] [INFO ] [REMOTE ] SUPV: Full fetch complete (68158 records). [2025-09-23T21:30:20.758504] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-23T21:30:20.822533] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:30:21.019181] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-23T21:30:21.188574] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-23T21:30:21.188702] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-23T21:30:21.189906] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-23T21:30:21.189977] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-23T21:30:21.191744] [DEBUG] [LOCAL ] SUPV: Trimmed 68158 records to 47159 (keeping 200 days of data) [2025-09-23T21:30:21.481725] [DEBUG] [LOCAL ] SUPV: Primary data saved (47159 records). [2025-09-23T21:30:21.481872] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-23T21:30:21.481962] [INFO ] [MAIN ] Update Progress: 2034/2372 symbols completed. SUPV took 39.7s. Estimated remaining: 44m 55s. Rate: 7.5 symbols/min [2025-09-23T21:30:21.656025] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:30:21.663817] [DEBUG] [LOCAL ] SWZ: Loaded 6107 existing records from primary storage. [2025-09-23T21:30:21.663948] [INFO ] [MAIN ] SWZ: Loaded 6107 existing records. [2025-09-23T21:30:21.844830] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:30:21.845096] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-23T21:30:21.845144] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-23T21:30:21.845504] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-23T21:30:21.845582] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-23T21:30:22.213421] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:30:22.213870] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-23T21:30:22.312130] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (2.91 seconds). [2025-09-23T21:30:22.602170] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-23T21:30:23.057865] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T21:30:23.094853] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-23T21:30:23.174220] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-23T21:30:23.402196] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-23T21:30:24.071629] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T21:30:24.088802] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T21:30:24.202213] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-23T21:30:25.002269] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-23T21:30:25.802218] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-23T21:30:26.017261] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T21:30:26.169693] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T21:30:26.602179] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-23T21:30:26.744253] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T21:30:27.204053] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T21:30:27.402203] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-23T21:30:28.202215] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-23T21:30:29.002223] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-23T21:30:29.325764] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-23T21:30:29.802187] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-23T21:30:29.830392] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:30:30.029335] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T21:30:30.602196] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-23T21:30:31.142733] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T21:30:31.263054] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T21:30:31.402267] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-23T21:30:32.202208] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-23T21:30:32.632956] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T21:30:33.002190] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-23T21:30:33.802248] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-23T21:30:34.019675] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T21:30:34.328186] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T21:30:34.347228] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T21:30:34.602216] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-23T21:30:35.402204] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-23T21:30:36.053192] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T21:30:36.202217] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-23T21:30:36.361570] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T21:30:37.002288] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-23T21:30:37.802250] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-23T21:30:38.602190] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-23T21:30:38.747436] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-23T21:30:38.984046] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T21:30:38.999316] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T21:30:39.402198] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-23T21:30:40.202219] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-23T21:30:40.490165] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T21:30:40.855299] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T21:30:41.002181] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-23T21:30:41.802194] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-23T21:30:41.960682] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T21:30:42.250024] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T21:30:42.251353] [INFO ] [REMOTE ] SWZ: Full fetch complete (8080 records). [2025-09-23T21:30:42.251538] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-23T21:30:42.620756] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-23T21:30:42.630411] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-23T21:30:42.630527] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-23T21:30:42.631019] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-23T21:30:42.631100] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-23T21:30:42.657476] [DEBUG] [LOCAL ] SWZ: Trimmed 8080 records to 6034 (keeping 200 days of data) [2025-09-23T21:30:42.662128] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T21:30:42.704037] [DEBUG] [LOCAL ] SWZ: Primary data saved (6034 records). [2025-09-23T21:30:42.704502] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-23T21:30:42.704613] [INFO ] [MAIN ] Update Progress: 2035/2372 symbols completed. SWZ took 21.2s. Estimated remaining: 44m 49s. Rate: 7.5 symbols/min [2025-09-23T21:30:42.877887] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:30:42.919034] [DEBUG] [LOCAL ] SXC: Loaded 41630 existing records from primary storage. [2025-09-23T21:30:42.919206] [INFO ] [MAIN ] SXC: Loaded 41630 existing records. [2025-09-23T21:30:43.096079] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:30:43.096329] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-23T21:30:43.096376] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-23T21:30:43.097346] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-23T21:30:43.097405] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-23T21:30:43.411791] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-23T21:30:43.452542] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:30:44.202198] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-23T21:30:44.550466] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-23T21:30:45.002178] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-23T21:30:45.213572] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-23T21:30:45.434086] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T21:30:45.802193] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-23T21:30:46.562187] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T21:30:46.576183] [INFO ] [REMOTE ] SW: Full fetch complete (76736 records). [2025-09-23T21:30:46.576346] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-23T21:30:46.611380] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-23T21:30:46.991918] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-23T21:30:46.992012] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-23T21:30:46.993142] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-23T21:30:46.993225] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-23T21:30:46.994834] [DEBUG] [LOCAL ] SW: Trimmed 76736 records to 53163 (keeping 200 days of data) [2025-09-23T21:30:47.335589] [DEBUG] [LOCAL ] SW: Primary data saved (53163 records). [2025-09-23T21:30:47.335965] [INFO ] [MAIN ] SW: Full history saved. [2025-09-23T21:30:47.336132] [INFO ] [MAIN ] Update Progress: 2036/2372 symbols completed. SW took 34.9s. Estimated remaining: 44m 41s. Rate: 7.5 symbols/min [2025-09-23T21:30:47.410784] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-23T21:30:47.509886] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:30:47.522510] [DEBUG] [LOCAL ] SXI: Loaded 11475 existing records from primary storage. [2025-09-23T21:30:47.522611] [INFO ] [MAIN ] SXI: Loaded 11475 existing records. [2025-09-23T21:30:47.703543] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:30:47.704071] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-23T21:30:47.704220] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-23T21:30:47.704707] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-23T21:30:47.704835] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-23T21:30:47.908603] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-23T21:30:48.129906] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:30:48.150759] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T21:30:48.202151] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-23T21:30:49.002228] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-23T21:30:49.060108] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T21:30:49.137706] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T21:30:49.802214] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-23T21:30:50.373620] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T21:30:50.602207] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-23T21:30:51.264417] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T21:30:51.402184] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-23T21:30:51.792629] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T21:30:51.798134] [INFO ] [REMOTE ] SWX: Full fetch complete (43744 records). [2025-09-23T21:30:51.798229] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-23T21:30:52.108712] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T21:30:52.203742] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-23T21:30:52.203358] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-23T21:30:52.203949] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-23T21:30:52.205801] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-23T21:30:52.205973] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-23T21:30:52.207164] [DEBUG] [LOCAL ] SWX: Trimmed 43744 records to 31378 (keeping 200 days of data) [2025-09-23T21:30:52.415516] [DEBUG] [LOCAL ] SWX: Primary data saved (31378 records). [2025-09-23T21:30:52.415708] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-23T21:30:52.415806] [INFO ] [MAIN ] Update Progress: 2037/2372 symbols completed. SWX took 32.4s. Estimated remaining: 44m 32s. Rate: 7.5 symbols/min [2025-09-23T21:30:52.996527] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T21:30:53.002137] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-23T21:30:53.801083] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T21:30:53.803871] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-23T21:30:54.602200] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-23T21:30:54.614096] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T21:30:55.402258] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-23T21:30:56.202159] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-23T21:30:56.294773] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T21:30:56.374517] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T21:30:56.383299] [INFO ] [REMOTE ] SWK: Full fetch complete (75410 records). [2025-09-23T21:30:56.383441] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-23T21:30:56.823998] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-23T21:30:56.824093] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-23T21:30:56.825459] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-23T21:30:56.825588] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-23T21:30:56.827318] [DEBUG] [LOCAL ] SWK: Trimmed 75410 records to 52470 (keeping 200 days of data) [2025-09-23T21:30:57.007685] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-23T21:30:57.157123] [DEBUG] [LOCAL ] SWK: Primary data saved (52470 records). [2025-09-23T21:30:57.157268] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-23T21:30:57.157353] [INFO ] [MAIN ] Update Progress: 2038/2372 symbols completed. SWK took 38.7s. Estimated remaining: 44m 24s. Rate: 7.5 symbols/min [2025-09-23T21:30:57.645634] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T21:30:57.802166] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-23T21:30:57.860576] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T21:30:58.602236] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-23T21:30:59.483870] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T21:30:59.494953] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T21:30:59.503867] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-23T21:31:00.202252] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-23T21:31:01.157235] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T21:31:01.166269] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-23T21:31:01.214517] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T21:31:01.802241] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-23T21:31:02.338192] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T21:31:02.602266] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-23T21:31:02.789433] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T21:31:03.402223] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-23T21:31:04.114253] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T21:31:04.202236] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-23T21:31:04.235196] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T21:31:04.238039] [INFO ] [REMOTE ] SXI: Full fetch complete (14533 records). [2025-09-23T21:31:04.238115] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-23T21:31:04.646475] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-23T21:31:04.646559] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-23T21:31:04.646946] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-23T21:31:04.647008] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-23T21:31:04.647525] [DEBUG] [LOCAL ] SXI: Trimmed 14533 records to 11511 (keeping 200 days of data) [2025-09-23T21:31:04.722944] [DEBUG] [LOCAL ] SXI: Primary data saved (11511 records). [2025-09-23T21:31:04.723095] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-23T21:31:04.723182] [INFO ] [MAIN ] Update Progress: 2039/2372 symbols completed. SXI took 17.4s. Estimated remaining: 44m 16s. Rate: 7.5 symbols/min [2025-09-23T21:31:05.623550] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T21:31:05.633220] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-23T21:31:07.192582] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T21:31:07.199525] [INFO ] [REMOTE ] SXC: Full fetch complete (61216 records). [2025-09-23T21:31:07.199720] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-23T21:31:07.589931] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-23T21:31:07.590093] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-23T21:31:07.591207] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-23T21:31:07.591286] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-23T21:31:07.592735] [DEBUG] [LOCAL ] SXC: Trimmed 61216 records to 41626 (keeping 200 days of data) [2025-09-23T21:31:07.860245] [DEBUG] [LOCAL ] SXC: Primary data saved (41626 records). [2025-09-23T21:31:07.860378] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-23T21:31:07.860460] [INFO ] [MAIN ] Update Progress: 2040/2372 symbols completed. SXC took 25.2s. Estimated remaining: 44m 7s. Rate: 7.5 symbols/min [2025-09-23T21:31:08.528467] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:31:08.587290] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:31:08.641441] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:31:08.670336] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:31:08.737380] [DEBUG] [LOCAL ] SXT: Loaded 29013 existing records from primary storage. [2025-09-23T21:31:08.769534] [DEBUG] [LOCAL ] SYF: Loaded 53459 existing records from primary storage. [2025-09-23T21:31:08.768617] [INFO ] [MAIN ] SXT: Loaded 29013 existing records. [2025-09-23T21:31:08.769980] [INFO ] [MAIN ] SYF: Loaded 53459 existing records. [2025-09-23T21:31:08.852980] [DEBUG] [LOCAL ] SYK: Loaded 47072 existing records from primary storage. [2025-09-23T21:31:08.918602] [INFO ] [MAIN ] SYK: Loaded 47072 existing records. [2025-09-23T21:31:09.037207] [DEBUG] [LOCAL ] SYY: Loaded 53246 existing records from primary storage. [2025-09-23T21:31:09.108671] [INFO ] [MAIN ] SYY: Loaded 53246 existing records. [2025-09-23T21:31:09.321127] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:31:09.424201] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:31:09.464477] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-23T21:31:09.464756] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-23T21:31:09.464702] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-23T21:31:09.569184] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-23T21:31:09.540254] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:31:09.569430] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:31:09.566089] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-23T21:31:09.570315] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-23T21:31:09.570006] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-23T21:31:09.581464] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-23T21:31:09.581336] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-23T21:31:09.581396] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-23T21:31:09.610308] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-23T21:31:09.632990] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-23T21:31:09.638206] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-23T21:31:09.654424] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-23T21:31:09.684926] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-23T21:31:09.684987] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-23T21:31:10.821377] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:31:10.858102] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-23T21:31:10.989737] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:31:11.032211] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-23T21:31:11.050273] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:31:11.069753] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-23T21:31:11.093703] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:31:11.094001] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-23T21:31:12.001250] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T21:31:12.005337] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-23T21:31:12.555574] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T21:31:12.566973] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-23T21:31:12.640439] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T21:31:12.650202] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-23T21:31:12.728246] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T21:31:12.732416] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-23T21:31:12.983461] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T21:31:12.994111] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-23T21:31:13.882375] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T21:31:13.887247] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-23T21:31:14.255001] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T21:31:14.265185] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-23T21:31:14.298240] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T21:31:14.602190] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-23T21:31:14.714770] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T21:31:14.914604] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T21:31:15.402190] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-23T21:31:16.057205] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T21:31:16.120778] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T21:31:16.202199] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-23T21:31:17.002220] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-23T21:31:17.077465] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T21:31:17.693374] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T21:31:17.802211] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-23T21:31:18.434481] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T21:31:18.602229] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-23T21:31:19.402219] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-23T21:31:19.857078] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-23T21:31:19.914014] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T21:31:20.202249] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-23T21:31:21.002279] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-23T21:31:21.358900] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-23T21:31:21.500265] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T21:31:21.802210] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-23T21:31:22.602734] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-23T21:31:22.602631] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T21:31:23.402296] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-23T21:31:23.874392] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-23T21:31:24.202171] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-23T21:31:24.469191] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T21:31:25.002169] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-23T21:31:25.232989] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T21:31:25.766864] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T21:31:25.802216] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-23T21:31:26.602255] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-23T21:31:26.816966] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T21:31:27.402219] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-23T21:31:27.644963] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T21:31:27.729408] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T21:31:28.202216] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-23T21:31:28.968064] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T21:31:29.002257] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-23T21:31:29.515334] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T21:31:29.802270] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-23T21:31:30.602251] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-23T21:31:30.764132] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T21:31:31.402257] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-23T21:31:31.538671] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T21:31:31.631207] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T21:31:31.638089] [INFO ] [REMOTE ] SXT: Full fetch complete (37756 records). [2025-09-23T21:31:31.638216] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-23T21:31:32.033229] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-23T21:31:32.033354] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-23T21:31:32.034342] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-23T21:31:32.034420] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-23T21:31:32.038462] [DEBUG] [LOCAL ] SXT: Trimmed 37756 records to 29088 (keeping 200 days of data) [2025-09-23T21:31:32.213934] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-23T21:31:32.232897] [DEBUG] [LOCAL ] SXT: Primary data saved (29088 records). [2025-09-23T21:31:32.233070] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-23T21:31:32.233194] [INFO ] [MAIN ] Update Progress: 2041/2372 symbols completed. SXT took 24.4s. Estimated remaining: 44m 2s. Rate: 7.5 symbols/min [2025-09-23T21:31:32.427279] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:31:32.486421] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-23T21:31:32.486599] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-09-23T21:31:32.678548] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:31:32.678870] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-23T21:31:32.679033] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-23T21:31:32.680347] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-23T21:31:32.680410] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-23T21:31:33.004166] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-23T21:31:33.088228] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:31:33.125473] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T21:31:33.613200] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T21:31:33.802215] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-23T21:31:34.602191] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-23T21:31:34.898281] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T21:31:35.402232] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-23T21:31:35.872559] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T21:31:36.202176] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-23T21:31:36.294108] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T21:31:36.302351] [INFO ] [REMOTE ] SYK: Full fetch complete (68728 records). [2025-09-23T21:31:36.302553] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-23T21:31:36.748682] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-23T21:31:36.748817] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-23T21:31:36.750033] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-23T21:31:36.750206] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-23T21:31:36.752362] [DEBUG] [LOCAL ] SYK: Trimmed 68728 records to 47075 (keeping 200 days of data) [2025-09-23T21:31:36.898368] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T21:31:37.011698] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-23T21:31:37.122462] [DEBUG] [LOCAL ] SYK: Primary data saved (47075 records). [2025-09-23T21:31:37.122606] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-23T21:31:37.122789] [INFO ] [MAIN ] Update Progress: 2042/2372 symbols completed. SYK took 29.3s. Estimated remaining: 43m 53s. Rate: 7.5 symbols/min [2025-09-23T21:31:37.305868] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:31:37.351997] [DEBUG] [LOCAL ] TAC: Loaded 42951 existing records from primary storage. [2025-09-23T21:31:37.352194] [INFO ] [MAIN ] TAC: Loaded 42951 existing records. [2025-09-23T21:31:37.536857] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:31:37.537724] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-23T21:31:37.537853] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-23T21:31:37.539225] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-23T21:31:37.539319] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-23T21:31:37.806310] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-23T21:31:37.990180] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:31:37.992168] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T21:31:38.602221] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-23T21:31:38.713964] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T21:31:38.724283] [INFO ] [REMOTE ] SYY: Full fetch complete (76974 records). [2025-09-23T21:31:38.724511] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-23T21:31:39.189106] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-23T21:31:39.189220] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-23T21:31:39.190423] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-23T21:31:39.190489] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-23T21:31:39.196534] [DEBUG] [LOCAL ] SYY: Trimmed 76974 records to 53237 (keeping 200 days of data) [2025-09-23T21:31:39.421634] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-23T21:31:39.536871] [DEBUG] [LOCAL ] SYY: Primary data saved (53237 records). [2025-09-23T21:31:39.537015] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-23T21:31:39.537155] [INFO ] [MAIN ] Update Progress: 2043/2372 symbols completed. SYY took 31.7s. Estimated remaining: 43m 44s. Rate: 7.5 symbols/min [2025-09-23T21:31:39.710470] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:31:39.765047] [DEBUG] [LOCAL ] TAK: Loaded 49926 existing records from primary storage. [2025-09-23T21:31:39.765200] [INFO ] [MAIN ] TAK: Loaded 49926 existing records. [2025-09-23T21:31:39.944873] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:31:39.945238] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-23T21:31:39.945306] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-23T21:31:39.946625] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-23T21:31:39.946717] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-23T21:31:40.314950] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:31:40.315804] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-23T21:31:40.353470] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-23T21:31:40.456176] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T21:31:40.468687] [INFO ] [REMOTE ] SYF: Full fetch complete (77337 records). [2025-09-23T21:31:40.468874] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-23T21:31:40.883936] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-23T21:31:40.884296] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-23T21:31:40.885670] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-23T21:31:40.885938] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-23T21:31:40.887746] [DEBUG] [LOCAL ] SYF: Trimmed 77337 records to 53457 (keeping 200 days of data) [2025-09-23T21:31:41.004593] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-23T21:31:41.028346] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T21:31:41.303397] [DEBUG] [LOCAL ] SYF: Primary data saved (53457 records). [2025-09-23T21:31:41.303575] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-23T21:31:41.303764] [INFO ] [MAIN ] Update Progress: 2044/2372 symbols completed. SYF took 33.4s. Estimated remaining: 43m 35s. Rate: 7.5 symbols/min [2025-09-23T21:31:41.558013] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:31:41.589084] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T21:31:41.655094] [DEBUG] [LOCAL ] TAL: Loaded 52123 existing records from primary storage. [2025-09-23T21:31:41.655324] [INFO ] [MAIN ] TAL: Loaded 52123 existing records. [2025-09-23T21:31:41.807356] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-23T21:31:41.841391] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:31:41.841792] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-23T21:31:41.841846] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-23T21:31:41.843147] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-23T21:31:41.843207] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-23T21:31:42.198746] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:31:42.602197] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-23T21:31:43.402274] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-23T21:31:43.468146] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-23T21:31:43.520284] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T21:31:44.202165] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-23T21:31:44.279738] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T21:31:45.002284] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-23T21:31:45.086052] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T21:31:45.802255] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-23T21:31:46.532025] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T21:31:46.602203] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-23T21:31:46.677952] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-23T21:31:47.402201] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-23T21:31:47.650152] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T21:31:47.777180] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T21:31:48.202200] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-23T21:31:49.002227] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-23T21:31:49.786672] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-23T21:31:49.802155] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-23T21:31:49.892748] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T21:31:50.270938] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T21:31:50.602249] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-23T21:31:51.402240] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-23T21:31:52.143055] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T21:31:52.202232] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-23T21:31:52.286280] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-23T21:31:53.007003] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-23T21:31:53.012519] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T21:31:53.802218] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-23T21:31:54.001242] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T21:31:54.316199] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T21:31:54.602221] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-23T21:31:55.335689] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T21:31:55.402204] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-23T21:31:56.202266] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-23T21:31:56.935822] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T21:31:56.965382] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T21:31:57.002202] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-23T21:31:57.802176] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-23T21:31:57.879218] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T21:31:58.559711] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T21:31:58.602190] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-23T21:31:59.402196] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-23T21:32:00.186300] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T21:32:00.209936] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-23T21:32:00.233189] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-23T21:32:01.002263] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-23T21:32:01.432905] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T21:32:01.802237] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-23T21:32:02.013962] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T21:32:02.024454] [INFO ] [REMOTE ] TAC: Full fetch complete (64304 records). [2025-09-23T21:32:02.024706] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-23T21:32:02.452971] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-23T21:32:02.453063] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-23T21:32:02.454048] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-23T21:32:02.454115] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-23T21:32:02.455495] [DEBUG] [LOCAL ] TAC: Trimmed 64304 records to 42907 (keeping 200 days of data) [2025-09-23T21:32:02.635422] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-23T21:32:02.728375] [DEBUG] [LOCAL ] TAC: Primary data saved (42907 records). [2025-09-23T21:32:02.728509] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-23T21:32:02.728605] [INFO ] [MAIN ] Update Progress: 2045/2372 symbols completed. TAC took 25.6s. Estimated remaining: 43m 30s. Rate: 7.5 symbols/min [2025-09-23T21:32:02.900014] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:32:02.947481] [DEBUG] [LOCAL ] TALO: Loaded 50811 existing records from primary storage. [2025-09-23T21:32:02.947667] [INFO ] [MAIN ] TALO: Loaded 50811 existing records. [2025-09-23T21:32:03.123792] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:32:03.124026] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-23T21:32:03.124074] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-23T21:32:03.125171] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-23T21:32:03.125233] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-23T21:32:03.496740] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:32:03.497362] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-23T21:32:03.529506] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T21:32:03.578547] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-23T21:32:04.202230] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-23T21:32:04.553772] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-23T21:32:05.002185] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-23T21:32:05.266813] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T21:32:05.802165] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-23T21:32:05.904017] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T21:32:05.912203] [INFO ] [REMOTE ] TAK: Full fetch complete (71477 records). [2025-09-23T21:32:05.912318] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-23T21:32:06.302147] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-23T21:32:06.302224] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-23T21:32:06.303241] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-23T21:32:06.303304] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-23T21:32:06.304681] [DEBUG] [LOCAL ] TAK: Trimmed 71477 records to 49893 (keeping 200 days of data) [2025-09-23T21:32:06.601615] [DEBUG] [LOCAL ] TAK: Primary data saved (49893 records). [2025-09-23T21:32:06.601771] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-23T21:32:06.601863] [INFO ] [MAIN ] Update Progress: 2046/2372 symbols completed. TAK took 27.1s. Estimated remaining: 43m 21s. Rate: 7.5 symbols/min [2025-09-23T21:32:06.633886] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-23T21:32:06.778190] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:32:06.842035] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T21:32:06.868809] [DEBUG] [LOCAL ] TAP: Loaded 52867 existing records from primary storage. [2025-09-23T21:32:06.868943] [INFO ] [MAIN ] TAP: Loaded 52867 existing records. [2025-09-23T21:32:07.052937] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:32:07.053373] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-23T21:32:07.053505] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-23T21:32:07.054619] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-23T21:32:07.054703] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-23T21:32:07.380127] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T21:32:07.432217] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-09-23T21:32:07.428405] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-23T21:32:07.462774] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:32:07.462902] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-23T21:32:07.667186] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-23T21:32:07.911738] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-23T21:32:07.911822] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-23T21:32:07.912887] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-23T21:32:07.912949] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-23T21:32:07.914423] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-09-23T21:32:08.205884] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-23T21:32:08.260840] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-09-23T21:32:08.260985] [INFO ] [MAIN ] T: Full history saved. [2025-09-23T21:32:08.261101] [INFO ] [MAIN ] Update Progress: 2047/2372 symbols completed. T took 36.0s. Estimated remaining: 43m 12s. Rate: 7.5 symbols/min [2025-09-23T21:32:08.431918] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:32:08.444796] [DEBUG] [LOCAL ] TBB: Loaded 11697 existing records from primary storage. [2025-09-23T21:32:08.444991] [INFO ] [MAIN ] TBB: Loaded 11697 existing records. [2025-09-23T21:32:08.622083] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:32:08.622347] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-23T21:32:08.622396] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-23T21:32:08.622815] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-23T21:32:08.622878] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-23T21:32:08.991885] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:32:09.002151] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-23T21:32:09.113234] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T21:32:09.802179] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-23T21:32:09.907165] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T21:32:10.059063] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T21:32:10.602211] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-23T21:32:11.402247] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-23T21:32:11.480599] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T21:32:11.509277] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T21:32:12.202193] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-23T21:32:12.951979] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T21:32:13.002191] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-23T21:32:13.130539] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T21:32:13.802243] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-23T21:32:14.602231] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-23T21:32:14.740962] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T21:32:15.301040] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T21:32:15.402189] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-23T21:32:16.202221] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-23T21:32:16.395185] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T21:32:17.002166] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-23T21:32:17.200889] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T21:32:17.800897] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T21:32:17.801861] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T21:32:17.804512] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-23T21:32:18.602245] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-23T21:32:19.402177] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-23T21:32:19.433459] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:32:19.593059] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T21:32:20.202199] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-23T21:32:21.002184] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-23T21:32:21.169584] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T21:32:21.202182] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T21:32:21.802259] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-23T21:32:22.602290] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-23T21:32:22.697243] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T21:32:23.395072] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T21:32:23.402134] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-23T21:32:23.474058] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T21:32:23.482842] [INFO ] [REMOTE ] TAL: Full fetch complete (75682 records). [2025-09-23T21:32:23.482990] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-23T21:32:23.875777] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-23T21:32:23.875930] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-23T21:32:23.877190] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-23T21:32:23.877266] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-23T21:32:23.878850] [DEBUG] [LOCAL ] TAL: Trimmed 75682 records to 52110 (keeping 200 days of data) [2025-09-23T21:32:24.192776] [DEBUG] [LOCAL ] TAL: Primary data saved (52110 records). [2025-09-23T21:32:24.192923] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-23T21:32:24.193009] [INFO ] [MAIN ] Update Progress: 2048/2372 symbols completed. TAL took 42.9s. Estimated remaining: 43m 5s. Rate: 7.5 symbols/min [2025-09-23T21:32:24.207438] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-23T21:32:24.375045] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:32:24.373576] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T21:32:24.411016] [DEBUG] [LOCAL ] TBBB: Loaded 35854 existing records from primary storage. [2025-09-23T21:32:24.411151] [INFO ] [MAIN ] TBBB: Loaded 35854 existing records. [2025-09-23T21:32:24.587077] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:32:24.587297] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-23T21:32:24.587345] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-23T21:32:24.588051] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-23T21:32:24.588110] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-23T21:32:24.938038] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:32:25.002141] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-23T21:32:25.802271] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-23T21:32:26.107111] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T21:32:26.384947] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T21:32:26.602251] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-23T21:32:27.409013] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-23T21:32:27.433134] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T21:32:27.453305] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T21:32:28.202211] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-23T21:32:28.652839] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T21:32:29.002269] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-23T21:32:29.780320] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T21:32:29.782745] [INFO ] [REMOTE ] TBB: Full fetch complete (17996 records). [2025-09-23T21:32:29.782822] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-23T21:32:29.814012] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-23T21:32:30.162599] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-23T21:32:30.162728] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-23T21:32:30.163129] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-23T21:32:30.163169] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-23T21:32:30.163854] [DEBUG] [LOCAL ] TBB: Trimmed 17996 records to 11701 (keeping 200 days of data) [2025-09-23T21:32:30.261133] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-23T21:32:30.288066] [DEBUG] [LOCAL ] TBB: Primary data saved (11701 records). [2025-09-23T21:32:30.288773] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-23T21:32:30.288879] [INFO ] [MAIN ] Update Progress: 2049/2372 symbols completed. TBB took 22.0s. Estimated remaining: 42m 57s. Rate: 7.5 symbols/min [2025-09-23T21:32:30.476551] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:32:30.499145] [DEBUG] [LOCAL ] TBI: Loaded 22640 existing records from primary storage. [2025-09-23T21:32:30.499306] [INFO ] [MAIN ] TBI: Loaded 22640 existing records. [2025-09-23T21:32:30.606620] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-23T21:32:30.688811] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:32:30.689057] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-23T21:32:30.689107] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-23T21:32:30.689615] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-23T21:32:30.689715] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-23T21:32:31.079005] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:32:31.245388] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T21:32:31.402251] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-23T21:32:31.762862] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T21:32:32.083096] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-23T21:32:32.202198] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-23T21:32:33.002184] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-23T21:32:33.284449] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T21:32:33.802240] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-23T21:32:34.576576] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T21:32:34.584895] [INFO ] [REMOTE ] TALO: Full fetch complete (73252 records). [2025-09-23T21:32:34.585026] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-23T21:32:34.607419] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-23T21:32:34.987478] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-23T21:32:34.987578] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-23T21:32:34.988789] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-23T21:32:34.988859] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-23T21:32:34.990753] [DEBUG] [LOCAL ] TALO: Trimmed 73252 records to 50828 (keeping 200 days of data) [2025-09-23T21:32:35.289436] [DEBUG] [LOCAL ] TALO: Primary data saved (50828 records). [2025-09-23T21:32:35.289766] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-23T21:32:35.289883] [INFO ] [MAIN ] Update Progress: 2050/2372 symbols completed. TALO took 32.6s. Estimated remaining: 42m 48s. Rate: 7.5 symbols/min [2025-09-23T21:32:35.407386] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-23T21:32:35.468122] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:32:35.468683] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-23T21:32:35.468948] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-23T21:32:35.469261] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-23T21:32:35.469317] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-23T21:32:35.469359] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-23T21:32:35.469393] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-23T21:32:35.905727] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:32:35.909173] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T21:32:36.146185] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T21:32:36.202198] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-23T21:32:36.478533] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T21:32:37.002213] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-23T21:32:37.741131] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T21:32:37.802187] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-23T21:32:38.285036] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T21:32:38.602208] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-23T21:32:39.302928] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T21:32:39.402225] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-23T21:32:39.821411] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T21:32:40.202242] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-23T21:32:41.002225] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-23T21:32:41.345251] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T21:32:41.547994] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T21:32:41.771555] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T21:32:41.802192] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-23T21:32:42.602190] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-23T21:32:43.118230] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T21:32:43.234591] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T21:32:43.402214] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-23T21:32:44.202211] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-23T21:32:44.965478] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T21:32:45.002178] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-23T21:32:45.527510] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T21:32:45.536961] [INFO ] [REMOTE ] TAP: Full fetch complete (76141 records). [2025-09-23T21:32:45.537155] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-23T21:32:45.812262] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-23T21:32:45.942355] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-23T21:32:45.942533] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-23T21:32:45.943884] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-23T21:32:45.943959] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-23T21:32:45.945823] [DEBUG] [LOCAL ] TAP: Trimmed 76141 records to 52874 (keeping 200 days of data) [2025-09-23T21:32:46.187535] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-23T21:32:46.277325] [DEBUG] [LOCAL ] TAP: Primary data saved (52874 records). [2025-09-23T21:32:46.277537] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-23T21:32:46.277667] [INFO ] [MAIN ] Update Progress: 2051/2372 symbols completed. TAP took 39.7s. Estimated remaining: 42m 41s. Rate: 7.5 symbols/min [2025-09-23T21:32:46.460136] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:32:46.473154] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T21:32:46.484464] [DEBUG] [LOCAL ] TBN: Loaded 2975 existing records from primary storage. [2025-09-23T21:32:46.484548] [INFO ] [MAIN ] TBN: Loaded 2975 existing records. [2025-09-23T21:32:46.607320] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-23T21:32:46.670875] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:32:46.671150] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-23T21:32:46.671201] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-23T21:32:46.671497] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-23T21:32:46.671558] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-23T21:32:47.023779] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:32:47.402210] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-23T21:32:47.775497] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-23T21:32:47.799064] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T21:32:47.804687] [INFO ] [REMOTE ] TBBB: Full fetch complete (51257 records). [2025-09-23T21:32:47.804799] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-23T21:32:48.195089] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-23T21:32:48.195173] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-23T21:32:48.196131] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-23T21:32:48.196195] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-23T21:32:48.197287] [DEBUG] [LOCAL ] TBBB: Trimmed 51257 records to 35773 (keeping 200 days of data) [2025-09-23T21:32:48.246199] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-23T21:32:48.408864] [DEBUG] [LOCAL ] TBBB: Primary data saved (35773 records). [2025-09-23T21:32:48.409035] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-23T21:32:48.409181] [INFO ] [MAIN ] Update Progress: 2052/2372 symbols completed. TBBB took 24.2s. Estimated remaining: 42m 32s. Rate: 7.5 symbols/min [2025-09-23T21:32:48.587212] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:32:48.587423] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-23T21:32:48.587490] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-23T21:32:48.587637] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-23T21:32:48.587714] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-23T21:32:48.587761] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-23T21:32:48.587794] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-23T21:32:48.952130] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:32:48.953025] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T21:32:49.002219] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-23T21:32:49.609724] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T21:32:49.802199] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-23T21:32:50.357057] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T21:32:50.602203] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-23T21:32:50.812876] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:32:50.813196] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-23T21:32:51.402237] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-23T21:32:51.740231] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T21:32:52.202239] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-23T21:32:52.633145] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T21:32:53.002225] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-23T21:32:53.217562] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:32:53.217918] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-23T21:32:53.802230] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-23T21:32:54.132617] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T21:32:54.602268] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-23T21:32:54.937792] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T21:32:55.402222] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-23T21:32:56.202263] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-23T21:32:56.416494] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:32:56.416855] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-23T21:32:56.520464] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T21:32:57.002241] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-23T21:32:57.437062] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T21:32:57.802199] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-23T21:32:58.602207] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-23T21:32:58.929734] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T21:32:58.938422] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T21:32:59.402197] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-23T21:32:59.616306] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:32:59.616823] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-23T21:33:00.202236] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-23T21:33:00.773675] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T21:33:01.002288] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-23T21:33:01.802235] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-23T21:33:02.258040] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T21:33:02.602195] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-23T21:33:02.842692] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-23T21:33:03.402231] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-23T21:33:03.490634] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-23T21:33:03.966601] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T21:33:04.202209] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-23T21:33:04.484165] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:33:04.484751] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-23T21:33:05.002404] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-23T21:33:05.229002] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:33:05.229504] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-23T21:33:05.802256] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-23T21:33:06.002798] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:33:06.003301] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-23T21:33:06.602235] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-23T21:33:06.806476] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:33:06.806976] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-23T21:33:07.402285] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-23T21:33:07.993880] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T21:33:08.202295] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-23T21:33:09.002268] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-23T21:33:09.144341] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T21:33:09.148026] [INFO ] [REMOTE ] TBI: Full fetch complete (31696 records). [2025-09-23T21:33:09.148145] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-23T21:33:09.545064] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T21:33:09.547418] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-23T21:33:09.547834] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-23T21:33:09.551819] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-23T21:33:09.551946] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-23T21:33:09.553894] [DEBUG] [LOCAL ] TBI: Trimmed 31696 records to 22596 (keeping 200 days of data) [2025-09-23T21:33:09.687810] [DEBUG] [LOCAL ] TBI: Primary data saved (22596 records). [2025-09-23T21:33:09.687961] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-23T21:33:09.688051] [INFO ] [MAIN ] Update Progress: 2053/2372 symbols completed. TBI took 39.4s. Estimated remaining: 42m 26s. Rate: 7.5 symbols/min [2025-09-23T21:33:09.807401] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-23T21:33:09.869945] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:33:09.923600] [DEBUG] [LOCAL ] TD: Loaded 52270 existing records from primary storage. [2025-09-23T21:33:09.923842] [INFO ] [MAIN ] TD: Loaded 52270 existing records. [2025-09-23T21:33:10.125159] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:33:10.125441] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-23T21:33:10.125491] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-23T21:33:10.126871] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-23T21:33:10.126933] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-23T21:33:10.236298] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T21:33:10.244007] [INFO ] [REMOTE ] TCAI: Full fetch complete (952 records). [2025-09-23T21:33:10.249280] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-23T21:33:10.613535] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-23T21:33:10.650193] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 35 unique days, need 200 days [2025-09-23T21:33:10.671780] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:33:10.709730] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:33:10.719379] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:33:10.719521] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-23T21:33:10.720172] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-23T21:33:10.720244] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-23T21:33:10.720309] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-23T21:33:10.720457] [INFO ] [MAIN ] Update Progress: 2054/2372 symbols completed. TCAI took 22.3s. Estimated remaining: 42m 17s. Rate: 7.5 symbols/min [2025-09-23T21:33:10.904846] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:33:10.954184] [DEBUG] [LOCAL ] TDC: Loaded 46931 existing records from primary storage. [2025-09-23T21:33:10.954437] [INFO ] [MAIN ] TDC: Loaded 46931 existing records. [2025-09-23T21:33:11.069085] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T21:33:11.156343] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:33:11.156739] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-23T21:33:11.156800] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-23T21:33:11.158167] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-23T21:33:11.158231] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-23T21:33:11.410363] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-23T21:33:11.543549] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:33:12.041027] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T21:33:12.042801] [INFO ] [REMOTE ] TBN: Full fetch complete (4805 records). [2025-09-23T21:33:12.042877] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-23T21:33:12.207442] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-23T21:33:12.447851] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-23T21:33:12.447988] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-23T21:33:12.448207] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-23T21:33:12.448252] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-23T21:33:12.448724] [DEBUG] [LOCAL ] TBN: Trimmed 4805 records to 2967 (keeping 200 days of data) [2025-09-23T21:33:12.466739] [DEBUG] [LOCAL ] TBN: Primary data saved (2967 records). [2025-09-23T21:33:12.466818] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-23T21:33:12.466908] [INFO ] [MAIN ] Update Progress: 2055/2372 symbols completed. TBN took 26.2s. Estimated remaining: 42m 8s. Rate: 7.5 symbols/min [2025-09-23T21:33:12.640263] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:33:12.651438] [DEBUG] [LOCAL ] TDF: Loaded 6452 existing records from primary storage. [2025-09-23T21:33:12.655215] [INFO ] [MAIN ] TDF: Loaded 6452 existing records. [2025-09-23T21:33:12.655099] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T21:33:12.844191] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:33:12.844571] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-23T21:33:12.844696] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-23T21:33:12.845079] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-23T21:33:12.845144] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-23T21:33:13.006531] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-23T21:33:13.225356] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:33:13.802256] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-23T21:33:14.602370] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-23T21:33:15.402350] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-23T21:33:15.472205] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T21:33:16.059529] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T21:33:16.060446] [INFO ] [REMOTE ] TBLU: Full fetch complete (1170 records). [2025-09-23T21:33:16.060516] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-23T21:33:16.225114] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-23T21:33:16.284686] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T21:33:16.300146] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:33:16.300354] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:33:16.300803] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-23T21:33:16.315795] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-23T21:33:16.315974] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-23T21:33:16.329632] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-23T21:33:16.329492] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (3.32 seconds). [2025-09-23T21:33:16.329908] [INFO ] [MAIN ] Update Progress: 2056/2372 symbols completed. TBLU took 41.0s. Estimated remaining: 41m 60s. Rate: 7.5 symbols/min [2025-09-23T21:33:16.355349] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T21:33:16.543372] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:33:16.566824] [DEBUG] [LOCAL ] TDG: Loaded 22170 existing records from primary storage. [2025-09-23T21:33:16.567029] [INFO ] [MAIN ] TDG: Loaded 22170 existing records. [2025-09-23T21:33:16.743573] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:33:16.743848] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-23T21:33:16.743897] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-23T21:33:16.745123] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-23T21:33:16.745186] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-23T21:33:17.005228] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-23T21:33:17.107932] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T21:33:17.142825] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:33:17.802265] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-23T21:33:18.560635] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T21:33:18.602159] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-23T21:33:19.402230] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-23T21:33:19.507897] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T21:33:20.186104] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T21:33:20.202177] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-23T21:33:20.316010] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T21:33:20.964750] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T21:33:21.002156] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-23T21:33:21.586833] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T21:33:21.802224] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-23T21:33:22.602213] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-23T21:33:22.832801] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T21:33:22.999312] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T21:33:23.402206] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-23T21:33:23.987683] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T21:33:24.202218] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-23T21:33:25.002204] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-23T21:33:25.327820] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T21:33:25.654570] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T21:33:25.802175] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-23T21:33:26.545251] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T21:33:26.602141] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-23T21:33:27.282333] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T21:33:27.284237] [INFO ] [REMOTE ] TDF: Full fetch complete (10642 records). [2025-09-23T21:33:27.284307] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-23T21:33:27.407320] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-23T21:33:27.646122] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-23T21:33:27.646200] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-23T21:33:27.646466] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-23T21:33:27.646503] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-23T21:33:27.646957] [DEBUG] [LOCAL ] TDF: Trimmed 10642 records to 6459 (keeping 200 days of data) [2025-09-23T21:33:27.684965] [DEBUG] [LOCAL ] TDF: Primary data saved (6459 records). [2025-09-23T21:33:27.685060] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-23T21:33:27.685137] [INFO ] [MAIN ] Update Progress: 2057/2372 symbols completed. TDF took 15.2s. Estimated remaining: 41m 52s. Rate: 7.5 symbols/min [2025-09-23T21:33:27.853337] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:33:27.902953] [DEBUG] [LOCAL ] TDOC: Loaded 53347 existing records from primary storage. [2025-09-23T21:33:27.903157] [INFO ] [MAIN ] TDOC: Loaded 53347 existing records. [2025-09-23T21:33:28.077476] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:33:28.077773] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-23T21:33:28.077826] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-23T21:33:28.079232] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-23T21:33:28.079292] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-23T21:33:28.215855] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-23T21:33:28.435131] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:33:28.655210] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T21:33:29.002215] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-23T21:33:29.802272] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-23T21:33:30.602174] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-23T21:33:30.909286] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-23T21:33:30.982088] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-23T21:33:31.402195] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-23T21:33:31.470723] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T21:33:32.202386] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-23T21:33:32.317889] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-23T21:33:33.002183] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-23T21:33:33.041076] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T21:33:33.563857] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T21:33:33.802147] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-23T21:33:34.602207] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-23T21:33:34.972685] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T21:33:35.054136] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-23T21:33:35.402209] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-23T21:33:36.138792] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T21:33:36.202214] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-23T21:33:36.703213] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T21:33:37.002204] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-23T21:33:37.802171] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-23T21:33:37.978603] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T21:33:38.509952] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T21:33:38.602186] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-23T21:33:38.901748] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T21:33:39.402210] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-23T21:33:40.202266] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-23T21:33:40.328374] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T21:33:40.488496] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T21:33:41.002200] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-23T21:33:41.802281] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-23T21:33:42.513812] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-23T21:33:42.602178] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-23T21:33:42.766539] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T21:33:43.161318] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T21:33:43.402285] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-23T21:33:44.202217] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-23T21:33:44.383999] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T21:33:44.388848] [INFO ] [REMOTE ] TDG: Full fetch complete (32360 records). [2025-09-23T21:33:44.388955] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-23T21:33:44.780694] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-23T21:33:44.780862] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-23T21:33:44.781569] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-23T21:33:44.781668] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-23T21:33:44.783426] [DEBUG] [LOCAL ] TDG: Trimmed 32360 records to 22145 (keeping 200 days of data) [2025-09-23T21:33:44.910161] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-23T21:33:44.970456] [DEBUG] [LOCAL ] TDG: Primary data saved (22145 records). [2025-09-23T21:33:44.970594] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-23T21:33:44.970717] [INFO ] [MAIN ] Update Progress: 2058/2372 symbols completed. TDG took 28.6s. Estimated remaining: 41m 46s. Rate: 7.5 symbols/min [2025-09-23T21:33:45.007299] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-23T21:33:45.143660] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:33:45.182751] [DEBUG] [LOCAL ] TDS: Loaded 42835 existing records from primary storage. [2025-09-23T21:33:45.182916] [INFO ] [MAIN ] TDS: Loaded 42835 existing records. [2025-09-23T21:33:45.399143] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:33:45.399402] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-23T21:33:45.399468] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-23T21:33:45.400729] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-23T21:33:45.400795] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-23T21:33:45.791695] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:33:45.802143] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-23T21:33:45.902822] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T21:33:46.602184] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-23T21:33:47.149016] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-23T21:33:47.367114] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T21:33:47.402181] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-23T21:33:47.870252] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T21:33:48.202205] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-23T21:33:48.923402] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T21:33:49.002227] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-23T21:33:49.791878] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T21:33:49.801020] [INFO ] [REMOTE ] TDC: Full fetch complete (66718 records). [2025-09-23T21:33:49.801153] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-23T21:33:49.807505] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-23T21:33:50.224964] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-23T21:33:50.225128] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-23T21:33:50.226408] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-23T21:33:50.226607] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-23T21:33:50.236491] [DEBUG] [LOCAL ] TDC: Trimmed 66718 records to 46900 (keeping 200 days of data) [2025-09-23T21:33:50.251158] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T21:33:50.554914] [DEBUG] [LOCAL ] TDC: Primary data saved (46900 records). [2025-09-23T21:33:50.555282] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-23T21:33:50.555664] [INFO ] [MAIN ] Update Progress: 2059/2372 symbols completed. TDC took 39.8s. Estimated remaining: 41m 37s. Rate: 7.5 symbols/min [2025-09-23T21:33:50.612724] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-23T21:33:50.735226] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:33:50.779173] [DEBUG] [LOCAL ] TDW: Loaded 45528 existing records from primary storage. [2025-09-23T21:33:50.779349] [INFO ] [MAIN ] TDW: Loaded 45528 existing records. [2025-09-23T21:33:50.960949] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:33:50.961272] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-23T21:33:50.961341] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-23T21:33:50.962387] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-23T21:33:50.962448] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-23T21:33:51.335134] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:33:51.402222] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-23T21:33:51.901600] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-23T21:33:52.202209] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-23T21:33:52.511974] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T21:33:53.002189] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-23T21:33:53.034449] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T21:33:53.802152] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-23T21:33:54.072050] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-23T21:33:54.602244] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-23T21:33:54.741436] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T21:33:55.402247] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-23T21:33:55.482485] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T21:33:56.202253] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-23T21:33:56.921664] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-23T21:33:57.002304] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-23T21:33:57.115264] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T21:33:57.802202] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-23T21:33:57.837724] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T21:33:57.846467] [INFO ] [REMOTE ] TD: Full fetch complete (75786 records). [2025-09-23T21:33:57.846671] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-23T21:33:58.246889] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-23T21:33:58.246979] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-23T21:33:58.248168] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-23T21:33:58.248274] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-23T21:33:58.249935] [DEBUG] [LOCAL ] TD: Trimmed 75786 records to 52271 (keeping 200 days of data) [2025-09-23T21:33:58.395321] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T21:33:58.602222] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-23T21:33:58.643365] [DEBUG] [LOCAL ] TD: Primary data saved (52271 records). [2025-09-23T21:33:58.643510] [INFO ] [MAIN ] TD: Full history saved. [2025-09-23T21:33:58.643755] [INFO ] [MAIN ] Update Progress: 2060/2372 symbols completed. TD took 49.0s. Estimated remaining: 41m 29s. Rate: 7.5 symbols/min [2025-09-23T21:33:58.816888] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:33:58.845636] [DEBUG] [LOCAL ] TDY: Loaded 22743 existing records from primary storage. [2025-09-23T21:33:58.845806] [INFO ] [MAIN ] TDY: Loaded 22743 existing records. [2025-09-23T21:33:59.026091] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:33:59.026372] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-23T21:33:59.026422] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-23T21:33:59.027107] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-23T21:33:59.027188] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-23T21:33:59.396600] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:33:59.402164] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-23T21:33:59.900079] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T21:34:00.202157] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-23T21:34:00.314704] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T21:34:00.518097] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T21:34:01.002228] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-23T21:34:01.361860] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T21:34:01.802179] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-23T21:34:02.123079] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T21:34:02.602208] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-23T21:34:03.408416] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-23T21:34:03.413907] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T21:34:04.202184] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-23T21:34:04.278006] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T21:34:04.287578] [INFO ] [REMOTE ] TDOC: Full fetch complete (77271 records). [2025-09-23T21:34:04.287794] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-23T21:34:04.524494] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T21:34:04.762887] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-23T21:34:04.763005] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-23T21:34:04.764629] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-23T21:34:04.764725] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-23T21:34:04.767144] [DEBUG] [LOCAL ] TDOC: Trimmed 77271 records to 53347 (keeping 200 days of data) [2025-09-23T21:34:05.002362] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-23T21:34:05.123068] [DEBUG] [LOCAL ] TDOC: Primary data saved (53347 records). [2025-09-23T21:34:05.123300] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-23T21:34:05.123435] [INFO ] [MAIN ] Update Progress: 2061/2372 symbols completed. TDOC took 37.4s. Estimated remaining: 41m 21s. Rate: 7.5 symbols/min [2025-09-23T21:34:05.347632] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:34:05.348166] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-23T21:34:05.348225] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-23T21:34:05.348433] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-23T21:34:05.348500] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-23T21:34:05.348569] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-23T21:34:05.348606] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-23T21:34:05.728208] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:34:05.760544] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T21:34:05.802155] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-23T21:34:06.185019] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T21:34:06.602194] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-23T21:34:07.402175] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-23T21:34:07.588953] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T21:34:07.849473] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T21:34:08.202227] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-23T21:34:08.413211] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:34:08.413545] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-23T21:34:09.002212] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-23T21:34:09.120424] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T21:34:09.802236] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-23T21:34:10.419770] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T21:34:10.602193] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-23T21:34:10.813464] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:34:10.813828] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-23T21:34:11.402166] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-23T21:34:11.450867] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T21:34:12.202206] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-23T21:34:12.923632] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T21:34:13.002247] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-23T21:34:13.208013] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:34:13.208348] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-23T21:34:13.437032] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T21:34:13.444200] [INFO ] [REMOTE ] TDS: Full fetch complete (61492 records). [2025-09-23T21:34:13.444335] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-23T21:34:13.808886] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-23T21:34:13.863957] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-23T21:34:13.864043] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-23T21:34:13.865023] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-23T21:34:13.865107] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-23T21:34:13.866489] [DEBUG] [LOCAL ] TDS: Trimmed 61492 records to 42808 (keeping 200 days of data) [2025-09-23T21:34:14.145513] [DEBUG] [LOCAL ] TDS: Primary data saved (42808 records). [2025-09-23T21:34:14.145671] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-23T21:34:14.145808] [INFO ] [MAIN ] Update Progress: 2062/2372 symbols completed. TDS took 29.2s. Estimated remaining: 41m 13s. Rate: 7.5 symbols/min [2025-09-23T21:34:14.312622] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:34:14.327110] [DEBUG] [LOCAL ] TEAF: Loaded 7291 existing records from primary storage. [2025-09-23T21:34:14.327786] [INFO ] [MAIN ] TEAF: Loaded 7291 existing records. [2025-09-23T21:34:14.502787] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:34:14.503159] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-23T21:34:14.503215] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-23T21:34:14.504080] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-23T21:34:14.504140] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-23T21:34:14.602169] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-23T21:34:14.853546] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:34:15.402225] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-23T21:34:15.473885] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T21:34:15.535455] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T21:34:16.202217] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-23T21:34:16.783760] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T21:34:17.002186] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-23T21:34:17.578512] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T21:34:17.712747] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T21:34:17.802211] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-23T21:34:18.602192] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-23T21:34:19.098398] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T21:34:19.402195] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-23T21:34:20.206800] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-23T21:34:20.238380] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T21:34:20.439023] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T21:34:20.845337] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T21:34:21.002197] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-23T21:34:21.802240] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-23T21:34:22.424187] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T21:34:22.534764] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T21:34:22.602242] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-23T21:34:23.229638] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T21:34:23.402193] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-23T21:34:24.202217] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-23T21:34:24.254615] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T21:34:25.002228] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-23T21:34:25.622512] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T21:34:25.802270] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-23T21:34:25.910968] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T21:34:26.602200] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-23T21:34:26.864796] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T21:34:26.868310] [INFO ] [REMOTE ] TDY: Full fetch complete (32283 records). [2025-09-23T21:34:26.868399] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-23T21:34:27.087915] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T21:34:27.281387] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-23T21:34:27.281473] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-23T21:34:27.282169] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-23T21:34:27.282231] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-23T21:34:27.283062] [DEBUG] [LOCAL ] TDY: Trimmed 32283 records to 22718 (keeping 200 days of data) [2025-09-23T21:34:27.402351] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-23T21:34:27.431673] [DEBUG] [LOCAL ] TDY: Primary data saved (22718 records). [2025-09-23T21:34:27.431812] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-23T21:34:27.431923] [INFO ] [MAIN ] Update Progress: 2063/2372 symbols completed. TDY took 28.8s. Estimated remaining: 41m 6s. Rate: 7.5 symbols/min [2025-09-23T21:34:27.606545] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:34:27.662073] [DEBUG] [LOCAL ] TECK: Loaded 53437 existing records from primary storage. [2025-09-23T21:34:27.662224] [INFO ] [MAIN ] TECK: Loaded 53437 existing records. [2025-09-23T21:34:27.848201] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:34:27.848463] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-23T21:34:27.848510] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-23T21:34:27.849845] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-23T21:34:27.849910] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-23T21:34:28.202083] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:34:28.202215] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-23T21:34:29.002171] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-23T21:34:29.030112] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T21:34:29.432004] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T21:34:29.742725] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T21:34:29.802166] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-23T21:34:30.490299] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T21:34:30.602206] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-23T21:34:31.402205] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-23T21:34:32.037377] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T21:34:32.039103] [INFO ] [REMOTE ] TEAF: Full fetch complete (9798 records). [2025-09-23T21:34:32.039177] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-23T21:34:32.165868] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T21:34:32.205328] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-23T21:34:32.205699] [INFO ] [REMOTE ] TDW: Full fetch complete (67253 records). [2025-09-23T21:34:32.228626] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-23T21:34:32.639503] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-23T21:34:32.656238] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-23T21:34:32.656674] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-23T21:34:32.664138] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-23T21:34:32.678947] [DEBUG] [LOCAL ] TEAF: Trimmed 9798 records to 7325 (keeping 200 days of data) [2025-09-23T21:34:32.949673] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-23T21:34:32.950168] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-23T21:34:32.951842] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-23T21:34:32.952197] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-23T21:34:32.957053] [DEBUG] [LOCAL ] TDW: Trimmed 67253 records to 45501 (keeping 200 days of data) [2025-09-23T21:34:32.961315] [DEBUG] [LOCAL ] TEAF: Primary data saved (7325 records). [2025-09-23T21:34:32.961482] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-23T21:34:32.961581] [INFO ] [MAIN ] Update Progress: 2064/2372 symbols completed. TEAF took 18.8s. Estimated remaining: 40m 58s. Rate: 7.5 symbols/min [2025-09-23T21:34:33.048124] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-23T21:34:33.364176] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:34:33.408747] [DEBUG] [LOCAL ] TEF: Loaded 37410 existing records from primary storage. [2025-09-23T21:34:33.409979] [INFO ] [MAIN ] TEF: Loaded 37410 existing records. [2025-09-23T21:34:33.655850] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:34:33.657049] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-23T21:34:33.657438] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-23T21:34:33.659016] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-23T21:34:33.659420] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-23T21:34:33.806545] [DEBUG] [LOCAL ] TDW: Primary data saved (45501 records). [2025-09-23T21:34:33.806807] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-23T21:34:33.827033] [INFO ] [MAIN ] Update Progress: 2065/2372 symbols completed. TDW took 43.3s. Estimated remaining: 40m 49s. Rate: 7.5 symbols/min [2025-09-23T21:34:34.251199] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:34:34.257623] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:34:34.258456] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-23T21:34:34.292158] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-23T21:34:34.321819] [DEBUG] [LOCAL ] TEI: Loaded 20379 existing records from primary storage. [2025-09-23T21:34:34.321964] [INFO ] [MAIN ] TEI: Loaded 20379 existing records. [2025-09-23T21:34:34.502047] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:34:34.502295] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-23T21:34:34.502343] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-23T21:34:34.502940] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-23T21:34:34.503001] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-23T21:34:34.604992] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-23T21:34:34.898999] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:34:34.930599] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T21:34:35.402194] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-23T21:34:35.706549] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T21:34:35.926024] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T21:34:35.933870] [INFO ] [REMOTE ] TE: Full fetch complete (46282 records). [2025-09-23T21:34:35.934011] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-23T21:34:36.134486] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 142 unique days, need 200 days [2025-09-23T21:34:36.135082] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:34:36.135169] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:34:36.135248] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-23T21:34:36.135320] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-23T21:34:36.135371] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-23T21:34:36.135454] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-23T21:34:36.135541] [INFO ] [MAIN ] Update Progress: 2066/2372 symbols completed. TE took 31.0s. Estimated remaining: 40m 40s. Rate: 7.5 symbols/min [2025-09-23T21:34:36.206891] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-23T21:34:36.332066] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:34:36.332892] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T21:34:36.402663] [DEBUG] [LOCAL ] TEL: Loaded 51150 existing records from primary storage. [2025-09-23T21:34:36.402847] [INFO ] [MAIN ] TEL: Loaded 51150 existing records. [2025-09-23T21:34:36.581070] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:34:36.581332] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-23T21:34:36.581383] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-23T21:34:36.583016] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-23T21:34:36.583106] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-23T21:34:36.942401] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:34:37.002185] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-23T21:34:37.760167] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T21:34:37.802231] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-23T21:34:38.417199] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T21:34:38.602218] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-23T21:34:38.864236] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T21:34:39.402204] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-23T21:34:39.697296] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T21:34:40.202194] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-23T21:34:41.002174] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-23T21:34:41.035456] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T21:34:41.565784] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T21:34:41.690594] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T21:34:41.802201] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-23T21:34:42.602233] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-23T21:34:43.402174] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-23T21:34:43.442679] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T21:34:44.202239] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-23T21:34:44.406181] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T21:34:45.007307] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-23T21:34:45.024724] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T21:34:45.802201] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-23T21:34:45.834785] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T21:34:46.132536] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T21:34:46.602302] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-23T21:34:47.377877] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T21:34:47.402174] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-23T21:34:48.162447] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T21:34:48.202196] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-23T21:34:48.728138] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T21:34:49.002232] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-23T21:34:49.802175] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-23T21:34:50.001260] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T21:34:50.046954] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T21:34:50.602237] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-23T21:34:51.209954] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T21:34:51.402179] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-23T21:34:51.884580] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T21:34:52.202297] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-23T21:34:52.777919] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T21:34:53.002192] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-23T21:34:53.669946] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T21:34:53.802221] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-23T21:34:53.913745] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T21:34:53.923690] [INFO ] [REMOTE ] TEF: Full fetch complete (54524 records). [2025-09-23T21:34:53.923888] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-23T21:34:54.380851] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-23T21:34:54.380933] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-23T21:34:54.381840] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-23T21:34:54.381902] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-23T21:34:54.383009] [DEBUG] [LOCAL ] TEF: Trimmed 54524 records to 37382 (keeping 200 days of data) [2025-09-23T21:34:54.599127] [DEBUG] [LOCAL ] TEF: Primary data saved (37382 records). [2025-09-23T21:34:54.599268] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-23T21:34:54.599364] [INFO ] [MAIN ] Update Progress: 2067/2372 symbols completed. TEF took 21.6s. Estimated remaining: 40m 33s. Rate: 7.5 symbols/min [2025-09-23T21:34:54.620563] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-23T21:34:54.776510] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:34:54.807082] [DEBUG] [LOCAL ] TEN: Loaded 31061 existing records from primary storage. [2025-09-23T21:34:54.807223] [INFO ] [MAIN ] TEN: Loaded 31061 existing records. [2025-09-23T21:34:54.988518] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:34:54.988793] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-23T21:34:54.988844] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-23T21:34:54.989566] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-23T21:34:54.989626] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-23T21:34:55.356050] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:34:55.383679] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T21:34:55.402145] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-23T21:34:55.712575] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T21:34:56.202227] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-23T21:34:57.002195] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-23T21:34:57.257829] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T21:34:57.641822] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T21:34:57.802229] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-23T21:34:58.076364] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T21:34:58.602231] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-23T21:34:59.102475] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T21:34:59.341695] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T21:34:59.402165] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-23T21:35:00.202287] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-23T21:35:00.481422] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T21:35:00.485365] [INFO ] [REMOTE ] TEI: Full fetch complete (29795 records). [2025-09-23T21:35:00.485462] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-23T21:35:00.868541] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-23T21:35:00.868621] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-23T21:35:00.869265] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-23T21:35:00.869318] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-23T21:35:00.870040] [DEBUG] [LOCAL ] TEI: Trimmed 29795 records to 20409 (keeping 200 days of data) [2025-09-23T21:35:00.995517] [DEBUG] [LOCAL ] TEI: Primary data saved (20409 records). [2025-09-23T21:35:00.995722] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-23T21:35:00.995823] [INFO ] [MAIN ] Update Progress: 2068/2372 symbols completed. TEI took 27.2s. Estimated remaining: 40m 25s. Rate: 7.5 symbols/min [2025-09-23T21:35:01.007266] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-23T21:35:01.175686] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:01.193808] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T21:35:01.218600] [DEBUG] [LOCAL ] TEO: Loaded 21805 existing records from primary storage. [2025-09-23T21:35:01.218765] [INFO ] [MAIN ] TEO: Loaded 21805 existing records. [2025-09-23T21:35:01.455468] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:01.455799] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-23T21:35:01.455852] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-23T21:35:01.456413] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-23T21:35:01.456475] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-23T21:35:01.807434] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-23T21:35:01.851200] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:02.602202] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-23T21:35:02.927025] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T21:35:03.294715] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T21:35:03.403267] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-23T21:35:03.406093] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T21:35:04.202205] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-23T21:35:05.002219] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-23T21:35:05.107366] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T21:35:05.163787] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T21:35:05.802256] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-23T21:35:06.602232] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-23T21:35:06.900614] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T21:35:07.402261] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-23T21:35:07.540393] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T21:35:07.549793] [INFO ] [REMOTE ] TEL: Full fetch complete (73282 records). [2025-09-23T21:35:07.550038] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-23T21:35:07.984407] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-23T21:35:07.984670] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-23T21:35:07.985931] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-23T21:35:07.986052] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-23T21:35:07.987930] [DEBUG] [LOCAL ] TEL: Trimmed 73282 records to 51153 (keeping 200 days of data) [2025-09-23T21:35:08.113115] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T21:35:08.212838] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-23T21:35:08.363626] [DEBUG] [LOCAL ] TEL: Primary data saved (51153 records). [2025-09-23T21:35:08.363819] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-23T21:35:08.365736] [INFO ] [MAIN ] Update Progress: 2069/2372 symbols completed. TEL took 32.2s. Estimated remaining: 40m 17s. Rate: 7.5 symbols/min [2025-09-23T21:35:08.539133] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:08.600579] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-09-23T21:35:08.600792] [INFO ] [MAIN ] TEVA: Loaded 53633 existing records. [2025-09-23T21:35:08.780267] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:08.780559] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-23T21:35:08.780612] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-23T21:35:08.781784] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-23T21:35:08.781936] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-23T21:35:09.013295] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-23T21:35:09.198527] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:09.231879] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T21:35:09.523385] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T21:35:09.802259] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-23T21:35:10.299050] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T21:35:10.602236] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-23T21:35:10.927193] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T21:35:11.402263] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-23T21:35:12.202221] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-23T21:35:12.678938] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-23T21:35:13.002164] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-23T21:35:13.032565] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T21:35:13.331392] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T21:35:13.802202] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-23T21:35:14.602190] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-23T21:35:14.933376] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T21:35:15.402198] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-23T21:35:16.202200] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-23T21:35:16.547117] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T21:35:16.763482] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T21:35:17.002180] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-23T21:35:17.802249] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-23T21:35:18.456725] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T21:35:18.550831] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (5.55 seconds). [2025-09-23T21:35:18.602864] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-23T21:35:19.402231] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-23T21:35:19.636246] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T21:35:20.202178] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-23T21:35:20.714111] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-23T21:35:20.791406] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T21:35:21.002183] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-23T21:35:21.318236] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (5.12 seconds). [2025-09-23T21:35:21.802221] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-23T21:35:22.135512] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T21:35:22.144366] [INFO ] [REMOTE ] TECK: Full fetch complete (77297 records). [2025-09-23T21:35:22.144495] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-23T21:35:22.537792] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-23T21:35:22.537913] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-23T21:35:22.539887] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-23T21:35:22.539951] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-23T21:35:22.541541] [DEBUG] [LOCAL ] TECK: Trimmed 77297 records to 53436 (keeping 200 days of data) [2025-09-23T21:35:22.606014] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-23T21:35:22.792277] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T21:35:22.909349] [DEBUG] [LOCAL ] TECK: Primary data saved (53436 records). [2025-09-23T21:35:22.909492] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-23T21:35:22.909580] [INFO ] [MAIN ] Update Progress: 2070/2372 symbols completed. TECK took 55.5s. Estimated remaining: 40m 10s. Rate: 7.5 symbols/min [2025-09-23T21:35:23.128396] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-23T21:35:23.132200] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:23.186515] [DEBUG] [LOCAL ] TEX: Loaded 44750 existing records from primary storage. [2025-09-23T21:35:23.186697] [INFO ] [MAIN ] TEX: Loaded 44750 existing records. [2025-09-23T21:35:23.382209] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:23.382695] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-23T21:35:23.382752] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-23T21:35:23.383863] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-23T21:35:23.383931] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-23T21:35:23.407443] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-23T21:35:23.783923] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:23.801435] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T21:35:23.807878] [INFO ] [REMOTE ] TEN: Full fetch complete (44890 records). [2025-09-23T21:35:23.808050] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-23T21:35:24.194577] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-23T21:35:24.194724] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-23T21:35:24.195638] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-23T21:35:24.195892] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-23T21:35:24.202540] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-23T21:35:24.202475] [DEBUG] [LOCAL ] TEN: Trimmed 44890 records to 31081 (keeping 200 days of data) [2025-09-23T21:35:24.214065] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T21:35:24.420743] [DEBUG] [LOCAL ] TEN: Primary data saved (31081 records). [2025-09-23T21:35:24.420901] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-23T21:35:24.420993] [INFO ] [MAIN ] Update Progress: 2071/2372 symbols completed. TEN took 29.8s. Estimated remaining: 40m 1s. Rate: 7.5 symbols/min [2025-09-23T21:35:24.600749] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:24.653459] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-23T21:35:24.653604] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-09-23T21:35:24.841223] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:24.841536] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-23T21:35:24.841586] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-23T21:35:24.842788] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-23T21:35:24.842850] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-23T21:35:25.011802] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-23T21:35:25.230134] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:25.802286] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-23T21:35:25.859324] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T21:35:26.021293] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T21:35:26.026423] [INFO ] [REMOTE ] TEO: Full fetch complete (32738 records). [2025-09-23T21:35:26.026513] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-23T21:35:26.402217] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-23T21:35:26.402293] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-23T21:35:26.402951] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-23T21:35:26.403011] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-23T21:35:26.403788] [DEBUG] [LOCAL ] TEO: Trimmed 32738 records to 21923 (keeping 200 days of data) [2025-09-23T21:35:26.527428] [DEBUG] [LOCAL ] TEO: Primary data saved (21923 records). [2025-09-23T21:35:26.527552] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-23T21:35:26.527634] [INFO ] [MAIN ] Update Progress: 2072/2372 symbols completed. TEO took 25.5s. Estimated remaining: 39m 52s. Rate: 7.5 symbols/min [2025-09-23T21:35:26.607295] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-23T21:35:26.705204] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:26.738546] [DEBUG] [LOCAL ] TFII: Loaded 34464 existing records from primary storage. [2025-09-23T21:35:26.738709] [INFO ] [MAIN ] TFII: Loaded 34464 existing records. [2025-09-23T21:35:26.927774] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:26.928068] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-23T21:35:26.928117] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-23T21:35:26.929068] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-23T21:35:26.929130] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-23T21:35:27.288807] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:27.402199] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-23T21:35:27.729068] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T21:35:28.166813] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T21:35:28.202145] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-23T21:35:28.632254] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T21:35:29.002200] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-23T21:35:29.497636] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T21:35:29.802194] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-23T21:35:30.602246] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-23T21:35:30.825789] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T21:35:31.402202] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-23T21:35:31.432800] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T21:35:31.500738] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T21:35:32.202199] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-23T21:35:33.002196] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-23T21:35:33.414919] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-23T21:35:33.569504] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T21:35:33.802198] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-23T21:35:34.602175] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-23T21:35:34.912367] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T21:35:34.985072] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T21:35:35.402209] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-23T21:35:36.202168] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-23T21:35:36.516385] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T21:35:36.652252] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T21:35:37.002229] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-23T21:35:37.802210] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-23T21:35:38.316941] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T21:35:38.613082] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-23T21:35:38.618362] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T21:35:39.402212] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-23T21:35:39.931585] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T21:35:40.211772] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-23T21:35:40.217098] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T21:35:40.697134] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T21:35:41.002197] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-23T21:35:41.802167] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-23T21:35:41.874499] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T21:35:42.564747] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T21:35:42.602179] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-23T21:35:43.402219] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-23T21:35:43.851872] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-23T21:35:44.202204] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-23T21:35:44.712866] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-23T21:35:45.002234] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-23T21:35:45.040401] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T21:35:45.583413] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T21:35:45.802211] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-23T21:35:46.602169] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-23T21:35:47.096835] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-23T21:35:47.168568] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T21:35:47.402203] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-23T21:35:47.473321] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T21:35:48.202213] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-23T21:35:49.002181] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-23T21:35:49.391937] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-23T21:35:49.404472] [INFO ] [REMOTE ] TEVA: Full fetch complete (77671 records). [2025-09-23T21:35:49.404667] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-23T21:35:49.779602] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T21:35:49.827004] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-23T21:35:49.882545] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-23T21:35:49.882680] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-23T21:35:49.884273] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-23T21:35:49.884671] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-23T21:35:49.887990] [DEBUG] [LOCAL ] TEVA: Trimmed 77671 records to 53633 (keeping 200 days of data) [2025-09-23T21:35:50.230411] [DEBUG] [LOCAL ] TEVA: Primary data saved (53633 records). [2025-09-23T21:35:50.230555] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-23T21:35:50.230684] [INFO ] [MAIN ] Update Progress: 2073/2372 symbols completed. TEVA took 41.9s. Estimated remaining: 39m 47s. Rate: 7.5 symbols/min [2025-09-23T21:35:50.401310] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:50.447542] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T21:35:50.446616] [DEBUG] [LOCAL ] TFIN: Loaded 23616 existing records from primary storage. [2025-09-23T21:35:50.454345] [INFO ] [MAIN ] TFIN: Loaded 23616 existing records. [2025-09-23T21:35:50.518207] [INFO ] [REMOTE ] TEX: Full fetch complete (64744 records). [2025-09-23T21:35:50.534505] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-23T21:35:50.605435] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-23T21:35:50.734816] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:50.739112] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-23T21:35:50.739544] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-23T21:35:50.756132] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-23T21:35:50.766524] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-23T21:35:51.359151] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-23T21:35:51.359366] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-23T21:35:51.360797] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-23T21:35:51.361277] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-23T21:35:51.440305] [DEBUG] [LOCAL ] TEX: Trimmed 64744 records to 44678 (keeping 200 days of data) [2025-09-23T21:35:51.444253] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:51.445246] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-23T21:35:51.747980] [DEBUG] [LOCAL ] TEX: Primary data saved (44678 records). [2025-09-23T21:35:51.748117] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-23T21:35:51.748244] [INFO ] [MAIN ] Update Progress: 2074/2372 symbols completed. TEX took 28.8s. Estimated remaining: 39m 38s. Rate: 7.5 symbols/min [2025-09-23T21:35:51.926386] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:51.966253] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T21:35:52.010044] [DEBUG] [LOCAL ] TFPM: Loaded 37199 existing records from primary storage. [2025-09-23T21:35:52.010279] [INFO ] [MAIN ] TFPM: Loaded 37199 existing records. [2025-09-23T21:35:52.209337] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-23T21:35:52.231534] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:52.242269] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T21:35:52.244020] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T21:35:52.242568] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-23T21:35:52.251682] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-23T21:35:52.256798] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-23T21:35:52.256897] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-23T21:35:52.612187] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:53.002206] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-23T21:35:53.802231] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-23T21:35:54.006105] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T21:35:54.357383] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T21:35:54.602213] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-23T21:35:54.773931] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T21:35:55.402243] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-23T21:35:56.202179] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-23T21:35:56.342927] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T21:35:56.355723] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-09-23T21:35:56.355892] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-23T21:35:56.501240] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T21:35:56.798736] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-23T21:35:56.798875] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-23T21:35:56.800048] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-23T21:35:56.800114] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-23T21:35:56.802132] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 53667 (keeping 200 days of data) [2025-09-23T21:35:57.004974] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-23T21:35:57.149509] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T21:35:57.157460] [INFO ] [REMOTE ] TFII: Full fetch complete (47586 records). [2025-09-23T21:35:57.158212] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-23T21:35:57.583838] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-09-23T21:35:57.599909] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-23T21:35:57.602117] [INFO ] [MAIN ] Update Progress: 2075/2372 symbols completed. TFC took 33.2s. Estimated remaining: 39m 29s. Rate: 7.5 symbols/min [2025-09-23T21:35:57.685010] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-23T21:35:57.696762] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-23T21:35:57.702920] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-23T21:35:57.703000] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-23T21:35:57.767399] [DEBUG] [LOCAL ] TFII: Trimmed 47586 records to 34320 (keeping 200 days of data) [2025-09-23T21:35:57.849947] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-23T21:35:57.854564] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:57.943348] [DEBUG] [LOCAL ] TFX: Loaded 37490 existing records from primary storage. [2025-09-23T21:35:57.944026] [INFO ] [MAIN ] TFX: Loaded 37490 existing records. [2025-09-23T21:35:58.149381] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:58.150499] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-23T21:35:58.151459] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-23T21:35:58.159473] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-23T21:35:58.168153] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-23T21:35:58.184188] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T21:35:58.633119] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:58.634124] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-23T21:35:58.651137] [DEBUG] [LOCAL ] TFII: Primary data saved (34320 records). [2025-09-23T21:35:58.651687] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-23T21:35:58.651818] [INFO ] [MAIN ] Update Progress: 2076/2372 symbols completed. TFII took 32.1s. Estimated remaining: 39m 21s. Rate: 7.5 symbols/min [2025-09-23T21:35:58.829694] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:35:58.844618] [DEBUG] [LOCAL ] TG: Loaded 10477 existing records from primary storage. [2025-09-23T21:35:58.844793] [INFO ] [MAIN ] TG: Loaded 10477 existing records. [2025-09-23T21:35:59.028293] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:35:59.028806] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-23T21:35:59.028883] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-23T21:35:59.034842] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-23T21:35:59.044176] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-23T21:35:59.112878] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T21:35:59.402476] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-23T21:35:59.488098] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:35:59.902155] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T21:36:00.202271] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-23T21:36:00.656593] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T21:36:01.002215] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-23T21:36:01.251925] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T21:36:01.802251] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-23T21:36:02.552906] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T21:36:02.602211] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-23T21:36:03.402269] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-23T21:36:04.055607] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-23T21:36:04.202212] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-23T21:36:05.002275] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-23T21:36:05.029520] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-23T21:36:05.236989] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T21:36:05.296269] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T21:36:05.599864] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T21:36:05.802213] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-23T21:36:06.602187] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-23T21:36:06.620461] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T21:36:07.402257] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-23T21:36:08.180965] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T21:36:08.202162] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-23T21:36:08.242209] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T21:36:09.002319] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-23T21:36:09.501470] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T21:36:09.802231] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-23T21:36:09.947617] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T21:36:10.602167] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-23T21:36:11.085710] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T21:36:11.402283] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-23T21:36:12.063701] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T21:36:12.094520] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T21:36:12.202154] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-23T21:36:13.002217] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-23T21:36:13.165803] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T21:36:13.802159] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-23T21:36:13.953589] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T21:36:14.606134] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-23T21:36:14.608706] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T21:36:15.402199] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-23T21:36:16.202161] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-23T21:36:16.497146] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T21:36:16.926917] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-23T21:36:17.002200] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-23T21:36:17.802190] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-23T21:36:18.258615] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T21:36:18.261603] [INFO ] [REMOTE ] TG: Full fetch complete (15303 records). [2025-09-23T21:36:18.261728] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-23T21:36:18.581106] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-23T21:36:18.602952] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-23T21:36:18.708281] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-23T21:36:18.708380] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-23T21:36:18.708833] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-23T21:36:18.708899] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-23T21:36:18.709492] [DEBUG] [LOCAL ] TG: Trimmed 15303 records to 10498 (keeping 200 days of data) [2025-09-23T21:36:18.774715] [DEBUG] [LOCAL ] TG: Primary data saved (10498 records). [2025-09-23T21:36:18.774862] [INFO ] [MAIN ] TG: Full history saved. [2025-09-23T21:36:18.774965] [INFO ] [MAIN ] Update Progress: 2077/2372 symbols completed. TG took 20.1s. Estimated remaining: 39m 14s. Rate: 7.5 symbols/min [2025-09-23T21:36:19.402255] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-23T21:36:19.431547] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T21:36:19.440702] [INFO ] [REMOTE ] TFPM: Full fetch complete (50388 records). [2025-09-23T21:36:19.440820] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-23T21:36:19.836194] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-23T21:36:19.836368] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-23T21:36:19.837348] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-23T21:36:19.837432] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-23T21:36:19.849934] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T21:36:19.854065] [DEBUG] [LOCAL ] TFPM: Trimmed 50388 records to 37335 (keeping 200 days of data) [2025-09-23T21:36:19.855097] [INFO ] [REMOTE ] TFIN: Full fetch complete (30863 records). [2025-09-23T21:36:19.855440] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-23T21:36:20.343620] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-23T21:36:20.343980] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-23T21:36:20.344971] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-23T21:36:20.345283] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-23T21:36:20.349550] [DEBUG] [LOCAL ] TFIN: Trimmed 30863 records to 23634 (keeping 200 days of data) [2025-09-23T21:36:20.624810] [DEBUG] [LOCAL ] TFPM: Primary data saved (37335 records). [2025-09-23T21:36:20.624698] [DEBUG] [LOCAL ] TFIN: Primary data saved (23634 records). [2025-09-23T21:36:20.624956] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-23T21:36:20.625078] [INFO ] [MAIN ] Update Progress: 2078/2372 symbols completed. TFIN took 30.4s. Estimated remaining: 39m 5s. Rate: 7.5 symbols/min [2025-09-23T21:36:20.625170] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-23T21:36:20.625431] [INFO ] [MAIN ] Update Progress: 2079/2372 symbols completed. TFPM took 28.9s. Estimated remaining: 38m 56s. Rate: 7.5 symbols/min [2025-09-23T21:36:20.671460] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T21:36:20.679637] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-23T21:36:22.565940] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T21:36:22.579669] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-23T21:36:24.191255] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T21:36:24.200234] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-23T21:36:25.664793] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T21:36:25.672887] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-23T21:36:27.047728] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T21:36:27.057391] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-23T21:36:28.358137] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T21:36:28.366577] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-23T21:36:29.783267] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T21:36:29.791102] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-23T21:36:31.353847] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T21:36:31.360625] [INFO ] [REMOTE ] TFX: Full fetch complete (54146 records). [2025-09-23T21:36:31.360763] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-23T21:36:31.755496] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-23T21:36:31.755598] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-23T21:36:31.756558] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-23T21:36:31.756620] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-23T21:36:31.757736] [DEBUG] [LOCAL ] TFX: Trimmed 54146 records to 37421 (keeping 200 days of data) [2025-09-23T21:36:32.002041] [DEBUG] [LOCAL ] TFX: Primary data saved (37421 records). [2025-09-23T21:36:32.002191] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-23T21:36:32.002293] [INFO ] [MAIN ] Update Progress: 2080/2372 symbols completed. TFX took 34.4s. Estimated remaining: 38m 49s. Rate: 7.5 symbols/min [2025-09-23T21:36:32.701798] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:36:32.705367] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:36:32.733448] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:36:32.712361] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:36:32.733749] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-23T21:36:32.734024] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-23T21:36:32.734293] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-23T21:36:32.734440] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-23T21:36:32.734546] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-23T21:36:32.734738] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-23T21:36:32.939004] [DEBUG] [LOCAL ] TGLS: Loaded 28439 existing records from primary storage. [2025-09-23T21:36:32.994948] [INFO ] [MAIN ] TGLS: Loaded 28439 existing records. [2025-09-23T21:36:33.011228] [DEBUG] [LOCAL ] TGS: Loaded 32397 existing records from primary storage. [2025-09-23T21:36:33.047745] [INFO ] [MAIN ] TGS: Loaded 32397 existing records. [2025-09-23T21:36:33.261630] [DEBUG] [LOCAL ] TGNA: Loaded 48693 existing records from primary storage. [2025-09-23T21:36:33.311810] [INFO ] [MAIN ] TGNA: Loaded 48693 existing records. [2025-09-23T21:36:33.554427] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:36:33.612110] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:36:33.648568] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-23T21:36:33.678545] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-23T21:36:33.688427] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:36:33.688549] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-23T21:36:33.692462] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-23T21:36:33.703402] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-23T21:36:33.708725] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-23T21:36:33.720102] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-23T21:36:33.749683] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-23T21:36:33.749865] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-23T21:36:33.879003] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:36:33.931418] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:36:33.963096] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-23T21:36:33.989485] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-23T21:36:34.006841] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-23T21:36:34.013467] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-23T21:36:34.020768] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-23T21:36:34.031531] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-23T21:36:34.390093] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:36:34.485695] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-23T21:36:34.501456] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-23T21:36:34.757084] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:36:34.829894] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-23T21:36:34.838538] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:36:34.842421] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:36:34.861263] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-23T21:36:34.865856] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-23T21:36:34.866935] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-23T21:36:34.946564] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:36:34.946853] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-23T21:36:35.093050] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:36:35.093284] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-23T21:36:35.093585] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-23T21:36:35.312538] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:36:35.312950] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-23T21:36:35.313349] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-23T21:36:35.520998] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:36:35.521258] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-23T21:36:35.521577] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-23T21:36:36.012060] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T21:36:36.017476] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-23T21:36:36.145504] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T21:36:36.152130] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-23T21:36:36.231268] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T21:36:36.241280] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-23T21:36:36.505905] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T21:36:36.510745] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-23T21:36:37.074033] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T21:36:37.080296] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-23T21:36:37.088512] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T21:36:37.598319] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T21:36:37.755819] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T21:36:37.802148] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-23T21:36:38.358572] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T21:36:38.602191] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-23T21:36:38.995922] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T21:36:39.402185] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-23T21:36:39.502387] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T21:36:40.202204] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-23T21:36:41.002203] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-23T21:36:41.165458] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T21:36:41.277361] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T21:36:41.282906] [INFO ] [REMOTE ] TGE: Full fetch complete (8757 records). [2025-09-23T21:36:41.283125] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-23T21:36:41.490864] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 76 unique days, need 200 days [2025-09-23T21:36:41.491224] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:36:41.491298] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:36:41.491374] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-23T21:36:41.491497] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-23T21:36:41.491543] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-23T21:36:41.491602] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-23T21:36:41.491760] [INFO ] [MAIN ] Update Progress: 2081/2372 symbols completed. TGE took 9.5s. Estimated remaining: 38m 41s. Rate: 7.5 symbols/min [2025-09-23T21:36:41.661721] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:36:41.726677] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-23T21:36:41.726900] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-09-23T21:36:41.807528] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-23T21:36:41.940021] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:36:41.940357] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-23T21:36:41.940409] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-23T21:36:41.942322] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-23T21:36:41.942387] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-23T21:36:42.332271] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:36:42.374550] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T21:36:42.602212] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-23T21:36:43.114417] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T21:36:43.402257] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-23T21:36:43.540506] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T21:36:44.202240] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-23T21:36:44.445320] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T21:36:45.002212] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-23T21:36:45.802195] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-23T21:36:45.869095] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T21:36:46.382024] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T21:36:46.602227] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-23T21:36:46.757974] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T21:36:47.402207] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-23T21:36:48.202200] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-23T21:36:48.690872] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T21:36:48.864683] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-23T21:36:49.002230] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-23T21:36:49.807358] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-23T21:36:49.821932] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T21:36:50.602239] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-23T21:36:50.757165] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T21:36:50.792554] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T21:36:51.402198] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-23T21:36:51.930943] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T21:36:52.202230] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-23T21:36:52.545412] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T21:36:53.002206] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-23T21:36:53.802214] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-23T21:36:53.997759] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T21:36:54.602277] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-23T21:36:55.110810] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-23T21:36:55.156581] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T21:36:55.402193] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-23T21:36:56.093558] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T21:36:56.202173] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-23T21:36:57.002207] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-23T21:36:57.542182] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T21:36:57.668041] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-23T21:36:57.802158] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-23T21:36:58.327454] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T21:36:58.337539] [INFO ] [REMOTE ] TGNA: Full fetch complete (69870 records). [2025-09-23T21:36:58.337843] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-23T21:36:58.607391] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-23T21:36:58.772356] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-23T21:36:58.772503] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-23T21:36:58.774151] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-23T21:36:58.774247] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-23T21:36:58.776503] [DEBUG] [LOCAL ] TGNA: Trimmed 69870 records to 48720 (keeping 200 days of data) [2025-09-23T21:36:59.114287] [DEBUG] [LOCAL ] TGNA: Primary data saved (48720 records). [2025-09-23T21:36:59.114465] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-23T21:36:59.114571] [INFO ] [MAIN ] Update Progress: 2082/2372 symbols completed. TGNA took 27.1s. Estimated remaining: 38m 34s. Rate: 7.5 symbols/min [2025-09-23T21:36:59.295182] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:36:59.349251] [DEBUG] [LOCAL ] THC: Loaded 48174 existing records from primary storage. [2025-09-23T21:36:59.349492] [INFO ] [MAIN ] THC: Loaded 48174 existing records. [2025-09-23T21:36:59.415699] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-23T21:36:59.540818] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:36:59.541397] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-23T21:36:59.541627] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-23T21:36:59.542856] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-23T21:36:59.542918] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-23T21:36:59.848698] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T21:36:59.958761] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:37:00.001955] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T21:37:00.202172] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-23T21:37:00.883787] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T21:37:01.002241] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-23T21:37:01.802223] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-23T21:37:02.543310] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-23T21:37:02.602150] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-23T21:37:02.730059] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T21:37:02.962288] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T21:37:02.967066] [INFO ] [REMOTE ] TGLS: Full fetch complete (40313 records). [2025-09-23T21:37:02.967171] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-23T21:37:03.341970] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-23T21:37:03.342048] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-23T21:37:03.342850] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-23T21:37:03.342910] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-23T21:37:03.343794] [DEBUG] [LOCAL ] TGLS: Trimmed 40313 records to 28378 (keeping 200 days of data) [2025-09-23T21:37:03.404718] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-23T21:37:03.526292] [DEBUG] [LOCAL ] TGLS: Primary data saved (28378 records). [2025-09-23T21:37:03.526438] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-23T21:37:03.526542] [INFO ] [MAIN ] Update Progress: 2083/2372 symbols completed. TGLS took 31.5s. Estimated remaining: 38m 26s. Rate: 7.5 symbols/min [2025-09-23T21:37:03.724148] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:37:03.757771] [DEBUG] [LOCAL ] THG: Loaded 21919 existing records from primary storage. [2025-09-23T21:37:03.757962] [INFO ] [MAIN ] THG: Loaded 21919 existing records. [2025-09-23T21:37:04.022088] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:37:04.022455] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-23T21:37:04.022530] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-23T21:37:04.023324] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-23T21:37:04.023401] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-23T21:37:04.207445] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-23T21:37:04.599686] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:37:04.974325] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-23T21:37:05.007467] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-23T21:37:05.022979] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T21:37:05.802177] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-23T21:37:05.860789] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T21:37:05.868172] [INFO ] [REMOTE ] TGS: Full fetch complete (47415 records). [2025-09-23T21:37:05.868311] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-23T21:37:06.272868] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T21:37:06.332904] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-23T21:37:06.333000] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-23T21:37:06.334004] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-23T21:37:06.334071] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-23T21:37:06.335208] [DEBUG] [LOCAL ] TGS: Trimmed 47415 records to 32502 (keeping 200 days of data) [2025-09-23T21:37:06.528307] [DEBUG] [LOCAL ] TGS: Primary data saved (32502 records). [2025-09-23T21:37:06.528446] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-23T21:37:06.528533] [INFO ] [MAIN ] Update Progress: 2084/2372 symbols completed. TGS took 34.5s. Estimated remaining: 38m 17s. Rate: 7.5 symbols/min [2025-09-23T21:37:06.607435] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-23T21:37:06.701703] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:37:06.706129] [DEBUG] [LOCAL ] THIR: Loaded 2157 existing records from primary storage. [2025-09-23T21:37:06.706219] [INFO ] [MAIN ] THIR: Loaded 2157 existing records. [2025-09-23T21:37:06.897307] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:37:06.897631] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-23T21:37:06.897713] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-23T21:37:06.897947] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-23T21:37:06.898008] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-23T21:37:07.261538] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:37:07.402196] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-23T21:37:07.735003] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-23T21:37:08.151831] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-23T21:37:08.202169] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-23T21:37:08.612299] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-23T21:37:09.002269] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-23T21:37:09.266211] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-23T21:37:09.802205] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-23T21:37:10.452140] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-23T21:37:10.602163] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-23T21:37:11.242475] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T21:37:11.402196] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-23T21:37:11.747567] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T21:37:12.202240] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-23T21:37:12.885825] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-23T21:37:12.895180] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-09-23T21:37:12.895357] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-23T21:37:13.002951] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-23T21:37:13.303025] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-23T21:37:13.303130] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-23T21:37:13.304338] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-23T21:37:13.304419] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-23T21:37:13.316404] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T21:37:13.323343] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-09-23T21:37:13.666514] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-09-23T21:37:13.666675] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-23T21:37:13.666778] [INFO ] [MAIN ] Update Progress: 2085/2372 symbols completed. TGT took 32.2s. Estimated remaining: 38m 9s. Rate: 7.5 symbols/min [2025-09-23T21:37:13.807309] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-23T21:37:13.840395] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:37:13.844046] [DEBUG] [LOCAL ] THLV: Loaded 1635 existing records from primary storage. [2025-09-23T21:37:13.844115] [INFO ] [MAIN ] THLV: Loaded 1635 existing records. [2025-09-23T21:37:14.023504] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:37:14.023785] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-23T21:37:14.023836] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-23T21:37:14.024085] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-23T21:37:14.024146] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-23T21:37:14.284364] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T21:37:14.390052] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:37:14.602166] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-23T21:37:14.777333] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:37:15.030552] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T21:37:15.402210] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-23T21:37:15.841543] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-23T21:37:16.202218] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-23T21:37:17.002198] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-23T21:37:17.442782] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T21:37:17.802227] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-23T21:37:17.855783] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T21:37:18.271421] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T21:37:18.602204] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-23T21:37:19.059687] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T21:37:19.402198] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-23T21:37:19.768157] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T21:37:20.202233] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-23T21:37:20.573304] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-23T21:37:21.002247] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-23T21:37:21.457342] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T21:37:21.802238] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-23T21:37:22.230733] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T21:37:22.602235] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-23T21:37:23.052323] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T21:37:23.402201] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-23T21:37:23.781229] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T21:37:24.202203] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-23T21:37:24.757542] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-23T21:37:25.002237] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-23T21:37:25.460044] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T21:37:25.461367] [INFO ] [REMOTE ] THIR: Full fetch complete (2627 records). [2025-09-23T21:37:25.461479] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-23T21:37:25.815834] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-23T21:37:25.863961] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-23T21:37:25.864072] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-23T21:37:25.864232] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-23T21:37:25.864274] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-23T21:37:25.864765] [DEBUG] [LOCAL ] THIR: Trimmed 2627 records to 2172 (keeping 200 days of data) [2025-09-23T21:37:25.879505] [DEBUG] [LOCAL ] THIR: Primary data saved (2172 records). [2025-09-23T21:37:25.879623] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-23T21:37:25.879796] [INFO ] [MAIN ] Update Progress: 2086/2372 symbols completed. THIR took 19.4s. Estimated remaining: 38m 2s. Rate: 7.5 symbols/min [2025-09-23T21:37:26.070540] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:37:26.121210] [DEBUG] [LOCAL ] THO: Loaded 42359 existing records from primary storage. [2025-09-23T21:37:26.121425] [INFO ] [MAIN ] THO: Loaded 42359 existing records. [2025-09-23T21:37:26.314722] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:37:26.315008] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-23T21:37:26.315059] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-23T21:37:26.316172] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-23T21:37:26.316238] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-23T21:37:26.608757] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-23T21:37:26.699208] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:37:26.985159] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T21:37:27.402221] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-23T21:37:27.464526] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T21:37:27.816012] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-23T21:37:28.202175] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-23T21:37:28.543353] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-23T21:37:28.544246] [INFO ] [REMOTE ] THLV: Full fetch complete (2701 records). [2025-09-23T21:37:28.544313] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-23T21:37:28.895368] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-23T21:37:28.895435] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-23T21:37:28.895516] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-23T21:37:28.895637] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-23T21:37:28.896008] [DEBUG] [LOCAL ] THLV: Trimmed 2701 records to 1623 (keeping 200 days of data) [2025-09-23T21:37:28.905937] [DEBUG] [LOCAL ] THLV: Primary data saved (1623 records). [2025-09-23T21:37:28.905998] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-23T21:37:28.906065] [INFO ] [MAIN ] Update Progress: 2087/2372 symbols completed. THLV took 15.2s. Estimated remaining: 37m 53s. Rate: 7.5 symbols/min [2025-09-23T21:37:29.004675] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-23T21:37:29.075252] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:37:29.099423] [DEBUG] [LOCAL ] THQ: Loaded 24432 existing records from primary storage. [2025-09-23T21:37:29.099568] [INFO ] [MAIN ] THQ: Loaded 24432 existing records. [2025-09-23T21:37:29.279126] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:37:29.279368] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-23T21:37:29.279417] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-23T21:37:29.280069] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-23T21:37:29.280129] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-23T21:37:29.627951] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:37:29.802167] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-23T21:37:30.602189] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-23T21:37:30.824579] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T21:37:30.874737] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T21:37:31.402277] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-23T21:37:32.143528] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T21:37:32.202223] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-23T21:37:32.549676] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T21:37:33.002268] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-23T21:37:33.670716] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T21:37:33.802152] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-23T21:37:34.130249] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T21:37:34.602209] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-23T21:37:35.223396] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T21:37:35.402173] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-23T21:37:36.202156] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-23T21:37:36.220513] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T21:37:37.002230] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-23T21:37:37.138182] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T21:37:37.768580] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T21:37:37.802155] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-23T21:37:38.316714] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T21:37:38.602254] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-23T21:37:39.402227] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-23T21:37:39.498343] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T21:37:39.548949] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T21:37:40.202221] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-23T21:37:40.986867] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T21:37:40.994513] [INFO ] [REMOTE ] THC: Full fetch complete (69536 records). [2025-09-23T21:37:40.994691] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-23T21:37:41.008078] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-23T21:37:41.316966] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T21:37:41.414572] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-23T21:37:41.414679] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-23T21:37:41.415731] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-23T21:37:41.415836] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-23T21:37:41.417161] [DEBUG] [LOCAL ] THC: Trimmed 69536 records to 48112 (keeping 200 days of data) [2025-09-23T21:37:41.707715] [DEBUG] [LOCAL ] THC: Primary data saved (48112 records). [2025-09-23T21:37:41.707858] [INFO ] [MAIN ] THC: Full history saved. [2025-09-23T21:37:41.707945] [INFO ] [MAIN ] Update Progress: 2088/2372 symbols completed. THC took 42.6s. Estimated remaining: 37m 46s. Rate: 7.5 symbols/min [2025-09-23T21:37:41.807406] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-23T21:37:41.902072] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:37:41.922669] [DEBUG] [LOCAL ] THR: Loaded 19987 existing records from primary storage. [2025-09-23T21:37:41.922813] [INFO ] [MAIN ] THR: Loaded 19987 existing records. [2025-09-23T21:37:42.110284] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:37:42.110763] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-23T21:37:42.110958] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-23T21:37:42.111891] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-23T21:37:42.111955] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-23T21:37:42.270599] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T21:37:42.489202] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:37:42.602164] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-23T21:37:42.795235] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T21:37:43.402222] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-23T21:37:43.443191] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T21:37:44.202166] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-23T21:37:44.495035] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T21:37:45.002162] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-23T21:37:45.248049] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T21:37:45.802180] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-23T21:37:46.103335] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T21:37:46.521420] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T21:37:46.602173] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-23T21:37:47.402195] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-23T21:37:47.688060] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T21:37:48.202219] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-23T21:37:49.002181] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-23T21:37:49.188259] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T21:37:49.195738] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T21:37:49.204911] [INFO ] [REMOTE ] THG: Full fetch complete (31075 records). [2025-09-23T21:37:49.205295] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-23T21:37:49.574495] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-23T21:37:49.574585] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-23T21:37:49.575211] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-23T21:37:49.575275] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-23T21:37:49.576188] [DEBUG] [LOCAL ] THG: Trimmed 31075 records to 21862 (keeping 200 days of data) [2025-09-23T21:37:49.714056] [DEBUG] [LOCAL ] THG: Primary data saved (21862 records). [2025-09-23T21:37:49.714181] [INFO ] [MAIN ] THG: Full history saved. [2025-09-23T21:37:49.714263] [INFO ] [MAIN ] Update Progress: 2089/2372 symbols completed. THG took 46.2s. Estimated remaining: 37m 38s. Rate: 7.5 symbols/min [2025-09-23T21:37:49.809319] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-23T21:37:49.896629] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:37:49.940823] [DEBUG] [LOCAL ] THS: Loaded 37927 existing records from primary storage. [2025-09-23T21:37:49.940969] [INFO ] [MAIN ] THS: Loaded 37927 existing records. [2025-09-23T21:37:50.128785] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:37:50.138235] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-23T21:37:50.138920] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T21:37:50.143724] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-23T21:37:50.145220] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-23T21:37:50.145297] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-23T21:37:50.498215] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:37:50.602234] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-23T21:37:50.674069] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T21:37:51.402299] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-23T21:37:51.751544] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T21:37:52.158361] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T21:37:52.202145] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-23T21:37:53.002235] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-23T21:37:53.254179] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T21:37:53.802211] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-23T21:37:54.422739] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T21:37:54.602302] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-23T21:37:55.076845] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T21:37:55.402220] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-23T21:37:55.687176] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T21:37:56.202269] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-23T21:37:57.008693] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-23T21:37:57.022937] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T21:37:57.504177] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T21:37:57.802168] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-23T21:37:58.013637] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T21:37:58.602227] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-23T21:37:59.264621] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T21:37:59.376837] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T21:37:59.381400] [INFO ] [REMOTE ] THQ: Full fetch complete (34790 records). [2025-09-23T21:37:59.381533] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-23T21:37:59.407337] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-23T21:37:59.786406] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-23T21:37:59.786491] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-23T21:37:59.787385] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-23T21:37:59.787450] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-23T21:37:59.788371] [DEBUG] [LOCAL ] THQ: Trimmed 34790 records to 24507 (keeping 200 days of data) [2025-09-23T21:37:59.956948] [DEBUG] [LOCAL ] THQ: Primary data saved (24507 records). [2025-09-23T21:37:59.957274] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-23T21:37:59.957615] [INFO ] [MAIN ] Update Progress: 2090/2372 symbols completed. THQ took 31.1s. Estimated remaining: 37m 30s. Rate: 7.5 symbols/min [2025-09-23T21:38:00.149291] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:38:00.174017] [DEBUG] [LOCAL ] THW: Loaded 19118 existing records from primary storage. [2025-09-23T21:38:00.174256] [INFO ] [MAIN ] THW: Loaded 19118 existing records. [2025-09-23T21:38:00.207406] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-23T21:38:00.370960] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:38:00.371232] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-23T21:38:00.371294] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-23T21:38:00.372015] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-23T21:38:00.372098] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-23T21:38:00.498154] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T21:38:00.788274] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:38:01.002257] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-23T21:38:01.802195] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-23T21:38:01.928886] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T21:38:01.960043] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T21:38:02.604741] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-23T21:38:02.608612] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T21:38:03.402200] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-23T21:38:04.202264] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-23T21:38:04.252689] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T21:38:04.606911] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T21:38:05.002203] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-23T21:38:05.438679] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T21:38:05.715682] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T21:38:05.802242] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-23T21:38:06.602194] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-23T21:38:06.954390] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T21:38:06.960404] [INFO ] [REMOTE ] THR: Full fetch complete (28906 records). [2025-09-23T21:38:06.960547] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-23T21:38:07.371723] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-23T21:38:07.371893] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-23T21:38:07.372734] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-23T21:38:07.372839] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-23T21:38:07.373740] [DEBUG] [LOCAL ] THR: Trimmed 28906 records to 19961 (keeping 200 days of data) [2025-09-23T21:38:07.434504] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-23T21:38:07.508112] [DEBUG] [LOCAL ] THR: Primary data saved (19961 records). [2025-09-23T21:38:07.508268] [INFO ] [MAIN ] THR: Full history saved. [2025-09-23T21:38:07.508446] [INFO ] [MAIN ] Update Progress: 2091/2372 symbols completed. THR took 25.8s. Estimated remaining: 37m 22s. Rate: 7.5 symbols/min [2025-09-23T21:38:07.680200] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:38:07.680379] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-23T21:38:07.680416] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-23T21:38:07.680565] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-23T21:38:07.680607] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-23T21:38:07.680692] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-23T21:38:07.680745] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-23T21:38:08.064347] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:38:08.165408] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T21:38:08.202161] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-23T21:38:08.402804] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T21:38:09.002227] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-23T21:38:09.437733] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T21:38:09.447883] [INFO ] [REMOTE ] THO: Full fetch complete (60203 records). [2025-09-23T21:38:09.448071] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-23T21:38:09.808155] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-23T21:38:09.871298] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-23T21:38:09.871589] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-23T21:38:09.873336] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-23T21:38:09.884907] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-23T21:38:09.886350] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T21:38:09.892899] [DEBUG] [LOCAL ] THO: Trimmed 60203 records to 42355 (keeping 200 days of data) [2025-09-23T21:38:10.166304] [DEBUG] [LOCAL ] THO: Primary data saved (42355 records). [2025-09-23T21:38:10.166441] [INFO ] [MAIN ] THO: Full history saved. [2025-09-23T21:38:10.166622] [INFO ] [MAIN ] Update Progress: 2092/2372 symbols completed. THO took 44.3s. Estimated remaining: 37m 13s. Rate: 7.5 symbols/min [2025-09-23T21:38:10.336730] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:38:10.376773] [DEBUG] [LOCAL ] TIMB: Loaded 36889 existing records from primary storage. [2025-09-23T21:38:10.376935] [INFO ] [MAIN ] TIMB: Loaded 36889 existing records. [2025-09-23T21:38:10.553300] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:38:10.553597] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-23T21:38:10.553678] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-23T21:38:10.554720] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-23T21:38:10.554799] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-23T21:38:10.613253] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-23T21:38:10.855003] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:38:10.879495] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-23T21:38:10.919307] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:38:11.325540] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T21:38:11.402233] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-23T21:38:12.202216] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-23T21:38:12.768331] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T21:38:13.002257] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-23T21:38:13.336238] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T21:38:13.802209] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-23T21:38:14.014193] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:38:14.014522] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-23T21:38:14.519984] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T21:38:14.602254] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-23T21:38:15.088891] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T21:38:15.402262] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-23T21:38:16.202198] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-23T21:38:16.927249] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T21:38:17.002210] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-23T21:38:17.335086] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T21:38:17.802192] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-23T21:38:18.438673] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T21:38:18.448338] [INFO ] [REMOTE ] THS: Full fetch complete (53564 records). [2025-09-23T21:38:18.448496] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-23T21:38:18.625857] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-23T21:38:18.845345] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-23T21:38:18.845438] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-23T21:38:18.846390] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-23T21:38:18.846455] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-23T21:38:18.847752] [DEBUG] [LOCAL ] THS: Trimmed 53564 records to 37989 (keeping 200 days of data) [2025-09-23T21:38:19.097445] [DEBUG] [LOCAL ] THS: Primary data saved (37989 records). [2025-09-23T21:38:19.097761] [INFO ] [MAIN ] THS: Full history saved. [2025-09-23T21:38:19.097886] [INFO ] [MAIN ] Update Progress: 2093/2372 symbols completed. THS took 29.4s. Estimated remaining: 37m 6s. Rate: 7.5 symbols/min [2025-09-23T21:38:19.250530] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T21:38:19.314694] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:38:19.320930] [DEBUG] [LOCAL ] TISI: Loaded 3851 existing records from primary storage. [2025-09-23T21:38:19.321047] [INFO ] [MAIN ] TISI: Loaded 3851 existing records. [2025-09-23T21:38:19.405280] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-23T21:38:19.535307] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:38:19.535727] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-23T21:38:19.535796] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-23T21:38:19.536229] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-23T21:38:19.536290] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-23T21:38:19.729129] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T21:38:19.921147] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:38:20.202220] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-23T21:38:20.883759] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T21:38:21.002188] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-23T21:38:21.323906] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T21:38:21.802253] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-23T21:38:22.463035] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T21:38:22.501179] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T21:38:22.602240] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-23T21:38:23.202147] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T21:38:23.402203] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-23T21:38:24.202209] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-23T21:38:24.887926] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T21:38:25.002154] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-23T21:38:25.656944] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T21:38:25.802194] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-23T21:38:26.085872] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T21:38:26.291835] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T21:38:26.602180] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-23T21:38:27.402256] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-23T21:38:27.887835] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T21:38:27.952061] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T21:38:28.202269] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-23T21:38:28.958775] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T21:38:29.002206] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-23T21:38:29.636577] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T21:38:29.802243] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-23T21:38:30.564428] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T21:38:30.602210] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-23T21:38:31.175704] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T21:38:31.402241] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-23T21:38:31.963164] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T21:38:32.202260] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-23T21:38:33.002237] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-23T21:38:33.788557] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T21:38:33.802137] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-23T21:38:34.165502] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T21:38:34.602197] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-23T21:38:35.369073] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T21:38:35.402180] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-23T21:38:35.788045] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T21:38:36.202250] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-23T21:38:37.002177] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-23T21:38:37.081145] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T21:38:37.162560] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T21:38:37.166543] [INFO ] [REMOTE ] THW: Full fetch complete (29343 records). [2025-09-23T21:38:37.166732] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-23T21:38:37.552001] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-23T21:38:37.552094] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-23T21:38:37.552782] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-23T21:38:37.552845] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-23T21:38:37.554707] [DEBUG] [LOCAL ] THW: Trimmed 29343 records to 19103 (keeping 200 days of data) [2025-09-23T21:38:37.680440] [DEBUG] [LOCAL ] THW: Primary data saved (19103 records). [2025-09-23T21:38:37.680590] [INFO ] [MAIN ] THW: Full history saved. [2025-09-23T21:38:37.680790] [INFO ] [MAIN ] Update Progress: 2094/2372 symbols completed. THW took 37.7s. Estimated remaining: 36m 59s. Rate: 7.5 symbols/min [2025-09-23T21:38:37.807326] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-23T21:38:37.859122] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:38:37.899968] [DEBUG] [LOCAL ] TIXT: Loaded 31270 existing records from primary storage. [2025-09-23T21:38:37.900754] [INFO ] [MAIN ] TIXT: Loaded 31270 existing records. [2025-09-23T21:38:38.092479] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:38:38.093075] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-23T21:38:38.093166] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-23T21:38:38.094592] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-23T21:38:38.094688] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-23T21:38:38.252253] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T21:38:38.494536] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:38:38.514423] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T21:38:38.602244] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-23T21:38:39.402215] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-23T21:38:39.855835] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T21:38:40.204512] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-23T21:38:40.209619] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T21:38:40.218412] [INFO ] [REMOTE ] TIC: Full fetch complete (37928 records). [2025-09-23T21:38:40.218540] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-23T21:38:40.416418] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-23T21:38:40.417088] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:38:40.417202] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:38:40.417301] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-23T21:38:40.417421] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-23T21:38:40.417503] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-23T21:38:40.417605] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-23T21:38:40.417793] [INFO ] [MAIN ] Update Progress: 2095/2372 symbols completed. TIC took 32.9s. Estimated remaining: 36m 50s. Rate: 7.5 symbols/min [2025-09-23T21:38:40.593075] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:38:40.668734] [DEBUG] [LOCAL ] TJX: Loaded 53672 existing records from primary storage. [2025-09-23T21:38:40.669056] [INFO ] [MAIN ] TJX: Loaded 53672 existing records. [2025-09-23T21:38:40.780322] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T21:38:40.798173] [INFO ] [REMOTE ] TISI: Full fetch complete (5041 records). [2025-09-23T21:38:40.823123] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-23T21:38:40.977706] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:38:40.999107] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-23T21:38:41.023175] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-23T21:38:41.004325] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-23T21:38:41.029247] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-23T21:38:41.037477] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-23T21:38:41.530471] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-23T21:38:41.536314] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-23T21:38:41.542518] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-23T21:38:41.542605] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-23T21:38:41.548414] [DEBUG] [LOCAL ] TISI: Trimmed 5041 records to 3847 (keeping 200 days of data) [2025-09-23T21:38:41.671766] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:38:41.676550] [DEBUG] [LOCAL ] TISI: Primary data saved (3847 records). [2025-09-23T21:38:41.676714] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-23T21:38:41.676817] [INFO ] [MAIN ] Update Progress: 2096/2372 symbols completed. TISI took 22.6s. Estimated remaining: 36m 41s. Rate: 7.5 symbols/min [2025-09-23T21:38:41.807413] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-23T21:38:41.852952] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:38:41.896544] [DEBUG] [LOCAL ] TK: Loaded 39812 existing records from primary storage. [2025-09-23T21:38:41.896741] [INFO ] [MAIN ] TK: Loaded 39812 existing records. [2025-09-23T21:38:42.080346] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:38:42.080576] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-23T21:38:42.080624] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-23T21:38:42.081735] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-23T21:38:42.081831] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-23T21:38:42.389734] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T21:38:42.478135] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:38:42.602243] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-23T21:38:43.402182] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-23T21:38:43.544551] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T21:38:43.576327] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T21:38:44.202244] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-23T21:38:44.637722] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T21:38:44.643090] [INFO ] [REMOTE ] TIMB: Full fetch complete (54972 records). [2025-09-23T21:38:44.643192] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-23T21:38:45.003551] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-23T21:38:45.028727] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-23T21:38:45.028826] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-23T21:38:45.029789] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-23T21:38:45.029974] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-23T21:38:45.031179] [DEBUG] [LOCAL ] TIMB: Trimmed 54972 records to 36746 (keeping 200 days of data) [2025-09-23T21:38:45.260744] [DEBUG] [LOCAL ] TIMB: Primary data saved (36746 records). [2025-09-23T21:38:45.260903] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-23T21:38:45.260988] [INFO ] [MAIN ] Update Progress: 2097/2372 symbols completed. TIMB took 35.1s. Estimated remaining: 36m 33s. Rate: 7.5 symbols/min [2025-09-23T21:38:45.487491] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:38:45.523729] [DEBUG] [LOCAL ] TKC: Loaded 38172 existing records from primary storage. [2025-09-23T21:38:45.523875] [INFO ] [MAIN ] TKC: Loaded 38172 existing records. [2025-09-23T21:38:45.708338] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:38:45.708681] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-23T21:38:45.708758] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-23T21:38:45.709687] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-23T21:38:45.709751] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-23T21:38:45.803913] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-23T21:38:46.122412] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T21:38:46.129956] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:38:46.354060] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T21:38:46.602207] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-23T21:38:47.402207] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-23T21:38:47.612261] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T21:38:47.857794] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T21:38:48.202213] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-23T21:38:48.609057] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T21:38:49.002237] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-23T21:38:49.441851] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T21:38:49.802230] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-23T21:38:50.369429] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T21:38:50.590734] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T21:38:50.602141] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-23T21:38:51.402200] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-23T21:38:51.895108] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T21:38:52.202232] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-23T21:38:53.002206] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-23T21:38:53.384519] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-23T21:38:53.512446] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T21:38:53.802225] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-23T21:38:54.572195] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T21:38:54.602153] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-23T21:38:55.402210] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-23T21:38:55.818202] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T21:38:56.209722] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-23T21:38:56.215514] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T21:38:56.716886] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T21:38:57.002247] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-23T21:38:57.802158] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-23T21:38:58.227121] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T21:38:58.232513] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T21:38:58.602243] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-23T21:38:59.015891] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T21:38:59.402246] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-23T21:38:59.768162] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T21:39:00.202244] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-23T21:39:00.685532] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T21:39:01.002252] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-23T21:39:01.720663] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T21:39:01.802198] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-23T21:39:02.602223] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-23T21:39:02.879917] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T21:39:03.402252] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-23T21:39:04.202268] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-23T21:39:04.819590] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (3.02 seconds). [2025-09-23T21:39:05.005953] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-23T21:39:05.008355] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T21:39:05.051825] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-23T21:39:05.802218] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-23T21:39:06.383952] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-23T21:39:06.535594] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T21:39:06.602199] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-23T21:39:07.201174] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T21:39:07.207914] [INFO ] [REMOTE ] TK: Full fetch complete (57125 records). [2025-09-23T21:39:07.208040] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-23T21:39:07.410166] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-23T21:39:07.718157] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-23T21:39:07.718303] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-23T21:39:07.719531] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-23T21:39:07.719604] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-23T21:39:07.721078] [DEBUG] [LOCAL ] TK: Trimmed 57125 records to 39804 (keeping 200 days of data) [2025-09-23T21:39:08.057244] [DEBUG] [LOCAL ] TK: Primary data saved (39804 records). [2025-09-23T21:39:08.057458] [INFO ] [MAIN ] TK: Full history saved. [2025-09-23T21:39:08.057593] [INFO ] [MAIN ] Update Progress: 2098/2372 symbols completed. TK took 26.4s. Estimated remaining: 36m 27s. Rate: 7.5 symbols/min [2025-09-23T21:39:08.207479] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-23T21:39:08.352951] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:39:08.439792] [DEBUG] [LOCAL ] TKO: Loaded 44254 existing records from primary storage. [2025-09-23T21:39:08.440060] [INFO ] [MAIN ] TKO: Loaded 44254 existing records. [2025-09-23T21:39:08.693148] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:39:08.715091] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-23T21:39:08.715343] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-23T21:39:08.718965] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-23T21:39:08.719057] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-23T21:39:08.719484] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-23T21:39:08.895871] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T21:39:09.007389] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-23T21:39:09.155878] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:39:09.764067] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T21:39:09.802244] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-23T21:39:10.235953] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T21:39:10.244130] [INFO ] [REMOTE ] TIXT: Full fetch complete (45542 records). [2025-09-23T21:39:10.244305] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-23T21:39:10.607356] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-23T21:39:10.696371] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-23T21:39:10.696494] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-23T21:39:10.697690] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-23T21:39:10.697777] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-23T21:39:10.699185] [DEBUG] [LOCAL ] TIXT: Trimmed 45542 records to 31392 (keeping 200 days of data) [2025-09-23T21:39:10.878956] [DEBUG] [LOCAL ] TIXT: Primary data saved (31392 records). [2025-09-23T21:39:10.879122] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-23T21:39:10.879217] [INFO ] [MAIN ] Update Progress: 2099/2372 symbols completed. TIXT took 33.2s. Estimated remaining: 36m 18s. Rate: 7.5 symbols/min [2025-09-23T21:39:11.056192] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:39:11.095885] [DEBUG] [LOCAL ] TKR: Loaded 40056 existing records from primary storage. [2025-09-23T21:39:11.096042] [INFO ] [MAIN ] TKR: Loaded 40056 existing records. [2025-09-23T21:39:11.286722] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:39:11.294570] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-23T21:39:11.307914] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-23T21:39:11.309280] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T21:39:11.309352] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-23T21:39:11.316788] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-23T21:39:11.411352] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-23T21:39:11.679240] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:39:11.921762] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T21:39:12.202249] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-23T21:39:13.002238] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-23T21:39:13.066539] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T21:39:13.073983] [INFO ] [REMOTE ] TKC: Full fetch complete (51356 records). [2025-09-23T21:39:13.074099] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-23T21:39:13.450579] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-23T21:39:13.450681] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-23T21:39:13.451570] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-23T21:39:13.451613] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-23T21:39:13.452726] [DEBUG] [LOCAL ] TKC: Trimmed 51356 records to 38265 (keeping 200 days of data) [2025-09-23T21:39:13.671908] [DEBUG] [LOCAL ] TKC: Primary data saved (38265 records). [2025-09-23T21:39:13.672050] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-23T21:39:13.672136] [INFO ] [MAIN ] Update Progress: 2100/2372 symbols completed. TKC took 28.4s. Estimated remaining: 36m 10s. Rate: 7.5 symbols/min [2025-09-23T21:39:13.814390] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-23T21:39:13.846149] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:39:13.886252] [DEBUG] [LOCAL ] TLK: Loaded 39680 existing records from primary storage. [2025-09-23T21:39:13.886481] [INFO ] [MAIN ] TLK: Loaded 39680 existing records. [2025-09-23T21:39:14.068318] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:39:14.069225] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-23T21:39:14.091933] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-23T21:39:14.093522] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T21:39:14.093590] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-23T21:39:14.102443] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-23T21:39:14.461843] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:39:14.483486] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T21:39:14.602161] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-23T21:39:15.402251] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-23T21:39:15.866933] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T21:39:16.202168] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-23T21:39:16.256228] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T21:39:17.002238] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-23T21:39:17.802269] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-23T21:39:18.208151] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-09-23T21:39:18.545333] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-23T21:39:18.602151] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-23T21:39:19.304131] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-23T21:39:19.337133] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T21:39:19.346579] [INFO ] [REMOTE ] TJX: Full fetch complete (77680 records). [2025-09-23T21:39:19.346913] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-23T21:39:19.412857] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-23T21:39:19.787977] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-23T21:39:19.788136] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-23T21:39:19.789416] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-23T21:39:19.790132] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-23T21:39:19.791183] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T21:39:19.800795] [DEBUG] [LOCAL ] TJX: Trimmed 77680 records to 53672 (keeping 200 days of data) [2025-09-23T21:39:20.150388] [DEBUG] [LOCAL ] TJX: Primary data saved (53672 records). [2025-09-23T21:39:20.150542] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-23T21:39:20.152904] [INFO ] [MAIN ] Update Progress: 2101/2372 symbols completed. TJX took 39.7s. Estimated remaining: 36m 1s. Rate: 7.5 symbols/min [2025-09-23T21:39:20.208447] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-23T21:39:20.329007] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:39:20.351155] [DEBUG] [LOCAL ] TLYS: Loaded 16940 existing records from primary storage. [2025-09-23T21:39:20.351286] [INFO ] [MAIN ] TLYS: Loaded 16940 existing records. [2025-09-23T21:39:20.535539] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:39:20.535928] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-23T21:39:20.535982] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-23T21:39:20.536418] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-23T21:39:20.536478] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-23T21:39:20.897928] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:39:20.920531] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T21:39:21.002144] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-23T21:39:21.789673] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T21:39:21.802172] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-23T21:39:22.400753] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T21:39:22.602197] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-23T21:39:23.402193] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-23T21:39:23.452112] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T21:39:24.050820] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T21:39:24.202176] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-23T21:39:24.349873] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T21:39:25.002205] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-23T21:39:25.626233] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T21:39:25.802205] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-23T21:39:26.091460] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T21:39:26.602190] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-23T21:39:27.216864] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T21:39:27.402192] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-23T21:39:27.461452] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T21:39:28.202249] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-23T21:39:29.002191] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-23T21:39:29.057162] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T21:39:29.744531] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T21:39:29.799921] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T21:39:29.802572] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-23T21:39:30.602322] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-23T21:39:31.371379] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T21:39:31.402139] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-23T21:39:32.202168] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-23T21:39:32.304623] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T21:39:32.467897] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T21:39:33.002229] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-23T21:39:33.555511] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T21:39:33.802200] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-23T21:39:34.288946] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T21:39:34.602196] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-23T21:39:34.627348] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:39:35.402200] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-23T21:39:36.168442] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T21:39:36.202156] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-23T21:39:36.460293] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T21:39:36.928721] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T21:39:37.002203] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-23T21:39:37.802214] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-23T21:39:38.602189] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-23T21:39:38.656169] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T21:39:38.667144] [INFO ] [REMOTE ] TKO: Full fetch complete (64642 records). [2025-09-23T21:39:38.667366] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-23T21:39:39.054789] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-23T21:39:39.054876] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-23T21:39:39.055883] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-23T21:39:39.055948] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-23T21:39:39.057296] [DEBUG] [LOCAL ] TKO: Trimmed 64642 records to 44226 (keeping 200 days of data) [2025-09-23T21:39:39.312527] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T21:39:39.382787] [DEBUG] [LOCAL ] TKO: Primary data saved (44226 records). [2025-09-23T21:39:39.382950] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-23T21:39:39.383064] [INFO ] [MAIN ] Update Progress: 2102/2372 symbols completed. TKO took 31.3s. Estimated remaining: 35m 55s. Rate: 7.5 symbols/min [2025-09-23T21:39:39.408942] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-23T21:39:39.562694] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:39:39.606143] [DEBUG] [LOCAL ] TM: Loaded 36688 existing records from primary storage. [2025-09-23T21:39:39.606285] [INFO ] [MAIN ] TM: Loaded 36688 existing records. [2025-09-23T21:39:39.786594] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:39:39.786873] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-23T21:39:39.786983] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-23T21:39:39.788130] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-23T21:39:39.788191] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-23T21:39:40.168869] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:39:40.172809] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T21:39:40.202149] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-23T21:39:41.002205] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-23T21:39:41.062233] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T21:39:41.288954] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T21:39:41.802199] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-23T21:39:42.607344] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-23T21:39:42.629347] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T21:39:42.647710] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T21:39:43.402199] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-23T21:39:44.162531] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T21:39:44.202149] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-23T21:39:44.342754] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T21:39:44.345976] [INFO ] [REMOTE ] TLYS: Full fetch complete (22014 records). [2025-09-23T21:39:44.346055] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-23T21:39:44.722359] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-23T21:39:44.722529] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-23T21:39:44.723091] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-23T21:39:44.723154] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-23T21:39:44.723840] [DEBUG] [LOCAL ] TLYS: Trimmed 22014 records to 16961 (keeping 200 days of data) [2025-09-23T21:39:44.825302] [DEBUG] [LOCAL ] TLYS: Primary data saved (16961 records). [2025-09-23T21:39:44.825480] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-23T21:39:44.825608] [INFO ] [MAIN ] Update Progress: 2103/2372 symbols completed. TLYS took 24.7s. Estimated remaining: 35m 47s. Rate: 7.5 symbols/min [2025-09-23T21:39:44.995115] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:39:45.002223] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-23T21:39:45.052382] [DEBUG] [LOCAL ] TME: Loaded 53200 existing records from primary storage. [2025-09-23T21:39:45.052570] [INFO ] [MAIN ] TME: Loaded 53200 existing records. [2025-09-23T21:39:45.232707] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:39:45.233011] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-23T21:39:45.233062] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-23T21:39:45.234883] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-23T21:39:45.234946] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-23T21:39:45.605821] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:39:45.718559] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T21:39:45.802162] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-23T21:39:46.602174] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-23T21:39:46.626120] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T21:39:46.632536] [INFO ] [REMOTE ] TLK: Full fetch complete (57413 records). [2025-09-23T21:39:46.632689] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-23T21:39:47.024816] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-23T21:39:47.024924] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-23T21:39:47.025938] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-23T21:39:47.026004] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-23T21:39:47.027366] [DEBUG] [LOCAL ] TLK: Trimmed 57413 records to 39553 (keeping 200 days of data) [2025-09-23T21:39:47.264978] [DEBUG] [LOCAL ] TLK: Primary data saved (39553 records). [2025-09-23T21:39:47.265158] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-23T21:39:47.265275] [INFO ] [MAIN ] Update Progress: 2104/2372 symbols completed. TLK took 33.6s. Estimated remaining: 35m 38s. Rate: 7.5 symbols/min [2025-09-23T21:39:47.435524] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-23T21:39:47.439065] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:39:47.482099] [DEBUG] [LOCAL ] TMHC: Loaded 45672 existing records from primary storage. [2025-09-23T21:39:47.482246] [INFO ] [MAIN ] TMHC: Loaded 45672 existing records. [2025-09-23T21:39:47.683850] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:39:47.684127] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-23T21:39:47.684272] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-23T21:39:47.695919] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-23T21:39:47.714982] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-23T21:39:47.797009] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-23T21:39:48.095102] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:39:48.202168] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-23T21:39:48.233405] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T21:39:48.240893] [INFO ] [REMOTE ] TKR: Full fetch complete (57612 records). [2025-09-23T21:39:48.241008] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-23T21:39:48.627309] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-23T21:39:48.627394] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-23T21:39:48.628339] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-23T21:39:48.628401] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-23T21:39:48.629610] [DEBUG] [LOCAL ] TKR: Trimmed 57612 records to 40151 (keeping 200 days of data) [2025-09-23T21:39:48.883015] [DEBUG] [LOCAL ] TKR: Primary data saved (40151 records). [2025-09-23T21:39:48.883140] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-23T21:39:48.883218] [INFO ] [MAIN ] Update Progress: 2105/2372 symbols completed. TKR took 38.0s. Estimated remaining: 35m 29s. Rate: 7.5 symbols/min [2025-09-23T21:39:49.002392] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-23T21:39:49.060373] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:39:49.113926] [DEBUG] [LOCAL ] TMO: Loaded 52335 existing records from primary storage. [2025-09-23T21:39:49.114180] [INFO ] [MAIN ] TMO: Loaded 52335 existing records. [2025-09-23T21:39:49.334116] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T21:39:49.356393] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:39:49.365102] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-23T21:39:49.365633] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-23T21:39:49.367469] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-23T21:39:49.367555] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-23T21:39:49.773982] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:39:49.804958] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-23T21:39:49.809262] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T21:39:50.602235] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-23T21:39:50.810236] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T21:39:51.409679] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-23T21:39:51.411899] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T21:39:52.202228] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-23T21:39:52.351508] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T21:39:53.002208] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-23T21:39:53.302716] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-23T21:39:53.395312] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T21:39:53.802230] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-23T21:39:54.602245] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-23T21:39:54.862480] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T21:39:55.333363] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T21:39:55.402263] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-23T21:39:56.148492] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T21:39:56.202203] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-23T21:39:57.002230] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-23T21:39:57.453748] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-23T21:39:57.802173] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-23T21:39:57.920295] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T21:39:58.526815] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T21:39:58.602234] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-23T21:39:59.339613] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T21:39:59.402147] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-23T21:39:59.956696] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T21:40:00.202221] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-23T21:40:01.002260] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-23T21:40:01.667484] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-23T21:40:01.755612] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T21:40:01.802394] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-23T21:40:02.382487] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T21:40:02.602226] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-23T21:40:03.402164] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-23T21:40:03.504857] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T21:40:04.062558] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T21:40:04.202153] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-23T21:40:05.002198] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-23T21:40:05.297571] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T21:40:05.802196] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-23T21:40:06.147261] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T21:40:06.185564] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T21:40:06.602194] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-23T21:40:07.402196] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-23T21:40:07.443874] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T21:40:08.202256] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-23T21:40:08.506305] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T21:40:09.002274] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-23T21:40:09.117522] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T21:40:09.773581] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T21:40:09.802169] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-23T21:40:10.602225] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-23T21:40:11.241063] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-23T21:40:11.402176] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-23T21:40:11.591874] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T21:40:11.600728] [INFO ] [REMOTE ] TME: Full fetch complete (76920 records). [2025-09-23T21:40:11.600856] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-23T21:40:12.050484] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-23T21:40:12.050726] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-23T21:40:12.051922] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-23T21:40:12.052037] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-23T21:40:12.082511] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T21:40:12.092909] [DEBUG] [LOCAL ] TME: Trimmed 76920 records to 53200 (keeping 200 days of data) [2025-09-23T21:40:12.208597] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-23T21:40:12.420090] [DEBUG] [LOCAL ] TME: Primary data saved (53200 records). [2025-09-23T21:40:12.420242] [INFO ] [MAIN ] TME: Full history saved. [2025-09-23T21:40:12.420353] [INFO ] [MAIN ] Update Progress: 2106/2372 symbols completed. TME took 27.6s. Estimated remaining: 35m 23s. Rate: 7.5 symbols/min [2025-09-23T21:40:12.602454] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:40:12.623169] [DEBUG] [LOCAL ] TNC: Loaded 15270 existing records from primary storage. [2025-09-23T21:40:12.623333] [INFO ] [MAIN ] TNC: Loaded 15270 existing records. [2025-09-23T21:40:12.808246] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:40:12.808806] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-23T21:40:12.808882] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-23T21:40:12.810380] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-23T21:40:12.810442] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-23T21:40:13.004163] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-23T21:40:13.189393] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:40:13.223477] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T21:40:13.365700] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T21:40:13.802208] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-23T21:40:14.602203] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-23T21:40:14.679158] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T21:40:14.689334] [INFO ] [REMOTE ] TMHC: Full fetch complete (65906 records). [2025-09-23T21:40:14.689542] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-23T21:40:15.114555] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-23T21:40:15.114712] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-23T21:40:15.116353] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-23T21:40:15.116450] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-23T21:40:15.118484] [DEBUG] [LOCAL ] TMHC: Trimmed 65906 records to 45664 (keeping 200 days of data) [2025-09-23T21:40:15.399760] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T21:40:15.406950] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-23T21:40:15.410042] [INFO ] [REMOTE ] TM: Full fetch complete (53076 records). [2025-09-23T21:40:15.410700] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-23T21:40:15.788859] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T21:40:15.891467] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-23T21:40:15.892020] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-23T21:40:15.893397] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-23T21:40:15.893521] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-23T21:40:15.907574] [DEBUG] [LOCAL ] TM: Trimmed 53076 records to 36620 (keeping 200 days of data) [2025-09-23T21:40:15.907220] [DEBUG] [LOCAL ] TMHC: Primary data saved (45664 records). [2025-09-23T21:40:15.908694] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-23T21:40:15.909571] [INFO ] [MAIN ] Update Progress: 2107/2372 symbols completed. TMHC took 28.6s. Estimated remaining: 35m 15s. Rate: 7.5 symbols/min [2025-09-23T21:40:16.197104] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:40:16.202373] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-23T21:40:16.245487] [DEBUG] [LOCAL ] TNET: Loaded 28907 existing records from primary storage. [2025-09-23T21:40:16.246676] [INFO ] [MAIN ] TNET: Loaded 28907 existing records. [2025-09-23T21:40:16.486566] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:40:16.486860] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-23T21:40:16.486923] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-23T21:40:16.495630] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-23T21:40:16.496135] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-23T21:40:16.921781] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:40:16.967969] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T21:40:16.972607] [DEBUG] [LOCAL ] TM: Primary data saved (36620 records). [2025-09-23T21:40:16.976885] [INFO ] [MAIN ] TM: Full history saved. [2025-09-23T21:40:16.977264] [INFO ] [MAIN ] Update Progress: 2108/2372 symbols completed. TM took 37.6s. Estimated remaining: 35m 6s. Rate: 7.5 symbols/min [2025-09-23T21:40:17.006571] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-23T21:40:17.176565] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:40:17.176835] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-23T21:40:17.177328] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-23T21:40:17.177599] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-23T21:40:17.177881] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-23T21:40:17.177978] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-23T21:40:17.178334] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-23T21:40:17.332402] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T21:40:17.610601] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:40:17.802217] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-23T21:40:18.239129] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T21:40:18.602198] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-23T21:40:19.402203] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-23T21:40:19.728985] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T21:40:19.927188] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-23T21:40:20.202241] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-23T21:40:20.443275] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T21:40:21.002206] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-23T21:40:21.208209] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:40:21.208550] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-23T21:40:21.802163] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-23T21:40:22.023198] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:40:22.023553] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-23T21:40:22.054637] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T21:40:22.602196] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-23T21:40:23.335047] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T21:40:23.344079] [INFO ] [REMOTE ] TMO: Full fetch complete (75466 records). [2025-09-23T21:40:23.344266] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-23T21:40:23.411794] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-23T21:40:23.768016] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-23T21:40:23.768120] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-23T21:40:23.769506] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-23T21:40:23.769585] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-23T21:40:23.773639] [DEBUG] [LOCAL ] TMO: Trimmed 75466 records to 52331 (keeping 200 days of data) [2025-09-23T21:40:24.131221] [DEBUG] [LOCAL ] TMO: Primary data saved (52331 records). [2025-09-23T21:40:24.131493] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-23T21:40:24.131629] [INFO ] [MAIN ] Update Progress: 2109/2372 symbols completed. TMO took 35.2s. Estimated remaining: 34m 58s. Rate: 7.5 symbols/min [2025-09-23T21:40:24.207415] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-23T21:40:24.313827] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:40:24.353121] [DEBUG] [LOCAL ] TNK: Loaded 35274 existing records from primary storage. [2025-09-23T21:40:24.353298] [INFO ] [MAIN ] TNK: Loaded 35274 existing records. [2025-09-23T21:40:24.476422] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:40:24.509375] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-23T21:40:24.537517] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:40:24.537893] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-23T21:40:24.537951] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-23T21:40:24.539034] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-23T21:40:24.539095] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-23T21:40:24.910087] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:40:24.933778] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T21:40:25.002200] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-23T21:40:25.802226] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-23T21:40:26.122362] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T21:40:26.602244] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-23T21:40:27.362622] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T21:40:27.402266] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-23T21:40:28.101578] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:40:28.102081] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-23T21:40:28.134130] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T21:40:28.202286] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-23T21:40:28.416277] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:40:28.416620] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-23T21:40:29.002204] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-23T21:40:29.802201] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-23T21:40:30.058110] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T21:40:30.602240] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-23T21:40:31.046440] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T21:40:31.315290] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T21:40:31.402197] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-23T21:40:31.608742] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:40:31.609080] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-23T21:40:32.202193] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-23T21:40:33.002205] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-23T21:40:33.194866] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T21:40:33.362440] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-23T21:40:33.802209] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-23T21:40:34.521198] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T21:40:34.602210] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-23T21:40:35.073727] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T21:40:35.402205] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-23T21:40:36.036137] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T21:40:36.038220] [INFO ] [REMOTE ] TNGY: Full fetch complete (3196 records). [2025-09-23T21:40:36.038298] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-23T21:40:36.207456] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-23T21:40:36.304142] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-23T21:40:36.304470] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:40:36.304561] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:40:36.304673] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-23T21:40:36.304765] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-23T21:40:36.304819] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-23T21:40:36.304904] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-23T21:40:36.305013] [INFO ] [MAIN ] Update Progress: 2110/2372 symbols completed. TNGY took 19.3s. Estimated remaining: 34m 50s. Rate: 7.5 symbols/min [2025-09-23T21:40:36.571225] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:40:36.630511] [DEBUG] [LOCAL ] TNL: Loaded 41900 existing records from primary storage. [2025-09-23T21:40:36.630835] [INFO ] [MAIN ] TNL: Loaded 41900 existing records. [2025-09-23T21:40:36.820089] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:40:36.820441] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-23T21:40:36.820494] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-23T21:40:36.821766] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-23T21:40:36.821830] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-23T21:40:37.003397] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-23T21:40:37.233151] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:40:37.234747] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T21:40:37.802194] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-23T21:40:38.461502] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T21:40:38.602176] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-23T21:40:38.800126] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T21:40:39.402197] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-23T21:40:39.965002] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T21:40:40.202199] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-23T21:40:40.264742] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T21:40:41.002210] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-23T21:40:41.753243] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T21:40:41.802210] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-23T21:40:41.895479] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T21:40:42.602246] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-23T21:40:43.312295] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T21:40:43.402152] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-23T21:40:43.604243] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T21:40:44.202217] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-23T21:40:44.926024] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T21:40:44.988135] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T21:40:45.002151] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-23T21:40:45.802191] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-23T21:40:46.602221] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-23T21:40:46.709984] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T21:40:47.317383] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T21:40:47.402155] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-23T21:40:47.916726] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T21:40:48.202300] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-23T21:40:48.765025] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T21:40:49.002161] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-23T21:40:49.169453] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T21:40:49.802164] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-23T21:40:49.932358] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T21:40:49.937255] [INFO ] [REMOTE ] TNET: Full fetch complete (41740 records). [2025-09-23T21:40:49.937345] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-23T21:40:50.315674] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-23T21:40:50.315761] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-23T21:40:50.316562] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-23T21:40:50.316622] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-23T21:40:50.317556] [DEBUG] [LOCAL ] TNET: Trimmed 41740 records to 28910 (keeping 200 days of data) [2025-09-23T21:40:50.502732] [DEBUG] [LOCAL ] TNET: Primary data saved (28910 records). [2025-09-23T21:40:50.502864] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-23T21:40:50.502948] [INFO ] [MAIN ] Update Progress: 2111/2372 symbols completed. TNET took 34.6s. Estimated remaining: 34m 43s. Rate: 7.5 symbols/min [2025-09-23T21:40:50.604467] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-23T21:40:50.680524] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:40:50.688478] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T21:40:50.691479] [INFO ] [REMOTE ] TNC: Full fetch complete (23271 records). [2025-09-23T21:40:50.691558] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-23T21:40:51.054210] [DEBUG] [LOCAL ] TOL: Loaded 51121 existing records from primary storage. [2025-09-23T21:40:51.067883] [INFO ] [MAIN ] TOL: Loaded 51121 existing records. [2025-09-23T21:40:51.197551] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-23T21:40:51.200217] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-23T21:40:51.200756] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-23T21:40:51.201149] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-23T21:40:51.241606] [DEBUG] [LOCAL ] TNC: Trimmed 23271 records to 15269 (keeping 200 days of data) [2025-09-23T21:40:51.284765] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:40:51.284978] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-23T21:40:51.285028] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-23T21:40:51.289395] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-23T21:40:51.289461] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-23T21:40:51.419376] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-23T21:40:51.737307] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:40:51.752694] [DEBUG] [LOCAL ] TNC: Primary data saved (15269 records). [2025-09-23T21:40:51.752789] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-23T21:40:51.752900] [INFO ] [MAIN ] Update Progress: 2112/2372 symbols completed. TNC took 39.3s. Estimated remaining: 34m 34s. Rate: 7.5 symbols/min [2025-09-23T21:40:51.922786] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:40:51.985484] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-23T21:40:51.985690] [INFO ] [MAIN ] TOST: Loaded 53681 existing records. [2025-09-23T21:40:52.171099] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:40:52.171475] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-23T21:40:52.171547] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-23T21:40:52.172911] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-23T21:40:52.173004] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-23T21:40:52.204509] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-23T21:40:52.361982] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T21:40:52.582913] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:40:52.605833] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T21:40:53.002225] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-23T21:40:53.802326] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-23T21:40:54.124805] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T21:40:54.543417] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T21:40:54.602271] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-23T21:40:55.279538] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T21:40:55.402221] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-23T21:40:56.202165] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-23T21:40:56.440284] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T21:40:57.002202] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-23T21:40:57.367257] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T21:40:57.613078] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T21:40:57.802211] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-23T21:40:58.602167] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-23T21:40:58.711841] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T21:40:59.402200] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-23T21:40:59.732387] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T21:40:59.788027] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T21:40:59.793987] [INFO ] [REMOTE ] TNK: Full fetch complete (51941 records). [2025-09-23T21:40:59.794103] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-23T21:41:00.201746] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-23T21:41:00.201839] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-23T21:41:00.202778] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-23T21:41:00.202940] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-23T21:41:00.203279] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-23T21:41:00.205612] [DEBUG] [LOCAL ] TNK: Trimmed 51941 records to 35266 (keeping 200 days of data) [2025-09-23T21:41:00.429097] [DEBUG] [LOCAL ] TNK: Primary data saved (35266 records). [2025-09-23T21:41:00.429260] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-23T21:41:00.429394] [INFO ] [MAIN ] Update Progress: 2113/2372 symbols completed. TNK took 36.3s. Estimated remaining: 34m 26s. Rate: 7.5 symbols/min [2025-09-23T21:41:00.602499] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:41:00.628130] [DEBUG] [LOCAL ] TPB: Loaded 24943 existing records from primary storage. [2025-09-23T21:41:00.628300] [INFO ] [MAIN ] TPB: Loaded 24943 existing records. [2025-09-23T21:41:00.819267] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:41:00.819515] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-23T21:41:00.819620] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-23T21:41:00.820284] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-23T21:41:00.820359] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-23T21:41:01.003848] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-23T21:41:01.199272] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:41:01.538616] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-23T21:41:01.802238] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-23T21:41:02.046876] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T21:41:02.512625] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T21:41:02.607921] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-23T21:41:02.611923] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T21:41:03.402211] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-23T21:41:04.202228] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-23T21:41:04.408151] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T21:41:05.002166] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-23T21:41:05.282065] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T21:41:05.802229] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-23T21:41:05.991099] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T21:41:06.509022] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T21:41:06.602200] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-23T21:41:06.935018] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T21:41:07.402244] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-23T21:41:07.734926] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T21:41:07.741967] [INFO ] [REMOTE ] TNL: Full fetch complete (58761 records). [2025-09-23T21:41:07.742127] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-23T21:41:08.131827] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-23T21:41:08.131967] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-23T21:41:08.133058] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-23T21:41:08.133122] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-23T21:41:08.134443] [DEBUG] [LOCAL ] TNL: Trimmed 58761 records to 41949 (keeping 200 days of data) [2025-09-23T21:41:08.223737] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-23T21:41:08.239003] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T21:41:08.417602] [DEBUG] [LOCAL ] TNL: Primary data saved (41949 records). [2025-09-23T21:41:08.417771] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-23T21:41:08.417879] [INFO ] [MAIN ] Update Progress: 2114/2372 symbols completed. TNL took 32.1s. Estimated remaining: 34m 18s. Rate: 7.5 symbols/min [2025-09-23T21:41:08.585410] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:41:08.625798] [DEBUG] [LOCAL ] TPC: Loaded 38846 existing records from primary storage. [2025-09-23T21:41:08.625983] [INFO ] [MAIN ] TPC: Loaded 38846 existing records. [2025-09-23T21:41:08.802295] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:41:08.802555] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-23T21:41:08.802676] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-23T21:41:08.803487] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-23T21:41:08.803547] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-23T21:41:09.008782] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-23T21:41:09.169501] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:41:09.802201] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-23T21:41:10.149018] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T21:41:10.602182] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-23T21:41:11.015086] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T21:41:11.337450] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-23T21:41:11.402164] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-23T21:41:12.202228] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-23T21:41:12.337639] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T21:41:12.548194] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T21:41:13.002239] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-23T21:41:13.802177] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-23T21:41:14.122185] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-23T21:41:14.183541] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T21:41:14.602201] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-23T21:41:15.402171] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-23T21:41:15.762462] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T21:41:15.889214] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-23T21:41:16.202199] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-23T21:41:16.629622] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T21:41:17.002161] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-23T21:41:17.416780] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T21:41:17.802245] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-23T21:41:18.602171] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-23T21:41:19.014664] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T21:41:19.159991] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T21:41:19.402195] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-23T21:41:19.568066] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T21:41:20.202186] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-23T21:41:20.404570] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T21:41:21.002239] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-23T21:41:21.110108] [DEBUG] [REMOTE ] TOL: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-23T21:41:21.110456] [WARN ] [REMOTE ] TOL: No data returned for month 2025-09 [2025-09-23T21:41:21.110559] [INFO ] [REMOTE ] TOL: Full fetch complete (67984 records). [2025-09-23T21:41:21.110693] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-23T21:41:21.111791] [FATAL] [VALIDATOR ] TOL: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T21:41:21.111932] [FATAL] [MAIN ] TOL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:41:21.112020] [WARN ] [MAIN ] TOL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:41:21.112118] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-23T21:41:21.112201] [DEBUG] [LOCAL ] TOL: No primary data file found to delete. [2025-09-23T21:41:21.112240] [INFO ] [LOCAL ] TOL: Starting deletion of derivative data. [2025-09-23T21:41:21.112711] [DEBUG] [LOCAL ] TOL: Deleted derivative data file. [2025-09-23T21:41:21.112822] [INFO ] [MAIN ] Update Progress: 2115/2372 symbols completed. TOL took 30.6s. Estimated remaining: 34m 11s. Rate: 7.5 symbols/min [2025-09-23T21:41:21.287676] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:41:21.330069] [DEBUG] [LOCAL ] TPH: Loaded 45252 existing records from primary storage. [2025-09-23T21:41:21.330226] [INFO ] [MAIN ] TPH: Loaded 45252 existing records. [2025-09-23T21:41:21.509779] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:41:21.510160] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-23T21:41:21.510304] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-23T21:41:21.511410] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-23T21:41:21.511472] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-23T21:41:21.753204] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T21:41:21.810305] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-23T21:41:21.982833] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:41:22.602256] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-23T21:41:23.125001] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T21:41:23.130391] [INFO ] [REMOTE ] TPB: Full fetch complete (34625 records). [2025-09-23T21:41:23.130575] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-23T21:41:23.407385] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-23T21:41:23.515760] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-23T21:41:23.515847] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-23T21:41:23.516670] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-23T21:41:23.516733] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-23T21:41:23.517562] [DEBUG] [LOCAL ] TPB: Trimmed 34625 records to 24884 (keeping 200 days of data) [2025-09-23T21:41:23.668909] [DEBUG] [LOCAL ] TPB: Primary data saved (24884 records). [2025-09-23T21:41:23.669039] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-23T21:41:23.669136] [INFO ] [MAIN ] Update Progress: 2116/2372 symbols completed. TPB took 23.2s. Estimated remaining: 34m 2s. Rate: 7.5 symbols/min [2025-09-23T21:41:23.843157] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:41:23.858385] [DEBUG] [LOCAL ] TPL: Loaded 12372 existing records from primary storage. [2025-09-23T21:41:23.858501] [INFO ] [MAIN ] TPL: Loaded 12372 existing records. [2025-09-23T21:41:24.064175] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:41:24.064468] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-23T21:41:24.064522] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-23T21:41:24.065162] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-23T21:41:24.065225] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-23T21:41:24.209389] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-23T21:41:24.434296] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:41:24.733305] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-23T21:41:25.002169] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-23T21:41:25.110108] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T21:41:25.747800] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T21:41:25.802153] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-23T21:41:26.602202] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-23T21:41:26.764172] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T21:41:26.890498] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T21:41:27.402210] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-23T21:41:28.139244] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T21:41:28.202204] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-23T21:41:28.895205] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T21:41:29.002233] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-23T21:41:29.802208] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-23T21:41:30.213468] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-23T21:41:30.222536] [INFO ] [REMOTE ] TOST: Full fetch complete (77698 records). [2025-09-23T21:41:30.222701] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-23T21:41:30.620860] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-23T21:41:30.648152] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-23T21:41:30.648326] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-23T21:41:30.649771] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-23T21:41:30.649977] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-23T21:41:30.676541] [DEBUG] [LOCAL ] TOST: Trimmed 77698 records to 53681 (keeping 200 days of data) [2025-09-23T21:41:30.678687] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T21:41:31.019877] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T21:41:31.042156] [DEBUG] [LOCAL ] TOST: Primary data saved (53681 records). [2025-09-23T21:41:31.042298] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-23T21:41:31.042397] [INFO ] [MAIN ] Update Progress: 2117/2372 symbols completed. TOST took 39.3s. Estimated remaining: 33m 54s. Rate: 7.5 symbols/min [2025-09-23T21:41:31.402401] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-23T21:41:32.168053] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T21:41:32.202148] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-23T21:41:33.007870] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-23T21:41:33.028120] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T21:41:33.721400] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T21:41:33.802157] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-23T21:41:34.179141] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T21:41:34.602193] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-23T21:41:35.231187] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T21:41:35.237878] [INFO ] [REMOTE ] TPC: Full fetch complete (54807 records). [2025-09-23T21:41:35.238039] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-23T21:41:35.408026] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-23T21:41:35.656779] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-23T21:41:35.656860] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-23T21:41:35.657783] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-23T21:41:35.657844] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-23T21:41:35.658999] [DEBUG] [LOCAL ] TPC: Trimmed 54807 records to 38834 (keeping 200 days of data) [2025-09-23T21:41:35.893512] [DEBUG] [LOCAL ] TPC: Primary data saved (38834 records). [2025-09-23T21:41:35.893711] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-23T21:41:35.893829] [INFO ] [MAIN ] Update Progress: 2118/2372 symbols completed. TPC took 27.5s. Estimated remaining: 33m 46s. Rate: 7.5 symbols/min [2025-09-23T21:41:36.261812] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T21:41:36.273955] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-23T21:41:36.430257] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T21:41:37.002315] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-23T21:41:37.987456] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T21:41:37.999061] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-23T21:41:38.032596] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T21:41:38.602223] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-23T21:41:39.526107] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T21:41:39.536044] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-23T21:41:39.645854] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T21:41:40.202283] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-23T21:41:41.194006] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T21:41:41.197086] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-23T21:41:41.250605] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T21:41:41.802241] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-23T21:41:42.277739] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T21:41:42.602265] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-23T21:41:43.221185] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T21:41:43.402170] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-23T21:41:43.637121] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T21:41:44.202270] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-23T21:41:44.883313] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T21:41:44.890904] [INFO ] [REMOTE ] TPH: Full fetch complete (64921 records). [2025-09-23T21:41:44.891080] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-23T21:41:45.261943] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T21:41:45.308184] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-23T21:41:45.307998] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-23T21:41:45.309124] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-23T21:41:45.310412] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-23T21:41:45.310594] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-23T21:41:45.312121] [DEBUG] [LOCAL ] TPH: Trimmed 64921 records to 45210 (keeping 200 days of data) [2025-09-23T21:41:45.573464] [DEBUG] [LOCAL ] TPH: Primary data saved (45210 records). [2025-09-23T21:41:45.573580] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-23T21:41:45.573691] [INFO ] [MAIN ] Update Progress: 2119/2372 symbols completed. TPH took 24.5s. Estimated remaining: 33m 38s. Rate: 7.5 symbols/min [2025-09-23T21:41:46.264581] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T21:41:46.267467] [INFO ] [REMOTE ] TPL: Full fetch complete (18391 records). [2025-09-23T21:41:46.267568] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-23T21:41:46.655566] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-23T21:41:46.655689] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-23T21:41:46.656098] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-23T21:41:46.656139] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-23T21:41:46.656740] [DEBUG] [LOCAL ] TPL: Trimmed 18391 records to 12414 (keeping 200 days of data) [2025-09-23T21:41:46.737717] [DEBUG] [LOCAL ] TPL: Primary data saved (12414 records). [2025-09-23T21:41:46.737854] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-23T21:41:46.737940] [INFO ] [MAIN ] Update Progress: 2120/2372 symbols completed. TPL took 23.1s. Estimated remaining: 33m 29s. Rate: 7.5 symbols/min [2025-09-23T21:41:47.314525] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:41:47.403503] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:41:47.471627] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:41:47.467133] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:41:47.484439] [DEBUG] [LOCAL ] TPZ: Loaded 5195 existing records from primary storage. [2025-09-23T21:41:47.484735] [INFO ] [MAIN ] TPZ: Loaded 5195 existing records. [2025-09-23T21:41:47.552842] [DEBUG] [LOCAL ] TPYP: Loaded 7872 existing records from primary storage. [2025-09-23T21:41:47.573791] [INFO ] [MAIN ] TPYP: Loaded 7872 existing records. [2025-09-23T21:41:47.648978] [DEBUG] [LOCAL ] TPVG: Loaded 27100 existing records from primary storage. [2025-09-23T21:41:47.674182] [INFO ] [MAIN ] TPVG: Loaded 27100 existing records. [2025-09-23T21:41:47.972846] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:41:48.071583] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-23T21:41:48.101859] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-23T21:41:48.076844] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:41:48.005976] [DEBUG] [LOCAL ] TPR: Loaded 53483 existing records from primary storage. [2025-09-23T21:41:48.138553] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-23T21:41:48.140726] [INFO ] [MAIN ] TPR: Loaded 53483 existing records. [2025-09-23T21:41:48.146665] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-23T21:41:48.146729] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-23T21:41:48.180173] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:41:48.176887] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-23T21:41:48.198591] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-23T21:41:48.220985] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-23T21:41:48.290192] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-23T21:41:48.325013] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-23T21:41:48.238604] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-23T21:41:48.362118] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-23T21:41:48.708786] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:41:48.816331] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-23T21:41:48.877903] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-23T21:41:49.008876] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-23T21:41:49.031783] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-23T21:41:49.334705] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:41:49.390145] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-23T21:41:49.467115] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:41:49.500412] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-23T21:41:49.767917] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:41:49.774214] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-23T21:41:49.849155] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:41:49.849487] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-23T21:41:50.224880] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T21:41:50.227343] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-23T21:41:50.626866] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T21:41:50.629297] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-23T21:41:51.034158] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T21:41:51.042144] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-23T21:41:51.091805] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T21:41:51.402182] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-23T21:41:51.454680] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T21:41:51.490364] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T21:41:52.101910] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T21:41:52.148860] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T21:41:52.202145] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-23T21:41:53.002196] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-23T21:41:53.099676] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T21:41:53.802204] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-23T21:41:54.578614] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T21:41:54.602154] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-23T21:41:54.925820] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T21:41:55.049245] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-23T21:41:55.402240] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-23T21:41:56.202182] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-23T21:41:56.256857] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T21:41:57.002191] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-23T21:41:57.544169] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T21:41:57.734721] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T21:41:57.802233] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-23T21:41:58.602266] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-23T21:41:59.402251] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-23T21:41:59.766806] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-23T21:41:59.867321] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T21:41:59.935669] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T21:42:00.202238] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-23T21:42:01.002170] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-23T21:42:01.389780] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T21:42:01.802248] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-23T21:42:02.602191] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-23T21:42:03.402273] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-23T21:42:04.186188] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-09-23T21:42:04.183828] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T21:42:04.205705] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-23T21:42:04.303035] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T21:42:04.667535] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-09-23T21:42:04.720836] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T21:42:05.002284] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-23T21:42:05.592827] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T21:42:05.802236] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-23T21:42:06.444895] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T21:42:06.602237] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-23T21:42:07.402202] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-23T21:42:08.131087] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T21:42:08.132929] [INFO ] [REMOTE ] TPYP: Full fetch complete (12537 records). [2025-09-23T21:42:08.133004] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-23T21:42:08.211974] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-23T21:42:08.541304] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-23T21:42:08.541528] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-23T21:42:08.541978] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-23T21:42:08.542057] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-23T21:42:08.542859] [DEBUG] [LOCAL ] TPYP: Trimmed 12537 records to 7880 (keeping 200 days of data) [2025-09-23T21:42:08.596935] [DEBUG] [LOCAL ] TPYP: Primary data saved (7880 records). [2025-09-23T21:42:08.597078] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-23T21:42:08.597170] [INFO ] [MAIN ] Update Progress: 2121/2372 symbols completed. TPYP took 21.9s. Estimated remaining: 33m 23s. Rate: 7.5 symbols/min [2025-09-23T21:42:08.791523] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-23T21:42:08.818132] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:42:08.847860] [DEBUG] [LOCAL ] TR: Loaded 18292 existing records from primary storage. [2025-09-23T21:42:08.848019] [INFO ] [MAIN ] TR: Loaded 18292 existing records. [2025-09-23T21:42:09.007700] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-23T21:42:09.043523] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:42:09.043812] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-23T21:42:09.043866] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-23T21:42:09.044528] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-23T21:42:09.044591] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-23T21:42:09.452443] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:42:09.457191] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T21:42:09.802197] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-23T21:42:10.602175] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-23T21:42:10.641202] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T21:42:11.110254] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T21:42:11.192313] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T21:42:11.402203] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-23T21:42:12.188515] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T21:42:12.202146] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-23T21:42:13.002203] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-23T21:42:13.179123] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T21:42:13.802201] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-23T21:42:14.310368] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T21:42:14.315821] [INFO ] [REMOTE ] TPVG: Full fetch complete (40194 records). [2025-09-23T21:42:14.315945] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-23T21:42:14.607366] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-23T21:42:14.739435] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-23T21:42:14.739547] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-23T21:42:14.740513] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-23T21:42:14.740578] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-23T21:42:14.741538] [DEBUG] [LOCAL ] TPVG: Trimmed 40194 records to 26984 (keeping 200 days of data) [2025-09-23T21:42:14.909069] [DEBUG] [LOCAL ] TPVG: Primary data saved (26984 records). [2025-09-23T21:42:14.909226] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-23T21:42:14.909321] [INFO ] [MAIN ] Update Progress: 2122/2372 symbols completed. TPVG took 28.2s. Estimated remaining: 33m 15s. Rate: 7.5 symbols/min [2025-09-23T21:42:15.078021] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:42:15.089109] [DEBUG] [LOCAL ] TRAK: Loaded 9317 existing records from primary storage. [2025-09-23T21:42:15.089253] [INFO ] [MAIN ] TRAK: Loaded 9317 existing records. [2025-09-23T21:42:15.264867] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:42:15.265125] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-23T21:42:15.265223] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-23T21:42:15.265711] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-23T21:42:15.265772] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-23T21:42:15.414688] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-23T21:42:15.656174] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:42:15.713194] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T21:42:16.013068] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-23T21:42:16.202246] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-23T21:42:16.697075] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T21:42:17.002201] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-23T21:42:17.802207] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-23T21:42:17.898603] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T21:42:18.157833] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T21:42:18.537875] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T21:42:18.602198] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-23T21:42:19.402257] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-23T21:42:19.973130] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T21:42:19.974450] [INFO ] [REMOTE ] TPZ: Full fetch complete (9234 records). [2025-09-23T21:42:19.974544] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-23T21:42:20.212040] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-23T21:42:20.390213] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-23T21:42:20.390352] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-23T21:42:20.390639] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-23T21:42:20.390830] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-23T21:42:20.391612] [DEBUG] [LOCAL ] TPZ: Trimmed 9234 records to 5169 (keeping 200 days of data) [2025-09-23T21:42:20.458861] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T21:42:20.479259] [DEBUG] [LOCAL ] TPZ: Primary data saved (5169 records). [2025-09-23T21:42:20.479348] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-23T21:42:20.479466] [INFO ] [MAIN ] Update Progress: 2123/2372 symbols completed. TPZ took 33.7s. Estimated remaining: 33m 7s. Rate: 7.5 symbols/min [2025-09-23T21:42:20.646267] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:42:20.665955] [DEBUG] [LOCAL ] TRC: Loaded 16078 existing records from primary storage. [2025-09-23T21:42:20.666069] [INFO ] [MAIN ] TRC: Loaded 16078 existing records. [2025-09-23T21:42:20.839776] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:42:20.840034] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-23T21:42:20.840090] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-23T21:42:20.840689] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-23T21:42:20.840760] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-23T21:42:21.010050] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-23T21:42:21.221569] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:42:21.234748] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T21:42:21.802265] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-23T21:42:22.602190] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-23T21:42:22.799884] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T21:42:23.074703] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-23T21:42:23.094701] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T21:42:23.402214] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-23T21:42:24.202297] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-23T21:42:25.002241] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-23T21:42:25.228036] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T21:42:25.237826] [INFO ] [REMOTE ] TPR: Full fetch complete (77441 records). [2025-09-23T21:42:25.238114] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-23T21:42:25.267733] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T21:42:25.686671] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-23T21:42:25.686773] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-23T21:42:25.688144] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-23T21:42:25.688275] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-23T21:42:25.690383] [DEBUG] [LOCAL ] TPR: Trimmed 77441 records to 53483 (keeping 200 days of data) [2025-09-23T21:42:25.805788] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T21:42:25.804049] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-23T21:42:26.074292] [DEBUG] [LOCAL ] TPR: Primary data saved (53483 records). [2025-09-23T21:42:26.074461] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-23T21:42:26.077809] [INFO ] [MAIN ] Update Progress: 2124/2372 symbols completed. TPR took 39.3s. Estimated remaining: 32m 58s. Rate: 7.5 symbols/min [2025-09-23T21:42:26.274458] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:42:26.339890] [DEBUG] [LOCAL ] TREX: Loaded 50024 existing records from primary storage. [2025-09-23T21:42:26.340041] [INFO ] [MAIN ] TREX: Loaded 50024 existing records. [2025-09-23T21:42:26.547541] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:42:26.547930] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-23T21:42:26.547995] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-23T21:42:26.549197] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-23T21:42:26.549279] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-23T21:42:26.608030] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-23T21:42:26.942265] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:42:26.956747] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T21:42:27.402195] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-23T21:42:27.590366] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T21:42:28.202218] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-23T21:42:29.002190] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-23T21:42:29.069760] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T21:42:29.158893] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T21:42:29.802200] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-23T21:42:30.422860] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T21:42:30.602190] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-23T21:42:31.402210] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-23T21:42:31.745136] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T21:42:32.193542] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T21:42:32.202131] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-23T21:42:32.344936] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T21:42:32.949904] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T21:42:33.002154] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-23T21:42:33.802168] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-23T21:42:34.003980] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T21:42:34.602187] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-23T21:42:34.991014] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T21:42:35.402202] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-23T21:42:36.170998] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T21:42:36.202153] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-23T21:42:36.214122] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T21:42:37.002218] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-23T21:42:37.802222] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-23T21:42:38.055150] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T21:42:38.089318] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T21:42:38.093238] [INFO ] [REMOTE ] TR: Full fetch complete (24835 records). [2025-09-23T21:42:38.093354] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-23T21:42:38.479008] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-23T21:42:38.479164] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-23T21:42:38.479791] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-23T21:42:38.479854] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-23T21:42:38.481071] [DEBUG] [LOCAL ] TR: Trimmed 24835 records to 18319 (keeping 200 days of data) [2025-09-23T21:42:38.603270] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-23T21:42:38.622665] [DEBUG] [LOCAL ] TR: Primary data saved (18319 records). [2025-09-23T21:42:38.622823] [INFO ] [MAIN ] TR: Full history saved. [2025-09-23T21:42:38.622955] [INFO ] [MAIN ] Update Progress: 2125/2372 symbols completed. TR took 30.0s. Estimated remaining: 32m 51s. Rate: 7.5 symbols/min [2025-09-23T21:42:38.795404] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:42:38.863041] [DEBUG] [LOCAL ] TRGP: Loaded 50848 existing records from primary storage. [2025-09-23T21:42:38.863403] [INFO ] [MAIN ] TRGP: Loaded 50848 existing records. [2025-09-23T21:42:39.071784] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T21:42:39.078451] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:42:39.084071] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-23T21:42:39.084144] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-23T21:42:39.085864] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-23T21:42:39.085929] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-23T21:42:39.406084] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-23T21:42:39.472878] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:42:39.466784] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T21:42:40.202234] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-23T21:42:41.002199] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-23T21:42:41.330860] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-23T21:42:41.550391] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T21:42:41.802186] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-23T21:42:42.035560] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T21:42:42.602204] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-23T21:42:43.221519] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T21:42:43.402156] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-23T21:42:43.570868] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T21:42:43.940639] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T21:42:43.943210] [INFO ] [REMOTE ] TRAK: Full fetch complete (13390 records). [2025-09-23T21:42:43.943282] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-23T21:42:44.207326] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-23T21:42:44.318599] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-23T21:42:44.318714] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-23T21:42:44.319054] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-23T21:42:44.319094] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-23T21:42:44.319605] [DEBUG] [LOCAL ] TRAK: Trimmed 13390 records to 9317 (keeping 200 days of data) [2025-09-23T21:42:44.383623] [DEBUG] [LOCAL ] TRAK: Primary data saved (9317 records). [2025-09-23T21:42:44.383780] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-23T21:42:44.383898] [INFO ] [MAIN ] Update Progress: 2126/2372 symbols completed. TRAK took 29.5s. Estimated remaining: 32m 43s. Rate: 7.5 symbols/min [2025-09-23T21:42:44.552926] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:42:44.604217] [DEBUG] [LOCAL ] TRN: Loaded 37376 existing records from primary storage. [2025-09-23T21:42:44.604360] [INFO ] [MAIN ] TRN: Loaded 37376 existing records. [2025-09-23T21:42:44.790960] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:42:44.792146] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-23T21:42:44.792202] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-23T21:42:44.793934] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-23T21:42:44.793996] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-23T21:42:45.007414] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-23T21:42:45.154084] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:42:45.802193] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-23T21:42:45.928127] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T21:42:46.602193] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-23T21:42:46.722917] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T21:42:46.756004] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T21:42:47.402194] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-23T21:42:47.559876] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T21:42:48.202257] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-23T21:42:49.002217] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-23T21:42:49.254959] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T21:42:49.489521] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T21:42:49.802216] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-23T21:42:50.163013] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T21:42:50.602189] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-23T21:42:51.402217] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-23T21:42:51.631038] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T21:42:51.651135] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T21:42:52.202261] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-23T21:42:53.002174] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-23T21:42:53.097634] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T21:42:53.181501] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T21:42:53.802172] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-23T21:42:53.825870] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T21:42:53.829491] [INFO ] [REMOTE ] TRC: Full fetch complete (22163 records). [2025-09-23T21:42:53.829572] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-23T21:42:54.233248] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-23T21:42:54.233327] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-23T21:42:54.233800] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-23T21:42:54.233860] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-23T21:42:54.234486] [DEBUG] [LOCAL ] TRC: Trimmed 22163 records to 16061 (keeping 200 days of data) [2025-09-23T21:42:54.338896] [DEBUG] [LOCAL ] TRC: Primary data saved (16061 records). [2025-09-23T21:42:54.339044] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-23T21:42:54.339134] [INFO ] [MAIN ] Update Progress: 2127/2372 symbols completed. TRC took 33.9s. Estimated remaining: 32m 35s. Rate: 7.5 symbols/min [2025-09-23T21:42:54.506573] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:42:54.559517] [DEBUG] [LOCAL ] TRNO: Loaded 44161 existing records from primary storage. [2025-09-23T21:42:54.559685] [INFO ] [MAIN ] TRNO: Loaded 44161 existing records. [2025-09-23T21:42:54.613807] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-23T21:42:54.742079] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:42:54.742336] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-23T21:42:54.742383] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-23T21:42:54.743448] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-23T21:42:54.743508] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-23T21:42:55.106378] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:42:55.162456] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T21:42:55.402191] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-23T21:42:56.202208] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-23T21:42:56.355304] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T21:42:56.961346] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T21:42:57.002257] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-23T21:42:57.802253] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-23T21:42:57.891511] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T21:42:58.225112] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T21:42:58.233996] [INFO ] [REMOTE ] TREX: Full fetch complete (70912 records). [2025-09-23T21:42:58.234174] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-23T21:42:58.607451] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-23T21:42:58.672278] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-23T21:42:58.672388] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-23T21:42:58.673717] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-23T21:42:58.673805] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-23T21:42:58.675516] [DEBUG] [LOCAL ] TREX: Trimmed 70912 records to 50009 (keeping 200 days of data) [2025-09-23T21:42:58.991908] [DEBUG] [LOCAL ] TREX: Primary data saved (50009 records). [2025-09-23T21:42:58.992236] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-23T21:42:58.992418] [INFO ] [MAIN ] Update Progress: 2128/2372 symbols completed. TREX took 32.9s. Estimated remaining: 32m 26s. Rate: 7.5 symbols/min [2025-09-23T21:42:59.170609] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:42:59.204881] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T21:42:59.259605] [DEBUG] [LOCAL ] TROX: Loaded 51770 existing records from primary storage. [2025-09-23T21:42:59.259792] [INFO ] [MAIN ] TROX: Loaded 51770 existing records. [2025-09-23T21:42:59.407379] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-23T21:42:59.438044] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:42:59.438333] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-23T21:42:59.438384] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-23T21:42:59.439489] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-23T21:42:59.439550] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-23T21:42:59.799112] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:43:00.207112] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-23T21:43:00.212733] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T21:43:01.002221] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-23T21:43:01.089593] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T21:43:01.802210] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-23T21:43:01.878698] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T21:43:02.602256] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-23T21:43:02.725732] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T21:43:02.831799] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T21:43:03.402259] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-23T21:43:04.064503] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T21:43:04.202232] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-23T21:43:04.788522] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T21:43:05.002204] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-23T21:43:05.674619] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T21:43:05.802198] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-23T21:43:06.201698] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T21:43:06.602180] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-23T21:43:06.961440] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T21:43:07.402223] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-23T21:43:08.202221] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-23T21:43:08.251317] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T21:43:09.002174] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-23T21:43:09.131936] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T21:43:09.313534] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T21:43:09.802243] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-23T21:43:10.602195] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-23T21:43:10.682688] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T21:43:11.073682] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T21:43:11.402248] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-23T21:43:11.758430] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T21:43:11.764498] [INFO ] [REMOTE ] TRN: Full fetch complete (52951 records). [2025-09-23T21:43:11.764694] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-23T21:43:12.149986] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-23T21:43:12.150073] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-23T21:43:12.150958] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-23T21:43:12.151019] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-23T21:43:12.152159] [DEBUG] [LOCAL ] TRN: Trimmed 52951 records to 37402 (keeping 200 days of data) [2025-09-23T21:43:12.209153] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-23T21:43:12.387261] [DEBUG] [LOCAL ] TRN: Primary data saved (37402 records). [2025-09-23T21:43:12.387420] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-23T21:43:12.387534] [INFO ] [MAIN ] Update Progress: 2129/2372 symbols completed. TRN took 28.0s. Estimated remaining: 32m 19s. Rate: 7.5 symbols/min [2025-09-23T21:43:12.558450] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:43:12.610921] [DEBUG] [LOCAL ] TRP: Loaded 52131 existing records from primary storage. [2025-09-23T21:43:12.611085] [INFO ] [MAIN ] TRP: Loaded 52131 existing records. [2025-09-23T21:43:12.794502] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:43:12.794968] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-23T21:43:12.795027] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-23T21:43:12.796213] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-23T21:43:12.796277] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-23T21:43:13.012266] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-23T21:43:13.185684] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:43:13.196172] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T21:43:13.377366] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T21:43:13.802187] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-23T21:43:13.841796] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T21:43:13.850307] [INFO ] [REMOTE ] TRGP: Full fetch complete (73515 records). [2025-09-23T21:43:13.850452] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-23T21:43:14.243408] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-23T21:43:14.243528] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-23T21:43:14.244596] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-23T21:43:14.244685] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-23T21:43:14.246166] [DEBUG] [LOCAL ] TRGP: Trimmed 73515 records to 50845 (keeping 200 days of data) [2025-09-23T21:43:14.573725] [DEBUG] [LOCAL ] TRGP: Primary data saved (50845 records). [2025-09-23T21:43:14.573864] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-23T21:43:14.573975] [INFO ] [MAIN ] Update Progress: 2130/2372 symbols completed. TRGP took 36.0s. Estimated remaining: 32m 10s. Rate: 7.5 symbols/min [2025-09-23T21:43:14.606005] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-23T21:43:14.751795] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:43:14.787402] [DEBUG] [LOCAL ] TRTX: Loaded 37353 existing records from primary storage. [2025-09-23T21:43:14.787565] [INFO ] [MAIN ] TRTX: Loaded 37353 existing records. [2025-09-23T21:43:14.970515] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:43:14.970840] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-23T21:43:14.970910] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-23T21:43:14.971888] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-23T21:43:14.971953] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-23T21:43:15.380241] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:43:15.402148] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-23T21:43:15.757963] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-23T21:43:16.202907] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-23T21:43:16.208541] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T21:43:16.460964] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T21:43:17.002216] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-23T21:43:17.554140] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T21:43:17.802233] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-23T21:43:18.602164] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-23T21:43:18.780381] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T21:43:19.070411] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T21:43:19.402261] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-23T21:43:20.202221] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-23T21:43:20.262322] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T21:43:21.002243] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-23T21:43:21.374122] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-23T21:43:21.747277] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T21:43:21.802161] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-23T21:43:22.366178] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T21:43:22.602201] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-23T21:43:22.948853] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T21:43:22.959099] [INFO ] [REMOTE ] TRNO: Full fetch complete (64112 records). [2025-09-23T21:43:22.959261] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-23T21:43:23.367858] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-23T21:43:23.367942] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-23T21:43:23.368957] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-23T21:43:23.369020] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-23T21:43:23.370315] [DEBUG] [LOCAL ] TRNO: Trimmed 64112 records to 44131 (keeping 200 days of data) [2025-09-23T21:43:23.428295] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-23T21:43:23.640100] [DEBUG] [LOCAL ] TRNO: Primary data saved (44131 records). [2025-09-23T21:43:23.640233] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-23T21:43:23.640314] [INFO ] [MAIN ] Update Progress: 2131/2372 symbols completed. TRNO took 29.3s. Estimated remaining: 32m 3s. Rate: 7.5 symbols/min [2025-09-23T21:43:23.817904] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:43:23.870564] [DEBUG] [LOCAL ] TRU: Loaded 51198 existing records from primary storage. [2025-09-23T21:43:23.870753] [INFO ] [MAIN ] TRU: Loaded 51198 existing records. [2025-09-23T21:43:24.062192] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:43:24.083455] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-23T21:43:24.083621] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-23T21:43:24.085089] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T21:43:24.093123] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-23T21:43:24.093431] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-23T21:43:24.207284] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-23T21:43:24.459740] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:43:25.002224] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-23T21:43:25.216870] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T21:43:25.802222] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-23T21:43:26.123408] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-23T21:43:26.602174] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-23T21:43:26.693951] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T21:43:27.402315] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-23T21:43:27.496137] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T21:43:27.581072] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T21:43:28.202206] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-23T21:43:29.002216] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-23T21:43:29.059666] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T21:43:29.169772] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T21:43:29.802259] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-23T21:43:30.602173] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-23T21:43:30.810004] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T21:43:31.194120] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T21:43:31.402175] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-23T21:43:32.202226] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-23T21:43:32.258190] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T21:43:32.660864] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T21:43:33.002214] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-23T21:43:33.619756] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T21:43:33.802216] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-23T21:43:34.550508] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T21:43:34.602184] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-23T21:43:35.153790] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T21:43:35.160485] [INFO ] [REMOTE ] TRTX: Full fetch complete (52820 records). [2025-09-23T21:43:35.160727] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-23T21:43:35.407328] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-23T21:43:35.578872] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-23T21:43:35.578961] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-23T21:43:35.580020] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-23T21:43:35.580083] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-23T21:43:35.581302] [DEBUG] [LOCAL ] TRTX: Trimmed 52820 records to 37337 (keeping 200 days of data) [2025-09-23T21:43:35.813983] [DEBUG] [LOCAL ] TRTX: Primary data saved (37337 records). [2025-09-23T21:43:35.814176] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-23T21:43:35.814300] [INFO ] [MAIN ] Update Progress: 2132/2372 symbols completed. TRTX took 21.2s. Estimated remaining: 31m 55s. Rate: 7.5 symbols/min [2025-09-23T21:43:36.010211] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:43:36.068801] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T21:43:36.096301] [DEBUG] [LOCAL ] TRV: Loaded 48275 existing records from primary storage. [2025-09-23T21:43:36.096445] [INFO ] [MAIN ] TRV: Loaded 48275 existing records. [2025-09-23T21:43:36.207591] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-23T21:43:36.277402] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:43:36.277623] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-23T21:43:36.277701] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-23T21:43:36.278777] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-23T21:43:36.278837] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-23T21:43:36.639148] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:43:36.971688] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T21:43:37.002210] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-23T21:43:37.802176] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-23T21:43:38.194882] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T21:43:38.413162] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T21:43:38.602275] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-23T21:43:39.402189] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-23T21:43:39.521932] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T21:43:39.531013] [INFO ] [REMOTE ] TROX: Full fetch complete (72536 records). [2025-09-23T21:43:39.531175] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-23T21:43:39.952232] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-23T21:43:39.952390] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-23T21:43:39.953625] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-23T21:43:39.953718] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-23T21:43:39.955363] [DEBUG] [LOCAL ] TROX: Trimmed 72536 records to 51774 (keeping 200 days of data) [2025-09-23T21:43:40.204556] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-23T21:43:40.274200] [DEBUG] [LOCAL ] TROX: Primary data saved (51774 records). [2025-09-23T21:43:40.274362] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-23T21:43:40.274566] [INFO ] [MAIN ] Update Progress: 2133/2372 symbols completed. TROX took 41.3s. Estimated remaining: 31m 47s. Rate: 7.5 symbols/min [2025-09-23T21:43:40.457572] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T21:43:40.486594] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:43:40.553527] [DEBUG] [LOCAL ] TS: Loaded 51670 existing records from primary storage. [2025-09-23T21:43:40.553707] [INFO ] [MAIN ] TS: Loaded 51670 existing records. [2025-09-23T21:43:40.760589] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:43:40.761157] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-23T21:43:40.761239] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-23T21:43:40.762534] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-23T21:43:40.762602] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-23T21:43:41.015073] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T21:43:41.013809] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-23T21:43:41.176674] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:43:41.789133] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T21:43:41.802154] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-23T21:43:42.602177] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-23T21:43:42.939004] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T21:43:43.407910] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-23T21:43:43.413302] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T21:43:43.995524] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T21:43:44.202235] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-23T21:43:44.823928] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T21:43:45.002211] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-23T21:43:45.802226] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-23T21:43:46.259863] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T21:43:46.602197] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-23T21:43:47.383204] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-23T21:43:47.402145] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-23T21:43:47.913601] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-23T21:43:48.202271] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-23T21:43:49.002223] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-23T21:43:49.378857] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-23T21:43:49.802302] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-23T21:43:49.961526] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T21:43:49.965358] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-23T21:43:50.602212] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-23T21:43:50.922964] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T21:43:51.402231] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-23T21:43:51.551814] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T21:43:51.560507] [INFO ] [REMOTE ] TRP: Full fetch complete (75566 records). [2025-09-23T21:43:51.560715] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-23T21:43:51.983720] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-23T21:43:51.983933] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-23T21:43:51.985186] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-23T21:43:51.985333] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-23T21:43:51.987312] [DEBUG] [LOCAL ] TRP: Trimmed 75566 records to 52132 (keeping 200 days of data) [2025-09-23T21:43:52.105723] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T21:43:52.207587] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-23T21:43:52.354625] [DEBUG] [LOCAL ] TRP: Primary data saved (52132 records). [2025-09-23T21:43:52.354820] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-23T21:43:52.354911] [INFO ] [MAIN ] Update Progress: 2134/2372 symbols completed. TRP took 40.0s. Estimated remaining: 31m 39s. Rate: 7.5 symbols/min [2025-09-23T21:43:52.529377] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:43:52.557822] [DEBUG] [LOCAL ] TSE: Loaded 28835 existing records from primary storage. [2025-09-23T21:43:52.557974] [INFO ] [MAIN ] TSE: Loaded 28835 existing records. [2025-09-23T21:43:52.761941] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:43:52.762237] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-23T21:43:52.762291] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-23T21:43:52.763432] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-23T21:43:52.763492] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-23T21:43:53.011112] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-23T21:43:53.134294] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:43:53.177318] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T21:43:53.802184] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-23T21:43:53.941941] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T21:43:54.410197] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T21:43:54.602150] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-23T21:43:55.402228] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-23T21:43:55.595387] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T21:43:56.003314] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T21:43:56.202193] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-23T21:43:56.330633] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T21:43:57.002198] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-23T21:43:57.634548] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T21:43:57.802203] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-23T21:43:58.129841] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T21:43:58.281700] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T21:43:58.292868] [INFO ] [REMOTE ] TRV: Full fetch complete (70073 records). [2025-09-23T21:43:58.293072] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-23T21:43:58.607294] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-23T21:43:58.689522] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-23T21:43:58.689631] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-23T21:43:58.690831] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-23T21:43:58.690903] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-23T21:43:58.694954] [DEBUG] [LOCAL ] TRV: Trimmed 70073 records to 48229 (keeping 200 days of data) [2025-09-23T21:43:58.998828] [DEBUG] [LOCAL ] TRV: Primary data saved (48229 records). [2025-09-23T21:43:58.998973] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-23T21:43:58.999060] [INFO ] [MAIN ] Update Progress: 2135/2372 symbols completed. TRV took 23.2s. Estimated remaining: 31m 31s. Rate: 7.5 symbols/min [2025-09-23T21:43:59.170524] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:43:59.179953] [DEBUG] [LOCAL ] TSI: Loaded 8336 existing records from primary storage. [2025-09-23T21:43:59.180047] [INFO ] [MAIN ] TSI: Loaded 8336 existing records. [2025-09-23T21:43:59.360005] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:43:59.360295] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-23T21:43:59.360342] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-23T21:43:59.360743] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-23T21:43:59.360807] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-23T21:43:59.408375] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-23T21:43:59.738420] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:44:00.202189] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-23T21:44:00.668962] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-23T21:44:01.002234] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-23T21:44:01.416863] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-23T21:44:01.428211] [INFO ] [REMOTE ] TRU: Full fetch complete (73033 records). [2025-09-23T21:44:01.428405] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-23T21:44:01.804695] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-23T21:44:01.853362] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-23T21:44:01.853459] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-23T21:44:01.854683] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-23T21:44:01.854788] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-23T21:44:01.860935] [DEBUG] [LOCAL ] TRU: Trimmed 73033 records to 51195 (keeping 200 days of data) [2025-09-23T21:44:02.202483] [DEBUG] [LOCAL ] TRU: Primary data saved (51195 records). [2025-09-23T21:44:02.202623] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-23T21:44:02.202831] [INFO ] [MAIN ] Update Progress: 2136/2372 symbols completed. TRU took 38.6s. Estimated remaining: 31m 23s. Rate: 7.5 symbols/min [2025-09-23T21:44:02.397639] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:44:02.419519] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-23T21:44:02.451739] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T21:44:02.467555] [DEBUG] [LOCAL ] TSLX: Loaded 35314 existing records from primary storage. [2025-09-23T21:44:02.467732] [INFO ] [MAIN ] TSLX: Loaded 35314 existing records. [2025-09-23T21:44:02.615363] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-23T21:44:02.672367] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:44:02.672713] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-23T21:44:02.672786] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-23T21:44:02.673823] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-23T21:44:02.673886] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-23T21:44:03.055474] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:44:03.402229] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-23T21:44:04.202189] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-23T21:44:04.435437] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-23T21:44:04.465170] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T21:44:04.838288] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T21:44:04.837900] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T21:44:05.002201] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-23T21:44:05.802209] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-23T21:44:06.327500] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T21:44:06.602164] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-23T21:44:06.764315] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T21:44:07.402196] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-23T21:44:07.826842] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T21:44:08.202214] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-23T21:44:08.930418] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T21:44:09.002177] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-23T21:44:09.353894] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T21:44:09.802222] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-23T21:44:10.296189] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T21:44:10.602200] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-23T21:44:11.242075] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T21:44:11.402201] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-23T21:44:12.109882] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T21:44:12.202187] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-23T21:44:12.936500] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T21:44:13.002195] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-23T21:44:13.534190] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T21:44:13.802202] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-23T21:44:14.237388] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T21:44:14.602190] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-23T21:44:15.402161] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-23T21:44:15.505213] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T21:44:15.514372] [INFO ] [REMOTE ] TS: Full fetch complete (74455 records). [2025-09-23T21:44:15.514543] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-23T21:44:15.660366] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T21:44:15.949535] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-23T21:44:15.949638] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-23T21:44:15.950786] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-23T21:44:15.950850] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-23T21:44:15.954062] [DEBUG] [LOCAL ] TS: Trimmed 74455 records to 51665 (keeping 200 days of data) [2025-09-23T21:44:16.202596] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-23T21:44:16.283696] [DEBUG] [LOCAL ] TS: Primary data saved (51665 records). [2025-09-23T21:44:16.283842] [INFO ] [MAIN ] TS: Full history saved. [2025-09-23T21:44:16.284017] [INFO ] [MAIN ] Update Progress: 2137/2372 symbols completed. TS took 36.0s. Estimated remaining: 31m 15s. Rate: 7.5 symbols/min [2025-09-23T21:44:16.457661] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:44:16.526110] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-23T21:44:16.526255] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-09-23T21:44:16.694396] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T21:44:16.751108] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:44:16.751584] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-23T21:44:16.751671] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-23T21:44:16.753270] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-23T21:44:16.753334] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-23T21:44:17.004773] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-23T21:44:17.044343] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T21:44:17.129458] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:44:17.802218] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-23T21:44:18.550512] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T21:44:18.602152] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-23T21:44:18.668215] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T21:44:19.402195] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-23T21:44:19.961934] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T21:44:20.202209] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-23T21:44:21.002208] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-23T21:44:21.359544] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T21:44:21.365721] [INFO ] [REMOTE ] TSLX: Full fetch complete (48891 records). [2025-09-23T21:44:21.365825] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-23T21:44:21.718211] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T21:44:21.792728] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-23T21:44:21.792816] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-23T21:44:21.793850] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-23T21:44:21.793912] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-23T21:44:21.795356] [DEBUG] [LOCAL ] TSLX: Trimmed 48891 records to 35229 (keeping 200 days of data) [2025-09-23T21:44:21.853625] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-23T21:44:22.024218] [DEBUG] [LOCAL ] TSLX: Primary data saved (35229 records). [2025-09-23T21:44:22.024359] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-23T21:44:22.024467] [INFO ] [MAIN ] Update Progress: 2138/2372 symbols completed. TSLX took 19.8s. Estimated remaining: 31m 7s. Rate: 7.5 symbols/min [2025-09-23T21:44:22.197631] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:44:22.231169] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-23T21:44:22.292365] [DEBUG] [LOCAL ] TSN: Loaded 52850 existing records from primary storage. [2025-09-23T21:44:22.292540] [INFO ] [MAIN ] TSN: Loaded 52850 existing records. [2025-09-23T21:44:22.482426] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:44:22.482746] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-23T21:44:22.482844] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-23T21:44:22.484174] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-23T21:44:22.484258] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-23T21:44:22.607311] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-23T21:44:22.853702] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:44:23.160878] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T21:44:23.402206] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-23T21:44:23.489502] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T21:44:24.202286] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-23T21:44:25.002233] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-23T21:44:25.221807] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T21:44:25.802215] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-23T21:44:26.069968] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T21:44:26.074442] [INFO ] [REMOTE ] TSE: Full fetch complete (41911 records). [2025-09-23T21:44:26.074526] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-23T21:44:26.451317] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-23T21:44:26.451395] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-23T21:44:26.452272] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-23T21:44:26.452333] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-23T21:44:26.453243] [DEBUG] [LOCAL ] TSE: Trimmed 41911 records to 28764 (keeping 200 days of data) [2025-09-23T21:44:26.607924] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-23T21:44:26.641386] [DEBUG] [LOCAL ] TSE: Primary data saved (28764 records). [2025-09-23T21:44:26.641521] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-23T21:44:26.641635] [INFO ] [MAIN ] Update Progress: 2139/2372 symbols completed. TSE took 34.3s. Estimated remaining: 30m 59s. Rate: 7.5 symbols/min [2025-09-23T21:44:26.825879] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:44:26.841169] [DEBUG] [LOCAL ] TSQ: Loaded 12128 existing records from primary storage. [2025-09-23T21:44:26.841319] [INFO ] [MAIN ] TSQ: Loaded 12128 existing records. [2025-09-23T21:44:27.033472] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:44:27.033943] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-23T21:44:27.034053] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-23T21:44:27.047601] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-23T21:44:27.071346] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-23T21:44:27.120093] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-09-23T21:44:27.404603] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-23T21:44:27.461787] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:44:27.631196] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T21:44:27.637841] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T21:44:28.202211] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-23T21:44:29.002302] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-23T21:44:29.802184] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-23T21:44:29.909850] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T21:44:30.025619] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T21:44:30.031418] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-23T21:44:30.596683] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T21:44:30.602132] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-23T21:44:31.402239] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-23T21:44:31.504753] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T21:44:32.202233] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-23T21:44:32.928983] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T21:44:32.930947] [INFO ] [REMOTE ] TSI: Full fetch complete (13284 records). [2025-09-23T21:44:32.931019] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-23T21:44:33.007912] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-23T21:44:33.325227] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-23T21:44:33.325314] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-23T21:44:33.325707] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-23T21:44:33.325771] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-23T21:44:33.326321] [DEBUG] [LOCAL ] TSI: Trimmed 13284 records to 8206 (keeping 200 days of data) [2025-09-23T21:44:33.379660] [DEBUG] [LOCAL ] TSI: Primary data saved (8206 records). [2025-09-23T21:44:33.379791] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-23T21:44:33.379892] [INFO ] [MAIN ] Update Progress: 2140/2372 symbols completed. TSI took 34.4s. Estimated remaining: 30m 51s. Rate: 7.5 symbols/min [2025-09-23T21:44:33.565700] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:44:33.630770] [DEBUG] [LOCAL ] TT: Loaded 47955 existing records from primary storage. [2025-09-23T21:44:33.630937] [INFO ] [MAIN ] TT: Loaded 47955 existing records. [2025-09-23T21:44:33.739694] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T21:44:33.802423] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-23T21:44:33.825760] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:44:33.826251] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-23T21:44:33.826381] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-23T21:44:33.827850] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-23T21:44:33.827911] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-23T21:44:34.197291] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:44:34.227348] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-23T21:44:34.602171] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-23T21:44:34.644408] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T21:44:35.402200] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-23T21:44:36.190340] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T21:44:36.202183] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-23T21:44:36.246392] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T21:44:37.002214] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-23T21:44:37.212918] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T21:44:37.802210] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-23T21:44:38.602189] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-23T21:44:38.760445] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T21:44:39.219861] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T21:44:39.402220] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-23T21:44:39.654349] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T21:44:40.202209] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-23T21:44:41.002173] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-23T21:44:41.047451] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T21:44:41.198748] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T21:44:41.802215] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-23T21:44:42.602288] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-23T21:44:42.851142] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T21:44:43.402274] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-23T21:44:44.202265] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-23T21:44:44.436179] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-23T21:44:44.561943] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-23T21:44:44.746359] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T21:44:45.002148] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-23T21:44:45.484554] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-23T21:44:45.802281] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-23T21:44:46.528430] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T21:44:46.530517] [INFO ] [REMOTE ] TSQ: Full fetch complete (16724 records). [2025-09-23T21:44:46.530590] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-23T21:44:46.607316] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-23T21:44:46.892298] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-23T21:44:46.892376] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-23T21:44:46.892795] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-23T21:44:46.892857] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-23T21:44:46.893961] [DEBUG] [LOCAL ] TSQ: Trimmed 16724 records to 12114 (keeping 200 days of data) [2025-09-23T21:44:46.964187] [DEBUG] [LOCAL ] TSQ: Primary data saved (12114 records). [2025-09-23T21:44:46.964332] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-23T21:44:46.964445] [INFO ] [MAIN ] Update Progress: 2141/2372 symbols completed. TSQ took 20.3s. Estimated remaining: 30m 43s. Rate: 7.5 symbols/min [2025-09-23T21:44:47.137507] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:44:47.137735] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-23T21:44:47.137781] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-23T21:44:47.137921] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-23T21:44:47.137965] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-23T21:44:47.138009] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-23T21:44:47.138040] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-23T21:44:47.414845] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-23T21:44:47.525414] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:44:47.764138] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-23T21:44:48.037053] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T21:44:48.202215] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-23T21:44:48.409711] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:44:48.410054] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-23T21:44:49.002201] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-23T21:44:49.208797] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:44:49.209198] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-23T21:44:49.391611] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T21:44:49.802226] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-23T21:44:50.602200] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-23T21:44:51.402242] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-23T21:44:51.811278] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-23T21:44:52.202173] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-23T21:44:52.484886] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T21:44:53.002274] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-23T21:44:53.707485] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-23T21:44:53.802210] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-23T21:44:54.157793] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T21:44:54.276152] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T21:44:54.585394] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T21:44:54.602168] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-23T21:44:55.402196] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-23T21:44:56.048136] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T21:44:56.202200] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-23T21:44:57.002198] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-23T21:44:57.802212] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-23T21:44:57.928167] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T21:44:57.939111] [INFO ] [REMOTE ] TSN: Full fetch complete (76236 records). [2025-09-23T21:44:57.939267] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-23T21:44:58.277489] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T21:44:58.390802] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-23T21:44:58.390947] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-23T21:44:58.392365] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-23T21:44:58.409120] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-23T21:44:58.426608] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-23T21:44:58.438274] [DEBUG] [LOCAL ] TSN: Trimmed 76236 records to 52872 (keeping 200 days of data) [2025-09-23T21:44:58.623188] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-23T21:44:58.776740] [DEBUG] [LOCAL ] TSN: Primary data saved (52872 records). [2025-09-23T21:44:58.776929] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-23T21:44:58.777040] [INFO ] [MAIN ] Update Progress: 2142/2372 symbols completed. TSN took 36.8s. Estimated remaining: 30m 36s. Rate: 7.5 symbols/min [2025-09-23T21:44:58.944762] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:44:58.986579] [DEBUG] [LOCAL ] TTC: Loaded 42753 existing records from primary storage. [2025-09-23T21:44:58.986800] [INFO ] [MAIN ] TTC: Loaded 42753 existing records. [2025-09-23T21:44:59.171028] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:44:59.171277] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-23T21:44:59.171326] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-23T21:44:59.172480] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-23T21:44:59.172543] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-23T21:44:59.406987] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-23T21:44:59.551704] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:44:59.665408] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T21:45:00.202220] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-23T21:45:00.514749] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T21:45:01.002185] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-23T21:45:01.370129] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-23T21:45:01.585062] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T21:45:01.802242] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-23T21:45:02.253004] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T21:45:02.602205] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-23T21:45:03.402215] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-23T21:45:04.202194] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-23T21:45:05.178204] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-23T21:45:05.186229] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-23T21:45:05.598690] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (3.80 seconds). [2025-09-23T21:45:05.802242] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-23T21:45:06.140965] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-23T21:45:06.503781] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T21:45:06.602225] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-23T21:45:07.049107] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T21:45:07.059761] [INFO ] [REMOTE ] TT: Full fetch complete (69795 records). [2025-09-23T21:45:07.059938] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-23T21:45:07.409408] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-23T21:45:07.509123] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-23T21:45:07.509506] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-23T21:45:07.510664] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-23T21:45:07.519382] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-23T21:45:07.541504] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T21:45:07.541964] [DEBUG] [LOCAL ] TT: Trimmed 69795 records to 47893 (keeping 200 days of data) [2025-09-23T21:45:07.692400] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (3.49 seconds). [2025-09-23T21:45:07.714347] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-09-23T21:45:07.718105] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-23T21:45:08.214095] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-23T21:45:08.297974] [DEBUG] [LOCAL ] TT: Primary data saved (47893 records). [2025-09-23T21:45:08.323676] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-23T21:45:08.323437] [INFO ] [MAIN ] TT: Full history saved. [2025-09-23T21:45:08.323844] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-23T21:45:08.323998] [INFO ] [MAIN ] Update Progress: 2143/2372 symbols completed. TT took 34.9s. Estimated remaining: 30m 28s. Rate: 7.5 symbols/min [2025-09-23T21:45:08.325248] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-23T21:45:08.325351] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-23T21:45:08.441457] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-09-23T21:45:08.612010] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:45:08.638488] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T21:45:08.644781] [INFO ] [REMOTE ] TTAM: Full fetch complete (32712 records). [2025-09-23T21:45:08.645355] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-23T21:45:08.876055] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 157 unique days, need 200 days [2025-09-23T21:45:08.878181] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:45:08.878774] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:45:08.879854] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-23T21:45:08.881265] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-23T21:45:08.881872] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-23T21:45:08.882482] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-23T21:45:08.882855] [INFO ] [MAIN ] Update Progress: 2144/2372 symbols completed. TTAM took 21.9s. Estimated remaining: 30m 19s. Rate: 7.5 symbols/min [2025-09-23T21:45:08.881165] [DEBUG] [LOCAL ] TTE: Loaded 51653 existing records from primary storage. [2025-09-23T21:45:08.923408] [INFO ] [MAIN ] TTE: Loaded 51653 existing records. [2025-09-23T21:45:09.218839] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:45:09.275886] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:45:09.281832] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-23T21:45:09.282035] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-23T21:45:09.336833] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-23T21:45:09.346392] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-23T21:45:09.614218] [DEBUG] [LOCAL ] TTI: Loaded 45260 existing records from primary storage. [2025-09-23T21:45:09.618831] [INFO ] [MAIN ] TTI: Loaded 45260 existing records. [2025-09-23T21:45:09.980271] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:45:10.004374] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-23T21:45:10.004519] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-23T21:45:10.030081] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:45:10.031141] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-23T21:45:10.032958] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-23T21:45:10.033905] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-23T21:45:10.385086] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T21:45:10.443638] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-23T21:45:10.562056] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:45:10.571602] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-09-23T21:45:10.572039] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-23T21:45:10.574695] [INFO ] [MAIN ] Update Progress: 2145/2372 symbols completed. TSM took 54.3s. Estimated remaining: 30m 10s. Rate: 7.5 symbols/min [2025-09-23T21:45:10.607269] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-23T21:45:10.745192] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:45:10.804855] [DEBUG] [LOCAL ] TU: Loaded 49920 existing records from primary storage. [2025-09-23T21:45:10.805008] [INFO ] [MAIN ] TU: Loaded 49920 existing records. [2025-09-23T21:45:10.982437] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:45:10.982732] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-23T21:45:10.982795] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-23T21:45:10.983907] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-23T21:45:10.983967] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-23T21:45:11.340265] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:45:11.402192] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-23T21:45:11.990399] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-23T21:45:12.055337] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T21:45:12.153576] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T21:45:12.202174] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-23T21:45:12.821266] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T21:45:13.002186] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-23T21:45:13.740536] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T21:45:13.802169] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-23T21:45:14.217705] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T21:45:14.602179] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-23T21:45:15.311475] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T21:45:15.402145] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-23T21:45:15.935397] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T21:45:16.202215] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-23T21:45:16.971930] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T21:45:17.002146] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-23T21:45:17.534497] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T21:45:17.802241] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-23T21:45:18.312716] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T21:45:18.602218] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-23T21:45:19.258358] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T21:45:19.402163] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-23T21:45:20.213518] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-23T21:45:20.218900] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T21:45:20.909904] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T21:45:21.002182] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-23T21:45:21.802207] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-23T21:45:22.174859] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-23T21:45:22.602205] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-23T21:45:23.402194] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-23T21:45:23.768302] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-09-23T21:45:23.874884] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-23T21:45:23.881806] [INFO ] [REMOTE ] TTC: Full fetch complete (62185 records). [2025-09-23T21:45:23.881932] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-23T21:45:24.209140] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-23T21:45:24.263503] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-23T21:45:24.263605] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-23T21:45:24.264605] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-23T21:45:24.264692] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-23T21:45:24.266329] [DEBUG] [LOCAL ] TTC: Trimmed 62185 records to 42609 (keeping 200 days of data) [2025-09-23T21:45:24.542393] [DEBUG] [LOCAL ] TTC: Primary data saved (42609 records). [2025-09-23T21:45:24.542529] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-23T21:45:24.542615] [INFO ] [MAIN ] Update Progress: 2146/2372 symbols completed. TTC took 25.8s. Estimated remaining: 30m 3s. Rate: 7.5 symbols/min [2025-09-23T21:45:24.719427] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:45:24.763899] [DEBUG] [LOCAL ] TUYA: Loaded 46618 existing records from primary storage. [2025-09-23T21:45:24.764143] [INFO ] [MAIN ] TUYA: Loaded 46618 existing records. [2025-09-23T21:45:24.880372] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T21:45:25.014390] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-23T21:45:25.014301] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:45:25.015526] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-23T21:45:25.015594] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-23T21:45:25.017386] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-23T21:45:25.017537] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-23T21:45:25.027532] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-23T21:45:25.380298] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:45:25.627204] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T21:45:25.802202] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-23T21:45:26.602168] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-23T21:45:26.689171] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T21:45:27.278326] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T21:45:27.402219] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-23T21:45:28.202179] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-23T21:45:28.406950] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T21:45:28.954627] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T21:45:29.002168] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-23T21:45:29.802239] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-23T21:45:30.170881] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T21:45:30.516533] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T21:45:30.524085] [INFO ] [REMOTE ] TTI: Full fetch complete (64782 records). [2025-09-23T21:45:30.524208] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-23T21:45:30.607346] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-23T21:45:30.927749] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-23T21:45:30.927856] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-23T21:45:30.928894] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-23T21:45:30.928956] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-23T21:45:30.930270] [DEBUG] [LOCAL ] TTI: Trimmed 64782 records to 45312 (keeping 200 days of data) [2025-09-23T21:45:31.195274] [DEBUG] [LOCAL ] TTI: Primary data saved (45312 records). [2025-09-23T21:45:31.195411] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-23T21:45:31.195514] [INFO ] [MAIN ] Update Progress: 2147/2372 symbols completed. TTI took 22.3s. Estimated remaining: 29m 55s. Rate: 7.5 symbols/min [2025-09-23T21:45:31.371777] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:45:31.404073] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-23T21:45:31.424763] [DEBUG] [LOCAL ] TV: Loaded 43023 existing records from primary storage. [2025-09-23T21:45:31.424999] [INFO ] [MAIN ] TV: Loaded 43023 existing records. [2025-09-23T21:45:31.608494] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:45:31.609147] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-23T21:45:31.609212] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-23T21:45:31.619810] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-23T21:45:31.638907] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-23T21:45:31.718827] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T21:45:32.041196] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:45:32.037457] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T21:45:32.202151] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-23T21:45:33.002254] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-23T21:45:33.387317] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T21:45:33.800285] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T21:45:33.803635] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-23T21:45:34.286193] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T21:45:34.602246] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-23T21:45:35.402226] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-23T21:45:35.734488] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T21:45:36.202239] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-23T21:45:36.239273] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T21:45:36.839823] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T21:45:37.002167] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-23T21:45:37.802171] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-23T21:45:38.068340] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T21:45:38.602191] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-23T21:45:38.729216] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T21:45:39.056271] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T21:45:39.402244] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-23T21:45:40.202169] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-23T21:45:40.338482] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T21:45:41.002198] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-23T21:45:41.347632] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T21:45:41.705896] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T21:45:41.802206] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-23T21:45:42.360441] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T21:45:42.602260] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-23T21:45:43.351533] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T21:45:43.402201] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-23T21:45:44.202230] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-23T21:45:44.313853] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T21:45:45.002222] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-23T21:45:45.126170] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T21:45:45.134553] [INFO ] [REMOTE ] TTE: Full fetch complete (75086 records). [2025-09-23T21:45:45.134736] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-23T21:45:45.535065] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-23T21:45:45.535208] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-23T21:45:45.536369] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-23T21:45:45.536557] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-23T21:45:45.563171] [DEBUG] [LOCAL ] TTE: Trimmed 75086 records to 51652 (keeping 200 days of data) [2025-09-23T21:45:45.564735] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T21:45:45.802414] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-23T21:45:45.893414] [DEBUG] [LOCAL ] TTE: Primary data saved (51652 records). [2025-09-23T21:45:45.893562] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-23T21:45:45.893676] [INFO ] [MAIN ] Update Progress: 2148/2372 symbols completed. TTE took 37.6s. Estimated remaining: 29m 48s. Rate: 7.5 symbols/min [2025-09-23T21:45:46.068760] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:45:46.076160] [DEBUG] [LOCAL ] TVC: Loaded 3510 existing records from primary storage. [2025-09-23T21:45:46.076252] [INFO ] [MAIN ] TVC: Loaded 3510 existing records. [2025-09-23T21:45:46.259087] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:45:46.259581] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-23T21:45:46.259709] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-23T21:45:46.260109] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-23T21:45:46.260255] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-23T21:45:46.385223] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T21:45:46.443170] [INFO ] [REMOTE ] TU: Full fetch complete (72947 records). [2025-09-23T21:45:46.452472] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-23T21:45:46.607060] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-23T21:45:46.818995] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:45:47.053636] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-23T21:45:47.053756] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-23T21:45:47.055067] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-23T21:45:47.055129] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-23T21:45:47.056959] [DEBUG] [LOCAL ] TU: Trimmed 72947 records to 49920 (keeping 200 days of data) [2025-09-23T21:45:47.366062] [DEBUG] [LOCAL ] TU: Primary data saved (49920 records). [2025-09-23T21:45:47.366197] [INFO ] [MAIN ] TU: Full history saved. [2025-09-23T21:45:47.366298] [INFO ] [MAIN ] Update Progress: 2149/2372 symbols completed. TU took 36.8s. Estimated remaining: 29m 39s. Rate: 7.5 symbols/min [2025-09-23T21:45:47.410202] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-23T21:45:47.576792] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:45:47.578525] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T21:45:47.593343] [DEBUG] [LOCAL ] TVE: Loaded 2815 existing records from primary storage. [2025-09-23T21:45:47.593436] [INFO ] [MAIN ] TVE: Loaded 2815 existing records. [2025-09-23T21:45:47.769130] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:45:47.769411] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-23T21:45:47.769463] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-23T21:45:47.769697] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-23T21:45:47.769766] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-23T21:45:48.133025] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:45:48.202709] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-23T21:45:48.202625] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T21:45:48.373502] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T21:45:48.674601] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-23T21:45:49.002234] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-23T21:45:49.648929] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T21:45:49.802223] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-23T21:45:50.389871] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T21:45:50.602204] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-23T21:45:51.018696] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T21:45:51.402194] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-23T21:45:52.202258] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-23T21:45:52.773084] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T21:45:53.002210] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-23T21:45:53.087086] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T21:45:53.597637] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T21:45:53.802260] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-23T21:45:54.602276] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-23T21:45:55.183548] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T21:45:55.402207] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-23T21:45:55.446345] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T21:45:56.202207] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-23T21:45:57.002205] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-23T21:45:57.100456] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T21:45:57.618280] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T21:45:57.811758] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-23T21:45:57.813204] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T21:45:57.825210] [INFO ] [REMOTE ] TUYA: Full fetch complete (65889 records). [2025-09-23T21:45:57.825406] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-23T21:45:58.241201] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-23T21:45:58.241367] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-23T21:45:58.242658] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-23T21:45:58.242767] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-23T21:45:58.246147] [DEBUG] [LOCAL ] TUYA: Trimmed 65889 records to 46578 (keeping 200 days of data) [2025-09-23T21:45:58.521299] [DEBUG] [LOCAL ] TUYA: Primary data saved (46578 records). [2025-09-23T21:45:58.521447] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-23T21:45:58.521663] [INFO ] [MAIN ] Update Progress: 2150/2372 symbols completed. TUYA took 34.0s. Estimated remaining: 29m 31s. Rate: 7.5 symbols/min [2025-09-23T21:45:58.607423] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-23T21:45:58.698742] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:45:58.733896] [DEBUG] [LOCAL ] TWI: Loaded 34588 existing records from primary storage. [2025-09-23T21:45:58.734045] [INFO ] [MAIN ] TWI: Loaded 34588 existing records. [2025-09-23T21:45:58.926341] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:45:58.926878] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-23T21:45:58.926990] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-23T21:45:58.928110] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-23T21:45:58.928188] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-23T21:45:59.100070] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T21:45:59.330363] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T21:45:59.335983] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:45:59.402157] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-23T21:45:59.849399] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T21:46:00.202201] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-23T21:46:01.002218] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-23T21:46:01.576278] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T21:46:01.802177] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-23T21:46:01.844708] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T21:46:02.395792] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T21:46:02.602224] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-23T21:46:03.402235] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-23T21:46:04.174383] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T21:46:04.202223] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-23T21:46:04.546351] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T21:46:04.840014] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T21:46:05.002224] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-23T21:46:05.462788] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T21:46:05.802198] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-23T21:46:06.602227] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-23T21:46:07.217089] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T21:46:07.239906] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T21:46:07.402199] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-23T21:46:08.202188] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-23T21:46:08.814033] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T21:46:09.002682] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-23T21:46:09.006498] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T21:46:09.495352] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T21:46:09.496495] [INFO ] [REMOTE ] TVE: Full fetch complete (4355 records). [2025-09-23T21:46:09.496588] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-23T21:46:09.811967] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-23T21:46:09.855394] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-23T21:46:09.855472] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-23T21:46:09.855686] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-23T21:46:09.855747] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-23T21:46:09.856158] [DEBUG] [LOCAL ] TVE: Trimmed 4355 records to 2795 (keeping 200 days of data) [2025-09-23T21:46:09.876587] [DEBUG] [LOCAL ] TVE: Primary data saved (2795 records). [2025-09-23T21:46:09.876732] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-23T21:46:09.876845] [INFO ] [MAIN ] Update Progress: 2151/2372 symbols completed. TVE took 22.5s. Estimated remaining: 29m 24s. Rate: 7.5 symbols/min [2025-09-23T21:46:10.059947] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:46:10.131952] [DEBUG] [LOCAL ] TWLO: Loaded 52724 existing records from primary storage. [2025-09-23T21:46:10.132121] [INFO ] [MAIN ] TWLO: Loaded 52724 existing records. [2025-09-23T21:46:10.308393] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:46:10.308744] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-23T21:46:10.308805] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-23T21:46:10.310233] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-23T21:46:10.310293] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-23T21:46:10.607317] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-23T21:46:10.732316] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:46:11.181063] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T21:46:11.389754] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T21:46:11.402134] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-23T21:46:12.202191] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-23T21:46:12.928232] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T21:46:12.935205] [INFO ] [REMOTE ] TV: Full fetch complete (62516 records). [2025-09-23T21:46:12.935334] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-23T21:46:13.010891] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-23T21:46:13.332952] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-23T21:46:13.333095] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-23T21:46:13.334085] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-23T21:46:13.334149] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-23T21:46:13.338260] [DEBUG] [LOCAL ] TV: Trimmed 62516 records to 43003 (keeping 200 days of data) [2025-09-23T21:46:13.563999] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T21:46:13.567265] [INFO ] [REMOTE ] TVC: Full fetch complete (5681 records). [2025-09-23T21:46:13.567597] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-23T21:46:13.804800] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-23T21:46:13.914122] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T21:46:14.004057] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-23T21:46:14.005608] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-23T21:46:14.006474] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-23T21:46:14.006905] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-23T21:46:14.010113] [DEBUG] [LOCAL ] TVC: Trimmed 5681 records to 3471 (keeping 200 days of data) [2025-09-23T21:46:14.049884] [DEBUG] [LOCAL ] TVC: Primary data saved (3471 records). [2025-09-23T21:46:14.056433] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-23T21:46:14.057988] [INFO ] [MAIN ] Update Progress: 2152/2372 symbols completed. TVC took 28.2s. Estimated remaining: 29m 15s. Rate: 7.5 symbols/min [2025-09-23T21:46:14.166551] [DEBUG] [LOCAL ] TV: Primary data saved (43003 records). [2025-09-23T21:46:14.166818] [INFO ] [MAIN ] TV: Full history saved. [2025-09-23T21:46:14.167344] [INFO ] [MAIN ] Update Progress: 2153/2372 symbols completed. TV took 43.0s. Estimated remaining: 29m 7s. Rate: 7.5 symbols/min [2025-09-23T21:46:14.370439] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:46:14.442581] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-23T21:46:14.462959] [INFO ] [MAIN ] TWN: Loaded 3250 existing records. [2025-09-23T21:46:14.464126] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:46:14.608746] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-23T21:46:14.653102] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:46:14.654359] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-23T21:46:14.654467] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-23T21:46:14.654844] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-23T21:46:14.654917] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-23T21:46:14.948437] [DEBUG] [LOCAL ] TWO: Loaded 48247 existing records from primary storage. [2025-09-23T21:46:14.970058] [INFO ] [MAIN ] TWO: Loaded 48247 existing records. [2025-09-23T21:46:15.233004] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:46:15.254542] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:46:15.254791] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-23T21:46:15.254847] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-23T21:46:15.255994] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-23T21:46:15.256057] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-23T21:46:15.407292] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-23T21:46:15.631422] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:46:15.902617] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-23T21:46:16.171794] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T21:46:16.194245] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T21:46:16.202156] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-23T21:46:16.771461] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T21:46:17.002207] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-23T21:46:17.802196] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-23T21:46:18.602199] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-23T21:46:19.151210] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-23T21:46:19.399709] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T21:46:19.403543] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-23T21:46:19.661129] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T21:46:20.202210] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-23T21:46:21.002201] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-23T21:46:21.135411] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T21:46:21.416685] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T21:46:21.796246] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T21:46:21.803869] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-23T21:46:22.485122] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T21:46:22.602246] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-23T21:46:23.200509] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T21:46:23.402213] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-23T21:46:24.202194] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-23T21:46:24.899012] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T21:46:25.002182] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-23T21:46:25.802184] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-23T21:46:25.959265] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T21:46:26.269154] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T21:46:26.274398] [INFO ] [REMOTE ] TWI: Full fetch complete (53339 records). [2025-09-23T21:46:26.274511] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-23T21:46:26.393969] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T21:46:26.607340] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-23T21:46:26.681884] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-23T21:46:26.681985] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-23T21:46:26.683235] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-23T21:46:26.683305] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-23T21:46:26.687046] [DEBUG] [LOCAL ] TWI: Trimmed 53339 records to 34560 (keeping 200 days of data) [2025-09-23T21:46:26.884911] [DEBUG] [LOCAL ] TWI: Primary data saved (34560 records). [2025-09-23T21:46:26.885055] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-23T21:46:26.885141] [INFO ] [MAIN ] Update Progress: 2154/2372 symbols completed. TWI took 28.4s. Estimated remaining: 28m 59s. Rate: 7.5 symbols/min [2025-09-23T21:46:27.053826] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:46:27.054029] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-23T21:46:27.054083] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-23T21:46:27.054257] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-23T21:46:27.054300] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-23T21:46:27.054341] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-23T21:46:27.054373] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-23T21:46:27.402800] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-23T21:46:27.423089] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:46:28.102780] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T21:46:28.202227] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-23T21:46:28.399693] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:46:28.400051] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-23T21:46:28.642578] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-23T21:46:29.002197] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-23T21:46:29.783098] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T21:46:29.802196] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-23T21:46:30.602210] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-23T21:46:31.402223] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-23T21:46:31.605865] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:46:31.606231] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-23T21:46:31.799358] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T21:46:32.112001] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T21:46:32.202204] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-23T21:46:32.401500] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:46:32.401855] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-23T21:46:33.002193] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-23T21:46:33.802191] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-23T21:46:34.602216] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-23T21:46:34.913072] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:46:34.913402] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-23T21:46:34.954359] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-23T21:46:35.035051] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T21:46:35.402199] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-23T21:46:36.202259] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-23T21:46:36.647930] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T21:46:37.002166] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-23T21:46:37.204113] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:46:37.204487] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-23T21:46:37.362836] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T21:46:37.802196] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-23T21:46:38.592821] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T21:46:38.602136] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-23T21:46:39.154465] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-23T21:46:39.402203] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-23T21:46:40.202201] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-23T21:46:40.647303] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T21:46:41.002198] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-23T21:46:41.385150] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T21:46:41.802217] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-23T21:46:42.602255] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-23T21:46:42.791534] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T21:46:43.269939] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T21:46:43.402204] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-23T21:46:44.077997] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-23T21:46:44.202193] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-23T21:46:44.849025] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T21:46:44.850182] [INFO ] [REMOTE ] TWN: Full fetch complete (5342 records). [2025-09-23T21:46:44.850254] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-23T21:46:45.007471] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-23T21:46:45.264781] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-23T21:46:45.265013] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-23T21:46:45.265333] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-23T21:46:45.265452] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-23T21:46:45.266841] [DEBUG] [LOCAL ] TWN: Trimmed 5342 records to 3226 (keeping 200 days of data) [2025-09-23T21:46:45.326003] [DEBUG] [LOCAL ] TWN: Primary data saved (3226 records). [2025-09-23T21:46:45.326719] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-23T21:46:45.330132] [INFO ] [MAIN ] Update Progress: 2155/2372 symbols completed. TWN took 31.3s. Estimated remaining: 28m 52s. Rate: 7.5 symbols/min [2025-09-23T21:46:45.329915] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T21:46:45.534893] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:46:45.564664] [DEBUG] [LOCAL ] TX: Loaded 23768 existing records from primary storage. [2025-09-23T21:46:45.564821] [INFO ] [MAIN ] TX: Loaded 23768 existing records. [2025-09-23T21:46:45.685386] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T21:46:45.713256] [INFO ] [REMOTE ] TWOD: Full fetch complete (4245 records). [2025-09-23T21:46:45.718468] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-23T21:46:45.807344] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-23T21:46:45.878985] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:46:45.880241] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-23T21:46:45.880332] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-23T21:46:45.886155] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-23T21:46:45.907376] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-23T21:46:46.046901] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 89 unique days, need 200 days [2025-09-23T21:46:46.064483] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:46:46.072874] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:46:46.075496] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-23T21:46:46.075579] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-23T21:46:46.076004] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-23T21:46:46.086672] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-23T21:46:46.091907] [INFO ] [MAIN ] Update Progress: 2156/2372 symbols completed. TWOD took 19.2s. Estimated remaining: 28m 43s. Rate: 7.5 symbols/min [2025-09-23T21:46:46.534621] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:46:46.609759] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-23T21:46:46.665199] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:46:46.743683] [DEBUG] [LOCAL ] TXNM: Loaded 44034 existing records from primary storage. [2025-09-23T21:46:46.743917] [INFO ] [MAIN ] TXNM: Loaded 44034 existing records. [2025-09-23T21:46:47.022095] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:46:47.022473] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-23T21:46:47.022542] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-23T21:46:47.023897] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-23T21:46:47.023981] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-23T21:46:47.407454] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-23T21:46:47.617905] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:46:47.650289] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T21:46:47.659304] [INFO ] [REMOTE ] TWLO: Full fetch complete (76444 records). [2025-09-23T21:46:47.659455] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-23T21:46:48.056615] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-23T21:46:48.056748] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-23T21:46:48.057932] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-23T21:46:48.058037] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-23T21:46:48.059576] [DEBUG] [LOCAL ] TWLO: Trimmed 76444 records to 52725 (keeping 200 days of data) [2025-09-23T21:46:48.241279] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-23T21:46:48.405183] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-23T21:46:48.432805] [DEBUG] [LOCAL ] TWLO: Primary data saved (52725 records). [2025-09-23T21:46:48.432966] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-23T21:46:48.433057] [INFO ] [MAIN ] Update Progress: 2157/2372 symbols completed. TWLO took 38.6s. Estimated remaining: 28m 35s. Rate: 7.5 symbols/min [2025-09-23T21:46:48.590907] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T21:46:49.002305] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-23T21:46:49.456047] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T21:46:49.802146] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-23T21:46:50.131763] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T21:46:50.602248] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-23T21:46:51.406084] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-23T21:46:51.411331] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T21:46:51.879339] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T21:46:52.202202] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-23T21:46:53.002227] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-23T21:46:53.341585] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T21:46:53.647296] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T21:46:53.802157] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-23T21:46:54.269885] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T21:46:54.602245] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-23T21:46:55.402158] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-23T21:46:55.444038] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T21:46:55.847078] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T21:46:56.202263] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-23T21:46:57.002195] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-23T21:46:57.170030] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T21:46:57.286616] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T21:46:57.802249] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-23T21:46:58.413971] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T21:46:58.602182] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-23T21:46:58.887257] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T21:46:59.402249] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-23T21:47:00.202168] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-23T21:47:00.483298] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T21:47:00.549830] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T21:47:01.002208] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-23T21:47:01.651990] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T21:47:01.660276] [INFO ] [REMOTE ] TWO: Full fetch complete (68809 records). [2025-09-23T21:47:01.660434] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-23T21:47:01.812603] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-23T21:47:02.073391] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-23T21:47:02.073472] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-23T21:47:02.074487] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-23T21:47:02.074551] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-23T21:47:02.076034] [DEBUG] [LOCAL ] TWO: Trimmed 68809 records to 48326 (keeping 200 days of data) [2025-09-23T21:47:02.370089] [DEBUG] [LOCAL ] TWO: Primary data saved (48326 records). [2025-09-23T21:47:02.370220] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-23T21:47:02.370306] [INFO ] [MAIN ] Update Progress: 2158/2372 symbols completed. TWO took 48.2s. Estimated remaining: 28m 28s. Rate: 7.5 symbols/min [2025-09-23T21:47:02.778267] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T21:47:02.787561] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-23T21:47:03.099610] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T21:47:03.402249] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-23T21:47:04.523050] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T21:47:04.534017] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-23T21:47:04.714859] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T21:47:04.718760] [INFO ] [REMOTE ] TX: Full fetch complete (35752 records). [2025-09-23T21:47:04.718850] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-23T21:47:05.086317] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-23T21:47:05.086396] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-23T21:47:05.087201] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-23T21:47:05.087263] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-23T21:47:05.088137] [DEBUG] [LOCAL ] TX: Trimmed 35752 records to 23690 (keeping 200 days of data) [2025-09-23T21:47:05.239979] [DEBUG] [LOCAL ] TX: Primary data saved (23690 records). [2025-09-23T21:47:05.240126] [INFO ] [MAIN ] TX: Full history saved. [2025-09-23T21:47:05.240240] [INFO ] [MAIN ] Update Progress: 2159/2372 symbols completed. TX took 19.9s. Estimated remaining: 28m 19s. Rate: 7.5 symbols/min [2025-09-23T21:47:06.044897] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T21:47:06.060466] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-23T21:47:07.551067] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T21:47:07.557896] [INFO ] [REMOTE ] TXNM: Full fetch complete (62745 records). [2025-09-23T21:47:07.558033] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-23T21:47:07.961701] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-23T21:47:07.961829] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-23T21:47:07.962839] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-23T21:47:07.962903] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-23T21:47:07.964282] [DEBUG] [LOCAL ] TXNM: Trimmed 62745 records to 43982 (keeping 200 days of data) [2025-09-23T21:47:08.235793] [DEBUG] [LOCAL ] TXNM: Primary data saved (43982 records). [2025-09-23T21:47:08.235929] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-23T21:47:08.236013] [INFO ] [MAIN ] Update Progress: 2160/2372 symbols completed. TXNM took 22.1s. Estimated remaining: 28m 11s. Rate: 7.5 symbols/min [2025-09-23T21:47:08.861283] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:08.913674] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:08.972814] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:08.974230] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:08.986576] [DEBUG] [LOCAL ] TY: Loaded 7646 existing records from primary storage. [2025-09-23T21:47:08.991564] [INFO ] [MAIN ] TY: Loaded 7646 existing records. [2025-09-23T21:47:09.080470] [DEBUG] [LOCAL ] TYG: Loaded 14298 existing records from primary storage. [2025-09-23T21:47:09.080909] [INFO ] [MAIN ] TYG: Loaded 14298 existing records. [2025-09-23T21:47:09.174414] [DEBUG] [LOCAL ] TXO: Loaded 18741 existing records from primary storage. [2025-09-23T21:47:09.204101] [INFO ] [MAIN ] TXO: Loaded 18741 existing records. [2025-09-23T21:47:09.481440] [DEBUG] [LOCAL ] TXT: Loaded 49780 existing records from primary storage. [2025-09-23T21:47:09.541836] [INFO ] [MAIN ] TXT: Loaded 49780 existing records. [2025-09-23T21:47:09.655507] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:09.783694] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-23T21:47:09.803734] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:09.824462] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:09.829841] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-23T21:47:09.856011] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-23T21:47:09.856238] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-23T21:47:09.856090] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-23T21:47:09.856888] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-23T21:47:09.856423] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-23T21:47:09.862180] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-23T21:47:09.882966] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-23T21:47:09.902094] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-23T21:47:09.907760] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-23T21:47:09.907695] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-23T21:47:10.063756] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:10.164902] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-23T21:47:10.268968] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-23T21:47:10.286709] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-23T21:47:10.317939] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-23T21:47:11.220161] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:11.267923] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:11.289558] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-23T21:47:11.289827] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-23T21:47:11.328582] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:11.379585] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-23T21:47:11.458956] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:11.459238] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-23T21:47:12.315601] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T21:47:12.320113] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-23T21:47:12.328031] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T21:47:12.330882] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-23T21:47:12.393666] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T21:47:12.397023] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-23T21:47:12.806478] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T21:47:12.816520] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-23T21:47:12.832791] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T21:47:12.835226] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-23T21:47:13.353113] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T21:47:13.356526] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-23T21:47:13.477039] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T21:47:13.664726] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T21:47:13.802239] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-23T21:47:14.495046] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T21:47:14.539091] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T21:47:14.548685] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T21:47:14.602145] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-23T21:47:15.402212] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-23T21:47:15.759753] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T21:47:16.202237] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-23T21:47:16.383748] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T21:47:17.002160] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-23T21:47:17.044182] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T21:47:17.802250] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-23T21:47:17.829940] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T21:47:18.559826] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T21:47:18.602209] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-23T21:47:19.349149] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T21:47:19.402148] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-23T21:47:20.166762] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T21:47:20.202271] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-23T21:47:21.002218] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-23T21:47:21.802294] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-23T21:47:21.851496] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T21:47:21.890173] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T21:47:22.365924] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-23T21:47:22.602196] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-23T21:47:23.402151] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-23T21:47:23.827555] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T21:47:24.202181] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-23T21:47:24.320909] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T21:47:24.859210] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T21:47:24.861018] [INFO ] [REMOTE ] TY: Full fetch complete (11798 records). [2025-09-23T21:47:24.861087] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-23T21:47:25.009139] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-23T21:47:25.247995] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-23T21:47:25.248071] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-23T21:47:25.248355] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-23T21:47:25.248444] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-23T21:47:25.248933] [DEBUG] [LOCAL ] TY: Trimmed 11798 records to 7679 (keeping 200 days of data) [2025-09-23T21:47:25.298885] [DEBUG] [LOCAL ] TY: Primary data saved (7679 records). [2025-09-23T21:47:25.299032] [INFO ] [MAIN ] TY: Full history saved. [2025-09-23T21:47:25.299125] [INFO ] [MAIN ] Update Progress: 2161/2372 symbols completed. TY took 17.1s. Estimated remaining: 28m 4s. Rate: 7.5 symbols/min [2025-09-23T21:47:25.492091] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:25.514629] [DEBUG] [LOCAL ] TYL: Loaded 22481 existing records from primary storage. [2025-09-23T21:47:25.514775] [INFO ] [MAIN ] TYL: Loaded 22481 existing records. [2025-09-23T21:47:25.696673] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:25.696945] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-23T21:47:25.696995] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-23T21:47:25.697674] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-23T21:47:25.697735] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-23T21:47:25.807277] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-23T21:47:26.062783] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:26.171156] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T21:47:26.602175] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-23T21:47:26.796686] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T21:47:27.402239] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-23T21:47:28.202247] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-23T21:47:28.215782] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T21:47:28.431635] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T21:47:29.002258] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-23T21:47:29.199838] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T21:47:29.802182] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-23T21:47:29.998400] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T21:47:30.602198] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-23T21:47:31.010083] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T21:47:31.402172] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-23T21:47:31.683572] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T21:47:32.202193] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-23T21:47:33.002156] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-23T21:47:33.138674] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T21:47:33.238888] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T21:47:33.242279] [INFO ] [REMOTE ] TXO: Full fetch complete (25838 records). [2025-09-23T21:47:33.242356] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-23T21:47:33.613155] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-23T21:47:33.613260] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-23T21:47:33.614009] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-23T21:47:33.614089] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-23T21:47:33.622975] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T21:47:33.627092] [DEBUG] [LOCAL ] TXO: Trimmed 25838 records to 18744 (keeping 200 days of data) [2025-09-23T21:47:33.748698] [DEBUG] [LOCAL ] TXO: Primary data saved (18744 records). [2025-09-23T21:47:33.748846] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-23T21:47:33.748935] [INFO ] [MAIN ] Update Progress: 2162/2372 symbols completed. TXO took 25.5s. Estimated remaining: 27m 56s. Rate: 7.5 symbols/min [2025-09-23T21:47:33.808594] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-23T21:47:33.937221] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:33.994483] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-23T21:47:33.994689] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-09-23T21:47:34.183317] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:34.183593] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-23T21:47:34.183661] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-23T21:47:34.184947] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-23T21:47:34.185008] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-23T21:47:34.544105] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:34.602144] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-23T21:47:35.054534] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T21:47:35.402237] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-23T21:47:36.202286] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-23T21:47:37.002243] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-23T21:47:37.003798] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T21:47:37.007335] [INFO ] [REMOTE ] TYG: Full fetch complete (22509 records). [2025-09-23T21:47:37.007424] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-23T21:47:37.163440] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-23T21:47:37.452096] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-23T21:47:37.452232] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-23T21:47:37.452903] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-23T21:47:37.453043] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-23T21:47:37.454356] [DEBUG] [LOCAL ] TYG: Trimmed 22509 records to 14240 (keeping 200 days of data) [2025-09-23T21:47:37.557940] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-23T21:47:37.608402] [DEBUG] [LOCAL ] TYG: Primary data saved (14240 records). [2025-09-23T21:47:37.608624] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-23T21:47:37.608786] [INFO ] [MAIN ] Update Progress: 2163/2372 symbols completed. TYG took 29.4s. Estimated remaining: 27m 47s. Rate: 7.5 symbols/min [2025-09-23T21:47:37.790891] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:37.802237] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-23T21:47:37.843017] [DEBUG] [LOCAL ] UA: Loaded 50408 existing records from primary storage. [2025-09-23T21:47:37.843231] [INFO ] [MAIN ] UA: Loaded 50408 existing records. [2025-09-23T21:47:38.028570] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:38.028911] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-23T21:47:38.029000] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-23T21:47:38.030388] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-23T21:47:38.030456] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-23T21:47:38.420111] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:38.421886] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T21:47:38.602260] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-23T21:47:39.402275] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-23T21:47:39.507551] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T21:47:40.060826] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T21:47:40.202222] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-23T21:47:41.002231] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-23T21:47:41.590730] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T21:47:41.702227] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-23T21:47:41.802268] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-23T21:47:42.602267] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-23T21:47:42.779856] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T21:47:43.195705] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T21:47:43.402226] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-23T21:47:44.202288] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-23T21:47:44.621774] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-23T21:47:44.698447] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T21:47:45.002166] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-23T21:47:45.311038] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T21:47:45.802192] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-23T21:47:46.602227] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-23T21:47:47.402266] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-23T21:47:47.469525] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T21:47:47.534515] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-23T21:47:48.202165] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-23T21:47:48.232005] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T21:47:48.288816] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T21:47:49.002253] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-23T21:47:49.802260] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-23T21:47:50.284056] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T21:47:50.409227] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-23T21:47:50.602218] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-23T21:47:51.402198] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-23T21:47:51.511330] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T21:47:51.726441] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T21:47:51.734994] [INFO ] [REMOTE ] TXT: Full fetch complete (72196 records). [2025-09-23T21:47:51.735134] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-23T21:47:52.151760] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-23T21:47:52.151873] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-23T21:47:52.153169] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-23T21:47:52.153250] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-23T21:47:52.154979] [DEBUG] [LOCAL ] TXT: Trimmed 72196 records to 49764 (keeping 200 days of data) [2025-09-23T21:47:52.210809] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-23T21:47:52.472737] [DEBUG] [LOCAL ] TXT: Primary data saved (49764 records). [2025-09-23T21:47:52.472872] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-23T21:47:52.472977] [INFO ] [MAIN ] Update Progress: 2164/2372 symbols completed. TXT took 44.2s. Estimated remaining: 27m 40s. Rate: 7.5 symbols/min [2025-09-23T21:47:52.656133] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:52.713143] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-09-23T21:47:52.713316] [INFO ] [MAIN ] UAA: Loaded 53509 existing records. [2025-09-23T21:47:52.910618] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:52.910921] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-23T21:47:52.910977] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-23T21:47:52.912059] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-23T21:47:52.912122] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-23T21:47:53.008777] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-23T21:47:53.281586] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:53.740001] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-23T21:47:53.807304] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-23T21:47:53.825261] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T21:47:53.873909] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T21:47:54.602218] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-23T21:47:55.133737] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T21:47:55.137606] [INFO ] [REMOTE ] TYL: Full fetch complete (31393 records). [2025-09-23T21:47:55.137745] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-23T21:47:55.408469] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-23T21:47:55.532777] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-23T21:47:55.532851] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-23T21:47:55.533474] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-23T21:47:55.533514] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-23T21:47:55.534290] [DEBUG] [LOCAL ] TYL: Trimmed 31393 records to 22381 (keeping 200 days of data) [2025-09-23T21:47:55.671563] [DEBUG] [LOCAL ] TYL: Primary data saved (22381 records). [2025-09-23T21:47:55.671713] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-23T21:47:55.671804] [INFO ] [MAIN ] Update Progress: 2165/2372 symbols completed. TYL took 30.4s. Estimated remaining: 27m 31s. Rate: 7.5 symbols/min [2025-09-23T21:47:55.844727] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:47:55.851679] [DEBUG] [LOCAL ] UAN: Loaded 5468 existing records from primary storage. [2025-09-23T21:47:55.851779] [INFO ] [MAIN ] UAN: Loaded 5468 existing records. [2025-09-23T21:47:56.032894] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:47:56.033273] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-23T21:47:56.033339] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-23T21:47:56.033911] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-23T21:47:56.033972] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-23T21:47:56.208721] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-23T21:47:56.228276] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-23T21:47:56.441116] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:47:57.002201] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-23T21:47:57.140499] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T21:47:57.789959] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T21:47:57.802133] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-23T21:47:58.343884] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-23T21:47:58.511197] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T21:47:58.602164] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-23T21:47:59.402194] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-23T21:48:00.202217] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-23T21:48:00.346262] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T21:48:01.002215] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-23T21:48:01.625543] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T21:48:01.802236] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-23T21:48:01.949445] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-23T21:48:02.270071] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-23T21:48:02.602207] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-23T21:48:03.402211] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-23T21:48:03.671037] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T21:48:04.202209] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-23T21:48:05.002250] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-23T21:48:05.580726] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-23T21:48:05.802197] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-23T21:48:06.141749] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T21:48:06.386431] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (3.78 seconds). [2025-09-23T21:48:06.602185] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-23T21:48:07.402229] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-23T21:48:08.048040] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-23T21:48:08.168406] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (3.17 seconds). [2025-09-23T21:48:08.185446] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T21:48:08.202153] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-23T21:48:08.740813] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-23T21:48:09.002208] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-23T21:48:09.802220] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-23T21:48:10.443194] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T21:48:10.478524] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-23T21:48:10.488515] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-09-23T21:48:10.488702] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-23T21:48:10.607276] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-23T21:48:10.914419] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T21:48:10.913540] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-23T21:48:10.922794] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-23T21:48:10.924377] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-23T21:48:10.924579] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-23T21:48:10.925054] [INFO ] [REMOTE ] UA: Full fetch complete (72892 records). [2025-09-23T21:48:10.925376] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-23T21:48:10.960572] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-09-23T21:48:11.408638] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-23T21:48:11.466929] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-23T21:48:11.467317] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-23T21:48:11.469266] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-23T21:48:11.469351] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-23T21:48:11.481983] [DEBUG] [LOCAL ] UA: Trimmed 72892 records to 50417 (keeping 200 days of data) [2025-09-23T21:48:11.918065] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-09-23T21:48:11.918468] [INFO ] [MAIN ] U: Full history saved. [2025-09-23T21:48:11.918594] [INFO ] [MAIN ] Update Progress: 2166/2372 symbols completed. U took 38.2s. Estimated remaining: 27m 24s. Rate: 7.5 symbols/min [2025-09-23T21:48:12.109217] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T21:48:12.149424] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:48:12.184433] [DEBUG] [LOCAL ] UA: Primary data saved (50417 records). [2025-09-23T21:48:12.184773] [INFO ] [MAIN ] UA: Full history saved. [2025-09-23T21:48:12.184971] [INFO ] [MAIN ] Update Progress: 2167/2372 symbols completed. UA took 34.6s. Estimated remaining: 27m 16s. Rate: 7.5 symbols/min [2025-09-23T21:48:12.206454] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-23T21:48:12.381088] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:48:12.401189] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-23T21:48:12.401390] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-09-23T21:48:12.625493] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:48:12.641736] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-23T21:48:12.644187] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T21:48:12.642388] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-23T21:48:12.657107] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-23T21:48:12.657324] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-23T21:48:12.771418] [DEBUG] [LOCAL ] UBS: Loaded 52452 existing records from primary storage. [2025-09-23T21:48:12.776394] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T21:48:12.776219] [INFO ] [MAIN ] UBS: Loaded 52452 existing records. [2025-09-23T21:48:13.007351] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-23T21:48:13.141966] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:48:13.172346] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-23T21:48:13.172497] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-23T21:48:13.179132] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-23T21:48:13.189421] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-23T21:48:13.361920] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:48:13.608922] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:48:13.802144] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-23T21:48:14.602164] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-23T21:48:15.078938] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T21:48:15.177493] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T21:48:15.178933] [INFO ] [REMOTE ] UAN: Full fetch complete (8339 records). [2025-09-23T21:48:15.179006] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-23T21:48:15.413505] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-23T21:48:15.547166] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-23T21:48:15.547268] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-23T21:48:15.547490] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-23T21:48:15.547556] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-23T21:48:15.548287] [DEBUG] [LOCAL ] UAN: Trimmed 8339 records to 5454 (keeping 200 days of data) [2025-09-23T21:48:15.609790] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T21:48:15.627707] [DEBUG] [LOCAL ] UAN: Primary data saved (5454 records). [2025-09-23T21:48:15.627801] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-23T21:48:15.627912] [INFO ] [MAIN ] Update Progress: 2168/2372 symbols completed. UAN took 20.0s. Estimated remaining: 27m 7s. Rate: 7.5 symbols/min [2025-09-23T21:48:15.795165] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:48:15.840884] [DEBUG] [LOCAL ] UCB: Loaded 38114 existing records from primary storage. [2025-09-23T21:48:15.841021] [INFO ] [MAIN ] UCB: Loaded 38114 existing records. [2025-09-23T21:48:16.027191] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:48:16.027623] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-23T21:48:16.027715] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-23T21:48:16.029601] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-23T21:48:16.029694] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-23T21:48:16.204689] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-23T21:48:16.391007] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:48:17.002200] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-23T21:48:17.237804] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-23T21:48:17.802187] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-23T21:48:18.227484] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T21:48:18.602238] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-23T21:48:19.402204] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-23T21:48:19.652467] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-23T21:48:19.747316] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T21:48:20.196892] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T21:48:20.204462] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-23T21:48:21.002165] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-23T21:48:21.192915] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T21:48:21.802190] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-23T21:48:22.346575] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-23T21:48:22.488244] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T21:48:22.602215] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-23T21:48:23.402267] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-23T21:48:24.084216] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T21:48:24.184509] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-23T21:48:24.202139] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-23T21:48:25.002305] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-23T21:48:25.459774] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T21:48:25.802175] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-23T21:48:26.602172] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-23T21:48:26.718425] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-23T21:48:26.868297] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T21:48:26.881746] [INFO ] [REMOTE ] UAA: Full fetch complete (77479 records). [2025-09-23T21:48:26.881999] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-23T21:48:27.307320] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-23T21:48:27.307533] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-23T21:48:27.308834] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-23T21:48:27.308978] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-23T21:48:27.311098] [DEBUG] [LOCAL ] UAA: Trimmed 77479 records to 53509 (keeping 200 days of data) [2025-09-23T21:48:27.426528] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-23T21:48:27.433062] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T21:48:27.663968] [DEBUG] [LOCAL ] UAA: Primary data saved (53509 records). [2025-09-23T21:48:27.664114] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-23T21:48:27.664272] [INFO ] [MAIN ] Update Progress: 2169/2372 symbols completed. UAA took 35.2s. Estimated remaining: 26m 60s. Rate: 7.5 symbols/min [2025-09-23T21:48:27.832029] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:48:27.888012] [DEBUG] [LOCAL ] UDR: Loaded 51790 existing records from primary storage. [2025-09-23T21:48:27.888160] [INFO ] [MAIN ] UDR: Loaded 51790 existing records. [2025-09-23T21:48:28.084037] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:48:28.084475] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-23T21:48:28.084553] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-23T21:48:28.085828] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-23T21:48:28.085907] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-23T21:48:28.203943] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-23T21:48:28.305831] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T21:48:28.492029] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:48:29.002223] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-23T21:48:29.802188] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-23T21:48:30.037293] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-23T21:48:30.234241] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T21:48:30.235987] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-23T21:48:30.602178] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-23T21:48:31.082308] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T21:48:31.402209] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-23T21:48:32.202343] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-23T21:48:32.937392] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T21:48:33.002161] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-23T21:48:33.111245] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-23T21:48:33.802233] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-23T21:48:34.171097] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T21:48:34.602170] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-23T21:48:34.948185] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T21:48:35.402214] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-23T21:48:36.014382] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T21:48:36.143122] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-23T21:48:36.202150] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-23T21:48:36.847827] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T21:48:37.002197] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-23T21:48:37.802203] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-23T21:48:38.603045] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-23T21:48:38.602942] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T21:48:38.713710] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-23T21:48:39.260736] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T21:48:39.402223] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-23T21:48:40.202190] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-23T21:48:40.443409] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T21:48:40.456715] [INFO ] [REMOTE ] UBS: Full fetch complete (75597 records). [2025-09-23T21:48:40.456914] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-23T21:48:40.859007] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T21:48:40.934756] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-23T21:48:40.934846] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-23T21:48:40.936130] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-23T21:48:40.936203] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-23T21:48:40.937774] [DEBUG] [LOCAL ] UBS: Trimmed 75597 records to 52443 (keeping 200 days of data) [2025-09-23T21:48:41.005473] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-23T21:48:41.270342] [DEBUG] [LOCAL ] UBS: Primary data saved (52443 records). [2025-09-23T21:48:41.270487] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-23T21:48:41.270608] [INFO ] [MAIN ] Update Progress: 2170/2372 symbols completed. UBS took 29.1s. Estimated remaining: 26m 52s. Rate: 7.5 symbols/min [2025-09-23T21:48:41.440890] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:48:41.485538] [DEBUG] [LOCAL ] UE: Loaded 42958 existing records from primary storage. [2025-09-23T21:48:41.485727] [INFO ] [MAIN ] UE: Loaded 42958 existing records. [2025-09-23T21:48:41.667348] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:48:41.667984] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-23T21:48:41.668052] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-23T21:48:41.669300] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-23T21:48:41.669360] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-23T21:48:41.808312] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-23T21:48:42.027589] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:48:42.602229] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-23T21:48:42.823095] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-23T21:48:42.889914] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T21:48:43.014748] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T21:48:43.402256] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-23T21:48:43.764682] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T21:48:44.202210] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-23T21:48:44.738189] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T21:48:44.744405] [INFO ] [REMOTE ] UCB: Full fetch complete (54698 records). [2025-09-23T21:48:44.744545] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-23T21:48:45.008611] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-23T21:48:45.139282] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-23T21:48:45.139370] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-23T21:48:45.140280] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-23T21:48:45.140342] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-23T21:48:45.143429] [DEBUG] [LOCAL ] UCB: Trimmed 54698 records to 38105 (keeping 200 days of data) [2025-09-23T21:48:45.383225] [DEBUG] [LOCAL ] UCB: Primary data saved (38105 records). [2025-09-23T21:48:45.383369] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-23T21:48:45.383477] [INFO ] [MAIN ] Update Progress: 2171/2372 symbols completed. UCB took 29.8s. Estimated remaining: 26m 44s. Rate: 7.5 symbols/min [2025-09-23T21:48:45.557043] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:48:45.566711] [DEBUG] [LOCAL ] UFI: Loaded 8192 existing records from primary storage. [2025-09-23T21:48:45.566803] [INFO ] [MAIN ] UFI: Loaded 8192 existing records. [2025-09-23T21:48:45.754454] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:48:45.755921] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-23T21:48:45.755979] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-23T21:48:45.756930] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-23T21:48:45.757064] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-23T21:48:45.806548] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-23T21:48:45.887981] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T21:48:46.216956] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:48:46.486615] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T21:48:46.602205] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-23T21:48:47.078720] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T21:48:47.402207] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-23T21:48:48.138759] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T21:48:48.202182] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-23T21:48:48.353137] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-23T21:48:48.996544] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T21:48:49.002132] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-23T21:48:49.771822] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T21:48:49.802177] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-23T21:48:50.602221] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-23T21:48:50.661285] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-23T21:48:50.984331] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-23T21:48:50.994230] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-09-23T21:48:50.994393] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-23T21:48:51.397522] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-23T21:48:51.397607] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-23T21:48:51.398708] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-23T21:48:51.398771] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-23T21:48:51.400264] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-09-23T21:48:51.402183] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-23T21:48:51.741173] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-09-23T21:48:51.741313] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-23T21:48:51.741466] [INFO ] [MAIN ] Update Progress: 2172/2372 symbols completed. UBER took 39.8s. Estimated remaining: 26m 36s. Rate: 7.5 symbols/min [2025-09-23T21:48:51.919896] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:48:51.972426] [DEBUG] [LOCAL ] UGI: Loaded 50566 existing records from primary storage. [2025-09-23T21:48:51.972594] [INFO ] [MAIN ] UGI: Loaded 50566 existing records. [2025-09-23T21:48:52.159267] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:48:52.159552] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-23T21:48:52.159668] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-23T21:48:52.160920] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-23T21:48:52.160982] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-23T21:48:52.207976] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-23T21:48:52.550948] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:48:53.002199] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-23T21:48:53.217933] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T21:48:53.727860] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T21:48:53.802153] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-23T21:48:53.819210] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T21:48:54.602225] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-23T21:48:55.339178] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T21:48:55.402263] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-23T21:48:55.953071] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T21:48:56.202210] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-23T21:48:56.783689] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T21:48:56.913439] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T21:48:57.002187] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-23T21:48:57.802232] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-23T21:48:58.602171] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-23T21:48:58.777964] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T21:48:59.298099] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T21:48:59.402220] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-23T21:48:59.574030] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:49:00.195867] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T21:49:00.202142] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-23T21:49:00.908835] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T21:49:00.910698] [INFO ] [REMOTE ] UFI: Full fetch complete (12315 records). [2025-09-23T21:49:00.910775] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-23T21:49:01.010321] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-23T21:49:01.286502] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-23T21:49:01.286609] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-23T21:49:01.286963] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-23T21:49:01.287022] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-23T21:49:01.287771] [DEBUG] [LOCAL ] UFI: Trimmed 12315 records to 8156 (keeping 200 days of data) [2025-09-23T21:49:01.353019] [DEBUG] [LOCAL ] UFI: Primary data saved (8156 records). [2025-09-23T21:49:01.353197] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-23T21:49:01.353351] [INFO ] [MAIN ] Update Progress: 2173/2372 symbols completed. UFI took 16.0s. Estimated remaining: 26m 28s. Rate: 7.5 symbols/min [2025-09-23T21:49:01.534958] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:49:01.577257] [DEBUG] [LOCAL ] UGP: Loaded 42582 existing records from primary storage. [2025-09-23T21:49:01.577398] [INFO ] [MAIN ] UGP: Loaded 42582 existing records. [2025-09-23T21:49:01.775687] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:49:01.775983] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-23T21:49:01.776033] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-23T21:49:01.776942] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-23T21:49:01.777001] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-23T21:49:01.809460] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-23T21:49:02.148192] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:49:02.602166] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-23T21:49:02.745772] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T21:49:02.857995] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T21:49:03.402198] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-23T21:49:04.081363] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T21:49:04.202210] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-23T21:49:05.002212] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-23T21:49:05.061245] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T21:49:05.070322] [INFO ] [REMOTE ] UDR: Full fetch complete (74362 records). [2025-09-23T21:49:05.070484] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-23T21:49:05.527467] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-23T21:49:05.527561] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-23T21:49:05.528623] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-23T21:49:05.528712] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-23T21:49:05.530196] [DEBUG] [LOCAL ] UDR: Trimmed 74362 records to 51781 (keeping 200 days of data) [2025-09-23T21:49:05.817923] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-23T21:49:05.892240] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T21:49:05.906771] [DEBUG] [LOCAL ] UDR: Primary data saved (51781 records). [2025-09-23T21:49:05.906935] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-23T21:49:05.907028] [INFO ] [MAIN ] Update Progress: 2174/2372 symbols completed. UDR took 38.2s. Estimated remaining: 26m 20s. Rate: 7.5 symbols/min [2025-09-23T21:49:06.077496] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:49:06.094507] [DEBUG] [LOCAL ] UHAL: Loaded 16429 existing records from primary storage. [2025-09-23T21:49:06.094673] [INFO ] [MAIN ] UHAL: Loaded 16429 existing records. [2025-09-23T21:49:06.275925] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:49:06.276222] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-23T21:49:06.276276] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-23T21:49:06.276818] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-23T21:49:06.276880] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-23T21:49:06.602211] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-23T21:49:06.646738] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:49:06.671833] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T21:49:07.402255] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-23T21:49:07.620673] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T21:49:08.202184] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-23T21:49:08.322170] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T21:49:08.841240] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T21:49:08.936923] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T21:49:09.002195] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-23T21:49:09.802193] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-23T21:49:10.456282] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T21:49:10.602165] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-23T21:49:10.911780] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T21:49:11.402207] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-23T21:49:11.978527] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T21:49:12.202209] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-23T21:49:12.806592] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T21:49:13.002235] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-23T21:49:13.802224] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-23T21:49:13.847609] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T21:49:14.546306] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T21:49:14.602238] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-23T21:49:15.402186] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-23T21:49:15.567440] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:49:15.675557] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T21:49:15.682392] [INFO ] [REMOTE ] UE: Full fetch complete (61451 records). [2025-09-23T21:49:15.682499] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-23T21:49:16.069658] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-23T21:49:16.069776] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-23T21:49:16.070731] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-23T21:49:16.070792] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-23T21:49:16.072079] [DEBUG] [LOCAL ] UE: Trimmed 61451 records to 42935 (keeping 200 days of data) [2025-09-23T21:49:16.252531] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-23T21:49:16.343231] [DEBUG] [LOCAL ] UE: Primary data saved (42935 records). [2025-09-23T21:49:16.343361] [INFO ] [MAIN ] UE: Full history saved. [2025-09-23T21:49:16.343464] [INFO ] [MAIN ] Update Progress: 2175/2372 symbols completed. UE took 35.1s. Estimated remaining: 26m 12s. Rate: 7.5 symbols/min [2025-09-23T21:49:16.516072] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:49:16.559339] [DEBUG] [LOCAL ] UHS: Loaded 41289 existing records from primary storage. [2025-09-23T21:49:16.559483] [INFO ] [MAIN ] UHS: Loaded 41289 existing records. [2025-09-23T21:49:16.739531] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:49:16.739809] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-23T21:49:16.739884] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-23T21:49:16.747819] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-23T21:49:16.761030] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-23T21:49:16.794514] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T21:49:17.007427] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-23T21:49:17.135979] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:49:17.313408] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T21:49:17.802205] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-23T21:49:18.602167] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-23T21:49:18.795131] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T21:49:18.834215] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T21:49:19.402198] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-23T21:49:20.178240] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T21:49:20.202172] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-23T21:49:20.376617] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T21:49:21.002238] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-23T21:49:21.748080] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T21:49:21.802249] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-23T21:49:22.272528] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T21:49:22.602246] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-23T21:49:23.397052] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T21:49:23.404632] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-23T21:49:23.802706] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T21:49:24.202219] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-23T21:49:25.002262] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-23T21:49:25.154926] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T21:49:25.802192] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-23T21:49:25.852868] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T21:49:26.382626] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T21:49:26.602261] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-23T21:49:27.402181] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-23T21:49:27.552544] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T21:49:28.202196] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-23T21:49:28.285361] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T21:49:28.370856] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T21:49:29.002202] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-23T21:49:29.803423] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-23T21:49:29.806473] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T21:49:29.977937] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T21:49:30.602207] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-23T21:49:31.407338] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-23T21:49:31.428041] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T21:49:31.437073] [INFO ] [REMOTE ] UGI: Full fetch complete (73414 records). [2025-09-23T21:49:31.437209] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-23T21:49:31.812795] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T21:49:31.857540] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-23T21:49:31.857954] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-23T21:49:31.859039] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-23T21:49:31.859102] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-23T21:49:31.860575] [DEBUG] [LOCAL ] UGI: Trimmed 73414 records to 50552 (keeping 200 days of data) [2025-09-23T21:49:32.185344] [DEBUG] [LOCAL ] UGI: Primary data saved (50552 records). [2025-09-23T21:49:32.185488] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-23T21:49:32.185576] [INFO ] [MAIN ] Update Progress: 2176/2372 symbols completed. UGI took 40.4s. Estimated remaining: 26m 4s. Rate: 7.5 symbols/min [2025-09-23T21:49:32.207396] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-23T21:49:32.370067] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:49:32.382018] [DEBUG] [LOCAL ] UHT: Loaded 10029 existing records from primary storage. [2025-09-23T21:49:32.382142] [INFO ] [MAIN ] UHT: Loaded 10029 existing records. [2025-09-23T21:49:32.560262] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:49:32.560690] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-23T21:49:32.560749] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-23T21:49:32.561259] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-23T21:49:32.561319] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-23T21:49:32.944500] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:49:32.957497] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T21:49:32.964715] [INFO ] [REMOTE ] UGP: Full fetch complete (62049 records). [2025-09-23T21:49:32.964823] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-23T21:49:33.007279] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-23T21:49:33.348398] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-23T21:49:33.348477] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-23T21:49:33.349449] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-23T21:49:33.349510] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-23T21:49:33.350759] [DEBUG] [LOCAL ] UGP: Trimmed 62049 records to 42568 (keeping 200 days of data) [2025-09-23T21:49:33.594805] [DEBUG] [LOCAL ] UGP: Primary data saved (42568 records). [2025-09-23T21:49:33.594926] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-23T21:49:33.595020] [INFO ] [MAIN ] Update Progress: 2177/2372 symbols completed. UGP took 32.2s. Estimated remaining: 25m 56s. Rate: 7.5 symbols/min [2025-09-23T21:49:33.767896] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:49:33.780830] [DEBUG] [LOCAL ] UI: Loaded 12558 existing records from primary storage. [2025-09-23T21:49:33.780947] [INFO ] [MAIN ] UI: Loaded 12558 existing records. [2025-09-23T21:49:33.853166] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-23T21:49:33.975504] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:49:33.997455] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-23T21:49:33.997636] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-23T21:49:33.998421] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-23T21:49:33.999193] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T21:49:33.999326] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-23T21:49:34.101113] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T21:49:34.384254] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:49:34.602153] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-23T21:49:34.832366] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T21:49:35.402261] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-23T21:49:35.414414] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T21:49:36.202232] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-23T21:49:36.988302] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T21:49:37.002156] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-23T21:49:37.223100] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T21:49:37.229020] [INFO ] [REMOTE ] UHAL: Full fetch complete (23155 records). [2025-09-23T21:49:37.229152] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-23T21:49:37.606232] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-23T21:49:37.606321] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-23T21:49:37.606879] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-23T21:49:37.606952] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-23T21:49:37.607843] [DEBUG] [LOCAL ] UHAL: Trimmed 23155 records to 16490 (keeping 200 days of data) [2025-09-23T21:49:37.708437] [DEBUG] [LOCAL ] UHAL: Primary data saved (16490 records). [2025-09-23T21:49:37.708612] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-23T21:49:37.708746] [INFO ] [MAIN ] Update Progress: 2178/2372 symbols completed. UHAL took 31.8s. Estimated remaining: 25m 48s. Rate: 7.5 symbols/min [2025-09-23T21:49:37.807591] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-23T21:49:37.890067] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:49:37.935312] [DEBUG] [LOCAL ] UIS: Loaded 37103 existing records from primary storage. [2025-09-23T21:49:37.935505] [INFO ] [MAIN ] UIS: Loaded 37103 existing records. [2025-09-23T21:49:38.141968] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:49:38.142341] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-23T21:49:38.142397] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-23T21:49:38.143171] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-23T21:49:38.143239] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-23T21:49:38.522065] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:49:38.550687] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T21:49:38.602165] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-23T21:49:38.750211] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T21:49:39.330153] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T21:49:39.402158] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-23T21:49:40.202193] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-23T21:49:40.930982] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T21:49:40.937616] [INFO ] [REMOTE ] UHS: Full fetch complete (58270 records). [2025-09-23T21:49:40.937764] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-23T21:49:41.007405] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-23T21:49:41.336142] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-23T21:49:41.336257] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-23T21:49:41.337431] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-23T21:49:41.337537] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-23T21:49:41.338877] [DEBUG] [LOCAL ] UHS: Trimmed 58270 records to 41216 (keeping 200 days of data) [2025-09-23T21:49:41.592157] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T21:49:41.641789] [DEBUG] [LOCAL ] UHS: Primary data saved (41216 records). [2025-09-23T21:49:41.641922] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-23T21:49:41.642003] [INFO ] [MAIN ] Update Progress: 2179/2372 symbols completed. UHS took 25.3s. Estimated remaining: 25m 39s. Rate: 7.5 symbols/min [2025-09-23T21:49:41.816312] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-23T21:49:41.821312] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:49:41.872799] [DEBUG] [LOCAL ] UL: Loaded 53067 existing records from primary storage. [2025-09-23T21:49:41.872971] [INFO ] [MAIN ] UL: Loaded 53067 existing records. [2025-09-23T21:49:42.065628] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:49:42.074490] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-23T21:49:42.074302] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T21:49:42.074674] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-23T21:49:42.079232] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-23T21:49:42.079295] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-23T21:49:42.433486] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T21:49:42.448337] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:49:42.602196] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-23T21:49:43.402197] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-23T21:49:44.202223] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-23T21:49:44.441965] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T21:49:44.615806] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T21:49:44.846599] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T21:49:45.002207] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-23T21:49:45.802206] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-23T21:49:46.072629] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T21:49:46.602232] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-23T21:49:46.766447] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T21:49:47.402197] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-23T21:49:48.202210] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-23T21:49:48.565252] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-23T21:49:48.977196] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T21:49:49.002161] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-23T21:49:49.298285] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T21:49:49.802196] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-23T21:49:50.487236] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T21:49:50.602166] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-23T21:49:50.774246] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T21:49:51.402204] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-23T21:49:52.021561] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T21:49:52.202207] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-23T21:49:52.246301] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T21:49:53.002191] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-23T21:49:53.014251] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T21:49:53.802230] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-23T21:49:54.538307] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T21:49:54.596782] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T21:49:54.602138] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-23T21:49:55.404259] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-23T21:49:55.407386] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T21:49:56.202220] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-23T21:49:56.346250] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T21:49:57.002201] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-23T21:49:57.666748] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T21:49:57.684064] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T21:49:57.802179] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-23T21:49:58.602236] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-23T21:49:58.703425] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T21:49:59.402199] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-23T21:50:00.073471] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T21:50:00.202203] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-23T21:50:00.724453] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T21:50:01.002209] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-23T21:50:01.806674] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-23T21:50:01.837458] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T21:50:01.842476] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T21:50:01.843376] [INFO ] [REMOTE ] UHT: Full fetch complete (15235 records). [2025-09-23T21:50:01.855415] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-23T21:50:02.234206] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-23T21:50:02.234305] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-23T21:50:02.234683] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-23T21:50:02.234745] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-23T21:50:02.235385] [DEBUG] [LOCAL ] UHT: Trimmed 15235 records to 10042 (keeping 200 days of data) [2025-09-23T21:50:02.304516] [DEBUG] [LOCAL ] UHT: Primary data saved (10042 records). [2025-09-23T21:50:02.304715] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-23T21:50:02.304825] [INFO ] [MAIN ] Update Progress: 2180/2372 symbols completed. UHT took 30.1s. Estimated remaining: 25m 32s. Rate: 7.5 symbols/min [2025-09-23T21:50:02.485887] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:50:02.527489] [DEBUG] [LOCAL ] ULS: Loaded 39211 existing records from primary storage. [2025-09-23T21:50:02.527674] [INFO ] [MAIN ] ULS: Loaded 39211 existing records. [2025-09-23T21:50:02.607452] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-23T21:50:02.727327] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:50:02.727774] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-23T21:50:02.727831] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-23T21:50:02.729754] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-23T21:50:02.729816] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-23T21:50:03.113031] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T21:50:03.168665] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:50:03.168954] [INFO ] [REMOTE ] UI: Full fetch complete (18093 records). [2025-09-23T21:50:03.169342] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-23T21:50:03.407312] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-23T21:50:03.553876] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-23T21:50:03.553959] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-23T21:50:03.554390] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-23T21:50:03.554429] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-23T21:50:03.555162] [DEBUG] [LOCAL ] UI: Trimmed 18093 records to 12673 (keeping 200 days of data) [2025-09-23T21:50:03.639256] [DEBUG] [LOCAL ] UI: Primary data saved (12673 records). [2025-09-23T21:50:03.639436] [INFO ] [MAIN ] UI: Full history saved. [2025-09-23T21:50:03.639540] [INFO ] [MAIN ] Update Progress: 2181/2372 symbols completed. UI took 30.0s. Estimated remaining: 25m 24s. Rate: 7.5 symbols/min [2025-09-23T21:50:03.831597] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:50:03.885500] [DEBUG] [LOCAL ] UMC: Loaded 52731 existing records from primary storage. [2025-09-23T21:50:03.885714] [INFO ] [MAIN ] UMC: Loaded 52731 existing records. [2025-09-23T21:50:04.060717] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T21:50:04.097425] [INFO ] [REMOTE ] UIS: Full fetch complete (51971 records). [2025-09-23T21:50:04.112018] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-23T21:50:04.111904] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:50:04.112260] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-23T21:50:04.112419] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-23T21:50:04.145954] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-23T21:50:04.179056] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-23T21:50:04.209377] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-23T21:50:04.912819] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:50:04.913180] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-23T21:50:04.913518] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-23T21:50:04.914458] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-23T21:50:04.914540] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-23T21:50:04.915722] [DEBUG] [LOCAL ] UIS: Trimmed 51971 records to 37092 (keeping 200 days of data) [2025-09-23T21:50:05.002314] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-23T21:50:05.134469] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T21:50:05.165522] [DEBUG] [LOCAL ] UIS: Primary data saved (37092 records). [2025-09-23T21:50:05.165702] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-23T21:50:05.165844] [INFO ] [MAIN ] Update Progress: 2182/2372 symbols completed. UIS took 27.5s. Estimated remaining: 25m 15s. Rate: 7.5 symbols/min [2025-09-23T21:50:05.344581] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:50:05.379243] [DEBUG] [LOCAL ] UMH: Loaded 33333 existing records from primary storage. [2025-09-23T21:50:05.379433] [INFO ] [MAIN ] UMH: Loaded 33333 existing records. [2025-09-23T21:50:05.572473] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:50:05.573195] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-23T21:50:05.573294] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-23T21:50:05.581676] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-23T21:50:05.594862] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-23T21:50:05.601586] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T21:50:05.812393] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-23T21:50:05.984713] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:50:06.602224] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-23T21:50:06.899795] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T21:50:07.402206] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-23T21:50:07.883732] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-23T21:50:07.965239] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T21:50:08.202168] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-23T21:50:08.628889] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T21:50:09.002195] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-23T21:50:09.093850] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T21:50:09.802252] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-23T21:50:10.392857] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T21:50:10.602261] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-23T21:50:11.402166] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-23T21:50:11.791696] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T21:50:12.053939] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T21:50:12.144139] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T21:50:12.202218] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-23T21:50:13.002233] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-23T21:50:13.802174] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-23T21:50:14.221925] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T21:50:14.320241] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T21:50:14.602211] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-23T21:50:15.351440] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T21:50:15.402226] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-23T21:50:16.043754] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T21:50:16.202148] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-23T21:50:17.002191] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-23T21:50:17.536520] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-23T21:50:17.802184] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-23T21:50:18.165495] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-23T21:50:18.229614] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T21:50:18.602218] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-23T21:50:19.343989] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T21:50:19.402157] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-23T21:50:20.202270] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-23T21:50:20.446221] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T21:50:20.889761] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T21:50:21.002158] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-23T21:50:21.802197] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-23T21:50:21.861787] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T21:50:22.410017] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T21:50:22.602209] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-23T21:50:23.176385] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T21:50:23.402194] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-23T21:50:24.089262] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T21:50:24.202211] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-23T21:50:25.002170] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-23T21:50:25.291591] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T21:50:25.718612] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T21:50:25.802146] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-23T21:50:26.602218] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-23T21:50:26.872756] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T21:50:27.151615] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T21:50:27.402197] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-23T21:50:27.878688] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T21:50:27.884999] [INFO ] [REMOTE ] ULS: Full fetch complete (54422 records). [2025-09-23T21:50:27.885122] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-23T21:50:28.211900] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-23T21:50:28.267394] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-23T21:50:28.267488] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-23T21:50:28.268583] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-23T21:50:28.268686] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-23T21:50:28.270158] [DEBUG] [LOCAL ] ULS: Trimmed 54422 records to 39325 (keeping 200 days of data) [2025-09-23T21:50:28.541681] [DEBUG] [LOCAL ] ULS: Primary data saved (39325 records). [2025-09-23T21:50:28.542000] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-23T21:50:28.542210] [INFO ] [MAIN ] Update Progress: 2183/2372 symbols completed. ULS took 26.2s. Estimated remaining: 25m 9s. Rate: 7.5 symbols/min [2025-09-23T21:50:28.741793] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:50:28.759045] [DEBUG] [LOCAL ] UNF: Loaded 11798 existing records from primary storage. [2025-09-23T21:50:28.759170] [INFO ] [MAIN ] UNF: Loaded 11798 existing records. [2025-09-23T21:50:28.952757] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:50:28.952977] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-23T21:50:28.953032] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-23T21:50:28.953487] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-23T21:50:28.953547] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-23T21:50:29.013125] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-23T21:50:29.385939] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:50:29.391024] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-23T21:50:29.802161] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-23T21:50:30.020271] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T21:50:30.032720] [INFO ] [REMOTE ] UL: Full fetch complete (76845 records). [2025-09-23T21:50:30.032857] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-23T21:50:30.454387] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-23T21:50:30.454577] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-23T21:50:30.456179] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-23T21:50:30.456287] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-23T21:50:30.458494] [DEBUG] [LOCAL ] UL: Trimmed 76845 records to 53069 (keeping 200 days of data) [2025-09-23T21:50:30.579245] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T21:50:30.603305] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-23T21:50:30.718046] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T21:50:30.833330] [DEBUG] [LOCAL ] UL: Primary data saved (53069 records). [2025-09-23T21:50:30.833463] [INFO ] [MAIN ] UL: Full history saved. [2025-09-23T21:50:30.833607] [INFO ] [MAIN ] Update Progress: 2184/2372 symbols completed. UL took 49.2s. Estimated remaining: 25m 0s. Rate: 7.5 symbols/min [2025-09-23T21:50:31.002549] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:50:31.044326] [DEBUG] [LOCAL ] UNFI: Loaded 41841 existing records from primary storage. [2025-09-23T21:50:31.044467] [INFO ] [MAIN ] UNFI: Loaded 41841 existing records. [2025-09-23T21:50:31.218570] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:50:31.218844] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-23T21:50:31.218910] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-23T21:50:31.219917] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-23T21:50:31.219980] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-23T21:50:31.408236] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-23T21:50:31.578731] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:50:32.202191] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-23T21:50:32.487169] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T21:50:32.508857] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T21:50:33.002252] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-23T21:50:33.580688] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T21:50:33.791442] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T21:50:33.802133] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-23T21:50:34.602203] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-23T21:50:34.763032] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T21:50:35.402196] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-23T21:50:36.202178] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-23T21:50:36.487139] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T21:50:36.534675] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T21:50:37.002264] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-23T21:50:37.684426] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T21:50:37.802256] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-23T21:50:38.231799] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T21:50:38.238188] [INFO ] [REMOTE ] UMH: Full fetch complete (46508 records). [2025-09-23T21:50:38.238291] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-23T21:50:38.507798] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T21:50:38.607379] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-23T21:50:38.671184] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-23T21:50:38.671300] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-23T21:50:38.672549] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-23T21:50:38.672636] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-23T21:50:38.676488] [DEBUG] [LOCAL ] UMH: Trimmed 46508 records to 33444 (keeping 200 days of data) [2025-09-23T21:50:38.910782] [DEBUG] [LOCAL ] UMH: Primary data saved (33444 records). [2025-09-23T21:50:38.910950] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-23T21:50:38.911070] [INFO ] [MAIN ] Update Progress: 2185/2372 symbols completed. UMH took 33.7s. Estimated remaining: 24m 52s. Rate: 7.5 symbols/min [2025-09-23T21:50:39.091121] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:50:39.157435] [DEBUG] [LOCAL ] UNH: Loaded 53794 existing records from primary storage. [2025-09-23T21:50:39.157623] [INFO ] [MAIN ] UNH: Loaded 53794 existing records. [2025-09-23T21:50:39.334272] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:50:39.334508] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-23T21:50:39.334556] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-23T21:50:39.335971] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-23T21:50:39.336034] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-23T21:50:39.411493] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-23T21:50:39.714927] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:50:40.000062] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T21:50:40.202195] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-23T21:50:41.002192] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-23T21:50:41.334030] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-23T21:50:41.343833] [INFO ] [REMOTE ] UMC: Full fetch complete (76606 records). [2025-09-23T21:50:41.344031] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-23T21:50:41.628411] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T21:50:41.762737] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T21:50:41.806900] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-23T21:50:41.833365] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-23T21:50:41.833494] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-23T21:50:41.834807] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-23T21:50:41.835033] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-23T21:50:41.836775] [DEBUG] [LOCAL ] UMC: Trimmed 76606 records to 52732 (keeping 200 days of data) [2025-09-23T21:50:42.165770] [DEBUG] [LOCAL ] UMC: Primary data saved (52732 records). [2025-09-23T21:50:42.165985] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-23T21:50:42.166317] [INFO ] [MAIN ] Update Progress: 2186/2372 symbols completed. UMC took 38.5s. Estimated remaining: 24m 44s. Rate: 7.5 symbols/min [2025-09-23T21:50:42.346474] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:50:42.397873] [DEBUG] [LOCAL ] UNM: Loaded 48738 existing records from primary storage. [2025-09-23T21:50:42.398053] [INFO ] [MAIN ] UNM: Loaded 48738 existing records. [2025-09-23T21:50:42.578970] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:50:42.579212] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-23T21:50:42.579259] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-23T21:50:42.580327] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-23T21:50:42.580431] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-23T21:50:42.607315] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-23T21:50:42.952106] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:50:43.402266] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-23T21:50:43.475317] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T21:50:43.995773] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T21:50:44.202226] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-23T21:50:44.807335] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-23T21:50:45.002205] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-23T21:50:45.676307] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T21:50:45.802188] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-23T21:50:46.602163] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-23T21:50:46.650009] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T21:50:46.684722] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T21:50:47.402218] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-23T21:50:48.040351] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T21:50:48.194109] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T21:50:48.196603] [INFO ] [REMOTE ] UNF: Full fetch complete (17104 records). [2025-09-23T21:50:48.196724] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-23T21:50:48.208432] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-23T21:50:48.574905] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-23T21:50:48.575092] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-23T21:50:48.575471] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-23T21:50:48.575581] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-23T21:50:48.576210] [DEBUG] [LOCAL ] UNF: Trimmed 17104 records to 11855 (keeping 200 days of data) [2025-09-23T21:50:48.653475] [DEBUG] [LOCAL ] UNF: Primary data saved (11855 records). [2025-09-23T21:50:48.653628] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-23T21:50:48.653809] [INFO ] [MAIN ] Update Progress: 2187/2372 symbols completed. UNF took 20.1s. Estimated remaining: 24m 36s. Rate: 7.5 symbols/min [2025-09-23T21:50:48.823066] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:50:48.831982] [DEBUG] [LOCAL ] UNMA: Loaded 3670 existing records from primary storage. [2025-09-23T21:50:48.832089] [INFO ] [MAIN ] UNMA: Loaded 3670 existing records. [2025-09-23T21:50:49.007558] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-23T21:50:49.012602] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:50:49.014035] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-23T21:50:49.014102] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-23T21:50:49.014465] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-23T21:50:49.014526] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-23T21:50:49.380701] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:50:49.802237] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-23T21:50:49.908436] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T21:50:50.602263] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-23T21:50:51.282449] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-23T21:50:51.402146] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-23T21:50:51.567030] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T21:50:52.133206] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T21:50:52.202225] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-23T21:50:53.002210] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-23T21:50:53.217747] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T21:50:53.606290] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T21:50:53.802230] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-23T21:50:54.048787] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T21:50:54.602252] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-23T21:50:55.190390] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T21:50:55.402173] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-23T21:50:55.960476] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-23T21:50:56.202242] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-23T21:50:56.881375] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T21:50:57.002206] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-23T21:50:57.514203] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T21:50:57.802202] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-23T21:50:58.255624] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T21:50:58.602210] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-23T21:50:58.996293] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T21:50:59.402245] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-23T21:51:00.184295] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T21:51:00.207314] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-23T21:51:00.225083] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T21:51:01.002203] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-23T21:51:01.774448] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T21:51:01.783082] [INFO ] [REMOTE ] UNFI: Full fetch complete (58795 records). [2025-09-23T21:51:01.783415] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-23T21:51:01.807437] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-23T21:51:02.233592] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-23T21:51:02.233762] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-23T21:51:02.235214] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-23T21:51:02.235385] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T21:51:02.235545] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-23T21:51:02.240874] [DEBUG] [LOCAL ] UNFI: Trimmed 58795 records to 41876 (keeping 200 days of data) [2025-09-23T21:51:02.493839] [DEBUG] [LOCAL ] UNFI: Primary data saved (41876 records). [2025-09-23T21:51:02.493974] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-23T21:51:02.494059] [INFO ] [MAIN ] Update Progress: 2188/2372 symbols completed. UNFI took 31.7s. Estimated remaining: 24m 28s. Rate: 7.5 symbols/min [2025-09-23T21:51:02.607308] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-23T21:51:02.664342] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:51:02.720965] [DEBUG] [LOCAL ] UNP: Loaded 53234 existing records from primary storage. [2025-09-23T21:51:02.721112] [INFO ] [MAIN ] UNP: Loaded 53234 existing records. [2025-09-23T21:51:02.903027] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:51:02.903337] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-23T21:51:02.903390] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-23T21:51:02.904778] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-23T21:51:02.904841] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-23T21:51:03.274103] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:51:03.402185] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-23T21:51:04.202198] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-23T21:51:04.756861] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T21:51:05.002162] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-23T21:51:05.193241] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-23T21:51:05.312628] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (3.51 seconds). [2025-09-23T21:51:05.461807] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-23T21:51:05.719474] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T21:51:05.802162] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-23T21:51:06.427816] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T21:51:06.602194] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-23T21:51:07.402186] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-23T21:51:07.982757] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T21:51:08.202162] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-23T21:51:08.374901] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T21:51:08.752302] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T21:51:09.002219] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-23T21:51:09.802196] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-23T21:51:10.287329] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T21:51:10.288622] [INFO ] [REMOTE ] UNMA: Full fetch complete (5792 records). [2025-09-23T21:51:10.288723] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-23T21:51:10.607394] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-23T21:51:10.735035] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-23T21:51:10.735195] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-23T21:51:10.735459] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-23T21:51:10.735595] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-23T21:51:10.736269] [DEBUG] [LOCAL ] UNMA: Trimmed 5792 records to 3622 (keeping 200 days of data) [2025-09-23T21:51:10.761033] [DEBUG] [LOCAL ] UNMA: Primary data saved (3622 records). [2025-09-23T21:51:10.761150] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-23T21:51:10.761407] [INFO ] [MAIN ] Update Progress: 2189/2372 symbols completed. UNMA took 22.1s. Estimated remaining: 24m 20s. Rate: 7.5 symbols/min [2025-09-23T21:51:10.940585] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T21:51:10.966799] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:51:11.025241] [DEBUG] [LOCAL ] UP: Loaded 43023 existing records from primary storage. [2025-09-23T21:51:11.025446] [INFO ] [MAIN ] UP: Loaded 43023 existing records. [2025-09-23T21:51:11.206951] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:51:11.207218] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-23T21:51:11.207267] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-23T21:51:11.208144] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-23T21:51:11.208208] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-23T21:51:11.411613] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-23T21:51:11.573811] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:51:12.202232] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-23T21:51:12.441691] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T21:51:13.002269] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-23T21:51:13.802238] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-23T21:51:13.831236] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T21:51:14.602232] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-23T21:51:15.005858] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-23T21:51:15.014306] [INFO ] [REMOTE ] UNM: Full fetch complete (70134 records). [2025-09-23T21:51:15.014458] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-23T21:51:15.434449] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-23T21:51:15.434573] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-23T21:51:15.436068] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-23T21:51:15.436188] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-23T21:51:15.437927] [DEBUG] [LOCAL ] UNM: Trimmed 70134 records to 48702 (keeping 200 days of data) [2025-09-23T21:51:15.565441] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (4.15 seconds). [2025-09-23T21:51:15.579068] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-23T21:51:15.792768] [DEBUG] [LOCAL ] UNM: Primary data saved (48702 records). [2025-09-23T21:51:15.792924] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-23T21:51:15.793030] [INFO ] [MAIN ] Update Progress: 2190/2372 symbols completed. UNM took 33.6s. Estimated remaining: 24m 12s. Rate: 7.5 symbols/min [2025-09-23T21:51:15.966345] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:51:16.019540] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-23T21:51:16.019793] [INFO ] [MAIN ] UPS: Loaded 53710 existing records. [2025-09-23T21:51:16.213729] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:51:16.214224] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-23T21:51:16.214384] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-23T21:51:16.215920] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-23T21:51:16.215986] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-23T21:51:16.505311] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-23T21:51:16.556322] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-23T21:51:16.643547] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:51:16.810857] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-23T21:51:17.002285] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-23T21:51:17.802238] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-23T21:51:18.255305] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-23T21:51:18.369078] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T21:51:18.495910] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T21:51:18.602151] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-23T21:51:19.402218] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-23T21:51:19.671269] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T21:51:20.202159] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-23T21:51:20.568437] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-23T21:51:20.605005] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T21:51:21.002188] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-23T21:51:21.802220] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-23T21:51:22.070013] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-23T21:51:22.315721] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T21:51:22.602232] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-23T21:51:23.337843] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T21:51:23.402173] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-23T21:51:24.202187] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-23T21:51:25.002183] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-23T21:51:25.502836] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-23T21:51:25.573888] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-23T21:51:25.802171] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-23T21:51:25.920189] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T21:51:26.602217] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-23T21:51:26.922992] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T21:51:27.402282] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-23T21:51:28.202257] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-23T21:51:28.656509] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-23T21:51:29.002226] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-23T21:51:29.508369] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (3.71 seconds). [2025-09-23T21:51:29.802270] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-23T21:51:30.338261] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-23T21:51:30.395595] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T21:51:30.461557] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-09-23T21:51:30.602266] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-23T21:51:31.328064] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T21:51:31.338425] [INFO ] [REMOTE ] UNH: Full fetch complete (77864 records). [2025-09-23T21:51:31.338695] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-23T21:51:31.407625] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-23T21:51:31.784242] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-23T21:51:31.784349] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-23T21:51:31.785538] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-23T21:51:31.785622] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-23T21:51:31.787552] [DEBUG] [LOCAL ] UNH: Trimmed 77864 records to 53794 (keeping 200 days of data) [2025-09-23T21:51:31.933973] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T21:51:32.201015] [DEBUG] [LOCAL ] UNH: Primary data saved (53794 records). [2025-09-23T21:51:32.201156] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-23T21:51:32.201244] [INFO ] [MAIN ] Update Progress: 2191/2372 symbols completed. UNH took 53.3s. Estimated remaining: 24m 5s. Rate: 7.5 symbols/min [2025-09-23T21:51:32.213004] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-23T21:51:32.374459] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:51:32.419197] [DEBUG] [LOCAL ] URI: Loaded 36513 existing records from primary storage. [2025-09-23T21:51:32.419382] [INFO ] [MAIN ] URI: Loaded 36513 existing records. [2025-09-23T21:51:32.606697] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:51:32.606951] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-23T21:51:32.607001] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-23T21:51:32.608006] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-23T21:51:32.608071] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-23T21:51:32.980756] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:51:33.002170] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-23T21:51:33.037184] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T21:51:33.074431] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T21:51:33.083451] [INFO ] [REMOTE ] UNP: Full fetch complete (76898 records). [2025-09-23T21:51:33.083610] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-23T21:51:33.475876] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-23T21:51:33.475960] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-23T21:51:33.477153] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-23T21:51:33.477216] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-23T21:51:33.478798] [DEBUG] [LOCAL ] UNP: Trimmed 76898 records to 53245 (keeping 200 days of data) [2025-09-23T21:51:33.802246] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-23T21:51:33.821227] [DEBUG] [LOCAL ] UNP: Primary data saved (53245 records). [2025-09-23T21:51:33.821381] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-23T21:51:33.821470] [INFO ] [MAIN ] Update Progress: 2192/2372 symbols completed. UNP took 31.3s. Estimated remaining: 23m 56s. Rate: 7.5 symbols/min [2025-09-23T21:51:34.008933] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:51:34.043818] [DEBUG] [LOCAL ] USA: Loaded 36159 existing records from primary storage. [2025-09-23T21:51:34.043962] [INFO ] [MAIN ] USA: Loaded 36159 existing records. [2025-09-23T21:51:34.221568] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:51:34.221958] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-23T21:51:34.222007] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-23T21:51:34.222817] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-23T21:51:34.222876] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-23T21:51:34.596148] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:51:34.607536] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-23T21:51:34.617454] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T21:51:35.402173] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-23T21:51:35.561732] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T21:51:35.571311] [INFO ] [REMOTE ] UP: Full fetch complete (62020 records). [2025-09-23T21:51:35.571498] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-23T21:51:35.769454] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T21:51:36.000094] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-23T21:51:36.000177] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-23T21:51:36.001562] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-23T21:51:36.001629] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-23T21:51:36.003395] [DEBUG] [LOCAL ] UP: Trimmed 62020 records to 43073 (keeping 200 days of data) [2025-09-23T21:51:36.207494] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-23T21:51:36.249024] [DEBUG] [LOCAL ] UP: Primary data saved (43073 records). [2025-09-23T21:51:36.249162] [INFO ] [MAIN ] UP: Full history saved. [2025-09-23T21:51:36.249247] [INFO ] [MAIN ] Update Progress: 2193/2372 symbols completed. UP took 25.5s. Estimated remaining: 23m 48s. Rate: 7.5 symbols/min [2025-09-23T21:51:36.419904] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:51:36.445857] [DEBUG] [LOCAL ] USAC: Loaded 22907 existing records from primary storage. [2025-09-23T21:51:36.446048] [INFO ] [MAIN ] USAC: Loaded 22907 existing records. [2025-09-23T21:51:36.635443] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:51:36.635743] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-23T21:51:36.635796] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-23T21:51:36.636395] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-23T21:51:36.636453] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-23T21:51:36.992568] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:51:37.002149] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-23T21:51:37.668022] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-23T21:51:37.741323] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T21:51:37.762351] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T21:51:37.802142] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-23T21:51:38.602204] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-23T21:51:39.109578] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T21:51:39.402200] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-23T21:51:40.035195] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T21:51:40.202216] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-23T21:51:41.002252] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-23T21:51:41.464869] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-23T21:51:41.549739] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T21:51:41.802151] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-23T21:51:41.837885] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T21:51:42.602226] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-23T21:51:43.074959] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T21:51:43.402203] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-23T21:51:44.191476] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T21:51:44.202147] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-23T21:51:44.249879] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T21:51:45.002212] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-23T21:51:45.802335] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-23T21:51:45.951942] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T21:51:46.174910] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T21:51:46.602252] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-23T21:51:47.109442] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T21:51:47.370736] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T21:51:47.402165] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-23T21:51:48.202216] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-23T21:51:48.389701] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T21:51:49.002207] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-23T21:51:49.802198] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-23T21:51:49.977053] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:51:50.602170] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-23T21:51:50.808821] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T21:51:51.001888] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-23T21:51:51.402200] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-23T21:51:52.137165] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T21:51:52.202161] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-23T21:51:52.915878] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T21:51:53.002206] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-23T21:51:53.594923] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T21:51:53.802243] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-23T21:51:54.124350] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T21:51:54.602255] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-23T21:51:55.185575] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T21:51:55.402269] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-23T21:51:55.741384] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T21:51:55.747682] [INFO ] [REMOTE ] USAC: Full fetch complete (35753 records). [2025-09-23T21:51:55.747940] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-23T21:51:56.147279] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-23T21:51:56.147388] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-23T21:51:56.148623] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-23T21:51:56.148709] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-23T21:51:56.149834] [DEBUG] [LOCAL ] USAC: Trimmed 35753 records to 22901 (keeping 200 days of data) [2025-09-23T21:51:56.206365] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-23T21:51:56.305627] [DEBUG] [LOCAL ] USAC: Primary data saved (22901 records). [2025-09-23T21:51:56.305891] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-23T21:51:56.306029] [INFO ] [MAIN ] Update Progress: 2194/2372 symbols completed. USAC took 20.1s. Estimated remaining: 23m 41s. Rate: 7.5 symbols/min [2025-09-23T21:51:56.484517] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:51:56.547106] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-23T21:51:56.547358] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-09-23T21:51:56.747385] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:51:56.747981] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-23T21:51:56.748038] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-23T21:51:56.749306] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-23T21:51:56.749372] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-23T21:51:57.006815] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-23T21:51:57.111058] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T21:51:57.190373] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:51:57.675949] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T21:51:57.802206] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-23T21:51:58.602238] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-23T21:51:59.254279] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T21:51:59.260673] [INFO ] [REMOTE ] URI: Full fetch complete (53818 records). [2025-09-23T21:51:59.260842] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-23T21:51:59.417617] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-23T21:51:59.608951] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T21:51:59.709731] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-23T21:51:59.709881] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-23T21:51:59.710845] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-23T21:51:59.710924] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-23T21:51:59.712306] [DEBUG] [LOCAL ] URI: Trimmed 53818 records to 36431 (keeping 200 days of data) [2025-09-23T21:51:59.838054] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-23T21:51:59.991281] [DEBUG] [LOCAL ] URI: Primary data saved (36431 records). [2025-09-23T21:51:59.991420] [INFO ] [MAIN ] URI: Full history saved. [2025-09-23T21:51:59.991505] [INFO ] [MAIN ] Update Progress: 2195/2372 symbols completed. URI took 27.8s. Estimated remaining: 23m 33s. Rate: 7.5 symbols/min [2025-09-23T21:52:00.187681] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:00.202245] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-23T21:52:00.247991] [DEBUG] [LOCAL ] USFD: Loaded 51236 existing records from primary storage. [2025-09-23T21:52:00.248149] [INFO ] [MAIN ] USFD: Loaded 51236 existing records. [2025-09-23T21:52:00.426777] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:00.427089] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-23T21:52:00.427144] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-23T21:52:00.428186] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-23T21:52:00.428246] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-23T21:52:00.788821] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:01.002213] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-23T21:52:01.532970] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T21:52:01.649774] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T21:52:01.802184] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-23T21:52:02.378431] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T21:52:02.602174] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-23T21:52:02.681633] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T21:52:02.690744] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-09-23T21:52:02.690873] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-23T21:52:03.081504] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-23T21:52:03.081668] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-23T21:52:03.082785] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-23T21:52:03.082849] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-23T21:52:03.084369] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 53710 (keeping 200 days of data) [2025-09-23T21:52:03.403752] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-23T21:52:03.430208] [DEBUG] [LOCAL ] UPS: Primary data saved (53710 records). [2025-09-23T21:52:03.430332] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-23T21:52:03.430431] [INFO ] [MAIN ] Update Progress: 2196/2372 symbols completed. UPS took 47.6s. Estimated remaining: 23m 24s. Rate: 7.5 symbols/min [2025-09-23T21:52:03.609981] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:03.628515] [DEBUG] [LOCAL ] USNA: Loaded 18228 existing records from primary storage. [2025-09-23T21:52:03.628714] [INFO ] [MAIN ] USNA: Loaded 18228 existing records. [2025-09-23T21:52:03.819127] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:03.819446] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-23T21:52:03.819497] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-23T21:52:03.820071] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-23T21:52:03.820132] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-23T21:52:04.204051] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-23T21:52:04.203983] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:04.475099] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-23T21:52:04.957304] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T21:52:04.964237] [INFO ] [REMOTE ] USA: Full fetch complete (51615 records). [2025-09-23T21:52:04.964347] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-23T21:52:05.012325] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-23T21:52:05.370862] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-23T21:52:05.370949] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-23T21:52:05.371859] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-23T21:52:05.371924] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-23T21:52:05.373078] [DEBUG] [LOCAL ] USA: Trimmed 51615 records to 36108 (keeping 200 days of data) [2025-09-23T21:52:05.596905] [DEBUG] [LOCAL ] USA: Primary data saved (36108 records). [2025-09-23T21:52:05.597052] [INFO ] [MAIN ] USA: Full history saved. [2025-09-23T21:52:05.597141] [INFO ] [MAIN ] Update Progress: 2197/2372 symbols completed. USA took 31.8s. Estimated remaining: 23m 16s. Rate: 7.5 symbols/min [2025-09-23T21:52:05.802157] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-23T21:52:06.304538] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-23T21:52:06.602194] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-23T21:52:08.085128] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-09-23T21:52:08.096131] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-23T21:52:08.168356] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-23T21:52:08.202138] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-23T21:52:08.694638] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-23T21:52:08.904301] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T21:52:09.002246] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-23T21:52:09.546513] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T21:52:09.700314] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T21:52:09.802210] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-23T21:52:10.602229] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-23T21:52:11.168149] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T21:52:11.402232] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-23T21:52:11.664877] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T21:52:12.202207] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-23T21:52:13.002208] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-23T21:52:13.174847] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:52:13.226329] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T21:52:13.802216] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-23T21:52:14.602365] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-23T21:52:14.771602] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:52:14.937371] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T21:52:15.402223] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-23T21:52:16.166094] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T21:52:16.202154] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-23T21:52:16.918057] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T21:52:17.002186] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-23T21:52:17.802170] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-23T21:52:17.911560] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T21:52:18.035741] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T21:52:18.602198] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-23T21:52:19.402193] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-23T21:52:19.746764] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T21:52:20.202173] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-23T21:52:20.424989] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T21:52:20.459354] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T21:52:21.002196] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-23T21:52:21.802185] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-23T21:52:21.999364] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T21:52:22.010097] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T21:52:22.602232] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-23T21:52:23.161714] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T21:52:23.402221] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-23T21:52:23.433187] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T21:52:23.436198] [INFO ] [REMOTE ] USNA: Full fetch complete (26505 records). [2025-09-23T21:52:23.436273] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-23T21:52:23.837371] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-23T21:52:23.837464] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-23T21:52:23.838113] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-23T21:52:23.838177] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-23T21:52:23.840147] [DEBUG] [LOCAL ] USNA: Trimmed 26505 records to 18221 (keeping 200 days of data) [2025-09-23T21:52:23.959405] [DEBUG] [LOCAL ] USNA: Primary data saved (18221 records). [2025-09-23T21:52:23.959609] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-23T21:52:23.959756] [INFO ] [MAIN ] Update Progress: 2198/2372 symbols completed. USNA took 20.5s. Estimated remaining: 23m 9s. Rate: 7.5 symbols/min [2025-09-23T21:52:24.202227] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-23T21:52:25.034632] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T21:52:25.043103] [INFO ] [REMOTE ] USFD: Full fetch complete (73901 records). [2025-09-23T21:52:25.043296] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-23T21:52:25.443709] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-23T21:52:25.443795] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-23T21:52:25.444850] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-23T21:52:25.444911] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-23T21:52:25.446345] [DEBUG] [LOCAL ] USFD: Trimmed 73901 records to 51227 (keeping 200 days of data) [2025-09-23T21:52:25.775784] [DEBUG] [LOCAL ] USFD: Primary data saved (51227 records). [2025-09-23T21:52:25.776061] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-23T21:52:25.776294] [INFO ] [MAIN ] Update Progress: 2199/2372 symbols completed. USFD took 25.8s. Estimated remaining: 23m 0s. Rate: 7.5 symbols/min [2025-09-23T21:52:25.898083] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T21:52:25.910816] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-23T21:52:26.614387] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T21:52:26.623866] [INFO ] [REMOTE ] USB: Full fetch complete (77709 records). [2025-09-23T21:52:26.623997] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-23T21:52:27.026493] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-23T21:52:27.026618] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-23T21:52:27.027932] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-23T21:52:27.028010] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-23T21:52:27.032420] [DEBUG] [LOCAL ] USB: Trimmed 77709 records to 53688 (keeping 200 days of data) [2025-09-23T21:52:27.374179] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-09-23T21:52:27.374328] [INFO ] [MAIN ] USB: Full history saved. [2025-09-23T21:52:27.374476] [INFO ] [MAIN ] Update Progress: 2200/2372 symbols completed. USB took 31.1s. Estimated remaining: 22m 52s. Rate: 7.5 symbols/min [2025-09-23T21:52:28.093738] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:28.059333] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:28.134379] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:28.135800] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:28.188122] [DEBUG] [LOCAL ] UTL: Loaded 11018 existing records from primary storage. [2025-09-23T21:52:28.176101] [DEBUG] [LOCAL ] USPH: Loaded 16607 existing records from primary storage. [2025-09-23T21:52:28.188343] [INFO ] [MAIN ] USPH: Loaded 16607 existing records. [2025-09-23T21:52:28.188552] [INFO ] [MAIN ] UTL: Loaded 11018 existing records. [2025-09-23T21:52:28.343924] [DEBUG] [LOCAL ] UTF: Loaded 28480 existing records from primary storage. [2025-09-23T21:52:28.376915] [INFO ] [MAIN ] UTF: Loaded 28480 existing records. [2025-09-23T21:52:28.484915] [DEBUG] [LOCAL ] UTI: Loaded 40552 existing records from primary storage. [2025-09-23T21:52:28.529961] [INFO ] [MAIN ] UTI: Loaded 40552 existing records. [2025-09-23T21:52:28.784913] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:28.855538] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:28.867665] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-23T21:52:28.904174] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-23T21:52:28.893676] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-23T21:52:28.903999] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:28.914495] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-23T21:52:28.911154] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-23T21:52:28.915135] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-23T21:52:28.915424] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-23T21:52:28.926091] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-23T21:52:28.931282] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-23T21:52:28.915730] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-23T21:52:28.936502] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-23T21:52:28.964544] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-23T21:52:29.195589] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:29.276750] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-23T21:52:29.285421] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-23T21:52:29.416568] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-23T21:52:29.444167] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-23T21:52:30.094471] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:30.243586] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-23T21:52:30.276935] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:30.326560] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-23T21:52:30.357091] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:30.396489] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-23T21:52:30.546823] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:30.547128] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-23T21:52:31.310419] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T21:52:31.313307] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-23T21:52:31.482205] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T21:52:31.490212] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-23T21:52:31.548166] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T21:52:31.551710] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-23T21:52:31.878882] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T21:52:31.881462] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-23T21:52:32.021399] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T21:52:32.202226] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-23T21:52:32.441803] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T21:52:32.674287] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T21:52:32.765195] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T21:52:33.002199] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-23T21:52:33.648426] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T21:52:33.802221] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-23T21:52:34.208786] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T21:52:34.602227] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-23T21:52:35.142432] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T21:52:35.402201] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-23T21:52:35.450450] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T21:52:36.202212] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-23T21:52:36.254796] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T21:52:37.002203] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-23T21:52:37.194146] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T21:52:37.599490] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T21:52:37.802227] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-23T21:52:38.388612] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T21:52:38.602219] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-23T21:52:39.402206] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-23T21:52:40.158984] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T21:52:40.203741] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-23T21:52:40.206139] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T21:52:41.002229] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-23T21:52:41.533318] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T21:52:41.791841] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T21:52:41.802140] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-23T21:52:42.602251] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-23T21:52:42.643817] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T21:52:43.402228] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-23T21:52:44.192812] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T21:52:44.202220] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-23T21:52:44.415227] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T21:52:45.002169] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-23T21:52:45.151919] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T21:52:45.802254] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-23T21:52:46.602168] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-23T21:52:46.645074] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T21:52:46.722738] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T21:52:46.725956] [INFO ] [REMOTE ] UTL: Full fetch complete (15136 records). [2025-09-23T21:52:46.726062] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-23T21:52:47.137877] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-23T21:52:47.137956] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-23T21:52:47.138347] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-23T21:52:47.138428] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-23T21:52:47.139023] [DEBUG] [LOCAL ] UTL: Trimmed 15136 records to 11057 (keeping 200 days of data) [2025-09-23T21:52:47.211880] [DEBUG] [LOCAL ] UTL: Primary data saved (11057 records). [2025-09-23T21:52:47.212024] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-23T21:52:47.212250] [INFO ] [MAIN ] Update Progress: 2201/2372 symbols completed. UTL took 19.8s. Estimated remaining: 22m 45s. Rate: 7.5 symbols/min [2025-09-23T21:52:47.403183] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-23T21:52:47.407273] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:47.424871] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T21:52:47.477297] [DEBUG] [LOCAL ] UTZ: Loaded 44757 existing records from primary storage. [2025-09-23T21:52:47.477445] [INFO ] [MAIN ] UTZ: Loaded 44757 existing records. [2025-09-23T21:52:47.655422] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:47.655848] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-23T21:52:47.655913] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-23T21:52:47.657235] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-23T21:52:47.657298] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-23T21:52:48.008230] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:48.202185] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-23T21:52:48.876306] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T21:52:49.002166] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-23T21:52:49.342700] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T21:52:49.802391] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-23T21:52:50.468672] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T21:52:50.602153] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-23T21:52:51.076327] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T21:52:51.402198] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-23T21:52:51.832839] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T21:52:52.202224] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-23T21:52:52.759872] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T21:52:53.002219] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-23T21:52:53.671752] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T21:52:53.802218] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-23T21:52:54.602153] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-23T21:52:55.039989] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T21:52:55.039386] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-23T21:52:55.402274] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-23T21:52:56.206617] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-23T21:52:56.211825] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T21:52:56.748061] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T21:52:56.754458] [INFO ] [REMOTE ] UTI: Full fetch complete (58015 records). [2025-09-23T21:52:56.754569] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-23T21:52:56.967901] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T21:52:57.007366] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-23T21:52:57.043775] [INFO ] [REMOTE ] USPH: Full fetch complete (22471 records). [2025-09-23T21:52:57.079826] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-23T21:52:57.303608] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-23T21:52:57.314111] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-23T21:52:57.354270] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-23T21:52:57.355563] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-23T21:52:57.481014] [DEBUG] [LOCAL ] UTI: Trimmed 58015 records to 40514 (keeping 200 days of data) [2025-09-23T21:52:57.655787] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-23T21:52:57.656444] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-23T21:52:57.657341] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-23T21:52:57.657692] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-23T21:52:57.660875] [DEBUG] [LOCAL ] USPH: Trimmed 22471 records to 16579 (keeping 200 days of data) [2025-09-23T21:52:57.839374] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-23T21:52:57.886162] [DEBUG] [LOCAL ] USPH: Primary data saved (16579 records). [2025-09-23T21:52:57.888893] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-23T21:52:57.889321] [INFO ] [MAIN ] Update Progress: 2202/2372 symbols completed. USPH took 30.5s. Estimated remaining: 22m 37s. Rate: 7.5 symbols/min [2025-09-23T21:52:58.087690] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:58.111670] [DEBUG] [LOCAL ] UTI: Primary data saved (40514 records). [2025-09-23T21:52:58.111808] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-23T21:52:58.111909] [INFO ] [MAIN ] Update Progress: 2203/2372 symbols completed. UTI took 30.7s. Estimated remaining: 22m 28s. Rate: 7.5 symbols/min [2025-09-23T21:52:58.304175] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:52:58.305559] [DEBUG] [LOCAL ] UVE: Loaded 21834 existing records from primary storage. [2025-09-23T21:52:58.305753] [INFO ] [MAIN ] UVE: Loaded 21834 existing records. [2025-09-23T21:52:58.456866] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T21:52:58.542416] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:58.542992] [DEBUG] [LOCAL ] UVV: Loaded 22336 existing records from primary storage. [2025-09-23T21:52:58.543211] [INFO ] [MAIN ] UVV: Loaded 22336 existing records. [2025-09-23T21:52:58.543495] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-23T21:52:58.608000] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-23T21:52:58.587263] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-23T21:52:58.627578] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-23T21:52:58.638970] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-23T21:52:58.855941] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:52:58.890248] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-23T21:52:58.898926] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-23T21:52:58.914992] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-23T21:52:58.952608] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-23T21:52:59.294164] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:59.407269] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-23T21:52:59.492782] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:52:59.793064] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T21:52:59.890132] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T21:53:00.034509] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T21:53:00.202203] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-23T21:53:01.002178] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-23T21:53:01.300300] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T21:53:01.802201] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-23T21:53:01.999965] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T21:53:02.602237] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-23T21:53:03.402209] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-23T21:53:03.505230] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T21:53:03.615212] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T21:53:04.202205] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-23T21:53:04.314866] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-23T21:53:05.002218] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-23T21:53:05.481458] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T21:53:05.802186] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-23T21:53:06.007204] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T21:53:06.602192] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-23T21:53:07.399890] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T21:53:07.409327] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-23T21:53:07.455827] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T21:53:08.202194] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-23T21:53:08.373529] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T21:53:09.002209] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-23T21:53:09.600088] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T21:53:09.802194] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-23T21:53:09.979142] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T21:53:10.602168] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-23T21:53:10.985034] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T21:53:11.402213] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-23T21:53:11.439366] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T21:53:12.202181] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-23T21:53:12.647786] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T21:53:13.002160] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-23T21:53:13.336480] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T21:53:13.805930] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T21:53:13.804716] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-23T21:53:14.602185] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-23T21:53:14.912743] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T21:53:15.402191] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-23T21:53:15.890981] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T21:53:16.202209] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-23T21:53:16.661882] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T21:53:16.855466] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T21:53:17.002246] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-23T21:53:17.802217] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-23T21:53:18.278333] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T21:53:18.284820] [INFO ] [REMOTE ] UTF: Full fetch complete (41156 records). [2025-09-23T21:53:18.284929] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-23T21:53:18.603808] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-23T21:53:18.709239] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-23T21:53:18.709322] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-23T21:53:18.710148] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-23T21:53:18.710210] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-23T21:53:18.711132] [DEBUG] [LOCAL ] UTF: Trimmed 41156 records to 28596 (keeping 200 days of data) [2025-09-23T21:53:18.823433] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T21:53:18.839876] [INFO ] [REMOTE ] UVE: Full fetch complete (29552 records). [2025-09-23T21:53:18.841374] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-23T21:53:19.259251] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-23T21:53:19.259922] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-23T21:53:19.261163] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-23T21:53:19.261734] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-23T21:53:19.266354] [DEBUG] [LOCAL ] UVE: Trimmed 29552 records to 21861 (keeping 200 days of data) [2025-09-23T21:53:19.422706] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-23T21:53:19.449157] [DEBUG] [LOCAL ] UVE: Primary data saved (21861 records). [2025-09-23T21:53:19.455335] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-23T21:53:19.456065] [INFO ] [MAIN ] Update Progress: 2204/2372 symbols completed. UVE took 21.6s. Estimated remaining: 22m 21s. Rate: 7.5 symbols/min [2025-09-23T21:53:19.568572] [DEBUG] [LOCAL ] UTF: Primary data saved (28596 records). [2025-09-23T21:53:19.569045] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-23T21:53:19.574540] [INFO ] [MAIN ] Update Progress: 2205/2372 symbols completed. UTF took 52.2s. Estimated remaining: 22m 13s. Rate: 7.5 symbols/min [2025-09-23T21:53:19.728459] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:53:19.827042] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:53:19.839328] [DEBUG] [LOCAL ] UZD: Loaded 6314 existing records from primary storage. [2025-09-23T21:53:19.839489] [INFO ] [MAIN ] UZD: Loaded 6314 existing records. [2025-09-23T21:53:20.047376] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:53:20.061872] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-23T21:53:20.062231] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-23T21:53:20.063255] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-23T21:53:20.063399] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-23T21:53:20.063190] [DEBUG] [LOCAL ] UWMC: Loaded 52726 existing records from primary storage. [2025-09-23T21:53:20.063687] [INFO ] [MAIN ] UWMC: Loaded 52726 existing records. [2025-09-23T21:53:20.131796] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T21:53:20.283706] [INFO ] [REMOTE ] UTZ: Full fetch complete (63638 records). [2025-09-23T21:53:20.300061] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-23T21:53:20.586278] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:53:20.640777] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-23T21:53:20.715704] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-23T21:53:20.735566] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-23T21:53:20.764311] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-23T21:53:21.013505] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:53:21.034513] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-23T21:53:21.137676] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T21:53:21.209341] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-23T21:53:21.404431] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-23T21:53:21.411852] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-23T21:53:21.428835] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-23T21:53:21.431895] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-23T21:53:21.483020] [DEBUG] [LOCAL ] UTZ: Trimmed 63638 records to 44740 (keeping 200 days of data) [2025-09-23T21:53:21.583481] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:53:21.803256] [DEBUG] [LOCAL ] UTZ: Primary data saved (44740 records). [2025-09-23T21:53:21.803496] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-23T21:53:21.803361] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-23T21:53:21.804492] [INFO ] [MAIN ] Update Progress: 2206/2372 symbols completed. UTZ took 34.6s. Estimated remaining: 22m 4s. Rate: 7.5 symbols/min [2025-09-23T21:53:21.912208] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T21:53:22.005414] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:53:22.015631] [DEBUG] [LOCAL ] UZE: Loaded 7454 existing records from primary storage. [2025-09-23T21:53:22.015823] [INFO ] [MAIN ] UZE: Loaded 7454 existing records. [2025-09-23T21:53:22.209311] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:53:22.209581] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-23T21:53:22.209634] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-23T21:53:22.210029] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-23T21:53:22.210091] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-23T21:53:22.604155] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-23T21:53:22.636311] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:53:22.653258] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T21:53:23.368241] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T21:53:23.402171] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-23T21:53:23.812294] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-23T21:53:24.196228] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T21:53:24.202170] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-23T21:53:24.930638] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T21:53:25.002235] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-23T21:53:25.729635] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T21:53:25.802188] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-23T21:53:26.522809] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T21:53:26.602200] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-23T21:53:27.402279] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-23T21:53:28.202173] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-23T21:53:28.239060] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T21:53:28.575696] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T21:53:28.905745] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T21:53:29.002213] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-23T21:53:29.630162] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T21:53:29.802224] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-23T21:53:30.602158] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-23T21:53:30.913220] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T21:53:30.917149] [INFO ] [REMOTE ] UVV: Full fetch complete (29718 records). [2025-09-23T21:53:30.917233] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-23T21:53:31.290608] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-23T21:53:31.290742] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-23T21:53:31.291380] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-23T21:53:31.291441] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-23T21:53:31.292176] [DEBUG] [LOCAL ] UVV: Trimmed 29718 records to 22410 (keeping 200 days of data) [2025-09-23T21:53:31.409958] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-23T21:53:31.427767] [DEBUG] [LOCAL ] UVV: Primary data saved (22410 records). [2025-09-23T21:53:31.427892] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-23T21:53:31.427991] [INFO ] [MAIN ] Update Progress: 2207/2372 symbols completed. UVV took 33.3s. Estimated remaining: 21m 56s. Rate: 7.5 symbols/min [2025-09-23T21:53:31.598772] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:53:31.607340] [DEBUG] [LOCAL ] UZF: Loaded 6456 existing records from primary storage. [2025-09-23T21:53:31.607472] [INFO ] [MAIN ] UZF: Loaded 6456 existing records. [2025-09-23T21:53:31.791404] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:53:31.791818] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-23T21:53:31.791872] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-23T21:53:31.792189] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-23T21:53:31.792268] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-23T21:53:32.046753] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T21:53:32.176201] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:53:32.203312] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-23T21:53:32.203217] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T21:53:32.975995] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T21:53:33.002247] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-23T21:53:33.407671] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T21:53:33.802246] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-23T21:53:34.565588] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T21:53:34.602200] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-23T21:53:35.402172] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-23T21:53:35.421529] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T21:53:36.202171] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-23T21:53:36.225872] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T21:53:36.898865] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T21:53:37.002173] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-23T21:53:37.802263] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-23T21:53:37.859425] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T21:53:38.404773] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T21:53:38.602242] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-23T21:53:39.328131] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T21:53:39.402178] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-23T21:53:40.147630] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T21:53:40.202153] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-23T21:53:40.774458] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T21:53:40.775709] [INFO ] [REMOTE ] UZD: Full fetch complete (9383 records). [2025-09-23T21:53:40.775782] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-23T21:53:41.007282] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-23T21:53:41.146101] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-23T21:53:41.146178] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-23T21:53:41.146427] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-23T21:53:41.146468] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-23T21:53:41.146925] [DEBUG] [LOCAL ] UZD: Trimmed 9383 records to 6309 (keeping 200 days of data) [2025-09-23T21:53:41.184595] [DEBUG] [LOCAL ] UZD: Primary data saved (6309 records). [2025-09-23T21:53:41.184736] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-23T21:53:41.184828] [INFO ] [MAIN ] Update Progress: 2208/2372 symbols completed. UZD took 21.6s. Estimated remaining: 21m 49s. Rate: 7.5 symbols/min [2025-09-23T21:53:41.362001] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:53:41.422387] [DEBUG] [LOCAL ] V: Loaded 53763 existing records from primary storage. [2025-09-23T21:53:41.422556] [INFO ] [MAIN ] V: Loaded 53763 existing records. [2025-09-23T21:53:41.604385] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:53:41.604737] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-23T21:53:41.604793] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-23T21:53:41.606246] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-23T21:53:41.606306] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-23T21:53:41.767271] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T21:53:41.812378] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-23T21:53:41.827817] [INFO ] [REMOTE ] UZE: Full fetch complete (10135 records). [2025-09-23T21:53:41.852201] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-23T21:53:42.122089] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:53:42.360595] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-23T21:53:42.360715] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-23T21:53:42.361012] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-23T21:53:42.361051] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-23T21:53:42.361711] [DEBUG] [LOCAL ] UZE: Trimmed 10135 records to 7458 (keeping 200 days of data) [2025-09-23T21:53:42.408235] [DEBUG] [LOCAL ] UZE: Primary data saved (7458 records). [2025-09-23T21:53:42.408374] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-23T21:53:42.408461] [INFO ] [MAIN ] Update Progress: 2209/2372 symbols completed. UZE took 20.6s. Estimated remaining: 21m 40s. Rate: 7.5 symbols/min [2025-09-23T21:53:42.575689] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:53:42.608493] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-23T21:53:42.610925] [DEBUG] [LOCAL ] VAC: Loaded 34656 existing records from primary storage. [2025-09-23T21:53:42.611011] [INFO ] [MAIN ] VAC: Loaded 34656 existing records. [2025-09-23T21:53:42.790661] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:53:42.790963] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-23T21:53:42.791012] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-23T21:53:42.791872] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-23T21:53:42.791933] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-23T21:53:43.151359] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:53:43.402217] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-23T21:53:43.722194] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T21:53:43.967668] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T21:53:44.202258] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-23T21:53:44.481585] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T21:53:45.002264] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-23T21:53:45.679246] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T21:53:45.731390] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T21:53:45.802194] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-23T21:53:46.602214] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-23T21:53:47.402166] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-23T21:53:47.574582] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T21:53:48.202193] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-23T21:53:48.626624] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T21:53:49.002185] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-23T21:53:49.060912] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-23T21:53:49.803263] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T21:53:49.803371] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-23T21:53:49.832760] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:53:50.602172] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-23T21:53:51.061514] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T21:53:51.402249] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-23T21:53:52.202197] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-23T21:53:52.747938] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-23T21:53:53.002230] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-23T21:53:53.280981] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T21:53:53.315603] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T21:53:53.802206] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-23T21:53:54.602220] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-23T21:53:55.077734] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T21:53:55.203666] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T21:53:55.402202] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-23T21:53:55.645305] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T21:53:56.202224] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-23T21:53:56.778119] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T21:53:57.002210] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-23T21:53:57.551405] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T21:53:57.807358] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-23T21:53:57.823807] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-23T21:53:58.602202] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-23T21:53:59.318917] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T21:53:59.406863] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-23T21:53:59.408719] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T21:54:00.202200] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-23T21:54:01.002258] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-23T21:54:01.083958] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T21:54:01.085299] [INFO ] [REMOTE ] UZF: Full fetch complete (8737 records). [2025-09-23T21:54:01.085373] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-23T21:54:01.486738] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-23T21:54:01.486901] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-23T21:54:01.487216] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-23T21:54:01.487369] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-23T21:54:01.488262] [DEBUG] [LOCAL ] UZF: Trimmed 8737 records to 6444 (keeping 200 days of data) [2025-09-23T21:54:01.553014] [DEBUG] [LOCAL ] UZF: Primary data saved (6444 records). [2025-09-23T21:54:01.553262] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-23T21:54:01.553761] [INFO ] [MAIN ] Update Progress: 2210/2372 symbols completed. UZF took 30.1s. Estimated remaining: 21m 33s. Rate: 7.5 symbols/min [2025-09-23T21:54:01.556427] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-23T21:54:01.654050] [INFO ] [REMOTE ] UWMC: Full fetch complete (75416 records). [2025-09-23T21:54:01.676699] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-23T21:54:01.805822] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-23T21:54:01.877122] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:02.226388] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-23T21:54:02.226510] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-23T21:54:02.227796] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-23T21:54:02.227885] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-23T21:54:02.229854] [DEBUG] [LOCAL ] VAL: Loaded 50453 existing records from primary storage. [2025-09-23T21:54:02.230461] [INFO ] [MAIN ] VAL: Loaded 50453 existing records. [2025-09-23T21:54:02.318196] [DEBUG] [LOCAL ] UWMC: Trimmed 75416 records to 52739 (keeping 200 days of data) [2025-09-23T21:54:02.554770] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:02.561016] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-23T21:54:02.568677] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-23T21:54:02.616385] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-23T21:54:02.625917] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-23T21:54:03.131405] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:54:03.132615] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-23T21:54:03.150117] [DEBUG] [LOCAL ] UWMC: Primary data saved (52739 records). [2025-09-23T21:54:03.150215] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-23T21:54:03.150292] [INFO ] [MAIN ] Update Progress: 2211/2372 symbols completed. UWMC took 43.7s. Estimated remaining: 21m 24s. Rate: 7.5 symbols/min [2025-09-23T21:54:03.320614] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:03.372791] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-23T21:54:03.372941] [INFO ] [MAIN ] VALE: Loaded 53694 existing records. [2025-09-23T21:54:03.551611] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:03.551907] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-23T21:54:03.552699] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-23T21:54:03.553825] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-23T21:54:03.553885] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-23T21:54:03.917869] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:54:03.918206] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-23T21:54:03.969784] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-23T21:54:04.202215] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-23T21:54:04.239487] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-23T21:54:05.002246] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-23T21:54:05.509868] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-23T21:54:05.802210] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-23T21:54:06.594381] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T21:54:06.603892] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-23T21:54:06.829488] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-23T21:54:07.257152] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T21:54:07.351957] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (3.15 seconds). [2025-09-23T21:54:07.402189] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-23T21:54:07.611917] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T21:54:08.202204] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-23T21:54:09.002217] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-23T21:54:09.460895] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-23T21:54:09.615925] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T21:54:09.802191] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-23T21:54:10.602198] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-23T21:54:11.234194] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-23T21:54:11.402180] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-23T21:54:11.488539] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T21:54:12.202171] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-23T21:54:12.364365] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T21:54:13.002247] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-23T21:54:13.519513] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-23T21:54:13.622962] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T21:54:13.802240] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-23T21:54:14.602231] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-23T21:54:15.027244] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T21:54:15.402197] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-23T21:54:15.497285] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T21:54:15.687299] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-23T21:54:15.696719] [INFO ] [REMOTE ] V: Full fetch complete (77829 records). [2025-09-23T21:54:15.696900] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-23T21:54:16.079011] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T21:54:16.135190] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-23T21:54:16.135294] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-23T21:54:16.136611] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-23T21:54:16.136702] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-23T21:54:16.138275] [DEBUG] [LOCAL ] V: Trimmed 77829 records to 53763 (keeping 200 days of data) [2025-09-23T21:54:16.204536] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-23T21:54:16.477844] [DEBUG] [LOCAL ] V: Primary data saved (53763 records). [2025-09-23T21:54:16.477995] [INFO ] [MAIN ] V: Full history saved. [2025-09-23T21:54:16.478085] [INFO ] [MAIN ] Update Progress: 2212/2372 symbols completed. V took 35.3s. Estimated remaining: 21m 17s. Rate: 7.5 symbols/min [2025-09-23T21:54:16.647837] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:16.654823] [DEBUG] [LOCAL ] VATE: Loaded 5717 existing records from primary storage. [2025-09-23T21:54:16.654914] [INFO ] [MAIN ] VATE: Loaded 5717 existing records. [2025-09-23T21:54:16.829864] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:16.830166] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-23T21:54:16.830248] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-23T21:54:16.830735] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-23T21:54:16.830818] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-23T21:54:17.007960] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-23T21:54:17.217950] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:54:17.802195] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-23T21:54:18.026259] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T21:54:18.375702] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T21:54:18.602274] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-23T21:54:19.012070] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T21:54:19.402273] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-23T21:54:19.482469] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T21:54:19.488049] [INFO ] [REMOTE ] VAC: Full fetch complete (47723 records). [2025-09-23T21:54:19.488165] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-23T21:54:19.876277] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-23T21:54:19.876382] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-23T21:54:19.877430] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-23T21:54:19.877506] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-23T21:54:19.878908] [DEBUG] [LOCAL ] VAC: Trimmed 47723 records to 34611 (keeping 200 days of data) [2025-09-23T21:54:20.097306] [DEBUG] [LOCAL ] VAC: Primary data saved (34611 records). [2025-09-23T21:54:20.097459] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-23T21:54:20.097566] [INFO ] [MAIN ] Update Progress: 2213/2372 symbols completed. VAC took 37.7s. Estimated remaining: 21m 9s. Rate: 7.5 symbols/min [2025-09-23T21:54:20.207354] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-23T21:54:20.275333] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:20.287080] [DEBUG] [LOCAL ] VBF: Loaded 7121 existing records from primary storage. [2025-09-23T21:54:20.287209] [INFO ] [MAIN ] VBF: Loaded 7121 existing records. [2025-09-23T21:54:20.477954] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:20.478456] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-23T21:54:20.478528] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-23T21:54:20.478978] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-23T21:54:20.479050] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-23T21:54:20.600417] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T21:54:20.875729] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:54:21.002204] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-23T21:54:21.802219] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-23T21:54:21.872982] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T21:54:21.947547] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T21:54:22.602261] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-23T21:54:23.402239] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-23T21:54:23.853289] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T21:54:24.202270] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-23T21:54:25.002190] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-23T21:54:25.038310] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (3.24 seconds). [2025-09-23T21:54:25.167538] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T21:54:25.366455] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-23T21:54:25.605046] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-23T21:54:25.802264] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-23T21:54:26.602264] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-23T21:54:27.402220] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-23T21:54:27.450797] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T21:54:27.504492] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T21:54:27.810639] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-23T21:54:28.202210] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-23T21:54:29.002196] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-23T21:54:29.649784] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T21:54:29.772180] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T21:54:29.780410] [INFO ] [REMOTE ] VAL: Full fetch complete (73287 records). [2025-09-23T21:54:29.780538] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-23T21:54:29.810791] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-23T21:54:30.180818] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-23T21:54:30.180926] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-23T21:54:30.182218] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-23T21:54:30.182281] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-23T21:54:30.183803] [DEBUG] [LOCAL ] VAL: Trimmed 73287 records to 50437 (keeping 200 days of data) [2025-09-23T21:54:30.484591] [DEBUG] [LOCAL ] VAL: Primary data saved (50437 records). [2025-09-23T21:54:30.484774] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-23T21:54:30.484873] [INFO ] [MAIN ] Update Progress: 2214/2372 symbols completed. VAL took 28.9s. Estimated remaining: 21m 1s. Rate: 7.5 symbols/min [2025-09-23T21:54:30.603325] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-23T21:54:30.609442] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T21:54:30.670129] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:30.685401] [DEBUG] [LOCAL ] VCV: Loaded 13355 existing records from primary storage. [2025-09-23T21:54:30.685546] [INFO ] [MAIN ] VCV: Loaded 13355 existing records. [2025-09-23T21:54:30.866902] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:30.867192] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-23T21:54:30.867284] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-23T21:54:30.867809] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-23T21:54:30.867870] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-23T21:54:31.238278] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:54:31.395439] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T21:54:31.402132] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-23T21:54:32.029210] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T21:54:32.202200] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-23T21:54:32.687353] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-23T21:54:33.002198] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-23T21:54:33.701281] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T21:54:33.802228] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-23T21:54:34.381330] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T21:54:34.602193] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-23T21:54:35.261334] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T21:54:35.402239] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-23T21:54:35.865943] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T21:54:35.867717] [INFO ] [REMOTE ] VATE: Full fetch complete (10537 records). [2025-09-23T21:54:35.867791] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-23T21:54:36.206411] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-23T21:54:36.231627] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-23T21:54:36.231738] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-23T21:54:36.232307] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-23T21:54:36.232366] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-23T21:54:36.232862] [DEBUG] [LOCAL ] VATE: Trimmed 10537 records to 5673 (keeping 200 days of data) [2025-09-23T21:54:36.265778] [DEBUG] [LOCAL ] VATE: Primary data saved (5673 records). [2025-09-23T21:54:36.265871] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-23T21:54:36.265947] [INFO ] [MAIN ] Update Progress: 2215/2372 symbols completed. VATE took 19.8s. Estimated remaining: 20m 53s. Rate: 7.5 symbols/min [2025-09-23T21:54:36.438199] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:36.483014] [DEBUG] [LOCAL ] VEEV: Loaded 47404 existing records from primary storage. [2025-09-23T21:54:36.483167] [INFO ] [MAIN ] VEEV: Loaded 47404 existing records. [2025-09-23T21:54:36.663318] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:36.663589] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-23T21:54:36.663637] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-23T21:54:36.664889] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-23T21:54:36.664952] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-23T21:54:37.018006] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-23T21:54:37.074934] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:54:37.338895] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T21:54:37.802221] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-23T21:54:37.822983] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T21:54:38.601470] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T21:54:38.604030] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-23T21:54:39.351448] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T21:54:39.402145] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-23T21:54:40.048109] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T21:54:40.049773] [INFO ] [REMOTE ] VBF: Full fetch complete (10353 records). [2025-09-23T21:54:40.049849] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-23T21:54:40.206247] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-23T21:54:40.430150] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-23T21:54:40.430239] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-23T21:54:40.430516] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-23T21:54:40.430555] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-23T21:54:40.431189] [DEBUG] [LOCAL ] VBF: Trimmed 10353 records to 7089 (keeping 200 days of data) [2025-09-23T21:54:40.476689] [DEBUG] [LOCAL ] VBF: Primary data saved (7089 records). [2025-09-23T21:54:40.476816] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-23T21:54:40.476922] [INFO ] [MAIN ] Update Progress: 2216/2372 symbols completed. VBF took 20.4s. Estimated remaining: 20m 44s. Rate: 7.5 symbols/min [2025-09-23T21:54:40.654873] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:40.671674] [DEBUG] [LOCAL ] VEL: Loaded 13060 existing records from primary storage. [2025-09-23T21:54:40.671869] [INFO ] [MAIN ] VEL: Loaded 13060 existing records. [2025-09-23T21:54:40.861801] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:40.862037] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-23T21:54:40.862085] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-23T21:54:40.862487] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-23T21:54:40.862552] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-23T21:54:41.013325] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-23T21:54:41.242478] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:54:41.802161] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-23T21:54:41.884186] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T21:54:42.277907] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-23T21:54:42.602226] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-23T21:54:43.402173] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-23T21:54:43.464241] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T21:54:43.541562] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T21:54:44.202184] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-23T21:54:45.002185] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-23T21:54:45.463279] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T21:54:45.518193] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T21:54:45.802163] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-23T21:54:45.887268] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T21:54:46.602188] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-23T21:54:46.716282] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T21:54:47.402177] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-23T21:54:47.483013] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T21:54:48.097558] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T21:54:48.202161] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-23T21:54:49.002186] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-23T21:54:49.728478] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T21:54:49.802168] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-23T21:54:50.258562] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-23T21:54:50.602199] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-23T21:54:50.784099] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T21:54:51.402248] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-23T21:54:52.202166] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-23T21:54:52.431197] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T21:54:52.564678] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T21:54:52.573774] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-09-23T21:54:52.573904] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-23T21:54:52.988603] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-23T21:54:52.988791] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-23T21:54:52.989946] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-23T21:54:52.990041] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-23T21:54:52.992765] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 53694 (keeping 200 days of data) [2025-09-23T21:54:53.002281] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-23T21:54:53.370525] [DEBUG] [LOCAL ] VALE: Primary data saved (53694 records). [2025-09-23T21:54:53.370864] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-23T21:54:53.371142] [INFO ] [MAIN ] Update Progress: 2217/2372 symbols completed. VALE took 50.2s. Estimated remaining: 20m 37s. Rate: 7.5 symbols/min [2025-09-23T21:54:53.547981] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:53.599526] [DEBUG] [LOCAL ] VET: Loaded 44141 existing records from primary storage. [2025-09-23T21:54:53.599691] [INFO ] [MAIN ] VET: Loaded 44141 existing records. [2025-09-23T21:54:53.782382] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:53.782903] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-23T21:54:53.783285] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-23T21:54:53.784615] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-23T21:54:53.784727] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-23T21:54:53.814232] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-23T21:54:53.915484] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T21:54:53.998002] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T21:54:54.208626] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:54:54.602213] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-23T21:54:54.859757] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T21:54:55.402194] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-23T21:54:56.202216] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-23T21:54:56.256626] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T21:54:56.349679] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T21:54:57.002201] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-23T21:54:57.211265] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T21:54:57.802212] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-23T21:54:58.608045] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-23T21:54:58.611278] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T21:54:58.640899] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T21:54:58.645717] [INFO ] [REMOTE ] VCV: Full fetch complete (19594 records). [2025-09-23T21:54:58.645934] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-23T21:54:59.051375] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-23T21:54:59.051509] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-23T21:54:59.052192] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-23T21:54:59.052257] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-23T21:54:59.053516] [DEBUG] [LOCAL ] VCV: Trimmed 19594 records to 13406 (keeping 200 days of data) [2025-09-23T21:54:59.157534] [DEBUG] [LOCAL ] VCV: Primary data saved (13406 records). [2025-09-23T21:54:59.157786] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-23T21:54:59.157982] [INFO ] [MAIN ] Update Progress: 2218/2372 symbols completed. VCV took 28.7s. Estimated remaining: 20m 29s. Rate: 7.5 symbols/min [2025-09-23T21:54:59.340485] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:54:59.402232] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-23T21:54:59.425379] [DEBUG] [LOCAL ] VFC: Loaded 53611 existing records from primary storage. [2025-09-23T21:54:59.425600] [INFO ] [MAIN ] VFC: Loaded 53611 existing records. [2025-09-23T21:54:59.619008] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:54:59.619448] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-23T21:54:59.619516] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-23T21:54:59.621109] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-23T21:54:59.621172] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-23T21:55:00.033411] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:55:00.203936] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-23T21:55:00.223867] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T21:55:00.433318] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T21:55:01.002251] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-23T21:55:01.802238] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-23T21:55:02.246454] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T21:55:02.458465] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T21:55:02.602206] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-23T21:55:03.402183] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-23T21:55:03.485264] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T21:55:03.533019] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T21:55:04.202248] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-23T21:55:05.002274] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-23T21:55:05.041326] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T21:55:05.802191] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-23T21:55:06.087968] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T21:55:06.488333] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T21:55:06.602234] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-23T21:55:07.336097] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T21:55:07.401344] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T21:55:07.404669] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-23T21:55:08.202195] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-23T21:55:09.002201] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-23T21:55:09.148632] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T21:55:09.485101] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T21:55:09.487798] [INFO ] [REMOTE ] VEL: Full fetch complete (16679 records). [2025-09-23T21:55:09.487874] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-23T21:55:09.807399] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-23T21:55:09.893585] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-23T21:55:09.893719] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-23T21:55:09.894136] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-23T21:55:09.894287] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-23T21:55:09.904982] [DEBUG] [LOCAL ] VEL: Trimmed 16679 records to 13126 (keeping 200 days of data) [2025-09-23T21:55:09.923076] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T21:55:10.017597] [DEBUG] [LOCAL ] VEL: Primary data saved (13126 records). [2025-09-23T21:55:10.017782] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-23T21:55:10.017917] [INFO ] [MAIN ] Update Progress: 2219/2372 symbols completed. VEL took 29.5s. Estimated remaining: 20m 21s. Rate: 7.5 symbols/min [2025-09-23T21:55:10.193470] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:55:10.193679] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-23T21:55:10.193734] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-23T21:55:10.193879] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-23T21:55:10.193922] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-23T21:55:10.193968] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-23T21:55:10.194000] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-23T21:55:10.607361] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-23T21:55:10.653454] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:55:11.402163] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-23T21:55:11.832247] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-23T21:55:12.202221] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-23T21:55:12.344190] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T21:55:12.982879] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T21:55:13.002143] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-23T21:55:13.802177] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-23T21:55:13.867206] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T21:55:13.880005] [INFO ] [REMOTE ] VEEV: Full fetch complete (68494 records). [2025-09-23T21:55:13.880209] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-23T21:55:14.280573] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-23T21:55:14.280682] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-23T21:55:14.281719] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-23T21:55:14.281782] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-23T21:55:14.283181] [DEBUG] [LOCAL ] VEEV: Trimmed 68494 records to 47275 (keeping 200 days of data) [2025-09-23T21:55:14.594829] [DEBUG] [LOCAL ] VEEV: Primary data saved (47275 records). [2025-09-23T21:55:14.594964] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-23T21:55:14.595105] [INFO ] [MAIN ] Update Progress: 2220/2372 symbols completed. VEEV took 38.3s. Estimated remaining: 20m 13s. Rate: 7.5 symbols/min [2025-09-23T21:55:14.617901] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-23T21:55:14.793807] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:55:14.804318] [DEBUG] [LOCAL ] VGI: Loaded 5195 existing records from primary storage. [2025-09-23T21:55:14.804480] [INFO ] [MAIN ] VGI: Loaded 5195 existing records. [2025-09-23T21:55:14.920000] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:55:14.960972] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-23T21:55:15.001115] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:55:15.001715] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-23T21:55:15.001858] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-23T21:55:15.002309] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-23T21:55:15.002377] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-23T21:55:15.323801] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-23T21:55:15.428253] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:55:15.403095] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-23T21:55:15.457300] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T21:55:16.202282] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-23T21:55:17.002203] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-23T21:55:17.441836] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T21:55:17.602329] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T21:55:17.760938] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T21:55:17.802253] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-23T21:55:18.526273] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T21:55:18.602572] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-23T21:55:19.402203] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-23T21:55:19.982177] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T21:55:20.124840] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T21:55:20.202170] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-23T21:55:21.002208] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-23T21:55:21.808305] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-23T21:55:21.816141] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T21:55:21.849565] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T21:55:22.402586] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T21:55:22.602204] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-23T21:55:23.402199] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-23T21:55:24.075483] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T21:55:24.085195] [INFO ] [REMOTE ] VET: Full fetch complete (64320 records). [2025-09-23T21:55:24.085375] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-23T21:55:24.207319] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-23T21:55:24.489134] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-23T21:55:24.489226] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-23T21:55:24.490291] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-23T21:55:24.490357] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-23T21:55:24.493912] [DEBUG] [LOCAL ] VET: Trimmed 64320 records to 44097 (keeping 200 days of data) [2025-09-23T21:55:24.757254] [DEBUG] [LOCAL ] VET: Primary data saved (44097 records). [2025-09-23T21:55:24.757379] [INFO ] [MAIN ] VET: Full history saved. [2025-09-23T21:55:24.757474] [INFO ] [MAIN ] Update Progress: 2221/2372 symbols completed. VET took 31.4s. Estimated remaining: 20m 5s. Rate: 7.5 symbols/min [2025-09-23T21:55:24.931197] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:55:24.936251] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T21:55:24.954377] [DEBUG] [LOCAL ] VGM: Loaded 18209 existing records from primary storage. [2025-09-23T21:55:24.954505] [INFO ] [MAIN ] VGM: Loaded 18209 existing records. [2025-09-23T21:55:25.007281] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-23T21:55:25.140958] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:55:25.141430] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-23T21:55:25.141506] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-23T21:55:25.142134] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-23T21:55:25.142195] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-23T21:55:25.470713] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-23T21:55:25.547403] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:55:25.802183] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-23T21:55:26.226697] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T21:55:26.602172] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-23T21:55:27.039229] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T21:55:27.402204] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-23T21:55:28.130859] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T21:55:28.202155] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-23T21:55:28.324025] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T21:55:28.742187] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T21:55:29.002253] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-23T21:55:29.620891] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T21:55:29.802186] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-23T21:55:30.390521] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T21:55:30.602199] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-23T21:55:31.221962] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T21:55:31.402283] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-23T21:55:32.202204] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-23T21:55:32.924979] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T21:55:32.927158] [INFO ] [REMOTE ] VGI: Full fetch complete (7764 records). [2025-09-23T21:55:32.927293] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-23T21:55:33.003370] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-23T21:55:33.315224] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-23T21:55:33.315433] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-23T21:55:33.315856] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-23T21:55:33.315984] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-23T21:55:33.316811] [DEBUG] [LOCAL ] VGI: Trimmed 7764 records to 5174 (keeping 200 days of data) [2025-09-23T21:55:33.365285] [DEBUG] [LOCAL ] VGI: Primary data saved (5174 records). [2025-09-23T21:55:33.379155] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-23T21:55:33.379271] [INFO ] [MAIN ] Update Progress: 2222/2372 symbols completed. VGI took 18.8s. Estimated remaining: 19m 57s. Rate: 7.5 symbols/min [2025-09-23T21:55:33.413851] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-23T21:55:33.567135] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:55:33.572177] [DEBUG] [LOCAL ] VHI: Loaded 2896 existing records from primary storage. [2025-09-23T21:55:33.572285] [INFO ] [MAIN ] VHI: Loaded 2896 existing records. [2025-09-23T21:55:33.754459] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:55:33.755253] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-23T21:55:33.755324] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-23T21:55:33.755841] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-23T21:55:33.755904] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-23T21:55:33.810899] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-23T21:55:33.888916] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T21:55:34.142599] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:55:34.602200] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-23T21:55:35.402224] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-23T21:55:35.917542] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T21:55:35.979264] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T21:55:36.202161] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-23T21:55:36.643214] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T21:55:37.002247] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-23T21:55:37.665938] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T21:55:37.802184] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-23T21:55:38.184240] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T21:55:38.572754] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T21:55:38.602169] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-23T21:55:39.083084] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T21:55:39.402196] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-23T21:55:40.202169] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-23T21:55:40.473299] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T21:55:41.002200] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-23T21:55:41.802220] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-23T21:55:42.223010] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-23T21:55:42.243010] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T21:55:42.602203] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-23T21:55:43.023013] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T21:55:43.184429] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T21:55:43.402283] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-23T21:55:43.806457] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T21:55:44.202206] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-23T21:55:44.773202] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T21:55:45.002225] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-23T21:55:45.802184] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-23T21:55:46.101345] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T21:55:46.602205] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-23T21:55:47.402221] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-23T21:55:47.655969] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T21:55:47.988628] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T21:55:47.988427] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-23T21:55:48.202213] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-23T21:55:48.692389] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T21:55:49.002204] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-23T21:55:49.802236] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-23T21:55:50.261163] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T21:55:50.262193] [INFO ] [REMOTE ] VHI: Full fetch complete (4621 records). [2025-09-23T21:55:50.262263] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-23T21:55:50.615301] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-23T21:55:50.623544] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-23T21:55:50.623763] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-23T21:55:50.623923] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-23T21:55:50.623964] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-23T21:55:50.624332] [DEBUG] [LOCAL ] VHI: Trimmed 4621 records to 2886 (keeping 200 days of data) [2025-09-23T21:55:50.643076] [DEBUG] [LOCAL ] VHI: Primary data saved (2886 records). [2025-09-23T21:55:50.643157] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-23T21:55:50.643563] [INFO ] [MAIN ] Update Progress: 2223/2372 symbols completed. VHI took 17.3s. Estimated remaining: 19m 50s. Rate: 7.5 symbols/min [2025-09-23T21:55:50.816984] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:55:50.817228] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-23T21:55:50.817302] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-23T21:55:50.817552] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-23T21:55:50.817704] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-23T21:55:50.817837] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-23T21:55:50.817887] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-23T21:55:51.016845] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-23T21:55:51.111274] [INFO ] [REMOTE ] VFC: Full fetch complete (77587 records). [2025-09-23T21:55:51.130010] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-23T21:55:51.329606] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:55:51.418008] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-23T21:55:51.630812] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-23T21:55:51.630901] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-23T21:55:51.632121] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-23T21:55:51.632188] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-23T21:55:51.633964] [DEBUG] [LOCAL ] VFC: Trimmed 77587 records to 53611 (keeping 200 days of data) [2025-09-23T21:55:51.733231] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:55:51.746745] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-23T21:55:51.976835] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T21:55:52.009840] [DEBUG] [LOCAL ] VFC: Primary data saved (53611 records). [2025-09-23T21:55:52.009994] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-23T21:55:52.010085] [INFO ] [MAIN ] Update Progress: 2224/2372 symbols completed. VFC took 52.9s. Estimated remaining: 19m 41s. Rate: 7.5 symbols/min [2025-09-23T21:55:52.191522] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:55:52.202206] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-23T21:55:52.249152] [DEBUG] [LOCAL ] VICI: Loaded 53649 existing records from primary storage. [2025-09-23T21:55:52.249304] [INFO ] [MAIN ] VICI: Loaded 53649 existing records. [2025-09-23T21:55:52.439436] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:55:52.439741] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-23T21:55:52.439803] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-23T21:55:52.441298] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-23T21:55:52.441360] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-23T21:55:52.803097] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:55:53.002163] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-23T21:55:53.256108] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T21:55:53.802221] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-23T21:55:54.602203] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-23T21:55:54.915816] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T21:55:54.933692] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:55:54.934202] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-23T21:55:54.957849] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T21:55:54.961809] [INFO ] [REMOTE ] VGM: Full fetch complete (26201 records). [2025-09-23T21:55:54.961931] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-23T21:55:55.344206] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-23T21:55:55.344295] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-23T21:55:55.345166] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-23T21:55:55.345254] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-23T21:55:55.346179] [DEBUG] [LOCAL ] VGM: Trimmed 26201 records to 18238 (keeping 200 days of data) [2025-09-23T21:55:55.404116] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-23T21:55:55.462437] [DEBUG] [LOCAL ] VGM: Primary data saved (18238 records). [2025-09-23T21:55:55.462587] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-23T21:55:55.462703] [INFO ] [MAIN ] Update Progress: 2225/2372 symbols completed. VGM took 30.7s. Estimated remaining: 19m 33s. Rate: 7.5 symbols/min [2025-09-23T21:55:55.636793] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:55:55.689525] [DEBUG] [LOCAL ] VIK: Loaded 52512 existing records from primary storage. [2025-09-23T21:55:55.689735] [INFO ] [MAIN ] VIK: Loaded 52512 existing records. [2025-09-23T21:55:55.891523] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:55:55.891833] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-23T21:55:55.891889] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-23T21:55:55.894089] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-23T21:55:55.894151] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-23T21:55:56.207445] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-23T21:55:56.277415] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:55:56.458604] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:55:56.458943] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-23T21:55:57.002166] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-23T21:55:57.249087] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:55:57.249349] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-23T21:55:57.302990] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T21:55:57.802219] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-23T21:55:58.602203] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-23T21:55:59.402215] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-23T21:55:59.534491] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T21:56:00.202263] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-23T21:56:00.385114] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T21:56:01.002194] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-23T21:56:01.322759] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-23T21:56:01.332080] [INFO ] [REMOTE ] VG: Full fetch complete (64510 records). [2025-09-23T21:56:01.332260] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-23T21:56:01.548415] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-23T21:56:01.549127] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:56:01.549202] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:56:01.549277] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-23T21:56:01.549347] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-23T21:56:01.549386] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-23T21:56:01.549442] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-23T21:56:01.549580] [INFO ] [MAIN ] Update Progress: 2226/2372 symbols completed. VG took 51.5s. Estimated remaining: 19m 25s. Rate: 7.5 symbols/min [2025-09-23T21:56:01.736192] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:56:01.800466] [DEBUG] [LOCAL ] VIPS: Loaded 51368 existing records from primary storage. [2025-09-23T21:56:01.800639] [INFO ] [MAIN ] VIPS: Loaded 51368 existing records. [2025-09-23T21:56:01.834900] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-23T21:56:02.033991] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:56:02.034293] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-23T21:56:02.034406] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-23T21:56:02.035842] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-23T21:56:02.035908] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-23T21:56:02.268248] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:56:02.319858] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-23T21:56:02.412811] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-23T21:56:02.491049] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:56:02.525715] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T21:56:02.602210] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-23T21:56:03.402242] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-23T21:56:03.599715] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:56:03.600147] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-23T21:56:04.202262] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-23T21:56:04.402506] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:56:04.402869] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-23T21:56:04.651685] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-23T21:56:05.002208] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-23T21:56:05.802218] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-23T21:56:06.007252] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:56:06.007576] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-23T21:56:06.602174] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-23T21:56:06.723636] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T21:56:07.402207] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-23T21:56:08.031924] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T21:56:08.202200] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-23T21:56:09.002192] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-23T21:56:09.205909] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:56:09.206258] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-23T21:56:09.386950] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-23T21:56:09.802190] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-23T21:56:09.987962] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T21:56:10.602276] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-23T21:56:11.402279] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-23T21:56:11.674029] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-23T21:56:12.202196] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-23T21:56:12.307028] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T21:56:13.002175] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-23T21:56:13.131473] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T21:56:13.156363] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T21:56:13.159814] [INFO ] [REMOTE ] VIA: Full fetch complete (2133 records). [2025-09-23T21:56:13.159883] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-23T21:56:13.361622] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 8 unique days, need 200 days [2025-09-23T21:56:13.361873] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:56:13.361943] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:56:13.362038] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-23T21:56:13.362168] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-23T21:56:13.362238] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-23T21:56:13.362313] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-23T21:56:13.362439] [INFO ] [MAIN ] Update Progress: 2227/2372 symbols completed. VIA took 22.7s. Estimated remaining: 19m 17s. Rate: 7.5 symbols/min [2025-09-23T21:56:13.549337] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:56:13.595506] [DEBUG] [LOCAL ] VIRT: Loaded 46913 existing records from primary storage. [2025-09-23T21:56:13.595700] [INFO ] [MAIN ] VIRT: Loaded 46913 existing records. [2025-09-23T21:56:13.792435] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:56:13.792783] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-23T21:56:13.792839] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-23T21:56:13.794040] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-23T21:56:13.794126] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-23T21:56:13.807568] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-23T21:56:14.177189] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:56:14.602215] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-23T21:56:14.673231] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T21:56:15.402195] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-23T21:56:15.585365] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T21:56:16.202180] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-23T21:56:16.336381] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T21:56:16.521583] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T21:56:17.002209] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-23T21:56:17.802220] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-23T21:56:17.950116] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T21:56:18.163363] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T21:56:18.602242] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-23T21:56:19.402184] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-23T21:56:19.727318] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-23T21:56:20.122870] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T21:56:20.202191] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-23T21:56:21.002255] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-23T21:56:21.292381] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T21:56:21.794368] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T21:56:21.803172] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-23T21:56:21.806257] [INFO ] [REMOTE ] VICI: Full fetch complete (77653 records). [2025-09-23T21:56:21.806457] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-23T21:56:22.276879] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-23T21:56:22.278446] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-23T21:56:22.278339] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T21:56:22.279971] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-23T21:56:22.280086] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-23T21:56:22.292325] [DEBUG] [LOCAL ] VICI: Trimmed 77653 records to 53649 (keeping 200 days of data) [2025-09-23T21:56:22.607544] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-23T21:56:22.655804] [DEBUG] [LOCAL ] VICI: Primary data saved (53649 records). [2025-09-23T21:56:22.655933] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-23T21:56:22.656032] [INFO ] [MAIN ] Update Progress: 2228/2372 symbols completed. VICI took 30.6s. Estimated remaining: 19m 9s. Rate: 7.5 symbols/min [2025-09-23T21:56:22.842126] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:56:22.884838] [DEBUG] [LOCAL ] VIST: Loaded 45968 existing records from primary storage. [2025-09-23T21:56:22.884986] [INFO ] [MAIN ] VIST: Loaded 45968 existing records. [2025-09-23T21:56:23.062762] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:56:23.063139] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-23T21:56:23.063195] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-23T21:56:23.064352] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-23T21:56:23.064412] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-23T21:56:23.415566] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:56:23.409615] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-23T21:56:23.651000] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T21:56:24.202240] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-23T21:56:24.466708] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T21:56:24.875029] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T21:56:25.002232] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-23T21:56:25.539878] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T21:56:25.802257] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-23T21:56:26.602216] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-23T21:56:26.841006] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T21:56:26.998668] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T21:56:27.402210] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-23T21:56:28.202243] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-23T21:56:28.312534] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T21:56:28.999233] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T21:56:29.007872] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-23T21:56:29.010314] [INFO ] [REMOTE ] VIK: Full fetch complete (75850 records). [2025-09-23T21:56:29.010567] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-23T21:56:29.539599] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-23T21:56:29.539761] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-23T21:56:29.541112] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-23T21:56:29.541182] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-23T21:56:29.542896] [DEBUG] [LOCAL ] VIK: Trimmed 75850 records to 52512 (keeping 200 days of data) [2025-09-23T21:56:29.810065] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-23T21:56:29.854997] [DEBUG] [LOCAL ] VIK: Primary data saved (52512 records). [2025-09-23T21:56:29.855110] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-23T21:56:29.855190] [INFO ] [MAIN ] Update Progress: 2229/2372 symbols completed. VIK took 34.4s. Estimated remaining: 19m 1s. Rate: 7.5 symbols/min [2025-09-23T21:56:30.031377] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:56:30.057347] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T21:56:30.105533] [DEBUG] [LOCAL ] VIV: Loaded 45285 existing records from primary storage. [2025-09-23T21:56:30.105780] [INFO ] [MAIN ] VIV: Loaded 45285 existing records. [2025-09-23T21:56:30.281398] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:56:30.281744] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-23T21:56:30.281799] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-23T21:56:30.282832] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-23T21:56:30.282893] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-23T21:56:30.609737] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-23T21:56:30.651237] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:56:30.683349] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T21:56:31.275253] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T21:56:31.402161] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-23T21:56:32.202200] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-23T21:56:32.354389] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T21:56:33.007337] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-23T21:56:33.021892] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T21:56:33.802222] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-23T21:56:33.851794] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T21:56:34.223514] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T21:56:34.602203] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-23T21:56:35.370063] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T21:56:35.402150] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-23T21:56:35.960768] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T21:56:36.202204] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-23T21:56:36.905906] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T21:56:37.002222] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-23T21:56:37.545127] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T21:56:37.802180] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-23T21:56:38.602189] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-23T21:56:38.820289] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T21:56:39.406316] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-23T21:56:39.411365] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T21:56:39.421412] [INFO ] [REMOTE ] VIPS: Full fetch complete (74599 records). [2025-09-23T21:56:39.421570] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-23T21:56:39.828427] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-23T21:56:39.828527] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-23T21:56:39.829751] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-23T21:56:39.829816] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-23T21:56:39.831419] [DEBUG] [LOCAL ] VIPS: Trimmed 74599 records to 51359 (keeping 200 days of data) [2025-09-23T21:56:40.152356] [DEBUG] [LOCAL ] VIPS: Primary data saved (51359 records). [2025-09-23T21:56:40.152631] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-23T21:56:40.152994] [INFO ] [MAIN ] Update Progress: 2230/2372 symbols completed. VIPS took 38.6s. Estimated remaining: 18m 53s. Rate: 7.5 symbols/min [2025-09-23T21:56:40.211639] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-23T21:56:40.337879] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:56:40.366412] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T21:56:40.385463] [INFO ] [REMOTE ] VIRT: Full fetch complete (66867 records). [2025-09-23T21:56:40.385349] [DEBUG] [LOCAL ] VKQ: Loaded 17382 existing records from primary storage. [2025-09-23T21:56:40.385604] [INFO ] [MAIN ] VKQ: Loaded 17382 existing records. [2025-09-23T21:56:40.417352] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-23T21:56:40.703464] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:56:40.754500] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-23T21:56:40.777909] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-23T21:56:40.840340] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-23T21:56:40.857316] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-23T21:56:41.086437] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-23T21:56:41.086583] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-23T21:56:41.088214] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-23T21:56:41.088358] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-23T21:56:41.139410] [DEBUG] [LOCAL ] VIRT: Trimmed 66867 records to 46883 (keeping 200 days of data) [2025-09-23T21:56:41.357485] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T21:56:41.421892] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-23T21:56:41.500349] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:56:41.705974] [DEBUG] [LOCAL ] VIRT: Primary data saved (46883 records). [2025-09-23T21:56:41.706143] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-23T21:56:41.706288] [INFO ] [MAIN ] Update Progress: 2231/2372 symbols completed. VIRT took 28.3s. Estimated remaining: 18m 45s. Rate: 7.5 symbols/min [2025-09-23T21:56:41.803466] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-23T21:56:41.892448] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:56:41.925769] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T21:56:41.960033] [DEBUG] [LOCAL ] VLN: Loaded 28348 existing records from primary storage. [2025-09-23T21:56:41.960193] [INFO ] [MAIN ] VLN: Loaded 28348 existing records. [2025-09-23T21:56:42.145663] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:56:42.145990] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-23T21:56:42.146060] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-23T21:56:42.146801] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-23T21:56:42.146862] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-23T21:56:42.507587] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:56:42.602215] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-23T21:56:42.916628] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T21:56:43.142610] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T21:56:43.402221] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-23T21:56:44.185327] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T21:56:44.202158] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-23T21:56:44.686631] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T21:56:45.002215] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-23T21:56:45.616089] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T21:56:45.802190] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-23T21:56:46.281849] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T21:56:46.602229] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-23T21:56:47.380976] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T21:56:47.402157] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-23T21:56:48.202206] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-23T21:56:48.332474] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T21:56:49.002197] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-23T21:56:49.071497] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T21:56:49.080416] [INFO ] [REMOTE ] VIST: Full fetch complete (66836 records). [2025-09-23T21:56:49.080610] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-23T21:56:49.198096] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T21:56:49.500068] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-23T21:56:49.500179] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-23T21:56:49.501364] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-23T21:56:49.501491] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-23T21:56:49.505058] [DEBUG] [LOCAL ] VIST: Trimmed 66836 records to 46006 (keeping 200 days of data) [2025-09-23T21:56:49.788968] [DEBUG] [LOCAL ] VIST: Primary data saved (46006 records). [2025-09-23T21:56:49.789120] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-23T21:56:49.789264] [INFO ] [MAIN ] Update Progress: 2232/2372 symbols completed. VIST took 27.1s. Estimated remaining: 18m 37s. Rate: 7.5 symbols/min [2025-09-23T21:56:49.810185] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-23T21:56:49.964497] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:56:50.036265] [DEBUG] [LOCAL ] VLO: Loaded 53088 existing records from primary storage. [2025-09-23T21:56:50.036447] [INFO ] [MAIN ] VLO: Loaded 53088 existing records. [2025-09-23T21:56:50.214226] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:56:50.214470] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-23T21:56:50.214526] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-23T21:56:50.215806] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-23T21:56:50.215899] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-23T21:56:50.588831] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:56:50.602143] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-23T21:56:50.682731] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T21:56:51.088258] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T21:56:51.402227] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-23T21:56:52.202241] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-23T21:56:52.421528] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T21:56:52.809169] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T21:56:52.979303] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T21:56:53.002149] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-23T21:56:53.802190] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-23T21:56:54.430336] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T21:56:54.439056] [INFO ] [REMOTE ] VIV: Full fetch complete (64776 records). [2025-09-23T21:56:54.439190] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-23T21:56:54.615012] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-23T21:56:54.830542] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-23T21:56:54.830625] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-23T21:56:54.831665] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-23T21:56:54.831728] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-23T21:56:54.833589] [DEBUG] [LOCAL ] VIV: Trimmed 64776 records to 45188 (keeping 200 days of data) [2025-09-23T21:56:55.119429] [DEBUG] [LOCAL ] VIV: Primary data saved (45188 records). [2025-09-23T21:56:55.119606] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-23T21:56:55.119855] [INFO ] [MAIN ] Update Progress: 2233/2372 symbols completed. VIV took 25.3s. Estimated remaining: 18m 29s. Rate: 7.5 symbols/min [2025-09-23T21:56:55.296895] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:56:55.319745] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T21:56:55.363608] [DEBUG] [LOCAL ] VLRS: Loaded 40969 existing records from primary storage. [2025-09-23T21:56:55.363790] [INFO ] [MAIN ] VLRS: Loaded 40969 existing records. [2025-09-23T21:56:55.407242] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-23T21:56:55.549259] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:56:55.549551] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-23T21:56:55.549614] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-23T21:56:55.550470] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-23T21:56:55.550532] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-23T21:56:55.714156] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T21:56:55.943834] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:56:56.202215] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-23T21:56:56.587507] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T21:56:57.002194] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-23T21:56:57.671213] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T21:56:57.802189] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-23T21:56:58.459470] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T21:56:58.602156] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-23T21:56:58.862697] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T21:56:59.402188] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-23T21:57:00.181285] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T21:57:00.202214] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-23T21:57:00.900603] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T21:57:01.002186] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-23T21:57:01.507281] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T21:57:01.802206] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-23T21:57:02.602177] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-23T21:57:02.971955] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-23T21:57:03.402193] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-23T21:57:04.202202] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-23T21:57:05.049911] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-09-23T21:57:05.055072] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-23T21:57:05.199718] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-23T21:57:05.669171] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-23T21:57:05.802207] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-23T21:57:05.866481] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T21:57:05.915122] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T21:57:06.381512] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T21:57:06.602188] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-23T21:57:07.402173] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-23T21:57:07.551552] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T21:57:08.202237] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-23T21:57:09.002191] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-23T21:57:09.056432] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T21:57:09.802209] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-23T21:57:09.862046] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T21:57:10.221997] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T21:57:10.602203] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-23T21:57:10.990292] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T21:57:11.350557] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T21:57:11.402161] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-23T21:57:12.202232] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-23T21:57:12.805015] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T21:57:12.816233] [INFO ] [REMOTE ] VKQ: Full fetch complete (24538 records). [2025-09-23T21:57:12.816788] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-23T21:57:13.004728] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-23T21:57:13.218058] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-23T21:57:13.218175] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-23T21:57:13.218840] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-23T21:57:13.218904] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-23T21:57:13.219567] [DEBUG] [LOCAL ] VKQ: Trimmed 24538 records to 17404 (keeping 200 days of data) [2025-09-23T21:57:13.332177] [DEBUG] [LOCAL ] VKQ: Primary data saved (17404 records). [2025-09-23T21:57:13.332332] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-23T21:57:13.332477] [INFO ] [MAIN ] Update Progress: 2234/2372 symbols completed. VKQ took 33.2s. Estimated remaining: 18m 21s. Rate: 7.5 symbols/min [2025-09-23T21:57:13.511418] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:57:13.523941] [DEBUG] [LOCAL ] VLT: Loaded 4646 existing records from primary storage. [2025-09-23T21:57:13.524054] [INFO ] [MAIN ] VLT: Loaded 4646 existing records. [2025-09-23T21:57:13.709258] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:57:13.709550] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-23T21:57:13.709601] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-23T21:57:13.709933] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-23T21:57:13.709995] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-23T21:57:13.807422] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-23T21:57:14.064363] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:57:14.602244] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-23T21:57:15.090570] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T21:57:15.123484] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-09-23T21:57:15.184291] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T21:57:15.402170] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-23T21:57:15.761287] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-23T21:57:16.202215] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-23T21:57:16.604283] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T21:57:16.610462] [INFO ] [REMOTE ] VLN: Full fetch complete (43406 records). [2025-09-23T21:57:16.610607] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-23T21:57:16.768159] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T21:57:17.008938] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-23T21:57:17.011747] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-23T21:57:17.012973] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-23T21:57:17.013989] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-23T21:57:17.014054] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-23T21:57:17.015084] [DEBUG] [LOCAL ] VLN: Trimmed 43406 records to 28471 (keeping 200 days of data) [2025-09-23T21:57:17.185142] [DEBUG] [LOCAL ] VLN: Primary data saved (28471 records). [2025-09-23T21:57:17.185299] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-23T21:57:17.185392] [INFO ] [MAIN ] Update Progress: 2235/2372 symbols completed. VLN took 35.5s. Estimated remaining: 18m 13s. Rate: 7.5 symbols/min [2025-09-23T21:57:17.355306] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:57:17.405702] [DEBUG] [LOCAL ] VLTO: Loaded 46032 existing records from primary storage. [2025-09-23T21:57:17.405889] [INFO ] [MAIN ] VLTO: Loaded 46032 existing records. [2025-09-23T21:57:17.598490] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:57:17.598894] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-23T21:57:17.598961] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-23T21:57:17.600352] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-23T21:57:17.600432] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-23T21:57:17.807356] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-23T21:57:17.974266] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:57:18.327119] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T21:57:18.352097] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T21:57:18.602269] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-23T21:57:19.402301] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-23T21:57:20.181817] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T21:57:20.202145] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-23T21:57:21.002208] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-23T21:57:21.640081] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T21:57:21.802249] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-23T21:57:22.433818] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T21:57:22.602452] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-23T21:57:22.943111] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T21:57:22.995372] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (3.59 seconds). [2025-09-23T21:57:23.402213] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-23T21:57:24.202187] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-23T21:57:24.228509] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T21:57:24.956259] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T21:57:25.002211] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-23T21:57:25.216026] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T21:57:25.577818] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T21:57:25.802222] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-23T21:57:26.602278] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-23T21:57:27.402161] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-23T21:57:27.700401] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T21:57:27.763014] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-23T21:57:27.991132] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T21:57:28.202169] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-23T21:57:29.002202] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-23T21:57:29.802237] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-23T21:57:29.873774] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T21:57:30.312845] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T21:57:30.318884] [INFO ] [REMOTE ] VLRS: Full fetch complete (58851 records). [2025-09-23T21:57:30.318985] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-23T21:57:30.606302] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-23T21:57:30.759584] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-23T21:57:30.759782] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-23T21:57:30.760945] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-23T21:57:30.761299] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-23T21:57:30.763361] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T21:57:30.773288] [INFO ] [REMOTE ] VLO: Full fetch complete (76930 records). [2025-09-23T21:57:30.773491] [DEBUG] [LOCAL ] VLRS: Trimmed 58851 records to 40846 (keeping 200 days of data) [2025-09-23T21:57:30.773603] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-23T21:57:31.308440] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-23T21:57:31.308902] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-23T21:57:31.311004] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-23T21:57:31.311114] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-23T21:57:31.318130] [DEBUG] [LOCAL ] VLO: Trimmed 76930 records to 53088 (keeping 200 days of data) [2025-09-23T21:57:31.429862] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-23T21:57:31.569253] [DEBUG] [LOCAL ] VLRS: Primary data saved (40846 records). [2025-09-23T21:57:31.569604] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-23T21:57:31.569773] [INFO ] [MAIN ] Update Progress: 2236/2372 symbols completed. VLRS took 36.4s. Estimated remaining: 18m 6s. Rate: 7.5 symbols/min [2025-09-23T21:57:31.849632] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:57:31.933761] [DEBUG] [LOCAL ] VMC: Loaded 43852 existing records from primary storage. [2025-09-23T21:57:31.933968] [INFO ] [MAIN ] VMC: Loaded 43852 existing records. [2025-09-23T21:57:32.189999] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:57:32.192516] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-23T21:57:32.193229] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-23T21:57:32.195156] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-23T21:57:32.195497] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-23T21:57:32.366422] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T21:57:32.377436] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-23T21:57:32.517118] [DEBUG] [LOCAL ] VLO: Primary data saved (53088 records). [2025-09-23T21:57:32.517762] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-23T21:57:32.529439] [INFO ] [MAIN ] Update Progress: 2237/2372 symbols completed. VLO took 42.7s. Estimated remaining: 17m 57s. Rate: 7.5 symbols/min [2025-09-23T21:57:32.626938] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:57:32.628762] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T21:57:33.002166] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-23T21:57:33.009179] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T21:57:33.802194] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-23T21:57:34.429257] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T21:57:34.430779] [INFO ] [REMOTE ] VLT: Full fetch complete (7522 records). [2025-09-23T21:57:34.430847] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-23T21:57:34.606587] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-23T21:57:34.803490] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-23T21:57:34.803590] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-23T21:57:34.803842] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-23T21:57:34.803917] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-23T21:57:34.813763] [DEBUG] [LOCAL ] VLT: Trimmed 7522 records to 4588 (keeping 200 days of data) [2025-09-23T21:57:34.842964] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T21:57:34.869663] [DEBUG] [LOCAL ] VLT: Primary data saved (4588 records). [2025-09-23T21:57:34.869778] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-23T21:57:34.869899] [INFO ] [MAIN ] Update Progress: 2238/2372 symbols completed. VLT took 21.5s. Estimated remaining: 17m 49s. Rate: 7.5 symbols/min [2025-09-23T21:57:35.402255] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-23T21:57:36.416073] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T21:57:36.425045] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-23T21:57:36.919060] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T21:57:37.002163] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-23T21:57:38.018687] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T21:57:38.027112] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-23T21:57:38.528914] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T21:57:38.602148] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-23T21:57:39.713526] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T21:57:39.722271] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-23T21:57:39.857146] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T21:57:40.202262] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-23T21:57:40.889199] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T21:57:40.897015] [INFO ] [REMOTE ] VLTO: Full fetch complete (66676 records). [2025-09-23T21:57:40.897129] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-23T21:57:41.302801] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-23T21:57:41.302951] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-23T21:57:41.304157] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-23T21:57:41.304223] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-23T21:57:41.305557] [DEBUG] [LOCAL ] VLTO: Trimmed 66676 records to 45994 (keeping 200 days of data) [2025-09-23T21:57:41.579261] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T21:57:41.594987] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-23T21:57:41.631455] [DEBUG] [LOCAL ] VLTO: Primary data saved (45994 records). [2025-09-23T21:57:41.631561] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-23T21:57:41.631638] [INFO ] [MAIN ] Update Progress: 2239/2372 symbols completed. VLTO took 24.4s. Estimated remaining: 17m 41s. Rate: 7.5 symbols/min [2025-09-23T21:57:43.368479] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T21:57:43.378734] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-23T21:57:45.130451] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T21:57:45.140124] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-23T21:57:46.512306] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T21:57:46.521313] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-23T21:57:48.198534] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T21:57:48.208087] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-23T21:57:49.780043] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T21:57:49.789289] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-23T21:57:50.507212] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T21:57:50.514131] [INFO ] [REMOTE ] VMC: Full fetch complete (62671 records). [2025-09-23T21:57:50.514254] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-23T21:57:50.916312] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-23T21:57:50.916430] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-23T21:57:50.917671] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-23T21:57:50.917738] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-23T21:57:50.919185] [DEBUG] [LOCAL ] VMC: Trimmed 62671 records to 43793 (keeping 200 days of data) [2025-09-23T21:57:51.212437] [DEBUG] [LOCAL ] VMC: Primary data saved (43793 records). [2025-09-23T21:57:51.212573] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-23T21:57:51.212682] [INFO ] [MAIN ] Update Progress: 2240/2372 symbols completed. VMC took 19.6s. Estimated remaining: 17m 33s. Rate: 7.5 symbols/min [2025-09-23T21:57:51.798235] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:57:51.880541] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:57:51.912628] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:57:51.965449] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:57:51.989524] [DEBUG] [LOCAL ] VMI: Loaded 15479 existing records from primary storage. [2025-09-23T21:57:51.984114] [DEBUG] [LOCAL ] VNCE: Loaded 6885 existing records from primary storage. [2025-09-23T21:57:51.995372] [INFO ] [MAIN ] VMI: Loaded 15479 existing records. [2025-09-23T21:57:52.013503] [INFO ] [MAIN ] VNCE: Loaded 6885 existing records. [2025-09-23T21:57:52.014080] [DEBUG] [LOCAL ] VMO: Loaded 21015 existing records from primary storage. [2025-09-23T21:57:52.040060] [INFO ] [MAIN ] VMO: Loaded 21015 existing records. [2025-09-23T21:57:52.411373] [DEBUG] [LOCAL ] VNO: Loaded 48973 existing records from primary storage. [2025-09-23T21:57:52.485319] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:57:52.495990] [INFO ] [MAIN ] VNO: Loaded 48973 existing records. [2025-09-23T21:57:52.583226] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:57:52.579794] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-23T21:57:52.640323] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-23T21:57:52.651276] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-23T21:57:52.651396] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-23T21:57:52.669816] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:57:52.670088] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-23T21:57:52.685147] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-23T21:57:52.670280] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-23T21:57:52.685222] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-23T21:57:52.700796] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-23T21:57:52.724055] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-23T21:57:52.812769] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-23T21:57:52.894219] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-23T21:57:53.059124] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:57:53.138351] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-23T21:57:53.138504] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-23T21:57:53.267060] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-23T21:57:53.299072] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-23T21:57:53.895118] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:57:53.994712] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-23T21:57:54.053991] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:57:54.081008] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-23T21:57:54.248702] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:57:54.260957] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-23T21:57:54.341219] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:57:54.341537] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-23T21:57:55.101202] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T21:57:55.104394] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-23T21:57:55.156887] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T21:57:55.161121] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-23T21:57:55.255718] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T21:57:55.261121] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-23T21:57:55.892897] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T21:57:55.903368] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-23T21:57:55.912943] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T21:57:55.916633] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-23T21:57:56.333172] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T21:57:56.338008] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-23T21:57:56.458247] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T21:57:56.463584] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-23T21:57:56.786162] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T21:57:56.789355] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-23T21:57:57.127529] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T21:57:57.130472] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-23T21:57:57.243352] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T21:57:57.253032] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-23T21:57:57.278723] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T21:57:57.284273] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-23T21:57:57.479711] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T21:57:57.512672] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T21:57:57.802251] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-23T21:57:58.248050] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T21:57:58.351240] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T21:57:58.587235] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T21:57:58.602147] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-23T21:57:59.402187] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-23T21:58:00.202157] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-23T21:58:00.300125] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T21:58:00.454884] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T21:58:01.002222] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-23T21:58:01.055552] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T21:58:01.802230] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-23T21:58:02.602186] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-23T21:58:02.733274] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T21:58:02.752764] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T21:58:03.229786] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T21:58:03.402173] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-23T21:58:04.202175] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-23T21:58:04.476408] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T21:58:05.002194] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-23T21:58:05.750871] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T21:58:05.802176] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-23T21:58:05.900721] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T21:58:06.586624] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T21:58:06.602136] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-23T21:58:07.236025] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T21:58:07.402188] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-23T21:58:07.811443] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-23T21:58:08.202196] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-23T21:58:09.002169] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-23T21:58:09.261867] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T21:58:09.802193] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-23T21:58:09.918739] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T21:58:09.923580] [INFO ] [REMOTE ] VNCE: Full fetch complete (15074 records). [2025-09-23T21:58:09.923761] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-23T21:58:10.295837] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-23T21:58:10.295917] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-23T21:58:10.296269] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-23T21:58:10.296306] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-23T21:58:10.296816] [DEBUG] [LOCAL ] VNCE: Trimmed 15074 records to 7130 (keeping 200 days of data) [2025-09-23T21:58:10.336088] [DEBUG] [LOCAL ] VNCE: Primary data saved (7130 records). [2025-09-23T21:58:10.336191] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-23T21:58:10.336272] [INFO ] [MAIN ] Update Progress: 2241/2372 symbols completed. VNCE took 19.1s. Estimated remaining: 17m 26s. Rate: 7.5 symbols/min [2025-09-23T21:58:10.503543] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:58:10.544754] [DEBUG] [LOCAL ] VNT: Loaded 44081 existing records from primary storage. [2025-09-23T21:58:10.544919] [INFO ] [MAIN ] VNT: Loaded 44081 existing records. [2025-09-23T21:58:10.607557] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-23T21:58:10.725390] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:58:10.725635] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-23T21:58:10.725763] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-23T21:58:10.726890] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-23T21:58:10.726953] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-23T21:58:11.027033] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T21:58:11.112248] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:58:11.402339] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-23T21:58:12.202182] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-23T21:58:12.315129] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T21:58:12.356862] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T21:58:13.002246] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-23T21:58:13.684821] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T21:58:13.802226] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-23T21:58:13.914016] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T21:58:14.602233] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-23T21:58:14.829427] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T21:58:15.402261] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-23T21:58:16.210029] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-23T21:58:16.215423] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T21:58:16.758198] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T21:58:16.939575] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T21:58:16.942844] [INFO ] [REMOTE ] VMI: Full fetch complete (21125 records). [2025-09-23T21:58:16.942971] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-23T21:58:17.008307] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-23T21:58:17.345758] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-23T21:58:17.345851] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-23T21:58:17.346386] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-23T21:58:17.346429] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-23T21:58:17.347238] [DEBUG] [LOCAL ] VMI: Trimmed 21125 records to 15478 (keeping 200 days of data) [2025-09-23T21:58:17.447429] [DEBUG] [LOCAL ] VMI: Primary data saved (15478 records). [2025-09-23T21:58:17.447586] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-23T21:58:17.447698] [INFO ] [MAIN ] Update Progress: 2242/2372 symbols completed. VMI took 26.2s. Estimated remaining: 17m 18s. Rate: 7.5 symbols/min [2025-09-23T21:58:17.623462] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:58:17.633808] [DEBUG] [LOCAL ] VOC: Loaded 8930 existing records from primary storage. [2025-09-23T21:58:17.633922] [INFO ] [MAIN ] VOC: Loaded 8930 existing records. [2025-09-23T21:58:17.818769] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-23T21:58:17.824534] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:58:17.825838] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-23T21:58:17.825905] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-23T21:58:17.826336] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-23T21:58:17.826489] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-23T21:58:18.189378] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:58:18.258804] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T21:58:18.263749] [INFO ] [REMOTE ] VMO: Full fetch complete (31492 records). [2025-09-23T21:58:18.263833] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-23T21:58:18.618265] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-23T21:58:18.669993] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-23T21:58:18.670077] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-23T21:58:18.670880] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-23T21:58:18.670943] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-23T21:58:18.671757] [DEBUG] [LOCAL ] VMO: Trimmed 31492 records to 21025 (keeping 200 days of data) [2025-09-23T21:58:18.803689] [DEBUG] [LOCAL ] VMO: Primary data saved (21025 records). [2025-09-23T21:58:18.803821] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-23T21:58:18.803908] [INFO ] [MAIN ] Update Progress: 2243/2372 symbols completed. VMO took 27.6s. Estimated remaining: 17m 9s. Rate: 7.5 symbols/min [2025-09-23T21:58:18.994717] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:58:19.045058] [DEBUG] [LOCAL ] VOYA: Loaded 42881 existing records from primary storage. [2025-09-23T21:58:19.045205] [INFO ] [MAIN ] VOYA: Loaded 42881 existing records. [2025-09-23T21:58:19.236005] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:58:19.236366] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-23T21:58:19.236417] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-23T21:58:19.237498] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-23T21:58:19.237557] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-23T21:58:19.405723] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-23T21:58:19.506904] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T21:58:19.579671] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T21:58:19.659589] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:58:20.202201] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-23T21:58:20.883797] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T21:58:21.002174] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-23T21:58:21.232502] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T21:58:21.802188] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-23T21:58:22.550377] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T21:58:22.602150] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-23T21:58:23.333971] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T21:58:23.402184] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-23T21:58:23.819358] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T21:58:24.202215] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-23T21:58:24.840611] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T21:58:25.002194] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-23T21:58:25.404449] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T21:58:25.413565] [INFO ] [REMOTE ] VNO: Full fetch complete (70481 records). [2025-09-23T21:58:25.413735] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-23T21:58:25.809309] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-23T21:58:25.810929] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-23T21:58:25.810987] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-23T21:58:25.812176] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-23T21:58:25.812351] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-23T21:58:25.813920] [DEBUG] [LOCAL ] VNO: Trimmed 70481 records to 48999 (keeping 200 days of data) [2025-09-23T21:58:26.111617] [DEBUG] [LOCAL ] VNO: Primary data saved (48999 records). [2025-09-23T21:58:26.111797] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-23T21:58:26.111890] [INFO ] [MAIN ] Update Progress: 2244/2372 symbols completed. VNO took 34.9s. Estimated remaining: 17m 1s. Rate: 7.5 symbols/min [2025-09-23T21:58:26.284816] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:58:26.284976] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-23T21:58:26.285013] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-23T21:58:26.285152] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-23T21:58:26.285194] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-23T21:58:26.285235] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-23T21:58:26.285266] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-23T21:58:26.602302] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-23T21:58:26.672246] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:58:26.696410] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T21:58:27.384690] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T21:58:27.402173] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-23T21:58:27.534670] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T21:58:28.202258] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-23T21:58:28.412419] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:58:28.412742] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-23T21:58:29.002223] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-23T21:58:29.086327] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T21:58:29.802231] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-23T21:58:30.026267] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:58:30.026617] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-23T21:58:30.504537] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T21:58:30.602191] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-23T21:58:30.804804] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:58:30.805201] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-23T21:58:31.402232] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-23T21:58:32.202218] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-23T21:58:32.211994] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T21:58:33.002206] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-23T21:58:33.802210] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-23T21:58:33.861092] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T21:58:34.000968] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:58:34.001311] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-23T21:58:34.295787] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T21:58:34.602211] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-23T21:58:35.402227] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-23T21:58:36.203857] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T21:58:36.202186] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-23T21:58:36.234412] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T21:58:37.002224] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-23T21:58:37.809248] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-23T21:58:37.830119] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T21:58:38.042896] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:58:38.043287] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-23T21:58:38.492085] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T21:58:38.499415] [INFO ] [REMOTE ] VNT: Full fetch complete (63487 records). [2025-09-23T21:58:38.499572] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-23T21:58:38.602173] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-23T21:58:38.893383] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-23T21:58:38.893479] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-23T21:58:38.894490] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-23T21:58:38.894554] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-23T21:58:38.895988] [DEBUG] [LOCAL ] VNT: Trimmed 63487 records to 43968 (keeping 200 days of data) [2025-09-23T21:58:39.172852] [DEBUG] [LOCAL ] VNT: Primary data saved (43968 records). [2025-09-23T21:58:39.173033] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-23T21:58:39.173176] [INFO ] [MAIN ] Update Progress: 2245/2372 symbols completed. VNT took 28.8s. Estimated remaining: 16m 54s. Rate: 7.5 symbols/min [2025-09-23T21:58:39.349586] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:58:39.368036] [DEBUG] [LOCAL ] VPG: Loaded 17204 existing records from primary storage. [2025-09-23T21:58:39.368186] [INFO ] [MAIN ] VPG: Loaded 17204 existing records. [2025-09-23T21:58:39.407497] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-23T21:58:39.588596] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:58:39.588896] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-23T21:58:39.588947] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-23T21:58:39.589573] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-23T21:58:39.589689] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-23T21:58:40.011486] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:58:40.156128] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T21:58:40.202150] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-23T21:58:40.225412] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T21:58:41.002211] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-23T21:58:41.807288] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-23T21:58:41.818074] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T21:58:42.014326] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T21:58:42.019516] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T21:58:42.019748] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-23T21:58:42.602226] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-23T21:58:43.402240] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-23T21:58:44.107819] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T21:58:44.175881] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T21:58:44.202145] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-23T21:58:45.002214] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-23T21:58:45.638385] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T21:58:45.646401] [INFO ] [REMOTE ] VOYA: Full fetch complete (62027 records). [2025-09-23T21:58:45.646543] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-23T21:58:45.804566] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-23T21:58:45.962461] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T21:58:46.058087] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-23T21:58:46.058190] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-23T21:58:46.059173] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-23T21:58:46.059235] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-23T21:58:46.061006] [DEBUG] [LOCAL ] VOYA: Trimmed 62027 records to 42835 (keeping 200 days of data) [2025-09-23T21:58:46.337426] [DEBUG] [LOCAL ] VOYA: Primary data saved (42835 records). [2025-09-23T21:58:46.337700] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-23T21:58:46.337934] [INFO ] [MAIN ] Update Progress: 2246/2372 symbols completed. VOYA took 27.5s. Estimated remaining: 16m 45s. Rate: 7.5 symbols/min [2025-09-23T21:58:46.513917] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:58:46.525236] [DEBUG] [LOCAL ] VPV: Loaded 5379 existing records from primary storage. [2025-09-23T21:58:46.525356] [INFO ] [MAIN ] VPV: Loaded 5379 existing records. [2025-09-23T21:58:46.606551] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-23T21:58:46.713132] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:58:46.713537] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-23T21:58:46.713611] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-23T21:58:46.713989] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-23T21:58:46.714063] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-23T21:58:46.828543] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T21:58:47.098713] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:58:47.402199] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-23T21:58:47.489081] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T21:58:48.202210] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-23T21:58:49.002172] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-23T21:58:49.071182] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T21:58:49.207349] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T21:58:49.802164] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-23T21:58:49.923310] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T21:58:50.602201] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-23T21:58:51.402159] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-23T21:58:51.481609] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T21:58:51.709304] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T21:58:52.202205] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-23T21:58:52.719415] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T21:58:53.002226] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-23T21:58:53.802195] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-23T21:58:53.987777] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T21:58:54.067484] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T21:58:54.293995] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T21:58:54.296483] [INFO ] [REMOTE ] VOC: Full fetch complete (13207 records). [2025-09-23T21:58:54.296839] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-23T21:58:54.607298] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-23T21:58:54.675038] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-23T21:58:54.675116] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-23T21:58:54.675574] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-23T21:58:54.675759] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-23T21:58:54.676493] [DEBUG] [LOCAL ] VOC: Trimmed 13207 records to 8936 (keeping 200 days of data) [2025-09-23T21:58:54.744261] [DEBUG] [LOCAL ] VOC: Primary data saved (8936 records). [2025-09-23T21:58:54.744545] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-23T21:58:54.744821] [INFO ] [MAIN ] Update Progress: 2247/2372 symbols completed. VOC took 37.3s. Estimated remaining: 16m 38s. Rate: 7.5 symbols/min [2025-09-23T21:58:54.922303] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:58:54.989618] [DEBUG] [LOCAL ] VRE: Loaded 34931 existing records from primary storage. [2025-09-23T21:58:54.989860] [INFO ] [MAIN ] VRE: Loaded 34931 existing records. [2025-09-23T21:58:55.171108] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:58:55.171361] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-23T21:58:55.171409] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-23T21:58:55.172476] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-23T21:58:55.172597] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-23T21:58:55.407272] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-23T21:58:55.476853] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T21:58:55.552081] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:58:56.202245] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-23T21:58:57.002185] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-23T21:58:57.149379] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T21:58:57.157109] [INFO ] [REMOTE ] VOYG: Full fetch complete (23691 records). [2025-09-23T21:58:57.157335] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-23T21:58:57.334810] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T21:58:57.379151] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-23T21:58:57.379563] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T21:58:57.379661] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T21:58:57.379747] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-23T21:58:57.379840] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-23T21:58:57.379906] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-23T21:58:57.379988] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-23T21:58:57.380081] [INFO ] [MAIN ] Update Progress: 2248/2372 symbols completed. VOYG took 31.3s. Estimated remaining: 16m 29s. Rate: 7.5 symbols/min [2025-09-23T21:58:57.551216] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:58:57.620887] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-23T21:58:57.621035] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-09-23T21:58:57.806159] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-23T21:58:57.811858] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:58:57.806083] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T21:58:57.815245] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-23T21:58:57.815764] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-23T21:58:57.817177] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-23T21:58:57.817240] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-23T21:58:58.167703] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:58:58.602157] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-23T21:58:58.945196] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T21:58:59.199533] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T21:58:59.402243] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-23T21:59:00.202238] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-23T21:59:00.699220] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T21:59:00.707003] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T21:59:01.002204] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-23T21:59:01.802165] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-23T21:59:02.058059] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T21:59:02.405743] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T21:59:02.602205] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-23T21:59:03.402224] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-23T21:59:03.941210] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T21:59:04.003865] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T21:59:04.202206] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-23T21:59:05.002232] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-23T21:59:05.204434] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T21:59:05.802183] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-23T21:59:06.526212] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T21:59:06.602201] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-23T21:59:06.753176] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T21:59:07.402261] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-23T21:59:08.202272] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-23T21:59:08.772190] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T21:59:09.002233] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-23T21:59:09.045848] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T21:59:09.214409] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-23T21:59:09.802179] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-23T21:59:09.873909] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T21:59:09.876949] [INFO ] [REMOTE ] VPG: Full fetch complete (23087 records). [2025-09-23T21:59:09.877027] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-23T21:59:10.246241] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-23T21:59:10.246318] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-23T21:59:10.246820] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-23T21:59:10.246893] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-23T21:59:10.247530] [DEBUG] [LOCAL ] VPG: Trimmed 23087 records to 17231 (keeping 200 days of data) [2025-09-23T21:59:10.355917] [DEBUG] [LOCAL ] VPG: Primary data saved (17231 records). [2025-09-23T21:59:10.356052] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-23T21:59:10.356152] [INFO ] [MAIN ] Update Progress: 2249/2372 symbols completed. VPG took 31.2s. Estimated remaining: 16m 22s. Rate: 7.5 symbols/min [2025-09-23T21:59:10.527093] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:59:10.540263] [DEBUG] [LOCAL ] VRTS: Loaded 9065 existing records from primary storage. [2025-09-23T21:59:10.540395] [INFO ] [MAIN ] VRTS: Loaded 9065 existing records. [2025-09-23T21:59:10.607427] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-23T21:59:10.743358] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:59:10.743799] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-23T21:59:10.743855] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-23T21:59:10.744361] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-23T21:59:10.744421] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-23T21:59:11.126062] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:59:11.402195] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-23T21:59:11.977338] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T21:59:12.201849] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T21:59:12.203205] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-23T21:59:12.337270] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-23T21:59:13.002229] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-23T21:59:13.512917] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T21:59:13.610158] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T21:59:13.802185] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-23T21:59:14.279360] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T21:59:14.281132] [INFO ] [REMOTE ] VPV: Full fetch complete (9386 records). [2025-09-23T21:59:14.281229] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-23T21:59:14.610009] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-23T21:59:14.655366] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-23T21:59:14.655461] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-23T21:59:14.655821] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-23T21:59:14.655884] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-23T21:59:14.656327] [DEBUG] [LOCAL ] VPV: Trimmed 9386 records to 5371 (keeping 200 days of data) [2025-09-23T21:59:14.693873] [DEBUG] [LOCAL ] VPV: Primary data saved (5371 records). [2025-09-23T21:59:14.694011] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-23T21:59:14.694223] [INFO ] [MAIN ] Update Progress: 2250/2372 symbols completed. VPV took 28.4s. Estimated remaining: 16m 13s. Rate: 7.5 symbols/min [2025-09-23T21:59:14.871671] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:59:14.939776] [DEBUG] [LOCAL ] VSCO: Loaded 52886 existing records from primary storage. [2025-09-23T21:59:14.939953] [INFO ] [MAIN ] VSCO: Loaded 52886 existing records. [2025-09-23T21:59:15.116900] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:59:15.117168] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-23T21:59:15.117216] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-23T21:59:15.118427] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-23T21:59:15.118488] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-23T21:59:15.404632] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-23T21:59:15.491149] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:59:16.049367] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T21:59:16.202232] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-23T21:59:16.855531] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T21:59:17.002252] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-23T21:59:17.802176] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-23T21:59:17.943008] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-23T21:59:18.514938] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T21:59:18.528234] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T21:59:18.532143] [INFO ] [REMOTE ] VRE: Full fetch complete (47767 records). [2025-09-23T21:59:18.532322] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-23T21:59:18.607459] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-23T21:59:18.943504] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-23T21:59:18.943603] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-23T21:59:18.945003] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-23T21:59:18.945069] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-23T21:59:18.946528] [DEBUG] [LOCAL ] VRE: Trimmed 47767 records to 34915 (keeping 200 days of data) [2025-09-23T21:59:19.179624] [DEBUG] [LOCAL ] VRE: Primary data saved (34915 records). [2025-09-23T21:59:19.179864] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-23T21:59:19.179978] [INFO ] [MAIN ] Update Progress: 2251/2372 symbols completed. VRE took 24.4s. Estimated remaining: 16m 5s. Rate: 7.5 symbols/min [2025-09-23T21:59:19.354397] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:59:19.405921] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-23T21:59:19.409128] [DEBUG] [LOCAL ] VSH: Loaded 48666 existing records from primary storage. [2025-09-23T21:59:19.409431] [INFO ] [MAIN ] VSH: Loaded 48666 existing records. [2025-09-23T21:59:19.610781] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:59:19.611183] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-23T21:59:19.611236] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-23T21:59:19.613214] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-23T21:59:19.613279] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-23T21:59:19.999190] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:59:20.173328] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T21:59:20.202300] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-23T21:59:21.002178] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-23T21:59:21.092115] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-23T21:59:21.512278] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-23T21:59:21.802285] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-23T21:59:22.042433] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T21:59:22.602217] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-23T21:59:23.256152] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T21:59:23.392573] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T21:59:23.402901] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-23T21:59:24.202235] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-23T21:59:24.402238] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T21:59:25.002204] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-23T21:59:25.802232] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-23T21:59:25.904051] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T21:59:26.602228] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-23T21:59:26.715154] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-23T21:59:27.395063] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T21:59:27.402133] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-23T21:59:27.524430] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T21:59:27.836767] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T21:59:27.838551] [INFO ] [REMOTE ] VRTS: Full fetch complete (11197 records). [2025-09-23T21:59:27.838736] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-23T21:59:28.212350] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-23T21:59:28.222303] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-23T21:59:28.223573] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-23T21:59:28.223926] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-23T21:59:28.223986] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-23T21:59:28.224776] [DEBUG] [LOCAL ] VRTS: Trimmed 11197 records to 9107 (keeping 200 days of data) [2025-09-23T21:59:28.289150] [DEBUG] [LOCAL ] VRTS: Primary data saved (9107 records). [2025-09-23T21:59:28.289325] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-23T21:59:28.289481] [INFO ] [MAIN ] Update Progress: 2252/2372 symbols completed. VRTS took 17.9s. Estimated remaining: 15m 57s. Rate: 7.5 symbols/min [2025-09-23T21:59:28.471024] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:59:28.537308] [DEBUG] [LOCAL ] VST: Loaded 53720 existing records from primary storage. [2025-09-23T21:59:28.537498] [INFO ] [MAIN ] VST: Loaded 53720 existing records. [2025-09-23T21:59:28.720523] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:59:28.720832] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-23T21:59:28.720883] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-23T21:59:28.722293] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-23T21:59:28.722358] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-23T21:59:29.007265] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-23T21:59:29.081846] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:59:29.802177] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-23T21:59:30.602169] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-23T21:59:30.701302] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T21:59:30.839233] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-23T21:59:30.999959] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T21:59:31.402273] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-23T21:59:32.202269] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-23T21:59:33.002289] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-23T21:59:33.064567] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-23T21:59:33.807216] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-23T21:59:33.812529] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-23T21:59:33.896635] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T21:59:34.602918] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-23T21:59:34.602828] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T21:59:35.402234] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-23T21:59:36.202277] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-23T21:59:36.373767] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-23T21:59:36.587688] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T21:59:36.771734] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T21:59:37.002234] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-23T21:59:37.802177] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-23T21:59:38.531626] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-23T21:59:38.602192] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-23T21:59:38.826177] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T21:59:39.237257] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T21:59:39.402157] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-23T21:59:40.202196] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-23T21:59:40.823186] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-23T21:59:41.002278] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-23T21:59:41.049941] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T21:59:41.652327] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T21:59:41.802219] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-23T21:59:42.602259] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-23T21:59:43.402210] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-23T21:59:43.447846] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T21:59:43.647715] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-23T21:59:44.202256] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-23T21:59:44.951566] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-23T21:59:44.960581] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-09-23T21:59:44.960769] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-23T21:59:45.004680] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-23T21:59:45.371546] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-23T21:59:45.371864] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-23T21:59:45.373020] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-23T21:59:45.389327] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-23T21:59:45.407447] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-23T21:59:45.420218] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-09-23T21:59:45.786796] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-09-23T21:59:45.786942] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-23T21:59:45.787028] [INFO ] [MAIN ] Update Progress: 2253/2372 symbols completed. VRT took 48.4s. Estimated remaining: 15m 50s. Rate: 7.5 symbols/min [2025-09-23T21:59:45.820993] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-23T21:59:45.968801] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:59:46.014458] [DEBUG] [LOCAL ] VSTS: Loaded 49035 existing records from primary storage. [2025-09-23T21:59:46.014634] [INFO ] [MAIN ] VSTS: Loaded 49035 existing records. [2025-09-23T21:59:46.202529] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:59:46.202836] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-23T21:59:46.202935] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-23T21:59:46.204195] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-23T21:59:46.204256] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-23T21:59:46.626480] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:59:46.627224] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-23T21:59:46.716333] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-23T21:59:46.864065] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T21:59:47.407284] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-23T21:59:47.424436] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T21:59:48.202216] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-23T21:59:48.315067] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T21:59:49.002253] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-23T21:59:49.802264] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-23T21:59:49.983726] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T21:59:49.993737] [INFO ] [REMOTE ] VSCO: Full fetch complete (76259 records). [2025-09-23T21:59:49.993968] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-23T21:59:50.255198] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-23T21:59:50.495473] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-23T21:59:50.495663] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-23T21:59:50.496829] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-23T21:59:50.496962] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-23T21:59:50.521541] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T21:59:50.530351] [DEBUG] [LOCAL ] VSCO: Trimmed 76259 records to 52871 (keeping 200 days of data) [2025-09-23T21:59:50.621753] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-23T21:59:50.859544] [DEBUG] [LOCAL ] VSCO: Primary data saved (52871 records). [2025-09-23T21:59:50.859731] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-23T21:59:50.859831] [INFO ] [MAIN ] Update Progress: 2254/2372 symbols completed. VSCO took 36.2s. Estimated remaining: 15m 42s. Rate: 7.5 symbols/min [2025-09-23T21:59:51.053569] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:59:51.095501] [DEBUG] [LOCAL ] VTEX: Loaded 43377 existing records from primary storage. [2025-09-23T21:59:51.095847] [INFO ] [MAIN ] VTEX: Loaded 43377 existing records. [2025-09-23T21:59:51.293957] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:59:51.294330] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-23T21:59:51.294476] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-23T21:59:51.295538] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-23T21:59:51.295603] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-23T21:59:51.406305] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-23T21:59:51.697324] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:59:51.700431] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T21:59:52.131836] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T21:59:52.202152] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-23T21:59:53.002204] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-23T21:59:53.802189] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-23T21:59:53.848556] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T21:59:54.244711] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-23T21:59:54.431425] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T21:59:54.602221] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-23T21:59:55.402169] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-23T21:59:55.514546] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T21:59:55.525866] [INFO ] [REMOTE ] VSH: Full fetch complete (71283 records). [2025-09-23T21:59:55.526059] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-23T21:59:55.851489] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T21:59:55.952886] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-23T21:59:55.952976] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-23T21:59:55.954054] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-23T21:59:55.954122] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-23T21:59:55.955583] [DEBUG] [LOCAL ] VSH: Trimmed 71283 records to 48617 (keeping 200 days of data) [2025-09-23T21:59:56.221285] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-23T21:59:56.252283] [DEBUG] [LOCAL ] VSH: Primary data saved (48617 records). [2025-09-23T21:59:56.252387] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-23T21:59:56.252469] [INFO ] [MAIN ] Update Progress: 2255/2372 symbols completed. VSH took 37.1s. Estimated remaining: 15m 34s. Rate: 7.5 symbols/min [2025-09-23T21:59:56.425008] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T21:59:56.471610] [DEBUG] [LOCAL ] VTLE: Loaded 48615 existing records from primary storage. [2025-09-23T21:59:56.471777] [INFO ] [MAIN ] VTLE: Loaded 48615 existing records. [2025-09-23T21:59:56.648860] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T21:59:56.649207] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-23T21:59:56.649255] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-23T21:59:56.650214] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-23T21:59:56.650277] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-23T21:59:57.011571] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T21:59:57.005946] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-23T21:59:57.051714] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T21:59:57.256442] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T21:59:57.802177] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-23T21:59:58.602188] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-23T21:59:59.332718] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-23T21:59:59.402168] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-23T21:59:59.505263] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T22:00:00.123303] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T22:00:00.202244] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-23T22:00:01.002280] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-23T22:00:01.802173] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-23T22:00:01.943122] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T22:00:02.168575] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-23T22:00:02.612052] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-23T22:00:02.636047] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T22:00:03.342988] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T22:00:03.402264] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-23T22:00:04.202208] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-23T22:00:05.002333] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-23T22:00:05.101070] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-23T22:00:05.239433] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T22:00:05.784898] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T22:00:05.802188] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-23T22:00:06.557957] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T22:00:06.602200] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-23T22:00:07.306213] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T22:00:07.402233] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-23T22:00:07.745322] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T22:00:07.933462] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T22:00:07.943323] [INFO ] [REMOTE ] VST: Full fetch complete (77806 records). [2025-09-23T22:00:07.943478] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-23T22:00:08.202292] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-23T22:00:08.354565] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-23T22:00:08.354692] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-23T22:00:08.355896] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-23T22:00:08.355965] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-23T22:00:08.357595] [DEBUG] [LOCAL ] VST: Trimmed 77806 records to 53720 (keeping 200 days of data) [2025-09-23T22:00:08.715804] [DEBUG] [LOCAL ] VST: Primary data saved (53720 records). [2025-09-23T22:00:08.715969] [INFO ] [MAIN ] VST: Full history saved. [2025-09-23T22:00:08.716059] [INFO ] [MAIN ] Update Progress: 2256/2372 symbols completed. VST took 40.4s. Estimated remaining: 15m 26s. Rate: 7.5 symbols/min [2025-09-23T22:00:08.919565] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:00:08.938773] [DEBUG] [LOCAL ] VTMX: Loaded 17377 existing records from primary storage. [2025-09-23T22:00:08.938926] [INFO ] [MAIN ] VTMX: Loaded 17377 existing records. [2025-09-23T22:00:09.007499] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-23T22:00:09.140215] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:00:09.140558] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-23T22:00:09.140619] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-23T22:00:09.141635] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-23T22:00:09.141724] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-23T22:00:09.508841] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:00:09.802230] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-23T22:00:09.953897] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T22:00:10.602203] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-23T22:00:10.868140] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T22:00:11.321806] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T22:00:11.402188] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-23T22:00:12.178414] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T22:00:12.187330] [INFO ] [REMOTE ] VSTS: Full fetch complete (69916 records). [2025-09-23T22:00:12.187452] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-23T22:00:12.208730] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-23T22:00:12.581047] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-23T22:00:12.581130] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-23T22:00:12.582251] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-23T22:00:12.582315] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-23T22:00:12.583866] [DEBUG] [LOCAL ] VSTS: Trimmed 69916 records to 49047 (keeping 200 days of data) [2025-09-23T22:00:12.870055] [DEBUG] [LOCAL ] VSTS: Primary data saved (49047 records). [2025-09-23T22:00:12.870201] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-23T22:00:12.870304] [INFO ] [MAIN ] Update Progress: 2257/2372 symbols completed. VSTS took 27.1s. Estimated remaining: 15m 18s. Rate: 7.5 symbols/min [2025-09-23T22:00:13.003063] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-23T22:00:13.047323] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:00:13.048463] [DEBUG] [LOCAL ] VTN: No existing data file found in primary storage. [2025-09-23T22:00:13.048535] [WARN ] [MAIN ] VTN: No existing data found, performing full refresh instead. [2025-09-23T22:00:13.048758] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-23T22:00:13.048807] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-23T22:00:13.048850] [DEBUG] [LOCAL ] VTN: No primary data file found to delete. [2025-09-23T22:00:13.048882] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-23T22:00:13.456028] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-23T22:00:13.452974] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:00:13.478936] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T22:00:13.802195] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-23T22:00:14.573414] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T22:00:14.602144] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-23T22:00:15.403199] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-23T22:00:15.403029] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T22:00:15.413226] [INFO ] [REMOTE ] VTEX: Full fetch complete (60864 records). [2025-09-23T22:00:15.413439] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-23T22:00:15.836617] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-23T22:00:15.836774] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-23T22:00:15.838723] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-23T22:00:15.838797] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-23T22:00:15.840973] [DEBUG] [LOCAL ] VTEX: Trimmed 60864 records to 43413 (keeping 200 days of data) [2025-09-23T22:00:16.102497] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T22:00:16.166119] [DEBUG] [LOCAL ] VTEX: Primary data saved (43413 records). [2025-09-23T22:00:16.166343] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-23T22:00:16.166477] [INFO ] [MAIN ] Update Progress: 2258/2372 symbols completed. VTEX took 25.3s. Estimated remaining: 15m 9s. Rate: 7.5 symbols/min [2025-09-23T22:00:16.212033] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-23T22:00:16.371428] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:00:16.377418] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T22:00:16.404919] [DEBUG] [LOCAL ] VTOL: Loaded 19716 existing records from primary storage. [2025-09-23T22:00:16.405115] [INFO ] [MAIN ] VTOL: Loaded 19716 existing records. [2025-09-23T22:00:16.586952] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:00:16.587338] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-23T22:00:16.587394] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-23T22:00:16.588212] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-23T22:00:16.588278] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-23T22:00:16.979504] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:00:17.002157] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-23T22:00:17.802943] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T22:00:17.803123] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-23T22:00:17.831154] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T22:00:18.573504] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T22:00:18.602181] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-23T22:00:19.384244] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T22:00:19.402200] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-23T22:00:20.202234] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-23T22:00:20.644316] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T22:00:21.002198] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-23T22:00:21.802194] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-23T22:00:22.602256] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-23T22:00:23.073439] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T22:00:23.085743] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-23T22:00:23.368355] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T22:00:23.402209] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-23T22:00:23.637720] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (3.44 seconds). [2025-09-23T22:00:24.110116] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T22:00:24.202219] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-23T22:00:25.002175] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-23T22:00:25.288665] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T22:00:25.802215] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-23T22:00:26.602240] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-23T22:00:26.692733] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T22:00:26.813092] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T22:00:27.034822] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T22:00:27.402210] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-23T22:00:28.202185] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-23T22:00:28.567293] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T22:00:29.002254] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-23T22:00:29.184349] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T22:00:29.802239] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-23T22:00:30.551945] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T22:00:30.559612] [INFO ] [REMOTE ] VTLE: Full fetch complete (68691 records). [2025-09-23T22:00:30.559786] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-23T22:00:30.607266] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-23T22:00:30.671465] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T22:00:30.969840] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-23T22:00:30.969951] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-23T22:00:30.971215] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-23T22:00:30.971282] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-23T22:00:30.972813] [DEBUG] [LOCAL ] VTLE: Trimmed 68691 records to 48624 (keeping 200 days of data) [2025-09-23T22:00:31.272206] [DEBUG] [LOCAL ] VTLE: Primary data saved (48624 records). [2025-09-23T22:00:31.272345] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-23T22:00:31.272432] [INFO ] [MAIN ] Update Progress: 2259/2372 symbols completed. VTLE took 35.0s. Estimated remaining: 15m 2s. Rate: 7.5 symbols/min [2025-09-23T22:00:31.407337] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-23T22:00:31.460615] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:00:31.516283] [DEBUG] [LOCAL ] VTR: Loaded 52838 existing records from primary storage. [2025-09-23T22:00:31.516529] [INFO ] [MAIN ] VTR: Loaded 52838 existing records. [2025-09-23T22:00:31.712863] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:00:31.713431] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-23T22:00:31.713513] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-23T22:00:31.714971] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-23T22:00:31.715040] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-23T22:00:31.999335] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T22:00:32.115433] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:00:32.172169] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T22:00:32.202220] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-23T22:00:33.002225] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-23T22:00:33.802208] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-23T22:00:34.602161] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-23T22:00:34.851558] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T22:00:35.402179] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-23T22:00:35.531575] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (3.33 seconds). [2025-09-23T22:00:36.076534] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-23T22:00:36.137467] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T22:00:36.139620] [INFO ] [REMOTE ] VTN: Full fetch complete (11506 records). [2025-09-23T22:00:36.139722] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-23T22:00:36.206945] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-23T22:00:36.553966] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-23T22:00:36.554151] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-23T22:00:36.555360] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T22:00:36.560364] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-23T22:00:36.561056] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-23T22:00:36.562116] [DEBUG] [LOCAL ] VTN: Trimmed 11506 records to 7265 (keeping 200 days of data) [2025-09-23T22:00:36.608491] [DEBUG] [LOCAL ] VTN: Primary data saved (7265 records). [2025-09-23T22:00:36.608620] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-23T22:00:36.608766] [INFO ] [MAIN ] Update Progress: 2260/2372 symbols completed. VTN took 23.7s. Estimated remaining: 14m 54s. Rate: 7.5 symbols/min [2025-09-23T22:00:36.778100] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:00:36.812054] [DEBUG] [LOCAL ] VTS: Loaded 30465 existing records from primary storage. [2025-09-23T22:00:36.812189] [INFO ] [MAIN ] VTS: Loaded 30465 existing records. [2025-09-23T22:00:36.992881] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:00:36.993357] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-23T22:00:36.993407] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-23T22:00:36.994260] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-23T22:00:36.994320] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-23T22:00:37.007282] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-23T22:00:37.197039] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T22:00:37.433179] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:00:37.802175] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-23T22:00:38.080158] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T22:00:38.602206] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-23T22:00:38.932048] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T22:00:39.317234] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T22:00:39.402222] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-23T22:00:40.202203] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-23T22:00:40.504212] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T22:00:41.002215] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-23T22:00:41.802178] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-23T22:00:41.986668] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T22:00:42.117387] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T22:00:42.576051] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T22:00:42.602203] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-23T22:00:43.402232] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-23T22:00:43.647024] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T22:00:44.117312] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T22:00:44.121705] [INFO ] [REMOTE ] VTOL: Full fetch complete (26204 records). [2025-09-23T22:00:44.121798] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-23T22:00:44.207302] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-23T22:00:44.529066] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-23T22:00:44.529168] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-23T22:00:44.529811] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-23T22:00:44.529909] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-23T22:00:44.531971] [DEBUG] [LOCAL ] VTOL: Trimmed 26204 records to 19767 (keeping 200 days of data) [2025-09-23T22:00:44.657896] [DEBUG] [LOCAL ] VTOL: Primary data saved (19767 records). [2025-09-23T22:00:44.658040] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-23T22:00:44.658218] [INFO ] [MAIN ] Update Progress: 2261/2372 symbols completed. VTOL took 28.5s. Estimated remaining: 14m 46s. Rate: 7.5 symbols/min [2025-09-23T22:00:44.835232] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:00:44.867075] [DEBUG] [LOCAL ] VVR: Loaded 30316 existing records from primary storage. [2025-09-23T22:00:44.867242] [INFO ] [MAIN ] VVR: Loaded 30316 existing records. [2025-09-23T22:00:45.007460] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-23T22:00:45.077361] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:00:45.077728] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-23T22:00:45.077843] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-23T22:00:45.078708] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-23T22:00:45.078786] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-23T22:00:45.441159] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T22:00:45.475854] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:00:45.802190] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-23T22:00:46.594940] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T22:00:46.597998] [INFO ] [REMOTE ] VTMX: Full fetch complete (26112 records). [2025-09-23T22:00:46.598094] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-23T22:00:46.610340] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-23T22:00:46.996537] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-23T22:00:47.035119] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-23T22:00:47.035204] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-23T22:00:47.035827] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-23T22:00:47.035930] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-23T22:00:47.038279] [DEBUG] [LOCAL ] VTMX: Trimmed 26112 records to 17446 (keeping 200 days of data) [2025-09-23T22:00:47.157354] [DEBUG] [LOCAL ] VTMX: Primary data saved (17446 records). [2025-09-23T22:00:47.157507] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-23T22:00:47.157732] [INFO ] [MAIN ] Update Progress: 2262/2372 symbols completed. VTMX took 38.4s. Estimated remaining: 14m 37s. Rate: 7.5 symbols/min [2025-09-23T22:00:47.326868] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:00:47.387517] [DEBUG] [LOCAL ] VVV: Loaded 50212 existing records from primary storage. [2025-09-23T22:00:47.387729] [INFO ] [MAIN ] VVV: Loaded 50212 existing records. [2025-09-23T22:00:47.409464] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-23T22:00:47.577033] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:00:47.577319] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-23T22:00:47.577388] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-23T22:00:47.578741] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-23T22:00:47.578804] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-23T22:00:47.943006] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:00:48.097140] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T22:00:48.202195] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-23T22:00:48.853031] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T22:00:49.002194] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-23T22:00:49.802217] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-23T22:00:50.107824] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T22:00:50.545842] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T22:00:50.602151] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-23T22:00:51.093585] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T22:00:51.402256] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-23T22:00:51.561328] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T22:00:52.202202] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-23T22:00:53.002194] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-23T22:00:53.335566] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T22:00:53.537928] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T22:00:53.802267] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-23T22:00:54.406931] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T22:00:54.602173] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-23T22:00:54.650927] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T22:00:55.402257] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-23T22:00:56.202188] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-23T22:00:56.526073] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T22:00:56.683766] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T22:00:57.002252] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-23T22:00:57.563672] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T22:00:57.802224] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-23T22:00:58.602224] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-23T22:00:58.682262] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T22:00:59.047890] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T22:00:59.053578] [INFO ] [REMOTE ] VTS: Full fetch complete (40765 records). [2025-09-23T22:00:59.053722] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-23T22:00:59.407430] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-23T22:00:59.494449] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-23T22:00:59.494552] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-23T22:00:59.495588] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-23T22:00:59.495683] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-23T22:00:59.496969] [DEBUG] [LOCAL ] VTS: Trimmed 40765 records to 30554 (keeping 200 days of data) [2025-09-23T22:00:59.708601] [DEBUG] [LOCAL ] VTS: Primary data saved (30554 records). [2025-09-23T22:00:59.708776] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-23T22:00:59.708900] [INFO ] [MAIN ] Update Progress: 2263/2372 symbols completed. VTS took 23.1s. Estimated remaining: 14m 30s. Rate: 7.5 symbols/min [2025-09-23T22:00:59.904555] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:00:59.931728] [DEBUG] [LOCAL ] VVX: Loaded 23361 existing records from primary storage. [2025-09-23T22:00:59.931864] [INFO ] [MAIN ] VVX: Loaded 23361 existing records. [2025-09-23T22:01:00.129301] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:01:00.129715] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-23T22:01:00.129773] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-23T22:01:00.130604] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-23T22:01:00.130696] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-23T22:01:00.205205] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-23T22:01:00.527370] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:01:00.557345] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T22:01:00.764541] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T22:01:01.002227] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-23T22:01:01.217743] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T22:01:01.802246] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-23T22:01:02.602176] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-23T22:01:02.729773] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T22:01:02.991408] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T22:01:03.402219] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-23T22:01:04.099032] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T22:01:04.202222] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-23T22:01:05.007387] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-23T22:01:05.032674] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T22:01:05.802171] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-23T22:01:06.093867] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T22:01:06.180830] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T22:01:06.601413] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T22:01:06.607138] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-23T22:01:07.402281] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-23T22:01:08.202223] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-23T22:01:08.287377] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T22:01:09.002219] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-23T22:01:09.145083] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T22:01:09.168683] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T22:01:09.802287] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-23T22:01:10.402675] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T22:01:10.602268] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-23T22:01:11.402459] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-23T22:01:11.581062] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T22:01:11.839791] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T22:01:12.202290] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-23T22:01:12.709335] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T22:01:13.002212] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-23T22:01:13.560091] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T22:01:13.802183] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-23T22:01:13.941066] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T22:01:14.147874] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-23T22:01:14.160547] [INFO ] [REMOTE ] VTR: Full fetch complete (76327 records). [2025-09-23T22:01:14.160705] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-23T22:01:14.554216] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-23T22:01:14.554296] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-23T22:01:14.555418] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-23T22:01:14.555482] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-23T22:01:14.556988] [DEBUG] [LOCAL ] VTR: Trimmed 76327 records to 52845 (keeping 200 days of data) [2025-09-23T22:01:14.625084] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-23T22:01:14.895336] [DEBUG] [LOCAL ] VTR: Primary data saved (52845 records). [2025-09-23T22:01:14.895483] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-23T22:01:14.895598] [INFO ] [MAIN ] Update Progress: 2264/2372 symbols completed. VTR took 43.6s. Estimated remaining: 14m 22s. Rate: 7.5 symbols/min [2025-09-23T22:01:15.061911] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:01:15.113354] [DEBUG] [LOCAL ] VYX: Loaded 49112 existing records from primary storage. [2025-09-23T22:01:15.113504] [INFO ] [MAIN ] VYX: Loaded 49112 existing records. [2025-09-23T22:01:15.292163] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:01:15.292438] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-23T22:01:15.292492] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-23T22:01:15.293601] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-23T22:01:15.293695] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-23T22:01:15.402733] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-23T22:01:15.668253] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:01:16.026518] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T22:01:16.202198] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-23T22:01:16.680082] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T22:01:17.002207] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-23T22:01:17.583880] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T22:01:17.802230] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-23T22:01:17.972777] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T22:01:18.602267] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-23T22:01:19.404325] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-23T22:01:19.409191] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T22:01:19.752390] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T22:01:20.202227] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-23T22:01:20.405516] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T22:01:20.414699] [INFO ] [REMOTE ] VVR: Full fetch complete (45728 records). [2025-09-23T22:01:20.414810] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-23T22:01:20.793531] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-23T22:01:20.793614] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-23T22:01:20.794483] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-23T22:01:20.794543] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-23T22:01:20.797219] [DEBUG] [LOCAL ] VVR: Trimmed 45728 records to 30480 (keeping 200 days of data) [2025-09-23T22:01:20.982374] [DEBUG] [LOCAL ] VVR: Primary data saved (30480 records). [2025-09-23T22:01:20.982547] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-23T22:01:20.982694] [INFO ] [MAIN ] Update Progress: 2265/2372 symbols completed. VVR took 36.3s. Estimated remaining: 14m 14s. Rate: 7.5 symbols/min [2025-09-23T22:01:21.007264] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-23T22:01:21.166578] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:01:21.220573] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-23T22:01:21.220744] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-09-23T22:01:21.400614] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:01:21.400871] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-23T22:01:21.400918] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-23T22:01:21.402517] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-23T22:01:21.402578] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-23T22:01:21.766716] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:01:21.791734] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T22:01:21.802147] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-23T22:01:22.446874] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T22:01:22.455089] [INFO ] [REMOTE ] VVV: Full fetch complete (72281 records). [2025-09-23T22:01:22.455215] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-23T22:01:22.607280] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-23T22:01:22.854459] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-23T22:01:22.854539] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-23T22:01:22.855628] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-23T22:01:22.855860] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-23T22:01:22.857364] [DEBUG] [LOCAL ] VVV: Trimmed 72281 records to 50212 (keeping 200 days of data) [2025-09-23T22:01:23.177953] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T22:01:23.202410] [DEBUG] [LOCAL ] VVV: Primary data saved (50212 records). [2025-09-23T22:01:23.202512] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-23T22:01:23.202587] [INFO ] [MAIN ] Update Progress: 2266/2372 symbols completed. VVV took 36.0s. Estimated remaining: 14m 6s. Rate: 7.5 symbols/min [2025-09-23T22:01:23.369283] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:01:23.402249] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-23T22:01:23.423521] [DEBUG] [LOCAL ] W: Loaded 53505 existing records from primary storage. [2025-09-23T22:01:23.423676] [INFO ] [MAIN ] W: Loaded 53505 existing records. [2025-09-23T22:01:23.603601] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:01:23.603874] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-23T22:01:23.603921] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-23T22:01:23.605027] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-23T22:01:23.605086] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-23T22:01:23.956292] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:01:24.202169] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-23T22:01:24.545110] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T22:01:24.921335] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-23T22:01:25.002174] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-23T22:01:25.802227] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-23T22:01:25.833910] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T22:01:26.602205] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-23T22:01:27.092685] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T22:01:27.264385] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-23T22:01:27.402193] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-23T22:01:28.061042] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T22:01:28.202175] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-23T22:01:28.437156] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T22:01:28.442230] [INFO ] [REMOTE ] VVX: Full fetch complete (33549 records). [2025-09-23T22:01:28.442337] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-23T22:01:28.813252] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-23T22:01:28.813377] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-23T22:01:28.814064] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-23T22:01:28.814126] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-23T22:01:28.814971] [DEBUG] [LOCAL ] VVX: Trimmed 33549 records to 23369 (keeping 200 days of data) [2025-09-23T22:01:28.948410] [DEBUG] [LOCAL ] VVX: Primary data saved (23369 records). [2025-09-23T22:01:28.948543] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-23T22:01:28.948639] [INFO ] [MAIN ] Update Progress: 2267/2372 symbols completed. VVX took 29.2s. Estimated remaining: 13m 58s. Rate: 7.5 symbols/min [2025-09-23T22:01:29.012134] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-23T22:01:29.121267] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:01:29.169687] [DEBUG] [LOCAL ] WAB: Loaded 44293 existing records from primary storage. [2025-09-23T22:01:29.169853] [INFO ] [MAIN ] WAB: Loaded 44293 existing records. [2025-09-23T22:01:29.351423] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:01:29.351779] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-23T22:01:29.351835] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-23T22:01:29.352905] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-23T22:01:29.352966] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-23T22:01:29.720050] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:01:29.802185] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-23T22:01:30.017754] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T22:01:30.602294] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-23T22:01:31.336305] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-23T22:01:31.402185] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-23T22:01:31.430700] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T22:01:32.202166] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-23T22:01:32.313521] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T22:01:33.002229] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-23T22:01:33.197371] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T22:01:33.802199] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-23T22:01:34.474371] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-23T22:01:34.602167] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-23T22:01:35.040145] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T22:01:35.402212] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-23T22:01:35.598403] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T22:01:36.202280] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-23T22:01:37.002223] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-23T22:01:37.005418] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-23T22:01:37.208015] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T22:01:37.500411] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T22:01:37.802209] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-23T22:01:38.602158] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-23T22:01:38.738114] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T22:01:39.350937] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T22:01:39.402147] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-23T22:01:40.202194] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-23T22:01:40.905409] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-23T22:01:41.007024] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-23T22:01:41.013479] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T22:01:41.736627] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T22:01:41.802166] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-23T22:01:42.602209] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-23T22:01:43.095369] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-23T22:01:43.192125] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T22:01:43.402224] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-23T22:01:44.202188] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-23T22:01:44.550306] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T22:01:45.002208] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-23T22:01:45.330556] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T22:01:45.803574] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-23T22:01:45.808331] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T22:01:45.816579] [INFO ] [REMOTE ] VYX: Full fetch complete (70290 records). [2025-09-23T22:01:45.816728] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-23T22:01:46.215823] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-23T22:01:46.215908] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-23T22:01:46.217033] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-23T22:01:46.217097] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-23T22:01:46.218530] [DEBUG] [LOCAL ] VYX: Trimmed 70290 records to 49075 (keeping 200 days of data) [2025-09-23T22:01:46.508776] [DEBUG] [LOCAL ] VYX: Primary data saved (49075 records). [2025-09-23T22:01:46.508914] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-23T22:01:46.509026] [INFO ] [MAIN ] Update Progress: 2268/2372 symbols completed. VYX took 31.6s. Estimated remaining: 13m 50s. Rate: 7.5 symbols/min [2025-09-23T22:01:46.605559] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-23T22:01:46.690733] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:01:46.725815] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T22:01:46.774847] [DEBUG] [LOCAL ] WAL: Loaded 45453 existing records from primary storage. [2025-09-23T22:01:46.775010] [INFO ] [MAIN ] WAL: Loaded 45453 existing records. [2025-09-23T22:01:46.965870] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:01:46.966151] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-23T22:01:46.966199] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-23T22:01:46.967247] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-23T22:01:46.967307] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-23T22:01:47.339614] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:01:47.402147] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-23T22:01:48.202161] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-23T22:01:48.474113] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-23T22:01:48.527497] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-23T22:01:48.986409] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T22:01:49.002152] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-23T22:01:49.649735] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T22:01:49.658591] [INFO ] [REMOTE ] W: Full fetch complete (77440 records). [2025-09-23T22:01:49.658785] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-23T22:01:49.803972] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-23T22:01:50.061720] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-23T22:01:50.061817] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-23T22:01:50.062910] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-23T22:01:50.062975] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-23T22:01:50.064517] [DEBUG] [LOCAL ] W: Trimmed 77440 records to 53503 (keeping 200 days of data) [2025-09-23T22:01:50.381324] [DEBUG] [LOCAL ] W: Primary data saved (53503 records). [2025-09-23T22:01:50.381491] [INFO ] [MAIN ] W: Full history saved. [2025-09-23T22:01:50.381605] [INFO ] [MAIN ] Update Progress: 2269/2372 symbols completed. W took 27.2s. Estimated remaining: 13m 42s. Rate: 7.5 symbols/min [2025-09-23T22:01:50.556830] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:01:50.590946] [DEBUG] [LOCAL ] WAT: Loaded 35108 existing records from primary storage. [2025-09-23T22:01:50.591084] [INFO ] [MAIN ] WAT: Loaded 35108 existing records. [2025-09-23T22:01:50.621341] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-23T22:01:50.780319] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:01:50.780704] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-23T22:01:50.780783] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-23T22:01:50.790531] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-23T22:01:50.806499] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-23T22:01:50.884359] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T22:01:51.186117] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:01:51.215142] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T22:01:51.402147] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-23T22:01:52.202228] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-23T22:01:52.661912] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-23T22:01:53.002194] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-23T22:01:53.031627] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T22:01:53.766752] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T22:01:53.775846] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-09-23T22:01:53.775983] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-23T22:01:53.807279] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-23T22:01:54.288031] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-23T22:01:54.288356] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-23T22:01:54.292100] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-23T22:01:54.290387] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-23T22:01:54.300962] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-23T22:01:54.303041] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-09-23T22:01:54.615565] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-23T22:01:54.642317] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-09-23T22:01:54.642460] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-23T22:01:54.642558] [INFO ] [MAIN ] Update Progress: 2270/2372 symbols completed. VZ took 33.7s. Estimated remaining: 13m 34s. Rate: 7.5 symbols/min [2025-09-23T22:01:54.810913] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:01:54.811091] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-23T22:01:54.811146] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-23T22:01:54.811284] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-23T22:01:54.811325] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-23T22:01:54.811366] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-23T22:01:54.811398] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-23T22:01:55.175350] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:01:55.287978] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T22:01:55.402148] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-23T22:01:55.617864] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:01:55.618058] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-23T22:01:55.995164] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T22:01:56.202256] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-09-23T22:01:56.409042] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:01:56.409374] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-09-23T22:01:57.002250] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-23T22:01:57.802285] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-02. [2025-09-23T22:01:58.451569] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:01:58.451919] [WARN ] [REMOTE ] WBI: No data returned for month 2025-02 [2025-09-23T22:01:58.471608] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T22:01:58.602189] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-03. [2025-09-23T22:01:58.815475] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:01:58.815853] [WARN ] [REMOTE ] WBI: No data returned for month 2025-03 [2025-09-23T22:01:59.402189] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-23T22:02:00.202199] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-23T22:02:00.874207] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T22:02:01.002217] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-23T22:02:01.761974] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T22:02:01.802202] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-04. [2025-09-23T22:02:02.455126] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:02:02.455444] [WARN ] [REMOTE ] WBI: No data returned for month 2025-04 [2025-09-23T22:02:02.492052] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T22:02:02.602173] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-23T22:02:03.402224] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-05. [2025-09-23T22:02:03.629125] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:02:03.629877] [WARN ] [REMOTE ] WBI: No data returned for month 2025-05 [2025-09-23T22:02:04.207384] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-23T22:02:04.239483] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T22:02:05.002204] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-06. [2025-09-23T22:02:05.362446] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:02:05.362801] [WARN ] [REMOTE ] WBI: No data returned for month 2025-06 [2025-09-23T22:02:05.802185] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-07. [2025-09-23T22:02:06.031737] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:02:06.036279] [WARN ] [REMOTE ] WBI: No data returned for month 2025-07 [2025-09-23T22:02:06.038110] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T22:02:06.602255] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-23T22:02:07.402234] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-08. [2025-09-23T22:02:07.623047] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:02:07.624051] [WARN ] [REMOTE ] WBI: No data returned for month 2025-08 [2025-09-23T22:02:08.202243] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-09. [2025-09-23T22:02:08.297325] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T22:02:08.731294] [INFO ] [REMOTE ] WBI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T22:02:08.735073] [INFO ] [REMOTE ] WBI: Full fetch complete (1649 records). [2025-09-23T22:02:08.735218] [DEBUG] [VALIDATOR ] WBI: Validating primary data. [2025-09-23T22:02:08.976514] [WARN ] [VALIDATOR ] WBI: Validation failed - insufficient historical data. Have 5 unique days, need 200 days [2025-09-23T22:02:08.976749] [FATAL] [MAIN ] WBI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T22:02:08.976801] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T22:02:08.976842] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-23T22:02:08.976920] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-23T22:02:08.976975] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-23T22:02:08.977017] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-23T22:02:08.977079] [INFO ] [MAIN ] Update Progress: 2271/2372 symbols completed. WBI took 14.3s. Estimated remaining: 13m 26s. Rate: 7.5 symbols/min [2025-09-23T22:02:09.007463] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-23T22:02:09.159962] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:02:09.215995] [DEBUG] [LOCAL ] WBS: Loaded 48833 existing records from primary storage. [2025-09-23T22:02:09.216207] [INFO ] [MAIN ] WBS: Loaded 48833 existing records. [2025-09-23T22:02:09.395567] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:02:09.395860] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-23T22:02:09.395908] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-23T22:02:09.397284] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-23T22:02:09.397362] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-23T22:02:09.747922] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:02:09.802173] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-23T22:02:10.592406] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T22:02:10.602131] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-23T22:02:11.365434] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T22:02:11.402169] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-23T22:02:11.764495] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T22:02:12.073406] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T22:02:12.082581] [INFO ] [REMOTE ] WAB: Full fetch complete (64518 records). [2025-09-23T22:02:12.082750] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-23T22:02:12.207320] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-23T22:02:12.489422] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-23T22:02:12.489556] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-23T22:02:12.490740] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-23T22:02:12.490814] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-23T22:02:12.492429] [DEBUG] [LOCAL ] WAB: Trimmed 64518 records to 44280 (keeping 200 days of data) [2025-09-23T22:02:12.789339] [DEBUG] [LOCAL ] WAB: Primary data saved (44280 records). [2025-09-23T22:02:12.789478] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-23T22:02:12.789577] [INFO ] [MAIN ] Update Progress: 2272/2372 symbols completed. WAB took 43.8s. Estimated remaining: 13m 18s. Rate: 7.5 symbols/min [2025-09-23T22:02:12.971196] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:02:12.987559] [DEBUG] [LOCAL ] WBX: Loaded 12761 existing records from primary storage. [2025-09-23T22:02:12.987733] [INFO ] [MAIN ] WBX: Loaded 12761 existing records. [2025-09-23T22:02:13.010088] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-23T22:02:13.177429] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:02:13.177835] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-23T22:02:13.177892] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-23T22:02:13.178451] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-23T22:02:13.178514] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-23T22:02:13.548248] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:02:13.572512] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T22:02:13.802226] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-23T22:02:13.960044] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T22:02:14.602200] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-23T22:02:15.402159] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-23T22:02:15.536513] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T22:02:15.818889] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T22:02:16.202213] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-23T22:02:16.818605] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T22:02:17.002222] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-23T22:02:17.802236] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-23T22:02:17.888200] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T22:02:18.555263] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T22:02:18.602196] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-23T22:02:18.978940] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T22:02:19.402203] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-23T22:02:20.114769] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T22:02:20.202175] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-23T22:02:21.002228] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-23T22:02:21.187607] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T22:02:21.591609] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T22:02:21.656058] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T22:02:21.662182] [INFO ] [REMOTE ] WAT: Full fetch complete (49944 records). [2025-09-23T22:02:21.662276] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-23T22:02:21.807591] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-23T22:02:22.055433] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-23T22:02:22.055520] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-23T22:02:22.056453] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-23T22:02:22.056515] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-23T22:02:22.057731] [DEBUG] [LOCAL ] WAT: Trimmed 49944 records to 35074 (keeping 200 days of data) [2025-09-23T22:02:22.273031] [DEBUG] [LOCAL ] WAT: Primary data saved (35074 records). [2025-09-23T22:02:22.273163] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-23T22:02:22.273257] [INFO ] [MAIN ] Update Progress: 2273/2372 symbols completed. WAT took 31.9s. Estimated remaining: 13m 10s. Rate: 7.5 symbols/min [2025-09-23T22:02:22.450048] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:02:22.494836] [DEBUG] [LOCAL ] WCC: Loaded 40146 existing records from primary storage. [2025-09-23T22:02:22.495007] [INFO ] [MAIN ] WCC: Loaded 40146 existing records. [2025-09-23T22:02:22.607324] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-23T22:02:22.679905] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:02:22.680166] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-23T22:02:22.680248] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-23T22:02:22.681427] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-23T22:02:22.681490] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-23T22:02:23.042045] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:02:23.402268] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-23T22:02:23.456957] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T22:02:23.470756] [INFO ] [REMOTE ] WAL: Full fetch complete (66309 records). [2025-09-23T22:02:23.470914] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-23T22:02:23.873979] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-23T22:02:23.874101] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-23T22:02:23.875221] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-23T22:02:23.875331] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-23T22:02:23.877280] [DEBUG] [LOCAL ] WAL: Trimmed 66309 records to 45418 (keeping 200 days of data) [2025-09-23T22:02:24.152274] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T22:02:24.209841] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-23T22:02:24.233495] [DEBUG] [LOCAL ] WAL: Primary data saved (45418 records). [2025-09-23T22:02:24.233692] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-23T22:02:24.233840] [INFO ] [MAIN ] Update Progress: 2274/2372 symbols completed. WAL took 37.7s. Estimated remaining: 13m 2s. Rate: 7.5 symbols/min [2025-09-23T22:02:24.425961] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:02:24.449401] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T22:02:24.509329] [DEBUG] [LOCAL ] WCN: Loaded 48072 existing records from primary storage. [2025-09-23T22:02:24.509515] [INFO ] [MAIN ] WCN: Loaded 48072 existing records. [2025-09-23T22:02:24.687680] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:02:24.687951] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-23T22:02:24.688010] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-23T22:02:24.689192] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-23T22:02:24.689252] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-23T22:02:25.007349] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-23T22:02:25.045873] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:02:25.802190] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-23T22:02:26.110145] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T22:02:26.297837] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T22:02:26.602205] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-23T22:02:27.371013] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T22:02:27.402170] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-23T22:02:28.093274] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T22:02:28.202227] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-23T22:02:28.936630] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T22:02:29.002153] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-23T22:02:29.802188] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-23T22:02:29.844727] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T22:02:30.034342] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T22:02:30.602211] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-23T22:02:31.084270] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T22:02:31.402202] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-23T22:02:32.202177] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-23T22:02:32.322869] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T22:02:33.002244] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-23T22:02:33.143381] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T22:02:33.802246] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-23T22:02:33.964426] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T22:02:34.587565] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T22:02:34.602144] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-23T22:02:34.667353] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T22:02:35.344264] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T22:02:35.402151] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-23T22:02:35.981298] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T22:02:36.202211] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-23T22:02:37.002222] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-23T22:02:37.616540] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T22:02:37.802213] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-23T22:02:37.846300] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T22:02:38.602206] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-23T22:02:39.402196] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-23T22:02:39.729609] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T22:02:39.789832] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T22:02:40.202193] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-23T22:02:40.622429] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T22:02:41.002207] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-23T22:02:41.319206] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T22:02:41.554524] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T22:02:41.555909] [INFO ] [REMOTE ] WBX: Full fetch complete (26058 records). [2025-09-23T22:02:41.556028] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-23T22:02:41.807411] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-23T22:02:41.957214] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-23T22:02:41.957302] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-23T22:02:41.957885] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-23T22:02:41.958005] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-23T22:02:41.958828] [DEBUG] [LOCAL ] WBX: Trimmed 26058 records to 12641 (keeping 200 days of data) [2025-09-23T22:02:42.046038] [DEBUG] [LOCAL ] WBX: Primary data saved (12641 records). [2025-09-23T22:02:42.046305] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-23T22:02:42.046602] [INFO ] [MAIN ] Update Progress: 2275/2372 symbols completed. WBX took 29.3s. Estimated remaining: 12m 54s. Rate: 7.5 symbols/min [2025-09-23T22:02:42.227012] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:02:42.253088] [DEBUG] [LOCAL ] WD: Loaded 23499 existing records from primary storage. [2025-09-23T22:02:42.253219] [INFO ] [MAIN ] WD: Loaded 23499 existing records. [2025-09-23T22:02:42.431269] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:02:42.431554] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-23T22:02:42.431609] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-23T22:02:42.432312] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-23T22:02:42.432416] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-23T22:02:42.603628] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-23T22:02:42.821569] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:02:43.404075] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-23T22:02:43.407637] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T22:02:44.202213] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-23T22:02:44.324993] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T22:02:44.676128] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T22:02:44.688446] [INFO ] [REMOTE ] WBS: Full fetch complete (69333 records). [2025-09-23T22:02:44.688681] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-23T22:02:45.007251] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-23T22:02:45.090685] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-23T22:02:45.090819] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-23T22:02:45.091997] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-23T22:02:45.092160] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-23T22:02:45.093732] [DEBUG] [LOCAL ] WBS: Trimmed 69333 records to 48780 (keeping 200 days of data) [2025-09-23T22:02:45.214227] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T22:02:45.427221] [DEBUG] [LOCAL ] WBS: Primary data saved (48780 records). [2025-09-23T22:02:45.427375] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-23T22:02:45.427488] [INFO ] [MAIN ] Update Progress: 2276/2372 symbols completed. WBS took 36.5s. Estimated remaining: 12m 46s. Rate: 7.5 symbols/min [2025-09-23T22:02:45.608464] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:02:45.628566] [DEBUG] [LOCAL ] WDH: Loaded 16899 existing records from primary storage. [2025-09-23T22:02:45.628739] [INFO ] [MAIN ] WDH: Loaded 16899 existing records. [2025-09-23T22:02:45.816296] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-23T22:02:45.823300] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:02:45.823766] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-23T22:02:45.824431] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-23T22:02:45.825033] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-23T22:02:45.825096] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-23T22:02:46.226997] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:02:46.569960] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T22:02:46.602149] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-23T22:02:47.402186] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-23T22:02:47.600772] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T22:02:48.148595] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T22:02:48.155584] [INFO ] [REMOTE ] WCC: Full fetch complete (57772 records). [2025-09-23T22:02:48.155752] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-23T22:02:48.209222] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-23T22:02:48.271429] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T22:02:48.562937] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-23T22:02:48.563027] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-23T22:02:48.563971] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-23T22:02:48.564129] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-23T22:02:48.565576] [DEBUG] [LOCAL ] WCC: Trimmed 57772 records to 40057 (keeping 200 days of data) [2025-09-23T22:02:48.837362] [DEBUG] [LOCAL ] WCC: Primary data saved (40057 records). [2025-09-23T22:02:48.837488] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-23T22:02:48.837600] [INFO ] [MAIN ] Update Progress: 2277/2372 symbols completed. WCC took 26.6s. Estimated remaining: 12m 38s. Rate: 7.5 symbols/min [2025-09-23T22:02:49.002166] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-23T22:02:49.275563] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T22:02:49.802213] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-23T22:02:50.194740] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T22:02:50.592394] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T22:02:50.602144] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-23T22:02:51.402238] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-23T22:02:51.419353] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T22:02:52.202239] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-23T22:02:52.609507] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T22:02:53.002192] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-23T22:02:53.220592] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T22:02:53.802419] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-23T22:02:54.607269] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-23T22:02:54.622509] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T22:02:55.018611] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T22:02:55.402191] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-23T22:02:55.610051] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T22:02:56.202262] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-23T22:02:56.983025] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T22:02:57.002347] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-23T22:02:57.259364] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T22:02:57.802276] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-23T22:02:57.920229] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T22:02:58.348727] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-23T22:02:58.602291] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-23T22:02:59.402259] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-23T22:02:59.728342] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T22:03:00.202219] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-23T22:03:00.984611] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T22:03:01.008913] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-23T22:03:01.015233] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T22:03:01.802249] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-23T22:03:02.454597] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T22:03:02.602214] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-23T22:03:03.402231] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-23T22:03:05.057900] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (3.26 seconds). [2025-09-23T22:03:05.066249] [INFO ] [REMOTE ] WCN: Full fetch complete (69332 records). [2025-09-23T22:03:05.066378] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-23T22:03:05.273132] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T22:03:05.308055] [INFO ] [REMOTE ] WDH: Full fetch complete (22641 records). [2025-09-23T22:03:05.342729] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-23T22:03:05.399305] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-23T22:03:05.425376] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-23T22:03:05.738090] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-23T22:03:05.743313] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-23T22:03:05.749776] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-23T22:03:05.754988] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-23T22:03:05.862741] [DEBUG] [LOCAL ] WCN: Trimmed 69332 records to 48064 (keeping 200 days of data) [2025-09-23T22:03:06.123262] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-23T22:03:06.123844] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-23T22:03:06.129526] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-23T22:03:06.134536] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-23T22:03:06.140031] [DEBUG] [LOCAL ] WDH: Trimmed 22641 records to 17064 (keeping 200 days of data) [2025-09-23T22:03:06.358157] [DEBUG] [LOCAL ] WDH: Primary data saved (17064 records). [2025-09-23T22:03:06.362070] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-23T22:03:06.362967] [INFO ] [MAIN ] Update Progress: 2278/2372 symbols completed. WDH took 20.9s. Estimated remaining: 12m 30s. Rate: 7.5 symbols/min [2025-09-23T22:03:06.437148] [DEBUG] [LOCAL ] WCN: Primary data saved (48064 records). [2025-09-23T22:03:06.437290] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-23T22:03:06.437417] [INFO ] [MAIN ] Update Progress: 2279/2372 symbols completed. WCN took 42.2s. Estimated remaining: 12m 22s. Rate: 7.5 symbols/min [2025-09-23T22:03:06.566368] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-23T22:03:06.571672] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-23T22:03:07.730916] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T22:03:07.737237] [INFO ] [REMOTE ] WD: Full fetch complete (32827 records). [2025-09-23T22:03:07.737429] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-23T22:03:08.122909] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-23T22:03:08.123000] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-23T22:03:08.123904] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-23T22:03:08.123973] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-23T22:03:08.124821] [DEBUG] [LOCAL ] WD: Trimmed 32827 records to 23537 (keeping 200 days of data) [2025-09-23T22:03:08.287282] [DEBUG] [LOCAL ] WD: Primary data saved (23537 records). [2025-09-23T22:03:08.287430] [INFO ] [MAIN ] WD: Full history saved. [2025-09-23T22:03:08.287542] [INFO ] [MAIN ] Update Progress: 2280/2372 symbols completed. WD took 26.2s. Estimated remaining: 12m 14s. Rate: 7.5 symbols/min [2025-09-23T22:03:08.911353] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:03:08.996975] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:03:09.059810] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:03:09.088629] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:03:09.089607] [DEBUG] [LOCAL ] WDI: No existing data file found in primary storage. [2025-09-23T22:03:09.089920] [WARN ] [MAIN ] WDI: No existing data found, performing full refresh instead. [2025-09-23T22:03:09.091048] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-23T22:03:09.091129] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-23T22:03:09.091180] [DEBUG] [LOCAL ] WDI: No primary data file found to delete. [2025-09-23T22:03:09.091215] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-23T22:03:09.235541] [DEBUG] [LOCAL ] WEA: Loaded 7369 existing records from primary storage. [2025-09-23T22:03:09.296969] [DEBUG] [LOCAL ] WEAV: Loaded 42103 existing records from primary storage. [2025-09-23T22:03:09.303556] [INFO ] [MAIN ] WEA: Loaded 7369 existing records. [2025-09-23T22:03:09.414456] [DEBUG] [LOCAL ] WDS: Loaded 43685 existing records from primary storage. [2025-09-23T22:03:09.361751] [INFO ] [MAIN ] WEAV: Loaded 42103 existing records. [2025-09-23T22:03:09.435355] [INFO ] [MAIN ] WDS: Loaded 43685 existing records. [2025-09-23T22:03:10.022480] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:03:09.997799] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:03:10.095716] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:03:10.113417] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-23T22:03:10.119676] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:03:10.121317] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-23T22:03:10.121406] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-23T22:03:10.121803] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-23T22:03:10.121869] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-23T22:03:10.122077] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-23T22:03:10.122389] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-23T22:03:10.122841] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-23T22:03:10.122903] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-23T22:03:10.139288] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-23T22:03:10.134066] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-23T22:03:10.145940] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-23T22:03:10.168273] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-23T22:03:11.296009] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:03:11.292991] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:03:11.300498] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-23T22:03:11.299759] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:03:11.300226] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-23T22:03:11.302461] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-23T22:03:11.320826] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T22:03:11.327156] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-23T22:03:11.737667] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T22:03:11.741118] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-23T22:03:12.185869] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T22:03:12.191380] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-23T22:03:12.422956] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T22:03:12.425045] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-23T22:03:13.122197] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T22:03:13.124026] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-23T22:03:13.154011] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T22:03:13.164033] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-23T22:03:13.785910] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T22:03:13.802142] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-23T22:03:13.896171] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-23T22:03:14.602245] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-23T22:03:14.777313] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T22:03:15.391721] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T22:03:15.402148] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-23T22:03:15.611089] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-23T22:03:16.202172] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-23T22:03:16.262158] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T22:03:16.287478] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T22:03:17.002236] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-23T22:03:17.315459] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T22:03:17.802175] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-23T22:03:18.050772] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T22:03:18.602271] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-23T22:03:19.300938] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T22:03:19.372968] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T22:03:19.402153] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-23T22:03:20.202216] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-23T22:03:21.002182] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-23T22:03:21.106721] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T22:03:21.473678] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T22:03:21.488568] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-23T22:03:21.802190] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-23T22:03:22.602171] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-23T22:03:22.936475] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T22:03:23.402261] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-23T22:03:24.202183] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-23T22:03:24.245756] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T22:03:24.379674] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T22:03:25.002288] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-23T22:03:25.267017] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T22:03:25.802217] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-23T22:03:26.602204] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-23T22:03:26.729387] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T22:03:26.729876] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T22:03:27.402261] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-23T22:03:28.151237] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T22:03:28.202189] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-23T22:03:28.997510] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T22:03:29.006352] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-23T22:03:29.254293] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T22:03:29.425095] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T22:03:29.802241] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-23T22:03:30.568678] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T22:03:30.570574] [INFO ] [REMOTE ] WEA: Full fetch complete (9927 records). [2025-09-23T22:03:30.570672] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-23T22:03:30.607342] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-23T22:03:30.947529] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-23T22:03:30.947614] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-23T22:03:30.947880] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-23T22:03:30.947940] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-23T22:03:30.948370] [DEBUG] [LOCAL ] WEA: Trimmed 9927 records to 7353 (keeping 200 days of data) [2025-09-23T22:03:30.992368] [DEBUG] [LOCAL ] WEA: Primary data saved (7353 records). [2025-09-23T22:03:30.992467] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-23T22:03:30.992549] [INFO ] [MAIN ] Update Progress: 2281/2372 symbols completed. WEA took 22.7s. Estimated remaining: 12m 6s. Rate: 7.5 symbols/min [2025-09-23T22:03:31.164104] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:03:31.220620] [DEBUG] [LOCAL ] WEC: Loaded 52216 existing records from primary storage. [2025-09-23T22:03:31.220791] [INFO ] [MAIN ] WEC: Loaded 52216 existing records. [2025-09-23T22:03:31.408933] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-23T22:03:31.415037] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:03:31.416185] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-23T22:03:31.416238] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-23T22:03:31.417621] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-23T22:03:31.417710] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-23T22:03:31.794796] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:03:32.187860] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T22:03:32.202137] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-23T22:03:32.514241] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T22:03:33.002197] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-23T22:03:33.802168] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-23T22:03:33.835486] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T22:03:34.602183] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-23T22:03:34.691058] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T22:03:34.806119] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T22:03:34.809558] [INFO ] [REMOTE ] WDI: Full fetch complete (30852 records). [2025-09-23T22:03:34.809638] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-23T22:03:35.183059] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-23T22:03:35.183192] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-23T22:03:35.183920] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-23T22:03:35.183984] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-23T22:03:35.184845] [DEBUG] [LOCAL ] WDI: Trimmed 30852 records to 21050 (keeping 200 days of data) [2025-09-23T22:03:35.314748] [DEBUG] [LOCAL ] WDI: Primary data saved (21050 records). [2025-09-23T22:03:35.314882] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-23T22:03:35.314959] [INFO ] [MAIN ] Update Progress: 2282/2372 symbols completed. WDI took 27.0s. Estimated remaining: 11m 58s. Rate: 7.5 symbols/min [2025-09-23T22:03:35.407327] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-23T22:03:35.498333] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:03:35.552033] [DEBUG] [LOCAL ] WELL: Loaded 52364 existing records from primary storage. [2025-09-23T22:03:35.552209] [INFO ] [MAIN ] WELL: Loaded 52364 existing records. [2025-09-23T22:03:35.734739] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:03:35.735005] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-23T22:03:35.735057] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-23T22:03:35.736428] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-23T22:03:35.736490] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-23T22:03:36.129327] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T22:03:36.133806] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:03:36.202153] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-23T22:03:37.002177] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-23T22:03:37.064834] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T22:03:37.313519] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T22:03:37.320589] [INFO ] [REMOTE ] WDS: Full fetch complete (64849 records). [2025-09-23T22:03:37.320740] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-23T22:03:37.713045] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-23T22:03:37.713127] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-23T22:03:37.714123] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-23T22:03:37.714186] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-23T22:03:37.715429] [DEBUG] [LOCAL ] WDS: Trimmed 64849 records to 43647 (keeping 200 days of data) [2025-09-23T22:03:37.806355] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-23T22:03:37.993618] [DEBUG] [LOCAL ] WDS: Primary data saved (43647 records). [2025-09-23T22:03:37.993831] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-23T22:03:37.993948] [INFO ] [MAIN ] Update Progress: 2283/2372 symbols completed. WDS took 29.7s. Estimated remaining: 11m 50s. Rate: 7.5 symbols/min [2025-09-23T22:03:38.184448] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:03:38.229969] [DEBUG] [LOCAL ] WES: Loaded 48034 existing records from primary storage. [2025-09-23T22:03:38.230117] [INFO ] [MAIN ] WES: Loaded 48034 existing records. [2025-09-23T22:03:38.411541] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:03:38.411821] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-23T22:03:38.411874] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-23T22:03:38.413097] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-23T22:03:38.413198] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-23T22:03:38.607353] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-23T22:03:38.798626] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:03:38.828084] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T22:03:39.402241] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-23T22:03:39.714117] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T22:03:39.854795] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T22:03:39.862203] [INFO ] [REMOTE ] WEAV: Full fetch complete (61623 records). [2025-09-23T22:03:39.862323] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-23T22:03:40.211791] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-23T22:03:40.259920] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-23T22:03:40.260025] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-23T22:03:40.261170] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-23T22:03:40.261241] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-23T22:03:40.262779] [DEBUG] [LOCAL ] WEAV: Trimmed 61623 records to 42058 (keeping 200 days of data) [2025-09-23T22:03:40.504409] [DEBUG] [LOCAL ] WEAV: Primary data saved (42058 records). [2025-09-23T22:03:40.504539] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-23T22:03:40.504663] [INFO ] [MAIN ] Update Progress: 2284/2372 symbols completed. WEAV took 32.2s. Estimated remaining: 11m 42s. Rate: 7.5 symbols/min [2025-09-23T22:03:40.678517] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:03:40.715266] [DEBUG] [LOCAL ] WEX: Loaded 35529 existing records from primary storage. [2025-09-23T22:03:40.715409] [INFO ] [MAIN ] WEX: Loaded 35529 existing records. [2025-09-23T22:03:40.898491] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:03:40.898785] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-23T22:03:40.898840] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-23T22:03:40.899855] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-23T22:03:40.899918] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-23T22:03:41.007315] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-23T22:03:41.276561] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:03:41.306323] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T22:03:41.640510] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T22:03:41.802204] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-23T22:03:42.602252] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-23T22:03:42.635301] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T22:03:43.402224] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-23T22:03:43.629421] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T22:03:43.928034] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T22:03:44.202240] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-23T22:03:44.379735] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T22:03:45.002192] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-23T22:03:45.802195] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-23T22:03:46.093914] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T22:03:46.602190] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-23T22:03:46.662815] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T22:03:47.393106] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T22:03:47.403998] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-23T22:03:48.202243] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-23T22:03:48.479115] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T22:03:48.861892] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T22:03:49.002191] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-23T22:03:49.779182] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T22:03:49.802152] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-23T22:03:50.602233] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-23T22:03:50.667447] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T22:03:51.304102] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T22:03:51.402321] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-23T22:03:52.202181] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-23T22:03:52.345243] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T22:03:53.002192] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-23T22:03:53.203554] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T22:03:53.802212] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-23T22:03:54.029334] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T22:03:54.602239] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-23T22:03:54.744925] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T22:03:55.343717] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T22:03:55.402187] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-23T22:03:56.202258] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-23T22:03:56.299261] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T22:03:56.800825] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T22:03:57.002297] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-23T22:03:57.731864] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T22:03:57.802229] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-23T22:03:58.602201] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-23T22:03:58.723528] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T22:03:59.402238] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-23T22:03:59.602467] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-23T22:04:00.202211] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-23T22:04:00.401162] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T22:04:00.917603] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T22:04:01.002208] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-23T22:04:01.802235] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-23T22:04:01.960122] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T22:04:02.499203] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T22:04:02.602207] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-23T22:04:03.138800] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T22:04:03.402208] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-23T22:04:04.057889] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T22:04:04.202242] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-23T22:04:04.972180] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T22:04:04.980979] [INFO ] [REMOTE ] WEC: Full fetch complete (75468 records). [2025-09-23T22:04:04.981145] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-23T22:04:05.007381] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-23T22:04:05.457912] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-23T22:04:05.458159] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-23T22:04:05.459338] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-23T22:04:05.459790] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-23T22:04:05.463226] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T22:04:05.479063] [DEBUG] [LOCAL ] WEC: Trimmed 75468 records to 52213 (keeping 200 days of data) [2025-09-23T22:04:05.802423] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-23T22:04:05.817664] [DEBUG] [LOCAL ] WEC: Primary data saved (52213 records). [2025-09-23T22:04:05.817871] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-23T22:04:05.817977] [INFO ] [MAIN ] Update Progress: 2285/2372 symbols completed. WEC took 34.8s. Estimated remaining: 11m 35s. Rate: 7.5 symbols/min [2025-09-23T22:04:05.993156] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:04:06.005417] [DEBUG] [LOCAL ] WF: Loaded 10918 existing records from primary storage. [2025-09-23T22:04:06.005562] [INFO ] [MAIN ] WF: Loaded 10918 existing records. [2025-09-23T22:04:06.193579] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:04:06.193845] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-23T22:04:06.193896] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-23T22:04:06.194277] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-23T22:04:06.194337] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-23T22:04:06.595069] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:04:06.596786] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T22:04:06.603387] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-23T22:04:07.328729] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T22:04:07.402172] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-23T22:04:07.707748] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-23T22:04:07.946570] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T22:04:08.202240] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-23T22:04:09.002204] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-23T22:04:09.802295] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-23T22:04:09.830239] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T22:04:10.055873] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T22:04:10.141315] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-23T22:04:10.150474] [INFO ] [REMOTE ] WELL: Full fetch complete (75725 records). [2025-09-23T22:04:10.150670] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-23T22:04:10.546960] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-23T22:04:10.547053] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-23T22:04:10.548205] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-23T22:04:10.548270] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-23T22:04:10.549852] [DEBUG] [LOCAL ] WELL: Trimmed 75725 records to 52359 (keeping 200 days of data) [2025-09-23T22:04:10.607491] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-23T22:04:10.894341] [DEBUG] [LOCAL ] WELL: Primary data saved (52359 records). [2025-09-23T22:04:10.894485] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-23T22:04:10.894569] [INFO ] [MAIN ] Update Progress: 2286/2372 symbols completed. WELL took 35.6s. Estimated remaining: 11m 26s. Rate: 7.5 symbols/min [2025-09-23T22:04:11.081355] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:04:11.138164] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-23T22:04:11.138411] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-09-23T22:04:11.328902] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:04:11.329223] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-23T22:04:11.329272] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-23T22:04:11.330576] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-23T22:04:11.330637] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-23T22:04:11.410773] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-23T22:04:11.700375] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:04:12.202166] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-23T22:04:12.295439] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T22:04:12.467947] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T22:04:12.475991] [INFO ] [REMOTE ] WES: Full fetch complete (69690 records). [2025-09-23T22:04:12.476122] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-23T22:04:12.888666] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-23T22:04:12.888772] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-23T22:04:12.889957] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-23T22:04:12.890028] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-23T22:04:12.891549] [DEBUG] [LOCAL ] WES: Trimmed 69690 records to 48023 (keeping 200 days of data) [2025-09-23T22:04:13.007991] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-23T22:04:13.206669] [DEBUG] [LOCAL ] WES: Primary data saved (48023 records). [2025-09-23T22:04:13.206838] [INFO ] [MAIN ] WES: Full history saved. [2025-09-23T22:04:13.206930] [INFO ] [MAIN ] Update Progress: 2287/2372 symbols completed. WES took 35.2s. Estimated remaining: 11m 18s. Rate: 7.5 symbols/min [2025-09-23T22:04:13.376397] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:04:13.401454] [DEBUG] [LOCAL ] WFG: Loaded 24971 existing records from primary storage. [2025-09-23T22:04:13.401681] [INFO ] [MAIN ] WFG: Loaded 24971 existing records. [2025-09-23T22:04:13.581115] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:04:13.581367] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-23T22:04:13.581416] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-23T22:04:13.582324] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-23T22:04:13.582389] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-23T22:04:13.817130] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-23T22:04:13.967417] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:04:13.979022] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T22:04:14.126261] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T22:04:14.602327] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-23T22:04:15.141603] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T22:04:15.147529] [INFO ] [REMOTE ] WEX: Full fetch complete (50849 records). [2025-09-23T22:04:15.147673] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-23T22:04:15.407377] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-23T22:04:15.547497] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-23T22:04:15.547609] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-23T22:04:15.548696] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-23T22:04:15.548760] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-23T22:04:15.550405] [DEBUG] [LOCAL ] WEX: Trimmed 50849 records to 35399 (keeping 200 days of data) [2025-09-23T22:04:15.772714] [DEBUG] [LOCAL ] WEX: Primary data saved (35399 records). [2025-09-23T22:04:15.772853] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-23T22:04:15.772978] [INFO ] [MAIN ] Update Progress: 2288/2372 symbols completed. WEX took 35.3s. Estimated remaining: 11m 10s. Rate: 7.5 symbols/min [2025-09-23T22:04:15.940678] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:04:15.979795] [DEBUG] [LOCAL ] WGO: Loaded 39435 existing records from primary storage. [2025-09-23T22:04:15.979933] [INFO ] [MAIN ] WGO: Loaded 39435 existing records. [2025-09-23T22:04:16.169994] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:04:16.170462] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-23T22:04:16.170567] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-23T22:04:16.171616] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-23T22:04:16.171718] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-23T22:04:16.205329] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-23T22:04:16.544882] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:04:16.562108] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T22:04:16.637941] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T22:04:17.004471] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-23T22:04:17.008211] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T22:04:17.802257] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-23T22:04:18.597002] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T22:04:18.604613] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-23T22:04:19.033026] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T22:04:19.402212] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-23T22:04:20.202174] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-23T22:04:20.561061] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-23T22:04:20.612174] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T22:04:21.002163] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-23T22:04:21.426418] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T22:04:21.802196] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-23T22:04:21.919992] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T22:04:22.345512] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T22:04:22.602222] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-23T22:04:23.402243] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-23T22:04:24.202160] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-23T22:04:24.743709] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-23T22:04:24.814237] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T22:04:25.002204] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-23T22:04:25.196560] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T22:04:25.802199] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-23T22:04:26.134570] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T22:04:26.602199] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-23T22:04:27.402284] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-23T22:04:27.822281] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T22:04:28.037594] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-23T22:04:28.202179] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-23T22:04:28.765576] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T22:04:29.002213] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-23T22:04:29.802235] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-23T22:04:30.091956] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T22:04:30.272295] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T22:04:30.602166] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-23T22:04:30.627278] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T22:04:31.402254] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-23T22:04:32.154018] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T22:04:32.202158] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-23T22:04:32.524850] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T22:04:33.002204] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-23T22:04:33.728566] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T22:04:33.802186] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-23T22:04:34.128528] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T22:04:34.133300] [INFO ] [REMOTE ] WFG: Full fetch complete (35657 records). [2025-09-23T22:04:34.133438] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-23T22:04:34.518931] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-23T22:04:34.519060] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-23T22:04:34.519871] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-23T22:04:34.519951] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-23T22:04:34.524426] [DEBUG] [LOCAL ] WFG: Trimmed 35657 records to 24918 (keeping 200 days of data) [2025-09-23T22:04:34.619611] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-23T22:04:34.686315] [DEBUG] [LOCAL ] WFG: Primary data saved (24918 records). [2025-09-23T22:04:34.686460] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-23T22:04:34.686571] [INFO ] [MAIN ] Update Progress: 2289/2372 symbols completed. WFG took 21.5s. Estimated remaining: 11m 3s. Rate: 7.5 symbols/min [2025-09-23T22:04:34.858857] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:04:34.904528] [DEBUG] [LOCAL ] WH: Loaded 45898 existing records from primary storage. [2025-09-23T22:04:34.904706] [INFO ] [MAIN ] WH: Loaded 45898 existing records. [2025-09-23T22:04:35.083709] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:04:35.083967] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-23T22:04:35.084015] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-23T22:04:35.085269] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-23T22:04:35.085331] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-23T22:04:35.404017] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-23T22:04:35.467363] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:04:35.475718] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T22:04:35.505526] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T22:04:36.202276] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-23T22:04:37.002148] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-23T22:04:37.274099] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-23T22:04:37.725416] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T22:04:37.802172] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-23T22:04:38.498497] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T22:04:38.602145] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-23T22:04:39.402175] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-23T22:04:39.590764] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T22:04:39.960770] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T22:04:40.202197] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-23T22:04:41.002198] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-23T22:04:41.729537] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T22:04:41.802212] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-23T22:04:41.944696] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-23T22:04:42.218732] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T22:04:42.225502] [INFO ] [REMOTE ] WGO: Full fetch complete (57325 records). [2025-09-23T22:04:42.225662] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-23T22:04:42.603330] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-23T22:04:42.641561] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-23T22:04:42.641774] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-23T22:04:42.643508] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-23T22:04:42.643995] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-23T22:04:42.643867] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T22:04:42.648334] [INFO ] [REMOTE ] WF: Full fetch complete (16708 records). [2025-09-23T22:04:42.648435] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-23T22:04:42.721743] [DEBUG] [LOCAL ] WGO: Trimmed 57325 records to 39379 (keeping 200 days of data) [2025-09-23T22:04:43.157221] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-23T22:04:43.157634] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-23T22:04:43.158426] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-23T22:04:43.158867] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-23T22:04:43.161019] [DEBUG] [LOCAL ] WF: Trimmed 16708 records to 10870 (keeping 200 days of data) [2025-09-23T22:04:43.245350] [DEBUG] [LOCAL ] WF: Primary data saved (10870 records). [2025-09-23T22:04:43.250039] [INFO ] [MAIN ] WF: Full history saved. [2025-09-23T22:04:43.250207] [INFO ] [MAIN ] Update Progress: 2290/2372 symbols completed. WF took 37.4s. Estimated remaining: 10m 55s. Rate: 7.5 symbols/min [2025-09-23T22:04:43.429623] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-23T22:04:43.540836] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:04:43.573541] [DEBUG] [LOCAL ] WGO: Primary data saved (39379 records). [2025-09-23T22:04:43.573759] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-23T22:04:43.573948] [INFO ] [MAIN ] Update Progress: 2291/2372 symbols completed. WGO took 27.8s. Estimated remaining: 10m 46s. Rate: 7.5 symbols/min [2025-09-23T22:04:43.775136] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:04:43.772472] [DEBUG] [LOCAL ] WHD: Loaded 40594 existing records from primary storage. [2025-09-23T22:04:43.775293] [INFO ] [MAIN ] WHD: Loaded 40594 existing records. [2025-09-23T22:04:43.881862] [DEBUG] [LOCAL ] WHG: Loaded 3418 existing records from primary storage. [2025-09-23T22:04:43.882399] [INFO ] [MAIN ] WHG: Loaded 3418 existing records. [2025-09-23T22:04:44.083916] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:04:44.122833] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-23T22:04:44.201236] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:04:44.201353] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-23T22:04:44.201700] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-23T22:04:44.201773] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-23T22:04:44.202325] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-23T22:04:44.202385] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-23T22:04:44.234737] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-23T22:04:44.240163] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-23T22:04:44.904155] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:04:44.937922] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-23T22:04:44.974290] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:04:45.004480] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-23T22:04:45.013429] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-23T22:04:45.055479] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T22:04:45.565057] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T22:04:45.802219] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-23T22:04:46.229066] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T22:04:46.415727] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T22:04:46.602209] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-23T22:04:47.177443] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T22:04:47.402238] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-23T22:04:48.202207] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-23T22:04:49.002160] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-23T22:04:49.090678] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T22:04:49.634740] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T22:04:49.644636] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-09-23T22:04:49.644789] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-23T22:04:49.814077] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-23T22:04:50.064043] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-23T22:04:50.064263] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-23T22:04:50.065460] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-23T22:04:50.065555] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-23T22:04:50.094874] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T22:04:50.095032] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 53748 (keeping 200 days of data) [2025-09-23T22:04:50.486958] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-09-23T22:04:50.487463] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-23T22:04:50.487725] [INFO ] [MAIN ] Update Progress: 2292/2372 symbols completed. WFC took 39.6s. Estimated remaining: 10m 38s. Rate: 7.5 symbols/min [2025-09-23T22:04:50.568324] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T22:04:50.607252] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-23T22:04:50.683424] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:04:50.732576] [DEBUG] [LOCAL ] WHR: Loaded 48111 existing records from primary storage. [2025-09-23T22:04:50.732781] [INFO ] [MAIN ] WHR: Loaded 48111 existing records. [2025-09-23T22:04:50.914758] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:04:50.915078] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-23T22:04:50.915140] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-23T22:04:50.916598] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-23T22:04:50.916683] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-23T22:04:51.294731] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:04:51.402188] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-23T22:04:52.145633] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T22:04:52.145875] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T22:04:52.202194] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-23T22:04:53.002200] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-23T22:04:53.756794] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T22:04:53.783837] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T22:04:53.802161] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-23T22:04:54.602192] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-23T22:04:55.201538] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T22:04:55.402183] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-23T22:04:55.450286] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T22:04:56.202236] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-23T22:04:56.798424] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T22:04:57.002190] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-23T22:04:57.383151] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-23T22:04:57.495770] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T22:04:57.802212] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-23T22:04:58.602238] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-23T22:04:59.402177] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-23T22:04:59.507823] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T22:04:59.849833] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T22:04:59.850889] [INFO ] [REMOTE ] WHG: Full fetch complete (4671 records). [2025-09-23T22:04:59.850959] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-23T22:05:00.217124] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-23T22:05:00.222508] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-23T22:05:00.223687] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-23T22:05:00.224077] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-23T22:05:00.224262] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-23T22:05:00.225414] [DEBUG] [LOCAL ] WHG: Trimmed 4671 records to 3395 (keeping 200 days of data) [2025-09-23T22:05:00.251194] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T22:05:00.282419] [DEBUG] [LOCAL ] WHG: Primary data saved (3395 records). [2025-09-23T22:05:00.282541] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-23T22:05:00.282660] [INFO ] [MAIN ] Update Progress: 2293/2372 symbols completed. WHG took 16.7s. Estimated remaining: 10m 30s. Rate: 7.5 symbols/min [2025-09-23T22:05:00.455353] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:05:00.465427] [DEBUG] [LOCAL ] WIA: Loaded 4864 existing records from primary storage. [2025-09-23T22:05:00.465533] [INFO ] [MAIN ] WIA: Loaded 4864 existing records. [2025-09-23T22:05:00.647840] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:05:00.648111] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-23T22:05:00.648161] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-23T22:05:00.648603] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-23T22:05:00.648699] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-23T22:05:01.007333] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-23T22:05:01.013169] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:05:01.802189] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-23T22:05:01.999059] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T22:05:02.511005] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T22:05:02.602229] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-23T22:05:02.755636] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T22:05:03.402281] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-23T22:05:04.202277] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-23T22:05:04.283141] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T22:05:04.821620] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T22:05:04.984152] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T22:05:05.002183] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-23T22:05:05.802235] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-23T22:05:06.480876] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T22:05:06.490067] [INFO ] [REMOTE ] WH: Full fetch complete (65019 records). [2025-09-23T22:05:06.490284] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-23T22:05:06.607327] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-23T22:05:06.927294] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-23T22:05:06.927381] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-23T22:05:06.928402] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-23T22:05:06.928467] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-23T22:05:06.929818] [DEBUG] [LOCAL ] WH: Trimmed 65019 records to 45807 (keeping 200 days of data) [2025-09-23T22:05:07.229940] [DEBUG] [LOCAL ] WH: Primary data saved (45807 records). [2025-09-23T22:05:07.230073] [INFO ] [MAIN ] WH: Full history saved. [2025-09-23T22:05:07.230183] [INFO ] [MAIN ] Update Progress: 2294/2372 symbols completed. WH took 32.5s. Estimated remaining: 10m 22s. Rate: 7.5 symbols/min [2025-09-23T22:05:07.400851] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:05:07.402216] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-23T22:05:07.415437] [DEBUG] [LOCAL ] WINN: Loaded 11839 existing records from primary storage. [2025-09-23T22:05:07.415906] [INFO ] [MAIN ] WINN: Loaded 11839 existing records. [2025-09-23T22:05:07.522707] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T22:05:07.630377] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:05:07.624721] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T22:05:07.640123] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-23T22:05:07.640516] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-23T22:05:07.641357] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-23T22:05:07.641419] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-23T22:05:08.050207] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:05:08.202184] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-23T22:05:09.002197] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-23T22:05:09.172629] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T22:05:09.374998] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T22:05:09.802163] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-23T22:05:09.843935] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T22:05:10.602202] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-23T22:05:11.402214] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-23T22:05:11.454406] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T22:05:11.635586] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T22:05:11.992270] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T22:05:12.202199] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-23T22:05:12.884992] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T22:05:13.002239] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-23T22:05:13.802195] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-23T22:05:14.436600] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T22:05:14.602165] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-23T22:05:14.613781] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T22:05:15.402187] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-23T22:05:16.074126] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T22:05:16.140823] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-23T22:05:16.202174] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-23T22:05:16.883273] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T22:05:17.002199] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-23T22:05:17.799767] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T22:05:17.802505] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-23T22:05:18.359184] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T22:05:18.602238] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-23T22:05:19.402235] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-23T22:05:19.910869] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T22:05:20.202166] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-23T22:05:20.365390] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T22:05:20.994782] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T22:05:21.002144] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-23T22:05:21.799190] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T22:05:21.802129] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-23T22:05:22.602203] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-23T22:05:22.624463] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T22:05:22.626235] [INFO ] [REMOTE ] WIA: Full fetch complete (7292 records). [2025-09-23T22:05:22.626308] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-23T22:05:22.988081] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-23T22:05:22.988166] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-23T22:05:22.988354] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-23T22:05:22.988391] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-23T22:05:22.988825] [DEBUG] [LOCAL ] WIA: Trimmed 7292 records to 4863 (keeping 200 days of data) [2025-09-23T22:05:23.016604] [DEBUG] [LOCAL ] WIA: Primary data saved (4863 records). [2025-09-23T22:05:23.016863] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-23T22:05:23.016952] [INFO ] [MAIN ] Update Progress: 2295/2372 symbols completed. WIA took 22.7s. Estimated remaining: 10m 15s. Rate: 7.5 symbols/min [2025-09-23T22:05:23.189454] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:05:23.250076] [DEBUG] [LOCAL ] WIT: Loaded 52271 existing records from primary storage. [2025-09-23T22:05:23.250234] [INFO ] [MAIN ] WIT: Loaded 52271 existing records. [2025-09-23T22:05:23.406862] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-23T22:05:23.436791] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:05:23.437054] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-23T22:05:23.437105] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-23T22:05:23.438236] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-23T22:05:23.438300] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-23T22:05:23.814442] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:05:24.202244] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-23T22:05:24.356952] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T22:05:24.559540] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T22:05:24.566857] [INFO ] [REMOTE ] WHD: Full fetch complete (57133 records). [2025-09-23T22:05:24.566963] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-23T22:05:24.971969] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-23T22:05:24.972051] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-23T22:05:24.972988] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-23T22:05:24.973051] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-23T22:05:24.974222] [DEBUG] [LOCAL ] WHD: Trimmed 57133 records to 40569 (keeping 200 days of data) [2025-09-23T22:05:25.033780] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-23T22:05:25.239213] [DEBUG] [LOCAL ] WHD: Primary data saved (40569 records). [2025-09-23T22:05:25.239365] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-23T22:05:25.239505] [INFO ] [MAIN ] Update Progress: 2296/2372 symbols completed. WHD took 42.0s. Estimated remaining: 10m 6s. Rate: 7.5 symbols/min [2025-09-23T22:05:25.419316] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:05:25.439333] [DEBUG] [LOCAL ] WIW: Loaded 20844 existing records from primary storage. [2025-09-23T22:05:25.439463] [INFO ] [MAIN ] WIW: Loaded 20844 existing records. [2025-09-23T22:05:25.621166] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:05:25.621402] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-23T22:05:25.621507] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-23T22:05:25.622143] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-23T22:05:25.622203] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-23T22:05:25.808480] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-23T22:05:25.994848] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:05:26.025165] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T22:05:26.593924] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T22:05:26.604337] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-23T22:05:26.624730] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T22:05:27.402234] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-23T22:05:27.857132] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T22:05:28.202214] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-23T22:05:28.859667] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T22:05:29.002207] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-23T22:05:29.343575] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-23T22:05:29.802194] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-23T22:05:29.821623] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T22:05:30.602204] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-23T22:05:31.401183] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T22:05:31.410502] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-23T22:05:31.808132] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T22:05:32.202177] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-23T22:05:32.269789] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T22:05:32.272277] [INFO ] [REMOTE ] WINN: Full fetch complete (17708 records). [2025-09-23T22:05:32.272368] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-23T22:05:32.675073] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-23T22:05:32.675151] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-23T22:05:32.675546] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-23T22:05:32.675584] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-23T22:05:32.676248] [DEBUG] [LOCAL ] WINN: Trimmed 17708 records to 11865 (keeping 200 days of data) [2025-09-23T22:05:32.751198] [DEBUG] [LOCAL ] WINN: Primary data saved (11865 records). [2025-09-23T22:05:32.751333] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-23T22:05:32.751415] [INFO ] [MAIN ] Update Progress: 2297/2372 symbols completed. WINN took 25.5s. Estimated remaining: 9m 58s. Rate: 7.5 symbols/min [2025-09-23T22:05:32.933040] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:05:32.944406] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T22:05:32.980995] [DEBUG] [LOCAL ] WK: Loaded 36586 existing records from primary storage. [2025-09-23T22:05:32.981130] [INFO ] [MAIN ] WK: Loaded 36586 existing records. [2025-09-23T22:05:33.010063] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-23T22:05:33.165613] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:05:33.165928] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-23T22:05:33.166003] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-23T22:05:33.166902] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-23T22:05:33.166964] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-23T22:05:33.535045] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:05:33.802210] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-23T22:05:34.602174] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-23T22:05:34.827312] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T22:05:34.850432] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T22:05:35.402245] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-23T22:05:36.202166] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-23T22:05:36.429969] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T22:05:36.946696] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T22:05:37.002144] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-23T22:05:37.802160] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-23T22:05:37.972316] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T22:05:38.602210] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-23T22:05:38.914827] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-23T22:05:39.402177] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-23T22:05:39.549420] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T22:05:39.932191] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T22:05:40.075260] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T22:05:40.202181] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-23T22:05:41.002177] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-23T22:05:41.220678] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T22:05:41.802203] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-23T22:05:42.602178] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-23T22:05:43.257992] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-23T22:05:43.285294] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T22:05:43.285498] [INFO ] [REMOTE ] WHR: Full fetch complete (68315 records). [2025-09-23T22:05:43.296149] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-23T22:05:43.407358] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-23T22:05:43.689050] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-23T22:05:43.689136] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-23T22:05:43.690463] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-23T22:05:43.690529] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-23T22:05:43.692012] [DEBUG] [LOCAL ] WHR: Trimmed 68315 records to 48114 (keeping 200 days of data) [2025-09-23T22:05:43.991431] [DEBUG] [LOCAL ] WHR: Primary data saved (48114 records). [2025-09-23T22:05:43.991570] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-23T22:05:43.991685] [INFO ] [MAIN ] Update Progress: 2298/2372 symbols completed. WHR took 53.5s. Estimated remaining: 9m 51s. Rate: 7.5 symbols/min [2025-09-23T22:05:44.176039] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:05:44.210946] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-23T22:05:44.212720] [DEBUG] [LOCAL ] WKC: Loaded 35178 existing records from primary storage. [2025-09-23T22:05:44.213634] [INFO ] [MAIN ] WKC: Loaded 35178 existing records. [2025-09-23T22:05:44.406462] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:05:44.406893] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-23T22:05:44.407073] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-23T22:05:44.417039] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-23T22:05:44.417206] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-23T22:05:44.543457] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T22:05:44.692428] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T22:05:44.846440] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:05:45.002198] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-23T22:05:45.802168] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-23T22:05:45.971770] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T22:05:46.518195] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T22:05:46.602176] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-23T22:05:47.402191] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-23T22:05:47.668744] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T22:05:47.703515] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T22:05:48.202237] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-23T22:05:48.548398] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T22:05:49.002208] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-23T22:05:49.802179] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-23T22:05:50.125261] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T22:05:50.380824] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T22:05:50.602200] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-23T22:05:50.936617] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T22:05:51.402259] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-23T22:05:52.202167] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-23T22:05:52.357422] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T22:05:52.366174] [INFO ] [REMOTE ] WIT: Full fetch complete (75554 records). [2025-09-23T22:05:52.366301] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-23T22:05:52.771728] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-23T22:05:52.771835] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-23T22:05:52.773108] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-23T22:05:52.773176] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-23T22:05:52.774682] [DEBUG] [LOCAL ] WIT: Trimmed 75554 records to 52285 (keeping 200 days of data) [2025-09-23T22:05:52.913395] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T22:05:53.021666] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-23T22:05:53.058323] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T22:05:53.066614] [INFO ] [REMOTE ] WIW: Full fetch complete (30533 records). [2025-09-23T22:05:53.067005] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-23T22:05:53.558568] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-23T22:05:53.559260] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-23T22:05:53.560401] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-23T22:05:53.560485] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-23T22:05:53.563211] [DEBUG] [LOCAL ] WIW: Trimmed 30533 records to 20769 (keeping 200 days of data) [2025-09-23T22:05:53.703668] [DEBUG] [LOCAL ] WIW: Primary data saved (20769 records). [2025-09-23T22:05:53.704450] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-23T22:05:53.704865] [INFO ] [MAIN ] Update Progress: 2299/2372 symbols completed. WIW took 28.5s. Estimated remaining: 9m 43s. Rate: 7.5 symbols/min [2025-09-23T22:05:53.804785] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-23T22:05:53.815685] [DEBUG] [LOCAL ] WIT: Primary data saved (52285 records). [2025-09-23T22:05:53.820023] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-23T22:05:53.820274] [INFO ] [MAIN ] Update Progress: 2300/2372 symbols completed. WIT took 30.8s. Estimated remaining: 9m 34s. Rate: 7.5 symbols/min [2025-09-23T22:05:54.006722] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:05:54.086857] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:05:54.096892] [DEBUG] [LOCAL ] WLKP: Loaded 6638 existing records from primary storage. [2025-09-23T22:05:54.097078] [INFO ] [MAIN ] WLKP: Loaded 6638 existing records. [2025-09-23T22:05:54.254639] [DEBUG] [LOCAL ] WLK: Loaded 45372 existing records from primary storage. [2025-09-23T22:05:54.288452] [INFO ] [MAIN ] WLK: Loaded 45372 existing records. [2025-09-23T22:05:54.353700] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:05:54.409943] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-23T22:05:54.428511] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-23T22:05:54.434688] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-23T22:05:54.434821] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-23T22:05:54.580851] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:05:54.623152] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-23T22:05:54.623348] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-23T22:05:54.634056] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-23T22:05:54.715886] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-23T22:05:54.812141] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T22:05:54.920929] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-23T22:05:55.057317] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:05:55.287184] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:05:55.402168] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-23T22:05:55.481624] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T22:05:56.202181] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-23T22:05:56.328341] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T22:05:56.699919] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T22:05:56.990875] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T22:05:57.003060] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-23T22:05:57.788522] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T22:05:57.802217] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-23T22:05:58.602206] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-23T22:05:59.181601] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T22:05:59.343036] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T22:05:59.402216] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-23T22:06:00.202202] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-23T22:06:00.914983] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T22:06:01.002255] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-23T22:06:01.667522] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T22:06:01.802284] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-23T22:06:02.622411] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-23T22:06:02.649794] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T22:06:03.402280] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-23T22:06:04.202229] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-23T22:06:04.981950] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T22:06:04.988702] [INFO ] [REMOTE ] WK: Full fetch complete (51959 records). [2025-09-23T22:06:04.988814] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-23T22:06:05.102179] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T22:06:05.111533] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-23T22:06:05.409920] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-23T22:06:05.410182] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-23T22:06:05.411825] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-23T22:06:05.411999] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-23T22:06:05.423029] [DEBUG] [LOCAL ] WK: Trimmed 51959 records to 36653 (keeping 200 days of data) [2025-09-23T22:06:05.438219] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (2.82 seconds). [2025-09-23T22:06:05.685978] [DEBUG] [LOCAL ] WK: Primary data saved (36653 records). [2025-09-23T22:06:05.686142] [INFO ] [MAIN ] WK: Full history saved. [2025-09-23T22:06:05.686257] [INFO ] [MAIN ] Update Progress: 2301/2372 symbols completed. WK took 32.9s. Estimated remaining: 9m 27s. Rate: 7.5 symbols/min [2025-09-23T22:06:05.816777] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (4.01 seconds). [2025-09-23T22:06:05.809079] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-23T22:06:05.893883] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:05.894423] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-23T22:06:05.894471] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-23T22:06:05.894622] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-23T22:06:05.894705] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-23T22:06:05.894762] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-23T22:06:05.894797] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-23T22:06:06.014324] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T22:06:06.274807] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:06:06.602285] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-23T22:06:07.402288] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-23T22:06:07.601813] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T22:06:07.976210] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T22:06:07.998236] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T22:06:08.202203] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-23T22:06:08.609215] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T22:06:09.002268] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-23T22:06:09.802220] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-23T22:06:10.149079] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T22:06:10.602169] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-23T22:06:10.639943] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T22:06:10.950504] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-23T22:06:11.402212] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-23T22:06:11.836210] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T22:06:12.202204] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-23T22:06:12.611725] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T22:06:13.002218] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-23T22:06:13.802202] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-23T22:06:13.831485] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T22:06:14.602222] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-23T22:06:15.402222] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-23T22:06:15.848124] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-23T22:06:15.994681] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-23T22:06:16.202226] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-23T22:06:17.005099] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-23T22:06:17.010934] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-23T22:06:17.556118] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T22:06:17.562601] [INFO ] [REMOTE ] WKC: Full fetch complete (51454 records). [2025-09-23T22:06:17.562762] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-23T22:06:17.803483] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-23T22:06:17.849344] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T22:06:17.978626] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-23T22:06:17.978734] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-23T22:06:17.979604] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-23T22:06:17.979663] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-23T22:06:17.980739] [DEBUG] [LOCAL ] WKC: Trimmed 51454 records to 35151 (keeping 200 days of data) [2025-09-23T22:06:18.191862] [DEBUG] [LOCAL ] WKC: Primary data saved (35151 records). [2025-09-23T22:06:18.192006] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-23T22:06:18.192094] [INFO ] [MAIN ] Update Progress: 2302/2372 symbols completed. WKC took 34.2s. Estimated remaining: 9m 19s. Rate: 7.5 symbols/min [2025-09-23T22:06:18.360226] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:18.394065] [DEBUG] [LOCAL ] WLY: Loaded 30318 existing records from primary storage. [2025-09-23T22:06:18.394337] [INFO ] [MAIN ] WLY: Loaded 30318 existing records. [2025-09-23T22:06:18.578881] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:06:18.579155] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-23T22:06:18.579211] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-23T22:06:18.580157] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-23T22:06:18.580219] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-23T22:06:18.613591] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-23T22:06:18.965799] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:06:19.100084] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-23T22:06:19.402212] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-23T22:06:19.552514] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T22:06:19.834801] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T22:06:20.202233] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-23T22:06:20.838884] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T22:06:21.002211] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-23T22:06:21.748458] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T22:06:21.802159] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-23T22:06:22.541937] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T22:06:22.544351] [INFO ] [REMOTE ] WLKP: Full fetch complete (10173 records). [2025-09-23T22:06:22.544471] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-23T22:06:22.607501] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-23T22:06:22.950254] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-23T22:06:22.950359] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-23T22:06:22.950619] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-23T22:06:22.950691] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-23T22:06:22.951184] [DEBUG] [LOCAL ] WLKP: Trimmed 10173 records to 6653 (keeping 200 days of data) [2025-09-23T22:06:22.992980] [DEBUG] [LOCAL ] WLKP: Primary data saved (6653 records). [2025-09-23T22:06:22.993133] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-23T22:06:22.993225] [INFO ] [MAIN ] Update Progress: 2303/2372 symbols completed. WLKP took 29.2s. Estimated remaining: 9m 11s. Rate: 7.5 symbols/min [2025-09-23T22:06:23.172687] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:23.227121] [DEBUG] [LOCAL ] WM: Loaded 50960 existing records from primary storage. [2025-09-23T22:06:23.227335] [INFO ] [MAIN ] WM: Loaded 50960 existing records. [2025-09-23T22:06:23.405011] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-23T22:06:23.409012] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:06:23.410155] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-23T22:06:23.410206] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-23T22:06:23.411845] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-23T22:06:23.411909] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-23T22:06:23.796285] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:06:23.827709] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T22:06:23.828532] [INFO ] [REMOTE ] WLTG: Full fetch complete (1668 records). [2025-09-23T22:06:23.828601] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-23T22:06:24.024675] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T22:06:24.024927] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T22:06:24.024978] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T22:06:24.025047] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-23T22:06:24.025114] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-23T22:06:24.025152] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-23T22:06:24.025193] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-23T22:06:24.025254] [INFO ] [MAIN ] Update Progress: 2304/2372 symbols completed. WLTG took 18.3s. Estimated remaining: 9m 2s. Rate: 7.5 symbols/min [2025-09-23T22:06:24.203714] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-23T22:06:24.205474] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:24.269119] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-23T22:06:24.269273] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-09-23T22:06:24.477430] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:06:24.477843] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-23T22:06:24.477989] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-23T22:06:24.479671] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-23T22:06:24.479737] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-23T22:06:24.819120] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-23T22:06:24.912912] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:06:25.002189] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-23T22:06:25.716780] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T22:06:25.802184] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-23T22:06:26.602225] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-23T22:06:26.747068] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T22:06:27.065626] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T22:06:27.402217] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-23T22:06:28.202165] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-23T22:06:28.302173] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T22:06:28.417454] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T22:06:29.002197] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-23T22:06:29.802173] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-23T22:06:29.934519] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T22:06:30.491504] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T22:06:30.498958] [INFO ] [REMOTE ] WLK: Full fetch complete (62729 records). [2025-09-23T22:06:30.499077] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-23T22:06:30.604807] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-23T22:06:30.902552] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-23T22:06:30.902669] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-23T22:06:30.903736] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-23T22:06:30.903797] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-23T22:06:30.905125] [DEBUG] [LOCAL ] WLK: Trimmed 62729 records to 45411 (keeping 200 days of data) [2025-09-23T22:06:31.184466] [DEBUG] [LOCAL ] WLK: Primary data saved (45411 records). [2025-09-23T22:06:31.184597] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-23T22:06:31.184757] [INFO ] [MAIN ] Update Progress: 2305/2372 symbols completed. WLK took 37.5s. Estimated remaining: 8m 54s. Rate: 7.5 symbols/min [2025-09-23T22:06:31.357083] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:31.373189] [DEBUG] [LOCAL ] WMK: Loaded 14547 existing records from primary storage. [2025-09-23T22:06:31.373313] [INFO ] [MAIN ] WMK: Loaded 14547 existing records. [2025-09-23T22:06:31.407344] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-23T22:06:31.579923] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:06:31.581159] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-23T22:06:31.581429] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-23T22:06:31.582070] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-23T22:06:31.582134] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-23T22:06:31.946864] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T22:06:32.013366] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:06:32.203741] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-23T22:06:32.207549] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T22:06:32.524559] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T22:06:33.002197] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-23T22:06:33.802192] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-23T22:06:34.089962] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-23T22:06:34.602162] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-23T22:06:35.210154] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T22:06:35.226638] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T22:06:35.402198] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-23T22:06:35.506615] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-23T22:06:36.202184] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-23T22:06:36.219460] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T22:06:37.002217] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-23T22:06:37.802202] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-23T22:06:38.124670] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-23T22:06:38.191977] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T22:06:38.602189] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-23T22:06:39.402188] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-23T22:06:39.860143] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T22:06:40.202165] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-23T22:06:40.301095] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T22:06:41.002397] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-23T22:06:41.372352] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-23T22:06:41.802231] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-23T22:06:42.086603] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T22:06:42.456412] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T22:06:42.602238] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-23T22:06:43.402167] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-23T22:06:43.601861] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T22:06:44.202169] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-23T22:06:44.475066] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T22:06:44.517254] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T22:06:44.813823] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T22:06:45.002237] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-23T22:06:45.802194] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-23T22:06:46.602156] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-23T22:06:46.927723] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T22:06:47.402223] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-23T22:06:47.723038] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T22:06:47.786876] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T22:06:48.202214] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-23T22:06:49.002174] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-23T22:06:49.250237] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T22:06:49.314616] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T22:06:49.802225] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-23T22:06:50.602286] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-23T22:06:50.902686] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T22:06:50.929144] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T22:06:50.935750] [INFO ] [REMOTE ] WLY: Full fetch complete (43286 records). [2025-09-23T22:06:50.935861] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-23T22:06:51.351871] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-23T22:06:51.352017] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-23T22:06:51.353232] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-23T22:06:51.353381] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-23T22:06:51.354932] [DEBUG] [LOCAL ] WLY: Trimmed 43286 records to 30209 (keeping 200 days of data) [2025-09-23T22:06:51.440480] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-23T22:06:51.642858] [DEBUG] [LOCAL ] WLY: Primary data saved (30209 records). [2025-09-23T22:06:51.643057] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-23T22:06:51.643249] [INFO ] [MAIN ] Update Progress: 2306/2372 symbols completed. WLY took 33.5s. Estimated remaining: 8m 47s. Rate: 7.5 symbols/min [2025-09-23T22:06:51.938631] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:52.016783] [DEBUG] [LOCAL ] WMS: Loaded 39626 existing records from primary storage. [2025-09-23T22:06:52.017079] [INFO ] [MAIN ] WMS: Loaded 39626 existing records. [2025-09-23T22:06:52.207457] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-23T22:06:52.297410] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:06:52.297861] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-23T22:06:52.297942] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-23T22:06:52.299241] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-23T22:06:52.299323] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-23T22:06:52.690395] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:06:52.739241] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-23T22:06:52.917813] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T22:06:53.002173] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-23T22:06:53.474908] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-23T22:06:53.802249] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-23T22:06:53.911250] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T22:06:54.511249] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T22:06:54.520200] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-09-23T22:06:54.520330] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-23T22:06:54.607297] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-23T22:06:54.930981] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-23T22:06:54.931062] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-23T22:06:54.932146] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-23T22:06:54.932209] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-23T22:06:54.934019] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-09-23T22:06:55.294768] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-09-23T22:06:55.294928] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-23T22:06:55.295106] [INFO ] [MAIN ] Update Progress: 2307/2372 symbols completed. WMB took 31.3s. Estimated remaining: 8m 39s. Rate: 7.5 symbols/min [2025-09-23T22:06:55.407221] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-23T22:06:55.507009] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:55.571753] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T22:06:55.571387] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-23T22:06:55.574950] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-09-23T22:06:55.759033] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:06:55.759293] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-23T22:06:55.759344] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-23T22:06:55.760626] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-23T22:06:55.760717] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-23T22:06:56.136555] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:06:56.169095] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T22:06:56.180533] [INFO ] [REMOTE ] WM: Full fetch complete (73694 records). [2025-09-23T22:06:56.180704] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-23T22:06:56.207298] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-23T22:06:56.581501] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-23T22:06:56.581587] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-23T22:06:56.582680] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-23T22:06:56.582744] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-23T22:06:56.584757] [DEBUG] [LOCAL ] WM: Trimmed 73694 records to 50959 (keeping 200 days of data) [2025-09-23T22:06:56.927727] [DEBUG] [LOCAL ] WM: Primary data saved (50959 records). [2025-09-23T22:06:56.928018] [INFO ] [MAIN ] WM: Full history saved. [2025-09-23T22:06:56.928153] [INFO ] [MAIN ] Update Progress: 2308/2372 symbols completed. WM took 33.9s. Estimated remaining: 8m 31s. Rate: 7.5 symbols/min [2025-09-23T22:06:57.005564] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-23T22:06:57.182072] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:57.225252] [DEBUG] [LOCAL ] WNC: Loaded 40252 existing records from primary storage. [2025-09-23T22:06:57.234124] [INFO ] [MAIN ] WNC: Loaded 40252 existing records. [2025-09-23T22:06:57.290547] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T22:06:57.421263] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:06:57.421590] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-23T22:06:57.421639] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-23T22:06:57.422838] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-23T22:06:57.422902] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-23T22:06:57.787398] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:06:57.802156] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-23T22:06:58.602206] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-23T22:06:59.082759] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-23T22:06:59.122253] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T22:06:59.227838] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T22:06:59.232089] [INFO ] [REMOTE ] WMK: Full fetch complete (19354 records). [2025-09-23T22:06:59.232163] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-23T22:06:59.408275] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-23T22:06:59.618335] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-23T22:06:59.618427] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-23T22:06:59.618898] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-23T22:06:59.618962] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-23T22:06:59.619578] [DEBUG] [LOCAL ] WMK: Trimmed 19354 records to 14549 (keeping 200 days of data) [2025-09-23T22:06:59.739153] [DEBUG] [LOCAL ] WMK: Primary data saved (14549 records). [2025-09-23T22:06:59.739318] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-23T22:06:59.739457] [INFO ] [MAIN ] Update Progress: 2309/2372 symbols completed. WMK took 28.6s. Estimated remaining: 8m 22s. Rate: 7.5 symbols/min [2025-09-23T22:06:59.926714] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:06:59.975547] [DEBUG] [LOCAL ] WNS: Loaded 39866 existing records from primary storage. [2025-09-23T22:06:59.975815] [INFO ] [MAIN ] WNS: Loaded 39866 existing records. [2025-09-23T22:07:00.160171] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:07:00.160417] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-23T22:07:00.160465] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-23T22:07:00.161479] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-23T22:07:00.161542] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-23T22:07:00.207358] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-23T22:07:00.534421] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:07:01.002193] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-23T22:07:01.802397] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-23T22:07:01.894435] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T22:07:02.026467] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-23T22:07:02.123585] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T22:07:02.602255] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-23T22:07:03.193256] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T22:07:03.402186] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-23T22:07:03.795446] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T22:07:04.202289] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-23T22:07:05.002237] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-23T22:07:05.128920] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T22:07:05.805538] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-23T22:07:05.809308] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T22:07:06.602236] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-23T22:07:07.341746] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T22:07:07.402182] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-23T22:07:07.673268] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-23T22:07:07.707394] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T22:07:08.202237] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-23T22:07:08.856324] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T22:07:09.002230] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-23T22:07:09.802206] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-23T22:07:10.428636] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-23T22:07:10.505343] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T22:07:10.602165] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-23T22:07:10.701445] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T22:07:11.402214] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-23T22:07:12.202266] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-23T22:07:12.569993] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-23T22:07:13.002213] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-23T22:07:13.533788] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T22:07:13.686662] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-23T22:07:13.802201] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-23T22:07:14.540992] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T22:07:14.602222] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-23T22:07:14.922716] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T22:07:15.402191] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-23T22:07:16.207401] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-23T22:07:16.223940] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T22:07:16.630968] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T22:07:17.002195] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-23T22:07:17.570459] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T22:07:17.802282] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-23T22:07:18.542812] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T22:07:18.602143] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-23T22:07:18.977589] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T22:07:19.402211] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-23T22:07:20.057031] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T22:07:20.202257] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-23T22:07:20.804731] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T22:07:21.002209] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-23T22:07:21.802230] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-23T22:07:21.890851] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T22:07:22.602282] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-23T22:07:22.971234] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T22:07:22.976964] [INFO ] [REMOTE ] WNC: Full fetch complete (57478 records). [2025-09-23T22:07:22.977163] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-23T22:07:23.383610] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-23T22:07:23.383803] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-23T22:07:23.384841] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-23T22:07:23.384922] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-23T22:07:23.386467] [DEBUG] [LOCAL ] WNC: Trimmed 57478 records to 40165 (keeping 200 days of data) [2025-09-23T22:07:23.452408] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-23T22:07:23.528820] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T22:07:23.714871] [DEBUG] [LOCAL ] WNC: Primary data saved (40165 records). [2025-09-23T22:07:23.715036] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-23T22:07:23.715155] [INFO ] [MAIN ] Update Progress: 2310/2372 symbols completed. WNC took 26.8s. Estimated remaining: 8m 15s. Rate: 7.5 symbols/min [2025-09-23T22:07:23.907319] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:07:23.971732] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-23T22:07:23.971952] [INFO ] [MAIN ] WOLF: Loaded 53532 existing records. [2025-09-23T22:07:24.172678] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:07:24.173204] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-23T22:07:24.173336] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-23T22:07:24.174795] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-23T22:07:24.174870] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-23T22:07:24.208885] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-23T22:07:24.518817] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T22:07:24.637997] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:07:24.736623] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T22:07:24.745008] [INFO ] [REMOTE ] WMS: Full fetch complete (57357 records). [2025-09-23T22:07:24.745246] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-23T22:07:25.007347] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-23T22:07:25.146605] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-23T22:07:25.146731] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-23T22:07:25.147850] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-23T22:07:25.147918] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-23T22:07:25.149488] [DEBUG] [LOCAL ] WMS: Trimmed 57357 records to 39642 (keeping 200 days of data) [2025-09-23T22:07:25.400019] [DEBUG] [LOCAL ] WMS: Primary data saved (39642 records). [2025-09-23T22:07:25.400171] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-23T22:07:25.400260] [INFO ] [MAIN ] Update Progress: 2311/2372 symbols completed. WMS took 33.8s. Estimated remaining: 8m 7s. Rate: 7.5 symbols/min [2025-09-23T22:07:25.576063] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:07:25.600892] [DEBUG] [LOCAL ] WOR: Loaded 24577 existing records from primary storage. [2025-09-23T22:07:25.601061] [INFO ] [MAIN ] WOR: Loaded 24577 existing records. [2025-09-23T22:07:25.776247] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:07:25.776491] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-23T22:07:25.776539] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-23T22:07:25.777279] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-23T22:07:25.777340] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-23T22:07:25.808564] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-23T22:07:26.143760] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:07:26.499274] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T22:07:26.602260] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-23T22:07:26.805072] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-23T22:07:27.402283] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-23T22:07:27.607091] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T22:07:27.614034] [INFO ] [REMOTE ] WNS: Full fetch complete (54782 records). [2025-09-23T22:07:27.614186] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-23T22:07:28.024172] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-23T22:07:28.024420] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-23T22:07:28.026079] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-23T22:07:28.026164] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-23T22:07:28.060408] [DEBUG] [LOCAL ] WNS: Trimmed 54782 records to 39966 (keeping 200 days of data) [2025-09-23T22:07:28.062474] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-23T22:07:28.206729] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-23T22:07:28.353241] [DEBUG] [LOCAL ] WNS: Primary data saved (39966 records). [2025-09-23T22:07:28.353487] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-23T22:07:28.353619] [INFO ] [MAIN ] Update Progress: 2312/2372 symbols completed. WNS took 28.6s. Estimated remaining: 7m 59s. Rate: 7.5 symbols/min [2025-09-23T22:07:28.545062] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:07:28.580152] [DEBUG] [LOCAL ] WOW: Loaded 29992 existing records from primary storage. [2025-09-23T22:07:28.580311] [INFO ] [MAIN ] WOW: Loaded 29992 existing records. [2025-09-23T22:07:28.770946] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:07:28.771321] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-23T22:07:28.771376] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-23T22:07:28.772088] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-23T22:07:28.772154] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-23T22:07:29.016360] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-23T22:07:29.184144] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:07:29.802190] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-23T22:07:29.892451] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-23T22:07:30.429504] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T22:07:30.617055] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-23T22:07:30.625518] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-23T22:07:31.153999] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T22:07:31.402190] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-23T22:07:31.928368] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T22:07:32.202212] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-23T22:07:33.002159] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-23T22:07:33.419538] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T22:07:33.595474] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-23T22:07:33.779756] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T22:07:33.802143] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-23T22:07:34.602199] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-23T22:07:34.849594] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T22:07:35.402211] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-23T22:07:36.202212] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-23T22:07:36.276533] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T22:07:36.306508] [DEBUG] [REMOTE ] WMT: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-23T22:07:36.307001] [WARN ] [REMOTE ] WMT: No data returned for month 2025-07 [2025-09-23T22:07:37.002205] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-23T22:07:37.708276] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-23T22:07:37.802187] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-23T22:07:38.602198] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-23T22:07:39.402260] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-23T22:07:39.820765] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-23T22:07:39.955492] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T22:07:40.202168] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-23T22:07:40.242381] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-23T22:07:40.807687] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T22:07:41.002258] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-23T22:07:41.353404] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T22:07:41.802189] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-23T22:07:42.293147] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T22:07:42.508708] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T22:07:42.518043] [INFO ] [REMOTE ] WMT: Full fetch complete (69408 records). [2025-09-23T22:07:42.518203] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-23T22:07:42.607328] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-23T22:07:42.731079] [WARN ] [VALIDATOR ] WMT: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-23T22:07:42.731787] [FATAL] [MAIN ] WMT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T22:07:42.731860] [WARN ] [MAIN ] WMT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T22:07:42.731908] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-23T22:07:42.731968] [DEBUG] [LOCAL ] WMT: No primary data file found to delete. [2025-09-23T22:07:42.732004] [INFO ] [LOCAL ] WMT: Starting deletion of derivative data. [2025-09-23T22:07:42.732427] [DEBUG] [LOCAL ] WMT: Deleted derivative data file. [2025-09-23T22:07:42.732528] [INFO ] [MAIN ] Update Progress: 2313/2372 symbols completed. WMT took 47.4s. Estimated remaining: 7m 51s. Rate: 7.5 symbols/min [2025-09-23T22:07:42.903366] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:07:42.953608] [DEBUG] [LOCAL ] WPC: Loaded 48670 existing records from primary storage. [2025-09-23T22:07:42.953792] [INFO ] [MAIN ] WPC: Loaded 48670 existing records. [2025-09-23T22:07:43.131667] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:07:43.131902] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-23T22:07:43.131954] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-23T22:07:43.133046] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-23T22:07:43.133108] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-23T22:07:43.407730] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-23T22:07:43.491907] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:07:44.202256] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-23T22:07:44.630840] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T22:07:44.862881] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-23T22:07:45.002258] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-23T22:07:45.297213] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T22:07:45.802236] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-23T22:07:46.602214] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-23T22:07:46.791938] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T22:07:47.402194] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-23T22:07:47.715199] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T22:07:48.202176] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-23T22:07:48.240255] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-23T22:07:48.690881] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T22:07:49.002269] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-23T22:07:49.205931] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T22:07:49.802263] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-23T22:07:50.602252] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-23T22:07:51.327725] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T22:07:51.402146] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-23T22:07:51.463514] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-23T22:07:52.202196] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-23T22:07:52.326501] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T22:07:52.821773] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T22:07:52.828168] [INFO ] [REMOTE ] WOW: Full fetch complete (41537 records). [2025-09-23T22:07:52.828266] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-23T22:07:53.008909] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-23T22:07:53.211756] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-23T22:07:53.211834] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-23T22:07:53.212688] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-23T22:07:53.212752] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-23T22:07:53.213670] [DEBUG] [LOCAL ] WOW: Trimmed 41537 records to 30117 (keeping 200 days of data) [2025-09-23T22:07:53.374825] [DEBUG] [LOCAL ] WOW: Primary data saved (30117 records). [2025-09-23T22:07:53.374956] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-23T22:07:53.375041] [INFO ] [MAIN ] Update Progress: 2314/2372 symbols completed. WOW took 25.0s. Estimated remaining: 7m 43s. Rate: 7.5 symbols/min [2025-09-23T22:07:53.546868] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:07:53.597785] [DEBUG] [LOCAL ] WPM: Loaded 52724 existing records from primary storage. [2025-09-23T22:07:53.597929] [INFO ] [MAIN ] WPM: Loaded 52724 existing records. [2025-09-23T22:07:53.775110] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:07:53.775421] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-23T22:07:53.775472] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-23T22:07:53.776708] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-23T22:07:53.776771] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-23T22:07:53.808309] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-23T22:07:54.138612] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:07:54.471832] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T22:07:54.602157] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-23T22:07:54.626937] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T22:07:54.864259] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T22:07:55.402232] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-23T22:07:56.202178] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-23T22:07:56.489682] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T22:07:56.493621] [INFO ] [REMOTE ] WOR: Full fetch complete (35724 records). [2025-09-23T22:07:56.493785] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-23T22:07:56.882712] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-23T22:07:56.882815] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-23T22:07:56.883552] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-23T22:07:56.883631] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-23T22:07:56.884729] [DEBUG] [LOCAL ] WOR: Trimmed 35724 records to 24614 (keeping 200 days of data) [2025-09-23T22:07:57.009934] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-23T22:07:57.020093] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-23T22:07:57.057222] [INFO ] [REMOTE ] WOLF: Full fetch complete (77599 records). [2025-09-23T22:07:57.071238] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-23T22:07:57.136257] [DEBUG] [LOCAL ] WOR: Primary data saved (24614 records). [2025-09-23T22:07:57.158324] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-23T22:07:57.164124] [INFO ] [MAIN ] Update Progress: 2315/2372 symbols completed. WOR took 31.8s. Estimated remaining: 7m 35s. Rate: 7.5 symbols/min [2025-09-23T22:07:57.557200] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:07:57.708529] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-23T22:07:57.717447] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-23T22:07:57.718818] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-23T22:07:57.719138] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-23T22:07:57.720765] [DEBUG] [LOCAL ] WOLF: Trimmed 77599 records to 53532 (keeping 200 days of data) [2025-09-23T22:07:57.818709] [DEBUG] [LOCAL ] WPP: Loaded 33716 existing records from primary storage. [2025-09-23T22:07:57.819834] [INFO ] [MAIN ] WPP: Loaded 33716 existing records. [2025-09-23T22:07:58.014211] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:07:58.017451] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-23T22:07:58.017624] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-23T22:07:58.029257] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-23T22:07:58.035780] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-23T22:07:58.093175] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T22:07:58.130836] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-23T22:07:58.456636] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:07:58.607333] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-23T22:07:58.651212] [DEBUG] [LOCAL ] WOLF: Primary data saved (53532 records). [2025-09-23T22:07:58.651363] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-23T22:07:58.651527] [INFO ] [MAIN ] Update Progress: 2316/2372 symbols completed. WOLF took 34.9s. Estimated remaining: 7m 27s. Rate: 7.5 symbols/min [2025-09-23T22:07:58.825116] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:07:58.882827] [DEBUG] [LOCAL ] WRB: Loaded 50615 existing records from primary storage. [2025-09-23T22:07:58.898842] [INFO ] [MAIN ] WRB: Loaded 50615 existing records. [2025-09-23T22:07:58.982404] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T22:07:59.102357] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:07:59.102622] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-23T22:07:59.102702] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-23T22:07:59.103860] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-23T22:07:59.103924] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-23T22:07:59.420384] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-23T22:07:59.464786] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:07:59.603603] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T22:07:59.653979] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T22:08:00.202207] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-23T22:08:01.002185] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-23T22:08:01.215922] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T22:08:01.551781] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T22:08:01.802237] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-23T22:08:02.602179] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-23T22:08:02.672543] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T22:08:03.402170] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-23T22:08:03.484465] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T22:08:03.906494] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T22:08:04.202235] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-23T22:08:05.002243] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-23T22:08:05.312210] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-23T22:08:05.699936] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T22:08:05.802209] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-23T22:08:06.602168] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-23T22:08:06.762401] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T22:08:07.226095] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T22:08:07.402201] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-23T22:08:08.202182] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-23T22:08:08.600970] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T22:08:09.002181] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-23T22:08:09.245606] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T22:08:09.802260] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-23T22:08:10.321929] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-23T22:08:10.602237] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-23T22:08:11.121342] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-23T22:08:11.263402] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T22:08:11.402198] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-23T22:08:12.202179] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-23T22:08:12.509812] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T22:08:13.002229] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-23T22:08:13.387471] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-23T22:08:13.552481] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T22:08:13.802257] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-23T22:08:14.381284] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T22:08:14.602265] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-23T22:08:14.789115] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T22:08:15.402291] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-23T22:08:16.082390] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T22:08:16.202194] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-23T22:08:17.002184] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-23T22:08:17.093358] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T22:08:17.802229] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-23T22:08:18.165085] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-23T22:08:18.305620] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T22:08:18.602250] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-23T22:08:19.402228] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-23T22:08:19.449589] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T22:08:19.843447] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T22:08:20.202272] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-23T22:08:21.002175] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-23T22:08:21.398267] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-23T22:08:21.793408] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T22:08:21.803841] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-23T22:08:22.188445] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T22:08:22.196464] [INFO ] [REMOTE ] WPC: Full fetch complete (70926 records). [2025-09-23T22:08:22.196603] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-23T22:08:22.607581] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-23T22:08:22.612231] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-23T22:08:22.612575] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-23T22:08:22.614631] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-23T22:08:22.614844] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-23T22:08:22.616840] [DEBUG] [LOCAL ] WPC: Trimmed 70926 records to 48608 (keeping 200 days of data) [2025-09-23T22:08:22.937415] [DEBUG] [LOCAL ] WPC: Primary data saved (48608 records). [2025-09-23T22:08:22.937578] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-23T22:08:22.937699] [INFO ] [MAIN ] Update Progress: 2317/2372 symbols completed. WPC took 40.2s. Estimated remaining: 7m 19s. Rate: 7.5 symbols/min [2025-09-23T22:08:23.402198] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-23T22:08:24.026680] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-23T22:08:24.181547] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T22:08:24.202141] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-23T22:08:25.002168] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-23T22:08:25.186664] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T22:08:25.196465] [INFO ] [REMOTE ] WPM: Full fetch complete (75815 records). [2025-09-23T22:08:25.196635] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-23T22:08:25.645748] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T22:08:25.756745] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-23T22:08:25.756883] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-23T22:08:25.758061] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-23T22:08:25.758271] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-23T22:08:25.758439] [INFO ] [REMOTE ] WRB: Full fetch complete (73086 records). [2025-09-23T22:08:25.758676] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-23T22:08:25.821473] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T22:08:25.862750] [INFO ] [REMOTE ] WPP: Full fetch complete (44945 records). [2025-09-23T22:08:25.868406] [DEBUG] [LOCAL ] WPM: Trimmed 75815 records to 52728 (keeping 200 days of data) [2025-09-23T22:08:25.891962] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-23T22:08:26.559723] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-23T22:08:26.683678] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-23T22:08:26.732784] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-23T22:08:26.738151] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-23T22:08:26.854243] [DEBUG] [LOCAL ] WRB: Trimmed 73086 records to 50581 (keeping 200 days of data) [2025-09-23T22:08:26.894979] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-23T22:08:26.896155] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-23T22:08:26.897225] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-23T22:08:26.950521] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-23T22:08:27.061928] [DEBUG] [LOCAL ] WPP: Trimmed 44945 records to 33736 (keeping 200 days of data) [2025-09-23T22:08:27.135266] [DEBUG] [LOCAL ] WPM: Primary data saved (52728 records). [2025-09-23T22:08:27.137552] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-23T22:08:27.145820] [INFO ] [MAIN ] Update Progress: 2318/2372 symbols completed. WPM took 33.8s. Estimated remaining: 7m 11s. Rate: 7.5 symbols/min [2025-09-23T22:08:27.302381] [DEBUG] [LOCAL ] WPP: Primary data saved (33736 records). [2025-09-23T22:08:27.311110] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-23T22:08:27.311808] [INFO ] [MAIN ] Update Progress: 2319/2372 symbols completed. WPP took 30.1s. Estimated remaining: 7m 3s. Rate: 7.5 symbols/min [2025-09-23T22:08:27.509075] [DEBUG] [LOCAL ] WRB: Primary data saved (50581 records). [2025-09-23T22:08:27.509244] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-23T22:08:27.509338] [INFO ] [MAIN ] Update Progress: 2320/2372 symbols completed. WRB took 28.9s. Estimated remaining: 6m 55s. Rate: 7.5 symbols/min [2025-09-23T22:08:28.153280] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:08:28.216784] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:08:28.227582] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:08:28.285296] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:08:28.321312] [DEBUG] [LOCAL ] WSO: Loaded 24683 existing records from primary storage. [2025-09-23T22:08:28.321521] [INFO ] [MAIN ] WSO: Loaded 24683 existing records. [2025-09-23T22:08:28.395248] [DEBUG] [LOCAL ] WS: Loaded 23847 existing records from primary storage. [2025-09-23T22:08:28.429858] [INFO ] [MAIN ] WS: Loaded 23847 existing records. [2025-09-23T22:08:28.654327] [DEBUG] [LOCAL ] WSM: Loaded 49931 existing records from primary storage. [2025-09-23T22:08:28.699920] [DEBUG] [LOCAL ] WRBY: Loaded 50873 existing records from primary storage. [2025-09-23T22:08:28.700092] [INFO ] [MAIN ] WSM: Loaded 49931 existing records. [2025-09-23T22:08:28.700247] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:08:28.722715] [INFO ] [MAIN ] WRBY: Loaded 50873 existing records. [2025-09-23T22:08:28.749556] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-23T22:08:28.821401] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-23T22:08:28.850998] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-23T22:08:28.874324] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-23T22:08:29.029290] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:08:29.198886] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-23T22:08:29.232253] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-23T22:08:29.289100] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-23T22:08:29.302238] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-23T22:08:29.318995] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:08:29.330014] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:08:29.347371] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-23T22:08:29.373973] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-23T22:08:29.408247] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-23T22:08:29.411795] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-23T22:08:29.411884] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-23T22:08:29.417235] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-23T22:08:29.422612] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-23T22:08:29.464538] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-23T22:08:30.277736] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:08:30.326434] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-23T22:08:30.742077] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:08:30.739103] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:08:30.754061] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-23T22:08:30.769569] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-23T22:08:30.775765] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:08:30.777591] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-23T22:08:31.575678] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T22:08:31.579803] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-23T22:08:32.115217] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T22:08:32.121757] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-23T22:08:32.454411] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T22:08:32.465150] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-23T22:08:32.551584] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T22:08:32.562387] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-23T22:08:32.666961] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T22:08:32.671502] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-23T22:08:33.028198] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T22:08:33.034241] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-23T22:08:33.944949] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T22:08:33.950419] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-23T22:08:34.197417] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T22:08:34.241361] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T22:08:34.546914] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-23T22:08:34.602175] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-23T22:08:35.171454] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T22:08:35.402248] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-23T22:08:36.202175] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-23T22:08:36.306988] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T22:08:36.380877] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T22:08:37.002204] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-23T22:08:37.598218] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T22:08:37.802235] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-23T22:08:38.297077] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T22:08:38.581167] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T22:08:38.602153] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-23T22:08:39.402222] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-23T22:08:39.762869] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T22:08:40.202192] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-23T22:08:41.002193] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-23T22:08:41.159945] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T22:08:41.188238] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T22:08:41.802261] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-23T22:08:42.140517] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T22:08:42.602214] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-23T22:08:43.199084] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T22:08:43.402258] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-23T22:08:44.202210] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-23T22:08:44.546872] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T22:08:44.750112] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T22:08:45.002234] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-23T22:08:45.331077] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T22:08:45.802334] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-23T22:08:45.897112] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T22:08:45.902578] [INFO ] [REMOTE ] WSO: Full fetch complete (33932 records). [2025-09-23T22:08:45.902783] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-23T22:08:46.280365] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-23T22:08:46.280452] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-23T22:08:46.281186] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-23T22:08:46.281274] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-23T22:08:46.282074] [DEBUG] [LOCAL ] WSO: Trimmed 33932 records to 24720 (keeping 200 days of data) [2025-09-23T22:08:46.440040] [DEBUG] [LOCAL ] WSO: Primary data saved (24720 records). [2025-09-23T22:08:46.440174] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-23T22:08:46.440276] [INFO ] [MAIN ] Update Progress: 2321/2372 symbols completed. WSO took 18.9s. Estimated remaining: 6m 47s. Rate: 7.5 symbols/min [2025-09-23T22:08:46.607446] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-23T22:08:46.662989] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:08:46.689074] [DEBUG] [LOCAL ] WSR: Loaded 23388 existing records from primary storage. [2025-09-23T22:08:46.689225] [INFO ] [MAIN ] WSR: Loaded 23388 existing records. [2025-09-23T22:08:46.868490] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:08:46.868789] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-23T22:08:46.868850] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-23T22:08:46.869564] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-23T22:08:46.869624] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-23T22:08:47.232896] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:08:47.268346] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T22:08:47.402242] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-23T22:08:47.614841] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T22:08:48.202235] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-23T22:08:48.914971] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T22:08:49.002205] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-23T22:08:49.262530] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T22:08:49.802249] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-23T22:08:50.528587] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T22:08:50.602164] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-23T22:08:50.984537] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-23T22:08:51.402212] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-23T22:08:51.680891] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T22:08:52.202257] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-23T22:08:53.002225] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-23T22:08:53.097078] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T22:08:53.802159] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-23T22:08:53.976296] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T22:08:54.012157] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T22:08:54.602215] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-23T22:08:55.402229] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-23T22:08:55.603867] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T22:08:55.955545] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T22:08:56.202173] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-23T22:08:56.234054] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T22:08:57.002282] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-23T22:08:57.802221] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-23T22:08:58.008367] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T22:08:58.058343] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T22:08:58.602208] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-23T22:08:59.402215] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-23T22:08:59.683945] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T22:08:59.801916] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T22:09:00.202201] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-23T22:09:00.993721] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T22:09:01.002256] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-23T22:09:01.003841] [INFO ] [REMOTE ] WRBY: Full fetch complete (73336 records). [2025-09-23T22:09:01.004029] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-23T22:09:01.426403] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-23T22:09:01.426515] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-23T22:09:01.428044] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-23T22:09:01.428178] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-23T22:09:01.431239] [DEBUG] [LOCAL ] WRBY: Trimmed 73336 records to 50882 (keeping 200 days of data) [2025-09-23T22:09:01.764562] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T22:09:01.786255] [DEBUG] [LOCAL ] WRBY: Primary data saved (50882 records). [2025-09-23T22:09:01.786532] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-23T22:09:01.786829] [INFO ] [MAIN ] Update Progress: 2322/2372 symbols completed. WRBY took 34.3s. Estimated remaining: 6m 39s. Rate: 7.5 symbols/min [2025-09-23T22:09:01.809290] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-23T22:09:01.982855] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:02.029423] [DEBUG] [LOCAL ] WST: Loaded 37728 existing records from primary storage. [2025-09-23T22:09:02.029589] [INFO ] [MAIN ] WST: Loaded 37728 existing records. [2025-09-23T22:09:02.263731] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T22:09:02.262316] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:09:02.271484] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-23T22:09:02.272075] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-23T22:09:02.272824] [INFO ] [REMOTE ] WSM: Full fetch complete (72220 records). [2025-09-23T22:09:02.272978] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-23T22:09:02.273402] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-23T22:09:02.273492] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-23T22:09:02.610546] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-23T22:09:03.058933] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:03.076743] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-23T22:09:03.076854] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-23T22:09:03.078317] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-23T22:09:03.078387] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-23T22:09:03.080053] [DEBUG] [LOCAL ] WSM: Trimmed 72220 records to 49906 (keeping 200 days of data) [2025-09-23T22:09:03.404085] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-23T22:09:03.413614] [DEBUG] [LOCAL ] WSM: Primary data saved (49906 records). [2025-09-23T22:09:03.413724] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-23T22:09:03.413945] [INFO ] [MAIN ] Update Progress: 2323/2372 symbols completed. WSM took 35.9s. Estimated remaining: 6m 31s. Rate: 7.5 symbols/min [2025-09-23T22:09:03.583176] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:03.635286] [DEBUG] [LOCAL ] WT: Loaded 47585 existing records from primary storage. [2025-09-23T22:09:03.635427] [INFO ] [MAIN ] WT: Loaded 47585 existing records. [2025-09-23T22:09:03.814576] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:09:03.814856] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-23T22:09:03.814915] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-23T22:09:03.816099] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-23T22:09:03.816159] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-23T22:09:04.177382] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:04.202195] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-23T22:09:04.284418] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-23T22:09:04.293343] [INFO ] [REMOTE ] WS: Full fetch complete (36207 records). [2025-09-23T22:09:04.293494] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-23T22:09:04.688764] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-23T22:09:04.688888] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-23T22:09:04.689697] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-23T22:09:04.689777] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-23T22:09:04.691426] [DEBUG] [LOCAL ] WS: Trimmed 36207 records to 23862 (keeping 200 days of data) [2025-09-23T22:09:04.707080] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T22:09:04.873695] [DEBUG] [LOCAL ] WS: Primary data saved (23862 records). [2025-09-23T22:09:04.873833] [INFO ] [MAIN ] WS: Full history saved. [2025-09-23T22:09:04.873961] [INFO ] [MAIN ] Update Progress: 2324/2372 symbols completed. WS took 37.4s. Estimated remaining: 6m 23s. Rate: 7.5 symbols/min [2025-09-23T22:09:05.005025] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-23T22:09:05.052745] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:05.104358] [DEBUG] [LOCAL ] WTI: Loaded 43694 existing records from primary storage. [2025-09-23T22:09:05.104797] [INFO ] [MAIN ] WTI: Loaded 43694 existing records. [2025-09-23T22:09:05.254495] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T22:09:05.326220] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:09:05.326614] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-23T22:09:05.326698] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-23T22:09:05.327871] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-23T22:09:05.327932] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-23T22:09:05.697384] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:05.727145] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T22:09:05.802157] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-23T22:09:05.883672] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T22:09:06.602253] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-23T22:09:07.402168] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-23T22:09:07.592292] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T22:09:08.207272] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-23T22:09:08.226385] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T22:09:08.920882] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T22:09:09.002213] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-23T22:09:09.283557] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T22:09:09.802211] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-23T22:09:10.487765] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T22:09:10.602183] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-23T22:09:11.304030] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T22:09:11.402186] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-23T22:09:11.712154] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T22:09:12.202217] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-23T22:09:12.779943] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T22:09:13.002238] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-23T22:09:13.802203] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-23T22:09:14.602199] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-23T22:09:14.897871] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-23T22:09:15.402276] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-23T22:09:15.459201] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-23T22:09:15.674301] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T22:09:15.753450] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T22:09:15.757425] [INFO ] [REMOTE ] WSR: Full fetch complete (32786 records). [2025-09-23T22:09:15.757532] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-23T22:09:16.133299] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-23T22:09:16.133387] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-23T22:09:16.134062] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-23T22:09:16.134124] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-23T22:09:16.134893] [DEBUG] [LOCAL ] WSR: Trimmed 32786 records to 23361 (keeping 200 days of data) [2025-09-23T22:09:16.205372] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-23T22:09:16.290912] [DEBUG] [LOCAL ] WSR: Primary data saved (23361 records). [2025-09-23T22:09:16.291074] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-23T22:09:16.291191] [INFO ] [MAIN ] Update Progress: 2325/2372 symbols completed. WSR took 29.9s. Estimated remaining: 6m 15s. Rate: 7.5 symbols/min [2025-09-23T22:09:16.458687] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:16.458920] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-23T22:09:16.458963] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-23T22:09:16.459136] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-23T22:09:16.459178] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-23T22:09:16.459217] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-23T22:09:16.459249] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-23T22:09:16.827634] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:17.002200] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-23T22:09:17.109639] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T22:09:17.335131] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-23T22:09:17.501104] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T22:09:17.802199] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-23T22:09:18.602247] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-23T22:09:19.151508] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T22:09:19.402187] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-23T22:09:19.489679] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T22:09:20.202196] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-23T22:09:20.619194] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T22:09:21.002177] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-23T22:09:21.060254] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T22:09:21.802217] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-23T22:09:22.297195] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-23T22:09:22.563999] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T22:09:22.602143] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-23T22:09:23.402215] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-23T22:09:24.202215] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-23T22:09:24.463569] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T22:09:25.002251] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-23T22:09:25.144317] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T22:09:25.802174] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-23T22:09:25.985003] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T22:09:26.465302] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T22:09:26.602221] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-23T22:09:27.351324] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T22:09:27.402169] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-23T22:09:27.909674] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T22:09:27.918211] [INFO ] [REMOTE ] WT: Full fetch complete (69032 records). [2025-09-23T22:09:27.918322] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-23T22:09:28.207343] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-23T22:09:28.312126] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-23T22:09:28.312205] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-23T22:09:28.313322] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-23T22:09:28.313386] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-23T22:09:28.314716] [DEBUG] [LOCAL ] WT: Trimmed 69032 records to 47621 (keeping 200 days of data) [2025-09-23T22:09:28.597433] [DEBUG] [LOCAL ] WT: Primary data saved (47621 records). [2025-09-23T22:09:28.597559] [INFO ] [MAIN ] WT: Full history saved. [2025-09-23T22:09:28.597667] [INFO ] [MAIN ] Update Progress: 2326/2372 symbols completed. WT took 25.2s. Estimated remaining: 6m 7s. Rate: 7.5 symbols/min [2025-09-23T22:09:28.782058] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:28.782323] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T22:09:28.833865] [DEBUG] [LOCAL ] WTRG: Loaded 50932 existing records from primary storage. [2025-09-23T22:09:28.834044] [INFO ] [MAIN ] WTRG: Loaded 50932 existing records. [2025-09-23T22:09:29.015459] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-23T22:09:29.015383] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:09:29.016945] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-23T22:09:29.017080] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-23T22:09:29.018359] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-23T22:09:29.018424] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-23T22:09:29.343493] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T22:09:29.434145] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:29.475140] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T22:09:29.802198] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-23T22:09:30.280391] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T22:09:30.602195] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-23T22:09:31.075073] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T22:09:31.402155] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-23T22:09:31.897662] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T22:09:32.202168] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-23T22:09:33.002186] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-23T22:09:33.681121] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T22:09:33.682309] [INFO ] [REMOTE ] WTM: Full fetch complete (2202 records). [2025-09-23T22:09:33.682380] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-23T22:09:33.822778] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-23T22:09:33.874234] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T22:09:33.874633] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T22:09:33.874749] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T22:09:33.874972] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-23T22:09:33.875135] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-23T22:09:33.875217] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-23T22:09:33.875364] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-23T22:09:33.875539] [INFO ] [MAIN ] Update Progress: 2327/2372 symbols completed. WTM took 17.6s. Estimated remaining: 5m 59s. Rate: 7.5 symbols/min [2025-09-23T22:09:34.070609] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:34.075362] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T22:09:34.103400] [DEBUG] [LOCAL ] WTS: Loaded 18557 existing records from primary storage. [2025-09-23T22:09:34.103519] [INFO ] [MAIN ] WTS: Loaded 18557 existing records. [2025-09-23T22:09:34.278769] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:09:34.279012] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-23T22:09:34.279060] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-23T22:09:34.279678] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-23T22:09:34.279740] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-23T22:09:34.604916] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-23T22:09:34.642143] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:35.402172] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-23T22:09:35.557955] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T22:09:36.090829] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T22:09:36.202186] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-23T22:09:36.641439] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T22:09:37.002187] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-23T22:09:37.802169] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-23T22:09:37.832883] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T22:09:37.904639] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T22:09:38.602193] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-23T22:09:39.232866] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T22:09:39.402189] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-23T22:09:40.102240] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T22:09:40.110291] [INFO ] [REMOTE ] WTI: Full fetch complete (64119 records). [2025-09-23T22:09:40.110488] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-23T22:09:40.209054] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-23T22:09:40.591310] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-23T22:09:40.591454] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-23T22:09:40.592509] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-23T22:09:40.592633] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-23T22:09:40.594312] [DEBUG] [LOCAL ] WTI: Trimmed 64119 records to 43736 (keeping 200 days of data) [2025-09-23T22:09:40.829004] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T22:09:40.890805] [DEBUG] [LOCAL ] WTI: Primary data saved (43736 records). [2025-09-23T22:09:40.890947] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-23T22:09:40.891033] [INFO ] [MAIN ] Update Progress: 2328/2372 symbols completed. WTI took 36.0s. Estimated remaining: 5m 51s. Rate: 7.5 symbols/min [2025-09-23T22:09:41.007308] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-23T22:09:41.063487] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:41.106487] [DEBUG] [LOCAL ] WTTR: Loaded 45079 existing records from primary storage. [2025-09-23T22:09:41.106710] [INFO ] [MAIN ] WTTR: Loaded 45079 existing records. [2025-09-23T22:09:41.286803] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:09:41.287282] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-23T22:09:41.287494] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-23T22:09:41.288563] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-23T22:09:41.288629] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-23T22:09:41.613242] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T22:09:41.698848] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:41.802171] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-23T22:09:42.534268] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T22:09:42.602151] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-23T22:09:43.402253] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-23T22:09:43.454637] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T22:09:43.995931] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T22:09:44.003606] [INFO ] [REMOTE ] WST: Full fetch complete (53395 records). [2025-09-23T22:09:44.003799] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-23T22:09:44.203210] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-23T22:09:44.419611] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-23T22:09:44.419749] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-23T22:09:44.420835] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-23T22:09:44.420921] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-23T22:09:44.432380] [DEBUG] [LOCAL ] WST: Trimmed 53395 records to 37595 (keeping 200 days of data) [2025-09-23T22:09:44.452194] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T22:09:44.696899] [DEBUG] [LOCAL ] WST: Primary data saved (37595 records). [2025-09-23T22:09:44.697084] [INFO ] [MAIN ] WST: Full history saved. [2025-09-23T22:09:44.700476] [INFO ] [MAIN ] Update Progress: 2329/2372 symbols completed. WST took 42.9s. Estimated remaining: 5m 43s. Rate: 7.5 symbols/min [2025-09-23T22:09:44.881273] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:44.946212] [DEBUG] [LOCAL ] WU: Loaded 53451 existing records from primary storage. [2025-09-23T22:09:44.946412] [INFO ] [MAIN ] WU: Loaded 53451 existing records. [2025-09-23T22:09:45.008584] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-23T22:09:45.126291] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:09:45.126531] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-23T22:09:45.126580] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-23T22:09:45.127876] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-23T22:09:45.127974] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-23T22:09:45.483890] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:45.802201] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-23T22:09:45.909854] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T22:09:46.428220] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T22:09:46.485009] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T22:09:46.602180] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-23T22:09:47.402254] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-23T22:09:47.784887] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T22:09:48.202218] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-23T22:09:49.002198] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-23T22:09:49.288920] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T22:09:49.807621] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-23T22:09:49.836956] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T22:09:50.458719] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T22:09:50.602150] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-23T22:09:51.030795] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T22:09:51.402241] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-23T22:09:52.188147] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T22:09:52.202145] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-23T22:09:52.498273] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T22:09:53.002207] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-23T22:09:53.761708] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T22:09:53.802151] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-23T22:09:54.602230] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-23T22:09:54.677149] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T22:09:55.402185] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-23T22:09:55.500403] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T22:09:55.509321] [INFO ] [REMOTE ] WTRG: Full fetch complete (73213 records). [2025-09-23T22:09:55.509468] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-23T22:09:55.909117] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-23T22:09:55.909221] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-23T22:09:55.910419] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-23T22:09:55.910544] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-23T22:09:55.912189] [DEBUG] [LOCAL ] WTRG: Trimmed 73213 records to 50937 (keeping 200 days of data) [2025-09-23T22:09:56.044896] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T22:09:56.223227] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-23T22:09:56.264483] [DEBUG] [LOCAL ] WTRG: Primary data saved (50937 records). [2025-09-23T22:09:56.264613] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-23T22:09:56.266045] [INFO ] [MAIN ] Update Progress: 2330/2372 symbols completed. WTRG took 27.7s. Estimated remaining: 5m 35s. Rate: 7.5 symbols/min [2025-09-23T22:09:56.438140] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:09:56.493685] [DEBUG] [LOCAL ] WWW: Loaded 49168 existing records from primary storage. [2025-09-23T22:09:56.493939] [INFO ] [MAIN ] WWW: Loaded 49168 existing records. [2025-09-23T22:09:56.676360] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:09:56.676849] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-23T22:09:56.676927] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-23T22:09:56.678026] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-23T22:09:56.678092] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-23T22:09:57.018512] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-23T22:09:57.056355] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T22:09:57.111174] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:09:57.693528] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T22:09:57.802242] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-23T22:09:58.095327] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T22:09:58.602243] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-23T22:09:59.402188] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-23T22:09:59.464811] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T22:10:00.202168] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-23T22:10:00.507606] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T22:10:00.599919] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T22:10:01.002194] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-23T22:10:01.802199] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-23T22:10:01.890913] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T22:10:01.912909] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T22:10:02.602256] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-23T22:10:03.402204] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-23T22:10:03.450906] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T22:10:04.192355] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T22:10:04.202158] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-23T22:10:04.344405] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T22:10:04.348483] [INFO ] [REMOTE ] WTS: Full fetch complete (26356 records). [2025-09-23T22:10:04.348615] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-23T22:10:04.726642] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-23T22:10:04.726750] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-23T22:10:04.727303] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-23T22:10:04.727342] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-23T22:10:04.728020] [DEBUG] [LOCAL ] WTS: Trimmed 26356 records to 18514 (keeping 200 days of data) [2025-09-23T22:10:04.849011] [DEBUG] [LOCAL ] WTS: Primary data saved (18514 records). [2025-09-23T22:10:04.849178] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-23T22:10:04.849270] [INFO ] [MAIN ] Update Progress: 2331/2372 symbols completed. WTS took 31.0s. Estimated remaining: 5m 27s. Rate: 7.5 symbols/min [2025-09-23T22:10:05.007919] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-23T22:10:05.028006] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:10:05.087718] [DEBUG] [LOCAL ] WY: Loaded 53118 existing records from primary storage. [2025-09-23T22:10:05.087871] [INFO ] [MAIN ] WY: Loaded 53118 existing records. [2025-09-23T22:10:05.264681] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:10:05.264936] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-23T22:10:05.264984] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-23T22:10:05.266251] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-23T22:10:05.266313] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-23T22:10:05.618672] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:10:05.802151] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-23T22:10:06.022706] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T22:10:06.175906] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T22:10:06.602205] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-23T22:10:07.402187] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-23T22:10:07.641680] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T22:10:08.202234] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-23T22:10:08.260053] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T22:10:09.002174] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-23T22:10:09.335561] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T22:10:09.797492] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T22:10:09.806530] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-23T22:10:10.602245] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-23T22:10:10.757458] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T22:10:11.402179] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-23T22:10:11.575255] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T22:10:12.202229] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-23T22:10:12.525842] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T22:10:13.002192] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-23T22:10:13.123774] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T22:10:13.541737] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T22:10:13.802207] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-23T22:10:14.607353] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-23T22:10:14.629354] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T22:10:15.402281] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-23T22:10:15.818310] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-23T22:10:16.202221] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-23T22:10:16.530673] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-23T22:10:16.625312] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T22:10:16.634464] [INFO ] [REMOTE ] WTTR: Full fetch complete (65595 records). [2025-09-23T22:10:16.634743] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-23T22:10:17.024517] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-23T22:10:17.048787] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-23T22:10:17.048889] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-23T22:10:17.050059] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-23T22:10:17.050249] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-23T22:10:17.051772] [DEBUG] [LOCAL ] WTTR: Trimmed 65595 records to 45098 (keeping 200 days of data) [2025-09-23T22:10:17.324219] [DEBUG] [LOCAL ] WTTR: Primary data saved (45098 records). [2025-09-23T22:10:17.324380] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-23T22:10:17.324472] [INFO ] [MAIN ] Update Progress: 2332/2372 symbols completed. WTTR took 36.4s. Estimated remaining: 5m 19s. Rate: 7.5 symbols/min [2025-09-23T22:10:17.503335] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:10:17.533197] [DEBUG] [LOCAL ] XFLT: Loaded 30093 existing records from primary storage. [2025-09-23T22:10:17.533347] [INFO ] [MAIN ] XFLT: Loaded 30093 existing records. [2025-09-23T22:10:17.721163] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:10:17.721442] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-23T22:10:17.721491] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-23T22:10:17.722199] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-23T22:10:17.722260] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-23T22:10:17.803464] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-23T22:10:18.099635] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:10:18.130964] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T22:10:18.602186] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-23T22:10:18.888465] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T22:10:18.897275] [INFO ] [REMOTE ] WU: Full fetch complete (77318 records). [2025-09-23T22:10:18.897398] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-23T22:10:19.292614] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-23T22:10:19.292818] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-23T22:10:19.294038] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-23T22:10:19.294118] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-23T22:10:19.296387] [DEBUG] [LOCAL ] WU: Trimmed 77318 records to 53454 (keeping 200 days of data) [2025-09-23T22:10:19.417506] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-23T22:10:19.431637] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T22:10:19.674488] [DEBUG] [LOCAL ] WU: Primary data saved (53454 records). [2025-09-23T22:10:19.674815] [INFO ] [MAIN ] WU: Full history saved. [2025-09-23T22:10:19.674915] [INFO ] [MAIN ] Update Progress: 2333/2372 symbols completed. WU took 35.0s. Estimated remaining: 5m 11s. Rate: 7.5 symbols/min [2025-09-23T22:10:19.844755] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:10:19.888710] [DEBUG] [LOCAL ] XHR: Loaded 44300 existing records from primary storage. [2025-09-23T22:10:19.888910] [INFO ] [MAIN ] XHR: Loaded 44300 existing records. [2025-09-23T22:10:20.067240] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:10:20.067470] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-23T22:10:20.067516] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-23T22:10:20.068488] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-23T22:10:20.068549] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-23T22:10:20.210414] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-23T22:10:20.451453] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:10:20.464557] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T22:10:20.532715] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T22:10:21.002214] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-23T22:10:21.802246] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-23T22:10:22.177533] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-23T22:10:22.602218] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-23T22:10:22.730777] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T22:10:23.261177] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T22:10:23.402203] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-23T22:10:23.868110] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T22:10:24.202200] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-23T22:10:25.002202] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-23T22:10:25.367089] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T22:10:25.393002] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T22:10:25.802248] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-23T22:10:26.214229] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T22:10:26.602218] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-23T22:10:27.115855] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T22:10:27.402194] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-23T22:10:28.002864] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T22:10:28.202238] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-23T22:10:28.715139] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T22:10:29.002208] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-23T22:10:29.541038] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T22:10:29.802201] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-23T22:10:30.582269] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T22:10:30.590770] [INFO ] [REMOTE ] WWW: Full fetch complete (69927 records). [2025-09-23T22:10:30.590921] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-23T22:10:30.612761] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-23T22:10:30.984108] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-23T22:10:30.984203] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-23T22:10:30.985288] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-23T22:10:30.985352] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-23T22:10:30.986806] [DEBUG] [LOCAL ] WWW: Trimmed 69927 records to 49188 (keeping 200 days of data) [2025-09-23T22:10:31.287197] [DEBUG] [LOCAL ] WWW: Primary data saved (49188 records). [2025-09-23T22:10:31.287337] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-23T22:10:31.287424] [INFO ] [MAIN ] Update Progress: 2334/2372 symbols completed. WWW took 35.0s. Estimated remaining: 5m 3s. Rate: 7.5 symbols/min [2025-09-23T22:10:31.407396] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-23T22:10:31.463675] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:10:31.464167] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-23T22:10:31.464264] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-23T22:10:31.464623] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-23T22:10:31.464738] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-23T22:10:31.464910] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-23T22:10:31.464967] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-23T22:10:31.848985] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:10:31.881276] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-23T22:10:32.202212] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-23T22:10:32.346927] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T22:10:32.414997] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:10:32.416401] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T22:10:32.425489] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-23T22:10:33.002205] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-23T22:10:33.802199] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-23T22:10:34.602172] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-23T22:10:34.959563] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-23T22:10:34.971335] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:10:34.972275] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-23T22:10:35.011948] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T22:10:35.402197] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-23T22:10:36.202206] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-23T22:10:37.002221] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-23T22:10:37.461746] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-23T22:10:37.641889] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T22:10:37.802224] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-23T22:10:38.177098] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T22:10:38.509314] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T22:10:38.519775] [INFO ] [REMOTE ] WY: Full fetch complete (76824 records). [2025-09-23T22:10:38.520062] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-23T22:10:38.607433] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-23T22:10:38.911825] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-23T22:10:38.911931] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-23T22:10:38.913115] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-23T22:10:38.913183] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-23T22:10:38.914783] [DEBUG] [LOCAL ] WY: Trimmed 76824 records to 53118 (keeping 200 days of data) [2025-09-23T22:10:39.249810] [DEBUG] [LOCAL ] WY: Primary data saved (53118 records). [2025-09-23T22:10:39.249982] [INFO ] [MAIN ] WY: Full history saved. [2025-09-23T22:10:39.250070] [INFO ] [MAIN ] Update Progress: 2335/2372 symbols completed. WY took 34.4s. Estimated remaining: 4m 55s. Rate: 7.5 symbols/min [2025-09-23T22:10:39.405175] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-23T22:10:39.422800] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:10:39.478559] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-23T22:10:39.478783] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-09-23T22:10:39.655098] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:10:39.655355] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-23T22:10:39.655402] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-23T22:10:39.656876] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-23T22:10:39.656940] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-23T22:10:40.033155] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:10:40.183588] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T22:10:40.202150] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-23T22:10:41.002197] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-23T22:10:41.283678] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T22:10:41.649400] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T22:10:41.802237] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-23T22:10:42.602316] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-23T22:10:43.237184] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-23T22:10:43.322346] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T22:10:43.402202] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-23T22:10:44.202168] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-23T22:10:44.382260] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T22:10:44.490798] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T22:10:45.002206] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-23T22:10:45.739984] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T22:10:45.747593] [INFO ] [REMOTE ] XHR: Full fetch complete (61576 records). [2025-09-23T22:10:45.747735] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-23T22:10:45.810476] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-23T22:10:46.143694] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-23T22:10:46.143838] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-23T22:10:46.145710] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-23T22:10:46.145816] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-23T22:10:46.150125] [DEBUG] [LOCAL ] XHR: Trimmed 61576 records to 44220 (keeping 200 days of data) [2025-09-23T22:10:46.441622] [DEBUG] [LOCAL ] XHR: Primary data saved (44220 records). [2025-09-23T22:10:46.441780] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-23T22:10:46.441900] [INFO ] [MAIN ] Update Progress: 2336/2372 symbols completed. XHR took 26.8s. Estimated remaining: 4m 47s. Rate: 7.5 symbols/min [2025-09-23T22:10:46.615612] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:10:46.612076] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-23T22:10:46.649196] [DEBUG] [LOCAL ] XPER: Loaded 29634 existing records from primary storage. [2025-09-23T22:10:46.649605] [INFO ] [MAIN ] XPER: Loaded 29634 existing records. [2025-09-23T22:10:46.880041] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:10:46.880764] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-23T22:10:46.881553] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-23T22:10:46.883330] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T22:10:46.893591] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-23T22:10:46.893686] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-23T22:10:47.280178] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:10:47.284420] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T22:10:47.402172] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-23T22:10:48.202248] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-23T22:10:48.756322] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T22:10:48.875279] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-23T22:10:49.002248] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-23T22:10:49.802211] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-23T22:10:49.905896] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T22:10:50.390127] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T22:10:50.396184] [INFO ] [REMOTE ] XFLT: Full fetch complete (44510 records). [2025-09-23T22:10:50.396362] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-23T22:10:50.603615] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-23T22:10:50.813038] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-23T22:10:50.813158] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-23T22:10:50.814251] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-23T22:10:50.814506] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-23T22:10:50.834572] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T22:10:50.841236] [DEBUG] [LOCAL ] XFLT: Trimmed 44510 records to 30138 (keeping 200 days of data) [2025-09-23T22:10:51.037071] [DEBUG] [LOCAL ] XFLT: Primary data saved (30138 records). [2025-09-23T22:10:51.037216] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-23T22:10:51.037419] [INFO ] [MAIN ] Update Progress: 2337/2372 symbols completed. XFLT took 33.7s. Estimated remaining: 4m 39s. Rate: 7.5 symbols/min [2025-09-23T22:10:51.219941] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:10:51.277209] [DEBUG] [LOCAL ] XPEV: Loaded 53642 existing records from primary storage. [2025-09-23T22:10:51.277370] [INFO ] [MAIN ] XPEV: Loaded 53642 existing records. [2025-09-23T22:10:51.415428] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-23T22:10:51.458618] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:10:51.458875] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-23T22:10:51.458922] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-23T22:10:51.460122] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-23T22:10:51.460208] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-23T22:10:51.838790] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:10:52.202205] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-23T22:10:53.002174] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-23T22:10:53.051974] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-23T22:10:53.180595] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T22:10:53.802253] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-23T22:10:54.512692] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T22:10:54.602165] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-23T22:10:54.691884] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-23T22:10:55.402201] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-23T22:10:55.885355] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T22:10:56.094552] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-23T22:10:56.202198] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-23T22:10:56.974059] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T22:10:57.002149] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-23T22:10:57.802247] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-23T22:10:58.307689] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T22:10:58.315396] [INFO ] [REMOTE ] XIFR: Full fetch complete (54214 records). [2025-09-23T22:10:58.315569] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-23T22:10:58.531708] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 161 unique days, need 200 days [2025-09-23T22:10:58.532594] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T22:10:58.532756] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T22:10:58.533008] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-23T22:10:58.533175] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-23T22:10:58.533249] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-23T22:10:58.533343] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-23T22:10:58.533515] [INFO ] [MAIN ] Update Progress: 2338/2372 symbols completed. XIFR took 27.2s. Estimated remaining: 4m 31s. Rate: 7.5 symbols/min [2025-09-23T22:10:58.606431] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-23T22:10:58.715184] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:10:58.758945] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-23T22:10:58.826521] [DEBUG] [LOCAL ] XPO: Loaded 48220 existing records from primary storage. [2025-09-23T22:10:58.826704] [INFO ] [MAIN ] XPO: Loaded 48220 existing records. [2025-09-23T22:10:59.013133] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:10:59.013407] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-23T22:10:59.013457] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-23T22:10:59.014696] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-23T22:10:59.014761] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-23T22:10:59.333925] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T22:10:59.407276] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-23T22:10:59.449885] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:11:00.202218] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-23T22:11:00.813774] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T22:11:01.007463] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-23T22:11:01.035662] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-23T22:11:01.802251] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-23T22:11:02.034526] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T22:11:02.188430] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T22:11:02.602219] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-23T22:11:03.402219] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-23T22:11:04.124409] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-23T22:11:04.202156] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-23T22:11:04.726032] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T22:11:04.872506] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-23T22:11:05.002192] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-23T22:11:05.802187] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-23T22:11:06.074517] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T22:11:06.206945] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-23T22:11:06.602251] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-23T22:11:07.115085] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T22:11:07.402237] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-23T22:11:08.202295] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-23T22:11:08.619369] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T22:11:08.627459] [INFO ] [REMOTE ] XPER: Full fetch complete (43251 records). [2025-09-23T22:11:08.627632] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-23T22:11:09.006854] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-23T22:11:09.022326] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-23T22:11:09.022438] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-23T22:11:09.023377] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-23T22:11:09.023474] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-23T22:11:09.026285] [DEBUG] [LOCAL ] XPER: Trimmed 43251 records to 29640 (keeping 200 days of data) [2025-09-23T22:11:09.202508] [DEBUG] [LOCAL ] XPER: Primary data saved (29640 records). [2025-09-23T22:11:09.202670] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-23T22:11:09.202816] [INFO ] [MAIN ] Update Progress: 2339/2372 symbols completed. XPER took 22.8s. Estimated remaining: 4m 23s. Rate: 7.5 symbols/min [2025-09-23T22:11:09.379762] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:11:09.435675] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-23T22:11:09.460174] [DEBUG] [LOCAL ] XPOF: Loaded 38863 existing records from primary storage. [2025-09-23T22:11:09.460324] [INFO ] [MAIN ] XPOF: Loaded 38863 existing records. [2025-09-23T22:11:09.640374] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:11:09.640857] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-23T22:11:09.640941] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-23T22:11:09.642060] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-23T22:11:09.642124] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-23T22:11:09.816459] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-23T22:11:10.016196] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:11:10.044182] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T22:11:10.602289] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-23T22:11:11.326130] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-23T22:11:11.402190] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-23T22:11:12.202218] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-23T22:11:12.521870] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-23T22:11:12.539372] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-23T22:11:13.002172] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-23T22:11:13.051729] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T22:11:13.352458] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-23T22:11:13.802203] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-23T22:11:14.538569] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T22:11:14.548100] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-09-23T22:11:14.548275] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-23T22:11:14.609940] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-23T22:11:14.959680] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-23T22:11:14.959778] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-23T22:11:14.960969] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-23T22:11:14.961039] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-23T22:11:14.962770] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-09-23T22:11:15.307754] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-09-23T22:11:15.307900] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-23T22:11:15.308016] [INFO ] [MAIN ] Update Progress: 2340/2372 symbols completed. XOM took 36.1s. Estimated remaining: 4m 15s. Rate: 7.5 symbols/min [2025-09-23T22:11:15.408974] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-23T22:11:15.488620] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:11:15.536534] [DEBUG] [LOCAL ] XPRO: Loaded 46119 existing records from primary storage. [2025-09-23T22:11:15.536731] [INFO ] [MAIN ] XPRO: Loaded 46119 existing records. [2025-09-23T22:11:15.711759] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-23T22:11:15.782267] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:11:15.782762] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-23T22:11:15.782894] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-23T22:11:15.785251] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-23T22:11:15.785320] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-23T22:11:16.061476] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T22:11:16.186336] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:11:16.202184] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-23T22:11:17.002231] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-23T22:11:17.319146] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T22:11:17.543727] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T22:11:17.802230] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-23T22:11:18.602218] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-23T22:11:18.952496] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T22:11:19.402172] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-23T22:11:19.612082] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T22:11:19.815826] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T22:11:20.202202] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-23T22:11:21.002252] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-23T22:11:21.531428] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-23T22:11:21.593586] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T22:11:21.802243] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-23T22:11:22.602179] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-23T22:11:22.673767] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T22:11:23.233078] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T22:11:23.402256] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-23T22:11:24.202160] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-23T22:11:24.240633] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T22:11:25.002199] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-23T22:11:25.501680] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T22:11:25.578987] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T22:11:25.802200] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-23T22:11:26.500003] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T22:11:26.602161] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-23T22:11:27.402170] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-23T22:11:27.499146] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T22:11:28.122629] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T22:11:28.202152] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-23T22:11:29.002186] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-23T22:11:29.648104] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-23T22:11:29.657181] [INFO ] [REMOTE ] XPEV: Full fetch complete (77681 records). [2025-09-23T22:11:29.657354] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-23T22:11:29.802590] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-23T22:11:29.925170] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T22:11:30.104330] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-23T22:11:30.104433] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-23T22:11:30.105621] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-23T22:11:30.105721] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-23T22:11:30.130120] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T22:11:30.129120] [DEBUG] [LOCAL ] XPEV: Trimmed 77681 records to 53641 (keeping 200 days of data) [2025-09-23T22:11:30.469328] [DEBUG] [LOCAL ] XPEV: Primary data saved (53641 records). [2025-09-23T22:11:30.469486] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-23T22:11:30.469639] [INFO ] [MAIN ] Update Progress: 2341/2372 symbols completed. XPEV took 39.4s. Estimated remaining: 4m 7s. Rate: 7.5 symbols/min [2025-09-23T22:11:30.612352] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-23T22:11:30.645833] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:11:30.674913] [DEBUG] [LOCAL ] XYF: Loaded 27974 existing records from primary storage. [2025-09-23T22:11:30.675046] [INFO ] [MAIN ] XYF: Loaded 27974 existing records. [2025-09-23T22:11:30.857541] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:11:30.857817] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-23T22:11:30.857866] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-23T22:11:30.858600] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-23T22:11:30.858690] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-23T22:11:31.226471] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:11:31.402173] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-23T22:11:31.493467] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T22:11:31.502002] [INFO ] [REMOTE ] XPO: Full fetch complete (70141 records). [2025-09-23T22:11:31.502145] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-23T22:11:31.924378] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-23T22:11:31.924524] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-23T22:11:31.925753] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-23T22:11:31.925924] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-23T22:11:31.927982] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T22:11:31.941084] [DEBUG] [LOCAL ] XPO: Trimmed 70141 records to 48148 (keeping 200 days of data) [2025-09-23T22:11:32.208752] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-23T22:11:32.239628] [DEBUG] [LOCAL ] XPO: Primary data saved (48148 records). [2025-09-23T22:11:32.239764] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-23T22:11:32.239845] [INFO ] [MAIN ] Update Progress: 2342/2372 symbols completed. XPO took 33.7s. Estimated remaining: 3m 59s. Rate: 7.5 symbols/min [2025-09-23T22:11:32.407402] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:11:32.461214] [DEBUG] [LOCAL ] XYL: Loaded 48198 existing records from primary storage. [2025-09-23T22:11:32.461353] [INFO ] [MAIN ] XYL: Loaded 48198 existing records. [2025-09-23T22:11:32.694804] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:11:32.700211] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-23T22:11:32.701138] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-23T22:11:32.701089] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T22:11:32.703049] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-23T22:11:32.703711] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-23T22:11:32.912606] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T22:11:33.004002] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-23T22:11:33.115105] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:11:33.793517] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T22:11:33.802134] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-23T22:11:34.602293] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-23T22:11:34.617263] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T22:11:35.402276] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-23T22:11:36.202187] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-23T22:11:36.368135] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T22:11:37.002207] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-23T22:11:37.115065] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T22:11:37.258836] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T22:11:37.264791] [INFO ] [REMOTE ] XPOF: Full fetch complete (52237 records). [2025-09-23T22:11:37.264924] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-23T22:11:37.650847] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-23T22:11:37.650993] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-23T22:11:37.651952] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-23T22:11:37.652018] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-23T22:11:37.653291] [DEBUG] [LOCAL ] XPOF: Trimmed 52237 records to 38831 (keeping 200 days of data) [2025-09-23T22:11:37.806896] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-23T22:11:37.881620] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T22:11:37.896964] [DEBUG] [LOCAL ] XPOF: Primary data saved (38831 records). [2025-09-23T22:11:37.897131] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-23T22:11:37.897242] [INFO ] [MAIN ] Update Progress: 2343/2372 symbols completed. XPOF took 28.7s. Estimated remaining: 3m 51s. Rate: 7.5 symbols/min [2025-09-23T22:11:38.066024] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:11:38.066268] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-23T22:11:38.066323] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-23T22:11:38.066431] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-23T22:11:38.066469] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-23T22:11:38.066509] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-23T22:11:38.066541] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-23T22:11:38.421187] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:11:38.602171] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-23T22:11:38.813399] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T22:11:38.813941] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-23T22:11:39.302774] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T22:11:39.402238] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-23T22:11:40.202206] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-23T22:11:41.002204] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-23T22:11:41.201617] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T22:11:41.310125] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T22:11:41.802259] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-23T22:11:42.226254] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T22:11:42.602267] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-23T22:11:43.402189] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-23T22:11:43.523826] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T22:11:43.879767] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T22:11:44.210054] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-23T22:11:44.213978] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T22:11:45.002245] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-23T22:11:45.802179] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-23T22:11:46.064957] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T22:11:46.602205] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-23T22:11:47.254238] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-23T22:11:47.407302] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-23T22:11:47.418624] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T22:11:48.202286] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-23T22:11:48.289866] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T22:11:48.833263] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T22:11:49.002192] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-23T22:11:49.807570] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-23T22:11:49.812859] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T22:11:50.602219] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-23T22:11:50.661488] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T22:11:51.402258] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-23T22:11:52.127909] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-23T22:11:52.202175] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-23T22:11:52.544510] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-23T22:11:52.884775] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T22:11:53.002183] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-23T22:11:53.802206] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-23T22:11:54.225382] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T22:11:54.444973] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T22:11:54.602196] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-23T22:11:55.215454] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T22:11:55.402170] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-23T22:11:56.202208] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-23T22:11:57.002321] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-23T22:11:57.005367] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-23T22:11:57.068340] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T22:11:57.114072] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T22:11:57.118081] [INFO ] [REMOTE ] XYF: Full fetch complete (31381 records). [2025-09-23T22:11:57.118161] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-23T22:11:57.494210] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-23T22:11:57.494291] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-23T22:11:57.494942] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-23T22:11:57.495003] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-23T22:11:57.495817] [DEBUG] [LOCAL ] XYF: Trimmed 31381 records to 28034 (keeping 200 days of data) [2025-09-23T22:11:57.658733] [DEBUG] [LOCAL ] XYF: Primary data saved (28034 records). [2025-09-23T22:11:57.658870] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-23T22:11:57.658969] [INFO ] [MAIN ] Update Progress: 2344/2372 symbols completed. XYF took 27.2s. Estimated remaining: 3m 44s. Rate: 7.5 symbols/min [2025-09-23T22:11:57.807402] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-23T22:11:57.831924] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:11:57.866320] [DEBUG] [LOCAL ] YALA: Loaded 37363 existing records from primary storage. [2025-09-23T22:11:57.866470] [INFO ] [MAIN ] YALA: Loaded 37363 existing records. [2025-09-23T22:11:58.045103] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:11:58.045373] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-23T22:11:58.045422] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-23T22:11:58.046242] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-23T22:11:58.046305] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-23T22:11:58.447312] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:11:58.452666] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T22:11:58.464159] [INFO ] [REMOTE ] XPRO: Full fetch complete (66671 records). [2025-09-23T22:11:58.464335] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-23T22:11:58.611260] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-23T22:11:58.889869] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-23T22:11:58.889963] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-23T22:11:58.891013] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-23T22:11:58.891084] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-23T22:11:58.892680] [DEBUG] [LOCAL ] XPRO: Trimmed 66671 records to 46074 (keeping 200 days of data) [2025-09-23T22:11:59.169915] [DEBUG] [LOCAL ] XPRO: Primary data saved (46074 records). [2025-09-23T22:11:59.170064] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-23T22:11:59.170164] [INFO ] [MAIN ] Update Progress: 2345/2372 symbols completed. XPRO took 43.9s. Estimated remaining: 3m 35s. Rate: 7.5 symbols/min [2025-09-23T22:11:59.343976] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:11:59.409395] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-23T22:11:59.410919] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T22:11:59.421694] [DEBUG] [LOCAL ] YELP: Loaded 45342 existing records from primary storage. [2025-09-23T22:11:59.421920] [INFO ] [REMOTE ] XYL: Full fetch complete (69893 records). [2025-09-23T22:11:59.422304] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-23T22:11:59.422214] [INFO ] [MAIN ] YELP: Loaded 45342 existing records. [2025-09-23T22:11:59.782431] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:11:59.793968] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-23T22:11:59.848592] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-23T22:11:59.891587] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-23T22:11:59.896850] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-23T22:12:00.162017] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-23T22:12:00.162260] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-23T22:12:00.163483] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-23T22:12:00.163576] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-23T22:12:00.249840] [DEBUG] [LOCAL ] XYL: Trimmed 69893 records to 48125 (keeping 200 days of data) [2025-09-23T22:12:00.491782] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-23T22:12:00.574143] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-23T22:12:00.595950] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:12:00.634388] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T22:12:00.853282] [DEBUG] [LOCAL ] XYL: Primary data saved (48125 records). [2025-09-23T22:12:00.853425] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-23T22:12:00.853514] [INFO ] [MAIN ] Update Progress: 2346/2372 symbols completed. XYL took 28.6s. Estimated remaining: 3m 27s. Rate: 7.5 symbols/min [2025-09-23T22:12:01.004074] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-23T22:12:01.042318] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:12:01.092857] [DEBUG] [LOCAL ] YETI: Loaded 52486 existing records from primary storage. [2025-09-23T22:12:01.093034] [INFO ] [MAIN ] YETI: Loaded 52486 existing records. [2025-09-23T22:12:01.269824] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:12:01.270081] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-23T22:12:01.270136] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-23T22:12:01.271705] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-23T22:12:01.271765] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-23T22:12:01.624869] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:12:01.802282] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-23T22:12:02.041391] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T22:12:02.602248] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-23T22:12:03.050138] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-23T22:12:03.402213] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-23T22:12:03.606194] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T22:12:04.202203] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-23T22:12:04.357163] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T22:12:05.002254] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-23T22:12:05.802229] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-23T22:12:06.227175] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T22:12:06.305560] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-23T22:12:06.391532] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-23T22:12:06.602209] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-23T22:12:07.402170] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-23T22:12:07.461008] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T22:12:08.178071] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T22:12:08.187052] [INFO ] [REMOTE ] XYZ: Full fetch complete (66227 records). [2025-09-23T22:12:08.187196] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-23T22:12:08.209343] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-23T22:12:08.399947] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 170 unique days, need 200 days [2025-09-23T22:12:08.400987] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T22:12:08.401190] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T22:12:08.401344] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-23T22:12:08.401493] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-23T22:12:08.401569] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-23T22:12:08.401780] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-23T22:12:08.401884] [INFO ] [MAIN ] Update Progress: 2347/2372 symbols completed. XYZ took 30.5s. Estimated remaining: 3m 19s. Rate: 7.5 symbols/min [2025-09-23T22:12:08.549929] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T22:12:08.633208] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:12:08.673279] [DEBUG] [LOCAL ] YEXT: Loaded 43344 existing records from primary storage. [2025-09-23T22:12:08.673440] [INFO ] [MAIN ] YEXT: Loaded 43344 existing records. [2025-09-23T22:12:08.857941] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:12:08.858220] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-23T22:12:08.858292] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-23T22:12:08.859241] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-23T22:12:08.859334] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-23T22:12:09.007295] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-23T22:12:09.245024] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:12:09.690956] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T22:12:09.802207] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-23T22:12:10.602242] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-23T22:12:10.992420] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T22:12:11.355512] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T22:12:11.402149] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-23T22:12:11.872822] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T22:12:12.202201] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-23T22:12:12.563935] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T22:12:13.002199] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-23T22:12:13.802263] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-23T22:12:13.867259] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T22:12:14.602191] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-23T22:12:14.852414] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T22:12:15.236768] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T22:12:15.402218] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-23T22:12:16.022046] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T22:12:16.202191] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-23T22:12:17.002201] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-23T22:12:17.298454] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T22:12:17.802205] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-23T22:12:18.025632] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T22:12:18.174299] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T22:12:18.602199] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-23T22:12:19.074483] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T22:12:19.402194] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-23T22:12:19.731918] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T22:12:20.202199] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-23T22:12:21.002177] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-23T22:12:21.293929] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T22:12:21.340283] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T22:12:21.802218] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-23T22:12:22.602200] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-23T22:12:23.402219] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-23T22:12:23.451009] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-23T22:12:23.859184] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-23T22:12:24.202207] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-23T22:12:25.002169] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-23T22:12:25.172006] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-23T22:12:25.196961] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T22:12:25.771952] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T22:12:25.802146] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-23T22:12:26.208700] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T22:12:26.602217] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-23T22:12:26.966775] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T22:12:27.402245] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-23T22:12:28.205138] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-23T22:12:28.210836] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T22:12:29.002194] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-23T22:12:29.139892] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T22:12:29.148732] [INFO ] [REMOTE ] YETI: Full fetch complete (75411 records). [2025-09-23T22:12:29.148898] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-23T22:12:29.548112] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-23T22:12:29.548245] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-23T22:12:29.549358] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-23T22:12:29.549422] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-23T22:12:29.571674] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T22:12:29.570806] [DEBUG] [LOCAL ] YETI: Trimmed 75411 records to 52472 (keeping 200 days of data) [2025-09-23T22:12:29.802292] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-23T22:12:29.891768] [DEBUG] [LOCAL ] YETI: Primary data saved (52472 records). [2025-09-23T22:12:29.891904] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-23T22:12:29.891992] [INFO ] [MAIN ] Update Progress: 2348/2372 symbols completed. YETI took 29.0s. Estimated remaining: 3m 12s. Rate: 7.5 symbols/min [2025-09-23T22:12:30.061117] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:12:30.113670] [DEBUG] [LOCAL ] YMM: Loaded 52698 existing records from primary storage. [2025-09-23T22:12:30.113894] [INFO ] [MAIN ] YMM: Loaded 52698 existing records. [2025-09-23T22:12:30.296873] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:12:30.297354] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-23T22:12:30.297425] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-23T22:12:30.307071] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-23T22:12:30.320542] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-23T22:12:30.417741] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T22:12:30.611223] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-23T22:12:30.694764] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:12:31.402243] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-23T22:12:31.461072] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T22:12:31.970077] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T22:12:31.978139] [INFO ] [REMOTE ] YEXT: Full fetch complete (63511 records). [2025-09-23T22:12:31.978279] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-23T22:12:32.207311] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-23T22:12:32.370280] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-23T22:12:32.370368] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-23T22:12:32.371500] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-23T22:12:32.371566] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-23T22:12:32.372951] [DEBUG] [LOCAL ] YEXT: Trimmed 63511 records to 43298 (keeping 200 days of data) [2025-09-23T22:12:32.624696] [DEBUG] [LOCAL ] YEXT: Primary data saved (43298 records). [2025-09-23T22:12:32.624836] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-23T22:12:32.624926] [INFO ] [MAIN ] Update Progress: 2349/2372 symbols completed. YEXT took 24.2s. Estimated remaining: 3m 4s. Rate: 7.5 symbols/min [2025-09-23T22:12:32.798226] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:12:32.848800] [DEBUG] [LOCAL ] YOU: Loaded 49873 existing records from primary storage. [2025-09-23T22:12:32.848943] [INFO ] [MAIN ] YOU: Loaded 49873 existing records. [2025-09-23T22:12:33.003332] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-23T22:12:33.047889] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:12:33.048175] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-23T22:12:33.048338] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-23T22:12:33.059583] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-23T22:12:33.075996] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-23T22:12:33.151386] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T22:12:33.467148] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:12:33.802202] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-23T22:12:33.899231] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T22:12:34.242989] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T22:12:34.248165] [INFO ] [REMOTE ] YALA: Full fetch complete (46597 records). [2025-09-23T22:12:34.248258] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-23T22:12:34.607449] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-23T22:12:34.622069] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-23T22:12:34.622900] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-23T22:12:34.623821] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-23T22:12:34.623995] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-23T22:12:34.625142] [DEBUG] [LOCAL ] YALA: Trimmed 46597 records to 37425 (keeping 200 days of data) [2025-09-23T22:12:34.834871] [DEBUG] [LOCAL ] YALA: Primary data saved (37425 records). [2025-09-23T22:12:34.835018] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-23T22:12:34.835107] [INFO ] [MAIN ] Update Progress: 2350/2372 symbols completed. YALA took 37.2s. Estimated remaining: 2m 56s. Rate: 7.5 symbols/min [2025-09-23T22:12:35.002210] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:12:35.054315] [DEBUG] [LOCAL ] YPF: Loaded 50483 existing records from primary storage. [2025-09-23T22:12:35.054467] [INFO ] [MAIN ] YPF: Loaded 50483 existing records. [2025-09-23T22:12:35.233127] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:12:35.233360] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-23T22:12:35.233407] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-23T22:12:35.234485] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-23T22:12:35.234546] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-23T22:12:35.417931] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-23T22:12:35.609073] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:12:35.641249] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T22:12:36.202216] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-23T22:12:36.452277] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T22:12:36.603459] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T22:12:36.611428] [INFO ] [REMOTE ] YELP: Full fetch complete (64199 records). [2025-09-23T22:12:36.611546] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-23T22:12:37.015851] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-23T22:12:37.012454] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-23T22:12:37.016086] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-23T22:12:37.018259] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-23T22:12:37.018459] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-23T22:12:37.019837] [DEBUG] [LOCAL ] YELP: Trimmed 64199 records to 45370 (keeping 200 days of data) [2025-09-23T22:12:37.297825] [DEBUG] [LOCAL ] YELP: Primary data saved (45370 records). [2025-09-23T22:12:37.297965] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-23T22:12:37.298055] [INFO ] [MAIN ] Update Progress: 2351/2372 symbols completed. YELP took 38.1s. Estimated remaining: 2m 48s. Rate: 7.5 symbols/min [2025-09-23T22:12:37.505475] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:12:37.518595] [DEBUG] [LOCAL ] YRD: Loaded 12606 existing records from primary storage. [2025-09-23T22:12:37.518732] [INFO ] [MAIN ] YRD: Loaded 12606 existing records. [2025-09-23T22:12:37.742337] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:12:37.742823] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-23T22:12:37.742947] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-23T22:12:37.743367] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-23T22:12:37.743427] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-23T22:12:37.833179] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-23T22:12:37.881753] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T22:12:38.149927] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:12:38.602257] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-23T22:12:38.897726] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-23T22:12:39.402178] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-23T22:12:39.509421] [DEBUG] [REMOTE ] YMM: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-23T22:12:39.509789] [WARN ] [REMOTE ] YMM: No data returned for month 2025-03 [2025-09-23T22:12:39.552430] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T22:12:40.202223] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-23T22:12:40.424306] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T22:12:41.002228] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-23T22:12:41.802211] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-23T22:12:42.060314] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T22:12:42.602182] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-23T22:12:42.701237] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T22:12:42.750695] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T22:12:43.402209] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-23T22:12:44.210223] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-23T22:12:44.228784] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T22:12:45.002214] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-23T22:12:45.063906] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T22:12:45.229936] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T22:12:45.802237] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-23T22:12:46.602254] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-23T22:12:46.864990] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T22:12:47.402262] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-23T22:12:47.566869] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T22:12:48.062342] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T22:12:48.202205] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-23T22:12:48.898495] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T22:12:49.002172] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-23T22:12:49.303031] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T22:12:49.802208] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-23T22:12:50.602211] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-23T22:12:50.744517] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T22:12:51.402301] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-23T22:12:51.685247] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T22:12:51.802875] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T22:12:52.202271] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-23T22:12:52.711027] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T22:12:53.002201] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-23T22:12:53.802202] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-23T22:12:54.022751] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T22:12:54.602181] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-23T22:12:54.667388] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T22:12:54.725091] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T22:12:55.402208] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-23T22:12:55.987677] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T22:12:56.202214] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-23T22:12:57.002218] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-23T22:12:57.184580] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T22:12:57.212175] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T22:12:57.802252] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-23T22:12:58.602266] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-23T22:12:58.854531] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T22:12:59.402169] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-23T22:12:59.528157] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T22:12:59.601586] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T22:13:00.202211] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-23T22:13:01.002197] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-23T22:13:01.068841] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T22:13:01.077584] [INFO ] [REMOTE ] YPF: Full fetch complete (73528 records). [2025-09-23T22:13:01.077792] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-23T22:13:01.499021] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-23T22:13:01.499211] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-23T22:13:01.500409] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-23T22:13:01.500510] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-23T22:13:01.505730] [DEBUG] [LOCAL ] YPF: Trimmed 73528 records to 50493 (keeping 200 days of data) [2025-09-23T22:13:01.777551] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T22:13:01.802316] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-23T22:13:01.880018] [DEBUG] [LOCAL ] YPF: Primary data saved (50493 records). [2025-09-23T22:13:01.880148] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-23T22:13:01.880296] [INFO ] [MAIN ] Update Progress: 2352/2372 symbols completed. YPF took 27.0s. Estimated remaining: 2m 40s. Rate: 7.5 symbols/min [2025-09-23T22:13:01.998638] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T22:13:02.068431] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:02.101481] [DEBUG] [LOCAL ] YSG: Loaded 24933 existing records from primary storage. [2025-09-23T22:13:02.101699] [INFO ] [MAIN ] YSG: Loaded 24933 existing records. [2025-09-23T22:13:02.283283] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:02.283616] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-23T22:13:02.283716] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-23T22:13:02.284324] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-23T22:13:02.284416] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-23T22:13:02.607352] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-23T22:13:02.648996] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:03.402179] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-23T22:13:03.443796] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T22:13:03.455271] [INFO ] [REMOTE ] YMM: Full fetch complete (68358 records). [2025-09-23T22:13:03.455504] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-23T22:13:03.657548] [WARN ] [VALIDATOR ] YMM: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T22:13:03.658539] [FATAL] [MAIN ] YMM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T22:13:03.658630] [WARN ] [MAIN ] YMM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T22:13:03.658743] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-23T22:13:03.658878] [DEBUG] [LOCAL ] YMM: No primary data file found to delete. [2025-09-23T22:13:03.658957] [INFO ] [LOCAL ] YMM: Starting deletion of derivative data. [2025-09-23T22:13:03.659417] [DEBUG] [LOCAL ] YMM: Deleted derivative data file. [2025-09-23T22:13:03.659724] [INFO ] [MAIN ] Update Progress: 2353/2372 symbols completed. YMM took 33.8s. Estimated remaining: 2m 32s. Rate: 7.5 symbols/min [2025-09-23T22:13:03.834772] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:03.902149] [DEBUG] [LOCAL ] YUM: Loaded 51289 existing records from primary storage. [2025-09-23T22:13:03.902317] [INFO ] [MAIN ] YUM: Loaded 51289 existing records. [2025-09-23T22:13:04.097283] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:04.097529] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-23T22:13:04.097579] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-23T22:13:04.099004] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-23T22:13:04.099068] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-23T22:13:04.210072] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-23T22:13:04.214704] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T22:13:04.508703] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:04.512604] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T22:13:04.529345] [INFO ] [REMOTE ] YOU: Full fetch complete (72199 records). [2025-09-23T22:13:04.529639] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-23T22:13:04.923756] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-23T22:13:04.923843] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-23T22:13:04.924906] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-23T22:13:04.924968] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-23T22:13:04.926549] [DEBUG] [LOCAL ] YOU: Trimmed 72199 records to 49867 (keeping 200 days of data) [2025-09-23T22:13:05.025068] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-23T22:13:05.248974] [DEBUG] [LOCAL ] YOU: Primary data saved (49867 records). [2025-09-23T22:13:05.249111] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-23T22:13:05.249250] [INFO ] [MAIN ] Update Progress: 2354/2372 symbols completed. YOU took 32.6s. Estimated remaining: 2m 24s. Rate: 7.5 symbols/min [2025-09-23T22:13:05.426382] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:05.480689] [DEBUG] [LOCAL ] YUMC: Loaded 52724 existing records from primary storage. [2025-09-23T22:13:05.480838] [INFO ] [MAIN ] YUMC: Loaded 52724 existing records. [2025-09-23T22:13:05.612763] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T22:13:05.693305] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:05.693706] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-23T22:13:05.693778] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-23T22:13:05.695149] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-23T22:13:05.695228] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-23T22:13:05.807339] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-23T22:13:06.054530] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:06.602156] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-23T22:13:06.842785] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T22:13:06.863623] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T22:13:07.402243] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-23T22:13:07.452020] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T22:13:08.048964] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T22:13:08.051621] [INFO ] [REMOTE ] YRD: Full fetch complete (19236 records). [2025-09-23T22:13:08.051745] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-23T22:13:08.207529] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-23T22:13:08.438958] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-23T22:13:08.439049] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-23T22:13:08.439458] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-23T22:13:08.439566] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-23T22:13:08.440985] [DEBUG] [LOCAL ] YRD: Trimmed 19236 records to 12584 (keeping 200 days of data) [2025-09-23T22:13:08.523471] [DEBUG] [LOCAL ] YRD: Primary data saved (12584 records). [2025-09-23T22:13:08.523621] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-23T22:13:08.523813] [INFO ] [MAIN ] Update Progress: 2355/2372 symbols completed. YRD took 31.2s. Estimated remaining: 2m 16s. Rate: 7.5 symbols/min [2025-09-23T22:13:08.691793] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:08.754476] [DEBUG] [LOCAL ] ZBH: Loaded 51226 existing records from primary storage. [2025-09-23T22:13:08.754626] [INFO ] [MAIN ] ZBH: Loaded 51226 existing records. [2025-09-23T22:13:08.935399] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:08.935708] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-23T22:13:08.935806] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-23T22:13:08.937279] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-23T22:13:08.937343] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-23T22:13:09.007334] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-23T22:13:09.076560] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T22:13:09.326394] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:09.802196] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-23T22:13:10.602198] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-23T22:13:10.833479] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T22:13:11.402160] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-23T22:13:11.535114] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T22:13:11.913352] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T22:13:12.202254] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-23T22:13:13.002180] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-23T22:13:13.131447] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T22:13:13.277863] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T22:13:13.802212] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-23T22:13:14.602185] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-23T22:13:14.729764] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T22:13:14.869337] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T22:13:15.402277] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-23T22:13:16.029596] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T22:13:16.202198] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-23T22:13:16.559756] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-23T22:13:17.002185] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-23T22:13:17.622301] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T22:13:17.802205] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-23T22:13:18.602201] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-23T22:13:18.743256] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T22:13:19.402219] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-23T22:13:19.794918] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T22:13:20.061936] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T22:13:20.202194] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-23T22:13:21.002173] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-23T22:13:21.199627] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T22:13:21.264765] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T22:13:21.802254] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-23T22:13:22.426302] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T22:13:22.602197] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-23T22:13:23.396798] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T22:13:23.407246] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-23T22:13:24.202172] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-23T22:13:24.476318] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T22:13:25.002230] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-23T22:13:25.217989] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T22:13:25.802244] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-23T22:13:26.135459] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T22:13:26.318293] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T22:13:26.602222] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-23T22:13:27.258916] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T22:13:27.402212] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-23T22:13:28.135400] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T22:13:28.202190] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-23T22:13:29.002212] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-23T22:13:29.207371] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T22:13:29.802242] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-23T22:13:30.048635] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-23T22:13:30.462701] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T22:13:30.602164] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-23T22:13:30.929896] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T22:13:30.934752] [INFO ] [REMOTE ] YSG: Full fetch complete (32716 records). [2025-09-23T22:13:30.934839] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-23T22:13:31.335408] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-23T22:13:31.335497] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-23T22:13:31.336238] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-23T22:13:31.336303] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-23T22:13:31.337548] [DEBUG] [LOCAL ] YSG: Trimmed 32716 records to 24977 (keeping 200 days of data) [2025-09-23T22:13:31.422774] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-23T22:13:31.484809] [DEBUG] [LOCAL ] YSG: Primary data saved (24977 records). [2025-09-23T22:13:31.484938] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-23T22:13:31.485030] [INFO ] [MAIN ] Update Progress: 2356/2372 symbols completed. YSG took 29.6s. Estimated remaining: 2m 8s. Rate: 7.5 symbols/min [2025-09-23T22:13:31.652859] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:31.672450] [DEBUG] [LOCAL ] ZEPP: Loaded 16667 existing records from primary storage. [2025-09-23T22:13:31.672596] [INFO ] [MAIN ] ZEPP: Loaded 16667 existing records. [2025-09-23T22:13:31.851962] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:31.852233] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-23T22:13:31.852280] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-23T22:13:31.852854] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-23T22:13:31.852913] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-23T22:13:32.224876] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:32.218584] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-23T22:13:32.306830] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T22:13:32.790997] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T22:13:33.002197] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-23T22:13:33.542982] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T22:13:33.802264] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-23T22:13:34.101405] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T22:13:34.602277] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-23T22:13:35.089980] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T22:13:35.402211] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-23T22:13:35.501588] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T22:13:36.202235] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-23T22:13:36.771143] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T22:13:37.002241] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-23T22:13:37.099919] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T22:13:37.593169] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T22:13:37.802191] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-23T22:13:38.511248] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T22:13:38.522192] [INFO ] [REMOTE ] YUM: Full fetch complete (74376 records). [2025-09-23T22:13:38.522485] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-23T22:13:38.607506] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-23T22:13:39.115727] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-23T22:13:39.115915] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-23T22:13:39.117395] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-23T22:13:39.117468] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-23T22:13:39.119528] [DEBUG] [LOCAL ] YUM: Trimmed 74376 records to 51264 (keeping 200 days of data) [2025-09-23T22:13:39.404246] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-23T22:13:39.524255] [DEBUG] [LOCAL ] YUM: Primary data saved (51264 records). [2025-09-23T22:13:39.524411] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-23T22:13:39.524528] [INFO ] [MAIN ] Update Progress: 2357/2372 symbols completed. YUM took 35.9s. Estimated remaining: 1m 60s. Rate: 7.5 symbols/min [2025-09-23T22:13:40.202209] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-23T22:13:40.616535] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T22:13:40.775201] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T22:13:41.002202] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-23T22:13:41.133637] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T22:13:41.142692] [INFO ] [REMOTE ] ZBH: Full fetch complete (73851 records). [2025-09-23T22:13:41.142880] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-23T22:13:41.560121] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-23T22:13:41.560239] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-23T22:13:41.561981] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-23T22:13:41.562053] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-23T22:13:41.564149] [DEBUG] [LOCAL ] ZBH: Trimmed 73851 records to 51247 (keeping 200 days of data) [2025-09-23T22:13:41.771946] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T22:13:41.803302] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-23T22:13:41.908757] [DEBUG] [LOCAL ] ZBH: Primary data saved (51247 records). [2025-09-23T22:13:41.908908] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-23T22:13:41.908998] [INFO ] [MAIN ] Update Progress: 2358/2372 symbols completed. ZBH took 33.4s. Estimated remaining: 1m 52s. Rate: 7.5 symbols/min [2025-09-23T22:13:42.602207] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-23T22:13:43.198938] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T22:13:43.402312] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-23T22:13:43.471895] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T22:13:43.480728] [INFO ] [REMOTE ] YUMC: Full fetch complete (76113 records). [2025-09-23T22:13:43.480864] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-23T22:13:43.909979] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-23T22:13:43.910085] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-23T22:13:43.911264] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-23T22:13:43.911329] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-23T22:13:43.912801] [DEBUG] [LOCAL ] YUMC: Trimmed 76113 records to 52708 (keeping 200 days of data) [2025-09-23T22:13:44.243499] [DEBUG] [LOCAL ] YUMC: Primary data saved (52708 records). [2025-09-23T22:13:44.243683] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-23T22:13:44.243792] [INFO ] [MAIN ] Update Progress: 2359/2372 symbols completed. YUMC took 39.0s. Estimated remaining: 1m 44s. Rate: 7.5 symbols/min [2025-09-23T22:13:44.878446] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T22:13:44.885128] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-23T22:13:46.490312] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T22:13:46.498264] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-23T22:13:47.950556] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T22:13:47.956370] [INFO ] [REMOTE ] ZEPP: Full fetch complete (18149 records). [2025-09-23T22:13:47.956448] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-23T22:13:48.341612] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-23T22:13:48.341722] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-23T22:13:48.342159] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-23T22:13:48.342200] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-23T22:13:48.342834] [DEBUG] [LOCAL ] ZEPP: Trimmed 18149 records to 16807 (keeping 200 days of data) [2025-09-23T22:13:48.441247] [DEBUG] [LOCAL ] ZEPP: Primary data saved (16807 records). [2025-09-23T22:13:48.441390] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-23T22:13:48.441477] [INFO ] [MAIN ] Update Progress: 2360/2372 symbols completed. ZEPP took 17.0s. Estimated remaining: 1m 36s. Rate: 7.5 symbols/min [2025-09-23T22:13:49.062056] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:49.233280] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:49.252445] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:49.288431] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:13:49.312226] [DEBUG] [LOCAL ] ZH: Loaded 26895 existing records from primary storage. [2025-09-23T22:13:49.312460] [INFO ] [MAIN ] ZH: Loaded 26895 existing records. [2025-09-23T22:13:49.567243] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:49.580493] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-23T22:13:49.582124] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-23T22:13:49.596829] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-23T22:13:49.598185] [INFO ] [MAIN ] ZETA: Loaded 53595 existing records. [2025-09-23T22:13:49.598879] [DEBUG] [LOCAL ] ZGN: Loaded 40907 existing records from primary storage. [2025-09-23T22:13:49.605610] [DEBUG] [LOCAL ] ZIM: Loaded 53550 existing records from primary storage. [2025-09-23T22:13:49.604916] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-23T22:13:49.620723] [INFO ] [MAIN ] ZIM: Loaded 53550 existing records. [2025-09-23T22:13:49.639943] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-23T22:13:49.645294] [INFO ] [MAIN ] ZGN: Loaded 40907 existing records. [2025-09-23T22:13:50.201823] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:50.246110] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-23T22:13:50.269210] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-23T22:13:50.317357] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-23T22:13:50.351561] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-23T22:13:50.375118] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:50.389453] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:13:50.439923] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-23T22:13:50.465116] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-23T22:13:50.445338] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-23T22:13:50.495224] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-23T22:13:50.515912] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-23T22:13:50.521182] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-23T22:13:50.526414] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-23T22:13:50.603495] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-23T22:13:50.844875] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:50.845743] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-23T22:13:51.538917] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:51.556824] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-23T22:13:51.699513] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:51.724107] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-23T22:13:51.723409] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:13:51.724694] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-23T22:13:52.016558] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T22:13:52.022128] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-23T22:13:52.917562] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T22:13:52.926104] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-23T22:13:53.091426] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T22:13:53.096266] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-23T22:13:53.342538] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T22:13:53.353490] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-23T22:13:53.990079] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-23T22:13:54.001011] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-23T22:13:54.056883] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T22:13:54.065332] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-23T22:13:54.616498] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T22:13:54.624788] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-23T22:13:55.328001] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T22:13:55.339933] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T22:13:55.346719] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-23T22:13:55.402147] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-23T22:13:55.831187] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T22:13:56.042602] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T22:13:56.202165] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-23T22:13:56.880507] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T22:13:57.002149] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-23T22:13:57.421607] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-23T22:13:57.479388] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T22:13:57.802247] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-23T22:13:58.538064] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T22:13:58.602177] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-23T22:13:58.841173] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-23T22:13:59.402259] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-23T22:13:59.887350] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T22:14:00.202207] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-23T22:14:01.002192] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-23T22:14:01.480556] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T22:14:01.802271] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-23T22:14:01.842908] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-23T22:14:02.602240] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-23T22:14:03.237239] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T22:14:03.392152] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-23T22:14:03.403394] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-23T22:14:04.202271] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-23T22:14:04.618976] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T22:14:04.736718] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-23T22:14:05.002203] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-23T22:14:05.726452] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T22:14:05.802195] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-23T22:14:06.602212] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-23T22:14:06.972481] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T22:14:07.016226] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-23T22:14:07.402268] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-23T22:14:08.202271] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-23T22:14:08.856907] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T22:14:08.899996] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-23T22:14:09.002273] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-23T22:14:09.802281] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-23T22:14:10.098960] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T22:14:10.602250] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-23T22:14:10.636473] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T22:14:10.642044] [INFO ] [REMOTE ] ZH: Full fetch complete (39872 records). [2025-09-23T22:14:10.642232] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-23T22:14:11.042185] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-23T22:14:11.042272] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-23T22:14:11.043191] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-23T22:14:11.043254] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-23T22:14:11.044208] [DEBUG] [LOCAL ] ZH: Trimmed 39872 records to 26759 (keeping 200 days of data) [2025-09-23T22:14:11.194407] [DEBUG] [LOCAL ] ZH: Primary data saved (26759 records). [2025-09-23T22:14:11.194546] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-23T22:14:11.194633] [INFO ] [MAIN ] Update Progress: 2361/2372 symbols completed. ZH took 22.7s. Estimated remaining: 1m 28s. Rate: 7.5 symbols/min [2025-09-23T22:14:11.372794] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:14:11.407222] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-23T22:14:11.427903] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-23T22:14:11.455024] [DEBUG] [LOCAL ] ZIP: Loaded 44431 existing records from primary storage. [2025-09-23T22:14:11.455737] [INFO ] [MAIN ] ZIP: Loaded 44431 existing records. [2025-09-23T22:14:11.638113] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:14:11.638434] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-23T22:14:11.638483] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-23T22:14:11.639455] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-23T22:14:11.639516] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-23T22:14:12.012318] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:14:12.033127] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T22:14:12.040438] [INFO ] [REMOTE ] ZGN: Full fetch complete (58378 records). [2025-09-23T22:14:12.040615] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-23T22:14:12.213839] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-23T22:14:12.476300] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-23T22:14:12.476400] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-23T22:14:12.477571] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-23T22:14:12.477638] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-23T22:14:12.479221] [DEBUG] [LOCAL ] ZGN: Trimmed 58378 records to 40910 (keeping 200 days of data) [2025-09-23T22:14:12.744941] [DEBUG] [LOCAL ] ZGN: Primary data saved (40910 records). [2025-09-23T22:14:12.745091] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-23T22:14:12.745194] [INFO ] [MAIN ] Update Progress: 2362/2372 symbols completed. ZGN took 24.3s. Estimated remaining: 1m 20s. Rate: 7.5 symbols/min [2025-09-23T22:14:12.928046] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:14:12.970664] [DEBUG] [LOCAL ] ZK: Loaded 40228 existing records from primary storage. [2025-09-23T22:14:12.970869] [INFO ] [MAIN ] ZK: Loaded 40228 existing records. [2025-09-23T22:14:13.014091] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-23T22:14:13.166629] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:14:13.166927] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-23T22:14:13.166981] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-23T22:14:13.167925] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-23T22:14:13.167986] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-23T22:14:13.571476] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:14:13.728501] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-23T22:14:13.802155] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-23T22:14:14.428119] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T22:14:14.602191] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-23T22:14:14.636175] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-23T22:14:15.402204] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-23T22:14:16.202171] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-23T22:14:16.235052] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T22:14:16.386345] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-23T22:14:17.002163] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-23T22:14:17.277288] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T22:14:17.472574] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T22:14:17.802210] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-23T22:14:18.602189] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-23T22:14:19.022304] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T22:14:19.402204] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-23T22:14:19.521044] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-23T22:14:19.752135] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T22:14:20.202194] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-23T22:14:21.002199] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-23T22:14:21.610896] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T22:14:21.735988] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T22:14:21.802153] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-23T22:14:22.270052] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T22:14:22.602241] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-23T22:14:23.129053] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T22:14:23.402193] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-23T22:14:24.202195] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-23T22:14:24.790573] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-23T22:14:24.799629] [INFO ] [REMOTE ] ZETA: Full fetch complete (77677 records). [2025-09-23T22:14:24.799805] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-23T22:14:25.012397] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-23T22:14:25.242738] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-23T22:14:25.242841] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-23T22:14:25.244195] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-23T22:14:25.244263] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-23T22:14:25.246069] [DEBUG] [LOCAL ] ZETA: Trimmed 77677 records to 53595 (keeping 200 days of data) [2025-09-23T22:14:25.595410] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-23T22:14:25.607369] [INFO ] [REMOTE ] ZIM: Full fetch complete (77521 records). [2025-09-23T22:14:25.608788] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-23T22:14:25.610877] [DEBUG] [LOCAL ] ZETA: Primary data saved (53595 records). [2025-09-23T22:14:25.611124] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-23T22:14:25.611246] [INFO ] [MAIN ] Update Progress: 2363/2372 symbols completed. ZETA took 37.2s. Estimated remaining: 1m 12s. Rate: 7.5 symbols/min [2025-09-23T22:14:25.913990] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:14:25.935014] [DEBUG] [LOCAL ] ZKH: No existing data file found in primary storage. [2025-09-23T22:14:25.956084] [WARN ] [MAIN ] ZKH: No existing data found, performing full refresh instead. [2025-09-23T22:14:26.028071] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-23T22:14:26.053593] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-23T22:14:26.109229] [DEBUG] [LOCAL ] ZKH: No primary data file found to delete. [2025-09-23T22:14:26.137514] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-23T22:14:26.199959] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T22:14:26.323965] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-23T22:14:26.376157] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-23T22:14:26.376735] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-23T22:14:26.378048] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-23T22:14:26.398931] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-23T22:14:26.505423] [DEBUG] [LOCAL ] ZIM: Trimmed 77521 records to 53542 (keeping 200 days of data) [2025-09-23T22:14:26.742714] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:14:26.743844] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-23T22:14:26.784385] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T22:14:27.031492] [DEBUG] [LOCAL ] ZIM: Primary data saved (53542 records). [2025-09-23T22:14:27.031675] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-23T22:14:27.031786] [INFO ] [MAIN ] Update Progress: 2364/2372 symbols completed. ZIM took 38.6s. Estimated remaining: 1m 4s. Rate: 7.5 symbols/min [2025-09-23T22:14:27.219706] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:14:27.268926] [DEBUG] [LOCAL ] ZTO: Loaded 50073 existing records from primary storage. [2025-09-23T22:14:27.269102] [INFO ] [MAIN ] ZTO: Loaded 50073 existing records. [2025-09-23T22:14:27.381805] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T22:14:27.404372] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-23T22:14:27.470418] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:14:27.470703] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-23T22:14:27.470762] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-23T22:14:27.471830] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-23T22:14:27.471892] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-23T22:14:27.854730] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:14:27.979501] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T22:14:28.202244] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-23T22:14:28.910697] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T22:14:29.002163] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-23T22:14:29.052864] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T22:14:29.802203] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-23T22:14:30.379547] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T22:14:30.602232] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-23T22:14:31.366539] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T22:14:31.402269] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-23T22:14:32.007213] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T22:14:32.202228] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-23T22:14:32.959482] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T22:14:32.998665] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T22:14:33.002091] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-23T22:14:33.802169] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-23T22:14:33.813805] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T22:14:34.602231] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-23T22:14:35.402230] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-23T22:14:35.575876] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T22:14:35.642201] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T22:14:35.994823] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T22:14:36.202246] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-23T22:14:37.002201] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-23T22:14:37.578119] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T22:14:37.802227] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-23T22:14:37.991709] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T22:14:38.602212] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-23T22:14:39.402216] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-23T22:14:39.465741] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T22:14:39.473937] [INFO ] [REMOTE ] ZK: Full fetch complete (57580 records). [2025-09-23T22:14:39.474186] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-23T22:14:39.889587] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-23T22:14:39.889706] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-23T22:14:39.890743] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-23T22:14:39.890806] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-23T22:14:39.892119] [DEBUG] [LOCAL ] ZK: Trimmed 57580 records to 40229 (keeping 200 days of data) [2025-09-23T22:14:40.131892] [DEBUG] [LOCAL ] ZK: Primary data saved (40229 records). [2025-09-23T22:14:40.132085] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-23T22:14:40.132460] [INFO ] [MAIN ] Update Progress: 2365/2372 symbols completed. ZK took 27.4s. Estimated remaining: 55.9s. Rate: 7.5 symbols/min [2025-09-23T22:14:40.202874] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-23T22:14:40.316941] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:14:40.348333] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T22:14:40.369824] [DEBUG] [LOCAL ] ZTR: Loaded 16743 existing records from primary storage. [2025-09-23T22:14:40.369963] [INFO ] [MAIN ] ZTR: Loaded 16743 existing records. [2025-09-23T22:14:40.551291] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:14:40.551621] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-23T22:14:40.551709] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-23T22:14:40.552339] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-23T22:14:40.552401] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-23T22:14:40.983983] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:14:40.985255] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T22:14:40.988300] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T22:14:41.002155] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-23T22:14:41.802217] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-23T22:14:41.999052] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T22:14:42.602223] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-23T22:14:42.897697] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T22:14:43.082127] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T22:14:43.402242] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-23T22:14:44.202207] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-23T22:14:44.778482] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T22:14:44.788180] [INFO ] [REMOTE ] ZIP: Full fetch complete (59305 records). [2025-09-23T22:14:44.788396] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-23T22:14:45.007290] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-23T22:14:45.190969] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-23T22:14:45.191062] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-23T22:14:45.192119] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-23T22:14:45.192216] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-23T22:14:45.193998] [DEBUG] [LOCAL ] ZIP: Trimmed 59305 records to 44413 (keeping 200 days of data) [2025-09-23T22:14:45.347087] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T22:14:45.506084] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T22:14:45.509517] [INFO ] [REMOTE ] ZKH: Full fetch complete (11868 records). [2025-09-23T22:14:45.510236] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-23T22:14:45.578949] [DEBUG] [LOCAL ] ZIP: Primary data saved (44413 records). [2025-09-23T22:14:45.579080] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-23T22:14:45.585110] [INFO ] [MAIN ] Update Progress: 2366/2372 symbols completed. ZIP took 34.4s. Estimated remaining: 47.9s. Rate: 7.5 symbols/min [2025-09-23T22:14:45.831058] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-23T22:14:46.047948] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:14:46.141309] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-23T22:14:46.141391] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-23T22:14:46.141781] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-23T22:14:46.141920] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-23T22:14:46.142413] [DEBUG] [LOCAL ] ZKH: Trimmed 11868 records to 8058 (keeping 200 days of data) [2025-09-23T22:14:46.190105] [DEBUG] [LOCAL ] ZKH: Primary data saved (8058 records). [2025-09-23T22:14:46.190283] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-23T22:14:46.190372] [INFO ] [MAIN ] Update Progress: 2367/2372 symbols completed. ZKH took 20.6s. Estimated remaining: 39.9s. Rate: 7.5 symbols/min [2025-09-23T22:14:46.350157] [DEBUG] [LOCAL ] ZTS: Loaded 53006 existing records from primary storage. [2025-09-23T22:14:46.376193] [INFO ] [MAIN ] ZTS: Loaded 53006 existing records. [2025-09-23T22:14:46.427965] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:14:46.605610] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:14:46.605683] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-23T22:14:46.606938] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-23T22:14:46.607003] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-23T22:14:46.608593] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-23T22:14:46.608678] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-23T22:14:46.731489] [DEBUG] [LOCAL ] ZVIA: Loaded 35427 existing records from primary storage. [2025-09-23T22:14:46.732028] [INFO ] [MAIN ] ZVIA: Loaded 35427 existing records. [2025-09-23T22:14:47.110329] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:14:47.121254] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-23T22:14:47.121334] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-23T22:14:47.126608] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-23T22:14:47.150594] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-23T22:14:47.230954] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:14:47.407287] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-23T22:14:47.595719] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:14:47.631864] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T22:14:47.702929] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T22:14:48.202253] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-23T22:14:49.002218] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-23T22:14:49.081940] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T22:14:49.717757] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T22:14:49.761786] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T22:14:49.802187] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-23T22:14:50.602181] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-23T22:14:50.864246] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T22:14:51.402265] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-23T22:14:51.927458] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T22:14:52.202227] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-23T22:14:52.766981] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T22:14:52.828387] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T22:14:53.002174] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-23T22:14:53.802261] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-23T22:14:54.602196] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-23T22:14:54.739101] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T22:14:54.798175] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T22:14:55.402193] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-23T22:14:56.094987] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T22:14:56.146845] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T22:14:56.202155] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-23T22:14:57.002183] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-23T22:14:57.251194] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T22:14:57.802249] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-23T22:14:58.602177] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-23T22:14:58.906147] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T22:14:59.147689] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T22:14:59.402219] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-23T22:14:59.825955] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T22:15:00.202259] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-23T22:15:01.007351] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-23T22:15:01.024603] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T22:15:01.098425] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T22:15:01.101416] [INFO ] [REMOTE ] ZTR: Full fetch complete (26828 records). [2025-09-23T22:15:01.101508] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-23T22:15:01.490011] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-23T22:15:01.490110] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-23T22:15:01.490759] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-23T22:15:01.490858] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-23T22:15:01.491865] [DEBUG] [LOCAL ] ZTR: Trimmed 26828 records to 16720 (keeping 200 days of data) [2025-09-23T22:15:01.609489] [DEBUG] [LOCAL ] ZTR: Primary data saved (16720 records). [2025-09-23T22:15:01.609821] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-23T22:15:01.610104] [INFO ] [MAIN ] Update Progress: 2368/2372 symbols completed. ZTR took 21.5s. Estimated remaining: 31.9s. Rate: 7.5 symbols/min [2025-09-23T22:15:01.801072] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T22:15:01.802190] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-23T22:15:01.860881] [DEBUG] [LOCAL ] ZWS: Loaded 42492 existing records from primary storage. [2025-09-23T22:15:01.861062] [INFO ] [MAIN ] ZWS: Loaded 42492 existing records. [2025-09-23T22:15:02.047626] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T22:15:02.047977] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-23T22:15:02.048074] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-23T22:15:02.049219] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-23T22:15:02.049303] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-23T22:15:02.425140] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T22:15:02.602242] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-23T22:15:03.402255] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-23T22:15:04.216542] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (3.21 seconds). [2025-09-23T22:15:04.229461] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-23T22:15:05.557843] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (3.76 seconds). [2025-09-23T22:15:05.566403] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-23T22:15:05.648333] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-23T22:15:05.688035] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (3.09 seconds). [2025-09-23T22:15:05.802165] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-23T22:15:06.602176] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-23T22:15:06.648085] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-23T22:15:07.042594] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T22:15:07.402241] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-23T22:15:07.536408] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T22:15:08.177361] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T22:15:08.202145] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-23T22:15:09.002221] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-23T22:15:09.352602] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T22:15:09.712318] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T22:15:09.802157] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-23T22:15:10.210992] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T22:15:10.219590] [INFO ] [REMOTE ] ZTO: Full fetch complete (73084 records). [2025-09-23T22:15:10.219803] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-23T22:15:10.612737] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-23T22:15:10.660592] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-23T22:15:10.660735] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-23T22:15:10.661911] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-23T22:15:10.661977] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-23T22:15:10.663624] [DEBUG] [LOCAL ] ZTO: Trimmed 73084 records to 49981 (keeping 200 days of data) [2025-09-23T22:15:10.989721] [DEBUG] [LOCAL ] ZTO: Primary data saved (49981 records). [2025-09-23T22:15:10.989863] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-23T22:15:10.990000] [INFO ] [MAIN ] Update Progress: 2369/2372 symbols completed. ZTO took 44.0s. Estimated remaining: 23.9s. Rate: 7.5 symbols/min [2025-09-23T22:15:11.375127] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T22:15:11.402158] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-23T22:15:12.085074] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T22:15:12.202211] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-23T22:15:13.002192] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-23T22:15:13.325873] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T22:15:13.802184] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-23T22:15:13.897375] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T22:15:14.602233] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-23T22:15:14.862850] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T22:15:15.402194] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-23T22:15:16.119570] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-23T22:15:16.202179] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-23T22:15:16.491406] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T22:15:16.568209] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-23T22:15:17.002259] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-23T22:15:17.205810] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T22:15:17.214595] [INFO ] [REMOTE ] ZTS: Full fetch complete (76687 records). [2025-09-23T22:15:17.214755] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-23T22:15:17.617037] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-23T22:15:17.617132] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-23T22:15:17.618289] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-23T22:15:17.618353] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-23T22:15:17.620199] [DEBUG] [LOCAL ] ZTS: Trimmed 76687 records to 53002 (keeping 200 days of data) [2025-09-23T22:15:17.811608] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-23T22:15:17.971536] [DEBUG] [LOCAL ] ZTS: Primary data saved (53002 records). [2025-09-23T22:15:17.971715] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-23T22:15:17.975829] [INFO ] [MAIN ] Update Progress: 2370/2372 symbols completed. ZTS took 32.4s. Estimated remaining: 16.0s. Rate: 7.5 symbols/min [2025-09-23T22:15:18.527224] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T22:15:18.602249] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-23T22:15:19.204825] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T22:15:19.402236] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-23T22:15:19.981340] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T22:15:19.987740] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52482 records). [2025-09-23T22:15:19.987846] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-23T22:15:20.379572] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-23T22:15:20.379675] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-23T22:15:20.380665] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-23T22:15:20.380727] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-23T22:15:20.381862] [DEBUG] [LOCAL ] ZVIA: Trimmed 52482 records to 35414 (keeping 200 days of data) [2025-09-23T22:15:20.606067] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35414 records). [2025-09-23T22:15:20.606422] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-23T22:15:20.606542] [INFO ] [MAIN ] Update Progress: 2371/2372 symbols completed. ZVIA took 34.4s. Estimated remaining: 8.0s. Rate: 7.5 symbols/min [2025-09-23T22:15:21.161021] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T22:15:21.172254] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-23T22:15:22.668783] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T22:15:22.680389] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-23T22:15:24.228478] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T22:15:24.240992] [INFO ] [REMOTE ] ZWS: Full fetch complete (61988 records). [2025-09-23T22:15:24.241323] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-23T22:15:24.819312] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-23T22:15:24.819451] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-23T22:15:24.821985] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-23T22:15:24.822120] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-23T22:15:24.824990] [DEBUG] [LOCAL ] ZWS: Trimmed 61988 records to 42484 (keeping 200 days of data) [2025-09-23T22:15:25.150185] [DEBUG] [LOCAL ] ZWS: Primary data saved (42484 records). [2025-09-23T22:15:25.150457] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-23T22:15:25.150680] [INFO ] [MAIN ] Update Progress: 2372/2372 symbols completed. ZWS took 23.5s. Estimated remaining: 0.0s. Rate: 7.5 symbols/min [2025-09-23T22:15:25.153051] [INFO ] [MAIN ] Parallel update completed in 5h 15m 22s [2025-09-23T22:15:25.153408] [WARN ] [MAIN ] Failed symbols (295): AAM, AACT, AAMI, A, AAUC, AAP, ABT, ACEL, ACHR, ACP... [2025-09-23T22:15:25.153552] [INFO ] [MAIN ] Update success rate: 87.6% (2077/2372 symbols) [2025-09-23T22:15:25.838207] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2077/2372 @ 87.56%)' [2025-09-23T22:15:25.839426] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-23T22:15:25.839861] [INFO ] [STATE ] Last completion updated: 2025-09-23T22:15:25.839503 [2025-09-23T22:15:25.840144] [WARN ] [STATE ] State set to: RUNNING [2025-09-23T22:15:25.840253] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-23T22:15:25.840452] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-23T22:15:25.840532] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-23T22:15:25.843013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-23T22:15:25.843465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-23T22:15:25.843848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-23T22:15:25.844246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-23T22:15:25.844616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-23T22:15:25.845018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-23T22:15:25.845470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-23T22:15:25.845848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-23T22:15:25.846177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-23T22:15:25.846556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-23T22:15:25.847018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-23T22:15:25.847381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-23T22:15:25.847796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-23T22:15:25.848083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-23T22:15:25.848447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-23T22:15:25.848787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-23T22:15:25.849094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-23T22:15:25.849349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-23T22:15:25.849608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-23T22:15:25.849889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-23T22:15:25.850182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-23T22:15:25.850470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-23T22:15:25.850832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-23T22:15:25.851167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-23T22:15:25.851417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-23T22:15:25.851787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-23T22:15:25.852116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-23T22:15:25.852379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-23T22:15:25.852613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-23T22:15:25.852942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-23T22:15:25.853210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-23T22:15:25.853471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-23T22:15:25.853912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-23T22:15:25.854302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-23T22:15:25.854522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-23T22:15:25.854885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-23T22:15:25.855126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-23T22:15:25.855374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-23T22:15:25.855728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-23T22:15:25.856012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-23T22:15:25.856225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-23T22:15:25.856477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-23T22:15:25.856868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-23T22:15:25.857106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-23T22:15:25.857397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-23T22:15:25.857703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-23T22:15:25.857926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-23T22:15:25.858149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-23T22:15:25.858476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-23T22:15:25.858797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-23T22:15:25.859142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-23T22:15:25.859374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-23T22:15:25.859674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-23T22:15:25.859963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-23T22:15:25.860277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-23T22:15:25.860486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-23T22:15:25.860742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-23T22:15:25.860950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-23T22:15:25.861264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-23T22:15:25.862120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-23T22:15:25.862480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-23T22:15:25.862833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-23T22:15:25.863057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-23T22:15:25.863328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-23T22:15:25.863571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-23T22:15:25.864088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-23T22:15:25.864382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-23T22:15:25.864619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-23T22:15:25.864931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-23T22:15:25.865385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-23T22:15:25.865689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-23T22:15:25.866005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-23T22:15:25.866371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-23T22:15:25.866702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-23T22:15:25.866989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-23T22:15:25.867289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-23T22:15:25.867605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-23T22:15:25.868020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-23T22:15:25.868393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-23T22:15:25.868741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-23T22:15:25.868966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-23T22:15:25.869324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-23T22:15:25.869693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-23T22:15:25.870000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-23T22:15:25.870372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-23T22:15:25.870763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-23T22:15:25.871075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-23T22:15:25.871441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-23T22:15:25.872035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-23T22:15:25.872260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-23T22:15:25.872492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-23T22:15:25.872862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-23T22:15:25.873102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-23T22:15:25.873314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-23T22:15:25.873571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-23T22:15:25.873831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-23T22:15:25.874066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-23T22:15:25.874296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-23T22:15:25.874521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-23T22:15:25.874800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-23T22:15:25.875013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-23T22:15:25.875220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-23T22:15:25.875445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-23T22:15:25.875779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-09-23T22:15:25.876062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-23T22:15:25.876269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-23T22:15:25.876494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-23T22:15:25.876717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-23T22:15:25.876915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-23T22:15:25.877334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-23T22:15:25.877584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-23T22:15:25.877898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-23T22:15:25.878147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-23T22:15:25.878585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-23T22:15:25.878860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-23T22:15:25.879122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-23T22:15:25.879376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-23T22:15:25.879575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-23T22:15:25.880087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-23T22:15:25.880308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-23T22:15:25.880554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-23T22:15:25.880863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-23T22:15:25.881041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-23T22:15:25.881258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-23T22:15:25.881454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-23T22:15:25.881738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-23T22:15:25.881998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-23T22:15:25.882191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-23T22:15:25.882387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-23T22:15:25.882567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-23T22:15:25.882816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-23T22:15:25.883055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-23T22:15:25.883308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-23T22:15:25.883525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-23T22:15:25.883750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-23T22:15:25.884044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-23T22:15:25.884280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-23T22:15:25.884597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-23T22:15:25.884870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-23T22:15:25.885081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-23T22:15:25.885368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-23T22:15:25.885629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-23T22:15:25.885989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-23T22:15:25.886341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-23T22:15:25.886628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-23T22:15:25.886923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-23T22:15:25.887201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-23T22:15:25.887457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-23T22:15:25.887802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-23T22:15:25.888141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-23T22:15:25.888396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-23T22:15:25.888931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-23T22:15:25.889267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-23T22:15:25.889947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-23T22:15:25.890335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-23T22:15:25.890558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-23T22:15:25.890954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-23T22:15:25.891228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-23T22:15:25.891483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-23T22:15:25.891743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-23T22:15:25.891980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-23T22:15:25.892246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-23T22:15:25.892503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-23T22:15:25.892792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-23T22:15:25.893015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-23T22:15:25.893181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-23T22:15:25.893386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-23T22:15:25.893659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-23T22:15:25.893869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-23T22:15:25.894134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-23T22:15:25.894363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-23T22:15:25.894585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-23T22:15:25.894796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-23T22:15:25.894978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-23T22:15:25.895237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-23T22:15:25.895414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-23T22:15:25.895604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-23T22:15:25.896026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-23T22:15:25.896203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-23T22:15:25.896437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-23T22:15:25.896618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-23T22:15:25.896988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-23T22:15:25.897184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-23T22:15:25.897584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-23T22:15:25.897786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-23T22:15:25.897953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-23T22:15:25.898128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-23T22:15:25.898319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-23T22:15:25.898500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-23T22:15:25.898748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-23T22:15:25.898942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-23T22:15:25.899132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-23T22:15:25.899345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-23T22:15:25.899518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-23T22:15:25.899820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-09-23T22:15:25.899993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-23T22:15:25.900240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-23T22:15:25.900455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-23T22:15:25.900701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-23T22:15:25.900911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-23T22:15:25.901116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-23T22:15:25.901295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-23T22:15:25.901527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-23T22:15:25.901762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-23T22:15:25.901934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-23T22:15:25.902132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-23T22:15:25.902341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-23T22:15:25.902558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-23T22:15:25.902829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-23T22:15:25.903117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-23T22:15:25.903331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-23T22:15:25.903625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-23T22:15:25.904022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-23T22:15:25.904264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-23T22:15:25.904471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-23T22:15:25.904723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-23T22:15:25.905009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-23T22:15:25.905334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-23T22:15:25.905601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-23T22:15:25.905857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-23T22:15:25.906193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-23T22:15:25.906414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-23T22:15:25.906843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-23T22:15:25.907085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-23T22:15:25.907358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-23T22:15:25.907845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-23T22:15:25.908145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-23T22:15:25.908376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-23T22:15:25.908671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-23T22:15:25.908938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-23T22:15:25.909269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-23T22:15:25.909542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-23T22:15:25.909866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-23T22:15:25.910095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-23T22:15:25.910295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-23T22:15:25.910501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-23T22:15:25.910742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-23T22:15:25.910963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-23T22:15:25.911106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-23T22:15:25.911294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-23T22:15:25.911521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-23T22:15:25.911796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-23T22:15:25.912045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-23T22:15:25.912250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-23T22:15:25.912436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-23T22:15:25.912615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-23T22:15:25.912805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-23T22:15:25.913000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-23T22:15:25.913174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-23T22:15:25.913378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-23T22:15:25.913755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-23T22:15:25.914037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-23T22:15:25.914220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-23T22:15:25.914414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-23T22:15:25.914670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-23T22:15:25.914918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-23T22:15:25.915156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-23T22:15:25.915509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-23T22:15:25.915871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-23T22:15:25.916041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-23T22:15:25.916290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-23T22:15:25.916480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-23T22:15:25.916736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-23T22:15:25.916982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-23T22:15:25.917192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-23T22:15:25.917374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-23T22:15:25.917707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-23T22:15:25.917952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-23T22:15:25.918160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-23T22:15:25.918343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-23T22:15:25.918540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-09-23T22:15:25.918786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-23T22:15:25.918954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-23T22:15:25.919503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-23T22:15:25.919884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-23T22:15:25.920118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-23T22:15:25.920408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-23T22:15:25.920676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-23T22:15:25.920928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-23T22:15:25.921196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-23T22:15:25.921386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-23T22:15:25.921683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-23T22:15:25.921934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-23T22:15:25.922109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-23T22:15:25.922336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-23T22:15:25.922637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-23T22:15:25.922939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-23T22:15:25.923146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-23T22:15:25.923335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-23T22:15:25.923557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-23T22:15:25.923881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-23T22:15:25.924116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-23T22:15:25.924312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-23T22:15:25.924518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-23T22:15:25.924743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-23T22:15:25.924998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-23T22:15:25.925244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-23T22:15:25.925411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-23T22:15:25.925573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-23T22:15:25.925886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-23T22:15:25.926068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-23T22:15:25.926271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-23T22:15:25.926500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-23T22:15:25.926718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-23T22:15:25.926919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-23T22:15:25.927110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-23T22:15:25.927273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-23T22:15:25.927470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-23T22:15:25.927674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-23T22:15:25.927855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-23T22:15:25.928035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-23T22:15:25.928225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-23T22:15:25.928394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-23T22:15:25.928573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-23T22:15:25.928767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-23T22:15:25.928936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-23T22:15:25.929145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-23T22:15:25.929383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-23T22:15:25.929579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-23T22:15:25.929989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-23T22:15:25.930154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-23T22:15:25.930413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-23T22:15:25.930711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-23T22:15:25.930948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-23T22:15:25.931158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-23T22:15:25.931356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-23T22:15:25.931577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-23T22:15:25.931906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-23T22:15:25.932073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-23T22:15:25.932257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-23T22:15:25.932415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-23T22:15:25.932607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-23T22:15:25.932836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-23T22:15:25.933021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-23T22:15:25.933196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-23T22:15:25.933427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-23T22:15:25.933626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-23T22:15:25.933810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-23T22:15:25.934020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-23T22:15:25.934205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-23T22:15:25.934361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-23T22:15:25.934558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-23T22:15:25.934755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-23T22:15:25.935022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-23T22:15:25.935237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-23T22:15:25.935590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-23T22:15:25.935814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-23T22:15:25.936010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-23T22:15:25.936228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-23T22:15:25.936382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-23T22:15:25.936570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-23T22:15:25.936822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-23T22:15:25.936988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-23T22:15:25.937205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-23T22:15:25.937396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-23T22:15:25.937585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-23T22:15:25.937860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-23T22:15:25.938054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-23T22:15:25.938267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-23T22:15:25.938489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-23T22:15:25.938720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-23T22:15:25.938942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-23T22:15:25.939132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-23T22:15:25.939364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-23T22:15:25.939612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-23T22:15:25.939930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-23T22:15:25.940135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-23T22:15:25.940347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-23T22:15:25.940547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-23T22:15:25.940758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-23T22:15:25.940945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-23T22:15:25.941119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-23T22:15:25.941351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-23T22:15:25.941536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-23T22:15:25.941738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-23T22:15:25.941893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-23T22:15:25.942053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-23T22:15:25.942225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-23T22:15:25.942579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-23T22:15:25.942807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-23T22:15:25.942973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-23T22:15:25.943144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-23T22:15:25.943328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-23T22:15:25.943522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-23T22:15:25.943832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-23T22:15:25.944016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-09-23T22:15:25.944242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-23T22:15:25.944439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-23T22:15:25.944639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-23T22:15:25.944886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-23T22:15:25.945092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-23T22:15:25.945291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-23T22:15:25.945472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-23T22:15:25.945678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-23T22:15:25.945891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-23T22:15:25.946063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-23T22:15:25.946241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-23T22:15:25.946409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-23T22:15:25.946584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-23T22:15:25.946827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-23T22:15:25.947026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-23T22:15:25.947200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-23T22:15:25.947382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-23T22:15:25.947544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-23T22:15:25.947813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-23T22:15:25.948001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-23T22:15:25.948176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-23T22:15:25.948553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-23T22:15:25.948727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-23T22:15:25.948933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-23T22:15:25.949086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-23T22:15:25.949256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-23T22:15:25.949441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-23T22:15:25.949597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-23T22:15:25.949791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-23T22:15:25.950001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-23T22:15:25.950200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-23T22:15:25.950572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-23T22:15:25.950787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-23T22:15:25.950985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-23T22:15:25.951161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-23T22:15:25.951350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-23T22:15:25.951508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-23T22:15:25.951754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-23T22:15:25.952038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-23T22:15:25.952249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-23T22:15:25.952425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-23T22:15:25.952608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-23T22:15:25.952845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-23T22:15:25.953039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-23T22:15:25.953240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-23T22:15:25.953389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-23T22:15:25.953554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-23T22:15:25.953787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-23T22:15:25.953985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-23T22:15:25.954183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-23T22:15:25.954370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-23T22:15:25.954539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-23T22:15:25.954730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-23T22:15:25.954928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-23T22:15:25.955189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-23T22:15:25.955601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-23T22:15:25.955913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-23T22:15:25.956075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-23T22:15:25.956399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-23T22:15:25.956589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-23T22:15:25.956842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-23T22:15:25.957023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-23T22:15:25.957216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-23T22:15:25.957395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-23T22:15:25.957606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-23T22:15:25.957825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-23T22:15:25.958019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-23T22:15:25.958205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-23T22:15:25.958391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-23T22:15:25.958568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-23T22:15:25.958816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-23T22:15:25.959038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-23T22:15:25.959232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-23T22:15:25.959465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-23T22:15:25.959684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-23T22:15:25.959867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-23T22:15:25.960052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-23T22:15:25.960236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-23T22:15:25.960460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-23T22:15:25.960620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-23T22:15:25.960876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-23T22:15:25.961087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-23T22:15:25.961278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-23T22:15:25.961497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-23T22:15:25.961722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-23T22:15:25.961897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-23T22:15:25.962271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-23T22:15:25.962469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-23T22:15:25.962707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-23T22:15:25.962900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-23T22:15:25.963111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-23T22:15:25.963295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-23T22:15:25.963526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-23T22:15:25.963783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-23T22:15:25.963955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-23T22:15:25.964276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-23T22:15:25.964475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-23T22:15:25.964627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-23T22:15:25.965006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-23T22:15:25.965185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-23T22:15:25.965362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-23T22:15:25.965570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-23T22:15:25.965950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-23T22:15:25.966124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-23T22:15:25.966343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-23T22:15:25.966529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-23T22:15:25.966758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-23T22:15:25.966917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-23T22:15:25.967089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-23T22:15:25.967297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-23T22:15:25.967453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-23T22:15:25.967595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-23T22:15:25.968047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-23T22:15:25.968243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-23T22:15:25.968431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-23T22:15:25.968630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-23T22:15:25.969072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-23T22:15:25.969242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-23T22:15:25.969464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-23T22:15:25.969666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-23T22:15:25.969834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-23T22:15:25.970003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-23T22:15:25.970156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-23T22:15:25.970344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-23T22:15:25.970533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-23T22:15:25.970760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-23T22:15:25.970997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-23T22:15:25.971184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-23T22:15:25.971401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-23T22:15:25.971555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-23T22:15:25.971831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-23T22:15:25.972006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-23T22:15:25.972176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-23T22:15:25.972321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-23T22:15:25.972503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-23T22:15:25.972686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-23T22:15:25.972853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-23T22:15:25.973011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-23T22:15:25.973174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-23T22:15:25.973479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-23T22:15:25.973707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-23T22:15:25.974234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-23T22:15:25.974389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-23T22:15:25.974576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-23T22:15:25.974997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-23T22:15:25.975160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-23T22:15:25.975353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-23T22:15:25.975536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-23T22:15:25.975731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-23T22:15:25.976057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-23T22:15:25.976252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-23T22:15:25.976476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-23T22:15:25.976638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-23T22:15:25.976812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-23T22:15:25.977171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-23T22:15:25.977340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-23T22:15:25.977505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-23T22:15:25.977674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-23T22:15:25.978009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-23T22:15:25.978201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-23T22:15:25.978361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-23T22:15:25.978525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-23T22:15:25.978720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-23T22:15:25.979067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-23T22:15:25.979227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-23T22:15:25.979414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-23T22:15:25.979577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-23T22:15:25.979898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-23T22:15:25.980065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-23T22:15:25.980248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-23T22:15:25.980435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-23T22:15:25.980607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-23T22:15:25.980799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-23T22:15:25.980962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-23T22:15:25.981149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-23T22:15:25.981314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-23T22:15:25.981474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-23T22:15:25.981674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-23T22:15:25.981856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-23T22:15:25.982043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-23T22:15:25.982253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-23T22:15:25.982409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-23T22:15:25.982579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-23T22:15:25.982759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-23T22:15:25.982919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-23T22:15:25.983068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-23T22:15:25.983257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-23T22:15:25.983453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-23T22:15:25.983624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-23T22:15:25.983819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-23T22:15:25.983989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-23T22:15:25.984176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-23T22:15:25.984375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-23T22:15:25.984576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-23T22:15:25.984784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-23T22:15:25.984971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-23T22:15:25.985143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-23T22:15:25.985315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-23T22:15:25.985508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-23T22:15:25.985715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-23T22:15:25.985917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-23T22:15:25.986099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-23T22:15:25.986274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-23T22:15:25.986429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-23T22:15:25.986623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-23T22:15:25.986845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-23T22:15:25.987035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-23T22:15:25.987285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-23T22:15:25.987488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-23T22:15:25.987638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-23T22:15:25.987902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-23T22:15:25.988089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-23T22:15:25.988250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-23T22:15:25.988417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-23T22:15:25.988574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-23T22:15:25.988770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-23T22:15:25.988950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-23T22:15:25.989105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-23T22:15:25.989265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-23T22:15:25.989467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-23T22:15:25.989677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-23T22:15:25.989856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-23T22:15:25.990041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-23T22:15:25.990247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-23T22:15:25.990421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-23T22:15:25.990587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-23T22:15:25.990803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-23T22:15:25.991026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-23T22:15:25.991188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-23T22:15:25.991357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-23T22:15:25.991516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-23T22:15:25.991703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-23T22:15:25.991857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-23T22:15:25.992039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-23T22:15:25.992211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-23T22:15:25.992393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-23T22:15:25.992548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-23T22:15:25.992757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-23T22:15:25.992913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-23T22:15:25.993087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-23T22:15:25.993393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-23T22:15:25.993554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-23T22:15:25.993744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-23T22:15:25.994085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-23T22:15:25.994236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-23T22:15:25.994547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-23T22:15:25.994926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-23T22:15:25.995085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-23T22:15:25.995280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-23T22:15:25.995500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-23T22:15:25.995810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-23T22:15:25.996015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-23T22:15:25.996149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-23T22:15:25.996318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-23T22:15:25.996499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-23T22:15:25.996723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-23T22:15:25.996907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-23T22:15:25.997082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-23T22:15:25.997263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-23T22:15:25.997429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-23T22:15:25.997668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-23T22:15:25.997847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-23T22:15:25.998031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-23T22:15:25.998195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-23T22:15:25.998395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-23T22:15:25.998567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-23T22:15:25.998787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-23T22:15:25.998943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-23T22:15:25.999152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-23T22:15:25.999328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-23T22:15:25.999498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-23T22:15:25.999710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-23T22:15:25.999860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-23T22:15:26.000013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-23T22:15:26.000177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-23T22:15:26.000322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-23T22:15:26.000505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-23T22:15:26.000737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-09-23T22:15:26.000939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-23T22:15:26.001096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-23T22:15:26.001266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-23T22:15:26.001447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-23T22:15:26.001610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-23T22:15:26.001821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-23T22:15:26.002031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-23T22:15:26.002192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-23T22:15:26.002366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-23T22:15:26.002530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-23T22:15:26.002732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-23T22:15:26.002891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-23T22:15:26.003038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-23T22:15:26.003230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-23T22:15:26.003407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-23T22:15:26.003630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-23T22:15:26.003952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-23T22:15:26.004134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-23T22:15:26.004330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-23T22:15:26.004564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-23T22:15:26.004743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-23T22:15:26.004900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-23T22:15:26.005079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-23T22:15:26.005280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-23T22:15:26.005462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-23T22:15:26.005670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-23T22:15:26.005889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-23T22:15:26.006047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-23T22:15:26.006227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-23T22:15:26.006419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-23T22:15:26.006611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-23T22:15:26.006788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-23T22:15:26.006998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-23T22:15:26.007184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-23T22:15:26.007359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-23T22:15:26.007610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-23T22:15:26.007767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-23T22:15:26.007968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-23T22:15:26.008159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-23T22:15:26.008333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-23T22:15:26.008541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-23T22:15:26.008844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-23T22:15:26.009012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-23T22:15:26.009157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-23T22:15:26.009326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-23T22:15:26.009521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-23T22:15:26.009710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-23T22:15:26.009890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-23T22:15:26.010068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-23T22:15:26.010253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-23T22:15:26.010411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-23T22:15:26.010583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-23T22:15:26.010819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-23T22:15:26.010992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-23T22:15:26.011153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-23T22:15:26.011302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-23T22:15:26.011476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-23T22:15:26.011631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-23T22:15:26.011932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-23T22:15:26.012113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-23T22:15:26.012299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-23T22:15:26.012455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-23T22:15:26.012639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-23T22:15:26.012956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-23T22:15:26.013212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-23T22:15:26.013431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-23T22:15:26.013633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-23T22:15:26.013859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-23T22:15:26.014029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-23T22:15:26.014318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-23T22:15:26.014482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-23T22:15:26.014692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-23T22:15:26.014886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-23T22:15:26.015037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-23T22:15:26.015233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-23T22:15:26.015399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-23T22:15:26.015578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-23T22:15:26.015772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-23T22:15:26.015944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-23T22:15:26.016119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-23T22:15:26.016267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-23T22:15:26.016434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-23T22:15:26.016601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-23T22:15:26.016837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-23T22:15:26.017041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-23T22:15:26.017201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-23T22:15:26.017371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-23T22:15:26.017529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-23T22:15:26.017712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-23T22:15:26.017870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-23T22:15:26.018044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-23T22:15:26.018200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-23T22:15:26.018354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-23T22:15:26.018544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-23T22:15:26.018753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-23T22:15:26.019066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-23T22:15:26.019251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-23T22:15:26.019405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-23T22:15:26.019953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-23T22:15:26.020112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-23T22:15:26.020262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-23T22:15:26.020431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-23T22:15:26.020599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-23T22:15:26.020984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-09-23T22:15:26.021138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-23T22:15:26.021303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-23T22:15:26.021459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-23T22:15:26.021598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-23T22:15:26.021783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-23T22:15:26.022141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-23T22:15:26.022304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-23T22:15:26.022452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-23T22:15:26.022620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-23T22:15:26.022889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-23T22:15:26.023051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-23T22:15:26.023239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-23T22:15:26.023431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-23T22:15:26.023604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-23T22:15:26.023792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-23T22:15:26.024008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-23T22:15:26.024161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-23T22:15:26.024332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-23T22:15:26.024483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-23T22:15:26.024666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-23T22:15:26.024828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-23T22:15:26.024999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-23T22:15:26.025172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-23T22:15:26.025337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-23T22:15:26.025511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-23T22:15:26.025674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-23T22:15:26.026030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-23T22:15:26.026206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-23T22:15:26.026335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-23T22:15:26.026493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-23T22:15:26.026684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-23T22:15:26.027048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-23T22:15:26.027200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-23T22:15:26.027404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-23T22:15:26.027588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-23T22:15:26.028145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-23T22:15:26.028348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-23T22:15:26.028538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-23T22:15:26.028941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-23T22:15:26.029154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-23T22:15:26.029420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-23T22:15:26.029571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-23T22:15:26.029860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-23T22:15:26.030025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-23T22:15:26.030185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-23T22:15:26.030336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-23T22:15:26.030493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-23T22:15:26.030670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-23T22:15:26.031034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-23T22:15:26.031175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-23T22:15:26.031362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-23T22:15:26.031526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-23T22:15:26.031709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-23T22:15:26.032013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-23T22:15:26.032181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-23T22:15:26.032333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-23T22:15:26.032541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-23T22:15:26.032711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-23T22:15:26.032860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-23T22:15:26.033033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-23T22:15:26.033210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-23T22:15:26.033403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-23T22:15:26.033598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-23T22:15:26.033775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-23T22:15:26.033938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-23T22:15:26.034091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-23T22:15:26.034245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-23T22:15:26.034407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-23T22:15:26.034580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-23T22:15:26.034772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-23T22:15:26.034924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-23T22:15:26.035095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-23T22:15:26.035405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-23T22:15:26.035605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-23T22:15:26.035941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-23T22:15:26.036092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-23T22:15:26.036239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-23T22:15:26.036386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-23T22:15:26.036533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-23T22:15:26.036752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-23T22:15:26.036942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-23T22:15:26.037118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-23T22:15:26.037288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-23T22:15:26.037454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-23T22:15:26.037604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-23T22:15:26.037779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-23T22:15:26.037988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-23T22:15:26.038131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-23T22:15:26.038271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-23T22:15:26.038437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-23T22:15:26.038600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-23T22:15:26.038781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-23T22:15:26.039026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-23T22:15:26.039171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-23T22:15:26.039303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-23T22:15:26.039504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-23T22:15:26.039676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-23T22:15:26.039851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-23T22:15:26.040010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-23T22:15:26.040214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-23T22:15:26.040402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-23T22:15:26.040608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-23T22:15:26.040803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-23T22:15:26.040944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-23T22:15:26.041098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-23T22:15:26.041286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-23T22:15:26.041445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-23T22:15:26.041662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-23T22:15:26.041846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-23T22:15:26.042005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-23T22:15:26.042165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-23T22:15:26.042340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-23T22:15:26.042535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-23T22:15:26.042706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-23T22:15:26.042885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-23T22:15:26.043057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-23T22:15:26.043226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-23T22:15:26.043396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-23T22:15:26.043539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-23T22:15:26.043798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-23T22:15:26.043963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-23T22:15:26.044157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-23T22:15:26.044440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-23T22:15:26.044584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-23T22:15:26.044774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-23T22:15:26.044924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-23T22:15:26.045068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-23T22:15:26.045340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-23T22:15:26.045515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-23T22:15:26.045703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-23T22:15:26.045873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-23T22:15:26.046017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-23T22:15:26.046171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-23T22:15:26.046368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-23T22:15:26.046512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-23T22:15:26.046719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-23T22:15:26.046897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-23T22:15:26.047065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-23T22:15:26.047229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-23T22:15:26.047433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-23T22:15:26.047585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-23T22:15:26.047797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-23T22:15:26.047959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-23T22:15:26.048113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-23T22:15:26.048247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-23T22:15:26.048391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-23T22:15:26.048552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-23T22:15:26.048711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-23T22:15:26.048875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-23T22:15:26.049039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-23T22:15:26.049260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-23T22:15:26.049399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-23T22:15:26.049545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-23T22:15:26.049755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-23T22:15:26.049924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-23T22:15:26.050098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-23T22:15:26.050306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-23T22:15:26.050467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-23T22:15:26.050717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-23T22:15:26.050868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-23T22:15:26.051040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-23T22:15:26.051187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-23T22:15:26.051340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-23T22:15:26.051491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-23T22:15:26.051634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-23T22:15:26.051987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-23T22:15:26.052198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-23T22:15:26.052349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-23T22:15:26.052498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-23T22:15:26.052673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-23T22:15:26.052840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-23T22:15:26.053011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-23T22:15:26.053183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-23T22:15:26.053352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-23T22:15:26.053499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-23T22:15:26.053633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-23T22:15:26.053800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-23T22:15:26.053925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-23T22:15:26.054060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-23T22:15:26.054228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-23T22:15:26.054420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-23T22:15:26.054804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-23T22:15:26.054984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-23T22:15:26.055123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-23T22:15:26.055300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-23T22:15:26.055448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-23T22:15:26.055620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-23T22:15:26.055817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-23T22:15:26.055995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-23T22:15:26.056146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-23T22:15:26.056313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-23T22:15:26.056483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-23T22:15:26.056665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-23T22:15:26.056835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-23T22:15:26.056982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-23T22:15:26.057137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-23T22:15:26.057317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-23T22:15:26.057530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-23T22:15:26.057753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-23T22:15:26.057929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-23T22:15:26.058070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-23T22:15:26.058250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-23T22:15:26.058403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-23T22:15:26.058576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-23T22:15:26.058743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-23T22:15:26.058894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-23T22:15:26.059050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-23T22:15:26.059195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-23T22:15:26.059337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-23T22:15:26.059511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-23T22:15:26.059829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-23T22:15:26.059982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-23T22:15:26.060142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-23T22:15:26.060302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-23T22:15:26.060476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-23T22:15:26.060659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-23T22:15:26.060820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-23T22:15:26.060976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-23T22:15:26.061155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-23T22:15:26.061314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-23T22:15:26.061488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-23T22:15:26.061668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-23T22:15:26.061832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-23T22:15:26.061969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-23T22:15:26.062164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-23T22:15:26.062295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-23T22:15:26.062483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-23T22:15:26.062745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-23T22:15:26.062925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-23T22:15:26.063077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-23T22:15:26.063239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-23T22:15:26.063390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-23T22:15:26.063566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-23T22:15:26.063741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-23T22:15:26.063903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-23T22:15:26.064036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-23T22:15:26.064188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-23T22:15:26.064354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-23T22:15:26.064499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-23T22:15:26.064687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-23T22:15:26.064880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-23T22:15:26.065087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-23T22:15:26.065247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-23T22:15:26.065415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-23T22:15:26.065569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-23T22:15:26.065803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-23T22:15:26.066088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-23T22:15:26.066232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-23T22:15:26.066382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-23T22:15:26.066561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-23T22:15:26.066741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-23T22:15:26.066917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-23T22:15:26.067040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-23T22:15:26.067169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-23T22:15:26.067326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-23T22:15:26.067474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-23T22:15:26.067811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-23T22:15:26.067956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-23T22:15:26.068123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-23T22:15:26.068307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-23T22:15:26.068512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-23T22:15:26.068689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-23T22:15:26.068829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-23T22:15:26.068974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-23T22:15:26.069136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-23T22:15:26.069335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-23T22:15:26.069503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-23T22:15:26.069716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-23T22:15:26.069844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-23T22:15:26.070203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-23T22:15:26.070372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-23T22:15:26.070515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-23T22:15:26.070697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-23T22:15:26.070849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-23T22:15:26.071023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-23T22:15:26.071166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-23T22:15:26.071328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-23T22:15:26.071494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-23T22:15:26.071659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-23T22:15:26.071832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-23T22:15:26.071969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-23T22:15:26.072117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-23T22:15:26.072252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-23T22:15:26.072398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-23T22:15:26.072596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-23T22:15:26.072792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-23T22:15:26.072956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-23T22:15:26.073092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-23T22:15:26.073239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-23T22:15:26.073390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-23T22:15:26.073536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-23T22:15:26.073906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-23T22:15:26.074066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-23T22:15:26.074232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-23T22:15:26.074377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-23T22:15:26.074567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-23T22:15:26.074734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-23T22:15:26.074908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-23T22:15:26.075068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-23T22:15:26.075213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-23T22:15:26.075370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-23T22:15:26.075520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-23T22:15:26.075847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-23T22:15:26.076033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-23T22:15:26.076189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-23T22:15:26.076341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-23T22:15:26.076478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-23T22:15:26.076636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-23T22:15:26.076812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-23T22:15:26.076934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-23T22:15:26.077090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-23T22:15:26.077246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-23T22:15:26.077396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-23T22:15:26.077555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-23T22:15:26.077723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-23T22:15:26.077879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-23T22:15:26.078021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-23T22:15:26.078160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-23T22:15:26.078298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-23T22:15:26.078460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-23T22:15:26.078632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-23T22:15:26.078804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-23T22:15:26.079068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-23T22:15:26.079257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-23T22:15:26.079412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-23T22:15:26.079568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-23T22:15:26.079763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-23T22:15:26.079915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-23T22:15:26.080066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-23T22:15:26.080228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-23T22:15:26.080524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-23T22:15:26.080710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-23T22:15:26.080852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-23T22:15:26.081037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-23T22:15:26.081183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-23T22:15:26.081356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-23T22:15:26.081522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-23T22:15:26.081738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-23T22:15:26.081921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-23T22:15:26.082068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-23T22:15:26.082216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-23T22:15:26.082389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-23T22:15:26.082543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-23T22:15:26.082715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-23T22:15:26.082857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-23T22:15:26.082971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-23T22:15:26.083113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-23T22:15:26.083255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-23T22:15:26.083413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-23T22:15:26.083571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-23T22:15:26.083827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-23T22:15:26.083990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-23T22:15:26.084127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-23T22:15:26.084278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-23T22:15:26.084430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-23T22:15:26.084718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-23T22:15:26.084878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-23T22:15:26.085005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-23T22:15:26.085172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-23T22:15:26.085336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-23T22:15:26.085484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-23T22:15:26.085675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-23T22:15:26.085850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-23T22:15:26.086012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-23T22:15:26.086144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-23T22:15:26.086299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-23T22:15:26.086473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-23T22:15:26.086618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-23T22:15:26.086847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-23T22:15:26.087023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-23T22:15:26.087202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-23T22:15:26.087350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-23T22:15:26.087486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-23T22:15:26.087619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-23T22:15:26.087787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-23T22:15:26.087937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-23T22:15:26.088085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-23T22:15:26.088257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-23T22:15:26.088416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-23T22:15:26.088580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-23T22:15:26.088738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-23T22:15:26.088889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-23T22:15:26.089118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-23T22:15:26.089264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-23T22:15:26.089411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-23T22:15:26.089554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-23T22:15:26.089733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-23T22:15:26.089876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-23T22:15:26.090025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-23T22:15:26.090169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-23T22:15:26.090305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-23T22:15:26.090467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-23T22:15:26.090605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-23T22:15:26.090783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-23T22:15:26.090919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-23T22:15:26.091059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-23T22:15:26.091195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-23T22:15:26.091362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-23T22:15:26.091521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-23T22:15:26.091756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-23T22:15:26.091916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-09-23T22:15:26.092073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-23T22:15:26.092211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-23T22:15:26.092360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-23T22:15:26.092506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-23T22:15:26.092633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-23T22:15:26.092799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-23T22:15:26.092954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-23T22:15:26.093223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-23T22:15:26.093402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-23T22:15:26.093524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-23T22:15:26.093667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-23T22:15:26.093816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-23T22:15:26.093959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-23T22:15:26.094099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-23T22:15:26.094259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-23T22:15:26.094404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-23T22:15:26.094587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-23T22:15:26.094760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-23T22:15:26.094918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-23T22:15:26.095096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-23T22:15:26.095257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-23T22:15:26.095394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-23T22:15:26.095559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-23T22:15:26.095714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-23T22:15:26.095885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-23T22:15:26.096033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-23T22:15:26.096165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-23T22:15:26.096329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-23T22:15:26.096476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-23T22:15:26.096629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-23T22:15:26.096812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-23T22:15:26.096946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-23T22:15:26.097090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-23T22:15:26.097222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-23T22:15:26.097346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-23T22:15:26.097495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-23T22:15:26.097710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-23T22:15:26.097846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-23T22:15:26.097988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-23T22:15:26.098138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-23T22:15:26.098278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-23T22:15:26.098425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-23T22:15:26.098550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-23T22:15:26.098729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-23T22:15:26.098872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-23T22:15:26.099028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-23T22:15:26.099184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-23T22:15:26.099321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-23T22:15:26.099470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-23T22:15:26.099612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-23T22:15:26.099870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-23T22:15:26.100027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-23T22:15:26.100190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-23T22:15:26.100331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-23T22:15:26.100506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-23T22:15:26.100679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-23T22:15:26.100857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-23T22:15:26.100992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-23T22:15:26.101142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-23T22:15:26.101290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-23T22:15:26.101438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-23T22:15:26.101584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-23T22:15:26.101761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-23T22:15:26.101911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-23T22:15:26.102046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-23T22:15:26.102202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-23T22:15:26.102346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-23T22:15:26.102485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-23T22:15:26.102638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-23T22:15:26.102836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-23T22:15:26.103016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-23T22:15:26.103177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-23T22:15:26.103336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-23T22:15:26.103473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-23T22:15:26.103627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-23T22:15:26.103793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-23T22:15:26.104021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-23T22:15:26.104175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-23T22:15:26.104296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-23T22:15:26.104434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-23T22:15:26.104584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-23T22:15:26.104754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-23T22:15:26.104913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-23T22:15:26.105072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-23T22:15:26.105213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-23T22:15:26.105369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-23T22:15:26.105532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-23T22:15:26.105696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-23T22:15:26.105859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-23T22:15:26.106000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-23T22:15:26.106149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-23T22:15:26.106293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-23T22:15:26.106439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-23T22:15:26.106618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-23T22:15:26.106802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-23T22:15:26.106934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-23T22:15:26.107087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-23T22:15:26.107252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-23T22:15:26.107399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-23T22:15:26.107548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-23T22:15:26.107788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-23T22:15:26.107944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-23T22:15:26.108089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-23T22:15:26.108243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-23T22:15:26.108400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-23T22:15:26.108558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-23T22:15:26.108954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-23T22:15:26.109127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-23T22:15:26.109256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-23T22:15:26.109447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-23T22:15:26.109607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-23T22:15:26.109780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-23T22:15:26.109941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-23T22:15:26.110109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-23T22:15:26.110265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-23T22:15:26.110431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-23T22:15:26.110706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-23T22:15:26.110857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-23T22:15:26.111021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-23T22:15:26.111181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-23T22:15:26.111328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-23T22:15:26.111495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-23T22:15:26.111614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-23T22:15:26.111778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-23T22:15:26.111901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-23T22:15:26.112027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-23T22:15:26.112180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-23T22:15:26.112363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-23T22:15:26.112488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-23T22:15:26.112632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-23T22:15:26.112836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-23T22:15:26.113018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-23T22:15:26.113178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-23T22:15:26.113316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-23T22:15:26.113474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-23T22:15:26.113627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-23T22:15:26.113836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-23T22:15:26.113973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-23T22:15:26.114119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-23T22:15:26.114275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-23T22:15:26.114398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-23T22:15:26.114609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-23T22:15:26.114802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-23T22:15:26.114948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-23T22:15:26.115098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-23T22:15:26.115244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-23T22:15:26.115393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-23T22:15:26.115538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-23T22:15:26.115824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-23T22:15:26.115989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-23T22:15:26.116133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-23T22:15:26.116274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-23T22:15:26.116417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-23T22:15:26.116597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-23T22:15:26.116814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-23T22:15:26.117014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-23T22:15:26.117156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-23T22:15:26.117283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-23T22:15:26.117394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-23T22:15:26.117535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-23T22:15:26.117714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-23T22:15:26.117848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-23T22:15:26.117975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-23T22:15:26.118099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-23T22:15:26.118199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-23T22:15:26.118331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-23T22:15:26.118470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-23T22:15:26.118629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-23T22:15:26.118803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-23T22:15:26.118952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-23T22:15:26.119067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-23T22:15:26.119218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-23T22:15:26.119393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-23T22:15:26.119539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-23T22:15:26.119710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-23T22:15:26.119877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-23T22:15:26.120117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-23T22:15:26.120277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-23T22:15:26.120432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-23T22:15:26.120576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-23T22:15:26.120732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-23T22:15:26.120853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-23T22:15:26.120980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-23T22:15:26.121154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-23T22:15:26.121324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-23T22:15:26.121475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-23T22:15:26.121612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-23T22:15:26.121809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-23T22:15:26.121966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-23T22:15:26.122224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-23T22:15:26.122362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-23T22:15:26.122523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-23T22:15:26.122674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-23T22:15:26.122831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-23T22:15:26.122984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-23T22:15:26.123127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-23T22:15:26.123241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-23T22:15:26.123375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-23T22:15:26.123528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-23T22:15:26.123928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-23T22:15:26.124057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-23T22:15:26.124187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-23T22:15:26.124346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-23T22:15:26.124485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-23T22:15:26.124638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-23T22:15:26.124818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-23T22:15:26.124952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-23T22:15:26.125133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-23T22:15:26.125273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-23T22:15:26.125402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-23T22:15:26.125665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-23T22:15:26.125828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-23T22:15:26.125974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-23T22:15:26.126095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-23T22:15:26.126223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-23T22:15:26.126386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-23T22:15:26.126525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-23T22:15:26.126692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-23T22:15:26.126841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-23T22:15:26.126970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-23T22:15:26.127104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-23T22:15:26.127225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-23T22:15:26.127386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-23T22:15:26.127530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-23T22:15:26.127676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-23T22:15:26.127824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-23T22:15:26.127975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-23T22:15:26.128117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-23T22:15:26.128278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-23T22:15:26.128429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-23T22:15:26.128604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-23T22:15:26.128766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-23T22:15:26.128904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-23T22:15:26.129031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-23T22:15:26.129132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-23T22:15:26.129279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-23T22:15:26.129421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-23T22:15:26.129563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-23T22:15:26.129938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-23T22:15:26.130099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-23T22:15:26.130241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-23T22:15:26.130452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-23T22:15:26.130602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-23T22:15:26.130767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-23T22:15:26.130927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-23T22:15:26.131095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-23T22:15:26.131244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-23T22:15:26.131402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-23T22:15:26.131554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-23T22:15:26.131893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-23T22:15:26.132060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-23T22:15:26.132219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-23T22:15:26.132348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-23T22:15:26.132493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-23T22:15:26.132631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-23T22:15:26.132801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-23T22:15:26.132966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-23T22:15:26.133134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-23T22:15:26.133273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-23T22:15:26.133425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-23T22:15:26.133624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-23T22:15:26.133795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-23T22:15:26.133922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-23T22:15:26.134067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-23T22:15:26.134196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-23T22:15:26.134314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-23T22:15:26.134458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-23T22:15:26.134603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-23T22:15:26.134788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-23T22:15:26.134972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-23T22:15:26.135127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-23T22:15:26.135279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-23T22:15:26.135425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-23T22:15:26.135624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-23T22:15:26.135844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-23T22:15:26.135981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-23T22:15:26.136121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-23T22:15:26.136269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-23T22:15:26.136414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-23T22:15:26.136585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-23T22:15:26.136779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-23T22:15:26.136930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-23T22:15:26.137072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-23T22:15:26.137209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-23T22:15:26.137399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-23T22:15:26.137553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-23T22:15:26.137714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-23T22:15:26.137865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-23T22:15:26.137989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-23T22:15:26.138106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-23T22:15:26.138249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-23T22:15:26.138378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-23T22:15:26.138494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-23T22:15:26.138852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-23T22:15:26.139011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-23T22:15:26.139139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-23T22:15:26.139257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-23T22:15:26.139428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-23T22:15:26.139563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-23T22:15:26.139858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-23T22:15:26.140038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-23T22:15:26.140189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-23T22:15:26.140316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-23T22:15:26.140442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-23T22:15:26.140611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-23T22:15:26.140773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-23T22:15:26.140913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-23T22:15:26.141088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-23T22:15:26.141229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-23T22:15:26.141419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-23T22:15:26.141605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-23T22:15:26.141822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-23T22:15:26.142061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-23T22:15:26.142253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-23T22:15:26.142384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-23T22:15:26.142499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-23T22:15:26.142638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-23T22:15:26.142838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-23T22:15:26.142987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-23T22:15:26.143125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-23T22:15:26.143315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-23T22:15:26.143473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-23T22:15:26.143659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-23T22:15:26.143835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-23T22:15:26.144012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-23T22:15:26.144171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-23T22:15:26.144327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-23T22:15:26.144489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-23T22:15:26.144696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-23T22:15:26.145023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-23T22:15:26.145209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-23T22:15:26.145579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-23T22:15:26.145746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-23T22:15:26.145931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-23T22:15:26.146086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-23T22:15:26.146234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-23T22:15:26.146380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-23T22:15:26.146540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-23T22:15:26.146767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-23T22:15:26.146971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-23T22:15:26.147145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-23T22:15:26.147283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-23T22:15:26.147837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-23T22:15:26.148005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-23T22:15:26.148148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-23T22:15:26.148324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-23T22:15:26.148513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-23T22:15:26.148673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-23T22:15:26.148838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-23T22:15:26.148984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-23T22:15:26.149202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-23T22:15:26.149383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-23T22:15:26.149549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-23T22:15:26.149710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-23T22:15:26.150142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-23T22:15:26.150331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-23T22:15:26.150498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-23T22:15:26.150629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-23T22:15:26.150865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-23T22:15:26.151044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-23T22:15:26.151253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-23T22:15:26.151407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-23T22:15:26.151594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-23T22:15:26.151802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-23T22:15:26.151966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-23T22:15:26.152115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-23T22:15:26.152273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-23T22:15:26.152404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-23T22:15:26.152576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-23T22:15:26.152754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-23T22:15:26.152932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-23T22:15:26.153082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-23T22:15:26.153236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-23T22:15:26.153388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-23T22:15:26.153552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-23T22:15:26.153739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-23T22:15:26.153893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-23T22:15:26.154044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-23T22:15:26.154170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-23T22:15:26.154273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-23T22:15:26.154375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-23T22:15:26.154530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-23T22:15:26.154718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-23T22:15:26.154888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-23T22:15:26.155029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-23T22:15:26.155154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-23T22:15:26.155276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-23T22:15:26.155443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-23T22:15:26.155605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-23T22:15:26.155991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-23T22:15:26.156143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-23T22:15:26.156312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-23T22:15:26.156443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-23T22:15:26.156618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-23T22:15:26.156830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-23T22:15:26.156960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-23T22:15:26.157063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-23T22:15:26.157233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-23T22:15:26.157442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-23T22:15:26.157591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-23T22:15:26.157763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-23T22:15:26.157939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-23T22:15:26.158084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-23T22:15:26.158228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-23T22:15:26.158385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-23T22:15:26.158534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-23T22:15:26.158720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-23T22:15:26.158889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-23T22:15:26.159066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-23T22:15:26.159200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-23T22:15:26.159456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-23T22:15:26.159630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-23T22:15:26.159801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-23T22:15:26.159965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-23T22:15:26.160148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-23T22:15:26.160301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-23T22:15:26.160429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-23T22:15:26.160550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-23T22:15:26.160714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-23T22:15:26.160859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-23T22:15:26.161029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-23T22:15:26.161222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-23T22:15:26.161390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-23T22:15:26.161561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-23T22:15:26.161721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-23T22:15:26.161868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-23T22:15:26.162019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-23T22:15:26.162172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-23T22:15:26.162335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-23T22:15:26.162483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-23T22:15:26.162622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-23T22:15:26.162821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-23T22:15:26.162961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-23T22:15:26.163239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-23T22:15:26.163393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-23T22:15:26.163548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-23T22:15:26.163834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-23T22:15:26.164002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-23T22:15:26.164150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-23T22:15:26.164290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-23T22:15:26.164442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-23T22:15:26.164602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-23T22:15:26.164763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-23T22:15:26.164913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-23T22:15:26.165058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-23T22:15:26.165211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-23T22:15:26.165375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-23T22:15:26.165716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-23T22:15:26.165898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-23T22:15:26.166031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-23T22:15:26.166199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-23T22:15:26.166323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-23T22:15:26.166460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-23T22:15:26.166628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-23T22:15:26.166808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-23T22:15:26.166953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-23T22:15:26.167103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-23T22:15:26.167246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-23T22:15:26.167389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-23T22:15:26.167522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-23T22:15:26.167706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-23T22:15:26.167860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-23T22:15:26.168029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-23T22:15:26.168178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-23T22:15:26.168319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-23T22:15:26.168499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-23T22:15:26.168678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-23T22:15:26.168844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-23T22:15:26.168975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-23T22:15:26.169098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-23T22:15:26.169271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-23T22:15:26.169421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-23T22:15:26.169539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-23T22:15:26.169696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-23T22:15:26.169856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-23T22:15:26.170105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-23T22:15:26.170265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-23T22:15:26.170414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-23T22:15:26.170563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-23T22:15:26.170745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-23T22:15:26.170958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-23T22:15:26.171109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-23T22:15:26.171261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-23T22:15:26.171540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-23T22:15:26.171836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-23T22:15:26.171988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-23T22:15:26.172184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-23T22:15:26.172327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-23T22:15:26.172476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-23T22:15:26.172616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-23T22:15:26.172790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-23T22:15:26.172910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-23T22:15:26.173052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-23T22:15:26.173204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-23T22:15:26.173371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-23T22:15:26.173514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-23T22:15:26.173635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-23T22:15:26.173784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-23T22:15:26.173906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-23T22:15:26.174048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-23T22:15:26.174202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-23T22:15:26.174372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-23T22:15:26.174520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-23T22:15:26.174637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-23T22:15:26.174828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-23T22:15:26.174973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-23T22:15:26.175129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-23T22:15:26.175279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-23T22:15:26.175420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-23T22:15:26.175567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-23T22:15:26.175743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-23T22:15:26.176145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-23T22:15:26.176270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-23T22:15:26.176447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-23T22:15:26.176574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-23T22:15:26.176732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-23T22:15:26.176882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-23T22:15:26.177036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-23T22:15:26.177183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-23T22:15:26.177312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-23T22:15:26.177480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-23T22:15:26.177658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-23T22:15:26.177789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-23T22:15:26.177918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-23T22:15:26.178044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-23T22:15:26.178150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-23T22:15:26.178255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-23T22:15:26.178352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-23T22:15:26.178451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-23T22:15:26.178587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-23T22:15:26.178778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-23T22:15:26.178921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-23T22:15:26.179042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-23T22:15:26.179235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-23T22:15:26.179387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-23T22:15:26.179532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-23T22:15:26.179850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-23T22:15:26.179984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-23T22:15:26.180112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-23T22:15:26.180237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-23T22:15:26.180347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-23T22:15:26.180498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-23T22:15:26.180669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-23T22:15:26.180822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-23T22:15:26.180965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-23T22:15:26.181114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-23T22:15:26.181237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-23T22:15:26.181389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-23T22:15:26.181538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-23T22:15:26.181715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-23T22:15:26.181902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-23T22:15:26.182041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-23T22:15:26.182202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-23T22:15:26.182378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-23T22:15:26.182529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-23T22:15:26.182701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-23T22:15:26.182853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-23T22:15:26.183013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-23T22:15:26.183153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-23T22:15:26.183289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-23T22:15:26.183409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-23T22:15:26.183525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-23T22:15:26.183711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-23T22:15:26.183887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-23T22:15:26.184082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-23T22:15:26.184279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-23T22:15:26.184433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-23T22:15:26.184574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-23T22:15:26.184745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-23T22:15:26.184884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-23T22:15:26.185001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-23T22:15:26.185133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-23T22:15:26.185433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-23T22:15:26.185561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-23T22:15:26.185696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-23T22:15:26.185899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-23T22:15:26.186325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-23T22:15:26.186470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-23T22:15:26.186611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-23T22:15:26.186780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-23T22:15:26.186944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-23T22:15:26.187108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-23T22:15:26.187297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-23T22:15:26.187444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-23T22:15:26.187614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-23T22:15:26.187906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-23T22:15:26.188109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-23T22:15:26.188270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-23T22:15:26.188438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-23T22:15:26.188635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-23T22:15:26.188787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-23T22:15:26.188895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-23T22:15:26.189008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-23T22:15:26.189165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-23T22:15:26.189337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-23T22:15:26.189498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-23T22:15:26.189672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-23T22:15:26.189875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-23T22:15:26.190063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-23T22:15:26.190237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-23T22:15:26.190379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-23T22:15:26.190552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-23T22:15:26.190736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-23T22:15:26.190890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-23T22:15:26.191107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-23T22:15:26.191265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-23T22:15:26.191405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-23T22:15:26.191548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-23T22:15:26.191845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-23T22:15:26.191973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-23T22:15:26.192070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-23T22:15:26.192197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-23T22:15:26.192343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-23T22:15:26.192536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-23T22:15:26.192720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-23T22:15:26.192861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-23T22:15:26.193004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-23T22:15:26.193164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-23T22:15:26.193335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-23T22:15:26.193500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-23T22:15:26.193661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-23T22:15:26.193844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-23T22:15:26.193975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-23T22:15:26.194095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-23T22:15:26.194268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-23T22:15:26.194413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-23T22:15:26.194537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-23T22:15:26.194694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-23T22:15:26.194914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-23T22:15:26.195059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-23T22:15:26.195198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-23T22:15:26.195358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-23T22:15:26.195635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-23T22:15:26.195961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-23T22:15:26.196114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-23T22:15:26.196237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-23T22:15:26.196397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-23T22:15:26.196550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-23T22:15:26.196707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-23T22:15:26.196847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-23T22:15:26.197015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-23T22:15:26.197171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-23T22:15:26.197326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-23T22:15:26.197483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-09-23T22:15:26.197686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-23T22:15:26.197822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-23T22:15:26.197959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-23T22:15:26.198107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-23T22:15:26.198249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-23T22:15:26.198357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-23T22:15:26.198489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-23T22:15:26.198628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-23T22:15:26.198785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-23T22:15:26.198917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-23T22:15:26.199064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-23T22:15:26.199216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-23T22:15:26.199346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-23T22:15:26.199470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-23T22:15:26.199606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-23T22:15:26.199756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-23T22:15:26.200080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-23T22:15:26.200229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-23T22:15:26.200382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-23T22:15:26.200536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-23T22:15:26.200706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-23T22:15:26.200851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-23T22:15:26.201005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-23T22:15:26.201144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-23T22:15:26.201330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-23T22:15:26.201474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-23T22:15:26.201623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-23T22:15:26.201783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-23T22:15:26.201960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-23T22:15:26.202105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-23T22:15:26.202240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-23T22:15:26.202430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-23T22:15:26.202587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-23T22:15:26.202770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-23T22:15:26.202894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-23T22:15:26.203011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-23T22:15:26.203150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-23T22:15:26.203290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-23T22:15:26.203433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-23T22:15:26.203583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-23T22:15:26.203875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-23T22:15:26.204021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-23T22:15:26.204145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-23T22:15:26.204288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-23T22:15:26.204421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-23T22:15:26.204560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-23T22:15:26.204723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-23T22:15:26.204859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-23T22:15:26.205002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-23T22:15:26.205146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-23T22:15:26.205268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-23T22:15:26.205393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-23T22:15:26.205544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-23T22:15:26.205742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-23T22:15:26.205925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-23T22:15:26.206068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-23T22:15:26.206275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-23T22:15:26.206423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-23T22:15:26.206593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-23T22:15:26.206815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-23T22:15:26.207007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-23T22:15:26.207157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-23T22:15:26.207298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-23T22:15:26.207425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-23T22:15:26.207570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-23T22:15:26.207742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-23T22:15:26.207906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-23T22:15:26.208047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-23T22:15:26.208187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-23T22:15:26.208354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-23T22:15:26.208496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-23T22:15:26.208633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-23T22:15:26.209074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-23T22:15:26.209218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-23T22:15:26.209353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-23T22:15:26.209532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-23T22:15:26.209701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-23T22:15:26.209850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-23T22:15:26.209999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-23T22:15:26.210338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-23T22:15:26.210536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-23T22:15:26.210709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-23T22:15:26.210868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-23T22:15:26.211009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-23T22:15:26.211143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-23T22:15:26.211292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-23T22:15:26.211453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-23T22:15:26.211594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-23T22:15:26.211918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-23T22:15:26.212094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-23T22:15:26.212264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-23T22:15:26.212392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-23T22:15:26.212495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-23T22:15:26.212598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-23T22:15:26.212748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-23T22:15:26.212879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-23T22:15:26.213008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-23T22:15:26.213136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-23T22:15:26.213285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-23T22:15:26.213445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-23T22:15:26.213638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-23T22:15:26.213822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-23T22:15:26.214027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-23T22:15:26.214179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-23T22:15:26.214324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-23T22:15:26.214495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-23T22:15:26.214700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-23T22:15:26.214853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-23T22:15:26.214975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-23T22:15:26.215128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-23T22:15:26.215284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-23T22:15:26.215434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-23T22:15:26.215579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-23T22:15:26.216004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-23T22:15:26.216140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-23T22:15:26.216387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-23T22:15:26.216509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-23T22:15:26.216843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-23T22:15:26.216983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-23T22:15:26.217117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-23T22:15:26.217266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-23T22:15:26.217419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-23T22:15:26.217550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-23T22:15:26.217736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-23T22:15:26.217903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-23T22:15:26.218039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-23T22:15:26.218142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-23T22:15:26.218283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-23T22:15:26.218462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-23T22:15:26.218609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-23T22:15:26.218812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-23T22:15:26.218967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-23T22:15:26.219129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-23T22:15:26.219262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-23T22:15:26.219365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-23T22:15:26.219521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-23T22:15:26.219856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-23T22:15:26.220017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-23T22:15:26.220168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-23T22:15:26.220324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-23T22:15:26.220477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-23T22:15:26.220617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-23T22:15:26.220766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-23T22:15:26.220877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-23T22:15:26.221006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-23T22:15:26.221132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-23T22:15:26.221291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-23T22:15:26.221458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-23T22:15:26.221587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-23T22:15:26.221728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-23T22:15:26.221876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHT.csv [2025-09-23T22:15:26.222219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-23T22:15:26.222344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-23T22:15:26.222465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-23T22:15:26.222611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-23T22:15:26.222793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-23T22:15:26.222930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-23T22:15:26.223058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-23T22:15:26.223212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-23T22:15:26.223384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-23T22:15:26.223612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-23T22:15:26.223834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-23T22:15:26.224008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-23T22:15:26.224152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-23T22:15:26.224277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-23T22:15:26.224381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-23T22:15:26.224497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-23T22:15:26.224618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-23T22:15:26.224756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-23T22:15:26.224905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-23T22:15:26.225070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-23T22:15:26.225412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-23T22:15:26.225553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-23T22:15:26.225792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-23T22:15:26.225935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-23T22:15:26.226086] [INFO ] [LOCAL ] Deleted 1988 derivative data files. [2025-09-23T22:15:26.226153] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-23T22:15:26.228415] [INFO ] [LOCAL ] Found 2077 symbols with primary data. [2025-09-23T22:15:26.228902] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2077 symbols [2025-09-23T22:15:26.230057] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:26.230438] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:26.231963] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:26.298346] [DEBUG] [LOCAL ] AAT: Loaded 30651 existing records from primary storage. [2025-09-23T22:15:26.297332] [DEBUG] [LOCAL ] AB: Loaded 28399 existing records from primary storage. [2025-09-23T22:15:26.298576] [INFO ] [MAIN ] AB: Loaded 28399 primary data records. [2025-09-23T22:15:26.298691] [INFO ] [MAIN ] AAT: Loaded 30651 primary data records. [2025-09-23T22:15:26.490838] [DEBUG] [LOCAL ] AA: Loaded 53614 existing records from primary storage. [2025-09-23T22:15:26.511028] [INFO ] [MAIN ] AA: Loaded 53614 primary data records. [2025-09-23T22:15:27.430595] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:27.431144] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:27.432997] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30651 primary records. [2025-09-23T22:15:27.433143] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-23T22:15:27.432331] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 28399 primary records. [2025-09-23T22:15:27.433461] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-23T22:15:27.479914] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:27.481702] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53614 primary records. [2025-09-23T22:15:27.481834] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-23T22:15:27.496684] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-09-23T22:15:27.499461] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-23T22:15:27.501847] [INFO ] [MAIN ] Derivative Progress: 1/2077 symbols completed. AAT took 1.3s. Estimated remaining: 44m 3s. Rate: 47.1 symbols/min [2025-09-23T22:15:27.503079] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-09-23T22:15:27.503014] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:27.499388] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-09-23T22:15:27.503347] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-23T22:15:27.506145] [INFO ] [MAIN ] Derivative Progress: 2/2077 symbols completed. AA took 1.3s. Estimated remaining: 22m 6s. Rate: 93.9 symbols/min [2025-09-23T22:15:27.503456] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-23T22:15:27.509009] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:27.509062] [INFO ] [MAIN ] Derivative Progress: 3/2077 symbols completed. AB took 1.3s. Estimated remaining: 14m 45s. Rate: 140.6 symbols/min [2025-09-23T22:15:27.509525] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:27.545008] [DEBUG] [LOCAL ] ABCB: Loaded 30812 existing records from primary storage. [2025-09-23T22:15:27.545196] [INFO ] [MAIN ] ABCB: Loaded 30812 primary data records. [2025-09-23T22:15:27.809255] [DEBUG] [LOCAL ] ABBV: Loaded 53686 existing records from primary storage. [2025-09-23T22:15:27.930067] [INFO ] [MAIN ] ABBV: Loaded 53686 primary data records. [2025-09-23T22:15:27.931094] [DEBUG] [LOCAL ] ABEV: Loaded 53274 existing records from primary storage. [2025-09-23T22:15:27.936704] [INFO ] [MAIN ] ABEV: Loaded 53274 primary data records. [2025-09-23T22:15:28.608780] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:28.609767] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30812 primary records. [2025-09-23T22:15:28.609939] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-23T22:15:28.633966] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-09-23T22:15:28.635187] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-23T22:15:28.638766] [INFO ] [MAIN ] Derivative Progress: 4/2077 symbols completed. ABCB took 1.1s. Estimated remaining: 20m 49s. Rate: 99.6 symbols/min [2025-09-23T22:15:28.639375] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:28.652280] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:28.653581] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53686 primary records. [2025-09-23T22:15:28.661459] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-23T22:15:28.667295] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:28.668627] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53274 primary records. [2025-09-23T22:15:28.668876] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-23T22:15:28.697102] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-09-23T22:15:28.698031] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-23T22:15:28.704262] [INFO ] [MAIN ] Derivative Progress: 5/2077 symbols completed. ABBV took 1.2s. Estimated remaining: 17m 6s. Rate: 121.2 symbols/min [2025-09-23T22:15:28.705411] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:28.717589] [DEBUG] [LOCAL ] ABG: Loaded 18794 existing records from primary storage. [2025-09-23T22:15:28.718625] [INFO ] [MAIN ] ABG: Loaded 18794 primary data records. [2025-09-23T22:15:28.740807] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-09-23T22:15:28.776524] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-23T22:15:28.805109] [INFO ] [MAIN ] Derivative Progress: 6/2077 symbols completed. ABEV took 1.3s. Estimated remaining: 14m 49s. Rate: 139.7 symbols/min [2025-09-23T22:15:28.835304] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:28.940008] [DEBUG] [LOCAL ] ABM: Loaded 32493 existing records from primary storage. [2025-09-23T22:15:28.940232] [INFO ] [MAIN ] ABM: Loaded 32493 primary data records. [2025-09-23T22:15:29.467003] [DEBUG] [LOCAL ] ABR: Loaded 52103 existing records from primary storage. [2025-09-23T22:15:29.467418] [INFO ] [MAIN ] ABR: Loaded 52103 primary data records. [2025-09-23T22:15:29.609824] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:29.639756] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18794 primary records. [2025-09-23T22:15:29.683692] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-23T22:15:29.853604] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-09-23T22:15:29.854988] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-23T22:15:29.857127] [INFO ] [MAIN ] Derivative Progress: 7/2077 symbols completed. ABG took 1.2s. Estimated remaining: 17m 53s. Rate: 115.7 symbols/min [2025-09-23T22:15:29.857990] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:29.879964] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:29.881058] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32493 primary records. [2025-09-23T22:15:29.881333] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-23T22:15:29.907096] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-09-23T22:15:29.907382] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-23T22:15:29.909253] [INFO ] [MAIN ] Derivative Progress: 8/2077 symbols completed. ABM took 1.2s. Estimated remaining: 15m 52s. Rate: 130.4 symbols/min [2025-09-23T22:15:29.909540] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:29.936288] [DEBUG] [LOCAL ] ACA: Loaded 23871 existing records from primary storage. [2025-09-23T22:15:29.936969] [INFO ] [MAIN ] ACA: Loaded 23871 primary data records. [2025-09-23T22:15:29.936835] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:29.970284] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 52103 primary records. [2025-09-23T22:15:29.995864] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-23T22:15:30.113039] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-09-23T22:15:30.165818] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-23T22:15:30.283586] [INFO ] [MAIN ] Derivative Progress: 9/2077 symbols completed. ABR took 1.5s. Estimated remaining: 15m 32s. Rate: 133.2 symbols/min [2025-09-23T22:15:30.284891] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:30.286468] [DEBUG] [LOCAL ] ACCO: Loaded 37773 existing records from primary storage. [2025-09-23T22:15:30.286799] [INFO ] [MAIN ] ACCO: Loaded 37773 primary data records. [2025-09-23T22:15:30.641198] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:30.643463] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 23871 primary records. [2025-09-23T22:15:30.642612] [DEBUG] [LOCAL ] ACI: Loaded 53272 existing records from primary storage. [2025-09-23T22:15:30.644095] [INFO ] [MAIN ] ACI: Loaded 53272 primary data records. [2025-09-23T22:15:30.644201] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-23T22:15:30.795095] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-09-23T22:15:30.810931] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-23T22:15:30.844132] [INFO ] [MAIN ] Derivative Progress: 10/2077 symbols completed. ACA took 1.0s. Estimated remaining: 15m 54s. Rate: 130.0 symbols/min [2025-09-23T22:15:30.865699] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:31.000069] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:31.001613] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 37773 primary records. [2025-09-23T22:15:31.001861] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-23T22:15:31.021923] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-09-23T22:15:31.022282] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-23T22:15:31.024088] [INFO ] [MAIN ] Derivative Progress: 11/2077 symbols completed. ACCO took 1.1s. Estimated remaining: 15m 1s. Rate: 137.6 symbols/min [2025-09-23T22:15:31.024765] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:31.051608] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:31.052374] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53272 primary records. [2025-09-23T22:15:31.052578] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-23T22:15:31.082089] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-09-23T22:15:31.082841] [DEBUG] [LOCAL ] ACM: Loaded 43154 existing records from primary storage. [2025-09-23T22:15:31.082964] [INFO ] [MAIN ] ACM: Loaded 43154 primary data records. [2025-09-23T22:15:31.082230] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-23T22:15:31.085044] [INFO ] [MAIN ] Derivative Progress: 12/2077 symbols completed. ACI took 0.8s. Estimated remaining: 13m 56s. Rate: 148.3 symbols/min [2025-09-23T22:15:31.090488] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:31.209930] [DEBUG] [LOCAL ] ACR: Loaded 6346 existing records from primary storage. [2025-09-23T22:15:31.220988] [INFO ] [MAIN ] ACR: Loaded 6346 primary data records. [2025-09-23T22:15:31.535839] [DEBUG] [LOCAL ] ACN: Loaded 53424 existing records from primary storage. [2025-09-23T22:15:31.549350] [INFO ] [MAIN ] ACN: Loaded 53424 primary data records. [2025-09-23T22:15:32.102775] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:32.104170] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43154 primary records. [2025-09-23T22:15:32.104420] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-23T22:15:32.126036] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-09-23T22:15:32.126702] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-23T22:15:32.129275] [INFO ] [MAIN ] Derivative Progress: 13/2077 symbols completed. ACM took 1.3s. Estimated remaining: 15m 37s. Rate: 132.2 symbols/min [2025-09-23T22:15:32.143536] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:32.145587] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 6346 primary records. [2025-09-23T22:15:32.145787] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-23T22:15:32.158790] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:32.166864] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53424 primary records. [2025-09-23T22:15:32.169481] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-23T22:15:32.186109] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-09-23T22:15:32.186553] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-23T22:15:32.188564] [INFO ] [MAIN ] Derivative Progress: 14/2077 symbols completed. ACR took 1.1s. Estimated remaining: 14m 38s. Rate: 140.9 symbols/min [2025-09-23T22:15:32.191347] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-09-23T22:15:32.191413] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-23T22:15:32.193832] [INFO ] [MAIN ] Derivative Progress: 15/2077 symbols completed. ACN took 1.2s. Estimated remaining: 13m 40s. Rate: 150.9 symbols/min [2025-09-23T22:15:32.194393] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:32.194667] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:32.194768] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:32.206155] [DEBUG] [LOCAL ] ACV: Loaded 6930 existing records from primary storage. [2025-09-23T22:15:32.206325] [INFO ] [MAIN ] ACV: Loaded 6930 primary data records. [2025-09-23T22:15:32.338085] [DEBUG] [LOCAL ] ACRE: Loaded 33501 existing records from primary storage. [2025-09-23T22:15:32.373387] [INFO ] [MAIN ] ACRE: Loaded 33501 primary data records. [2025-09-23T22:15:32.680508] [DEBUG] [LOCAL ] ACVA: Loaded 49359 existing records from primary storage. [2025-09-23T22:15:32.686489] [INFO ] [MAIN ] ACVA: Loaded 49359 primary data records. [2025-09-23T22:15:33.275405] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:33.276428] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 6930 primary records. [2025-09-23T22:15:33.276736] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-23T22:15:33.310852] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-09-23T22:15:33.311485] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:33.311683] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-23T22:15:33.312598] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33501 primary records. [2025-09-23T22:15:33.315099] [INFO ] [MAIN ] Derivative Progress: 16/2077 symbols completed. ACV took 1.1s. Estimated remaining: 15m 13s. Rate: 135.5 symbols/min [2025-09-23T22:15:33.315834] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-23T22:15:33.315554] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:33.341431] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-09-23T22:15:33.341618] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-23T22:15:33.356277] [INFO ] [MAIN ] Derivative Progress: 17/2077 symbols completed. ACRE took 1.2s. Estimated remaining: 14m 24s. Rate: 143.1 symbols/min [2025-09-23T22:15:33.356778] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:33.357219] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:33.358245] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49359 primary records. [2025-09-23T22:15:33.358586] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-23T22:15:33.374834] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-09-23T22:15:33.374981] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-23T22:15:33.377878] [INFO ] [MAIN ] Derivative Progress: 18/2077 symbols completed. ACVA took 1.2s. Estimated remaining: 13m 38s. Rate: 151.1 symbols/min [2025-09-23T22:15:33.378253] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:33.427310] [DEBUG] [LOCAL ] ADC: Loaded 46374 existing records from primary storage. [2025-09-23T22:15:33.427606] [INFO ] [MAIN ] ADC: Loaded 46374 primary data records. [2025-09-23T22:15:33.543413] [DEBUG] [LOCAL ] ADCT: Loaded 33951 existing records from primary storage. [2025-09-23T22:15:33.549546] [INFO ] [MAIN ] ADCT: Loaded 33951 primary data records. [2025-09-23T22:15:33.882220] [DEBUG] [LOCAL ] ADM: Loaded 53397 existing records from primary storage. [2025-09-23T22:15:33.893449] [INFO ] [MAIN ] ADM: Loaded 53397 primary data records. [2025-09-23T22:15:34.438013] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:34.439311] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46374 primary records. [2025-09-23T22:15:34.439808] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-23T22:15:34.477148] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-09-23T22:15:34.477795] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-23T22:15:34.480360] [INFO ] [MAIN ] Derivative Progress: 19/2077 symbols completed. ADC took 1.2s. Estimated remaining: 14m 54s. Rate: 138.2 symbols/min [2025-09-23T22:15:34.478051] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:34.482072] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:34.481964] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 33951 primary records. [2025-09-23T22:15:34.482299] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-23T22:15:34.502755] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-09-23T22:15:34.502895] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-23T22:15:34.504995] [INFO ] [MAIN ] Derivative Progress: 20/2077 symbols completed. ADCT took 1.1s. Estimated remaining: 14m 11s. Rate: 145.0 symbols/min [2025-09-23T22:15:34.513022] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:34.518379] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:34.519575] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53397 primary records. [2025-09-23T22:15:34.519792] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-23T22:15:34.542993] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-09-23T22:15:34.543152] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-23T22:15:34.546265] [INFO ] [MAIN ] Derivative Progress: 21/2077 symbols completed. ADM took 1.2s. Estimated remaining: 13m 34s. Rate: 151.5 symbols/min [2025-09-23T22:15:34.554841] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:34.559355] [DEBUG] [LOCAL ] AEFC: Loaded 8595 existing records from primary storage. [2025-09-23T22:15:34.559530] [INFO ] [MAIN ] AEFC: Loaded 8595 primary data records. [2025-09-23T22:15:34.616298] [DEBUG] [LOCAL ] ADX: Loaded 27857 existing records from primary storage. [2025-09-23T22:15:34.629697] [INFO ] [MAIN ] ADX: Loaded 27857 primary data records. [2025-09-23T22:15:35.240968] [DEBUG] [LOCAL ] AEM: Loaded 53465 existing records from primary storage. [2025-09-23T22:15:35.243187] [INFO ] [MAIN ] AEM: Loaded 53465 primary data records. [2025-09-23T22:15:35.624208] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:35.625252] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8595 primary records. [2025-09-23T22:15:35.625529] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-23T22:15:35.646487] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-09-23T22:15:35.647611] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-23T22:15:35.649976] [INFO ] [MAIN ] Derivative Progress: 22/2077 symbols completed. AEFC took 1.1s. Estimated remaining: 14m 40s. Rate: 140.1 symbols/min [2025-09-23T22:15:35.663327] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:35.664828] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:35.665885] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27857 primary records. [2025-09-23T22:15:35.666183] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-23T22:15:35.684745] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-09-23T22:15:35.685057] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-23T22:15:35.687159] [INFO ] [MAIN ] Derivative Progress: 23/2077 symbols completed. ADX took 1.2s. Estimated remaining: 14m 5s. Rate: 145.9 symbols/min [2025-09-23T22:15:35.687537] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:35.704324] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:35.705235] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53465 primary records. [2025-09-23T22:15:35.705390] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-23T22:15:35.723096] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-09-23T22:15:35.723222] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-23T22:15:35.725944] [INFO ] [MAIN ] Derivative Progress: 24/2077 symbols completed. AEM took 1.2s. Estimated remaining: 13m 32s. Rate: 151.6 symbols/min [2025-09-23T22:15:35.726265] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:35.800441] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-09-23T22:15:35.801246] [INFO ] [MAIN ] AEO: Loaded 53557 primary data records. [2025-09-23T22:15:35.853960] [DEBUG] [LOCAL ] AER: Loaded 48687 existing records from primary storage. [2025-09-23T22:15:35.898861] [INFO ] [MAIN ] AER: Loaded 48687 primary data records. [2025-09-23T22:15:36.002842] [DEBUG] [LOCAL ] AES: Loaded 53672 existing records from primary storage. [2025-09-23T22:15:36.022189] [INFO ] [MAIN ] AES: Loaded 53672 primary data records. [2025-09-23T22:15:36.809826] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:36.810690] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53557 primary records. [2025-09-23T22:15:36.810884] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-23T22:15:36.831007] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-09-23T22:15:36.831172] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-23T22:15:36.833079] [INFO ] [MAIN ] Derivative Progress: 25/2077 symbols completed. AEO took 1.2s. Estimated remaining: 14m 30s. Rate: 141.4 symbols/min [2025-09-23T22:15:36.833554] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:36.851141] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:36.852943] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53672 primary records. [2025-09-23T22:15:36.854474] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-23T22:15:36.876884] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:36.880414] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48687 primary records. [2025-09-23T22:15:36.880739] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-23T22:15:36.898621] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-09-23T22:15:36.898845] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-23T22:15:36.901419] [INFO ] [MAIN ] Derivative Progress: 26/2077 symbols completed. AES took 1.2s. Estimated remaining: 14m 2s. Rate: 146.2 symbols/min [2025-09-23T22:15:36.902163] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:36.905483] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-09-23T22:15:36.905554] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-23T22:15:36.909229] [INFO ] [MAIN ] Derivative Progress: 27/2077 symbols completed. AER took 1.2s. Estimated remaining: 13m 31s. Rate: 151.7 symbols/min [2025-09-23T22:15:36.909615] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:36.920954] [DEBUG] [LOCAL ] AFB: Loaded 11406 existing records from primary storage. [2025-09-23T22:15:36.921091] [INFO ] [MAIN ] AFB: Loaded 11406 primary data records. [2025-09-23T22:15:37.118191] [DEBUG] [LOCAL ] AESI: Loaded 49508 existing records from primary storage. [2025-09-23T22:15:37.258489] [INFO ] [MAIN ] AESI: Loaded 49508 primary data records. [2025-09-23T22:15:37.267110] [DEBUG] [LOCAL ] AFG: Loaded 32602 existing records from primary storage. [2025-09-23T22:15:37.267450] [INFO ] [MAIN ] AFG: Loaded 32602 primary data records. [2025-09-23T22:15:37.942594] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:37.943563] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11406 primary records. [2025-09-23T22:15:37.943723] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-23T22:15:37.962523] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-09-23T22:15:37.962697] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-23T22:15:37.964620] [INFO ] [MAIN ] Derivative Progress: 28/2077 symbols completed. AFB took 1.1s. Estimated remaining: 14m 19s. Rate: 143.1 symbols/min [2025-09-23T22:15:37.981211] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:37.982105] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49508 primary records. [2025-09-23T22:15:37.983024] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-23T22:15:38.010910] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:38.012487] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32602 primary records. [2025-09-23T22:15:38.012796] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-23T22:15:38.014894] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-09-23T22:15:38.014961] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-23T22:15:38.017102] [INFO ] [MAIN ] Derivative Progress: 29/2077 symbols completed. AESI took 1.2s. Estimated remaining: 13m 53s. Rate: 147.6 symbols/min [2025-09-23T22:15:38.032523] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-09-23T22:15:38.032588] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-23T22:15:38.035369] [INFO ] [MAIN ] Derivative Progress: 30/2077 symbols completed. AFG took 1.1s. Estimated remaining: 13m 26s. Rate: 152.5 symbols/min [2025-09-23T22:15:38.035946] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:38.036522] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:38.036581] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:38.042463] [DEBUG] [LOCAL ] AFGB: Loaded 2417 existing records from primary storage. [2025-09-23T22:15:38.042751] [INFO ] [MAIN ] AFGB: Loaded 2417 primary data records. [2025-09-23T22:15:38.068706] [DEBUG] [LOCAL ] AFGC: Loaded 2566 existing records from primary storage. [2025-09-23T22:15:38.068897] [DEBUG] [LOCAL ] AFGE: Loaded 2518 existing records from primary storage. [2025-09-23T22:15:38.069006] [INFO ] [MAIN ] AFGC: Loaded 2566 primary data records. [2025-09-23T22:15:38.091878] [INFO ] [MAIN ] AFGE: Loaded 2518 primary data records. [2025-09-23T22:15:39.027374] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:39.040769] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2417 primary records. [2025-09-23T22:15:39.041080] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-09-23T22:15:39.042060] [INFO ] [MAIN ] AFGC: Generated 1790 derivative records from 2566 primary records. [2025-09-23T22:15:39.042233] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-23T22:15:39.041339] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-23T22:15:39.072000] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:15:39.079603] [INFO ] [MAIN ] AFGE: Generated 1793 derivative records from 2518 primary records. [2025-09-23T22:15:39.080848] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-23T22:15:39.092673] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-09-23T22:15:39.093066] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1790 records). [2025-09-23T22:15:39.094043] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-23T22:15:39.093168] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-23T22:15:39.096269] [INFO ] [MAIN ] Derivative Progress: 31/2077 symbols completed. AFGC took 1.1s. Estimated remaining: 14m 9s. Rate: 144.5 symbols/min [2025-09-23T22:15:39.099408] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:39.103411] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1793 records). [2025-09-23T22:15:39.103679] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-23T22:15:39.106404] [INFO ] [MAIN ] Derivative Progress: 32/2077 symbols completed. AFGE took 1.1s. Estimated remaining: 13m 43s. Rate: 149.1 symbols/min [2025-09-23T22:15:39.108763] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:39.108870] [INFO ] [MAIN ] Derivative Progress: 33/2077 symbols completed. AFGB took 1.1s. Estimated remaining: 13m 18s. Rate: 153.7 symbols/min [2025-09-23T22:15:39.109582] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:39.130433] [DEBUG] [LOCAL ] AGD: Loaded 17730 existing records from primary storage. [2025-09-23T22:15:39.130703] [INFO ] [MAIN ] AGD: Loaded 17730 primary data records. [2025-09-23T22:15:39.514199] [DEBUG] [LOCAL ] AGCO: Loaded 42493 existing records from primary storage. [2025-09-23T22:15:39.528583] [INFO ] [MAIN ] AGCO: Loaded 42493 primary data records. [2025-09-23T22:15:39.528465] [DEBUG] [LOCAL ] AFL: Loaded 53146 existing records from primary storage. [2025-09-23T22:15:39.529043] [INFO ] [MAIN ] AFL: Loaded 53146 primary data records. [2025-09-23T22:15:40.210046] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:40.210976] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 17730 primary records. [2025-09-23T22:15:40.211127] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-23T22:15:40.231101] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-09-23T22:15:40.231338] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-23T22:15:40.233687] [INFO ] [MAIN ] Derivative Progress: 34/2077 symbols completed. AGD took 1.1s. Estimated remaining: 14m 2s. Rate: 145.7 symbols/min [2025-09-23T22:15:40.234422] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:40.268577] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:40.268303] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:40.270491] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42493 primary records. [2025-09-23T22:15:40.269708] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53146 primary records. [2025-09-23T22:15:40.270709] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-23T22:15:40.270782] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-23T22:15:40.300527] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-09-23T22:15:40.304802] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-09-23T22:15:40.303512] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-23T22:15:40.304993] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-23T22:15:40.307542] [INFO ] [MAIN ] Derivative Progress: 35/2077 symbols completed. AFL took 1.2s. Estimated remaining: 13m 41s. Rate: 149.2 symbols/min [2025-09-23T22:15:40.310206] [INFO ] [MAIN ] Derivative Progress: 36/2077 symbols completed. AGCO took 1.2s. Estimated remaining: 13m 18s. Rate: 153.4 symbols/min [2025-09-23T22:15:40.310084] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:40.310687] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:40.350426] [DEBUG] [LOCAL ] AGI: Loaded 53418 existing records from primary storage. [2025-09-23T22:15:40.350756] [INFO ] [MAIN ] AGI: Loaded 53418 primary data records. [2025-09-23T22:15:40.379306] [DEBUG] [LOCAL ] AGM: Loaded 9921 existing records from primary storage. [2025-09-23T22:15:40.404246] [INFO ] [MAIN ] AGM: Loaded 9921 primary data records. [2025-09-23T22:15:40.902960] [DEBUG] [LOCAL ] AGL: Loaded 52423 existing records from primary storage. [2025-09-23T22:15:40.909402] [INFO ] [MAIN ] AGL: Loaded 52423 primary data records. [2025-09-23T22:15:41.462761] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:41.463300] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:41.464130] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53418 primary records. [2025-09-23T22:15:41.465134] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-23T22:15:41.464950] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 9921 primary records. [2025-09-23T22:15:41.465970] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-23T22:15:41.494119] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-09-23T22:15:41.494460] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-23T22:15:41.496417] [INFO ] [MAIN ] Derivative Progress: 37/2077 symbols completed. AGI took 1.3s. Estimated remaining: 14m 2s. Rate: 145.4 symbols/min [2025-09-23T22:15:41.497386] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:41.504535] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-09-23T22:15:41.504934] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-23T22:15:41.507251] [INFO ] [MAIN ] Derivative Progress: 38/2077 symbols completed. AGM took 1.2s. Estimated remaining: 13m 40s. Rate: 149.2 symbols/min [2025-09-23T22:15:41.520476] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:41.521388] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:41.522113] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52423 primary records. [2025-09-23T22:15:41.522299] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-23T22:15:41.547485] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-09-23T22:15:41.547690] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-23T22:15:41.550168] [INFO ] [MAIN ] Derivative Progress: 39/2077 symbols completed. AGL took 1.2s. Estimated remaining: 13m 21s. Rate: 152.7 symbols/min [2025-09-23T22:15:41.550578] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:41.561665] [DEBUG] [LOCAL ] AGO: Loaded 28103 existing records from primary storage. [2025-09-23T22:15:41.561861] [INFO ] [MAIN ] AGO: Loaded 28103 primary data records. [2025-09-23T22:15:41.750409] [DEBUG] [LOCAL ] AGRO: Loaded 33795 existing records from primary storage. [2025-09-23T22:15:41.915432] [INFO ] [MAIN ] AGRO: Loaded 33795 primary data records. [2025-09-23T22:15:41.916172] [DEBUG] [LOCAL ] AGX: Loaded 33512 existing records from primary storage. [2025-09-23T22:15:41.916423] [INFO ] [MAIN ] AGX: Loaded 33512 primary data records. [2025-09-23T22:15:42.601909] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:42.603776] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 28103 primary records. [2025-09-23T22:15:42.604100] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-23T22:15:42.640784] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-09-23T22:15:42.641456] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:42.642295] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-23T22:15:42.644445] [INFO ] [MAIN ] Derivative Progress: 40/2077 symbols completed. AGO took 1.1s. Estimated remaining: 13m 56s. Rate: 146.2 symbols/min [2025-09-23T22:15:42.642228] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33512 primary records. [2025-09-23T22:15:42.645554] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:42.645962] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-23T22:15:42.665679] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-09-23T22:15:42.673332] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-23T22:15:42.680712] [INFO ] [MAIN ] Derivative Progress: 41/2077 symbols completed. AGX took 1.1s. Estimated remaining: 13m 37s. Rate: 149.5 symbols/min [2025-09-23T22:15:42.681152] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:42.682174] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33795 primary records. [2025-09-23T22:15:42.682539] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-23T22:15:42.682611] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:42.703428] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-09-23T22:15:42.703638] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-23T22:15:42.705870] [INFO ] [MAIN ] Derivative Progress: 42/2077 symbols completed. AGRO took 1.2s. Estimated remaining: 13m 18s. Rate: 152.9 symbols/min [2025-09-23T22:15:42.706263] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:42.725327] [DEBUG] [LOCAL ] AHT: Loaded 6041 existing records from primary storage. [2025-09-23T22:15:42.725487] [INFO ] [MAIN ] AHT: Loaded 6041 primary data records. [2025-09-23T22:15:42.853881] [DEBUG] [LOCAL ] AHH: Loaded 41438 existing records from primary storage. [2025-09-23T22:15:42.854256] [INFO ] [MAIN ] AHH: Loaded 41438 primary data records. [2025-09-23T22:15:42.955548] [DEBUG] [LOCAL ] AHR: Loaded 49330 existing records from primary storage. [2025-09-23T22:15:43.013370] [INFO ] [MAIN ] AHR: Loaded 49330 primary data records. [2025-09-23T22:15:43.791815] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:43.793003] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6041 primary records. [2025-09-23T22:15:43.794693] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-23T22:15:43.823301] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-09-23T22:15:43.824160] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:43.825000] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 41438 primary records. [2025-09-23T22:15:43.824241] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-23T22:15:43.827062] [INFO ] [MAIN ] Derivative Progress: 43/2077 symbols completed. AHT took 1.1s. Estimated remaining: 13m 52s. Rate: 146.6 symbols/min [2025-09-23T22:15:43.827301] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-23T22:15:43.857675] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-09-23T22:15:43.856690] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:43.857815] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-23T22:15:43.860082] [INFO ] [MAIN ] Derivative Progress: 44/2077 symbols completed. AHH took 1.2s. Estimated remaining: 13m 35s. Rate: 149.7 symbols/min [2025-09-23T22:15:43.860898] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49330 primary records. [2025-09-23T22:15:43.861128] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-23T22:15:43.876749] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-09-23T22:15:43.876808] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-23T22:15:43.879233] [INFO ] [MAIN ] Derivative Progress: 45/2077 symbols completed. AHR took 1.2s. Estimated remaining: 13m 17s. Rate: 153.0 symbols/min [2025-09-23T22:15:43.879936] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:43.879787] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:43.879890] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:43.911348] [DEBUG] [LOCAL ] AIN: Loaded 24626 existing records from primary storage. [2025-09-23T22:15:43.911561] [INFO ] [MAIN ] AIN: Loaded 24626 primary data records. [2025-09-23T22:15:44.284758] [DEBUG] [LOCAL ] AIG: Loaded 53475 existing records from primary storage. [2025-09-23T22:15:44.285378] [INFO ] [MAIN ] AIG: Loaded 53475 primary data records. [2025-09-23T22:15:44.292763] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-23T22:15:44.321206] [INFO ] [MAIN ] AI: Loaded 53749 primary data records. [2025-09-23T22:15:44.981532] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:44.983277] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24626 primary records. [2025-09-23T22:15:44.983518] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-23T22:15:45.002431] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-09-23T22:15:45.002889] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-23T22:15:45.005102] [INFO ] [MAIN ] Derivative Progress: 46/2077 symbols completed. AIN took 1.1s. Estimated remaining: 13m 49s. Rate: 147.0 symbols/min [2025-09-23T22:15:45.005606] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:45.023535] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:45.025169] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53475 primary records. [2025-09-23T22:15:45.025260] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-23T22:15:45.057868] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:45.059229] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53749 primary records. [2025-09-23T22:15:45.064059] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-23T22:15:45.064363] [DEBUG] [LOCAL ] AIO: Loaded 13260 existing records from primary storage. [2025-09-23T22:15:45.065925] [INFO ] [MAIN ] AIO: Loaded 13260 primary data records. [2025-09-23T22:15:45.166588] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-09-23T22:15:45.178756] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-23T22:15:45.188352] [INFO ] [MAIN ] Derivative Progress: 47/2077 symbols completed. AIG took 1.3s. Estimated remaining: 13m 39s. Rate: 148.7 symbols/min [2025-09-23T22:15:45.193048] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:45.220919] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-09-23T22:15:45.235542] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-23T22:15:45.248199] [INFO ] [MAIN ] Derivative Progress: 48/2077 symbols completed. AI took 1.4s. Estimated remaining: 13m 24s. Rate: 151.4 symbols/min [2025-09-23T22:15:45.290495] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:45.435056] [DEBUG] [LOCAL ] AIR: Loaded 27416 existing records from primary storage. [2025-09-23T22:15:45.435671] [INFO ] [MAIN ] AIR: Loaded 27416 primary data records. [2025-09-23T22:15:45.584474] [DEBUG] [LOCAL ] AIT: Loaded 28113 existing records from primary storage. [2025-09-23T22:15:45.620504] [INFO ] [MAIN ] AIT: Loaded 28113 primary data records. [2025-09-23T22:15:46.026857] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:46.047395] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13260 primary records. [2025-09-23T22:15:46.163907] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-23T22:15:46.182429] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-09-23T22:15:46.185416] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-23T22:15:46.189614] [INFO ] [MAIN ] Derivative Progress: 49/2077 symbols completed. AIO took 1.2s. Estimated remaining: 13m 46s. Rate: 147.3 symbols/min [2025-09-23T22:15:46.190898] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:46.204463] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:46.205960] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 27416 primary records. [2025-09-23T22:15:46.206746] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-23T22:15:46.226549] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-09-23T22:15:46.227604] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-23T22:15:46.230895] [INFO ] [MAIN ] Derivative Progress: 50/2077 symbols completed. AIR took 1.0s. Estimated remaining: 13m 31s. Rate: 150.0 symbols/min [2025-09-23T22:15:46.232220] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:46.245895] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:46.246566] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 28113 primary records. [2025-09-23T22:15:46.246625] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-23T22:15:46.272166] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-09-23T22:15:46.272279] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-23T22:15:46.274347] [INFO ] [MAIN ] Derivative Progress: 51/2077 symbols completed. AIT took 1.0s. Estimated remaining: 13m 16s. Rate: 152.7 symbols/min [2025-09-23T22:15:46.274724] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:46.292897] [DEBUG] [LOCAL ] AIZN: Loaded 3919 existing records from primary storage. [2025-09-23T22:15:46.294230] [INFO ] [MAIN ] AIZN: Loaded 3919 primary data records. [2025-09-23T22:15:46.294121] [DEBUG] [LOCAL ] AIV: Loaded 40198 existing records from primary storage. [2025-09-23T22:15:46.312869] [INFO ] [MAIN ] AIV: Loaded 40198 primary data records. [2025-09-23T22:15:46.491982] [DEBUG] [LOCAL ] AIZ: Loaded 30174 existing records from primary storage. [2025-09-23T22:15:46.497565] [INFO ] [MAIN ] AIZ: Loaded 30174 primary data records. [2025-09-23T22:15:47.272783] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-23T22:15:47.273861] [INFO ] [MAIN ] AIZN: Generated 1791 derivative records from 3919 primary records. [2025-09-23T22:15:47.275307] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-23T22:15:47.303072] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:47.304519] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40198 primary records. [2025-09-23T22:15:47.303847] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1791 records). [2025-09-23T22:15:47.304714] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-23T22:15:47.306080] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-23T22:15:47.309626] [INFO ] [MAIN ] Derivative Progress: 52/2077 symbols completed. AIZN took 1.0s. Estimated remaining: 13m 41s. Rate: 148.0 symbols/min [2025-09-23T22:15:47.310020] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:47.339478] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-09-23T22:15:47.339079] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:47.340255] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 30174 primary records. [2025-09-23T22:15:47.340383] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-23T22:15:47.343166] [INFO ] [MAIN ] Derivative Progress: 53/2077 symbols completed. AIV took 1.2s. Estimated remaining: 13m 26s. Rate: 150.6 symbols/min [2025-09-23T22:15:47.340468] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-23T22:15:47.344203] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:47.360813] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-09-23T22:15:47.361010] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-23T22:15:47.363330] [INFO ] [MAIN ] Derivative Progress: 54/2077 symbols completed. AIZ took 1.1s. Estimated remaining: 13m 12s. Rate: 153.3 symbols/min [2025-09-23T22:15:47.363634] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:47.417903] [DEBUG] [LOCAL ] AL: Loaded 44068 existing records from primary storage. [2025-09-23T22:15:47.418199] [INFO ] [MAIN ] AL: Loaded 44068 primary data records. [2025-09-23T22:15:47.524128] [DEBUG] [LOCAL ] ALEX: Loaded 31336 existing records from primary storage. [2025-09-23T22:15:47.535456] [INFO ] [MAIN ] ALEX: Loaded 31336 primary data records. [2025-09-23T22:15:47.536154] [DEBUG] [LOCAL ] ALB: Loaded 53222 existing records from primary storage. [2025-09-23T22:15:47.554950] [INFO ] [MAIN ] ALB: Loaded 53222 primary data records. [2025-09-23T22:15:48.417945] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:48.419214] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44068 primary records. [2025-09-23T22:15:48.419606] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-23T22:15:48.434319] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:48.435485] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31336 primary records. [2025-09-23T22:15:48.444201] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-23T22:15:48.480799] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:48.482370] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-09-23T22:15:48.483484] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53222 primary records. [2025-09-23T22:15:48.482636] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-09-23T22:15:48.483609] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-23T22:15:48.483753] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-23T22:15:48.483848] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-23T22:15:48.486963] [INFO ] [MAIN ] Derivative Progress: 55/2077 symbols completed. ALEX took 1.1s. Estimated remaining: 13m 38s. Rate: 148.3 symbols/min [2025-09-23T22:15:48.489720] [INFO ] [MAIN ] Derivative Progress: 56/2077 symbols completed. AL took 1.2s. Estimated remaining: 13m 23s. Rate: 150.9 symbols/min [2025-09-23T22:15:48.489335] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:48.501197] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:48.510700] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-09-23T22:15:48.510875] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-23T22:15:48.513269] [INFO ] [MAIN ] Derivative Progress: 57/2077 symbols completed. ALB took 1.2s. Estimated remaining: 13m 10s. Rate: 153.5 symbols/min [2025-09-23T22:15:48.513739] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:48.518726] [DEBUG] [LOCAL ] ALG: Loaded 10456 existing records from primary storage. [2025-09-23T22:15:48.518834] [INFO ] [MAIN ] ALG: Loaded 10456 primary data records. [2025-09-23T22:15:48.858317] [DEBUG] [LOCAL ] ALIT: Loaded 52761 existing records from primary storage. [2025-09-23T22:15:48.873586] [INFO ] [MAIN ] ALIT: Loaded 52761 primary data records. [2025-09-23T22:15:49.016258] [DEBUG] [LOCAL ] ALL: Loaded 50241 existing records from primary storage. [2025-09-23T22:15:49.017692] [INFO ] [MAIN ] ALL: Loaded 50241 primary data records. [2025-09-23T22:15:49.547029] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:49.547951] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10456 primary records. [2025-09-23T22:15:49.548052] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-23T22:15:49.566921] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-09-23T22:15:49.567611] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-23T22:15:49.570834] [INFO ] [MAIN ] Derivative Progress: 58/2077 symbols completed. ALG took 1.1s. Estimated remaining: 13m 33s. Rate: 149.1 symbols/min [2025-09-23T22:15:49.592233] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:49.593125] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52761 primary records. [2025-09-23T22:15:49.593229] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-23T22:15:49.614192] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-09-23T22:15:49.614384] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-23T22:15:49.616822] [INFO ] [MAIN ] Derivative Progress: 59/2077 symbols completed. ALIT took 1.1s. Estimated remaining: 13m 20s. Rate: 151.4 symbols/min [2025-09-23T22:15:49.629363] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:49.629956] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 50241 primary records. [2025-09-23T22:15:49.630016] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-23T22:15:49.645404] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-09-23T22:15:49.645482] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-23T22:15:49.647797] [INFO ] [MAIN ] Derivative Progress: 60/2077 symbols completed. ALL took 1.1s. Estimated remaining: 13m 7s. Rate: 153.7 symbols/min [2025-09-23T22:15:49.648371] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:49.648535] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:49.648765] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:49.706754] [DEBUG] [LOCAL ] ALLE: Loaded 45201 existing records from primary storage. [2025-09-23T22:15:49.706972] [INFO ] [MAIN ] ALLE: Loaded 45201 primary data records. [2025-09-23T22:15:49.862987] [DEBUG] [LOCAL ] ALSN: Loaded 43307 existing records from primary storage. [2025-09-23T22:15:49.880376] [DEBUG] [LOCAL ] ALLY: Loaded 53218 existing records from primary storage. [2025-09-23T22:15:49.904290] [INFO ] [MAIN ] ALLY: Loaded 53218 primary data records. [2025-09-23T22:15:49.913199] [INFO ] [MAIN ] ALSN: Loaded 43307 primary data records. [2025-09-23T22:15:50.757093] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:50.758350] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 45201 primary records. [2025-09-23T22:15:50.758812] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-23T22:15:50.794399] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:50.797138] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-09-23T22:15:50.796318] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53218 primary records. [2025-09-23T22:15:50.797776] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-23T22:15:50.797701] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-23T22:15:50.814186] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:50.824182] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43307 primary records. [2025-09-23T22:15:50.823309] [INFO ] [MAIN ] Derivative Progress: 61/2077 symbols completed. ALLE took 1.2s. Estimated remaining: 13m 33s. Rate: 148.8 symbols/min [2025-09-23T22:15:50.828129] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:50.824297] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-23T22:15:50.848261] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-09-23T22:15:50.849302] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-23T22:15:50.852341] [INFO ] [MAIN ] Derivative Progress: 62/2077 symbols completed. ALLY took 1.2s. Estimated remaining: 13m 20s. Rate: 151.1 symbols/min [2025-09-23T22:15:50.853278] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:50.853422] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-09-23T22:15:50.853526] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-23T22:15:50.856775] [INFO ] [MAIN ] Derivative Progress: 63/2077 symbols completed. ALSN took 1.2s. Estimated remaining: 13m 7s. Rate: 153.5 symbols/min [2025-09-23T22:15:50.863276] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:50.876292] [DEBUG] [LOCAL ] ALTG: Loaded 23978 existing records from primary storage. [2025-09-23T22:15:50.876490] [INFO ] [MAIN ] ALTG: Loaded 23978 primary data records. [2025-09-23T22:15:50.936903] [DEBUG] [LOCAL ] ALUR: Loaded 10889 existing records from primary storage. [2025-09-23T22:15:50.969149] [INFO ] [MAIN ] ALUR: Loaded 10889 primary data records. [2025-09-23T22:15:51.319866] [DEBUG] [LOCAL ] ALV: Loaded 42654 existing records from primary storage. [2025-09-23T22:15:51.326306] [INFO ] [MAIN ] ALV: Loaded 42654 primary data records. [2025-09-23T22:15:51.954141] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:51.955250] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23978 primary records. [2025-09-23T22:15:51.955786] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-23T22:15:51.983710] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:51.985971] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 10889 primary records. [2025-09-23T22:15:51.986679] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-23T22:15:52.000827] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-09-23T22:15:52.002035] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-23T22:15:52.005025] [INFO ] [MAIN ] Derivative Progress: 64/2077 symbols completed. ALTG took 1.2s. Estimated remaining: 13m 31s. Rate: 149.0 symbols/min [2025-09-23T22:15:52.005828] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:52.011979] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-09-23T22:15:52.024808] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:52.025612] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42654 primary records. [2025-09-23T22:15:52.027069] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-23T22:15:52.027164] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-23T22:15:52.029461] [INFO ] [MAIN ] Derivative Progress: 65/2077 symbols completed. ALUR took 1.2s. Estimated remaining: 13m 19s. Rate: 151.2 symbols/min [2025-09-23T22:15:52.030347] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:52.043313] [DEBUG] [LOCAL ] ALX: Loaded 5959 existing records from primary storage. [2025-09-23T22:15:52.046356] [INFO ] [MAIN ] ALX: Loaded 5959 primary data records. [2025-09-23T22:15:52.160398] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-09-23T22:15:52.166110] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-23T22:15:52.173506] [INFO ] [MAIN ] Derivative Progress: 66/2077 symbols completed. ALV took 1.3s. Estimated remaining: 13m 11s. Rate: 152.6 symbols/min [2025-09-23T22:15:52.189481] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:52.397110] [DEBUG] [LOCAL ] AM: Loaded 52154 existing records from primary storage. [2025-09-23T22:15:52.397313] [INFO ] [MAIN ] AM: Loaded 52154 primary data records. [2025-09-23T22:15:52.602628] [DEBUG] [LOCAL ] AMBC: Loaded 37181 existing records from primary storage. [2025-09-23T22:15:52.604392] [INFO ] [MAIN ] AMBC: Loaded 37181 primary data records. [2025-09-23T22:15:52.841912] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:52.848703] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 5959 primary records. [2025-09-23T22:15:52.869500] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-23T22:15:53.054532] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-09-23T22:15:53.055067] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-23T22:15:53.057397] [INFO ] [MAIN ] Derivative Progress: 67/2077 symbols completed. ALX took 1.1s. Estimated remaining: 13m 25s. Rate: 149.8 symbols/min [2025-09-23T22:15:53.057924] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:53.078286] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:53.079057] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52154 primary records. [2025-09-23T22:15:53.079294] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-23T22:15:53.110754] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:53.112447] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 37181 primary records. [2025-09-23T22:15:53.112864] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-23T22:15:53.112989] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-09-23T22:15:53.123428] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-23T22:15:53.132685] [INFO ] [MAIN ] Derivative Progress: 68/2077 symbols completed. AM took 1.1s. Estimated remaining: 13m 15s. Rate: 151.6 symbols/min [2025-09-23T22:15:53.136860] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:53.155221] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-09-23T22:15:53.155392] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-23T22:15:53.158035] [INFO ] [MAIN ] Derivative Progress: 69/2077 symbols completed. AMBC took 1.0s. Estimated remaining: 13m 4s. Rate: 153.7 symbols/min [2025-09-23T22:15:53.159110] [DEBUG] [LOCAL ] AMBP: Loaded 45331 existing records from primary storage. [2025-09-23T22:15:53.159540] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:53.159302] [INFO ] [MAIN ] AMBP: Loaded 45331 primary data records. [2025-09-23T22:15:53.498321] [DEBUG] [LOCAL ] AMC: Loaded 53758 existing records from primary storage. [2025-09-23T22:15:53.498732] [INFO ] [MAIN ] AMC: Loaded 53758 primary data records. [2025-09-23T22:15:53.621090] [DEBUG] [LOCAL ] AMCR: Loaded 53668 existing records from primary storage. [2025-09-23T22:15:53.661061] [INFO ] [MAIN ] AMCR: Loaded 53668 primary data records. [2025-09-23T22:15:54.171497] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:54.182171] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 45331 primary records. [2025-09-23T22:15:54.182363] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-23T22:15:54.204336] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-09-23T22:15:54.205319] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-23T22:15:54.207698] [INFO ] [MAIN ] Derivative Progress: 70/2077 symbols completed. AMBP took 1.1s. Estimated remaining: 13m 22s. Rate: 150.1 symbols/min [2025-09-23T22:15:54.209998] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:54.226105] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:54.227181] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53758 primary records. [2025-09-23T22:15:54.227441] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-23T22:15:54.247402] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-09-23T22:15:54.261464] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-23T22:15:54.261895] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:54.264255] [INFO ] [MAIN ] Derivative Progress: 71/2077 symbols completed. AMC took 1.1s. Estimated remaining: 13m 12s. Rate: 151.9 symbols/min [2025-09-23T22:15:54.264666] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:54.265421] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53668 primary records. [2025-09-23T22:15:54.265875] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-23T22:15:54.282306] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-09-23T22:15:54.282432] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-23T22:15:54.284964] [INFO ] [MAIN ] Derivative Progress: 72/2077 symbols completed. AMCR took 1.1s. Estimated remaining: 13m 1s. Rate: 154.0 symbols/min [2025-09-23T22:15:54.285505] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:54.311086] [DEBUG] [LOCAL ] AMG: Loaded 20774 existing records from primary storage. [2025-09-23T22:15:54.312030] [INFO ] [MAIN ] AMG: Loaded 20774 primary data records. [2025-09-23T22:15:54.400335] [DEBUG] [LOCAL ] AME: Loaded 48543 existing records from primary storage. [2025-09-23T22:15:54.417716] [INFO ] [MAIN ] AME: Loaded 48543 primary data records. [2025-09-23T22:15:54.819502] [DEBUG] [LOCAL ] AMH: Loaded 51695 existing records from primary storage. [2025-09-23T22:15:54.850108] [INFO ] [MAIN ] AMH: Loaded 51695 primary data records. [2025-09-23T22:15:55.297329] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:55.298666] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20774 primary records. [2025-09-23T22:15:55.299560] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-23T22:15:55.330537] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-09-23T22:15:55.331109] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:55.332194] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48543 primary records. [2025-09-23T22:15:55.331420] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-23T22:15:55.332383] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-23T22:15:55.335145] [INFO ] [MAIN ] Derivative Progress: 73/2077 symbols completed. AMG took 1.1s. Estimated remaining: 13m 19s. Rate: 150.5 symbols/min [2025-09-23T22:15:55.353773] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-09-23T22:15:55.354432] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-23T22:15:55.356738] [INFO ] [MAIN ] Derivative Progress: 74/2077 symbols completed. AME took 1.1s. Estimated remaining: 13m 8s. Rate: 152.4 symbols/min [2025-09-23T22:15:55.369818] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:55.370401] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51695 primary records. [2025-09-23T22:15:55.370464] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-23T22:15:55.386028] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-09-23T22:15:55.386089] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-23T22:15:55.388542] [INFO ] [MAIN ] Derivative Progress: 75/2077 symbols completed. AMH took 1.1s. Estimated remaining: 12m 58s. Rate: 154.3 symbols/min [2025-09-23T22:15:55.389202] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:55.389096] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:55.389458] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:55.450029] [DEBUG] [LOCAL ] AMP: Loaded 32522 existing records from primary storage. [2025-09-23T22:15:55.461624] [INFO ] [MAIN ] AMP: Loaded 32522 primary data records. [2025-09-23T22:15:55.483209] [DEBUG] [LOCAL ] AMN: Loaded 42049 existing records from primary storage. [2025-09-23T22:15:55.498734] [INFO ] [MAIN ] AMN: Loaded 42049 primary data records. [2025-09-23T22:15:55.680520] [DEBUG] [LOCAL ] AMPX: Loaded 52164 existing records from primary storage. [2025-09-23T22:15:55.694880] [INFO ] [MAIN ] AMPX: Loaded 52164 primary data records. [2025-09-23T22:15:56.465378] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:56.466457] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 42049 primary records. [2025-09-23T22:15:56.465638] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:56.467218] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32522 primary records. [2025-09-23T22:15:56.467301] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-23T22:15:56.467951] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-23T22:15:56.513198] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:56.515297] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52164 primary records. [2025-09-23T22:15:56.516618] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-23T22:15:56.518839] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-09-23T22:15:56.526420] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-09-23T22:15:56.526094] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-23T22:15:56.529157] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-23T22:15:56.529027] [INFO ] [MAIN ] Derivative Progress: 76/2077 symbols completed. AMP took 1.1s. Estimated remaining: 13m 18s. Rate: 150.5 symbols/min [2025-09-23T22:15:56.534983] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:56.537620] [INFO ] [MAIN ] Derivative Progress: 77/2077 symbols completed. AMN took 1.1s. Estimated remaining: 13m 7s. Rate: 152.4 symbols/min [2025-09-23T22:15:56.538866] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:56.539936] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-09-23T22:15:56.540020] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-23T22:15:56.542630] [INFO ] [MAIN ] Derivative Progress: 78/2077 symbols completed. AMPX took 1.2s. Estimated remaining: 12m 57s. Rate: 154.4 symbols/min [2025-09-23T22:15:56.543264] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:56.600990] [DEBUG] [LOCAL ] AMR: Loaded 29107 existing records from primary storage. [2025-09-23T22:15:56.602089] [INFO ] [MAIN ] AMR: Loaded 29107 primary data records. [2025-09-23T22:15:56.634048] [DEBUG] [LOCAL ] AMPY: Loaded 37407 existing records from primary storage. [2025-09-23T22:15:56.639433] [INFO ] [MAIN ] AMPY: Loaded 37407 primary data records. [2025-09-23T22:15:56.777721] [DEBUG] [LOCAL ] AMRC: Loaded 38438 existing records from primary storage. [2025-09-23T22:15:56.846188] [INFO ] [MAIN ] AMRC: Loaded 38438 primary data records. [2025-09-23T22:15:57.590721] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:57.592222] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 29107 primary records. [2025-09-23T22:15:57.599880] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-23T22:15:57.605923] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:57.606804] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 37407 primary records. [2025-09-23T22:15:57.614160] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-23T22:15:57.638507] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-09-23T22:15:57.638735] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-23T22:15:57.648604] [INFO ] [MAIN ] Derivative Progress: 79/2077 symbols completed. AMPY took 1.1s. Estimated remaining: 13m 15s. Rate: 150.9 symbols/min [2025-09-23T22:15:57.654476] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:57.655010] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:57.656267] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38438 primary records. [2025-09-23T22:15:57.657527] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-23T22:15:57.658821] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-09-23T22:15:57.659161] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-23T22:15:57.660989] [INFO ] [MAIN ] Derivative Progress: 80/2077 symbols completed. AMR took 1.1s. Estimated remaining: 13m 5s. Rate: 152.7 symbols/min [2025-09-23T22:15:57.668632] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:57.677846] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-09-23T22:15:57.677924] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-23T22:15:57.680190] [INFO ] [MAIN ] Derivative Progress: 81/2077 symbols completed. AMRC took 1.1s. Estimated remaining: 12m 55s. Rate: 154.5 symbols/min [2025-09-23T22:15:57.680506] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:57.694720] [DEBUG] [LOCAL ] AMTD: Loaded 3564 existing records from primary storage. [2025-09-23T22:15:57.694902] [INFO ] [MAIN ] AMTD: Loaded 3564 primary data records. [2025-09-23T22:15:57.802956] [DEBUG] [LOCAL ] AMTB: Loaded 20436 existing records from primary storage. [2025-09-23T22:15:57.824841] [INFO ] [MAIN ] AMTB: Loaded 20436 primary data records. [2025-09-23T22:15:58.150150] [DEBUG] [LOCAL ] AMT: Loaded 52450 existing records from primary storage. [2025-09-23T22:15:58.174671] [INFO ] [MAIN ] AMT: Loaded 52450 primary data records. [2025-09-23T22:15:58.691432] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:58.692567] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3564 primary records. [2025-09-23T22:15:58.693224] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-23T22:15:58.721150] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:58.725709] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20436 primary records. [2025-09-23T22:15:58.725833] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-23T22:15:58.727194] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-09-23T22:15:58.727692] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-23T22:15:58.748178] [INFO ] [MAIN ] Derivative Progress: 82/2077 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 11s. Rate: 151.3 symbols/min [2025-09-23T22:15:58.753579] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:58.755080] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:58.757987] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-09-23T22:15:58.759213] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52450 primary records. [2025-09-23T22:15:58.759348] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-23T22:15:58.759290] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-23T22:15:58.762590] [INFO ] [MAIN ] Derivative Progress: 83/2077 symbols completed. AMTB took 1.1s. Estimated remaining: 13m 2s. Rate: 153.1 symbols/min [2025-09-23T22:15:58.762843] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:58.780850] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-09-23T22:15:58.781081] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-23T22:15:58.783482] [INFO ] [MAIN ] Derivative Progress: 84/2077 symbols completed. AMT took 1.1s. Estimated remaining: 12m 52s. Rate: 154.8 symbols/min [2025-09-23T22:15:58.783894] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:58.788547] [DEBUG] [LOCAL ] AMWL: Loaded 8642 existing records from primary storage. [2025-09-23T22:15:58.789087] [INFO ] [MAIN ] AMWL: Loaded 8642 primary data records. [2025-09-23T22:15:59.141900] [DEBUG] [LOCAL ] AN: Loaded 32517 existing records from primary storage. [2025-09-23T22:15:59.143813] [INFO ] [MAIN ] AN: Loaded 32517 primary data records. [2025-09-23T22:15:59.227221] [DEBUG] [LOCAL ] AMX: Loaded 49162 existing records from primary storage. [2025-09-23T22:15:59.251918] [INFO ] [MAIN ] AMX: Loaded 49162 primary data records. [2025-09-23T22:15:59.862317] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:59.863874] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 8642 primary records. [2025-09-23T22:15:59.864709] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-23T22:15:59.884734] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-09-23T22:15:59.885011] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-23T22:15:59.887399] [INFO ] [MAIN ] Derivative Progress: 85/2077 symbols completed. AMWL took 1.1s. Estimated remaining: 13m 9s. Rate: 151.5 symbols/min [2025-09-23T22:15:59.890307] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:59.904568] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:59.905307] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 32517 primary records. [2025-09-23T22:15:59.905407] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-23T22:15:59.924244] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-09-23T22:15:59.924662] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-23T22:15:59.927032] [INFO ] [MAIN ] Derivative Progress: 86/2077 symbols completed. AN took 1.1s. Estimated remaining: 13m 0s. Rate: 153.1 symbols/min [2025-09-23T22:15:59.927378] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:59.940920] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:15:59.941677] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49162 primary records. [2025-09-23T22:15:59.941797] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-23T22:15:59.958250] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-09-23T22:15:59.958477] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-23T22:15:59.961044] [INFO ] [MAIN ] Derivative Progress: 87/2077 symbols completed. AMX took 1.2s. Estimated remaining: 12m 52s. Rate: 154.7 symbols/min [2025-09-23T22:15:59.961402] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:15:59.994681] [DEBUG] [LOCAL ] ANRO: Loaded 19470 existing records from primary storage. [2025-09-23T22:15:59.994897] [INFO ] [MAIN ] ANRO: Loaded 19470 primary data records. [2025-09-23T22:16:00.122133] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-23T22:16:00.141146] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-09-23T22:16:00.182268] [DEBUG] [LOCAL ] ANF: Loaded 52244 existing records from primary storage. [2025-09-23T22:16:00.196354] [INFO ] [MAIN ] ANF: Loaded 52244 primary data records. [2025-09-23T22:16:01.027073] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:01.029057] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 19470 primary records. [2025-09-23T22:16:01.029213] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-23T22:16:01.055036] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:01.057371] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52244 primary records. [2025-09-23T22:16:01.058613] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-23T22:16:01.088256] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-09-23T22:16:01.089064] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:01.090850] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-09-23T22:16:01.090942] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-23T22:16:01.089135] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-23T22:16:01.094117] [INFO ] [MAIN ] Derivative Progress: 88/2077 symbols completed. ANRO took 1.1s. Estimated remaining: 13m 8s. Rate: 151.4 symbols/min [2025-09-23T22:16:01.111759] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-09-23T22:16:01.112792] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-23T22:16:01.113332] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-09-23T22:16:01.116006] [INFO ] [MAIN ] Derivative Progress: 89/2077 symbols completed. ANF took 1.2s. Estimated remaining: 12m 59s. Rate: 153.1 symbols/min [2025-09-23T22:16:01.116151] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-23T22:16:01.118808] [INFO ] [MAIN ] Derivative Progress: 90/2077 symbols completed. ANET took 1.2s. Estimated remaining: 12m 50s. Rate: 154.8 symbols/min [2025-09-23T22:16:01.119382] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:01.120000] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:01.119542] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:01.164378] [DEBUG] [LOCAL ] AOMR: Loaded 16714 existing records from primary storage. [2025-09-23T22:16:01.165482] [INFO ] [MAIN ] AOMR: Loaded 16714 primary data records. [2025-09-23T22:16:01.177571] [DEBUG] [LOCAL ] AOD: Loaded 30169 existing records from primary storage. [2025-09-23T22:16:01.187855] [INFO ] [MAIN ] AOD: Loaded 30169 primary data records. [2025-09-23T22:16:01.376511] [DEBUG] [LOCAL ] ANVS: Loaded 23212 existing records from primary storage. [2025-09-23T22:16:01.407878] [INFO ] [MAIN ] ANVS: Loaded 23212 primary data records. [2025-09-23T22:16:02.178171] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:02.179173] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30169 primary records. [2025-09-23T22:16:02.180177] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-23T22:16:02.209700] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:02.211950] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16714 primary records. [2025-09-23T22:16:02.212432] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-23T22:16:02.228631] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-09-23T22:16:02.232918] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-09-23T22:16:02.233050] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-23T22:16:02.243380] [INFO ] [MAIN ] Derivative Progress: 91/2077 symbols completed. AOMR took 1.1s. Estimated remaining: 13m 6s. Rate: 151.6 symbols/min [2025-09-23T22:16:02.240843] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-23T22:16:02.250479] [INFO ] [MAIN ] Derivative Progress: 92/2077 symbols completed. AOD took 1.1s. Estimated remaining: 12m 57s. Rate: 153.2 symbols/min [2025-09-23T22:16:02.250589] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:02.251372] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:02.251623] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:02.252487] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23212 primary records. [2025-09-23T22:16:02.252882] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-23T22:16:02.271313] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-09-23T22:16:02.271515] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-23T22:16:02.274208] [INFO ] [MAIN ] Derivative Progress: 93/2077 symbols completed. ANVS took 1.2s. Estimated remaining: 12m 49s. Rate: 154.8 symbols/min [2025-09-23T22:16:02.274691] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:02.299991] [DEBUG] [LOCAL ] AORT: Loaded 29726 existing records from primary storage. [2025-09-23T22:16:02.300223] [INFO ] [MAIN ] AORT: Loaded 29726 primary data records. [2025-09-23T22:16:02.660167] [DEBUG] [LOCAL ] AON: Loaded 45655 existing records from primary storage. [2025-09-23T22:16:02.661420] [INFO ] [MAIN ] AON: Loaded 45655 primary data records. [2025-09-23T22:16:02.662230] [DEBUG] [LOCAL ] AOS: Loaded 49194 existing records from primary storage. [2025-09-23T22:16:02.662380] [INFO ] [MAIN ] AOS: Loaded 49194 primary data records. [2025-09-23T22:16:03.305536] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:03.307010] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29726 primary records. [2025-09-23T22:16:03.307306] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-23T22:16:03.329722] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-09-23T22:16:03.329910] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-23T22:16:03.333130] [INFO ] [MAIN ] Derivative Progress: 94/2077 symbols completed. AORT took 1.1s. Estimated remaining: 13m 3s. Rate: 152.0 symbols/min [2025-09-23T22:16:03.341486] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:03.347460] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:03.348337] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 49194 primary records. [2025-09-23T22:16:03.349615] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-23T22:16:03.382910] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-09-23T22:16:03.383669] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-23T22:16:03.383530] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:03.386819] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45655 primary records. [2025-09-23T22:16:03.387024] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-23T22:16:03.385819] [INFO ] [MAIN ] Derivative Progress: 95/2077 symbols completed. AOS took 1.1s. Estimated remaining: 12m 55s. Rate: 153.4 symbols/min [2025-09-23T22:16:03.391761] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:03.392283] [DEBUG] [LOCAL ] AP: Loaded 6975 existing records from primary storage. [2025-09-23T22:16:03.404000] [INFO ] [MAIN ] AP: Loaded 6975 primary data records. [2025-09-23T22:16:03.488367] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-09-23T22:16:03.504868] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-23T22:16:03.518594] [INFO ] [MAIN ] Derivative Progress: 96/2077 symbols completed. AON took 1.3s. Estimated remaining: 12m 49s. Rate: 154.5 symbols/min [2025-09-23T22:16:03.519412] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:03.745860] [DEBUG] [LOCAL ] APD: Loaded 45379 existing records from primary storage. [2025-09-23T22:16:03.746788] [INFO ] [MAIN ] APD: Loaded 45379 primary data records. [2025-09-23T22:16:03.962245] [DEBUG] [LOCAL ] APG: Loaded 50228 existing records from primary storage. [2025-09-23T22:16:03.962417] [INFO ] [MAIN ] APG: Loaded 50228 primary data records. [2025-09-23T22:16:04.331387] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:16:04.440335] [INFO ] [MAIN ] AP: Generated 1793 derivative records from 6975 primary records. [2025-09-23T22:16:04.454702] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-23T22:16:04.479685] [DEBUG] [LOCAL ] AP: Derivative data saved (1793 records). [2025-09-23T22:16:04.479959] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-23T22:16:04.502241] [INFO ] [MAIN ] Derivative Progress: 97/2077 symbols completed. AP took 1.2s. Estimated remaining: 13m 1s. Rate: 152.1 symbols/min [2025-09-23T22:16:04.503146] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:04.503832] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:04.505175] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45379 primary records. [2025-09-23T22:16:04.505554] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-23T22:16:04.525638] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-09-23T22:16:04.527565] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-23T22:16:04.529988] [INFO ] [MAIN ] Derivative Progress: 98/2077 symbols completed. APD took 1.1s. Estimated remaining: 12m 53s. Rate: 153.5 symbols/min [2025-09-23T22:16:04.530328] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:04.547907] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:04.548811] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50228 primary records. [2025-09-23T22:16:04.548999] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-23T22:16:04.566964] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-09-23T22:16:04.567208] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-23T22:16:04.569958] [INFO ] [MAIN ] Derivative Progress: 99/2077 symbols completed. APG took 1.1s. Estimated remaining: 12m 46s. Rate: 154.9 symbols/min [2025-09-23T22:16:04.570383] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:04.596369] [DEBUG] [LOCAL ] APOS: Loaded 7493 existing records from primary storage. [2025-09-23T22:16:04.596592] [INFO ] [MAIN ] APOS: Loaded 7493 primary data records. [2025-09-23T22:16:04.736480] [DEBUG] [LOCAL ] APLE: Loaded 52034 existing records from primary storage. [2025-09-23T22:16:04.736778] [INFO ] [MAIN ] APLE: Loaded 52034 primary data records. [2025-09-23T22:16:05.066415] [DEBUG] [LOCAL ] APO: Loaded 53386 existing records from primary storage. [2025-09-23T22:16:05.077567] [INFO ] [MAIN ] APO: Loaded 53386 primary data records. [2025-09-23T22:16:05.608699] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:05.609729] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7493 primary records. [2025-09-23T22:16:05.610248] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-23T22:16:05.644189] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:05.645816] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 52034 primary records. [2025-09-23T22:16:05.646210] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-09-23T22:16:05.646526] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-23T22:16:05.646619] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-23T22:16:05.649510] [INFO ] [MAIN ] Derivative Progress: 100/2077 symbols completed. APOS took 1.1s. Estimated remaining: 12m 59s. Rate: 152.2 symbols/min [2025-09-23T22:16:05.649859] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:05.681901] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:05.681597] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-09-23T22:16:05.682071] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-23T22:16:05.682768] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53386 primary records. [2025-09-23T22:16:05.684854] [INFO ] [MAIN ] Derivative Progress: 101/2077 symbols completed. APLE took 1.2s. Estimated remaining: 12m 52s. Rate: 153.6 symbols/min [2025-09-23T22:16:05.684984] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-23T22:16:05.686118] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:05.703672] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-09-23T22:16:05.703871] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-23T22:16:05.708602] [INFO ] [MAIN ] Derivative Progress: 102/2077 symbols completed. APO took 1.2s. Estimated remaining: 12m 44s. Rate: 155.0 symbols/min [2025-09-23T22:16:05.709071] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:05.716830] [DEBUG] [LOCAL ] AQNB: Loaded 4213 existing records from primary storage. [2025-09-23T22:16:05.730125] [INFO ] [MAIN ] AQNB: Loaded 4213 primary data records. [2025-09-23T22:16:05.864906] [DEBUG] [LOCAL ] APTV: Loaded 52221 existing records from primary storage. [2025-09-23T22:16:05.865546] [INFO ] [MAIN ] APTV: Loaded 52221 primary data records. [2025-09-23T22:16:06.191029] [DEBUG] [LOCAL ] AQN: Loaded 51946 existing records from primary storage. [2025-09-23T22:16:06.202684] [INFO ] [MAIN ] AQN: Loaded 51946 primary data records. [2025-09-23T22:16:06.728865] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:16:06.729829] [INFO ] [MAIN ] AQNB: Generated 1793 derivative records from 4213 primary records. [2025-09-23T22:16:06.731066] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-23T22:16:06.746972] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1793 records). [2025-09-23T22:16:06.748039] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-23T22:16:06.751350] [INFO ] [MAIN ] Derivative Progress: 103/2077 symbols completed. AQNB took 1.0s. Estimated remaining: 12m 57s. Rate: 152.5 symbols/min [2025-09-23T22:16:06.765747] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:06.766606] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52221 primary records. [2025-09-23T22:16:06.766741] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-23T22:16:06.793634] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:06.795326] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51946 primary records. [2025-09-23T22:16:06.795603] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-23T22:16:06.808263] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-09-23T22:16:06.811444] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-23T22:16:06.812431] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-09-23T22:16:06.814543] [INFO ] [MAIN ] Derivative Progress: 104/2077 symbols completed. APTV took 1.2s. Estimated remaining: 12m 50s. Rate: 153.7 symbols/min [2025-09-23T22:16:06.814821] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-23T22:16:06.817322] [INFO ] [MAIN ] Derivative Progress: 105/2077 symbols completed. AQN took 1.1s. Estimated remaining: 12m 42s. Rate: 155.2 symbols/min [2025-09-23T22:16:06.817869] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:06.817998] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:06.818307] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:06.834166] [DEBUG] [LOCAL ] ARDC: Loaded 14405 existing records from primary storage. [2025-09-23T22:16:06.834313] [INFO ] [MAIN ] ARDC: Loaded 14405 primary data records. [2025-09-23T22:16:07.188911] [DEBUG] [LOCAL ] ARCO: Loaded 44633 existing records from primary storage. [2025-09-23T22:16:07.189147] [INFO ] [MAIN ] ARCO: Loaded 44633 primary data records. [2025-09-23T22:16:07.189870] [DEBUG] [LOCAL ] AR: Loaded 53585 existing records from primary storage. [2025-09-23T22:16:07.222255] [INFO ] [MAIN ] AR: Loaded 53585 primary data records. [2025-09-23T22:16:07.884339] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:07.885384] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14405 primary records. [2025-09-23T22:16:07.885787] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-23T22:16:07.904111] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-09-23T22:16:07.904515] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-23T22:16:07.907056] [INFO ] [MAIN ] Derivative Progress: 106/2077 symbols completed. ARDC took 1.1s. Estimated remaining: 12m 55s. Rate: 152.6 symbols/min [2025-09-23T22:16:07.907668] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:07.933316] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:07.934868] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53585 primary records. [2025-09-23T22:16:07.935155] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-23T22:16:07.955883] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:07.961573] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44633 primary records. [2025-09-23T22:16:07.971506] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-23T22:16:07.971438] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-09-23T22:16:07.972461] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-23T22:16:07.975697] [INFO ] [MAIN ] Derivative Progress: 107/2077 symbols completed. AR took 1.2s. Estimated remaining: 12m 49s. Rate: 153.8 symbols/min [2025-09-23T22:16:07.976402] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:07.998040] [DEBUG] [LOCAL ] ARDT: Loaded 28224 existing records from primary storage. [2025-09-23T22:16:07.998691] [INFO ] [MAIN ] ARDT: Loaded 28224 primary data records. [2025-09-23T22:16:08.039704] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-09-23T22:16:08.059338] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-23T22:16:08.090730] [INFO ] [MAIN ] Derivative Progress: 108/2077 symbols completed. ARCO took 1.3s. Estimated remaining: 12m 43s. Rate: 154.8 symbols/min [2025-09-23T22:16:08.119110] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:08.362078] [DEBUG] [LOCAL ] ARE: Loaded 50634 existing records from primary storage. [2025-09-23T22:16:08.362465] [INFO ] [MAIN ] ARE: Loaded 50634 primary data records. [2025-09-23T22:16:08.689229] [DEBUG] [LOCAL ] ARES: Loaded 49614 existing records from primary storage. [2025-09-23T22:16:08.704436] [INFO ] [MAIN ] ARES: Loaded 49614 primary data records. [2025-09-23T22:16:08.787980] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:08.806003] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 28224 primary records. [2025-09-23T22:16:08.819706] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-23T22:16:08.917260] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-09-23T22:16:09.025484] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-23T22:16:09.036673] [INFO ] [MAIN ] Derivative Progress: 109/2077 symbols completed. ARDT took 1.1s. Estimated remaining: 12m 53s. Rate: 152.8 symbols/min [2025-09-23T22:16:09.037271] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:09.059812] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:09.060890] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50634 primary records. [2025-09-23T22:16:09.061132] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-23T22:16:09.102910] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:09.102667] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-09-23T22:16:09.103040] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-23T22:16:09.103719] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49614 primary records. [2025-09-23T22:16:09.106389] [INFO ] [MAIN ] Derivative Progress: 110/2077 symbols completed. ARE took 1.1s. Estimated remaining: 12m 47s. Rate: 153.9 symbols/min [2025-09-23T22:16:09.106797] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:09.106916] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-23T22:16:09.135861] [DEBUG] [LOCAL ] ARI: Loaded 43411 existing records from primary storage. [2025-09-23T22:16:09.137244] [INFO ] [MAIN ] ARI: Loaded 43411 primary data records. [2025-09-23T22:16:09.137118] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-09-23T22:16:09.137425] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-23T22:16:09.170911] [INFO ] [MAIN ] Derivative Progress: 111/2077 symbols completed. ARES took 1.1s. Estimated remaining: 12m 41s. Rate: 155.1 symbols/min [2025-09-23T22:16:09.182117] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:09.458296] [DEBUG] [LOCAL ] ARIS: Loaded 41981 existing records from primary storage. [2025-09-23T22:16:09.459109] [INFO ] [MAIN ] ARIS: Loaded 41981 primary data records. [2025-09-23T22:16:09.670267] [DEBUG] [LOCAL ] ARLO: Loaded 43939 existing records from primary storage. [2025-09-23T22:16:09.777421] [INFO ] [MAIN ] ARLO: Loaded 43939 primary data records. [2025-09-23T22:16:10.073792] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:10.199452] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43411 primary records. [2025-09-23T22:16:10.199929] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-23T22:16:10.219342] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-09-23T22:16:10.221423] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-23T22:16:10.225801] [INFO ] [MAIN ] Derivative Progress: 112/2077 symbols completed. ARI took 1.2s. Estimated remaining: 12m 52s. Rate: 152.7 symbols/min [2025-09-23T22:16:10.234586] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:10.240296] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:10.241106] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 41981 primary records. [2025-09-23T22:16:10.241784] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-23T22:16:10.259419] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-09-23T22:16:10.259870] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-23T22:16:10.262419] [INFO ] [MAIN ] Derivative Progress: 113/2077 symbols completed. ARIS took 1.2s. Estimated remaining: 12m 45s. Rate: 154.0 symbols/min [2025-09-23T22:16:10.262999] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:10.284896] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:10.285864] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43939 primary records. [2025-09-23T22:16:10.286015] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-23T22:16:10.326569] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-09-23T22:16:10.326770] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-23T22:16:10.329591] [INFO ] [MAIN ] Derivative Progress: 114/2077 symbols completed. ARLO took 1.2s. Estimated remaining: 12m 39s. Rate: 155.1 symbols/min [2025-09-23T22:16:10.330060] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:10.361860] [DEBUG] [LOCAL ] ARMK: Loaded 50336 existing records from primary storage. [2025-09-23T22:16:10.362145] [INFO ] [MAIN ] ARMK: Loaded 50336 primary data records. [2025-09-23T22:16:10.363006] [DEBUG] [LOCAL ] AROC: Loaded 48987 existing records from primary storage. [2025-09-23T22:16:10.375299] [INFO ] [MAIN ] AROC: Loaded 48987 primary data records. [2025-09-23T22:16:11.008997] [DEBUG] [LOCAL ] ARR: Loaded 52069 existing records from primary storage. [2025-09-23T22:16:11.009959] [INFO ] [MAIN ] ARR: Loaded 52069 primary data records. [2025-09-23T22:16:11.366565] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:11.380110] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50336 primary records. [2025-09-23T22:16:11.380619] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-23T22:16:11.382608] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:11.384158] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 48987 primary records. [2025-09-23T22:16:11.391615] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-23T22:16:11.401109] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-09-23T22:16:11.412691] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-23T22:16:11.418517] [INFO ] [MAIN ] Derivative Progress: 115/2077 symbols completed. ARMK took 1.2s. Estimated remaining: 12m 51s. Rate: 152.7 symbols/min [2025-09-23T22:16:11.420180] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:11.421554] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-09-23T22:16:11.422412] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-23T22:16:11.425210] [INFO ] [MAIN ] Derivative Progress: 116/2077 symbols completed. AROC took 1.2s. Estimated remaining: 12m 44s. Rate: 154.0 symbols/min [2025-09-23T22:16:11.425877] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:11.442736] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:11.443448] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52069 primary records. [2025-09-23T22:16:11.443602] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-23T22:16:11.460006] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-09-23T22:16:11.460071] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-23T22:16:11.462280] [INFO ] [MAIN ] Derivative Progress: 117/2077 symbols completed. ARR took 1.1s. Estimated remaining: 12m 38s. Rate: 155.2 symbols/min [2025-09-23T22:16:11.462620] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:11.509013] [DEBUG] [LOCAL ] ARW: Loaded 33212 existing records from primary storage. [2025-09-23T22:16:11.509488] [INFO ] [MAIN ] ARW: Loaded 33212 primary data records. [2025-09-23T22:16:11.509384] [DEBUG] [LOCAL ] ASA: Loaded 13773 existing records from primary storage. [2025-09-23T22:16:11.530692] [INFO ] [MAIN ] ASA: Loaded 13773 primary data records. [2025-09-23T22:16:11.734241] [DEBUG] [LOCAL ] AS: Loaded 53077 existing records from primary storage. [2025-09-23T22:16:11.761021] [INFO ] [MAIN ] AS: Loaded 53077 primary data records. [2025-09-23T22:16:12.512608] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:12.518419] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 13773 primary records. [2025-09-23T22:16:12.518633] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-23T22:16:12.517725] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:12.520016] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33212 primary records. [2025-09-23T22:16:12.520667] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-23T22:16:12.552465] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-09-23T22:16:12.554013] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-23T22:16:12.556581] [INFO ] [MAIN ] Derivative Progress: 118/2077 symbols completed. ARW took 1.1s. Estimated remaining: 12m 49s. Rate: 152.8 symbols/min [2025-09-23T22:16:12.570085] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-09-23T22:16:12.570452] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-23T22:16:12.570345] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:12.572791] [INFO ] [MAIN ] Derivative Progress: 119/2077 symbols completed. ASA took 1.1s. Estimated remaining: 12m 43s. Rate: 154.1 symbols/min [2025-09-23T22:16:12.573519] [INFO ] [MAIN ] AS: Generated 1794 derivative records from 53077 primary records. [2025-09-23T22:16:12.573743] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-23T22:16:12.588855] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-09-23T22:16:12.588917] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-23T22:16:12.591333] [INFO ] [MAIN ] Derivative Progress: 120/2077 symbols completed. AS took 1.2s. Estimated remaining: 12m 36s. Rate: 155.3 symbols/min [2025-09-23T22:16:12.591976] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:12.592069] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:12.592248] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:12.599262] [DEBUG] [LOCAL ] ASBA: Loaded 3438 existing records from primary storage. [2025-09-23T22:16:12.599475] [INFO ] [MAIN ] ASBA: Loaded 3438 primary data records. [2025-09-23T22:16:12.981218] [DEBUG] [LOCAL ] ASB: Loaded 49587 existing records from primary storage. [2025-09-23T22:16:12.980540] [DEBUG] [LOCAL ] ASAN: Loaded 52755 existing records from primary storage. [2025-09-23T22:16:12.982488] [INFO ] [MAIN ] ASAN: Loaded 52755 primary data records. [2025-09-23T22:16:12.982171] [INFO ] [MAIN ] ASB: Loaded 49587 primary data records. [2025-09-23T22:16:13.617779] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:13.619333] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3438 primary records. [2025-09-23T22:16:13.619551] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-23T22:16:13.637509] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-09-23T22:16:13.638086] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-23T22:16:13.640531] [INFO ] [MAIN ] Derivative Progress: 121/2077 symbols completed. ASBA took 1.0s. Estimated remaining: 12m 46s. Rate: 153.1 symbols/min [2025-09-23T22:16:13.641192] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:13.661521] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:13.662454] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52755 primary records. [2025-09-23T22:16:13.670214] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-23T22:16:13.675838] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:13.676847] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49587 primary records. [2025-09-23T22:16:13.676945] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-23T22:16:13.715846] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-09-23T22:16:13.716760] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-23T22:16:13.719503] [INFO ] [MAIN ] Derivative Progress: 122/2077 symbols completed. ASAN took 1.1s. Estimated remaining: 12m 41s. Rate: 154.1 symbols/min [2025-09-23T22:16:13.720774] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:13.721724] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-09-23T22:16:13.731178] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-23T22:16:13.734277] [INFO ] [MAIN ] Derivative Progress: 123/2077 symbols completed. ASB took 1.1s. Estimated remaining: 12m 35s. Rate: 155.3 symbols/min [2025-09-23T22:16:13.734631] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:13.735908] [DEBUG] [LOCAL ] ASC: Loaded 37756 existing records from primary storage. [2025-09-23T22:16:13.736105] [INFO ] [MAIN ] ASC: Loaded 37756 primary data records. [2025-09-23T22:16:13.923222] [DEBUG] [LOCAL ] ASGI: Loaded 22412 existing records from primary storage. [2025-09-23T22:16:13.945860] [INFO ] [MAIN ] ASGI: Loaded 22412 primary data records. [2025-09-23T22:16:13.946242] [DEBUG] [LOCAL ] ASG: Loaded 20570 existing records from primary storage. [2025-09-23T22:16:13.957730] [INFO ] [MAIN ] ASG: Loaded 20570 primary data records. [2025-09-23T22:16:14.748426] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:14.750379] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37756 primary records. [2025-09-23T22:16:14.750693] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-23T22:16:14.787102] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:14.801982] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22412 primary records. [2025-09-23T22:16:14.802505] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-23T22:16:14.805034] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:14.803902] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-09-23T22:16:14.817193] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 20570 primary records. [2025-09-23T22:16:14.819010] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-23T22:16:14.818930] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-23T22:16:14.821078] [INFO ] [MAIN ] Derivative Progress: 124/2077 symbols completed. ASC took 1.2s. Estimated remaining: 12m 45s. Rate: 153.1 symbols/min [2025-09-23T22:16:14.822845] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:14.824717] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-09-23T22:16:14.826021] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-23T22:16:14.835515] [INFO ] [MAIN ] Derivative Progress: 125/2077 symbols completed. ASGI took 1.1s. Estimated remaining: 12m 39s. Rate: 154.3 symbols/min [2025-09-23T22:16:14.836062] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:14.845997] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-09-23T22:16:14.846278] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-23T22:16:14.849247] [INFO ] [MAIN ] Derivative Progress: 126/2077 symbols completed. ASG took 1.1s. Estimated remaining: 12m 33s. Rate: 155.5 symbols/min [2025-09-23T22:16:14.849682] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:14.872837] [DEBUG] [LOCAL ] ASIX: Loaded 22480 existing records from primary storage. [2025-09-23T22:16:14.873517] [INFO ] [MAIN ] ASIX: Loaded 22480 primary data records. [2025-09-23T22:16:15.041174] [DEBUG] [LOCAL ] ASH: Loaded 37789 existing records from primary storage. [2025-09-23T22:16:15.095716] [INFO ] [MAIN ] ASH: Loaded 37789 primary data records. [2025-09-23T22:16:15.281508] [DEBUG] [LOCAL ] ASPN: Loaded 49610 existing records from primary storage. [2025-09-23T22:16:15.317074] [INFO ] [MAIN ] ASPN: Loaded 49610 primary data records. [2025-09-23T22:16:15.891272] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:15.893105] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22480 primary records. [2025-09-23T22:16:15.893221] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-23T22:16:15.910876] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-09-23T22:16:15.911253] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-23T22:16:15.913886] [INFO ] [MAIN ] Derivative Progress: 127/2077 symbols completed. ASIX took 1.1s. Estimated remaining: 12m 43s. Rate: 153.4 symbols/min [2025-09-23T22:16:15.914166] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:15.931735] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:15.932750] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37789 primary records. [2025-09-23T22:16:15.933017] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-23T22:16:15.954268] [DEBUG] [LOCAL ] ASR: Loaded 9238 existing records from primary storage. [2025-09-23T22:16:15.956346] [INFO ] [MAIN ] ASR: Loaded 9238 primary data records. [2025-09-23T22:16:16.031858] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-09-23T22:16:16.061589] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-23T22:16:16.070671] [INFO ] [MAIN ] Derivative Progress: 128/2077 symbols completed. ASH took 1.2s. Estimated remaining: 12m 39s. Rate: 154.1 symbols/min [2025-09-23T22:16:16.082961] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:16.079198] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:16.125970] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49610 primary records. [2025-09-23T22:16:16.141714] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-23T22:16:16.339189] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-09-23T22:16:16.340208] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-23T22:16:16.342983] [INFO ] [MAIN ] Derivative Progress: 129/2077 symbols completed. ASPN took 1.5s. Estimated remaining: 12m 37s. Rate: 154.4 symbols/min [2025-09-23T22:16:16.343358] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:16.386216] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:16:16.386899] [INFO ] [MAIN ] ASR: Generated 1792 derivative records from 9238 primary records. [2025-09-23T22:16:16.386963] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-23T22:16:16.419008] [DEBUG] [LOCAL ] ASR: Derivative data saved (1792 records). [2025-09-23T22:16:16.420573] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-23T22:16:16.434677] [INFO ] [MAIN ] Derivative Progress: 130/2077 symbols completed. ASR took 0.5s. Estimated remaining: 12m 32s. Rate: 155.4 symbols/min [2025-09-23T22:16:16.435043] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:16.420263] [DEBUG] [LOCAL ] ASX: Loaded 52890 existing records from primary storage. [2025-09-23T22:16:16.435361] [INFO ] [MAIN ] ASX: Loaded 52890 primary data records. [2025-09-23T22:16:16.558291] [DEBUG] [LOCAL ] ATEN: Loaded 39963 existing records from primary storage. [2025-09-23T22:16:16.558696] [INFO ] [MAIN ] ATEN: Loaded 39963 primary data records. [2025-09-23T22:16:16.770960] [DEBUG] [LOCAL ] ATGE: Loaded 32031 existing records from primary storage. [2025-09-23T22:16:16.887370] [INFO ] [MAIN ] ATGE: Loaded 32031 primary data records. [2025-09-23T22:16:17.445986] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:17.450613] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52890 primary records. [2025-09-23T22:16:17.464163] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:17.464298] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-23T22:16:17.465299] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 39963 primary records. [2025-09-23T22:16:17.467266] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-23T22:16:17.501877] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-09-23T22:16:17.502442] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-23T22:16:17.507068] [INFO ] [MAIN ] Derivative Progress: 131/2077 symbols completed. ATEN took 1.2s. Estimated remaining: 12m 42s. Rate: 153.3 symbols/min [2025-09-23T22:16:17.507348] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:17.520990] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-09-23T22:16:17.526210] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-23T22:16:17.526574] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:17.529735] [INFO ] [MAIN ] Derivative Progress: 132/2077 symbols completed. ASX took 1.4s. Estimated remaining: 12m 36s. Rate: 154.4 symbols/min [2025-09-23T22:16:17.530264] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:17.531673] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 32031 primary records. [2025-09-23T22:16:17.531776] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-23T22:16:17.551936] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-09-23T22:16:17.552267] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-23T22:16:17.555132] [INFO ] [MAIN ] Derivative Progress: 133/2077 symbols completed. ATGE took 1.1s. Estimated remaining: 12m 30s. Rate: 155.5 symbols/min [2025-09-23T22:16:17.567934] [DEBUG] [LOCAL ] ATHS: Loaded 7107 existing records from primary storage. [2025-09-23T22:16:17.568078] [INFO ] [MAIN ] ATHS: Loaded 7107 primary data records. [2025-09-23T22:16:17.689509] [DEBUG] [LOCAL ] ATHM: Loaded 32638 existing records from primary storage. [2025-09-23T22:16:17.700055] [INFO ] [MAIN ] ATHM: Loaded 32638 primary data records. [2025-09-23T22:16:18.318618] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:18.319775] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 7107 primary records. [2025-09-23T22:16:18.319950] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-23T22:16:18.350862] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:18.350960] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-09-23T22:16:18.351758] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 32638 primary records. [2025-09-23T22:16:18.351807] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-23T22:16:18.353974] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-23T22:16:18.353902] [INFO ] [MAIN ] Derivative Progress: 134/2077 symbols completed. ATHS took 0.8s. Estimated remaining: 12m 36s. Rate: 154.2 symbols/min [2025-09-23T22:16:18.369743] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-09-23T22:16:18.369859] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-23T22:16:18.372621] [INFO ] [MAIN ] Derivative Progress: 135/2077 symbols completed. ATHM took 0.9s. Estimated remaining: 12m 30s. Rate: 155.3 symbols/min [2025-09-23T22:16:18.373194] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:18.373340] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:18.373504] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:18.418962] [DEBUG] [LOCAL ] ATKR: Loaded 35702 existing records from primary storage. [2025-09-23T22:16:18.442713] [INFO ] [MAIN ] ATKR: Loaded 35702 primary data records. [2025-09-23T22:16:18.464986] [DEBUG] [LOCAL ] ATMU: Loaded 39751 existing records from primary storage. [2025-09-23T22:16:18.487710] [INFO ] [MAIN ] ATMU: Loaded 39751 primary data records. [2025-09-23T22:16:18.721318] [DEBUG] [LOCAL ] ATI: Loaded 51578 existing records from primary storage. [2025-09-23T22:16:18.885420] [INFO ] [MAIN ] ATI: Loaded 51578 primary data records. [2025-09-23T22:16:19.417990] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:19.419137] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35702 primary records. [2025-09-23T22:16:19.419423] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-23T22:16:19.446382] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:19.448278] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39751 primary records. [2025-09-23T22:16:19.448536] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-23T22:16:19.468288] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-09-23T22:16:19.468845] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-23T22:16:19.471256] [INFO ] [MAIN ] Derivative Progress: 136/2077 symbols completed. ATKR took 1.1s. Estimated remaining: 12m 40s. Rate: 153.3 symbols/min [2025-09-23T22:16:19.480017] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:19.486755] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:19.488982] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51578 primary records. [2025-09-23T22:16:19.490339] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-09-23T22:16:19.490699] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-23T22:16:19.490440] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-23T22:16:19.493725] [INFO ] [MAIN ] Derivative Progress: 137/2077 symbols completed. ATMU took 1.1s. Estimated remaining: 12m 34s. Rate: 154.3 symbols/min [2025-09-23T22:16:19.494382] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:19.510384] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-09-23T22:16:19.510585] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-23T22:16:19.513304] [INFO ] [MAIN ] Derivative Progress: 138/2077 symbols completed. ATI took 1.1s. Estimated remaining: 12m 29s. Rate: 155.4 symbols/min [2025-09-23T22:16:19.513705] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:19.548602] [DEBUG] [LOCAL ] ATS: Loaded 18001 existing records from primary storage. [2025-09-23T22:16:19.548831] [INFO ] [MAIN ] ATS: Loaded 18001 primary data records. [2025-09-23T22:16:19.631431] [DEBUG] [LOCAL ] ATR: Loaded 30488 existing records from primary storage. [2025-09-23T22:16:19.678037] [DEBUG] [LOCAL ] ATO: Loaded 41969 existing records from primary storage. [2025-09-23T22:16:19.659375] [INFO ] [MAIN ] ATR: Loaded 30488 primary data records. [2025-09-23T22:16:19.678302] [INFO ] [MAIN ] ATO: Loaded 41969 primary data records. [2025-09-23T22:16:20.629849] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:20.630876] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 18001 primary records. [2025-09-23T22:16:20.631130] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-23T22:16:20.670206] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:20.687531] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41969 primary records. [2025-09-23T22:16:20.688202] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-23T22:16:20.687409] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:20.690682] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30488 primary records. [2025-09-23T22:16:20.691061] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-23T22:16:20.693097] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-09-23T22:16:20.701955] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-23T22:16:20.712411] [INFO ] [MAIN ] Derivative Progress: 139/2077 symbols completed. ATS took 1.2s. Estimated remaining: 12m 40s. Rate: 153.1 symbols/min [2025-09-23T22:16:20.719514] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:20.729165] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-09-23T22:16:20.729816] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-09-23T22:16:20.729915] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-23T22:16:20.730009] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-23T22:16:20.732708] [INFO ] [MAIN ] Derivative Progress: 140/2077 symbols completed. ATO took 1.3s. Estimated remaining: 12m 34s. Rate: 154.1 symbols/min [2025-09-23T22:16:20.735724] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:20.735814] [INFO ] [MAIN ] Derivative Progress: 141/2077 symbols completed. ATR took 1.2s. Estimated remaining: 12m 28s. Rate: 155.2 symbols/min [2025-09-23T22:16:20.736592] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:20.743163] [DEBUG] [LOCAL ] AUNA: Loaded 4746 existing records from primary storage. [2025-09-23T22:16:20.743273] [INFO ] [MAIN ] AUNA: Loaded 4746 primary data records. [2025-09-23T22:16:21.111149] [DEBUG] [LOCAL ] AUB: Loaded 46455 existing records from primary storage. [2025-09-23T22:16:21.110301] [DEBUG] [LOCAL ] AU: Loaded 52932 existing records from primary storage. [2025-09-23T22:16:21.112524] [INFO ] [MAIN ] AU: Loaded 52932 primary data records. [2025-09-23T22:16:21.112272] [INFO ] [MAIN ] AUB: Loaded 46455 primary data records. [2025-09-23T22:16:21.774336] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:21.775380] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 4746 primary records. [2025-09-23T22:16:21.775803] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-23T22:16:21.793425] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-09-23T22:16:21.794023] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-23T22:16:21.797340] [INFO ] [MAIN ] Derivative Progress: 142/2077 symbols completed. AUNA took 1.1s. Estimated remaining: 12m 37s. Rate: 153.3 symbols/min [2025-09-23T22:16:21.797719] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:21.840134] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:21.842065] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52932 primary records. [2025-09-23T22:16:21.842228] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-23T22:16:21.841039] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:21.844084] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46455 primary records. [2025-09-23T22:16:21.844237] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-23T22:16:21.878461] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-09-23T22:16:21.881284] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-23T22:16:21.883919] [INFO ] [MAIN ] Derivative Progress: 143/2077 symbols completed. AU took 1.2s. Estimated remaining: 12m 33s. Rate: 154.2 symbols/min [2025-09-23T22:16:21.885057] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:21.903024] [DEBUG] [LOCAL ] AVA: Loaded 39654 existing records from primary storage. [2025-09-23T22:16:21.903619] [INFO ] [MAIN ] AVA: Loaded 39654 primary data records. [2025-09-23T22:16:21.946198] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-09-23T22:16:21.954084] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-23T22:16:21.974393] [INFO ] [MAIN ] Derivative Progress: 144/2077 symbols completed. AUB took 1.2s. Estimated remaining: 12m 28s. Rate: 155.0 symbols/min [2025-09-23T22:16:21.984448] [DEBUG] [LOCAL ] AVAL: Loaded 8950 existing records from primary storage. [2025-09-23T22:16:21.997766] [INFO ] [MAIN ] AVAL: Loaded 8950 primary data records. [2025-09-23T22:16:22.003188] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:22.631429] [DEBUG] [LOCAL ] AVB: Loaded 41728 existing records from primary storage. [2025-09-23T22:16:22.632105] [INFO ] [MAIN ] AVB: Loaded 41728 primary data records. [2025-09-23T22:16:22.844865] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:22.847751] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39654 primary records. [2025-09-23T22:16:22.958696] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-23T22:16:22.986779] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:22.987891] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8950 primary records. [2025-09-23T22:16:22.988218] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-23T22:16:23.019131] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-09-23T22:16:23.019781] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-23T22:16:23.021806] [INFO ] [MAIN ] Derivative Progress: 145/2077 symbols completed. AVA took 1.2s. Estimated remaining: 12m 37s. Rate: 153.2 symbols/min [2025-09-23T22:16:23.023295] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:23.026881] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-09-23T22:16:23.026974] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-23T22:16:23.030692] [INFO ] [MAIN ] Derivative Progress: 146/2077 symbols completed. AVAL took 1.1s. Estimated remaining: 12m 31s. Rate: 154.2 symbols/min [2025-09-23T22:16:23.031258] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:23.069435] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:23.070799] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 41728 primary records. [2025-09-23T22:16:23.069907] [DEBUG] [LOCAL ] AVD: Loaded 22934 existing records from primary storage. [2025-09-23T22:16:23.071006] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-23T22:16:23.071459] [INFO ] [MAIN ] AVD: Loaded 22934 primary data records. [2025-09-23T22:16:23.113898] [DEBUG] [LOCAL ] AVK: Loaded 17983 existing records from primary storage. [2025-09-23T22:16:23.147732] [INFO ] [MAIN ] AVK: Loaded 17983 primary data records. [2025-09-23T22:16:23.149209] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-09-23T22:16:23.201382] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-23T22:16:23.214005] [INFO ] [MAIN ] Derivative Progress: 147/2077 symbols completed. AVB took 1.2s. Estimated remaining: 12m 28s. Rate: 154.8 symbols/min [2025-09-23T22:16:23.253995] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:23.780566] [DEBUG] [LOCAL ] AVNS: Loaded 33579 existing records from primary storage. [2025-09-23T22:16:23.782499] [INFO ] [MAIN ] AVNS: Loaded 33579 primary data records. [2025-09-23T22:16:24.116453] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:24.118823] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22934 primary records. [2025-09-23T22:16:24.119016] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-23T22:16:24.140694] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:24.147911] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 17983 primary records. [2025-09-23T22:16:24.151544] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-23T22:16:24.152795] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-09-23T22:16:24.153052] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-23T22:16:24.163284] [INFO ] [MAIN ] Derivative Progress: 148/2077 symbols completed. AVD took 1.1s. Estimated remaining: 12m 35s. Rate: 153.3 symbols/min [2025-09-23T22:16:24.172568] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-09-23T22:16:24.172889] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-23T22:16:24.175522] [INFO ] [MAIN ] Derivative Progress: 149/2077 symbols completed. AVK took 1.1s. Estimated remaining: 12m 30s. Rate: 154.3 symbols/min [2025-09-23T22:16:24.192324] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:24.193013] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33579 primary records. [2025-09-23T22:16:24.193077] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-23T22:16:24.208441] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-09-23T22:16:24.208504] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-23T22:16:24.211055] [INFO ] [MAIN ] Derivative Progress: 150/2077 symbols completed. AVNS took 1.0s. Estimated remaining: 12m 25s. Rate: 155.2 symbols/min [2025-09-23T22:16:24.211670] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:24.211812] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:24.211930] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:24.247348] [DEBUG] [LOCAL ] AWF: Loaded 24324 existing records from primary storage. [2025-09-23T22:16:24.247675] [INFO ] [MAIN ] AWF: Loaded 24324 primary data records. [2025-09-23T22:16:24.430376] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-09-23T22:16:24.458755] [INFO ] [MAIN ] AVTR: Loaded 53567 primary data records. [2025-09-23T22:16:24.459992] [DEBUG] [LOCAL ] AVY: Loaded 37657 existing records from primary storage. [2025-09-23T22:16:24.535503] [INFO ] [MAIN ] AVY: Loaded 37657 primary data records. [2025-09-23T22:16:25.324758] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:25.325744] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24324 primary records. [2025-09-23T22:16:25.326163] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-23T22:16:25.348303] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-09-23T22:16:25.348477] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-23T22:16:25.350660] [INFO ] [MAIN ] Derivative Progress: 151/2077 symbols completed. AWF took 1.1s. Estimated remaining: 12m 34s. Rate: 153.2 symbols/min [2025-09-23T22:16:25.351062] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:25.364994] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:25.366274] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53567 primary records. [2025-09-23T22:16:25.366724] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-23T22:16:25.399845] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:25.407779] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-09-23T22:16:25.407975] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-23T22:16:25.411508] [INFO ] [MAIN ] Derivative Progress: 152/2077 symbols completed. AVTR took 1.2s. Estimated remaining: 12m 30s. Rate: 154.1 symbols/min [2025-09-23T22:16:25.408861] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37657 primary records. [2025-09-23T22:16:25.412108] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-23T22:16:25.412030] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:25.434638] [DEBUG] [LOCAL ] AWI: Loaded 26007 existing records from primary storage. [2025-09-23T22:16:25.435939] [INFO ] [MAIN ] AWI: Loaded 26007 primary data records. [2025-09-23T22:16:25.503548] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-09-23T22:16:25.533951] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-23T22:16:25.560328] [INFO ] [MAIN ] Derivative Progress: 153/2077 symbols completed. AVY took 1.3s. Estimated remaining: 12m 26s. Rate: 154.7 symbols/min [2025-09-23T22:16:25.582328] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:25.812990] [DEBUG] [LOCAL ] AWK: Loaded 48832 existing records from primary storage. [2025-09-23T22:16:25.813789] [INFO ] [MAIN ] AWK: Loaded 48832 primary data records. [2025-09-23T22:16:25.878973] [DEBUG] [LOCAL ] AWP: Loaded 21785 existing records from primary storage. [2025-09-23T22:16:25.911273] [INFO ] [MAIN ] AWP: Loaded 21785 primary data records. [2025-09-23T22:16:26.495586] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:26.496799] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 26007 primary records. [2025-09-23T22:16:26.497197] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-23T22:16:26.531612] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-09-23T22:16:26.532165] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-23T22:16:26.532440] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:26.534808] [INFO ] [MAIN ] Derivative Progress: 154/2077 symbols completed. AWI took 1.2s. Estimated remaining: 12m 33s. Rate: 153.2 symbols/min [2025-09-23T22:16:26.535540] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48832 primary records. [2025-09-23T22:16:26.535986] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-23T22:16:26.536242] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:26.556516] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-09-23T22:16:26.556812] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-23T22:16:26.559182] [INFO ] [MAIN ] Derivative Progress: 155/2077 symbols completed. AWK took 1.1s. Estimated remaining: 12m 28s. Rate: 154.2 symbols/min [2025-09-23T22:16:26.567137] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:26.572597] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:26.573283] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21785 primary records. [2025-09-23T22:16:26.573470] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-23T22:16:26.602371] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-09-23T22:16:26.602295] [DEBUG] [LOCAL ] AWR: Loaded 22614 existing records from primary storage. [2025-09-23T22:16:26.602635] [INFO ] [MAIN ] AWR: Loaded 22614 primary data records. [2025-09-23T22:16:26.602565] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-23T22:16:26.626263] [INFO ] [MAIN ] Derivative Progress: 156/2077 symbols completed. AWP took 1.0s. Estimated remaining: 12m 24s. Rate: 155.0 symbols/min [2025-09-23T22:16:26.682376] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:26.777599] [DEBUG] [LOCAL ] AX: Loaded 28637 existing records from primary storage. [2025-09-23T22:16:26.908729] [INFO ] [MAIN ] AX: Loaded 28637 primary data records. [2025-09-23T22:16:27.277698] [DEBUG] [LOCAL ] AXL: Loaded 50505 existing records from primary storage. [2025-09-23T22:16:27.292251] [INFO ] [MAIN ] AXL: Loaded 50505 primary data records. [2025-09-23T22:16:27.417019] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:27.443614] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22614 primary records. [2025-09-23T22:16:27.465191] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-23T22:16:27.633146] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-09-23T22:16:27.633487] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-23T22:16:27.637533] [INFO ] [MAIN ] Derivative Progress: 157/2077 symbols completed. AWR took 1.1s. Estimated remaining: 12m 31s. Rate: 153.4 symbols/min [2025-09-23T22:16:27.638630] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:27.654573] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:27.656407] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28637 primary records. [2025-09-23T22:16:27.656794] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-23T22:16:27.678839] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-09-23T22:16:27.692712] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-23T22:16:27.693014] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:27.695395] [INFO ] [MAIN ] Derivative Progress: 158/2077 symbols completed. AX took 1.1s. Estimated remaining: 12m 27s. Rate: 154.2 symbols/min [2025-09-23T22:16:27.696291] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50505 primary records. [2025-09-23T22:16:27.696426] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-23T22:16:27.696611] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:27.722551] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-09-23T22:16:27.722902] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-23T22:16:27.726108] [INFO ] [MAIN ] Derivative Progress: 159/2077 symbols completed. AXL took 1.1s. Estimated remaining: 12m 22s. Rate: 155.1 symbols/min [2025-09-23T22:16:27.726841] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:27.739323] [DEBUG] [LOCAL ] AXS: Loaded 38262 existing records from primary storage. [2025-09-23T22:16:27.739606] [INFO ] [MAIN ] AXS: Loaded 38262 primary data records. [2025-09-23T22:16:28.075600] [DEBUG] [LOCAL ] AYI: Loaded 25239 existing records from primary storage. [2025-09-23T22:16:28.089812] [INFO ] [MAIN ] AYI: Loaded 25239 primary data records. [2025-09-23T22:16:28.183605] [DEBUG] [LOCAL ] AXTA: Loaded 52056 existing records from primary storage. [2025-09-23T22:16:28.212579] [INFO ] [MAIN ] AXTA: Loaded 52056 primary data records. [2025-09-23T22:16:28.805947] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:28.807461] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38262 primary records. [2025-09-23T22:16:28.807608] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-23T22:16:28.830589] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-09-23T22:16:28.830746] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-23T22:16:28.833281] [INFO ] [MAIN ] Derivative Progress: 160/2077 symbols completed. AXS took 1.2s. Estimated remaining: 12m 30s. Rate: 153.3 symbols/min [2025-09-23T22:16:28.833916] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:28.851416] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:28.852592] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25239 primary records. [2025-09-23T22:16:28.852821] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-23T22:16:28.877837] [DEBUG] [LOCAL ] AZO: Loaded 11496 existing records from primary storage. [2025-09-23T22:16:28.878094] [INFO ] [MAIN ] AZO: Loaded 11496 primary data records. [2025-09-23T22:16:28.950233] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:28.960619] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52056 primary records. [2025-09-23T22:16:28.965921] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-23T22:16:28.979145] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-09-23T22:16:28.992582] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-23T22:16:29.017901] [INFO ] [MAIN ] Derivative Progress: 161/2077 symbols completed. AYI took 1.3s. Estimated remaining: 12m 27s. Rate: 153.8 symbols/min [2025-09-23T22:16:29.034634] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:29.229668] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-09-23T22:16:29.229914] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-23T22:16:29.232577] [INFO ] [MAIN ] Derivative Progress: 162/2077 symbols completed. AXTA took 1.5s. Estimated remaining: 12m 25s. Rate: 154.3 symbols/min [2025-09-23T22:16:29.233112] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:29.251343] [DEBUG] [LOCAL ] AZZ: Loaded 22139 existing records from primary storage. [2025-09-23T22:16:29.253425] [INFO ] [MAIN ] AZZ: Loaded 22139 primary data records. [2025-09-23T22:16:29.477301] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:29.598105] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11496 primary records. [2025-09-23T22:16:29.616814] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-23T22:16:29.650145] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-23T22:16:29.651397] [INFO ] [MAIN ] BA: Loaded 53791 primary data records. [2025-09-23T22:16:29.705805] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-09-23T22:16:29.724822] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-23T22:16:29.740755] [INFO ] [MAIN ] Derivative Progress: 163/2077 symbols completed. AZO took 0.9s. Estimated remaining: 12m 26s. Rate: 154.0 symbols/min [2025-09-23T22:16:30.003287] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:30.004537] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22139 primary records. [2025-09-23T22:16:30.004684] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-23T22:16:30.024893] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-09-23T22:16:30.025293] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-23T22:16:30.028138] [INFO ] [MAIN ] Derivative Progress: 164/2077 symbols completed. AZZ took 1.0s. Estimated remaining: 12m 24s. Rate: 154.2 symbols/min [2025-09-23T22:16:30.049432] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:30.050153] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53791 primary records. [2025-09-23T22:16:30.050216] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-23T22:16:30.066595] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-09-23T22:16:30.066723] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-23T22:16:30.068921] [INFO ] [MAIN ] Derivative Progress: 165/2077 symbols completed. BA took 0.8s. Estimated remaining: 12m 20s. Rate: 155.1 symbols/min [2025-09-23T22:16:30.069451] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:30.069613] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:30.069793] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:30.111143] [DEBUG] [LOCAL ] BAK: Loaded 38785 existing records from primary storage. [2025-09-23T22:16:30.137810] [INFO ] [MAIN ] BAK: Loaded 38785 primary data records. [2025-09-23T22:16:30.317077] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-23T22:16:30.322423] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-09-23T22:16:30.305368] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-23T22:16:30.354935] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-09-23T22:16:31.258897] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:31.260097] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 38785 primary records. [2025-09-23T22:16:31.260346] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-23T22:16:31.294551] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-09-23T22:16:31.295518] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:31.295732] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-23T22:16:31.298557] [INFO ] [MAIN ] Derivative Progress: 166/2077 symbols completed. BAK took 1.2s. Estimated remaining: 12m 29s. Rate: 153.1 symbols/min [2025-09-23T22:16:31.298894] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:31.296569] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-09-23T22:16:31.299592] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-23T22:16:31.313114] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:31.314116] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-09-23T22:16:31.322363] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-23T22:16:31.346571] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-09-23T22:16:31.347776] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-23T22:16:31.351105] [INFO ] [MAIN ] Derivative Progress: 167/2077 symbols completed. BAC took 1.3s. Estimated remaining: 12m 25s. Rate: 153.9 symbols/min [2025-09-23T22:16:31.351750] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-09-23T22:16:31.351837] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-23T22:16:31.355254] [INFO ] [MAIN ] Derivative Progress: 168/2077 symbols completed. BABA took 1.3s. Estimated remaining: 12m 20s. Rate: 154.8 symbols/min [2025-09-23T22:16:31.355194] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:31.355468] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:31.406053] [DEBUG] [LOCAL ] BALL: Loaded 51815 existing records from primary storage. [2025-09-23T22:16:31.406365] [INFO ] [MAIN ] BALL: Loaded 51815 primary data records. [2025-09-23T22:16:31.584490] [DEBUG] [LOCAL ] BANC: Loaded 51262 existing records from primary storage. [2025-09-23T22:16:31.603174] [INFO ] [MAIN ] BANC: Loaded 51262 primary data records. [2025-09-23T22:16:31.825151] [DEBUG] [LOCAL ] BAM: Loaded 52005 existing records from primary storage. [2025-09-23T22:16:31.850125] [INFO ] [MAIN ] BAM: Loaded 52005 primary data records. [2025-09-23T22:16:32.446289] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:32.448148] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51815 primary records. [2025-09-23T22:16:32.448383] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-23T22:16:32.471636] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-09-23T22:16:32.472125] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-23T22:16:32.475282] [INFO ] [MAIN ] Derivative Progress: 169/2077 symbols completed. BALL took 1.2s. Estimated remaining: 12m 28s. Rate: 153.1 symbols/min [2025-09-23T22:16:32.489011] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:32.488824] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:32.490153] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51262 primary records. [2025-09-23T22:16:32.490295] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-23T22:16:32.509288] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-09-23T22:16:32.517215] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-23T22:16:32.519312] [INFO ] [MAIN ] Derivative Progress: 170/2077 symbols completed. BANC took 1.2s. Estimated remaining: 12m 24s. Rate: 153.9 symbols/min [2025-09-23T22:16:32.525370] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:32.525170] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:32.526607] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52005 primary records. [2025-09-23T22:16:32.526872] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-23T22:16:32.550235] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-09-23T22:16:32.550535] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-23T22:16:32.553296] [INFO ] [MAIN ] Derivative Progress: 171/2077 symbols completed. BAM took 1.2s. Estimated remaining: 12m 19s. Rate: 154.7 symbols/min [2025-09-23T22:16:32.554373] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:32.562784] [DEBUG] [LOCAL ] BAP: Loaded 26398 existing records from primary storage. [2025-09-23T22:16:32.563165] [INFO ] [MAIN ] BAP: Loaded 26398 primary data records. [2025-09-23T22:16:32.884083] [DEBUG] [LOCAL ] BARK: Loaded 38517 existing records from primary storage. [2025-09-23T22:16:33.000076] [INFO ] [MAIN ] BARK: Loaded 38517 primary data records. [2025-09-23T22:16:33.136847] [DEBUG] [LOCAL ] BAX: Loaded 53493 existing records from primary storage. [2025-09-23T22:16:33.137167] [INFO ] [MAIN ] BAX: Loaded 53493 primary data records. [2025-09-23T22:16:33.704667] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:33.705892] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26398 primary records. [2025-09-23T22:16:33.706336] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-23T22:16:33.731625] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-09-23T22:16:33.745190] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:33.744630] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-23T22:16:33.746329] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38517 primary records. [2025-09-23T22:16:33.748935] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-23T22:16:33.748686] [INFO ] [MAIN ] Derivative Progress: 172/2077 symbols completed. BAP took 1.3s. Estimated remaining: 12m 28s. Rate: 152.8 symbols/min [2025-09-23T22:16:33.749496] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:33.770076] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-09-23T22:16:33.771129] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-23T22:16:33.773634] [INFO ] [MAIN ] Derivative Progress: 173/2077 symbols completed. BARK took 1.2s. Estimated remaining: 12m 23s. Rate: 153.7 symbols/min [2025-09-23T22:16:33.774110] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:33.787731] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:33.788590] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53493 primary records. [2025-09-23T22:16:33.788858] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-23T22:16:33.805147] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-09-23T22:16:33.805223] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-23T22:16:33.807943] [INFO ] [MAIN ] Derivative Progress: 174/2077 symbols completed. BAX took 1.3s. Estimated remaining: 12m 19s. Rate: 154.5 symbols/min [2025-09-23T22:16:33.808421] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:33.858814] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-23T22:16:33.859083] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-09-23T22:16:34.001708] [DEBUG] [LOCAL ] BBAR: Loaded 41265 existing records from primary storage. [2025-09-23T22:16:34.028721] [INFO ] [MAIN ] BBAR: Loaded 41265 primary data records. [2025-09-23T22:16:34.255723] [DEBUG] [LOCAL ] BBD: Loaded 53181 existing records from primary storage. [2025-09-23T22:16:34.290403] [INFO ] [MAIN ] BBD: Loaded 53181 primary data records. [2025-09-23T22:16:35.044428] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:35.046262] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-09-23T22:16:35.046443] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-23T22:16:35.075324] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-09-23T22:16:35.075910] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-23T22:16:35.078980] [INFO ] [MAIN ] Derivative Progress: 175/2077 symbols completed. BBAI took 1.3s. Estimated remaining: 12m 28s. Rate: 152.5 symbols/min [2025-09-23T22:16:35.080097] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:35.092867] [DEBUG] [LOCAL ] BBDO: Loaded 5032 existing records from primary storage. [2025-09-23T22:16:35.115708] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:35.114947] [INFO ] [MAIN ] BBDO: Loaded 5032 primary data records. [2025-09-23T22:16:35.118257] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41265 primary records. [2025-09-23T22:16:35.126236] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-23T22:16:35.219441] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:35.248374] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53181 primary records. [2025-09-23T22:16:35.283280] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-09-23T22:16:35.283439] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-23T22:16:35.283611] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-23T22:16:35.287839] [INFO ] [MAIN ] Derivative Progress: 176/2077 symbols completed. BBAR took 1.5s. Estimated remaining: 12m 26s. Rate: 152.9 symbols/min [2025-09-23T22:16:35.293875] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:35.444512] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-09-23T22:16:35.486146] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-23T22:16:35.498093] [INFO ] [MAIN ] Derivative Progress: 177/2077 symbols completed. BBD took 1.7s. Estimated remaining: 12m 24s. Rate: 153.3 symbols/min [2025-09-23T22:16:35.523186] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:35.716274] [DEBUG] [LOCAL ] BBN: Loaded 18034 existing records from primary storage. [2025-09-23T22:16:35.735345] [INFO ] [MAIN ] BBN: Loaded 18034 primary data records. [2025-09-23T22:16:35.784980] [DEBUG] [LOCAL ] BBU: Loaded 4116 existing records from primary storage. [2025-09-23T22:16:35.829400] [INFO ] [MAIN ] BBU: Loaded 4116 primary data records. [2025-09-23T22:16:36.520482] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:36.521686] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 5032 primary records. [2025-09-23T22:16:36.523552] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-23T22:16:36.544873] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-09-23T22:16:36.545901] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-23T22:16:36.550175] [INFO ] [MAIN ] Derivative Progress: 178/2077 symbols completed. BBDO took 1.5s. Estimated remaining: 12m 30s. Rate: 151.9 symbols/min [2025-09-23T22:16:36.564881] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:36.565781] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18034 primary records. [2025-09-23T22:16:36.565939] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-23T22:16:36.582581] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-09-23T22:16:36.582755] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-23T22:16:36.585427] [INFO ] [MAIN ] Derivative Progress: 179/2077 symbols completed. BBN took 1.3s. Estimated remaining: 12m 26s. Rate: 152.7 symbols/min [2025-09-23T22:16:36.601401] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:36.602116] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 4116 primary records. [2025-09-23T22:16:36.602180] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-23T22:16:36.617113] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-09-23T22:16:36.617205] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-23T22:16:36.620011] [INFO ] [MAIN ] Derivative Progress: 180/2077 symbols completed. BBU took 1.1s. Estimated remaining: 12m 22s. Rate: 153.4 symbols/min [2025-09-23T22:16:36.620917] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:36.620760] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:36.621591] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:36.638861] [DEBUG] [LOCAL ] BBUC: Loaded 13148 existing records from primary storage. [2025-09-23T22:16:36.639132] [INFO ] [MAIN ] BBUC: Loaded 13148 primary data records. [2025-09-23T22:16:36.785378] [DEBUG] [LOCAL ] BBW: Loaded 26671 existing records from primary storage. [2025-09-23T22:16:36.785683] [INFO ] [MAIN ] BBW: Loaded 26671 primary data records. [2025-09-23T22:16:36.999437] [DEBUG] [LOCAL ] BBVA: Loaded 49510 existing records from primary storage. [2025-09-23T22:16:37.119821] [INFO ] [MAIN ] BBVA: Loaded 49510 primary data records. [2025-09-23T22:16:37.743209] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:37.744678] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13148 primary records. [2025-09-23T22:16:37.745088] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-23T22:16:37.773041] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-09-23T22:16:37.786052] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-23T22:16:37.789291] [INFO ] [MAIN ] Derivative Progress: 181/2077 symbols completed. BBUC took 1.2s. Estimated remaining: 12m 30s. Rate: 151.8 symbols/min [2025-09-23T22:16:37.786883] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:37.790848] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:37.790752] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26671 primary records. [2025-09-23T22:16:37.791284] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-23T22:16:37.829017] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:37.830350] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49510 primary records. [2025-09-23T22:16:37.830965] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-23T22:16:37.840941] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-09-23T22:16:37.844357] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-23T22:16:37.847237] [INFO ] [MAIN ] Derivative Progress: 182/2077 symbols completed. BBW took 1.2s. Estimated remaining: 12m 26s. Rate: 152.5 symbols/min [2025-09-23T22:16:37.848749] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:37.854111] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-09-23T22:16:37.854317] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-23T22:16:37.857688] [INFO ] [MAIN ] Derivative Progress: 183/2077 symbols completed. BBVA took 1.2s. Estimated remaining: 12m 21s. Rate: 153.3 symbols/min [2025-09-23T22:16:37.858213] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:37.898111] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-09-23T22:16:37.898383] [INFO ] [MAIN ] BBWI: Loaded 53580 primary data records. [2025-09-23T22:16:38.249184] [DEBUG] [LOCAL ] BC: Loaded 44506 existing records from primary storage. [2025-09-23T22:16:38.254567] [INFO ] [MAIN ] BC: Loaded 44506 primary data records. [2025-09-23T22:16:38.284821] [DEBUG] [LOCAL ] BBY: Loaded 53480 existing records from primary storage. [2025-09-23T22:16:38.308375] [INFO ] [MAIN ] BBY: Loaded 53480 primary data records. [2025-09-23T22:16:38.920024] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:38.920958] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53580 primary records. [2025-09-23T22:16:38.921391] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-23T22:16:38.948195] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-09-23T22:16:38.948558] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-23T22:16:38.951429] [INFO ] [MAIN ] Derivative Progress: 184/2077 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 28s. Rate: 151.8 symbols/min [2025-09-23T22:16:38.953137] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:38.967848] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:38.969617] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44506 primary records. [2025-09-23T22:16:38.969808] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-23T22:16:38.996909] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:39.000447] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-09-23T22:16:39.001667] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-23T22:16:39.001404] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53480 primary records. [2025-09-23T22:16:39.004196] [INFO ] [MAIN ] Derivative Progress: 185/2077 symbols completed. BC took 1.1s. Estimated remaining: 12m 24s. Rate: 152.5 symbols/min [2025-09-23T22:16:39.004485] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-23T22:16:39.005120] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:39.034147] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-09-23T22:16:39.035744] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-23T22:16:39.038604] [INFO ] [MAIN ] Derivative Progress: 186/2077 symbols completed. BBY took 1.2s. Estimated remaining: 12m 20s. Rate: 153.3 symbols/min [2025-09-23T22:16:39.039638] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:39.058536] [DEBUG] [LOCAL ] BCAT: Loaded 34488 existing records from primary storage. [2025-09-23T22:16:39.058829] [INFO ] [MAIN ] BCAT: Loaded 34488 primary data records. [2025-09-23T22:16:39.181275] [DEBUG] [LOCAL ] BCC: Loaded 28407 existing records from primary storage. [2025-09-23T22:16:39.197894] [INFO ] [MAIN ] BCC: Loaded 28407 primary data records. [2025-09-23T22:16:39.584422] [DEBUG] [LOCAL ] BCE: Loaded 52350 existing records from primary storage. [2025-09-23T22:16:39.621005] [INFO ] [MAIN ] BCE: Loaded 52350 primary data records. [2025-09-23T22:16:40.136552] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:40.138091] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34488 primary records. [2025-09-23T22:16:40.138323] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-23T22:16:40.173035] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:16:40.174969] [INFO ] [MAIN ] BCC: Generated 1793 derivative records from 28407 primary records. [2025-09-23T22:16:40.175250] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-09-23T22:16:40.175358] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-23T22:16:40.175706] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-23T22:16:40.178083] [INFO ] [MAIN ] Derivative Progress: 187/2077 symbols completed. BCAT took 1.2s. Estimated remaining: 12m 27s. Rate: 151.7 symbols/min [2025-09-23T22:16:40.194482] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:40.195380] [DEBUG] [LOCAL ] BCC: Derivative data saved (1793 records). [2025-09-23T22:16:40.195632] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-23T22:16:40.198520] [INFO ] [MAIN ] Derivative Progress: 188/2077 symbols completed. BCC took 1.2s. Estimated remaining: 12m 23s. Rate: 152.5 symbols/min [2025-09-23T22:16:40.199479] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:40.216479] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:40.217304] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52350 primary records. [2025-09-23T22:16:40.217401] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-23T22:16:40.254112] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-09-23T22:16:40.254310] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-23T22:16:40.257940] [INFO ] [MAIN ] Derivative Progress: 189/2077 symbols completed. BCE took 1.2s. Estimated remaining: 12m 20s. Rate: 153.2 symbols/min [2025-09-23T22:16:40.259024] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:40.269731] [DEBUG] [LOCAL ] BCH: Loaded 29617 existing records from primary storage. [2025-09-23T22:16:40.270121] [INFO ] [MAIN ] BCH: Loaded 29617 primary data records. [2025-09-23T22:16:40.326136] [DEBUG] [LOCAL ] BCSF: Loaded 27779 existing records from primary storage. [2025-09-23T22:16:40.348591] [INFO ] [MAIN ] BCSF: Loaded 27779 primary data records. [2025-09-23T22:16:40.618177] [DEBUG] [LOCAL ] BCX: Loaded 21721 existing records from primary storage. [2025-09-23T22:16:40.751843] [INFO ] [MAIN ] BCX: Loaded 21721 primary data records. [2025-09-23T22:16:41.282042] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:41.290904] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 29617 primary records. [2025-09-23T22:16:41.291396] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-23T22:16:41.297882] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:41.300013] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27779 primary records. [2025-09-23T22:16:41.300255] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-23T22:16:41.333113] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-09-23T22:16:41.334166] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-09-23T22:16:41.334425] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-23T22:16:41.334319] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-23T22:16:41.337327] [INFO ] [MAIN ] Derivative Progress: 190/2077 symbols completed. BCSF took 1.1s. Estimated remaining: 12m 26s. Rate: 151.8 symbols/min [2025-09-23T22:16:41.340184] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:41.340395] [INFO ] [MAIN ] Derivative Progress: 191/2077 symbols completed. BCH took 1.2s. Estimated remaining: 12m 22s. Rate: 152.6 symbols/min [2025-09-23T22:16:41.341152] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:41.357718] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:41.358448] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21721 primary records. [2025-09-23T22:16:41.358584] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-23T22:16:41.387287] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-09-23T22:16:41.387363] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-23T22:16:41.389986] [INFO ] [MAIN ] Derivative Progress: 192/2077 symbols completed. BCX took 1.1s. Estimated remaining: 12m 18s. Rate: 153.3 symbols/min [2025-09-23T22:16:41.390361] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:41.410631] [DEBUG] [LOCAL ] BDC: Loaded 24877 existing records from primary storage. [2025-09-23T22:16:41.411210] [DEBUG] [LOCAL ] BDJ: Loaded 28925 existing records from primary storage. [2025-09-23T22:16:41.411357] [INFO ] [MAIN ] BDJ: Loaded 28925 primary data records. [2025-09-23T22:16:41.411466] [INFO ] [MAIN ] BDC: Loaded 24877 primary data records. [2025-09-23T22:16:42.100128] [DEBUG] [LOCAL ] BDN: Loaded 47615 existing records from primary storage. [2025-09-23T22:16:42.100451] [INFO ] [MAIN ] BDN: Loaded 47615 primary data records. [2025-09-23T22:16:42.441700] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:42.450619] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 28925 primary records. [2025-09-23T22:16:42.456088] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:42.455755] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-23T22:16:42.457183] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24877 primary records. [2025-09-23T22:16:42.458581] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-23T22:16:42.486579] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-09-23T22:16:42.487177] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-23T22:16:42.489441] [INFO ] [MAIN ] Derivative Progress: 193/2077 symbols completed. BDJ took 1.1s. Estimated remaining: 12m 24s. Rate: 151.8 symbols/min [2025-09-23T22:16:42.494839] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-09-23T22:16:42.495885] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-23T22:16:42.498862] [INFO ] [MAIN ] Derivative Progress: 194/2077 symbols completed. BDC took 1.2s. Estimated remaining: 12m 20s. Rate: 152.6 symbols/min [2025-09-23T22:16:42.513258] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:42.513876] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47615 primary records. [2025-09-23T22:16:42.513938] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-23T22:16:42.528707] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-09-23T22:16:42.528768] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-23T22:16:42.531429] [INFO ] [MAIN ] Derivative Progress: 195/2077 symbols completed. BDN took 1.1s. Estimated remaining: 12m 16s. Rate: 153.3 symbols/min [2025-09-23T22:16:42.532155] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:42.531997] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:42.532108] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:42.629436] [DEBUG] [LOCAL ] BEKE: Loaded 53257 existing records from primary storage. [2025-09-23T22:16:42.643825] [INFO ] [MAIN ] BEKE: Loaded 53257 primary data records. [2025-09-23T22:16:42.645248] [DEBUG] [LOCAL ] BDX: Loaded 52492 existing records from primary storage. [2025-09-23T22:16:42.645460] [INFO ] [MAIN ] BDX: Loaded 52492 primary data records. [2025-09-23T22:16:42.644608] [DEBUG] [LOCAL ] BEN: Loaded 53062 existing records from primary storage. [2025-09-23T22:16:42.693015] [INFO ] [MAIN ] BEN: Loaded 53062 primary data records. [2025-09-23T22:16:43.691491] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:43.697791] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52492 primary records. [2025-09-23T22:16:43.698821] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-23T22:16:43.696998] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:43.699626] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53257 primary records. [2025-09-23T22:16:43.702097] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-23T22:16:43.740607] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:43.744503] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53062 primary records. [2025-09-23T22:16:43.745446] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-23T22:16:43.748600] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-09-23T22:16:43.757091] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-23T22:16:43.761187] [INFO ] [MAIN ] Derivative Progress: 196/2077 symbols completed. BDX took 1.2s. Estimated remaining: 12m 24s. Rate: 151.7 symbols/min [2025-09-23T22:16:43.764612] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-09-23T22:16:43.765265] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-23T22:16:43.764843] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:43.768182] [INFO ] [MAIN ] Derivative Progress: 197/2077 symbols completed. BEKE took 1.2s. Estimated remaining: 12m 20s. Rate: 152.4 symbols/min [2025-09-23T22:16:43.769721] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:43.774592] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-09-23T22:16:43.774757] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-23T22:16:43.777980] [INFO ] [MAIN ] Derivative Progress: 198/2077 symbols completed. BEN took 1.2s. Estimated remaining: 12m 16s. Rate: 153.2 symbols/min [2025-09-23T22:16:43.778364] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:43.789130] [DEBUG] [LOCAL ] BEPH: Loaded 5122 existing records from primary storage. [2025-09-23T22:16:43.789323] [INFO ] [MAIN ] BEPH: Loaded 5122 primary data records. [2025-09-23T22:16:44.140346] [DEBUG] [LOCAL ] BEP: Loaded 38607 existing records from primary storage. [2025-09-23T22:16:44.141174] [DEBUG] [LOCAL ] BEPC: Loaded 46516 existing records from primary storage. [2025-09-23T22:16:44.146510] [INFO ] [MAIN ] BEP: Loaded 38607 primary data records. [2025-09-23T22:16:44.155117] [INFO ] [MAIN ] BEPC: Loaded 46516 primary data records. [2025-09-23T22:16:44.826807] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:44.827836] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5122 primary records. [2025-09-23T22:16:44.827974] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-23T22:16:44.848892] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-09-23T22:16:44.849488] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-23T22:16:44.851811] [INFO ] [MAIN ] Derivative Progress: 199/2077 symbols completed. BEPH took 1.1s. Estimated remaining: 12m 22s. Rate: 151.9 symbols/min [2025-09-23T22:16:44.852349] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:44.875692] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:44.879163] [DEBUG] [LOCAL ] BEPJ: Loaded 3259 existing records from primary storage. [2025-09-23T22:16:44.878980] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46516 primary records. [2025-09-23T22:16:44.879424] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-23T22:16:44.879595] [INFO ] [MAIN ] BEPJ: Loaded 3259 primary data records. [2025-09-23T22:16:44.904693] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:44.950745] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38607 primary records. [2025-09-23T22:16:44.958615] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-23T22:16:44.978080] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-09-23T22:16:44.983776] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-23T22:16:44.986108] [INFO ] [MAIN ] Derivative Progress: 200/2077 symbols completed. BEPC took 1.2s. Estimated remaining: 12m 19s. Rate: 152.4 symbols/min [2025-09-23T22:16:45.015870] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:45.047960] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-09-23T22:16:45.075841] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-23T22:16:45.096478] [INFO ] [MAIN ] Derivative Progress: 201/2077 symbols completed. BEP took 1.3s. Estimated remaining: 12m 16s. Rate: 152.9 symbols/min [2025-09-23T22:16:45.137602] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:45.289334] [DEBUG] [LOCAL ] BFAM: Loaded 33044 existing records from primary storage. [2025-09-23T22:16:45.290714] [INFO ] [MAIN ] BFAM: Loaded 33044 primary data records. [2025-09-23T22:16:45.643808] [DEBUG] [LOCAL ] BFH: Loaded 41829 existing records from primary storage. [2025-09-23T22:16:45.644051] [INFO ] [MAIN ] BFH: Loaded 41829 primary data records. [2025-09-23T22:16:45.696432] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:16:45.740370] [INFO ] [MAIN ] BEPJ: Generated 1793 derivative records from 3259 primary records. [2025-09-23T22:16:45.771128] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-23T22:16:46.043253] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1793 records). [2025-09-23T22:16:46.044314] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-23T22:16:46.046903] [INFO ] [MAIN ] Derivative Progress: 202/2077 symbols completed. BEPJ took 1.2s. Estimated remaining: 12m 21s. Rate: 151.8 symbols/min [2025-09-23T22:16:46.047294] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:46.068562] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:46.069730] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33044 primary records. [2025-09-23T22:16:46.070013] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-23T22:16:46.089892] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-09-23T22:16:46.090297] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-23T22:16:46.092470] [INFO ] [MAIN ] Derivative Progress: 203/2077 symbols completed. BFAM took 1.1s. Estimated remaining: 12m 17s. Rate: 152.5 symbols/min [2025-09-23T22:16:46.092745] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:46.126171] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:46.127230] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41829 primary records. [2025-09-23T22:16:46.127469] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-23T22:16:46.139910] [DEBUG] [LOCAL ] BFS: Loaded 9015 existing records from primary storage. [2025-09-23T22:16:46.144099] [INFO ] [MAIN ] BFS: Loaded 9015 primary data records. [2025-09-23T22:16:46.195267] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-09-23T22:16:46.234075] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-23T22:16:46.277483] [INFO ] [MAIN ] Derivative Progress: 204/2077 symbols completed. BFH took 1.1s. Estimated remaining: 12m 15s. Rate: 152.9 symbols/min [2025-09-23T22:16:46.279432] [DEBUG] [LOCAL ] BFLY: Loaded 51830 existing records from primary storage. [2025-09-23T22:16:46.295457] [INFO ] [MAIN ] BFLY: Loaded 51830 primary data records. [2025-09-23T22:16:46.295352] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:46.621487] [DEBUG] [LOCAL ] BFZ: Loaded 11731 existing records from primary storage. [2025-09-23T22:16:46.621958] [INFO ] [MAIN ] BFZ: Loaded 11731 primary data records. [2025-09-23T22:16:47.166418] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:47.168068] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9015 primary records. [2025-09-23T22:16:47.168550] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-23T22:16:47.202088] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:47.204473] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51830 primary records. [2025-09-23T22:16:47.204807] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-09-23T22:16:47.206476] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-23T22:16:47.207338] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-23T22:16:47.210447] [INFO ] [MAIN ] Derivative Progress: 205/2077 symbols completed. BFS took 1.1s. Estimated remaining: 12m 20s. Rate: 151.9 symbols/min [2025-09-23T22:16:47.231898] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:47.232371] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:47.233350] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11731 primary records. [2025-09-23T22:16:47.236195] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-23T22:16:47.255668] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-09-23T22:16:47.256205] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-09-23T22:16:47.256356] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-23T22:16:47.256307] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-23T22:16:47.258922] [INFO ] [MAIN ] Derivative Progress: 206/2077 symbols completed. BFLY took 1.2s. Estimated remaining: 12m 16s. Rate: 152.5 symbols/min [2025-09-23T22:16:47.261942] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:47.261760] [INFO ] [MAIN ] Derivative Progress: 207/2077 symbols completed. BFZ took 1.0s. Estimated remaining: 12m 12s. Rate: 153.3 symbols/min [2025-09-23T22:16:47.262123] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:47.285422] [DEBUG] [LOCAL ] BGH: Loaded 16373 existing records from primary storage. [2025-09-23T22:16:47.285683] [INFO ] [MAIN ] BGH: Loaded 16373 primary data records. [2025-09-23T22:16:47.377430] [DEBUG] [LOCAL ] BGB: Loaded 17392 existing records from primary storage. [2025-09-23T22:16:47.400560] [INFO ] [MAIN ] BGB: Loaded 17392 primary data records. [2025-09-23T22:16:47.700083] [DEBUG] [LOCAL ] BG: Loaded 50394 existing records from primary storage. [2025-09-23T22:16:47.738939] [INFO ] [MAIN ] BG: Loaded 50394 primary data records. [2025-09-23T22:16:48.337475] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:48.339620] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 16373 primary records. [2025-09-23T22:16:48.339985] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-23T22:16:48.372443] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:48.374287] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17392 primary records. [2025-09-23T22:16:48.374916] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-23T22:16:48.377135] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-09-23T22:16:48.384602] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-23T22:16:48.391198] [INFO ] [MAIN ] Derivative Progress: 208/2077 symbols completed. BGH took 1.1s. Estimated remaining: 12m 18s. Rate: 151.9 symbols/min [2025-09-23T22:16:48.409821] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:48.411145] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50394 primary records. [2025-09-23T22:16:48.410441] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-09-23T22:16:48.411250] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-23T22:16:48.411338] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-23T22:16:48.414196] [INFO ] [MAIN ] Derivative Progress: 209/2077 symbols completed. BGB took 1.2s. Estimated remaining: 12m 15s. Rate: 152.6 symbols/min [2025-09-23T22:16:48.429387] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-09-23T22:16:48.429451] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-23T22:16:48.432060] [INFO ] [MAIN ] Derivative Progress: 210/2077 symbols completed. BG took 1.2s. Estimated remaining: 12m 11s. Rate: 153.3 symbols/min [2025-09-23T22:16:48.432595] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:48.432846] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:48.432916] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:48.442690] [DEBUG] [LOCAL ] BGSF: Loaded 6707 existing records from primary storage. [2025-09-23T22:16:48.442819] [INFO ] [MAIN ] BGSF: Loaded 6707 primary data records. [2025-09-23T22:16:48.556173] [DEBUG] [LOCAL ] BGR: Loaded 13481 existing records from primary storage. [2025-09-23T22:16:48.559832] [INFO ] [MAIN ] BGR: Loaded 13481 primary data records. [2025-09-23T22:16:48.921948] [DEBUG] [LOCAL ] BGS: Loaded 50467 existing records from primary storage. [2025-09-23T22:16:48.953299] [INFO ] [MAIN ] BGS: Loaded 50467 primary data records. [2025-09-23T22:16:49.425679] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:16:49.427584] [INFO ] [MAIN ] BGSF: Generated 1793 derivative records from 6707 primary records. [2025-09-23T22:16:49.427961] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-23T22:16:49.455801] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:49.457304] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13481 primary records. [2025-09-23T22:16:49.458364] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-23T22:16:49.468199] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1793 records). [2025-09-23T22:16:49.472848] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-23T22:16:49.475006] [INFO ] [MAIN ] Derivative Progress: 211/2077 symbols completed. BGSF took 1.0s. Estimated remaining: 12m 16s. Rate: 152.1 symbols/min [2025-09-23T22:16:49.477721] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:49.480780] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-09-23T22:16:49.480929] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-23T22:16:49.483772] [INFO ] [MAIN ] Derivative Progress: 212/2077 symbols completed. BGR took 1.1s. Estimated remaining: 12m 12s. Rate: 152.8 symbols/min [2025-09-23T22:16:49.485700] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:49.501195] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:49.506525] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50467 primary records. [2025-09-23T22:16:49.506840] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-23T22:16:49.528439] [DEBUG] [LOCAL ] BGT: Loaded 16586 existing records from primary storage. [2025-09-23T22:16:49.529004] [INFO ] [MAIN ] BGT: Loaded 16586 primary data records. [2025-09-23T22:16:49.555180] [DEBUG] [LOCAL ] BGX: Loaded 10682 existing records from primary storage. [2025-09-23T22:16:49.566381] [INFO ] [MAIN ] BGX: Loaded 10682 primary data records. [2025-09-23T22:16:49.696952] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-09-23T22:16:49.702321] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-23T22:16:49.722117] [INFO ] [MAIN ] Derivative Progress: 213/2077 symbols completed. BGS took 1.3s. Estimated remaining: 12m 11s. Rate: 153.1 symbols/min [2025-09-23T22:16:49.768093] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:50.241415] [DEBUG] [LOCAL ] BGY: Loaded 22573 existing records from primary storage. [2025-09-23T22:16:50.243225] [INFO ] [MAIN ] BGY: Loaded 22573 primary data records. [2025-09-23T22:16:50.575507] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:50.588622] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16586 primary records. [2025-09-23T22:16:50.588993] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-23T22:16:50.587947] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:50.590478] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 10682 primary records. [2025-09-23T22:16:50.590783] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-23T22:16:50.614611] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-09-23T22:16:50.618895] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-23T22:16:50.621266] [INFO ] [MAIN ] Derivative Progress: 214/2077 symbols completed. BGT took 1.1s. Estimated remaining: 12m 15s. Rate: 152.1 symbols/min [2025-09-23T22:16:50.621771] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:50.628067] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-09-23T22:16:50.628222] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-23T22:16:50.630837] [INFO ] [MAIN ] Derivative Progress: 215/2077 symbols completed. BGX took 1.1s. Estimated remaining: 12m 11s. Rate: 152.8 symbols/min [2025-09-23T22:16:50.631092] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:50.653271] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:50.654073] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22573 primary records. [2025-09-23T22:16:50.654218] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-23T22:16:50.660618] [DEBUG] [LOCAL ] BH: Loaded 15557 existing records from primary storage. [2025-09-23T22:16:50.661060] [INFO ] [MAIN ] BH: Loaded 15557 primary data records. [2025-09-23T22:16:50.879817] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-09-23T22:16:51.008091] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-23T22:16:51.012723] [INFO ] [MAIN ] Derivative Progress: 216/2077 symbols completed. BGY took 1.3s. Estimated remaining: 12m 10s. Rate: 152.9 symbols/min [2025-09-23T22:16:51.009804] [DEBUG] [LOCAL ] BHC: Loaded 46783 existing records from primary storage. [2025-09-23T22:16:51.012962] [INFO ] [MAIN ] BHC: Loaded 46783 primary data records. [2025-09-23T22:16:51.019242] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:51.355356] [DEBUG] [LOCAL ] BHE: Loaded 25147 existing records from primary storage. [2025-09-23T22:16:51.357121] [INFO ] [MAIN ] BHE: Loaded 25147 primary data records. [2025-09-23T22:16:51.428373] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:16:51.461031] [INFO ] [MAIN ] BH: Generated 1793 derivative records from 15557 primary records. [2025-09-23T22:16:51.471432] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-23T22:16:51.713362] [DEBUG] [LOCAL ] BH: Derivative data saved (1793 records). [2025-09-23T22:16:51.716063] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-23T22:16:51.719214] [INFO ] [MAIN ] Derivative Progress: 217/2077 symbols completed. BH took 1.1s. Estimated remaining: 12m 13s. Rate: 152.3 symbols/min [2025-09-23T22:16:51.720661] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:51.736479] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:51.738035] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46783 primary records. [2025-09-23T22:16:51.738162] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-23T22:16:51.771411] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-09-23T22:16:51.771794] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-23T22:16:51.776718] [DEBUG] [LOCAL ] BHK: Loaded 22454 existing records from primary storage. [2025-09-23T22:16:51.777826] [INFO ] [MAIN ] BHK: Loaded 22454 primary data records. [2025-09-23T22:16:51.774429] [INFO ] [MAIN ] Derivative Progress: 218/2077 symbols completed. BHC took 1.1s. Estimated remaining: 12m 9s. Rate: 152.9 symbols/min [2025-09-23T22:16:51.794160] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:51.857843] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:51.886105] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 25147 primary records. [2025-09-23T22:16:51.916902] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-23T22:16:52.170010] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-09-23T22:16:52.183735] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-23T22:16:52.187421] [INFO ] [MAIN ] Derivative Progress: 219/2077 symbols completed. BHE took 1.2s. Estimated remaining: 12m 9s. Rate: 152.9 symbols/min [2025-09-23T22:16:52.187866] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:52.234418] [DEBUG] [LOCAL ] BHP: Loaded 53376 existing records from primary storage. [2025-09-23T22:16:52.234973] [INFO ] [MAIN ] BHP: Loaded 53376 primary data records. [2025-09-23T22:16:52.305848] [DEBUG] [LOCAL ] BHR: Loaded 21431 existing records from primary storage. [2025-09-23T22:16:52.332430] [INFO ] [MAIN ] BHR: Loaded 21431 primary data records. [2025-09-23T22:16:52.512876] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:52.554139] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 22454 primary records. [2025-09-23T22:16:52.554308] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-23T22:16:52.886252] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-09-23T22:16:52.888760] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-23T22:16:52.891098] [INFO ] [MAIN ] Derivative Progress: 220/2077 symbols completed. BHK took 1.2s. Estimated remaining: 12m 12s. Rate: 152.3 symbols/min [2025-09-23T22:16:52.892072] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:52.915515] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:52.918023] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53376 primary records. [2025-09-23T22:16:52.918295] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-23T22:16:52.940362] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:52.943983] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21431 primary records. [2025-09-23T22:16:52.944123] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-23T22:16:52.971729] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-09-23T22:16:52.972145] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-23T22:16:52.975313] [INFO ] [MAIN ] Derivative Progress: 221/2077 symbols completed. BHR took 0.8s. Estimated remaining: 12m 9s. Rate: 152.9 symbols/min [2025-09-23T22:16:52.975635] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:52.977810] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-09-23T22:16:52.978046] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-23T22:16:52.980291] [INFO ] [MAIN ] Derivative Progress: 222/2077 symbols completed. BHP took 1.2s. Estimated remaining: 12m 5s. Rate: 153.5 symbols/min [2025-09-23T22:16:52.980826] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:52.996418] [DEBUG] [LOCAL ] BHVN: Loaded 49614 existing records from primary storage. [2025-09-23T22:16:52.996698] [INFO ] [MAIN ] BHVN: Loaded 49614 primary data records. [2025-09-23T22:16:53.208717] [DEBUG] [LOCAL ] BIO: Loaded 25445 existing records from primary storage. [2025-09-23T22:16:53.208967] [INFO ] [MAIN ] BIO: Loaded 25445 primary data records. [2025-09-23T22:16:53.454879] [DEBUG] [LOCAL ] BILL: Loaded 52325 existing records from primary storage. [2025-09-23T22:16:53.484861] [INFO ] [MAIN ] BILL: Loaded 52325 primary data records. [2025-09-23T22:16:54.064493] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:54.066329] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 49614 primary records. [2025-09-23T22:16:54.066503] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-23T22:16:54.088026] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-09-23T22:16:54.088902] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-23T22:16:54.091499] [INFO ] [MAIN ] Derivative Progress: 223/2077 symbols completed. BHVN took 1.2s. Estimated remaining: 12m 10s. Rate: 152.3 symbols/min [2025-09-23T22:16:54.111966] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:54.112719] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 25445 primary records. [2025-09-23T22:16:54.112796] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-23T22:16:54.141352] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:54.142359] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52325 primary records. [2025-09-23T22:16:54.142616] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-23T22:16:54.158674] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-09-23T22:16:54.159020] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-23T22:16:54.161387] [INFO ] [MAIN ] Derivative Progress: 224/2077 symbols completed. BIO took 1.2s. Estimated remaining: 12m 7s. Rate: 152.8 symbols/min [2025-09-23T22:16:54.164123] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-09-23T22:16:54.164243] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-23T22:16:54.166830] [INFO ] [MAIN ] Derivative Progress: 225/2077 symbols completed. BILL took 1.2s. Estimated remaining: 12m 4s. Rate: 153.5 symbols/min [2025-09-23T22:16:54.167506] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:54.167714] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:54.168047] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:54.173332] [DEBUG] [LOCAL ] BIPH: Loaded 2635 existing records from primary storage. [2025-09-23T22:16:54.173483] [INFO ] [MAIN ] BIPH: Loaded 2635 primary data records. [2025-09-23T22:16:54.517538] [DEBUG] [LOCAL ] BIP: Loaded 39590 existing records from primary storage. [2025-09-23T22:16:54.539697] [INFO ] [MAIN ] BIP: Loaded 39590 primary data records. [2025-09-23T22:16:54.580413] [DEBUG] [LOCAL ] BIPC: Loaded 41701 existing records from primary storage. [2025-09-23T22:16:54.588322] [INFO ] [MAIN ] BIPC: Loaded 41701 primary data records. [2025-09-23T22:16:55.192033] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:16:55.194454] [INFO ] [MAIN ] BIPH: Generated 1793 derivative records from 2635 primary records. [2025-09-23T22:16:55.194831] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-23T22:16:55.213707] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1793 records). [2025-09-23T22:16:55.214127] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-23T22:16:55.216771] [INFO ] [MAIN ] Derivative Progress: 226/2077 symbols completed. BIPH took 1.0s. Estimated remaining: 12m 9s. Rate: 152.4 symbols/min [2025-09-23T22:16:55.217451] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:55.234303] [DEBUG] [LOCAL ] BIPI: Loaded 3293 existing records from primary storage. [2025-09-23T22:16:55.241354] [INFO ] [MAIN ] BIPI: Loaded 3293 primary data records. [2025-09-23T22:16:55.241588] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:55.299593] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39590 primary records. [2025-09-23T22:16:55.298527] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:55.305102] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-23T22:16:55.306536] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41701 primary records. [2025-09-23T22:16:55.306913] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-23T22:16:55.394202] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-09-23T22:16:55.394892] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-23T22:16:55.398102] [INFO ] [MAIN ] Derivative Progress: 227/2077 symbols completed. BIPC took 1.2s. Estimated remaining: 12m 7s. Rate: 152.7 symbols/min [2025-09-23T22:16:55.410064] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:55.423186] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-09-23T22:16:55.462835] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-23T22:16:55.481495] [INFO ] [MAIN ] Derivative Progress: 228/2077 symbols completed. BIP took 1.3s. Estimated remaining: 12m 4s. Rate: 153.3 symbols/min [2025-09-23T22:16:55.488063] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:55.488425] [DEBUG] [LOCAL ] BIPJ: Loaded 2951 existing records from primary storage. [2025-09-23T22:16:55.604037] [INFO ] [MAIN ] BIPJ: Loaded 2951 primary data records. [2025-09-23T22:16:55.999151] [DEBUG] [LOCAL ] BIRK: Loaded 50900 existing records from primary storage. [2025-09-23T22:16:55.999909] [INFO ] [MAIN ] BIRK: Loaded 50900 primary data records. [2025-09-23T22:16:56.085482] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:56.109405] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3293 primary records. [2025-09-23T22:16:56.121858] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-23T22:16:56.193975] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-09-23T22:16:56.194247] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-23T22:16:56.213095] [INFO ] [MAIN ] Derivative Progress: 229/2077 symbols completed. BIPI took 1.0s. Estimated remaining: 12m 6s. Rate: 152.7 symbols/min [2025-09-23T22:16:56.338929] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:56.356615] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:56.358260] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 2951 primary records. [2025-09-23T22:16:56.358436] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-23T22:16:56.373922] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-09-23T22:16:56.374189] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-23T22:16:56.376681] [INFO ] [MAIN ] Derivative Progress: 230/2077 symbols completed. BIPJ took 1.0s. Estimated remaining: 12m 4s. Rate: 153.1 symbols/min [2025-09-23T22:16:56.384075] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:56.395702] [DEBUG] [LOCAL ] BIT: Loaded 22326 existing records from primary storage. [2025-09-23T22:16:56.396110] [INFO ] [MAIN ] BIT: Loaded 22326 primary data records. [2025-09-23T22:16:56.498893] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:56.510147] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50900 primary records. [2025-09-23T22:16:56.525585] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-23T22:16:56.766883] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-09-23T22:16:56.767840] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-23T22:16:56.770270] [INFO ] [MAIN ] Derivative Progress: 231/2077 symbols completed. BIRK took 1.3s. Estimated remaining: 12m 4s. Rate: 153.1 symbols/min [2025-09-23T22:16:56.770573] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:56.788959] [DEBUG] [LOCAL ] BK: Loaded 53555 existing records from primary storage. [2025-09-23T22:16:56.789487] [INFO ] [MAIN ] BK: Loaded 53555 primary data records. [2025-09-23T22:16:57.114974] [DEBUG] [LOCAL ] BKH: Loaded 36620 existing records from primary storage. [2025-09-23T22:16:57.115452] [INFO ] [MAIN ] BKH: Loaded 36620 primary data records. [2025-09-23T22:16:57.244365] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:57.246635] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 22326 primary records. [2025-09-23T22:16:57.257349] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-23T22:16:57.468012] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-09-23T22:16:57.468274] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-23T22:16:57.470712] [INFO ] [MAIN ] Derivative Progress: 232/2077 symbols completed. BIT took 1.1s. Estimated remaining: 12m 6s. Rate: 152.6 symbols/min [2025-09-23T22:16:57.473038] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:57.491329] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:57.492252] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53555 primary records. [2025-09-23T22:16:57.492425] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-23T22:16:57.511890] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-09-23T22:16:57.512324] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-23T22:16:57.514735] [INFO ] [MAIN ] Derivative Progress: 233/2077 symbols completed. BK took 1.1s. Estimated remaining: 12m 2s. Rate: 153.1 symbols/min [2025-09-23T22:16:57.515125] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:57.561101] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:57.562632] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36620 primary records. [2025-09-23T22:16:57.562842] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-23T22:16:57.568634] [DEBUG] [LOCAL ] BKN: Loaded 7722 existing records from primary storage. [2025-09-23T22:16:57.579932] [INFO ] [MAIN ] BKN: Loaded 7722 primary data records. [2025-09-23T22:16:57.602571] [DEBUG] [LOCAL ] BKKT: Loaded 34261 existing records from primary storage. [2025-09-23T22:16:57.612749] [INFO ] [MAIN ] BKKT: Loaded 34261 primary data records. [2025-09-23T22:16:57.695545] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-09-23T22:16:57.755900] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-23T22:16:57.782756] [INFO ] [MAIN ] Derivative Progress: 234/2077 symbols completed. BKH took 1.0s. Estimated remaining: 12m 1s. Rate: 153.4 symbols/min [2025-09-23T22:16:57.793989] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:58.318074] [DEBUG] [LOCAL ] BKSY: Loaded 48276 existing records from primary storage. [2025-09-23T22:16:58.318703] [INFO ] [MAIN ] BKSY: Loaded 48276 primary data records. [2025-09-23T22:16:58.388563] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:58.416313] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7722 primary records. [2025-09-23T22:16:58.416457] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-23T22:16:58.491348] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:58.507414] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 34261 primary records. [2025-09-23T22:16:58.508020] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-23T22:16:58.560524] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-09-23T22:16:58.597135] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-23T22:16:58.685987] [INFO ] [MAIN ] Derivative Progress: 235/2077 symbols completed. BKN took 1.2s. Estimated remaining: 12m 5s. Rate: 152.5 symbols/min [2025-09-23T22:16:58.700935] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:58.706574] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-09-23T22:16:58.707770] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-23T22:16:58.710288] [INFO ] [MAIN ] Derivative Progress: 236/2077 symbols completed. BKKT took 1.2s. Estimated remaining: 12m 1s. Rate: 153.1 symbols/min [2025-09-23T22:16:58.710811] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:58.722131] [DEBUG] [LOCAL ] BKT: Loaded 10811 existing records from primary storage. [2025-09-23T22:16:58.722757] [INFO ] [MAIN ] BKT: Loaded 10811 primary data records. [2025-09-23T22:16:59.075189] [DEBUG] [LOCAL ] BKU: Loaded 41950 existing records from primary storage. [2025-09-23T22:16:59.080843] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:59.082394] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48276 primary records. [2025-09-23T22:16:59.082493] [INFO ] [MAIN ] BKU: Loaded 41950 primary data records. [2025-09-23T22:16:59.082692] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-23T22:16:59.183433] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-09-23T22:16:59.183978] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-23T22:16:59.197774] [INFO ] [MAIN ] Derivative Progress: 237/2077 symbols completed. BKSY took 1.4s. Estimated remaining: 12m 2s. Rate: 153.0 symbols/min [2025-09-23T22:16:59.209140] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:59.447639] [DEBUG] [LOCAL ] BKV: Loaded 29765 existing records from primary storage. [2025-09-23T22:16:59.453911] [INFO ] [MAIN ] BKV: Loaded 29765 primary data records. [2025-09-23T22:16:59.477501] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:59.545747] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 10811 primary records. [2025-09-23T22:16:59.557010] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-23T22:16:59.796035] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-09-23T22:16:59.796714] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-23T22:16:59.800766] [INFO ] [MAIN ] Derivative Progress: 238/2077 symbols completed. BKT took 1.1s. Estimated remaining: 12m 3s. Rate: 152.6 symbols/min [2025-09-23T22:16:59.815682] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:59.817316] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41950 primary records. [2025-09-23T22:16:59.817804] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-23T22:16:59.837827] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-09-23T22:16:59.838144] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-23T22:16:59.840446] [INFO ] [MAIN ] Derivative Progress: 239/2077 symbols completed. BKU took 1.1s. Estimated remaining: 11m 60s. Rate: 153.2 symbols/min [2025-09-23T22:16:59.855248] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:16:59.855879] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29765 primary records. [2025-09-23T22:16:59.855940] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-23T22:16:59.871109] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-09-23T22:16:59.871168] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-23T22:16:59.873704] [INFO ] [MAIN ] Derivative Progress: 240/2077 symbols completed. BKV took 0.7s. Estimated remaining: 11m 57s. Rate: 153.8 symbols/min [2025-09-23T22:16:59.874501] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:59.874587] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:59.874764] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:16:59.921899] [DEBUG] [LOCAL ] BLD: Loaded 28198 existing records from primary storage. [2025-09-23T22:16:59.931890] [INFO ] [MAIN ] BLD: Loaded 28198 primary data records. [2025-09-23T22:17:00.080808] [DEBUG] [LOCAL ] BLCO: Loaded 35761 existing records from primary storage. [2025-09-23T22:17:00.081428] [INFO ] [MAIN ] BLCO: Loaded 35761 primary data records. [2025-09-23T22:17:00.082146] [DEBUG] [LOCAL ] BLDR: Loaded 51666 existing records from primary storage. [2025-09-23T22:17:00.110907] [INFO ] [MAIN ] BLDR: Loaded 51666 primary data records. [2025-09-23T22:17:00.997266] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:01.000854] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 28198 primary records. [2025-09-23T22:17:01.001265] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-23T22:17:01.032490] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:01.033992] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35761 primary records. [2025-09-23T22:17:01.035322] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-23T22:17:01.057551] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-09-23T22:17:01.063701] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-23T22:17:01.072207] [INFO ] [MAIN ] Derivative Progress: 241/2077 symbols completed. BLD took 1.2s. Estimated remaining: 12m 3s. Rate: 152.5 symbols/min [2025-09-23T22:17:01.080047] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:01.082549] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:01.085247] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51666 primary records. [2025-09-23T22:17:01.086497] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-23T22:17:01.088855] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-09-23T22:17:01.097105] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-23T22:17:01.099669] [INFO ] [MAIN ] Derivative Progress: 242/2077 symbols completed. BLCO took 1.2s. Estimated remaining: 11m 59s. Rate: 153.0 symbols/min [2025-09-23T22:17:01.101529] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:01.115897] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-09-23T22:17:01.116264] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-23T22:17:01.119376] [INFO ] [MAIN ] Derivative Progress: 243/2077 symbols completed. BLDR took 1.2s. Estimated remaining: 11m 56s. Rate: 153.7 symbols/min [2025-09-23T22:17:01.125948] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:01.126310] [DEBUG] [LOCAL ] BLE: Loaded 14633 existing records from primary storage. [2025-09-23T22:17:01.126749] [INFO ] [MAIN ] BLE: Loaded 14633 primary data records. [2025-09-23T22:17:01.455235] [DEBUG] [LOCAL ] BLK: Loaded 34927 existing records from primary storage. [2025-09-23T22:17:01.475902] [INFO ] [MAIN ] BLK: Loaded 34927 primary data records. [2025-09-23T22:17:01.648589] [DEBUG] [LOCAL ] BLND: Loaded 49485 existing records from primary storage. [2025-09-23T22:17:01.657967] [INFO ] [MAIN ] BLND: Loaded 49485 primary data records. [2025-09-23T22:17:02.219811] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:02.220947] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14633 primary records. [2025-09-23T22:17:02.221211] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-23T22:17:02.243239] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-09-23T22:17:02.243624] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-23T22:17:02.246092] [INFO ] [MAIN ] Derivative Progress: 244/2077 symbols completed. BLE took 1.2s. Estimated remaining: 12m 1s. Rate: 152.5 symbols/min [2025-09-23T22:17:02.246375] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:02.260355] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:02.261967] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34927 primary records. [2025-09-23T22:17:02.262734] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-23T22:17:02.289109] [DEBUG] [LOCAL ] BLW: Loaded 12741 existing records from primary storage. [2025-09-23T22:17:02.290013] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-09-23T22:17:02.289933] [INFO ] [MAIN ] BLW: Loaded 12741 primary data records. [2025-09-23T22:17:02.290903] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-23T22:17:02.294837] [INFO ] [MAIN ] Derivative Progress: 245/2077 symbols completed. BLK took 1.2s. Estimated remaining: 11m 58s. Rate: 153.0 symbols/min [2025-09-23T22:17:02.324905] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:02.411868] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:02.428667] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49485 primary records. [2025-09-23T22:17:02.437916] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-23T22:17:02.621140] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-09-23T22:17:02.601454] [DEBUG] [LOCAL ] BLX: Loaded 15743 existing records from primary storage. [2025-09-23T22:17:02.621361] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-23T22:17:02.629122] [INFO ] [MAIN ] Derivative Progress: 246/2077 symbols completed. BLND took 1.5s. Estimated remaining: 11m 58s. Rate: 153.1 symbols/min [2025-09-23T22:17:02.638032] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:02.637630] [INFO ] [MAIN ] BLX: Loaded 15743 primary data records. [2025-09-23T22:17:02.975185] [DEBUG] [LOCAL ] BMA: Loaded 34895 existing records from primary storage. [2025-09-23T22:17:02.975887] [INFO ] [MAIN ] BMA: Loaded 34895 primary data records. [2025-09-23T22:17:03.169581] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:03.311291] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 12741 primary records. [2025-09-23T22:17:03.312218] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-23T22:17:03.334669] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-09-23T22:17:03.334896] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-23T22:17:03.337109] [INFO ] [MAIN ] Derivative Progress: 247/2077 symbols completed. BLW took 1.1s. Estimated remaining: 11m 59s. Rate: 152.6 symbols/min [2025-09-23T22:17:03.337486] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:03.351673] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:03.352692] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15743 primary records. [2025-09-23T22:17:03.353950] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-23T22:17:03.375336] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-09-23T22:17:03.377328] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-23T22:17:03.381902] [DEBUG] [LOCAL ] BME: Loaded 10811 existing records from primary storage. [2025-09-23T22:17:03.389551] [INFO ] [MAIN ] BME: Loaded 10811 primary data records. [2025-09-23T22:17:03.395981] [INFO ] [MAIN ] Derivative Progress: 248/2077 symbols completed. BLX took 1.1s. Estimated remaining: 11m 57s. Rate: 153.1 symbols/min [2025-09-23T22:17:03.408550] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:03.443173] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:03.443930] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 34895 primary records. [2025-09-23T22:17:03.466838] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-23T22:17:03.722617] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-09-23T22:17:03.736790] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-23T22:17:03.739661] [INFO ] [MAIN ] Derivative Progress: 249/2077 symbols completed. BMA took 1.1s. Estimated remaining: 11m 56s. Rate: 153.2 symbols/min [2025-09-23T22:17:03.740158] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:03.750755] [DEBUG] [LOCAL ] BMEZ: Loaded 26034 existing records from primary storage. [2025-09-23T22:17:03.750932] [INFO ] [MAIN ] BMEZ: Loaded 26034 primary data records. [2025-09-23T22:17:03.955331] [DEBUG] [LOCAL ] BMI: Loaded 24187 existing records from primary storage. [2025-09-23T22:17:03.957796] [INFO ] [MAIN ] BMI: Loaded 24187 primary data records. [2025-09-23T22:17:04.272077] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:04.293459] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 10811 primary records. [2025-09-23T22:17:04.335074] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-23T22:17:04.477117] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-09-23T22:17:04.478162] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-23T22:17:04.480455] [INFO ] [MAIN ] Derivative Progress: 250/2077 symbols completed. BME took 1.1s. Estimated remaining: 11m 58s. Rate: 152.7 symbols/min [2025-09-23T22:17:04.480816] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:04.490522] [DEBUG] [LOCAL ] BMN: Loaded 2537 existing records from primary storage. [2025-09-23T22:17:04.498691] [INFO ] [MAIN ] BMN: Loaded 2537 primary data records. [2025-09-23T22:17:04.568961] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:04.601892] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26034 primary records. [2025-09-23T22:17:04.610225] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-23T22:17:04.831521] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-09-23T22:17:04.832020] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-23T22:17:04.834705] [INFO ] [MAIN ] Derivative Progress: 251/2077 symbols completed. BMEZ took 1.4s. Estimated remaining: 11m 57s. Rate: 152.7 symbols/min [2025-09-23T22:17:04.844164] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:04.850511] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:04.851594] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24187 primary records. [2025-09-23T22:17:04.851923] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-23T22:17:04.872594] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-09-23T22:17:04.872726] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-23T22:17:04.875348] [INFO ] [MAIN ] Derivative Progress: 252/2077 symbols completed. BMI took 1.1s. Estimated remaining: 11m 54s. Rate: 153.3 symbols/min [2025-09-23T22:17:04.875967] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:04.891826] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:17:04.892578] [INFO ] [MAIN ] BMN: Generated 1793 derivative records from 2537 primary records. [2025-09-23T22:17:04.892813] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-23T22:17:04.907383] [DEBUG] [LOCAL ] BMN: Derivative data saved (1793 records). [2025-09-23T22:17:04.907487] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-23T22:17:04.909945] [INFO ] [MAIN ] Derivative Progress: 253/2077 symbols completed. BMN took 0.4s. Estimated remaining: 11m 51s. Rate: 153.8 symbols/min [2025-09-23T22:17:04.940411] [DEBUG] [LOCAL ] BMO: Loaded 41304 existing records from primary storage. [2025-09-23T22:17:04.940589] [INFO ] [MAIN ] BMO: Loaded 41304 primary data records. [2025-09-23T22:17:05.109370] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-23T22:17:05.134218] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-09-23T22:17:05.638565] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:05.639311] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41304 primary records. [2025-09-23T22:17:05.639596] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-23T22:17:05.657418] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-09-23T22:17:05.658379] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-23T22:17:05.661280] [INFO ] [MAIN ] Derivative Progress: 254/2077 symbols completed. BMO took 0.8s. Estimated remaining: 11m 54s. Rate: 153.3 symbols/min [2025-09-23T22:17:05.674566] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:05.675261] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-09-23T22:17:05.675327] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-23T22:17:05.691513] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-09-23T22:17:05.691592] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-23T22:17:05.694232] [INFO ] [MAIN ] Derivative Progress: 255/2077 symbols completed. BMY took 0.8s. Estimated remaining: 11m 51s. Rate: 153.8 symbols/min [2025-09-23T22:17:05.695901] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:05.696178] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:05.696395] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:05.705164] [DEBUG] [LOCAL ] BNH: Loaded 4838 existing records from primary storage. [2025-09-23T22:17:05.705319] [INFO ] [MAIN ] BNH: Loaded 4838 primary data records. [2025-09-23T22:17:05.910301] [DEBUG] [LOCAL ] BNED: Loaded 29989 existing records from primary storage. [2025-09-23T22:17:05.940716] [INFO ] [MAIN ] BNED: Loaded 29989 primary data records. [2025-09-23T22:17:06.189040] [DEBUG] [LOCAL ] BN: Loaded 52994 existing records from primary storage. [2025-09-23T22:17:06.193538] [INFO ] [MAIN ] BN: Loaded 52994 primary data records. [2025-09-23T22:17:06.771805] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:06.773246] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 4838 primary records. [2025-09-23T22:17:06.773504] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-23T22:17:06.792503] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-09-23T22:17:06.793741] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-23T22:17:06.798747] [INFO ] [MAIN ] Derivative Progress: 256/2077 symbols completed. BNH took 1.1s. Estimated remaining: 11m 55s. Rate: 152.7 symbols/min [2025-09-23T22:17:06.800739] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:06.817156] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:06.821132] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 29989 primary records. [2025-09-23T22:17:06.819967] [DEBUG] [LOCAL ] BNJ: Loaded 2584 existing records from primary storage. [2025-09-23T22:17:06.821275] [INFO ] [MAIN ] BNJ: Loaded 2584 primary data records. [2025-09-23T22:17:06.821485] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-23T22:17:06.938391] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:06.956712] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52994 primary records. [2025-09-23T22:17:06.957737] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-23T22:17:07.056912] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-09-23T22:17:07.060211] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-09-23T22:17:07.060619] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-23T22:17:07.063389] [INFO ] [MAIN ] Derivative Progress: 257/2077 symbols completed. BN took 1.4s. Estimated remaining: 11m 54s. Rate: 152.9 symbols/min [2025-09-23T22:17:07.171566] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-23T22:17:07.187963] [INFO ] [MAIN ] Derivative Progress: 258/2077 symbols completed. BNED took 1.5s. Estimated remaining: 11m 52s. Rate: 153.3 symbols/min [2025-09-23T22:17:07.185480] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:07.189072] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:07.216918] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:07.217688] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2584 primary records. [2025-09-23T22:17:07.221457] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-23T22:17:07.236961] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-09-23T22:17:07.237147] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-23T22:17:07.239971] [INFO ] [MAIN ] Derivative Progress: 259/2077 symbols completed. BNJ took 0.4s. Estimated remaining: 11m 49s. Rate: 153.8 symbols/min [2025-09-23T22:17:07.240476] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:07.269047] [DEBUG] [LOCAL ] BNT: Loaded 3417 existing records from primary storage. [2025-09-23T22:17:07.269354] [INFO ] [MAIN ] BNT: Loaded 3417 primary data records. [2025-09-23T22:17:07.415686] [DEBUG] [LOCAL ] BNL: Loaded 46871 existing records from primary storage. [2025-09-23T22:17:07.426727] [INFO ] [MAIN ] BNL: Loaded 46871 primary data records. [2025-09-23T22:17:07.437773] [DEBUG] [LOCAL ] BNS: Loaded 51460 existing records from primary storage. [2025-09-23T22:17:07.460759] [INFO ] [MAIN ] BNS: Loaded 51460 primary data records. [2025-09-23T22:17:08.341898] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:08.343137] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3417 primary records. [2025-09-23T22:17:08.343497] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-23T22:17:08.363626] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-09-23T22:17:08.366191] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-23T22:17:08.371082] [INFO ] [MAIN ] Derivative Progress: 260/2077 symbols completed. BNT took 1.1s. Estimated remaining: 11m 54s. Rate: 152.7 symbols/min [2025-09-23T22:17:08.371669] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:08.398902] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:08.399309] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:08.401289] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 46871 primary records. [2025-09-23T22:17:08.400395] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51460 primary records. [2025-09-23T22:17:08.401579] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-23T22:17:08.401721] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-23T22:17:08.435564] [DEBUG] [LOCAL ] BNY: Loaded 7423 existing records from primary storage. [2025-09-23T22:17:08.435970] [INFO ] [MAIN ] BNY: Loaded 7423 primary data records. [2025-09-23T22:17:08.437011] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-09-23T22:17:08.438851] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-23T22:17:08.440999] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-09-23T22:17:08.443984] [INFO ] [MAIN ] Derivative Progress: 261/2077 symbols completed. BNS took 1.3s. Estimated remaining: 11m 51s. Rate: 153.2 symbols/min [2025-09-23T22:17:08.455694] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:08.456060] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-23T22:17:08.459103] [INFO ] [MAIN ] Derivative Progress: 262/2077 symbols completed. BNL took 1.3s. Estimated remaining: 11m 48s. Rate: 153.8 symbols/min [2025-09-23T22:17:08.490931] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:08.653954] [DEBUG] [LOCAL ] BOC: Loaded 18394 existing records from primary storage. [2025-09-23T22:17:08.655271] [INFO ] [MAIN ] BOC: Loaded 18394 primary data records. [2025-09-23T22:17:08.655732] [DEBUG] [LOCAL ] BOE: Loaded 17606 existing records from primary storage. [2025-09-23T22:17:08.786117] [INFO ] [MAIN ] BOE: Loaded 17606 primary data records. [2025-09-23T22:17:09.474544] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:09.476019] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7423 primary records. [2025-09-23T22:17:09.476172] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-23T22:17:09.494912] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-09-23T22:17:09.495256] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-23T22:17:09.497763] [INFO ] [MAIN ] Derivative Progress: 263/2077 symbols completed. BNY took 1.1s. Estimated remaining: 11m 52s. Rate: 152.8 symbols/min [2025-09-23T22:17:09.498602] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:09.518500] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:09.519386] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 17606 primary records. [2025-09-23T22:17:09.519531] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-23T22:17:09.532618] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:09.533626] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18394 primary records. [2025-09-23T22:17:09.540731] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-23T22:17:09.581027] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-09-23T22:17:09.582620] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-23T22:17:09.585733] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-09-23T22:17:09.585883] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-23T22:17:09.585615] [INFO ] [MAIN ] Derivative Progress: 264/2077 symbols completed. BOC took 1.1s. Estimated remaining: 11m 50s. Rate: 153.3 symbols/min [2025-09-23T22:17:09.589439] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:09.589637] [INFO ] [MAIN ] Derivative Progress: 265/2077 symbols completed. BOE took 1.1s. Estimated remaining: 11m 47s. Rate: 153.8 symbols/min [2025-09-23T22:17:09.586421] [DEBUG] [LOCAL ] BOH: Loaded 31414 existing records from primary storage. [2025-09-23T22:17:09.589877] [INFO ] [MAIN ] BOH: Loaded 31414 primary data records. [2025-09-23T22:17:09.590049] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:09.811900] [DEBUG] [LOCAL ] BOND: Loaded 32076 existing records from primary storage. [2025-09-23T22:17:09.927395] [INFO ] [MAIN ] BOND: Loaded 32076 primary data records. [2025-09-23T22:17:10.058077] [DEBUG] [LOCAL ] BOOT: Loaded 40931 existing records from primary storage. [2025-09-23T22:17:10.062683] [INFO ] [MAIN ] BOOT: Loaded 40931 primary data records. [2025-09-23T22:17:10.638404] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:10.639757] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 31414 primary records. [2025-09-23T22:17:10.640210] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-23T22:17:10.659910] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-09-23T22:17:10.660715] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-23T22:17:10.663407] [INFO ] [MAIN ] Derivative Progress: 266/2077 symbols completed. BOH took 1.2s. Estimated remaining: 11m 51s. Rate: 152.8 symbols/min [2025-09-23T22:17:10.664112] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:10.682288] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:17:10.683837] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32076 primary records. [2025-09-23T22:17:10.684767] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-23T22:17:10.706742] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:10.707420] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 40931 primary records. [2025-09-23T22:17:10.710209] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-23T22:17:10.728967] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-09-23T22:17:10.729073] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-23T22:17:10.731281] [INFO ] [MAIN ] Derivative Progress: 267/2077 symbols completed. BOND took 1.1s. Estimated remaining: 11m 48s. Rate: 153.3 symbols/min [2025-09-23T22:17:10.732397] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:10.735097] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-09-23T22:17:10.749401] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-23T22:17:10.752340] [INFO ] [MAIN ] Derivative Progress: 268/2077 symbols completed. BOOT took 1.2s. Estimated remaining: 11m 46s. Rate: 153.8 symbols/min [2025-09-23T22:17:10.779766] [DEBUG] [LOCAL ] BORR: Loaded 51182 existing records from primary storage. [2025-09-23T22:17:10.779934] [INFO ] [MAIN ] BORR: Loaded 51182 primary data records. [2025-09-23T22:17:10.894885] [DEBUG] [LOCAL ] BOW: Loaded 23640 existing records from primary storage. [2025-09-23T22:17:10.900667] [INFO ] [MAIN ] BOW: Loaded 23640 primary data records. [2025-09-23T22:17:11.466468] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:11.467749] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51182 primary records. [2025-09-23T22:17:11.467948] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-23T22:17:11.486079] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-09-23T22:17:11.487815] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-23T22:17:11.490169] [INFO ] [MAIN ] Derivative Progress: 269/2077 symbols completed. BORR took 0.8s. Estimated remaining: 11m 47s. Rate: 153.3 symbols/min [2025-09-23T22:17:11.503396] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:11.504035] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23640 primary records. [2025-09-23T22:17:11.504096] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-23T22:17:11.519271] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-09-23T22:17:11.519345] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-23T22:17:11.522199] [INFO ] [MAIN ] Derivative Progress: 270/2077 symbols completed. BOW took 0.8s. Estimated remaining: 11m 45s. Rate: 153.9 symbols/min [2025-09-23T22:17:11.522865] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:11.523129] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:11.523281] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:11.589200] [DEBUG] [LOCAL ] BR: Loaded 34778 existing records from primary storage. [2025-09-23T22:17:11.589367] [INFO ] [MAIN ] BR: Loaded 34778 primary data records. [2025-09-23T22:17:11.731541] [DEBUG] [LOCAL ] BOX: Loaded 50321 existing records from primary storage. [2025-09-23T22:17:11.731848] [INFO ] [MAIN ] BOX: Loaded 50321 primary data records. [2025-09-23T22:17:11.815889] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-23T22:17:11.868199] [INFO ] [MAIN ] BP: Loaded 53711 primary data records. [2025-09-23T22:17:12.628798] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:12.630022] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34778 primary records. [2025-09-23T22:17:12.630195] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-23T22:17:12.650587] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-09-23T22:17:12.652275] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-23T22:17:12.655347] [INFO ] [MAIN ] Derivative Progress: 271/2077 symbols completed. BR took 1.1s. Estimated remaining: 11m 49s. Rate: 152.8 symbols/min [2025-09-23T22:17:12.656774] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:12.672603] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:12.674437] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53711 primary records. [2025-09-23T22:17:12.674557] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-23T22:17:12.699341] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:12.701054] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50321 primary records. [2025-09-23T22:17:12.701632] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-23T22:17:12.718827] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-09-23T22:17:12.719982] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-23T22:17:12.723742] [INFO ] [MAIN ] Derivative Progress: 272/2077 symbols completed. BP took 1.2s. Estimated remaining: 11m 47s. Rate: 153.2 symbols/min [2025-09-23T22:17:12.725565] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:12.728335] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-09-23T22:17:12.728453] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-23T22:17:12.731062] [INFO ] [MAIN ] Derivative Progress: 273/2077 symbols completed. BOX took 1.2s. Estimated remaining: 11m 44s. Rate: 153.8 symbols/min [2025-09-23T22:17:12.731580] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:12.763035] [DEBUG] [LOCAL ] BRC: Loaded 19365 existing records from primary storage. [2025-09-23T22:17:12.763181] [INFO ] [MAIN ] BRC: Loaded 19365 primary data records. [2025-09-23T22:17:12.898913] [DEBUG] [LOCAL ] BRBR: Loaded 51231 existing records from primary storage. [2025-09-23T22:17:12.944058] [INFO ] [MAIN ] BRBR: Loaded 51231 primary data records. [2025-09-23T22:17:13.027165] [DEBUG] [LOCAL ] BRCC: Loaded 40441 existing records from primary storage. [2025-09-23T22:17:13.167308] [INFO ] [MAIN ] BRCC: Loaded 40441 primary data records. [2025-09-23T22:17:13.791301] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:13.792498] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 19365 primary records. [2025-09-23T22:17:13.792859] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-23T22:17:13.811447] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-09-23T22:17:13.814196] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-23T22:17:13.816397] [INFO ] [MAIN ] Derivative Progress: 274/2077 symbols completed. BRC took 1.1s. Estimated remaining: 11m 48s. Rate: 152.8 symbols/min [2025-09-23T22:17:13.816924] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:13.830754] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:13.832148] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51231 primary records. [2025-09-23T22:17:13.832253] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-23T22:17:13.861765] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:13.862996] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40441 primary records. [2025-09-23T22:17:13.864773] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-23T22:17:13.864720] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-09-23T22:17:13.864933] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-23T22:17:13.869493] [INFO ] [MAIN ] Derivative Progress: 275/2077 symbols completed. BRBR took 1.2s. Estimated remaining: 11m 45s. Rate: 153.3 symbols/min [2025-09-23T22:17:13.869819] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:13.888991] [DEBUG] [LOCAL ] BRT: Loaded 4949 existing records from primary storage. [2025-09-23T22:17:13.889916] [INFO ] [MAIN ] BRT: Loaded 4949 primary data records. [2025-09-23T22:17:13.923028] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-09-23T22:17:13.935031] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-23T22:17:13.937705] [INFO ] [MAIN ] Derivative Progress: 276/2077 symbols completed. BRCC took 1.2s. Estimated remaining: 11m 43s. Rate: 153.7 symbols/min [2025-09-23T22:17:13.958868] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:14.233057] [DEBUG] [LOCAL ] BRW: Loaded 18999 existing records from primary storage. [2025-09-23T22:17:14.232629] [DEBUG] [LOCAL ] BRO: Loaded 51916 existing records from primary storage. [2025-09-23T22:17:14.233257] [INFO ] [MAIN ] BRW: Loaded 18999 primary data records. [2025-09-23T22:17:14.233499] [INFO ] [MAIN ] BRO: Loaded 51916 primary data records. [2025-09-23T22:17:14.899203] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:17:14.900201] [INFO ] [MAIN ] BRT: Generated 1793 derivative records from 4949 primary records. [2025-09-23T22:17:14.902355] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-23T22:17:14.918435] [DEBUG] [LOCAL ] BRT: Derivative data saved (1793 records). [2025-09-23T22:17:14.918722] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-23T22:17:14.920892] [INFO ] [MAIN ] Derivative Progress: 277/2077 symbols completed. BRT took 1.1s. Estimated remaining: 11m 46s. Rate: 152.9 symbols/min [2025-09-23T22:17:14.921254] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:14.940848] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:14.941724] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51916 primary records. [2025-09-23T22:17:14.953895] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-23T22:17:14.954111] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:14.954826] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 18999 primary records. [2025-09-23T22:17:14.954939] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-23T22:17:14.990764] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-09-23T22:17:14.991142] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-23T22:17:14.989910] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-09-23T22:17:15.006446] [INFO ] [MAIN ] Derivative Progress: 278/2077 symbols completed. BRW took 1.0s. Estimated remaining: 11m 44s. Rate: 153.3 symbols/min [2025-09-23T22:17:15.006538] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-23T22:17:15.010818] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:15.010994] [INFO ] [MAIN ] Derivative Progress: 279/2077 symbols completed. BRO took 1.2s. Estimated remaining: 11m 41s. Rate: 153.9 symbols/min [2025-09-23T22:17:15.013011] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:15.036208] [DEBUG] [LOCAL ] BRX: Loaded 51807 existing records from primary storage. [2025-09-23T22:17:15.036592] [INFO ] [MAIN ] BRX: Loaded 51807 primary data records. [2025-09-23T22:17:15.267677] [DEBUG] [LOCAL ] BSAC: Loaded 32985 existing records from primary storage. [2025-09-23T22:17:15.379085] [DEBUG] [LOCAL ] BSBR: Loaded 35113 existing records from primary storage. [2025-09-23T22:17:15.378542] [INFO ] [MAIN ] BSAC: Loaded 32985 primary data records. [2025-09-23T22:17:15.387759] [INFO ] [MAIN ] BSBR: Loaded 35113 primary data records. [2025-09-23T22:17:16.033272] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:16.034284] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51807 primary records. [2025-09-23T22:17:16.034845] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-23T22:17:16.055345] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-09-23T22:17:16.056163] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-23T22:17:16.058520] [INFO ] [MAIN ] Derivative Progress: 280/2077 symbols completed. BRX took 1.1s. Estimated remaining: 11m 45s. Rate: 153.0 symbols/min [2025-09-23T22:17:16.059202] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:16.098686] [DEBUG] [LOCAL ] BSL: Loaded 7936 existing records from primary storage. [2025-09-23T22:17:16.099801] [INFO ] [MAIN ] BSL: Loaded 7936 primary data records. [2025-09-23T22:17:16.099338] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:16.100502] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35113 primary records. [2025-09-23T22:17:16.099710] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:16.139223] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32985 primary records. [2025-09-23T22:17:16.147191] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-23T22:17:16.174069] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-23T22:17:16.250909] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-09-23T22:17:16.264483] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-23T22:17:16.293939] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-09-23T22:17:16.322639] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-23T22:17:16.325552] [INFO ] [MAIN ] Derivative Progress: 281/2077 symbols completed. BSBR took 1.3s. Estimated remaining: 11m 44s. Rate: 153.1 symbols/min [2025-09-23T22:17:16.333049] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:16.333186] [INFO ] [MAIN ] Derivative Progress: 282/2077 symbols completed. BSAC took 1.3s. Estimated remaining: 11m 41s. Rate: 153.7 symbols/min [2025-09-23T22:17:16.486540] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:16.517013] [DEBUG] [LOCAL ] BST: Loaded 19205 existing records from primary storage. [2025-09-23T22:17:16.517172] [INFO ] [MAIN ] BST: Loaded 19205 primary data records. [2025-09-23T22:17:16.671119] [DEBUG] [LOCAL ] BSM: Loaded 32342 existing records from primary storage. [2025-09-23T22:17:16.740677] [INFO ] [MAIN ] BSM: Loaded 32342 primary data records. [2025-09-23T22:17:16.735381] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:16.741423] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 7936 primary records. [2025-09-23T22:17:16.908361] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-23T22:17:17.003015] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-09-23T22:17:17.008312] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-23T22:17:17.056381] [INFO ] [MAIN ] Derivative Progress: 283/2077 symbols completed. BSL took 1.0s. Estimated remaining: 11m 43s. Rate: 153.2 symbols/min [2025-09-23T22:17:17.199908] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:17.200778] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 19205 primary records. [2025-09-23T22:17:17.200955] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-23T22:17:17.217188] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-09-23T22:17:17.217308] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-23T22:17:17.219707] [INFO ] [MAIN ] Derivative Progress: 284/2077 symbols completed. BST took 0.7s. Estimated remaining: 11m 41s. Rate: 153.5 symbols/min [2025-09-23T22:17:17.234585] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:17.235136] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32342 primary records. [2025-09-23T22:17:17.235197] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-23T22:17:17.250730] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-09-23T22:17:17.250790] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-23T22:17:17.252783] [INFO ] [MAIN ] Derivative Progress: 285/2077 symbols completed. BSM took 0.9s. Estimated remaining: 11m 38s. Rate: 154.0 symbols/min [2025-09-23T22:17:17.253287] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:17.253482] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:17.253586] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:17.262159] [DEBUG] [LOCAL ] BTA: Loaded 5282 existing records from primary storage. [2025-09-23T22:17:17.262301] [INFO ] [MAIN ] BTA: Loaded 5282 primary data records. [2025-09-23T22:17:17.426702] [DEBUG] [LOCAL ] BSTZ: Loaded 24871 existing records from primary storage. [2025-09-23T22:17:17.443184] [INFO ] [MAIN ] BSTZ: Loaded 24871 primary data records. [2025-09-23T22:17:17.757391] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-23T22:17:17.768375] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-09-23T22:17:18.281180] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:18.282039] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5282 primary records. [2025-09-23T22:17:18.283107] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-23T22:17:18.300604] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-09-23T22:17:18.301142] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-23T22:17:18.303352] [INFO ] [MAIN ] Derivative Progress: 286/2077 symbols completed. BTA took 1.0s. Estimated remaining: 11m 42s. Rate: 153.1 symbols/min [2025-09-23T22:17:18.303881] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:18.327453] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:18.328195] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24871 primary records. [2025-09-23T22:17:18.332550] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-23T22:17:18.352955] [DEBUG] [LOCAL ] BTCM: Loaded 14757 existing records from primary storage. [2025-09-23T22:17:18.353551] [INFO ] [MAIN ] BTCM: Loaded 14757 primary data records. [2025-09-23T22:17:18.405234] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:18.414371] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-09-23T22:17:18.414754] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-23T22:17:18.468306] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-09-23T22:17:18.483040] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-23T22:17:18.489252] [INFO ] [MAIN ] Derivative Progress: 287/2077 symbols completed. BSTZ took 1.2s. Estimated remaining: 11m 40s. Rate: 153.4 symbols/min [2025-09-23T22:17:18.492619] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:18.497143] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-09-23T22:17:18.498022] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-23T22:17:18.511451] [INFO ] [MAIN ] Derivative Progress: 288/2077 symbols completed. BSX took 1.3s. Estimated remaining: 11m 37s. Rate: 153.9 symbols/min [2025-09-23T22:17:18.511908] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:18.792212] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:18.807546] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 14757 primary records. [2025-09-23T22:17:18.807794] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-23T22:17:18.821614] [DEBUG] [LOCAL ] BTE: Loaded 52748 existing records from primary storage. [2025-09-23T22:17:18.823543] [INFO ] [MAIN ] BTE: Loaded 52748 primary data records. [2025-09-23T22:17:18.824458] [DEBUG] [LOCAL ] BTI: Loaded 53557 existing records from primary storage. [2025-09-23T22:17:18.834995] [INFO ] [MAIN ] BTI: Loaded 53557 primary data records. [2025-09-23T22:17:19.050273] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-09-23T22:17:19.082134] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-23T22:17:19.125505] [INFO ] [MAIN ] Derivative Progress: 289/2077 symbols completed. BTCM took 0.8s. Estimated remaining: 11m 38s. Rate: 153.6 symbols/min [2025-09-23T22:17:19.144040] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:19.482205] [DEBUG] [LOCAL ] BTO: Loaded 8939 existing records from primary storage. [2025-09-23T22:17:19.483170] [INFO ] [MAIN ] BTO: Loaded 8939 primary data records. [2025-09-23T22:17:19.842232] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:19.843476] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53557 primary records. [2025-09-23T22:17:19.844233] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-23T22:17:19.843703] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:19.845148] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52748 primary records. [2025-09-23T22:17:19.845944] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-23T22:17:19.876552] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-09-23T22:17:19.877891] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-23T22:17:19.880388] [INFO ] [MAIN ] Derivative Progress: 290/2077 symbols completed. BTE took 1.4s. Estimated remaining: 11m 40s. Rate: 153.1 symbols/min [2025-09-23T22:17:19.881614] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:19.883344] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-09-23T22:17:19.883440] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-23T22:17:19.885693] [INFO ] [MAIN ] Derivative Progress: 291/2077 symbols completed. BTI took 1.4s. Estimated remaining: 11m 38s. Rate: 153.6 symbols/min [2025-09-23T22:17:19.886328] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:19.902701] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:19.903463] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8939 primary records. [2025-09-23T22:17:19.903559] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-23T22:17:19.926350] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-09-23T22:17:19.933618] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-23T22:17:19.934187] [DEBUG] [LOCAL ] BTZ: Loaded 22844 existing records from primary storage. [2025-09-23T22:17:19.937061] [INFO ] [MAIN ] Derivative Progress: 292/2077 symbols completed. BTO took 0.8s. Estimated remaining: 11m 35s. Rate: 154.1 symbols/min [2025-09-23T22:17:19.937679] [INFO ] [MAIN ] BTZ: Loaded 22844 primary data records. [2025-09-23T22:17:19.937484] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:20.100677] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-23T22:17:20.131759] [INFO ] [MAIN ] BTU: Loaded 53303 primary data records. [2025-09-23T22:17:20.579028] [DEBUG] [LOCAL ] BUD: Loaded 52743 existing records from primary storage. [2025-09-23T22:17:20.628931] [INFO ] [MAIN ] BUD: Loaded 52743 primary data records. [2025-09-23T22:17:20.960972] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:20.962197] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22844 primary records. [2025-09-23T22:17:20.962599] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-23T22:17:20.985792] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-09-23T22:17:20.986126] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-23T22:17:20.988239] [INFO ] [MAIN ] Derivative Progress: 293/2077 symbols completed. BTZ took 1.1s. Estimated remaining: 11m 39s. Rate: 153.2 symbols/min [2025-09-23T22:17:20.988634] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:21.002988] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:21.003625] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53303 primary records. [2025-09-23T22:17:21.003918] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-23T22:17:21.023631] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-09-23T22:17:21.024113] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-23T22:17:21.029672] [INFO ] [MAIN ] Derivative Progress: 294/2077 symbols completed. BTU took 1.1s. Estimated remaining: 11m 36s. Rate: 153.7 symbols/min [2025-09-23T22:17:21.034847] [DEBUG] [LOCAL ] BUI: Loaded 11464 existing records from primary storage. [2025-09-23T22:17:21.035179] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:21.035120] [INFO ] [MAIN ] BUI: Loaded 11464 primary data records. [2025-09-23T22:17:21.150009] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:21.163013] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52743 primary records. [2025-09-23T22:17:21.163160] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-23T22:17:21.397160] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-09-23T22:17:21.397977] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-23T22:17:21.400938] [INFO ] [MAIN ] Derivative Progress: 295/2077 symbols completed. BUD took 1.5s. Estimated remaining: 11m 36s. Rate: 153.7 symbols/min [2025-09-23T22:17:21.401604] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:21.417550] [DEBUG] [LOCAL ] BURL: Loaded 46328 existing records from primary storage. [2025-09-23T22:17:21.417947] [INFO ] [MAIN ] BURL: Loaded 46328 primary data records. [2025-09-23T22:17:21.537324] [DEBUG] [LOCAL ] BUXX: Loaded 15142 existing records from primary storage. [2025-09-23T22:17:21.543593] [INFO ] [MAIN ] BUXX: Loaded 15142 primary data records. [2025-09-23T22:17:22.070419] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:22.071805] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11464 primary records. [2025-09-23T22:17:22.072241] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-23T22:17:22.106385] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-09-23T22:17:22.107161] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-23T22:17:22.109395] [INFO ] [MAIN ] Derivative Progress: 296/2077 symbols completed. BUI took 1.1s. Estimated remaining: 11m 37s. Rate: 153.3 symbols/min [2025-09-23T22:17:22.107100] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:22.110349] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 46328 primary records. [2025-09-23T22:17:22.110733] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-23T22:17:22.110585] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:22.131190] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-09-23T22:17:22.131484] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-23T22:17:22.141316] [INFO ] [MAIN ] Derivative Progress: 297/2077 symbols completed. BURL took 1.1s. Estimated remaining: 11m 35s. Rate: 153.7 symbols/min [2025-09-23T22:17:22.147173] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:22.147876] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:17:22.149185] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15142 primary records. [2025-09-23T22:17:22.149425] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-23T22:17:22.176384] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-09-23T22:17:22.176709] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-23T22:17:22.179625] [INFO ] [MAIN ] Derivative Progress: 298/2077 symbols completed. BUXX took 0.8s. Estimated remaining: 11m 32s. Rate: 154.2 symbols/min [2025-09-23T22:17:22.195124] [DEBUG] [LOCAL ] BV: Loaded 38602 existing records from primary storage. [2025-09-23T22:17:22.195312] [INFO ] [MAIN ] BV: Loaded 38602 primary data records. [2025-09-23T22:17:22.352245] [DEBUG] [LOCAL ] BVN: Loaded 43805 existing records from primary storage. [2025-09-23T22:17:22.374668] [INFO ] [MAIN ] BVN: Loaded 43805 primary data records. [2025-09-23T22:17:22.884049] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:22.884893] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38602 primary records. [2025-09-23T22:17:22.885045] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-23T22:17:22.916623] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:22.917295] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 43805 primary records. [2025-09-23T22:17:22.916370] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-09-23T22:17:22.917394] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-23T22:17:22.917471] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-23T22:17:22.919699] [INFO ] [MAIN ] Derivative Progress: 299/2077 symbols completed. BV took 0.8s. Estimated remaining: 11m 34s. Rate: 153.7 symbols/min [2025-09-23T22:17:22.935091] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-09-23T22:17:22.935149] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-23T22:17:22.937303] [INFO ] [MAIN ] Derivative Progress: 300/2077 symbols completed. BVN took 0.8s. Estimated remaining: 11m 31s. Rate: 154.2 symbols/min [2025-09-23T22:17:22.938042] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:22.937914] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:22.937782] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:22.951331] [DEBUG] [LOCAL ] BWG: Loaded 12317 existing records from primary storage. [2025-09-23T22:17:22.951458] [INFO ] [MAIN ] BWG: Loaded 12317 primary data records. [2025-09-23T22:17:23.291151] [DEBUG] [LOCAL ] BW: Loaded 39536 existing records from primary storage. [2025-09-23T22:17:23.291472] [INFO ] [MAIN ] BW: Loaded 39536 primary data records. [2025-09-23T22:17:23.416267] [DEBUG] [LOCAL ] BWA: Loaded 52250 existing records from primary storage. [2025-09-23T22:17:23.416498] [INFO ] [MAIN ] BWA: Loaded 52250 primary data records. [2025-09-23T22:17:23.943392] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:23.945038] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12317 primary records. [2025-09-23T22:17:23.946116] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-23T22:17:23.967192] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-09-23T22:17:23.979429] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-23T22:17:23.982207] [INFO ] [MAIN ] Derivative Progress: 301/2077 symbols completed. BWG took 1.0s. Estimated remaining: 11m 35s. Rate: 153.4 symbols/min [2025-09-23T22:17:23.982693] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:23.983560] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:23.984567] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 39536 primary records. [2025-09-23T22:17:23.984926] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-23T22:17:24.003686] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-09-23T22:17:24.011368] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-23T22:17:24.017909] [INFO ] [MAIN ] Derivative Progress: 302/2077 symbols completed. BW took 1.1s. Estimated remaining: 11m 32s. Rate: 153.8 symbols/min [2025-09-23T22:17:24.018203] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:24.018848] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:24.019564] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52250 primary records. [2025-09-23T22:17:24.019630] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-23T22:17:24.045536] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-09-23T22:17:24.045735] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-23T22:17:24.048300] [INFO ] [MAIN ] Derivative Progress: 303/2077 symbols completed. BWA took 1.1s. Estimated remaining: 11m 30s. Rate: 154.3 symbols/min [2025-09-23T22:17:24.048704] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:24.053395] [DEBUG] [LOCAL ] BWMX: Loaded 7621 existing records from primary storage. [2025-09-23T22:17:24.053513] [INFO ] [MAIN ] BWMX: Loaded 7621 primary data records. [2025-09-23T22:17:24.171428] [DEBUG] [LOCAL ] BWSN: Loaded 5091 existing records from primary storage. [2025-09-23T22:17:24.171200] [DEBUG] [LOCAL ] BWLP: Loaded 32847 existing records from primary storage. [2025-09-23T22:17:24.171600] [INFO ] [MAIN ] BWLP: Loaded 32847 primary data records. [2025-09-23T22:17:24.171781] [INFO ] [MAIN ] BWSN: Loaded 5091 primary data records. [2025-09-23T22:17:25.052446] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:25.053480] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7621 primary records. [2025-09-23T22:17:25.053580] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-23T22:17:25.085127] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:25.086396] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5091 primary records. [2025-09-23T22:17:25.087291] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-23T22:17:25.095584] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-09-23T22:17:25.100907] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-23T22:17:25.103284] [INFO ] [MAIN ] Derivative Progress: 304/2077 symbols completed. BWMX took 1.1s. Estimated remaining: 11m 33s. Rate: 153.4 symbols/min [2025-09-23T22:17:25.101161] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:25.104436] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32847 primary records. [2025-09-23T22:17:25.110753] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-23T22:17:25.104582] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:25.131169] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-09-23T22:17:25.131785] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-23T22:17:25.134467] [INFO ] [MAIN ] Derivative Progress: 305/2077 symbols completed. BWSN took 1.1s. Estimated remaining: 11m 31s. Rate: 153.9 symbols/min [2025-09-23T22:17:25.135805] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:25.137843] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-09-23T22:17:25.137911] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-23T22:17:25.140443] [INFO ] [MAIN ] Derivative Progress: 306/2077 symbols completed. BWLP took 1.2s. Estimated remaining: 11m 28s. Rate: 154.4 symbols/min [2025-09-23T22:17:25.141425] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:25.157047] [DEBUG] [LOCAL ] BXC: Loaded 13767 existing records from primary storage. [2025-09-23T22:17:25.157260] [INFO ] [MAIN ] BXC: Loaded 13767 primary data records. [2025-09-23T22:17:25.337059] [DEBUG] [LOCAL ] BWXT: Loaded 46764 existing records from primary storage. [2025-09-23T22:17:25.380720] [INFO ] [MAIN ] BWXT: Loaded 46764 primary data records. [2025-09-23T22:17:25.623996] [DEBUG] [LOCAL ] BX: Loaded 53497 existing records from primary storage. [2025-09-23T22:17:25.641066] [INFO ] [MAIN ] BX: Loaded 53497 primary data records. [2025-09-23T22:17:26.165289] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:26.166606] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13767 primary records. [2025-09-23T22:17:26.166824] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-23T22:17:26.186310] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-09-23T22:17:26.186770] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-23T22:17:26.189490] [INFO ] [MAIN ] Derivative Progress: 307/2077 symbols completed. BXC took 1.0s. Estimated remaining: 11m 32s. Rate: 153.5 symbols/min [2025-09-23T22:17:26.190022] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:26.203185] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:26.204160] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46764 primary records. [2025-09-23T22:17:26.204356] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-23T22:17:26.236385] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:26.237011] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-09-23T22:17:26.237113] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-23T22:17:26.237922] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53497 primary records. [2025-09-23T22:17:26.240133] [INFO ] [MAIN ] Derivative Progress: 308/2077 symbols completed. BWXT took 1.1s. Estimated remaining: 11m 29s. Rate: 154.0 symbols/min [2025-09-23T22:17:26.240309] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-23T22:17:26.241296] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:26.268321] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-09-23T22:17:26.268453] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-23T22:17:26.270911] [INFO ] [MAIN ] Derivative Progress: 309/2077 symbols completed. BX took 1.1s. Estimated remaining: 11m 27s. Rate: 154.4 symbols/min [2025-09-23T22:17:26.271226] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:26.286880] [DEBUG] [LOCAL ] BXMX: Loaded 19572 existing records from primary storage. [2025-09-23T22:17:26.299065] [INFO ] [MAIN ] BXMX: Loaded 19572 primary data records. [2025-09-23T22:17:26.334977] [DEBUG] [LOCAL ] BXMT: Loaded 47250 existing records from primary storage. [2025-09-23T22:17:26.348125] [INFO ] [MAIN ] BXMT: Loaded 47250 primary data records. [2025-09-23T22:17:26.964133] [DEBUG] [LOCAL ] BXP: Loaded 49802 existing records from primary storage. [2025-09-23T22:17:26.972634] [INFO ] [MAIN ] BXP: Loaded 49802 primary data records. [2025-09-23T22:17:27.380053] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:27.381434] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47250 primary records. [2025-09-23T22:17:27.381511] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:27.382303] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19572 primary records. [2025-09-23T22:17:27.382403] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-23T22:17:27.381608] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-23T22:17:27.421995] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-09-23T22:17:27.423451] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-23T22:17:27.426836] [INFO ] [MAIN ] Derivative Progress: 310/2077 symbols completed. BXMT took 1.2s. Estimated remaining: 11m 31s. Rate: 153.5 symbols/min [2025-09-23T22:17:27.428740] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-09-23T22:17:27.429233] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-23T22:17:27.429377] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:27.432555] [INFO ] [MAIN ] Derivative Progress: 311/2077 symbols completed. BXMX took 1.2s. Estimated remaining: 11m 28s. Rate: 154.0 symbols/min [2025-09-23T22:17:27.434288] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:27.458311] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:27.459487] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49802 primary records. [2025-09-23T22:17:27.459571] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-23T22:17:27.501332] [DEBUG] [LOCAL ] BY: Loaded 21542 existing records from primary storage. [2025-09-23T22:17:27.502358] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-09-23T22:17:27.502484] [INFO ] [MAIN ] BY: Loaded 21542 primary data records. [2025-09-23T22:17:27.502856] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-23T22:17:27.555410] [INFO ] [MAIN ] Derivative Progress: 312/2077 symbols completed. BXP took 1.3s. Estimated remaining: 11m 26s. Rate: 154.3 symbols/min [2025-09-23T22:17:27.562449] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:27.684674] [DEBUG] [LOCAL ] BXSL: Loaded 47457 existing records from primary storage. [2025-09-23T22:17:27.705192] [INFO ] [MAIN ] BXSL: Loaded 47457 primary data records. [2025-09-23T22:17:28.321385] [DEBUG] [LOCAL ] BYD: Loaded 45300 existing records from primary storage. [2025-09-23T22:17:28.460767] [INFO ] [MAIN ] BYD: Loaded 45300 primary data records. [2025-09-23T22:17:28.885781] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:28.886680] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21542 primary records. [2025-09-23T22:17:28.886880] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-23T22:17:28.907542] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-09-23T22:17:28.907811] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-23T22:17:28.910296] [INFO ] [MAIN ] Derivative Progress: 313/2077 symbols completed. BY took 1.5s. Estimated remaining: 11m 31s. Rate: 153.1 symbols/min [2025-09-23T22:17:28.924630] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:28.925401] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47457 primary records. [2025-09-23T22:17:28.925662] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-23T22:17:28.942319] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-09-23T22:17:28.942399] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-23T22:17:28.944671] [INFO ] [MAIN ] Derivative Progress: 314/2077 symbols completed. BXSL took 1.5s. Estimated remaining: 11m 29s. Rate: 153.5 symbols/min [2025-09-23T22:17:28.964183] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:28.965067] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 45300 primary records. [2025-09-23T22:17:28.965145] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-23T22:17:28.981411] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-09-23T22:17:28.981476] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-23T22:17:28.984028] [INFO ] [MAIN ] Derivative Progress: 315/2077 symbols completed. BYD took 1.4s. Estimated remaining: 11m 27s. Rate: 154.0 symbols/min [2025-09-23T22:17:28.984691] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:28.984555] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:28.984830] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:28.999928] [DEBUG] [LOCAL ] BYM: Loaded 12057 existing records from primary storage. [2025-09-23T22:17:29.000122] [INFO ] [MAIN ] BYM: Loaded 12057 primary data records. [2025-09-23T22:17:29.159992] [DEBUG] [LOCAL ] BZH: Loaded 32727 existing records from primary storage. [2025-09-23T22:17:29.179430] [INFO ] [MAIN ] BZH: Loaded 32727 primary data records. [2025-09-23T22:17:29.399632] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-23T22:17:29.417566] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-09-23T22:17:30.010682] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:30.012170] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 12057 primary records. [2025-09-23T22:17:30.012280] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-23T22:17:30.029917] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-09-23T22:17:30.030314] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-23T22:17:30.032855] [INFO ] [MAIN ] Derivative Progress: 316/2077 symbols completed. BYM took 1.0s. Estimated remaining: 11m 30s. Rate: 153.1 symbols/min [2025-09-23T22:17:30.033326] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:30.050920] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:30.052560] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32727 primary records. [2025-09-23T22:17:30.054176] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-23T22:17:30.080256] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:30.084928] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-09-23T22:17:30.085404] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-23T22:17:30.105861] [DEBUG] [LOCAL ] CAAP: Loaded 19410 existing records from primary storage. [2025-09-23T22:17:30.109441] [INFO ] [MAIN ] CAAP: Loaded 19410 primary data records. [2025-09-23T22:17:30.109319] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-09-23T22:17:30.111054] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-23T22:17:30.124702] [INFO ] [MAIN ] Derivative Progress: 317/2077 symbols completed. BZH took 1.1s. Estimated remaining: 11m 28s. Rate: 153.5 symbols/min [2025-09-23T22:17:30.150487] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:30.198445] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-09-23T22:17:30.225030] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-23T22:17:30.227818] [INFO ] [MAIN ] Derivative Progress: 318/2077 symbols completed. C took 1.2s. Estimated remaining: 11m 26s. Rate: 153.9 symbols/min [2025-09-23T22:17:30.250076] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:30.415079] [DEBUG] [LOCAL ] CABO: Loaded 17449 existing records from primary storage. [2025-09-23T22:17:30.428604] [INFO ] [MAIN ] CABO: Loaded 17449 primary data records. [2025-09-23T22:17:30.769512] [DEBUG] [LOCAL ] CACI: Loaded 25266 existing records from primary storage. [2025-09-23T22:17:30.770152] [INFO ] [MAIN ] CACI: Loaded 25266 primary data records. [2025-09-23T22:17:30.988129] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:31.138919] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19410 primary records. [2025-09-23T22:17:31.148155] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-23T22:17:31.170724] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-09-23T22:17:31.171187] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-23T22:17:31.185445] [INFO ] [MAIN ] Derivative Progress: 319/2077 symbols completed. CAAP took 1.2s. Estimated remaining: 11m 29s. Rate: 153.2 symbols/min [2025-09-23T22:17:31.186633] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:31.187502] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:31.188779] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 17449 primary records. [2025-09-23T22:17:31.189504] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-23T22:17:31.207877] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-09-23T22:17:31.209865] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-23T22:17:31.213327] [INFO ] [MAIN ] Derivative Progress: 320/2077 symbols completed. CABO took 1.1s. Estimated remaining: 11m 26s. Rate: 153.6 symbols/min [2025-09-23T22:17:31.214085] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:31.228028] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:31.228714] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 25266 primary records. [2025-09-23T22:17:31.228904] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-23T22:17:31.256552] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-09-23T22:17:31.256842] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-23T22:17:31.259813] [INFO ] [MAIN ] Derivative Progress: 321/2077 symbols completed. CACI took 1.0s. Estimated remaining: 11m 24s. Rate: 154.0 symbols/min [2025-09-23T22:17:31.260192] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:31.266478] [DEBUG] [LOCAL ] CAF: Loaded 3440 existing records from primary storage. [2025-09-23T22:17:31.266609] [INFO ] [MAIN ] CAF: Loaded 3440 primary data records. [2025-09-23T22:17:31.414728] [DEBUG] [LOCAL ] CADE: Loaded 48801 existing records from primary storage. [2025-09-23T22:17:31.415511] [INFO ] [MAIN ] CADE: Loaded 48801 primary data records. [2025-09-23T22:17:31.415434] [DEBUG] [LOCAL ] CAE: Loaded 38961 existing records from primary storage. [2025-09-23T22:17:31.415818] [INFO ] [MAIN ] CAE: Loaded 38961 primary data records. [2025-09-23T22:17:32.256931] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:32.259232] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3440 primary records. [2025-09-23T22:17:32.259537] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-23T22:17:32.286491] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:32.285795] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:32.287408] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 48801 primary records. [2025-09-23T22:17:32.294033] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 38961 primary records. [2025-09-23T22:17:32.295172] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-23T22:17:32.297991] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-23T22:17:32.310049] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-09-23T22:17:32.310153] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-23T22:17:32.330450] [INFO ] [MAIN ] Derivative Progress: 322/2077 symbols completed. CAF took 1.1s. Estimated remaining: 11m 27s. Rate: 153.2 symbols/min [2025-09-23T22:17:32.335681] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:32.335567] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-09-23T22:17:32.336772] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-23T22:17:32.340246] [INFO ] [MAIN ] Derivative Progress: 323/2077 symbols completed. CAE took 1.1s. Estimated remaining: 11m 25s. Rate: 153.7 symbols/min [2025-09-23T22:17:32.340943] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:32.343978] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-09-23T22:17:32.344105] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-23T22:17:32.347010] [INFO ] [MAIN ] Derivative Progress: 324/2077 symbols completed. CADE took 1.2s. Estimated remaining: 11m 22s. Rate: 154.1 symbols/min [2025-09-23T22:17:32.347385] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:32.424061] [DEBUG] [LOCAL ] CAL: Loaded 43299 existing records from primary storage. [2025-09-23T22:17:32.425309] [INFO ] [MAIN ] CAL: Loaded 43299 primary data records. [2025-09-23T22:17:32.451919] [DEBUG] [LOCAL ] CALX: Loaded 38586 existing records from primary storage. [2025-09-23T22:17:32.483984] [INFO ] [MAIN ] CALX: Loaded 38586 primary data records. [2025-09-23T22:17:32.510971] [DEBUG] [LOCAL ] CAG: Loaded 53659 existing records from primary storage. [2025-09-23T22:17:32.511179] [INFO ] [MAIN ] CAG: Loaded 53659 primary data records. [2025-09-23T22:17:33.420141] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:33.432898] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 38586 primary records. [2025-09-23T22:17:33.433433] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-23T22:17:33.433870] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:33.448547] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43299 primary records. [2025-09-23T22:17:33.449109] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-23T22:17:33.481779] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-09-23T22:17:33.482271] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:33.483410] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53659 primary records. [2025-09-23T22:17:33.482720] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-23T22:17:33.484226] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-23T22:17:33.487449] [INFO ] [MAIN ] Derivative Progress: 325/2077 symbols completed. CALX took 1.1s. Estimated remaining: 11m 26s. Rate: 153.2 symbols/min [2025-09-23T22:17:33.490369] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-09-23T22:17:33.489157] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:33.490475] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-23T22:17:33.492938] [INFO ] [MAIN ] Derivative Progress: 326/2077 symbols completed. CAL took 1.2s. Estimated remaining: 11m 24s. Rate: 153.7 symbols/min [2025-09-23T22:17:33.493402] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:33.510579] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-09-23T22:17:33.512025] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-23T22:17:33.515038] [INFO ] [MAIN ] Derivative Progress: 327/2077 symbols completed. CAG took 1.2s. Estimated remaining: 11m 21s. Rate: 154.1 symbols/min [2025-09-23T22:17:33.515514] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:33.519365] [DEBUG] [LOCAL ] CAPL: Loaded 5866 existing records from primary storage. [2025-09-23T22:17:33.519626] [INFO ] [MAIN ] CAPL: Loaded 5866 primary data records. [2025-09-23T22:17:33.656979] [DEBUG] [LOCAL ] CANG: Loaded 26721 existing records from primary storage. [2025-09-23T22:17:33.674044] [INFO ] [MAIN ] CANG: Loaded 26721 primary data records. [2025-09-23T22:17:34.059250] [DEBUG] [LOCAL ] CARR: Loaded 53596 existing records from primary storage. [2025-09-23T22:17:34.080120] [INFO ] [MAIN ] CARR: Loaded 53596 primary data records. [2025-09-23T22:17:34.545298] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:34.547213] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5866 primary records. [2025-09-23T22:17:34.548766] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-23T22:17:34.568405] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-09-23T22:17:34.568938] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-23T22:17:34.571268] [INFO ] [MAIN ] Derivative Progress: 328/2077 symbols completed. CAPL took 1.1s. Estimated remaining: 11m 24s. Rate: 153.3 symbols/min [2025-09-23T22:17:34.586363] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:17:34.587442] [INFO ] [MAIN ] CANG: Generated 1793 derivative records from 26721 primary records. [2025-09-23T22:17:34.587668] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-23T22:17:34.608224] [DEBUG] [LOCAL ] CANG: Derivative data saved (1793 records). [2025-09-23T22:17:34.608386] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-23T22:17:34.610986] [INFO ] [MAIN ] Derivative Progress: 329/2077 symbols completed. CANG took 1.1s. Estimated remaining: 11m 22s. Rate: 153.8 symbols/min [2025-09-23T22:17:34.623909] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:34.624604] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53596 primary records. [2025-09-23T22:17:34.624694] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-23T22:17:34.640507] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-09-23T22:17:34.640571] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-23T22:17:34.643482] [INFO ] [MAIN ] Derivative Progress: 330/2077 symbols completed. CARR took 1.1s. Estimated remaining: 11m 20s. Rate: 154.2 symbols/min [2025-09-23T22:17:34.644434] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:34.644344] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:34.644626] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:34.655016] [DEBUG] [LOCAL ] CATO: Loaded 7317 existing records from primary storage. [2025-09-23T22:17:34.655121] [INFO ] [MAIN ] CATO: Loaded 7317 primary data records. [2025-09-23T22:17:35.034448] [DEBUG] [LOCAL ] CARS: Loaded 40251 existing records from primary storage. [2025-09-23T22:17:35.045025] [INFO ] [MAIN ] CARS: Loaded 40251 primary data records. [2025-09-23T22:17:35.130910] [DEBUG] [LOCAL ] CAT: Loaded 52925 existing records from primary storage. [2025-09-23T22:17:35.155273] [INFO ] [MAIN ] CAT: Loaded 52925 primary data records. [2025-09-23T22:17:35.716380] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:35.717886] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 7317 primary records. [2025-09-23T22:17:35.718148] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-23T22:17:35.737048] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-09-23T22:17:35.737191] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-23T22:17:35.739682] [INFO ] [MAIN ] Derivative Progress: 331/2077 symbols completed. CATO took 1.1s. Estimated remaining: 11m 23s. Rate: 153.3 symbols/min [2025-09-23T22:17:35.741282] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:35.759459] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:35.760350] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 40251 primary records. [2025-09-23T22:17:35.760546] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-23T22:17:35.789493] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:35.790792] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52925 primary records. [2025-09-23T22:17:35.791128] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-23T22:17:35.803137] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-09-23T22:17:35.806155] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-23T22:17:35.808275] [INFO ] [MAIN ] Derivative Progress: 332/2077 symbols completed. CARS took 1.2s. Estimated remaining: 11m 21s. Rate: 153.7 symbols/min [2025-09-23T22:17:35.809139] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:35.828020] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-09-23T22:17:35.828164] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-23T22:17:35.830705] [INFO ] [MAIN ] Derivative Progress: 333/2077 symbols completed. CAT took 1.2s. Estimated remaining: 11m 19s. Rate: 154.2 symbols/min [2025-09-23T22:17:35.831083] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:35.849868] [DEBUG] [LOCAL ] CAVA: Loaded 53550 existing records from primary storage. [2025-09-23T22:17:35.852945] [INFO ] [MAIN ] CAVA: Loaded 53550 primary data records. [2025-09-23T22:17:35.916543] [DEBUG] [LOCAL ] CBAN: Loaded 11122 existing records from primary storage. [2025-09-23T22:17:35.938555] [INFO ] [MAIN ] CBAN: Loaded 11122 primary data records. [2025-09-23T22:17:36.186597] [DEBUG] [LOCAL ] CB: Loaded 50089 existing records from primary storage. [2025-09-23T22:17:36.215207] [INFO ] [MAIN ] CB: Loaded 50089 primary data records. [2025-09-23T22:17:36.837776] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:36.839319] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 11122 primary records. [2025-09-23T22:17:36.852301] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-23T22:17:36.852689] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:36.855232] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53550 primary records. [2025-09-23T22:17:36.855350] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-23T22:17:36.888618] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-09-23T22:17:36.890094] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-23T22:17:36.892955] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-09-23T22:17:36.892382] [INFO ] [MAIN ] Derivative Progress: 334/2077 symbols completed. CAVA took 1.2s. Estimated remaining: 11m 22s. Rate: 153.4 symbols/min [2025-09-23T22:17:36.894872] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:36.893955] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-23T22:17:36.898258] [INFO ] [MAIN ] Derivative Progress: 335/2077 symbols completed. CBAN took 1.1s. Estimated remaining: 11m 19s. Rate: 153.8 symbols/min [2025-09-23T22:17:36.911391] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:36.912099] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:36.913228] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 50089 primary records. [2025-09-23T22:17:36.913382] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-23T22:17:36.930020] [DEBUG] [LOCAL ] CBNA: Loaded 2892 existing records from primary storage. [2025-09-23T22:17:36.934783] [INFO ] [MAIN ] CBNA: Loaded 2892 primary data records. [2025-09-23T22:17:37.005166] [DEBUG] [LOCAL ] CBL: Loaded 16744 existing records from primary storage. [2025-09-23T22:17:37.020866] [INFO ] [MAIN ] CBL: Loaded 16744 primary data records. [2025-09-23T22:17:37.056038] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-09-23T22:17:37.131334] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-23T22:17:37.232317] [INFO ] [MAIN ] Derivative Progress: 336/2077 symbols completed. CB took 1.4s. Estimated remaining: 11m 19s. Rate: 153.9 symbols/min [2025-09-23T22:17:37.270608] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:37.618999] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:37.633759] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2892 primary records. [2025-09-23T22:17:37.634059] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-23T22:17:37.676054] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:37.678327] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16744 primary records. [2025-09-23T22:17:37.680984] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-09-23T22:17:37.680542] [DEBUG] [LOCAL ] CBRE: Loaded 50658 existing records from primary storage. [2025-09-23T22:17:37.681219] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-23T22:17:37.681094] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-23T22:17:37.683458] [INFO ] [MAIN ] CBRE: Loaded 50658 primary data records. [2025-09-23T22:17:37.683339] [INFO ] [MAIN ] Derivative Progress: 337/2077 symbols completed. CBNA took 0.8s. Estimated remaining: 11m 19s. Rate: 153.8 symbols/min [2025-09-23T22:17:37.706273] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:37.858157] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-09-23T22:17:37.867176] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-23T22:17:37.900799] [INFO ] [MAIN ] Derivative Progress: 338/2077 symbols completed. CBL took 1.0s. Estimated remaining: 11m 17s. Rate: 154.0 symbols/min [2025-09-23T22:17:38.012182] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:38.034705] [DEBUG] [LOCAL ] CBT: Loaded 31140 existing records from primary storage. [2025-09-23T22:17:38.034975] [INFO ] [MAIN ] CBT: Loaded 31140 primary data records. [2025-09-23T22:17:38.228958] [DEBUG] [LOCAL ] CBU: Loaded 22875 existing records from primary storage. [2025-09-23T22:17:38.250266] [INFO ] [MAIN ] CBU: Loaded 22875 primary data records. [2025-09-23T22:17:38.521335] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:38.527971] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50658 primary records. [2025-09-23T22:17:38.528096] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-23T22:17:38.764104] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-09-23T22:17:38.780496] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-23T22:17:38.784248] [INFO ] [MAIN ] Derivative Progress: 339/2077 symbols completed. CBRE took 1.5s. Estimated remaining: 11m 20s. Rate: 153.4 symbols/min [2025-09-23T22:17:38.785091] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:38.816318] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:38.817464] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 31140 primary records. [2025-09-23T22:17:38.817705] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-23T22:17:38.857852] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-09-23T22:17:38.859511] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-23T22:17:38.863611] [INFO ] [MAIN ] Derivative Progress: 340/2077 symbols completed. CBT took 1.2s. Estimated remaining: 11m 18s. Rate: 153.8 symbols/min [2025-09-23T22:17:38.866039] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:38.865917] [DEBUG] [LOCAL ] CBZ: Loaded 33481 existing records from primary storage. [2025-09-23T22:17:38.868397] [INFO ] [MAIN ] CBZ: Loaded 33481 primary data records. [2025-09-23T22:17:38.942006] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:38.969965] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22875 primary records. [2025-09-23T22:17:38.975677] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-23T22:17:39.270978] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-09-23T22:17:39.271235] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-23T22:17:39.273784] [INFO ] [MAIN ] Derivative Progress: 341/2077 symbols completed. CBU took 1.3s. Estimated remaining: 11m 17s. Rate: 153.8 symbols/min [2025-09-23T22:17:39.274251] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:39.301036] [DEBUG] [LOCAL ] CC: Loaded 53032 existing records from primary storage. [2025-09-23T22:17:39.301528] [INFO ] [MAIN ] CC: Loaded 53032 primary data records. [2025-09-23T22:17:39.466471] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:39.483534] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33481 primary records. [2025-09-23T22:17:39.502803] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-23T22:17:39.686074] [DEBUG] [LOCAL ] CCI: Loaded 53153 existing records from primary storage. [2025-09-23T22:17:39.701530] [INFO ] [MAIN ] CCI: Loaded 53153 primary data records. [2025-09-23T22:17:39.761264] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-09-23T22:17:39.770280] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-23T22:17:39.777782] [INFO ] [MAIN ] Derivative Progress: 342/2077 symbols completed. CBZ took 1.0s. Estimated remaining: 11m 18s. Rate: 153.7 symbols/min [2025-09-23T22:17:39.794995] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:40.017825] [DEBUG] [LOCAL ] CCIF: Loaded 15346 existing records from primary storage. [2025-09-23T22:17:40.018935] [INFO ] [MAIN ] CCIF: Loaded 15346 primary data records. [2025-09-23T22:17:40.149391] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:40.171087] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53032 primary records. [2025-09-23T22:17:40.191162] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-23T22:17:40.372946] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-09-23T22:17:40.374451] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-23T22:17:40.385104] [INFO ] [MAIN ] Derivative Progress: 343/2077 symbols completed. CC took 1.5s. Estimated remaining: 11m 18s. Rate: 153.4 symbols/min [2025-09-23T22:17:40.391080] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:40.392472] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53153 primary records. [2025-09-23T22:17:40.392556] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-23T22:17:40.410669] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-09-23T22:17:40.410767] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-23T22:17:40.412925] [INFO ] [MAIN ] Derivative Progress: 344/2077 symbols completed. CCI took 1.1s. Estimated remaining: 11m 16s. Rate: 153.8 symbols/min [2025-09-23T22:17:40.434058] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:40.435166] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15346 primary records. [2025-09-23T22:17:40.435238] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-23T22:17:40.450584] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-09-23T22:17:40.450694] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-23T22:17:40.454928] [INFO ] [MAIN ] Derivative Progress: 345/2077 symbols completed. CCIF took 0.7s. Estimated remaining: 11m 14s. Rate: 154.2 symbols/min [2025-09-23T22:17:40.455614] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:40.456003] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:40.455927] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:40.544124] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-23T22:17:40.544378] [INFO ] [MAIN ] CCJ: Loaded 53675 primary data records. [2025-09-23T22:17:40.545105] [DEBUG] [LOCAL ] CCK: Loaded 46406 existing records from primary storage. [2025-09-23T22:17:40.556679] [INFO ] [MAIN ] CCK: Loaded 46406 primary data records. [2025-09-23T22:17:40.761028] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-23T22:17:40.784703] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-09-23T22:17:41.584924] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:41.586445] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46406 primary records. [2025-09-23T22:17:41.585561] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:41.587344] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53675 primary records. [2025-09-23T22:17:41.588378] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-23T22:17:41.587897] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-23T22:17:41.630311] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:41.631737] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-09-23T22:17:41.632618] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-23T22:17:41.636722] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-09-23T22:17:41.645627] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-23T22:17:41.650679] [INFO ] [MAIN ] Derivative Progress: 346/2077 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 18s. Rate: 153.3 symbols/min [2025-09-23T22:17:41.651767] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:41.656780] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-09-23T22:17:41.657994] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-23T22:17:41.660621] [INFO ] [MAIN ] Derivative Progress: 347/2077 symbols completed. CCK took 1.2s. Estimated remaining: 11m 15s. Rate: 153.7 symbols/min [2025-09-23T22:17:41.661256] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:41.662268] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-09-23T22:17:41.662772] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-23T22:17:41.666148] [INFO ] [MAIN ] Derivative Progress: 348/2077 symbols completed. CCL took 1.2s. Estimated remaining: 11m 13s. Rate: 154.2 symbols/min [2025-09-23T22:17:41.666574] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:41.676550] [DEBUG] [LOCAL ] CCRD: Loaded 9000 existing records from primary storage. [2025-09-23T22:17:41.676696] [INFO ] [MAIN ] CCRD: Loaded 9000 primary data records. [2025-09-23T22:17:41.870490] [DEBUG] [LOCAL ] CCS: Loaded 30701 existing records from primary storage. [2025-09-23T22:17:42.012820] [INFO ] [MAIN ] CCS: Loaded 30701 primary data records. [2025-09-23T22:17:42.033856] [DEBUG] [LOCAL ] CCO: Loaded 47684 existing records from primary storage. [2025-09-23T22:17:42.055930] [INFO ] [MAIN ] CCO: Loaded 47684 primary data records. [2025-09-23T22:17:42.707801] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:42.710465] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 9000 primary records. [2025-09-23T22:17:42.710807] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-23T22:17:42.733145] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-09-23T22:17:42.733753] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-23T22:17:42.739613] [INFO ] [MAIN ] Derivative Progress: 349/2077 symbols completed. CCRD took 1.1s. Estimated remaining: 11m 16s. Rate: 153.4 symbols/min [2025-09-23T22:17:42.740530] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:42.778500] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:42.786541] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47684 primary records. [2025-09-23T22:17:42.786808] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-23T22:17:42.779025] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:42.788473] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30701 primary records. [2025-09-23T22:17:42.789130] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-23T22:17:42.825556] [DEBUG] [LOCAL ] CCU: Loaded 23677 existing records from primary storage. [2025-09-23T22:17:42.830508] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-09-23T22:17:42.830429] [INFO ] [MAIN ] CCU: Loaded 23677 primary data records. [2025-09-23T22:17:42.831453] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-23T22:17:42.831330] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-09-23T22:17:42.845713] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-23T22:17:42.838836] [INFO ] [MAIN ] Derivative Progress: 350/2077 symbols completed. CCS took 1.2s. Estimated remaining: 11m 14s. Rate: 153.7 symbols/min [2025-09-23T22:17:42.848961] [INFO ] [MAIN ] Derivative Progress: 351/2077 symbols completed. CCO took 1.2s. Estimated remaining: 11m 12s. Rate: 154.1 symbols/min [2025-09-23T22:17:42.849242] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:42.859670] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:43.223100] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-23T22:17:43.235695] [INFO ] [MAIN ] CDE: Loaded 53641 primary data records. [2025-09-23T22:17:43.270340] [DEBUG] [LOCAL ] CDP: Loaded 42704 existing records from primary storage. [2025-09-23T22:17:43.289825] [INFO ] [MAIN ] CDP: Loaded 42704 primary data records. [2025-09-23T22:17:43.947596] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:43.949593] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 23677 primary records. [2025-09-23T22:17:43.949978] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-23T22:17:43.973553] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-09-23T22:17:43.974216] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-23T22:17:43.976215] [INFO ] [MAIN ] Derivative Progress: 352/2077 symbols completed. CCU took 1.2s. Estimated remaining: 11m 15s. Rate: 153.3 symbols/min [2025-09-23T22:17:43.976778] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:43.994870] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:43.996925] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53641 primary records. [2025-09-23T22:17:43.997135] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-23T22:17:44.026288] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:44.027895] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42704 primary records. [2025-09-23T22:17:44.028267] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-23T22:17:44.039424] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-09-23T22:17:44.046483] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-09-23T22:17:44.044540] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-23T22:17:44.048699] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-23T22:17:44.048559] [INFO ] [MAIN ] Derivative Progress: 353/2077 symbols completed. CDE took 1.2s. Estimated remaining: 11m 13s. Rate: 153.7 symbols/min [2025-09-23T22:17:44.051709] [INFO ] [MAIN ] Derivative Progress: 354/2077 symbols completed. CDP took 1.2s. Estimated remaining: 11m 11s. Rate: 154.1 symbols/min [2025-09-23T22:17:44.051615] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:44.052368] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:44.074584] [DEBUG] [LOCAL ] CEE: Loaded 6777 existing records from primary storage. [2025-09-23T22:17:44.074787] [INFO ] [MAIN ] CEE: Loaded 6777 primary data records. [2025-09-23T22:17:44.249249] [DEBUG] [LOCAL ] CE: Loaded 51554 existing records from primary storage. [2025-09-23T22:17:44.260983] [INFO ] [MAIN ] CE: Loaded 51554 primary data records. [2025-09-23T22:17:44.287753] [DEBUG] [LOCAL ] CEPU: Loaded 25995 existing records from primary storage. [2025-09-23T22:17:44.468680] [INFO ] [MAIN ] CEPU: Loaded 25995 primary data records. [2025-09-23T22:17:45.087576] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:45.088874] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 6777 primary records. [2025-09-23T22:17:45.089087] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-23T22:17:45.111297] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-09-23T22:17:45.111816] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-23T22:17:45.113659] [INFO ] [MAIN ] Derivative Progress: 355/2077 symbols completed. CEE took 1.1s. Estimated remaining: 11m 14s. Rate: 153.4 symbols/min [2025-09-23T22:17:45.114285] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:45.130939] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:45.131895] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51554 primary records. [2025-09-23T22:17:45.139735] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-23T22:17:45.153028] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:45.158330] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25995 primary records. [2025-09-23T22:17:45.159141] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-23T22:17:45.178138] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-09-23T22:17:45.178995] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-23T22:17:45.181777] [INFO ] [MAIN ] Derivative Progress: 356/2077 symbols completed. CEPU took 1.1s. Estimated remaining: 11m 12s. Rate: 153.7 symbols/min [2025-09-23T22:17:45.182446] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:45.182087] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-09-23T22:17:45.182685] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-23T22:17:45.185166] [INFO ] [MAIN ] Derivative Progress: 357/2077 symbols completed. CE took 1.2s. Estimated remaining: 11m 9s. Rate: 154.1 symbols/min [2025-09-23T22:17:45.185517] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:45.235318] [DEBUG] [LOCAL ] CF: Loaded 52228 existing records from primary storage. [2025-09-23T22:17:45.235504] [INFO ] [MAIN ] CF: Loaded 52228 primary data records. [2025-09-23T22:17:45.375802] [DEBUG] [LOCAL ] CFR: Loaded 33622 existing records from primary storage. [2025-09-23T22:17:45.381666] [INFO ] [MAIN ] CFR: Loaded 33622 primary data records. [2025-09-23T22:17:45.714586] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-09-23T22:17:45.726380] [INFO ] [MAIN ] CFG: Loaded 53624 primary data records. [2025-09-23T22:17:46.267205] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:46.269116] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52228 primary records. [2025-09-23T22:17:46.270076] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-23T22:17:46.306193] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:46.308186] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33622 primary records. [2025-09-23T22:17:46.309153] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-23T22:17:46.309801] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-09-23T22:17:46.310354] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-23T22:17:46.312573] [INFO ] [MAIN ] Derivative Progress: 358/2077 symbols completed. CF took 1.2s. Estimated remaining: 11m 13s. Rate: 153.3 symbols/min [2025-09-23T22:17:46.331862] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-09-23T22:17:46.332198] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-23T22:17:46.346502] [INFO ] [MAIN ] Derivative Progress: 359/2077 symbols completed. CFR took 1.2s. Estimated remaining: 11m 11s. Rate: 153.7 symbols/min [2025-09-23T22:17:46.346811] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:46.347754] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53624 primary records. [2025-09-23T22:17:46.347821] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-23T22:17:46.363471] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-09-23T22:17:46.363533] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-23T22:17:46.366132] [INFO ] [MAIN ] Derivative Progress: 360/2077 symbols completed. CFG took 1.2s. Estimated remaining: 11m 8s. Rate: 154.1 symbols/min [2025-09-23T22:17:46.367696] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:46.367419] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:46.367599] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:46.374576] [DEBUG] [LOCAL ] CGV: Loaded 1405 existing records from primary storage. [2025-09-23T22:17:46.374955] [INFO ] [MAIN ] CGV: Loaded 1405 primary data records. [2025-09-23T22:17:46.640103] [DEBUG] [LOCAL ] CHCT: Loaded 24013 existing records from primary storage. [2025-09-23T22:17:46.716569] [INFO ] [MAIN ] CHCT: Loaded 24013 primary data records. [2025-09-23T22:17:46.728908] [DEBUG] [LOCAL ] CGAU: Loaded 42686 existing records from primary storage. [2025-09-23T22:17:46.754625] [INFO ] [MAIN ] CGAU: Loaded 42686 primary data records. [2025-09-23T22:17:47.435156] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:17:47.437000] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1405 primary records. [2025-09-23T22:17:47.437245] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-23T22:17:47.455374] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-09-23T22:17:47.455547] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-23T22:17:47.457816] [INFO ] [MAIN ] Derivative Progress: 361/2077 symbols completed. CGV took 1.1s. Estimated remaining: 11m 11s. Rate: 153.4 symbols/min [2025-09-23T22:17:47.465845] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:47.471901] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:47.472628] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24013 primary records. [2025-09-23T22:17:47.472851] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-23T22:17:47.503813] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:47.505235] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42686 primary records. [2025-09-23T22:17:47.505896] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-09-23T22:17:47.506061] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-23T22:17:47.508185] [INFO ] [MAIN ] Derivative Progress: 362/2077 symbols completed. CHCT took 1.1s. Estimated remaining: 11m 9s. Rate: 153.7 symbols/min [2025-09-23T22:17:47.508540] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:47.505961] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-23T22:17:47.529687] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-09-23T22:17:47.529808] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-23T22:17:47.533007] [INFO ] [MAIN ] Derivative Progress: 363/2077 symbols completed. CGAU took 1.2s. Estimated remaining: 11m 7s. Rate: 154.1 symbols/min [2025-09-23T22:17:47.533502] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:47.553298] [DEBUG] [LOCAL ] CHE: Loaded 14740 existing records from primary storage. [2025-09-23T22:17:47.553630] [INFO ] [MAIN ] CHE: Loaded 14740 primary data records. [2025-09-23T22:17:47.702888] [DEBUG] [LOCAL ] CHD: Loaded 52024 existing records from primary storage. [2025-09-23T22:17:47.735113] [INFO ] [MAIN ] CHD: Loaded 52024 primary data records. [2025-09-23T22:17:48.010136] [DEBUG] [LOCAL ] CHGG: Loaded 47742 existing records from primary storage. [2025-09-23T22:17:48.016456] [INFO ] [MAIN ] CHGG: Loaded 47742 primary data records. [2025-09-23T22:17:48.538969] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:48.540305] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 14740 primary records. [2025-09-23T22:17:48.541239] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-23T22:17:48.565365] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-09-23T22:17:48.566459] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-23T22:17:48.582891] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:48.583873] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52024 primary records. [2025-09-23T22:17:48.581921] [INFO ] [MAIN ] Derivative Progress: 364/2077 symbols completed. CHE took 1.1s. Estimated remaining: 11m 10s. Rate: 153.4 symbols/min [2025-09-23T22:17:48.584593] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:48.584692] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-23T22:17:48.602513] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-09-23T22:17:48.602703] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-23T22:17:48.604805] [INFO ] [MAIN ] Derivative Progress: 365/2077 symbols completed. CHD took 1.1s. Estimated remaining: 11m 8s. Rate: 153.8 symbols/min [2025-09-23T22:17:48.607802] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:48.622738] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:48.623432] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47742 primary records. [2025-09-23T22:17:48.623598] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-23T22:17:48.640161] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-09-23T22:17:48.645365] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-23T22:17:48.647985] [INFO ] [MAIN ] Derivative Progress: 366/2077 symbols completed. CHGG took 1.1s. Estimated remaining: 11m 6s. Rate: 154.2 symbols/min [2025-09-23T22:17:48.648557] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:48.670947] [DEBUG] [LOCAL ] CHMI: Loaded 22112 existing records from primary storage. [2025-09-23T22:17:48.671148] [INFO ] [MAIN ] CHMI: Loaded 22112 primary data records. [2025-09-23T22:17:48.717272] [DEBUG] [LOCAL ] CHN: Loaded 4788 existing records from primary storage. [2025-09-23T22:17:48.738384] [INFO ] [MAIN ] CHN: Loaded 4788 primary data records. [2025-09-23T22:17:48.877456] [DEBUG] [LOCAL ] CHH: Loaded 32213 existing records from primary storage. [2025-09-23T22:17:48.909373] [INFO ] [MAIN ] CHH: Loaded 32213 primary data records. [2025-09-23T22:17:49.662538] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:49.665523] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 22112 primary records. [2025-09-23T22:17:49.666407] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-23T22:17:49.681739] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:49.693544] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4788 primary records. [2025-09-23T22:17:49.695794] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-23T22:17:49.698946] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-09-23T22:17:49.699711] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-23T22:17:49.702119] [INFO ] [MAIN ] Derivative Progress: 367/2077 symbols completed. CHMI took 1.1s. Estimated remaining: 11m 9s. Rate: 153.5 symbols/min [2025-09-23T22:17:49.702465] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:49.721938] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-09-23T22:17:49.734803] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-23T22:17:49.735140] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:49.737911] [INFO ] [MAIN ] Derivative Progress: 368/2077 symbols completed. CHN took 1.1s. Estimated remaining: 11m 6s. Rate: 153.9 symbols/min [2025-09-23T22:17:49.738355] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:49.739317] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32213 primary records. [2025-09-23T22:17:49.740564] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-23T22:17:49.771894] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-09-23T22:17:49.776156] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-23T22:17:49.778958] [INFO ] [MAIN ] Derivative Progress: 369/2077 symbols completed. CHH took 1.2s. Estimated remaining: 11m 4s. Rate: 154.2 symbols/min [2025-09-23T22:17:49.779435] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:49.805334] [DEBUG] [LOCAL ] CHT: Loaded 19542 existing records from primary storage. [2025-09-23T22:17:49.805576] [INFO ] [MAIN ] CHT: Loaded 19542 primary data records. [2025-09-23T22:17:49.806368] [DEBUG] [LOCAL ] CHPT: Loaded 49401 existing records from primary storage. [2025-09-23T22:17:49.811863] [INFO ] [MAIN ] CHPT: Loaded 49401 primary data records. [2025-09-23T22:17:50.455962] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-23T22:17:50.456317] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-09-23T22:17:50.865285] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:50.866994] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 49401 primary records. [2025-09-23T22:17:50.866144] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:50.868062] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19542 primary records. [2025-09-23T22:17:50.868221] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-23T22:17:50.868168] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-23T22:17:50.897878] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-09-23T22:17:50.898409] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-23T22:17:50.900836] [INFO ] [MAIN ] Derivative Progress: 370/2077 symbols completed. CHT took 1.2s. Estimated remaining: 11m 7s. Rate: 153.5 symbols/min [2025-09-23T22:17:50.901617] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:50.906805] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-09-23T22:17:50.906884] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-23T22:17:50.909585] [INFO ] [MAIN ] Derivative Progress: 371/2077 symbols completed. CHPT took 1.2s. Estimated remaining: 11m 5s. Rate: 153.9 symbols/min [2025-09-23T22:17:50.910162] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:50.926815] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:50.927573] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53654 primary records. [2025-09-23T22:17:50.927730] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-23T22:17:50.954252] [DEBUG] [LOCAL ] CIA: Loaded 17059 existing records from primary storage. [2025-09-23T22:17:50.954435] [INFO ] [MAIN ] CIA: Loaded 17059 primary data records. [2025-09-23T22:17:50.968896] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-09-23T22:17:50.992023] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-23T22:17:51.013100] [INFO ] [MAIN ] Derivative Progress: 372/2077 symbols completed. CHWY took 1.2s. Estimated remaining: 11m 4s. Rate: 154.2 symbols/min [2025-09-23T22:17:51.073175] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:51.287953] [DEBUG] [LOCAL ] CI: Loaded 49904 existing records from primary storage. [2025-09-23T22:17:51.288716] [INFO ] [MAIN ] CI: Loaded 49904 primary data records. [2025-09-23T22:17:51.500151] [DEBUG] [LOCAL ] CIB: Loaded 31006 existing records from primary storage. [2025-09-23T22:17:51.617883] [INFO ] [MAIN ] CIB: Loaded 31006 primary data records. [2025-09-23T22:17:51.984421] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:51.994667] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 17059 primary records. [2025-09-23T22:17:51.994974] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-23T22:17:52.026424] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-09-23T22:17:52.031799] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:52.032567] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49904 primary records. [2025-09-23T22:17:52.031868] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-23T22:17:52.034756] [INFO ] [MAIN ] Derivative Progress: 373/2077 symbols completed. CIA took 1.1s. Estimated remaining: 11m 6s. Rate: 153.5 symbols/min [2025-09-23T22:17:52.035062] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-23T22:17:52.051617] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-09-23T22:17:52.051920] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-23T22:17:52.054241] [INFO ] [MAIN ] Derivative Progress: 374/2077 symbols completed. CI took 1.2s. Estimated remaining: 11m 4s. Rate: 153.9 symbols/min [2025-09-23T22:17:52.069154] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:52.069766] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 31006 primary records. [2025-09-23T22:17:52.069828] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-23T22:17:52.084822] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-09-23T22:17:52.084883] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-23T22:17:52.087384] [INFO ] [MAIN ] Derivative Progress: 375/2077 symbols completed. CIB took 1.0s. Estimated remaining: 11m 2s. Rate: 154.3 symbols/min [2025-09-23T22:17:52.087976] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:52.088052] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:52.088222] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:52.095791] [DEBUG] [LOCAL ] CIF: Loaded 4364 existing records from primary storage. [2025-09-23T22:17:52.096065] [INFO ] [MAIN ] CIF: Loaded 4364 primary data records. [2025-09-23T22:17:52.470465] [DEBUG] [LOCAL ] CIEN: Loaded 52087 existing records from primary storage. [2025-09-23T22:17:52.468455] [DEBUG] [LOCAL ] CIG: Loaded 43739 existing records from primary storage. [2025-09-23T22:17:52.470979] [INFO ] [MAIN ] CIG: Loaded 43739 primary data records. [2025-09-23T22:17:52.470750] [INFO ] [MAIN ] CIEN: Loaded 52087 primary data records. [2025-09-23T22:17:53.109922] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:53.111558] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4364 primary records. [2025-09-23T22:17:53.111725] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-23T22:17:53.132856] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-09-23T22:17:53.133140] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-23T22:17:53.135827] [INFO ] [MAIN ] Derivative Progress: 376/2077 symbols completed. CIF took 1.0s. Estimated remaining: 11m 5s. Rate: 153.6 symbols/min [2025-09-23T22:17:53.136592] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:53.174185] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:53.174512] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:53.175536] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52087 primary records. [2025-09-23T22:17:53.176237] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43739 primary records. [2025-09-23T22:17:53.176424] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-23T22:17:53.176360] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-23T22:17:53.203374] [DEBUG] [LOCAL ] CII: Loaded 15526 existing records from primary storage. [2025-09-23T22:17:53.206438] [INFO ] [MAIN ] CII: Loaded 15526 primary data records. [2025-09-23T22:17:53.316753] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-09-23T22:17:53.317022] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-23T22:17:53.312982] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-09-23T22:17:53.322503] [INFO ] [MAIN ] Derivative Progress: 377/2077 symbols completed. CIG took 1.2s. Estimated remaining: 11m 3s. Rate: 153.8 symbols/min [2025-09-23T22:17:53.348709] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:53.338217] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-23T22:17:53.373206] [INFO ] [MAIN ] Derivative Progress: 378/2077 symbols completed. CIEN took 1.3s. Estimated remaining: 11m 1s. Rate: 154.1 symbols/min [2025-09-23T22:17:53.373513] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:53.583991] [DEBUG] [LOCAL ] CIMN: Loaded 2681 existing records from primary storage. [2025-09-23T22:17:53.584334] [INFO ] [MAIN ] CIMN: Loaded 2681 primary data records. [2025-09-23T22:17:53.943574] [DEBUG] [LOCAL ] CIM: Loaded 37225 existing records from primary storage. [2025-09-23T22:17:53.944583] [INFO ] [MAIN ] CIM: Loaded 37225 primary data records. [2025-09-23T22:17:54.082029] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:54.083244] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15526 primary records. [2025-09-23T22:17:54.083552] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-23T22:17:54.313318] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-09-23T22:17:54.313815] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-23T22:17:54.316249] [INFO ] [MAIN ] Derivative Progress: 379/2077 symbols completed. CII took 1.2s. Estimated remaining: 11m 3s. Rate: 153.6 symbols/min [2025-09-23T22:17:54.317316] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:54.342624] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:17:54.343751] [INFO ] [MAIN ] CIMN: Generated 1793 derivative records from 2681 primary records. [2025-09-23T22:17:54.344018] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-23T22:17:54.360962] [DEBUG] [LOCAL ] CINT: Loaded 18366 existing records from primary storage. [2025-09-23T22:17:54.362670] [INFO ] [MAIN ] CINT: Loaded 18366 primary data records. [2025-09-23T22:17:54.402043] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1793 records). [2025-09-23T22:17:54.441726] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-23T22:17:54.454969] [INFO ] [MAIN ] Derivative Progress: 380/2077 symbols completed. CIMN took 1.1s. Estimated remaining: 11m 2s. Rate: 153.8 symbols/min [2025-09-23T22:17:54.473475] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:54.539413] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:54.570365] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37225 primary records. [2025-09-23T22:17:54.570544] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-23T22:17:54.711847] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-09-23T22:17:54.712676] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-23T22:17:54.716061] [INFO ] [MAIN ] Derivative Progress: 381/2077 symbols completed. CIM took 1.4s. Estimated remaining: 11m 1s. Rate: 154.0 symbols/min [2025-09-23T22:17:54.716636] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:54.725338] [DEBUG] [LOCAL ] CIO: Loaded 20138 existing records from primary storage. [2025-09-23T22:17:54.725796] [INFO ] [MAIN ] CIO: Loaded 20138 primary data records. [2025-09-23T22:17:54.939333] [DEBUG] [LOCAL ] CION: Loaded 29384 existing records from primary storage. [2025-09-23T22:17:55.057219] [INFO ] [MAIN ] CION: Loaded 29384 primary data records. [2025-09-23T22:17:55.118595] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:55.156253] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 18366 primary records. [2025-09-23T22:17:55.161493] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-23T22:17:55.235401] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-09-23T22:17:55.271437] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-23T22:17:55.290958] [INFO ] [MAIN ] Derivative Progress: 382/2077 symbols completed. CINT took 1.0s. Estimated remaining: 11m 1s. Rate: 153.8 symbols/min [2025-09-23T22:17:55.296965] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:55.493333] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:55.494717] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20138 primary records. [2025-09-23T22:17:55.494840] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-23T22:17:55.528523] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-09-23T22:17:55.528911] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-23T22:17:55.531466] [INFO ] [MAIN ] Derivative Progress: 383/2077 symbols completed. CIO took 1.1s. Estimated remaining: 11m 0s. Rate: 153.9 symbols/min [2025-09-23T22:17:55.532123] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:55.548882] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:55.550685] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 29384 primary records. [2025-09-23T22:17:55.550808] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-23T22:17:55.580898] [DEBUG] [LOCAL ] CIVI: Loaded 52583 existing records from primary storage. [2025-09-23T22:17:55.584068] [INFO ] [MAIN ] CIVI: Loaded 52583 primary data records. [2025-09-23T22:17:55.748367] [DEBUG] [LOCAL ] CLB: Loaded 33098 existing records from primary storage. [2025-09-23T22:17:55.759624] [INFO ] [MAIN ] CLB: Loaded 33098 primary data records. [2025-09-23T22:17:55.776915] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-09-23T22:17:55.836318] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-23T22:17:55.887264] [INFO ] [MAIN ] Derivative Progress: 384/2077 symbols completed. CION took 1.2s. Estimated remaining: 10m 60s. Rate: 154.0 symbols/min [2025-09-23T22:17:55.907348] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:56.262247] [DEBUG] [LOCAL ] CLCO: Loaded 12763 existing records from primary storage. [2025-09-23T22:17:56.276167] [INFO ] [MAIN ] CLCO: Loaded 12763 primary data records. [2025-09-23T22:17:56.615170] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:56.617035] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52583 primary records. [2025-09-23T22:17:56.617536] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-23T22:17:56.652089] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-09-23T22:17:56.651419] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:56.653091] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-23T22:17:56.653019] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33098 primary records. [2025-09-23T22:17:56.653198] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-23T22:17:56.655570] [INFO ] [MAIN ] Derivative Progress: 385/2077 symbols completed. CIVI took 1.4s. Estimated remaining: 11m 1s. Rate: 153.6 symbols/min [2025-09-23T22:17:56.655947] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:56.688553] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-09-23T22:17:56.688852] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:56.688994] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-23T22:17:56.689711] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12763 primary records. [2025-09-23T22:17:56.692633] [INFO ] [MAIN ] Derivative Progress: 386/2077 symbols completed. CLB took 1.2s. Estimated remaining: 10m 59s. Rate: 153.9 symbols/min [2025-09-23T22:17:56.692770] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-23T22:17:56.692991] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:56.724777] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-09-23T22:17:56.724631] [DEBUG] [LOCAL ] CLDT: Loaded 25815 existing records from primary storage. [2025-09-23T22:17:56.724904] [INFO ] [MAIN ] CLDT: Loaded 25815 primary data records. [2025-09-23T22:17:56.725054] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-23T22:17:56.748282] [INFO ] [MAIN ] Derivative Progress: 387/2077 symbols completed. CLCO took 0.8s. Estimated remaining: 10m 57s. Rate: 154.3 symbols/min [2025-09-23T22:17:56.792241] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:57.049694] [DEBUG] [LOCAL ] CLPR: Loaded 11559 existing records from primary storage. [2025-09-23T22:17:57.050032] [INFO ] [MAIN ] CLPR: Loaded 11559 primary data records. [2025-09-23T22:17:57.116088] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-23T22:17:57.122088] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-09-23T22:17:57.744935] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:57.751008] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25815 primary records. [2025-09-23T22:17:57.751158] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-23T22:17:57.884763] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-09-23T22:17:57.890365] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:57.892151] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 11559 primary records. [2025-09-23T22:17:57.890433] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-23T22:17:57.894811] [INFO ] [MAIN ] Derivative Progress: 388/2077 symbols completed. CLDT took 1.2s. Estimated remaining: 11m 0s. Rate: 153.5 symbols/min [2025-09-23T22:17:57.892281] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-23T22:17:57.913711] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-09-23T22:17:57.913796] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-23T22:17:57.916084] [INFO ] [MAIN ] Derivative Progress: 389/2077 symbols completed. CLPR took 1.1s. Estimated remaining: 10m 58s. Rate: 153.9 symbols/min [2025-09-23T22:17:57.933690] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:57.934617] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-09-23T22:17:57.934719] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-23T22:17:57.951560] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-09-23T22:17:57.951703] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-23T22:17:57.955385] [INFO ] [MAIN ] Derivative Progress: 390/2077 symbols completed. CLF took 1.3s. Estimated remaining: 10m 56s. Rate: 154.2 symbols/min [2025-09-23T22:17:57.956137] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:57.956427] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:57.956876] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:57.996528] [DEBUG] [LOCAL ] CLW: Loaded 21956 existing records from primary storage. [2025-09-23T22:17:57.996851] [INFO ] [MAIN ] CLW: Loaded 21956 primary data records. [2025-09-23T22:17:58.183951] [DEBUG] [LOCAL ] CLS: Loaded 53638 existing records from primary storage. [2025-09-23T22:17:58.194516] [INFO ] [MAIN ] CLS: Loaded 53638 primary data records. [2025-09-23T22:17:58.210966] [DEBUG] [LOCAL ] CLVT: Loaded 51969 existing records from primary storage. [2025-09-23T22:17:58.257625] [INFO ] [MAIN ] CLVT: Loaded 51969 primary data records. [2025-09-23T22:17:59.026729] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:59.028024] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21956 primary records. [2025-09-23T22:17:59.028409] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-23T22:17:59.063308] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-09-23T22:17:59.063959] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-23T22:17:59.062478] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:59.066139] [INFO ] [MAIN ] Derivative Progress: 391/2077 symbols completed. CLW took 1.1s. Estimated remaining: 10m 59s. Rate: 153.5 symbols/min [2025-09-23T22:17:59.067910] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51969 primary records. [2025-09-23T22:17:59.068928] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-23T22:17:59.070198] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:59.096669] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:17:59.098429] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53638 primary records. [2025-09-23T22:17:59.099791] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-09-23T22:17:59.099864] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-23T22:17:59.099943] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-23T22:17:59.103507] [INFO ] [MAIN ] Derivative Progress: 392/2077 symbols completed. CLVT took 1.1s. Estimated remaining: 10m 57s. Rate: 153.9 symbols/min [2025-09-23T22:17:59.111396] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:59.124017] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-09-23T22:17:59.124265] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-23T22:17:59.127169] [INFO ] [MAIN ] Derivative Progress: 393/2077 symbols completed. CLS took 1.2s. Estimated remaining: 10m 55s. Rate: 154.2 symbols/min [2025-09-23T22:17:59.127688] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:17:59.169062] [DEBUG] [LOCAL ] CM: Loaded 48632 existing records from primary storage. [2025-09-23T22:17:59.169284] [INFO ] [MAIN ] CM: Loaded 48632 primary data records. [2025-09-23T22:17:59.362935] [DEBUG] [LOCAL ] CMA: Loaded 50140 existing records from primary storage. [2025-09-23T22:17:59.395732] [INFO ] [MAIN ] CMA: Loaded 50140 primary data records. [2025-09-23T22:17:59.413112] [DEBUG] [LOCAL ] CMC: Loaded 45728 existing records from primary storage. [2025-09-23T22:17:59.553517] [INFO ] [MAIN ] CMC: Loaded 45728 primary data records. [2025-09-23T22:18:00.204158] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:00.205203] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48632 primary records. [2025-09-23T22:18:00.206194] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-23T22:18:00.236867] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-09-23T22:18:00.237362] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:00.238250] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 50140 primary records. [2025-09-23T22:18:00.237422] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-23T22:18:00.240459] [INFO ] [MAIN ] Derivative Progress: 394/2077 symbols completed. CM took 1.2s. Estimated remaining: 10m 58s. Rate: 153.5 symbols/min [2025-09-23T22:18:00.241077] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:00.240854] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-23T22:18:00.263702] [DEBUG] [LOCAL ] CMCM: Loaded 4730 existing records from primary storage. [2025-09-23T22:18:00.264360] [INFO ] [MAIN ] CMCM: Loaded 4730 primary data records. [2025-09-23T22:18:00.300441] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-09-23T22:18:00.331113] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:00.366234] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-23T22:18:00.374805] [INFO ] [MAIN ] Derivative Progress: 395/2077 symbols completed. CMA took 1.3s. Estimated remaining: 10m 56s. Rate: 153.8 symbols/min [2025-09-23T22:18:00.393326] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:00.372125] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45728 primary records. [2025-09-23T22:18:00.397413] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-23T22:18:00.623500] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-09-23T22:18:00.623734] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-23T22:18:00.626575] [INFO ] [MAIN ] Derivative Progress: 396/2077 symbols completed. CMC took 1.5s. Estimated remaining: 10m 55s. Rate: 153.9 symbols/min [2025-09-23T22:18:00.627027] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:00.667536] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:00.682894] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4730 primary records. [2025-09-23T22:18:00.683067] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-23T22:18:00.690764] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-09-23T22:18:00.691986] [INFO ] [MAIN ] CMG: Loaded 53720 primary data records. [2025-09-23T22:18:00.798190] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-09-23T22:18:00.811541] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-23T22:18:00.822179] [INFO ] [MAIN ] Derivative Progress: 397/2077 symbols completed. CMCM took 0.6s. Estimated remaining: 10m 54s. Rate: 154.1 symbols/min [2025-09-23T22:18:00.849554] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:00.855500] [DEBUG] [LOCAL ] CMI: Loaded 41900 existing records from primary storage. [2025-09-23T22:18:00.861048] [INFO ] [MAIN ] CMI: Loaded 41900 primary data records. [2025-09-23T22:18:01.386971] [DEBUG] [LOCAL ] CMRE: Loaded 35502 existing records from primary storage. [2025-09-23T22:18:01.387387] [INFO ] [MAIN ] CMRE: Loaded 35502 primary data records. [2025-09-23T22:18:01.788128] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:01.789388] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53720 primary records. [2025-09-23T22:18:01.790843] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-23T22:18:01.831588] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:01.834022] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41900 primary records. [2025-09-23T22:18:01.835564] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-23T22:18:01.861775] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-09-23T22:18:01.862904] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-23T22:18:01.866381] [INFO ] [MAIN ] Derivative Progress: 398/2077 symbols completed. CMG took 1.5s. Estimated remaining: 10m 57s. Rate: 153.4 symbols/min [2025-09-23T22:18:01.868053] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:01.870565] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-09-23T22:18:01.870738] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-23T22:18:01.874019] [INFO ] [MAIN ] Derivative Progress: 399/2077 symbols completed. CMI took 1.2s. Estimated remaining: 10m 55s. Rate: 153.8 symbols/min [2025-09-23T22:18:01.875067] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:01.899140] [DEBUG] [LOCAL ] CMSA: Loaded 3391 existing records from primary storage. [2025-09-23T22:18:01.899928] [INFO ] [MAIN ] CMSA: Loaded 3391 primary data records. [2025-09-23T22:18:01.899859] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:01.922540] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35502 primary records. [2025-09-23T22:18:01.951059] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-23T22:18:02.263111] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-09-23T22:18:02.265547] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-23T22:18:02.268090] [INFO ] [MAIN ] Derivative Progress: 400/2077 symbols completed. CMRE took 1.4s. Estimated remaining: 10m 54s. Rate: 153.8 symbols/min [2025-09-23T22:18:02.291544] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:02.293228] [DEBUG] [LOCAL ] CMS: Loaded 52611 existing records from primary storage. [2025-09-23T22:18:02.294399] [INFO ] [MAIN ] CMS: Loaded 52611 primary data records. [2025-09-23T22:18:02.388091] [DEBUG] [LOCAL ] CMSC: Loaded 5090 existing records from primary storage. [2025-09-23T22:18:02.394848] [INFO ] [MAIN ] CMSC: Loaded 5090 primary data records. [2025-09-23T22:18:02.971294] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:18:02.972844] [INFO ] [MAIN ] CMSA: Generated 1793 derivative records from 3391 primary records. [2025-09-23T22:18:02.973024] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-23T22:18:02.991050] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1793 records). [2025-09-23T22:18:02.991379] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-23T22:18:02.993818] [INFO ] [MAIN ] Derivative Progress: 401/2077 symbols completed. CMSA took 1.1s. Estimated remaining: 10m 55s. Rate: 153.5 symbols/min [2025-09-23T22:18:02.994937] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:03.007115] [DEBUG] [LOCAL ] CMSD: Loaded 8098 existing records from primary storage. [2025-09-23T22:18:03.007265] [INFO ] [MAIN ] CMSD: Loaded 8098 primary data records. [2025-09-23T22:18:03.151555] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:03.151814] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:03.181687] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52611 primary records. [2025-09-23T22:18:03.190310] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-23T22:18:03.191008] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5090 primary records. [2025-09-23T22:18:03.215217] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-23T22:18:03.368773] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-09-23T22:18:03.366746] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-09-23T22:18:03.369087] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-23T22:18:03.371845] [INFO ] [MAIN ] Derivative Progress: 402/2077 symbols completed. CMSC took 1.1s. Estimated remaining: 10m 55s. Rate: 153.5 symbols/min [2025-09-23T22:18:03.369164] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-23T22:18:03.374366] [INFO ] [MAIN ] Derivative Progress: 403/2077 symbols completed. CMS took 1.5s. Estimated remaining: 10m 53s. Rate: 153.9 symbols/min [2025-09-23T22:18:03.375130] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:03.397795] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:18:03.398519] [INFO ] [MAIN ] CMSD: Generated 1793 derivative records from 8098 primary records. [2025-09-23T22:18:03.398581] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-23T22:18:03.422287] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1793 records). [2025-09-23T22:18:03.432154] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-23T22:18:03.435445] [INFO ] [MAIN ] Derivative Progress: 404/2077 symbols completed. CMSD took 0.4s. Estimated remaining: 10m 51s. Rate: 154.2 symbols/min [2025-09-23T22:18:03.436544] [DEBUG] [LOCAL ] CMTG: Loaded 37485 existing records from primary storage. [2025-09-23T22:18:03.436681] [INFO ] [MAIN ] CMTG: Loaded 37485 primary data records. [2025-09-23T22:18:03.753662] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:03.754332] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 37485 primary records. [2025-09-23T22:18:03.754395] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-23T22:18:03.769918] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-09-23T22:18:03.770016] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-23T22:18:03.772031] [INFO ] [MAIN ] Derivative Progress: 405/2077 symbols completed. CMTG took 0.4s. Estimated remaining: 10m 50s. Rate: 154.2 symbols/min [2025-09-23T22:18:03.772879] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:03.772949] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:03.773825] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:03.785167] [DEBUG] [LOCAL ] CMU: Loaded 7381 existing records from primary storage. [2025-09-23T22:18:03.785412] [INFO ] [MAIN ] CMU: Loaded 7381 primary data records. [2025-09-23T22:18:04.156235] [DEBUG] [LOCAL ] CNA: Loaded 32752 existing records from primary storage. [2025-09-23T22:18:04.171057] [DEBUG] [LOCAL ] CNC: Loaded 53737 existing records from primary storage. [2025-09-23T22:18:04.171345] [INFO ] [MAIN ] CNC: Loaded 53737 primary data records. [2025-09-23T22:18:04.171555] [INFO ] [MAIN ] CNA: Loaded 32752 primary data records. [2025-09-23T22:18:04.798548] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:04.799449] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 7381 primary records. [2025-09-23T22:18:04.799935] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-23T22:18:04.817062] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-09-23T22:18:04.817885] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-23T22:18:04.820427] [INFO ] [MAIN ] Derivative Progress: 406/2077 symbols completed. CMU took 1.0s. Estimated remaining: 10m 53s. Rate: 153.6 symbols/min [2025-09-23T22:18:04.821218] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:04.843599] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:04.849282] [DEBUG] [LOCAL ] CNF: Loaded 10858 existing records from primary storage. [2025-09-23T22:18:04.851832] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53737 primary records. [2025-09-23T22:18:04.852190] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-23T22:18:04.852120] [INFO ] [MAIN ] CNF: Loaded 10858 primary data records. [2025-09-23T22:18:04.941275] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:04.951173] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32752 primary records. [2025-09-23T22:18:04.951525] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-23T22:18:05.005130] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-09-23T22:18:05.016421] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-23T22:18:05.034746] [INFO ] [MAIN ] Derivative Progress: 407/2077 symbols completed. CNA took 1.3s. Estimated remaining: 10m 52s. Rate: 153.8 symbols/min [2025-09-23T22:18:05.050095] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-09-23T22:18:05.050211] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:05.059368] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-23T22:18:05.072163] [INFO ] [MAIN ] Derivative Progress: 408/2077 symbols completed. CNC took 1.3s. Estimated remaining: 10m 50s. Rate: 154.1 symbols/min [2025-09-23T22:18:05.213107] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:05.256260] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:18:05.257126] [INFO ] [MAIN ] CNF: Generated 1792 derivative records from 10858 primary records. [2025-09-23T22:18:05.257236] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-23T22:18:05.285463] [DEBUG] [LOCAL ] CNF: Derivative data saved (1792 records). [2025-09-23T22:18:05.285688] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-23T22:18:05.287916] [INFO ] [MAIN ] Derivative Progress: 409/2077 symbols completed. CNF took 0.5s. Estimated remaining: 10m 49s. Rate: 154.3 symbols/min [2025-09-23T22:18:05.288375] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:05.305188] [DEBUG] [LOCAL ] CNH: Loaded 53561 existing records from primary storage. [2025-09-23T22:18:05.305448] [INFO ] [MAIN ] CNH: Loaded 53561 primary data records. [2025-09-23T22:18:05.391040] [DEBUG] [LOCAL ] CNK: Loaded 52903 existing records from primary storage. [2025-09-23T22:18:05.413341] [INFO ] [MAIN ] CNK: Loaded 52903 primary data records. [2025-09-23T22:18:05.960079] [DEBUG] [LOCAL ] CNMD: Loaded 32416 existing records from primary storage. [2025-09-23T22:18:05.974685] [INFO ] [MAIN ] CNMD: Loaded 32416 primary data records. [2025-09-23T22:18:06.330190] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:06.343306] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53561 primary records. [2025-09-23T22:18:06.343910] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-23T22:18:06.346293] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:06.356320] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52903 primary records. [2025-09-23T22:18:06.359354] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-23T22:18:06.381851] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-09-23T22:18:06.383920] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-09-23T22:18:06.384125] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-23T22:18:06.387011] [INFO ] [MAIN ] Derivative Progress: 410/2077 symbols completed. CNK took 1.2s. Estimated remaining: 10m 51s. Rate: 153.6 symbols/min [2025-09-23T22:18:06.387188] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-23T22:18:06.390189] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:06.390082] [INFO ] [MAIN ] Derivative Progress: 411/2077 symbols completed. CNH took 1.3s. Estimated remaining: 10m 49s. Rate: 154.0 symbols/min [2025-09-23T22:18:06.390864] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:06.407093] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:06.407906] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32416 primary records. [2025-09-23T22:18:06.408041] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-23T22:18:06.425420] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-09-23T22:18:06.425572] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-23T22:18:06.428131] [INFO ] [MAIN ] Derivative Progress: 412/2077 symbols completed. CNMD took 1.1s. Estimated remaining: 10m 47s. Rate: 154.3 symbols/min [2025-09-23T22:18:06.428508] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:06.467017] [DEBUG] [LOCAL ] CNNE: Loaded 36888 existing records from primary storage. [2025-09-23T22:18:06.478751] [INFO ] [MAIN ] CNNE: Loaded 36888 primary data records. [2025-09-23T22:18:06.491814] [DEBUG] [LOCAL ] CNO: Loaded 41431 existing records from primary storage. [2025-09-23T22:18:06.519376] [INFO ] [MAIN ] CNO: Loaded 41431 primary data records. [2025-09-23T22:18:06.777015] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-23T22:18:06.811281] [INFO ] [MAIN ] CNP: Loaded 53469 primary data records. [2025-09-23T22:18:07.484712] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:07.485931] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 41431 primary records. [2025-09-23T22:18:07.487233] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:07.487361] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-23T22:18:07.489944] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36888 primary records. [2025-09-23T22:18:07.490936] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-23T22:18:07.528008] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:07.529244] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53469 primary records. [2025-09-23T22:18:07.530319] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-23T22:18:07.548443] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-09-23T22:18:07.549207] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-23T22:18:07.552724] [INFO ] [MAIN ] Derivative Progress: 413/2077 symbols completed. CNNE took 1.2s. Estimated remaining: 10m 50s. Rate: 153.6 symbols/min [2025-09-23T22:18:07.550315] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-09-23T22:18:07.552882] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-23T22:18:07.555926] [INFO ] [MAIN ] Derivative Progress: 414/2077 symbols completed. CNO took 1.2s. Estimated remaining: 10m 48s. Rate: 154.0 symbols/min [2025-09-23T22:18:07.553894] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:07.558528] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-09-23T22:18:07.558722] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:07.559128] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-23T22:18:07.562320] [INFO ] [MAIN ] Derivative Progress: 415/2077 symbols completed. CNP took 1.1s. Estimated remaining: 10m 46s. Rate: 154.3 symbols/min [2025-09-23T22:18:07.562743] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:07.627467] [DEBUG] [LOCAL ] CODI: Loaded 39695 existing records from primary storage. [2025-09-23T22:18:07.628231] [INFO ] [MAIN ] CODI: Loaded 39695 primary data records. [2025-09-23T22:18:07.732637] [DEBUG] [LOCAL ] CNX: Loaded 51391 existing records from primary storage. [2025-09-23T22:18:07.732883] [INFO ] [MAIN ] CNX: Loaded 51391 primary data records. [2025-09-23T22:18:07.778544] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-09-23T22:18:07.792710] [INFO ] [MAIN ] CNQ: Loaded 53582 primary data records. [2025-09-23T22:18:08.658409] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:08.661842] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 39695 primary records. [2025-09-23T22:18:08.662561] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-23T22:18:08.693099] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:08.696337] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51391 primary records. [2025-09-23T22:18:08.699052] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-23T22:18:08.706877] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-09-23T22:18:08.712146] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-23T22:18:08.713435] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:08.715345] [INFO ] [MAIN ] Derivative Progress: 416/2077 symbols completed. CODI took 1.2s. Estimated remaining: 10m 49s. Rate: 153.6 symbols/min [2025-09-23T22:18:08.716022] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:08.724082] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53582 primary records. [2025-09-23T22:18:08.725554] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-23T22:18:08.746092] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-09-23T22:18:08.746763] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-23T22:18:08.749026] [INFO ] [MAIN ] Derivative Progress: 417/2077 symbols completed. CNX took 1.2s. Estimated remaining: 10m 47s. Rate: 153.9 symbols/min [2025-09-23T22:18:08.749853] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:08.753864] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-09-23T22:18:08.754020] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-23T22:18:08.756755] [INFO ] [MAIN ] Derivative Progress: 418/2077 symbols completed. CNQ took 1.2s. Estimated remaining: 10m 45s. Rate: 154.3 symbols/min [2025-09-23T22:18:08.816236] [DEBUG] [LOCAL ] COF: Loaded 53610 existing records from primary storage. [2025-09-23T22:18:08.816466] [INFO ] [MAIN ] COF: Loaded 53610 primary data records. [2025-09-23T22:18:08.937943] [DEBUG] [LOCAL ] COHR: Loaded 53365 existing records from primary storage. [2025-09-23T22:18:08.948621] [INFO ] [MAIN ] COHR: Loaded 53365 primary data records. [2025-09-23T22:18:09.461275] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:09.462263] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53610 primary records. [2025-09-23T22:18:09.462460] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-23T22:18:09.493237] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:09.494758] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53365 primary records. [2025-09-23T22:18:09.496674] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-23T22:18:09.496575] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-09-23T22:18:09.497543] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-23T22:18:09.499267] [INFO ] [MAIN ] Derivative Progress: 419/2077 symbols completed. COF took 0.8s. Estimated remaining: 10m 46s. Rate: 154.0 symbols/min [2025-09-23T22:18:09.518432] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-09-23T22:18:09.518579] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-23T22:18:09.521756] [INFO ] [MAIN ] Derivative Progress: 420/2077 symbols completed. COHR took 0.8s. Estimated remaining: 10m 44s. Rate: 154.3 symbols/min [2025-09-23T22:18:09.522470] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:09.522582] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:09.523153] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:09.609286] [DEBUG] [LOCAL ] CON: Loaded 38791 existing records from primary storage. [2025-09-23T22:18:09.610392] [DEBUG] [LOCAL ] COMP: Loaded 53386 existing records from primary storage. [2025-09-23T22:18:09.610492] [INFO ] [MAIN ] CON: Loaded 38791 primary data records. [2025-09-23T22:18:09.610582] [INFO ] [MAIN ] COMP: Loaded 53386 primary data records. [2025-09-23T22:18:09.852162] [DEBUG] [LOCAL ] COLD: Loaded 51991 existing records from primary storage. [2025-09-23T22:18:09.887215] [INFO ] [MAIN ] COLD: Loaded 51991 primary data records. [2025-09-23T22:18:10.625135] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:10.630933] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:10.631865] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38791 primary records. [2025-09-23T22:18:10.633111] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53386 primary records. [2025-09-23T22:18:10.633261] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-23T22:18:10.633305] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-23T22:18:10.666664] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-09-23T22:18:10.663845] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-09-23T22:18:10.667062] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-23T22:18:10.666979] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-23T22:18:10.669468] [INFO ] [MAIN ] Derivative Progress: 421/2077 symbols completed. COMP took 1.1s. Estimated remaining: 10m 47s. Rate: 153.6 symbols/min [2025-09-23T22:18:10.672966] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:10.673062] [INFO ] [MAIN ] Derivative Progress: 422/2077 symbols completed. CON took 1.1s. Estimated remaining: 10m 45s. Rate: 154.0 symbols/min [2025-09-23T22:18:10.673943] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:10.689691] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:10.690479] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 51991 primary records. [2025-09-23T22:18:10.690626] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-23T22:18:10.713297] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-09-23T22:18:10.713406] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-23T22:18:10.716209] [INFO ] [MAIN ] Derivative Progress: 423/2077 symbols completed. COLD took 1.2s. Estimated remaining: 10m 43s. Rate: 154.3 symbols/min [2025-09-23T22:18:10.724717] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:10.725169] [DEBUG] [LOCAL ] COOK: Loaded 24522 existing records from primary storage. [2025-09-23T22:18:10.725430] [INFO ] [MAIN ] COOK: Loaded 24522 primary data records. [2025-09-23T22:18:11.073034] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-23T22:18:11.073377] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-09-23T22:18:11.191119] [DEBUG] [LOCAL ] COR: Loaded 47253 existing records from primary storage. [2025-09-23T22:18:11.203864] [INFO ] [MAIN ] COR: Loaded 47253 primary data records. [2025-09-23T22:18:11.744548] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:11.746468] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24522 primary records. [2025-09-23T22:18:11.747550] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-23T22:18:11.766021] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-09-23T22:18:11.767353] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-23T22:18:11.769283] [INFO ] [MAIN ] Derivative Progress: 424/2077 symbols completed. COOK took 1.1s. Estimated remaining: 10m 45s. Rate: 153.7 symbols/min [2025-09-23T22:18:11.770206] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:11.790947] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:11.792337] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-09-23T22:18:11.792613] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-23T22:18:11.827870] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-09-23T22:18:11.833478] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-23T22:18:11.833395] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:11.836474] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 47253 primary records. [2025-09-23T22:18:11.835665] [INFO ] [MAIN ] Derivative Progress: 425/2077 symbols completed. COP took 1.2s. Estimated remaining: 10m 44s. Rate: 154.0 symbols/min [2025-09-23T22:18:11.836699] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-23T22:18:11.837378] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:11.871571] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-09-23T22:18:11.871767] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-23T22:18:11.874394] [INFO ] [MAIN ] Derivative Progress: 426/2077 symbols completed. COR took 1.1s. Estimated remaining: 10m 42s. Rate: 154.3 symbols/min [2025-09-23T22:18:11.874792] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:11.898979] [DEBUG] [LOCAL ] COTY: Loaded 53248 existing records from primary storage. [2025-09-23T22:18:11.899326] [INFO ] [MAIN ] COTY: Loaded 53248 primary data records. [2025-09-23T22:18:12.139341] [DEBUG] [LOCAL ] COUR: Loaded 48950 existing records from primary storage. [2025-09-23T22:18:12.139839] [INFO ] [MAIN ] COUR: Loaded 48950 primary data records. [2025-09-23T22:18:12.459837] [DEBUG] [LOCAL ] CP: Loaded 53279 existing records from primary storage. [2025-09-23T22:18:12.506369] [INFO ] [MAIN ] CP: Loaded 53279 primary data records. [2025-09-23T22:18:13.005807] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:13.008021] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53248 primary records. [2025-09-23T22:18:13.008314] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-23T22:18:13.026840] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-09-23T22:18:13.030244] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-23T22:18:13.032372] [INFO ] [MAIN ] Derivative Progress: 427/2077 symbols completed. COTY took 1.3s. Estimated remaining: 10m 45s. Rate: 153.6 symbols/min [2025-09-23T22:18:13.032820] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:13.048245] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:13.049433] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 48950 primary records. [2025-09-23T22:18:13.049580] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-23T22:18:13.071200] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-09-23T22:18:13.071371] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-23T22:18:13.073412] [INFO ] [MAIN ] Derivative Progress: 428/2077 symbols completed. COUR took 1.2s. Estimated remaining: 10m 43s. Rate: 153.9 symbols/min [2025-09-23T22:18:13.073843] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:13.095374] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:13.096431] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53279 primary records. [2025-09-23T22:18:13.096635] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-23T22:18:13.120414] [DEBUG] [LOCAL ] CPA: Loaded 28837 existing records from primary storage. [2025-09-23T22:18:13.123792] [INFO ] [MAIN ] CPA: Loaded 28837 primary data records. [2025-09-23T22:18:13.123665] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-09-23T22:18:13.187890] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-23T22:18:13.231019] [INFO ] [MAIN ] Derivative Progress: 429/2077 symbols completed. CP took 1.4s. Estimated remaining: 10m 42s. Rate: 154.1 symbols/min [2025-09-23T22:18:13.259076] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:13.265525] [DEBUG] [LOCAL ] CPAY: Loaded 31109 existing records from primary storage. [2025-09-23T22:18:13.299501] [INFO ] [MAIN ] CPAY: Loaded 31109 primary data records. [2025-09-23T22:18:13.588201] [DEBUG] [LOCAL ] CPF: Loaded 15434 existing records from primary storage. [2025-09-23T22:18:13.616093] [INFO ] [MAIN ] CPF: Loaded 15434 primary data records. [2025-09-23T22:18:14.017454] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:14.189240] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28837 primary records. [2025-09-23T22:18:14.194827] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-23T22:18:14.229118] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-09-23T22:18:14.237577] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-23T22:18:14.242888] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:14.245140] [INFO ] [MAIN ] Derivative Progress: 430/2077 symbols completed. CPA took 1.2s. Estimated remaining: 10m 44s. Rate: 153.6 symbols/min [2025-09-23T22:18:14.246298] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:14.247405] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 31109 primary records. [2025-09-23T22:18:14.247936] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-23T22:18:14.266380] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-09-23T22:18:14.266533] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-23T22:18:14.268993] [INFO ] [MAIN ] Derivative Progress: 431/2077 symbols completed. CPAY took 1.2s. Estimated remaining: 10m 42s. Rate: 153.9 symbols/min [2025-09-23T22:18:14.273512] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:14.282535] [DEBUG] [LOCAL ] CPK: Loaded 13338 existing records from primary storage. [2025-09-23T22:18:14.282807] [INFO ] [MAIN ] CPK: Loaded 13338 primary data records. [2025-09-23T22:18:14.404930] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:14.424425] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15434 primary records. [2025-09-23T22:18:14.424593] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-23T22:18:14.490402] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-09-23T22:18:14.511059] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-23T22:18:14.539447] [INFO ] [MAIN ] Derivative Progress: 432/2077 symbols completed. CPF took 1.3s. Estimated remaining: 10m 41s. Rate: 154.0 symbols/min [2025-09-23T22:18:14.559558] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:14.678061] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-09-23T22:18:14.678368] [INFO ] [MAIN ] CPNG: Loaded 53670 primary data records. [2025-09-23T22:18:15.051744] [DEBUG] [LOCAL ] CPRI: Loaded 52595 existing records from primary storage. [2025-09-23T22:18:15.050527] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:15.052943] [INFO ] [MAIN ] CPRI: Loaded 52595 primary data records. [2025-09-23T22:18:15.053023] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13338 primary records. [2025-09-23T22:18:15.053354] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-23T22:18:15.172512] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-09-23T22:18:15.172910] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-23T22:18:15.180812] [INFO ] [MAIN ] Derivative Progress: 433/2077 symbols completed. CPK took 0.9s. Estimated remaining: 10m 41s. Rate: 153.8 symbols/min [2025-09-23T22:18:15.387915] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:15.388815] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53670 primary records. [2025-09-23T22:18:15.389385] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-23T22:18:15.407218] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-09-23T22:18:15.407349] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-23T22:18:15.409760] [INFO ] [MAIN ] Derivative Progress: 434/2077 symbols completed. CPNG took 1.1s. Estimated remaining: 10m 40s. Rate: 153.9 symbols/min [2025-09-23T22:18:15.428872] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:15.429422] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52595 primary records. [2025-09-23T22:18:15.429481] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-23T22:18:15.444851] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-09-23T22:18:15.444927] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-23T22:18:15.446923] [INFO ] [MAIN ] Derivative Progress: 435/2077 symbols completed. CPRI took 0.9s. Estimated remaining: 10m 39s. Rate: 154.2 symbols/min [2025-09-23T22:18:15.447530] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:15.447474] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:15.447731] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:15.479979] [DEBUG] [LOCAL ] CQP: Loaded 19922 existing records from primary storage. [2025-09-23T22:18:15.480157] [INFO ] [MAIN ] CQP: Loaded 19922 primary data records. [2025-09-23T22:18:15.532108] [DEBUG] [LOCAL ] CR: Loaded 24782 existing records from primary storage. [2025-09-23T22:18:15.572493] [DEBUG] [LOCAL ] CPS: Loaded 26259 existing records from primary storage. [2025-09-23T22:18:15.582941] [INFO ] [MAIN ] CPS: Loaded 26259 primary data records. [2025-09-23T22:18:15.577748] [INFO ] [MAIN ] CR: Loaded 24782 primary data records. [2025-09-23T22:18:16.498449] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:16.499220] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 19922 primary records. [2025-09-23T22:18:16.499461] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-23T22:18:16.528896] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:16.544282] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-09-23T22:18:16.545203] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24782 primary records. [2025-09-23T22:18:16.545306] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-23T22:18:16.547600] [INFO ] [MAIN ] Derivative Progress: 436/2077 symbols completed. CQP took 1.1s. Estimated remaining: 10m 41s. Rate: 153.6 symbols/min [2025-09-23T22:18:16.547994] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:16.545508] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-23T22:18:16.549097] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:16.549773] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 26259 primary records. [2025-09-23T22:18:16.550087] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-23T22:18:16.578100] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-09-23T22:18:16.578210] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-23T22:18:16.581084] [INFO ] [MAIN ] Derivative Progress: 437/2077 symbols completed. CR took 1.1s. Estimated remaining: 10m 39s. Rate: 153.9 symbols/min [2025-09-23T22:18:16.581400] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:16.586098] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-09-23T22:18:16.586252] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-23T22:18:16.588882] [INFO ] [MAIN ] Derivative Progress: 438/2077 symbols completed. CPS took 1.1s. Estimated remaining: 10m 37s. Rate: 154.3 symbols/min [2025-09-23T22:18:16.589270] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:16.644832] [DEBUG] [LOCAL ] CRBG: Loaded 52352 existing records from primary storage. [2025-09-23T22:18:16.645051] [INFO ] [MAIN ] CRBG: Loaded 52352 primary data records. [2025-09-23T22:18:16.740904] [DEBUG] [LOCAL ] CRC: Loaded 44375 existing records from primary storage. [2025-09-23T22:18:16.758289] [INFO ] [MAIN ] CRC: Loaded 44375 primary data records. [2025-09-23T22:18:17.098826] [DEBUG] [LOCAL ] CRGY: Loaded 52511 existing records from primary storage. [2025-09-23T22:18:17.123067] [INFO ] [MAIN ] CRGY: Loaded 52511 primary data records. [2025-09-23T22:18:17.650476] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:17.652244] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52352 primary records. [2025-09-23T22:18:17.652488] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-23T22:18:17.683816] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:17.685224] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44375 primary records. [2025-09-23T22:18:17.686447] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-23T22:18:17.688755] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-09-23T22:18:17.700392] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-23T22:18:17.704133] [INFO ] [MAIN ] Derivative Progress: 439/2077 symbols completed. CRBG took 1.2s. Estimated remaining: 10m 40s. Rate: 153.6 symbols/min [2025-09-23T22:18:17.706706] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:17.720578] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:17.721796] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-09-23T22:18:17.722682] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52511 primary records. [2025-09-23T22:18:17.722788] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-23T22:18:17.722979] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-23T22:18:17.725236] [INFO ] [MAIN ] Derivative Progress: 440/2077 symbols completed. CRC took 1.1s. Estimated remaining: 10m 38s. Rate: 153.9 symbols/min [2025-09-23T22:18:17.726477] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:17.743174] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-09-23T22:18:17.743363] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-23T22:18:17.747182] [INFO ] [MAIN ] Derivative Progress: 441/2077 symbols completed. CRGY took 1.2s. Estimated remaining: 10m 36s. Rate: 154.3 symbols/min [2025-09-23T22:18:17.747550] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:17.832725] [DEBUG] [LOCAL ] CRI: Loaded 49985 existing records from primary storage. [2025-09-23T22:18:17.832049] [DEBUG] [LOCAL ] CRH: Loaded 53472 existing records from primary storage. [2025-09-23T22:18:17.832940] [INFO ] [MAIN ] CRH: Loaded 53472 primary data records. [2025-09-23T22:18:17.832890] [INFO ] [MAIN ] CRI: Loaded 49985 primary data records. [2025-09-23T22:18:18.071699] [DEBUG] [LOCAL ] CRK: Loaded 52121 existing records from primary storage. [2025-09-23T22:18:18.088748] [INFO ] [MAIN ] CRK: Loaded 52121 primary data records. [2025-09-23T22:18:18.885024] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:18.884547] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:18.885903] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49985 primary records. [2025-09-23T22:18:18.886108] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-23T22:18:18.886809] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53472 primary records. [2025-09-23T22:18:18.886922] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-23T22:18:18.931525] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:18.933241] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52121 primary records. [2025-09-23T22:18:18.933382] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-23T22:18:18.934739] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-09-23T22:18:18.935577] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-23T22:18:18.937813] [INFO ] [MAIN ] Derivative Progress: 442/2077 symbols completed. CRI took 1.2s. Estimated remaining: 10m 39s. Rate: 153.6 symbols/min [2025-09-23T22:18:18.935496] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-09-23T22:18:18.938071] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:18.939347] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-23T22:18:18.942786] [INFO ] [MAIN ] Derivative Progress: 443/2077 symbols completed. CRH took 1.2s. Estimated remaining: 10m 37s. Rate: 153.9 symbols/min [2025-09-23T22:18:18.943475] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:18.966337] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-09-23T22:18:18.966554] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-23T22:18:18.969068] [INFO ] [MAIN ] Derivative Progress: 444/2077 symbols completed. CRK took 1.2s. Estimated remaining: 10m 35s. Rate: 154.2 symbols/min [2025-09-23T22:18:18.969358] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:18.979542] [DEBUG] [LOCAL ] CRT: Loaded 4954 existing records from primary storage. [2025-09-23T22:18:18.979705] [INFO ] [MAIN ] CRT: Loaded 4954 primary data records. [2025-09-23T22:18:19.336687] [DEBUG] [LOCAL ] CRS: Loaded 43423 existing records from primary storage. [2025-09-23T22:18:19.337610] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-23T22:18:19.337883] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-09-23T22:18:19.338104] [INFO ] [MAIN ] CRS: Loaded 43423 primary data records. [2025-09-23T22:18:19.987193] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:19.988440] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4954 primary records. [2025-09-23T22:18:19.988725] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-23T22:18:20.010488] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-09-23T22:18:20.010808] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-23T22:18:20.013290] [INFO ] [MAIN ] Derivative Progress: 445/2077 symbols completed. CRT took 1.0s. Estimated remaining: 10m 37s. Rate: 153.6 symbols/min [2025-09-23T22:18:20.013914] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:20.034508] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:20.035530] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43423 primary records. [2025-09-23T22:18:20.048520] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:20.048255] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-23T22:18:20.049324] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-09-23T22:18:20.050156] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-23T22:18:20.079422] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-09-23T22:18:20.080398] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-23T22:18:20.083561] [INFO ] [MAIN ] Derivative Progress: 446/2077 symbols completed. CRS took 1.1s. Estimated remaining: 10m 36s. Rate: 153.9 symbols/min [2025-09-23T22:18:20.084350] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:20.098244] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-09-23T22:18:20.098492] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-23T22:18:20.100706] [INFO ] [MAIN ] Derivative Progress: 447/2077 symbols completed. CRM took 1.2s. Estimated remaining: 10m 34s. Rate: 154.3 symbols/min [2025-09-23T22:18:20.101214] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:20.117113] [DEBUG] [LOCAL ] CSAN: Loaded 42250 existing records from primary storage. [2025-09-23T22:18:20.117421] [INFO ] [MAIN ] CSAN: Loaded 42250 primary data records. [2025-09-23T22:18:20.241912] [DEBUG] [LOCAL ] CSR: Loaded 12558 existing records from primary storage. [2025-09-23T22:18:20.269946] [INFO ] [MAIN ] CSR: Loaded 12558 primary data records. [2025-09-23T22:18:20.391568] [DEBUG] [LOCAL ] CSL: Loaded 31553 existing records from primary storage. [2025-09-23T22:18:20.404300] [INFO ] [MAIN ] CSL: Loaded 31553 primary data records. [2025-09-23T22:18:21.486011] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:21.487143] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42250 primary records. [2025-09-23T22:18:21.487785] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-23T22:18:21.507584] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-09-23T22:18:21.508704] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-23T22:18:21.511999] [INFO ] [MAIN ] Derivative Progress: 448/2077 symbols completed. CSAN took 1.5s. Estimated remaining: 10m 37s. Rate: 153.4 symbols/min [2025-09-23T22:18:21.531936] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-23T22:18:21.533236] [INFO ] [MAIN ] CSR: Generated 1791 derivative records from 12558 primary records. [2025-09-23T22:18:21.534408] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-23T22:18:21.559849] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:21.566516] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31553 primary records. [2025-09-23T22:18:21.566615] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-23T22:18:21.582883] [DEBUG] [LOCAL ] CSR: Derivative data saved (1791 records). [2025-09-23T22:18:21.584167] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-23T22:18:21.588180] [INFO ] [MAIN ] Derivative Progress: 449/2077 symbols completed. CSR took 1.5s. Estimated remaining: 10m 36s. Rate: 153.6 symbols/min [2025-09-23T22:18:21.589524] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-09-23T22:18:21.589616] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-23T22:18:21.592272] [INFO ] [MAIN ] Derivative Progress: 450/2077 symbols completed. CSL took 1.5s. Estimated remaining: 10m 34s. Rate: 154.0 symbols/min [2025-09-23T22:18:21.592866] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:21.592976] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:21.593666] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:21.605142] [DEBUG] [LOCAL ] CTBB: Loaded 7105 existing records from primary storage. [2025-09-23T22:18:21.605553] [INFO ] [MAIN ] CTBB: Loaded 7105 primary data records. [2025-09-23T22:18:21.731460] [DEBUG] [LOCAL ] CSV: Loaded 13081 existing records from primary storage. [2025-09-23T22:18:21.732166] [INFO ] [MAIN ] CSV: Loaded 13081 primary data records. [2025-09-23T22:18:22.185016] [DEBUG] [LOCAL ] CSTM: Loaded 47738 existing records from primary storage. [2025-09-23T22:18:22.185424] [INFO ] [MAIN ] CSTM: Loaded 47738 primary data records. [2025-09-23T22:18:22.717332] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:22.718967] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7105 primary records. [2025-09-23T22:18:22.719075] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-23T22:18:22.741863] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-09-23T22:18:22.742382] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-23T22:18:22.758131] [INFO ] [MAIN ] Derivative Progress: 451/2077 symbols completed. CTBB took 1.2s. Estimated remaining: 10m 36s. Rate: 153.3 symbols/min [2025-09-23T22:18:22.759138] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:22.760337] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:22.762491] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 13081 primary records. [2025-09-23T22:18:22.762767] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-23T22:18:22.783988] [DEBUG] [LOCAL ] CTDD: Loaded 5842 existing records from primary storage. [2025-09-23T22:18:22.797873] [INFO ] [MAIN ] CTDD: Loaded 5842 primary data records. [2025-09-23T22:18:22.814032] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:22.863488] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47738 primary records. [2025-09-23T22:18:22.886159] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-23T22:18:22.906424] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-09-23T22:18:22.925322] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-23T22:18:22.930098] [INFO ] [MAIN ] Derivative Progress: 452/2077 symbols completed. CSV took 1.3s. Estimated remaining: 10m 35s. Rate: 153.5 symbols/min [2025-09-23T22:18:22.930530] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:22.956746] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-09-23T22:18:22.981700] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-23T22:18:22.984869] [INFO ] [MAIN ] Derivative Progress: 453/2077 symbols completed. CSTM took 1.4s. Estimated remaining: 10m 34s. Rate: 153.8 symbols/min [2025-09-23T22:18:23.000639] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:23.193603] [DEBUG] [LOCAL ] CTO: Loaded 28318 existing records from primary storage. [2025-09-23T22:18:23.198795] [INFO ] [MAIN ] CTO: Loaded 28318 primary data records. [2025-09-23T22:18:23.199099] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:23.231745] [INFO ] [MAIN ] CTDD: Generated 1794 derivative records from 5842 primary records. [2025-09-23T22:18:23.265721] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-23T22:18:23.340065] [DEBUG] [LOCAL ] CTOS: Loaded 36812 existing records from primary storage. [2025-09-23T22:18:23.341349] [INFO ] [MAIN ] CTOS: Loaded 36812 primary data records. [2025-09-23T22:18:23.452482] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1794 records). [2025-09-23T22:18:23.637589] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-23T22:18:23.664676] [INFO ] [MAIN ] Derivative Progress: 454/2077 symbols completed. CTDD took 0.9s. Estimated remaining: 10m 34s. Rate: 153.5 symbols/min [2025-09-23T22:18:23.685993] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:23.931722] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:23.932476] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 28318 primary records. [2025-09-23T22:18:23.932672] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-23T22:18:23.966539] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-09-23T22:18:23.966782] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-23T22:18:23.969017] [INFO ] [MAIN ] Derivative Progress: 455/2077 symbols completed. CTO took 1.0s. Estimated remaining: 10m 34s. Rate: 153.6 symbols/min [2025-09-23T22:18:23.970127] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:23.997672] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:23.999799] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 36812 primary records. [2025-09-23T22:18:24.000070] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-23T22:18:24.000842] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-23T22:18:24.002042] [INFO ] [MAIN ] CTRA: Loaded 53649 primary data records. [2025-09-23T22:18:24.176339] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-09-23T22:18:24.223337] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-23T22:18:24.335278] [INFO ] [MAIN ] Derivative Progress: 456/2077 symbols completed. CTOS took 1.3s. Estimated remaining: 10m 33s. Rate: 153.6 symbols/min [2025-09-23T22:18:24.345720] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:24.368533] [DEBUG] [LOCAL ] CTRE: Loaded 49212 existing records from primary storage. [2025-09-23T22:18:24.369703] [INFO ] [MAIN ] CTRE: Loaded 49212 primary data records. [2025-09-23T22:18:24.706894] [DEBUG] [LOCAL ] CTRI: Loaded 37835 existing records from primary storage. [2025-09-23T22:18:24.716330] [INFO ] [MAIN ] CTRI: Loaded 37835 primary data records. [2025-09-23T22:18:24.924578] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:25.096213] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53649 primary records. [2025-09-23T22:18:25.096604] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-23T22:18:25.116813] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-09-23T22:18:25.117340] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-23T22:18:25.120088] [INFO ] [MAIN ] Derivative Progress: 457/2077 symbols completed. CTRA took 1.4s. Estimated remaining: 10m 34s. Rate: 153.3 symbols/min [2025-09-23T22:18:25.120910] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:25.141370] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:25.142632] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49212 primary records. [2025-09-23T22:18:25.142916] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-23T22:18:25.173178] [DEBUG] [LOCAL ] CTS: Loaded 19403 existing records from primary storage. [2025-09-23T22:18:25.174418] [INFO ] [MAIN ] CTS: Loaded 19403 primary data records. [2025-09-23T22:18:25.174933] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-09-23T22:18:25.180542] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-23T22:18:25.189259] [INFO ] [MAIN ] Derivative Progress: 458/2077 symbols completed. CTRE took 1.2s. Estimated remaining: 10m 33s. Rate: 153.6 symbols/min [2025-09-23T22:18:25.199428] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:25.309316] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:25.339813] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 37835 primary records. [2025-09-23T22:18:25.372786] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-23T22:18:25.513490] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-09-23T22:18:25.513958] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-23T22:18:25.530881] [INFO ] [MAIN ] Derivative Progress: 459/2077 symbols completed. CTRI took 1.2s. Estimated remaining: 10m 32s. Rate: 153.6 symbols/min [2025-09-23T22:18:25.531924] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:25.553702] [DEBUG] [LOCAL ] CTVA: Loaded 53229 existing records from primary storage. [2025-09-23T22:18:25.553966] [INFO ] [MAIN ] CTVA: Loaded 53229 primary data records. [2025-09-23T22:18:25.892913] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:25.895942] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19403 primary records. [2025-09-23T22:18:25.911298] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-23T22:18:25.914748] [DEBUG] [LOCAL ] CUBE: Loaded 50740 existing records from primary storage. [2025-09-23T22:18:25.914925] [INFO ] [MAIN ] CUBE: Loaded 50740 primary data records. [2025-09-23T22:18:25.981419] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-09-23T22:18:26.007032] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-23T22:18:26.034301] [INFO ] [MAIN ] Derivative Progress: 460/2077 symbols completed. CTS took 0.9s. Estimated remaining: 10m 32s. Rate: 153.5 symbols/min [2025-09-23T22:18:26.057747] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:26.292965] [DEBUG] [LOCAL ] CUBI: Loaded 27245 existing records from primary storage. [2025-09-23T22:18:26.293733] [INFO ] [MAIN ] CUBI: Loaded 27245 primary data records. [2025-09-23T22:18:26.363275] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:26.378275] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53229 primary records. [2025-09-23T22:18:26.378433] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-23T22:18:26.470814] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-09-23T22:18:26.486574] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-23T22:18:26.513444] [INFO ] [MAIN ] Derivative Progress: 461/2077 symbols completed. CTVA took 1.3s. Estimated remaining: 10m 32s. Rate: 153.4 symbols/min [2025-09-23T22:18:26.513817] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:26.655112] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:26.656892] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50740 primary records. [2025-09-23T22:18:26.657455] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-23T22:18:26.679904] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-09-23T22:18:26.693667] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-23T22:18:26.697269] [INFO ] [MAIN ] Derivative Progress: 462/2077 symbols completed. CUBE took 1.2s. Estimated remaining: 10m 31s. Rate: 153.6 symbols/min [2025-09-23T22:18:26.698849] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:26.716292] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:26.730505] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27245 primary records. [2025-09-23T22:18:26.734087] [DEBUG] [LOCAL ] CULP: Loaded 3010 existing records from primary storage. [2025-09-23T22:18:26.734300] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-23T22:18:26.734508] [INFO ] [MAIN ] CULP: Loaded 3010 primary data records. [2025-09-23T22:18:26.768667] [DEBUG] [LOCAL ] CUK: Loaded 51014 existing records from primary storage. [2025-09-23T22:18:26.812232] [INFO ] [MAIN ] CUK: Loaded 51014 primary data records. [2025-09-23T22:18:27.000052] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-09-23T22:18:27.028755] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-23T22:18:27.070303] [INFO ] [MAIN ] Derivative Progress: 463/2077 symbols completed. CUBI took 1.0s. Estimated remaining: 10m 30s. Rate: 153.6 symbols/min [2025-09-23T22:18:27.456159] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:18:27.457152] [INFO ] [MAIN ] CULP: Generated 1793 derivative records from 3010 primary records. [2025-09-23T22:18:27.457331] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-23T22:18:27.486073] [DEBUG] [LOCAL ] CULP: Derivative data saved (1793 records). [2025-09-23T22:18:27.486188] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-23T22:18:27.488537] [INFO ] [MAIN ] Derivative Progress: 464/2077 symbols completed. CULP took 0.8s. Estimated remaining: 10m 30s. Rate: 153.6 symbols/min [2025-09-23T22:18:27.489294] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:27.490021] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51014 primary records. [2025-09-23T22:18:27.490083] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-23T22:18:27.506502] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-09-23T22:18:27.506563] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-23T22:18:27.508830] [INFO ] [MAIN ] Derivative Progress: 465/2077 symbols completed. CUK took 1.0s. Estimated remaining: 10m 28s. Rate: 153.9 symbols/min [2025-09-23T22:18:27.509320] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:27.509429] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:27.509742] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:27.547114] [DEBUG] [LOCAL ] CURV: Loaded 26669 existing records from primary storage. [2025-09-23T22:18:27.547293] [INFO ] [MAIN ] CURV: Loaded 26669 primary data records. [2025-09-23T22:18:27.672242] [DEBUG] [LOCAL ] CURB: Loaded 33003 existing records from primary storage. [2025-09-23T22:18:27.683525] [INFO ] [MAIN ] CURB: Loaded 33003 primary data records. [2025-09-23T22:18:27.881584] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-09-23T22:18:28.010617] [INFO ] [MAIN ] CVE: Loaded 53556 primary data records. [2025-09-23T22:18:28.557588] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:28.559975] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26669 primary records. [2025-09-23T22:18:28.560277] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-23T22:18:28.593940] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:28.596125] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 33003 primary records. [2025-09-23T22:18:28.596816] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-23T22:18:28.614389] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-09-23T22:18:28.615234] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-23T22:18:28.617911] [INFO ] [MAIN ] Derivative Progress: 466/2077 symbols completed. CURV took 1.1s. Estimated remaining: 10m 31s. Rate: 153.3 symbols/min [2025-09-23T22:18:28.618909] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:28.635497] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-09-23T22:18:28.635990] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:28.636372] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-23T22:18:28.640426] [INFO ] [MAIN ] Derivative Progress: 467/2077 symbols completed. CURB took 1.1s. Estimated remaining: 10m 29s. Rate: 153.6 symbols/min [2025-09-23T22:18:28.637246] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53556 primary records. [2025-09-23T22:18:28.640764] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:28.641106] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-23T22:18:28.659117] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-09-23T22:18:28.659272] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-23T22:18:28.661776] [INFO ] [MAIN ] Derivative Progress: 468/2077 symbols completed. CVE took 1.2s. Estimated remaining: 10m 27s. Rate: 153.9 symbols/min [2025-09-23T22:18:28.666449] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:28.674526] [DEBUG] [LOCAL ] CVLG: Loaded 15567 existing records from primary storage. [2025-09-23T22:18:28.674702] [INFO ] [MAIN ] CVLG: Loaded 15567 primary data records. [2025-09-23T22:18:28.892285] [DEBUG] [LOCAL ] CVI: Loaded 46431 existing records from primary storage. [2025-09-23T22:18:29.026303] [INFO ] [MAIN ] CVI: Loaded 46431 primary data records. [2025-09-23T22:18:29.216442] [DEBUG] [LOCAL ] CVNA: Loaded 53022 existing records from primary storage. [2025-09-23T22:18:29.270146] [INFO ] [MAIN ] CVNA: Loaded 53022 primary data records. [2025-09-23T22:18:29.735264] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:29.736235] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15567 primary records. [2025-09-23T22:18:29.736439] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-23T22:18:29.772683] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:29.774878] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46431 primary records. [2025-09-23T22:18:29.775419] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-09-23T22:18:29.775626] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-23T22:18:29.775720] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-23T22:18:29.778522] [INFO ] [MAIN ] Derivative Progress: 469/2077 symbols completed. CVLG took 1.1s. Estimated remaining: 10m 29s. Rate: 153.3 symbols/min [2025-09-23T22:18:29.786511] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:29.798937] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-09-23T22:18:29.799828] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-23T22:18:29.802123] [INFO ] [MAIN ] Derivative Progress: 470/2077 symbols completed. CVI took 1.2s. Estimated remaining: 10m 28s. Rate: 153.6 symbols/min [2025-09-23T22:18:29.802395] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:29.818051] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:18:29.818960] [INFO ] [MAIN ] CVNA: Generated 1793 derivative records from 53022 primary records. [2025-09-23T22:18:29.819158] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-23T22:18:29.836565] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1793 records). [2025-09-23T22:18:29.836720] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-23T22:18:29.839191] [INFO ] [MAIN ] Derivative Progress: 471/2077 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 26s. Rate: 153.9 symbols/min [2025-09-23T22:18:29.839454] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:29.895405] [DEBUG] [LOCAL ] CVS: Loaded 53697 existing records from primary storage. [2025-09-23T22:18:29.895626] [INFO ] [MAIN ] CVS: Loaded 53697 primary data records. [2025-09-23T22:18:30.041044] [DEBUG] [LOCAL ] CW: Loaded 22479 existing records from primary storage. [2025-09-23T22:18:30.041398] [INFO ] [MAIN ] CW: Loaded 22479 primary data records. [2025-09-23T22:18:30.042070] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-23T22:18:30.052985] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-09-23T22:18:30.888319] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:30.890208] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53697 primary records. [2025-09-23T22:18:30.890573] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-23T22:18:30.923083] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-09-23T22:18:30.929235] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-23T22:18:30.930226] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:30.932172] [INFO ] [MAIN ] Derivative Progress: 472/2077 symbols completed. CVS took 1.2s. Estimated remaining: 10m 28s. Rate: 153.3 symbols/min [2025-09-23T22:18:30.932945] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:30.933829] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22479 primary records. [2025-09-23T22:18:30.934007] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-23T22:18:30.960733] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:30.962710] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-09-23T22:18:30.963817] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-23T22:18:30.980097] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-09-23T22:18:30.982834] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-23T22:18:30.985385] [INFO ] [MAIN ] Derivative Progress: 473/2077 symbols completed. CW took 1.1s. Estimated remaining: 10m 27s. Rate: 153.6 symbols/min [2025-09-23T22:18:30.987046] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:30.989183] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-09-23T22:18:30.989351] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-23T22:18:30.991676] [INFO ] [MAIN ] Derivative Progress: 474/2077 symbols completed. CVX took 1.2s. Estimated remaining: 10m 25s. Rate: 153.9 symbols/min [2025-09-23T22:18:30.992122] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:31.041168] [DEBUG] [LOCAL ] CWAN: Loaded 52401 existing records from primary storage. [2025-09-23T22:18:31.041628] [INFO ] [MAIN ] CWAN: Loaded 52401 primary data records. [2025-09-23T22:18:31.241185] [DEBUG] [LOCAL ] CWK: Loaded 49427 existing records from primary storage. [2025-09-23T22:18:31.251430] [INFO ] [MAIN ] CWK: Loaded 49427 primary data records. [2025-09-23T22:18:31.251266] [DEBUG] [LOCAL ] CWH: Loaded 51415 existing records from primary storage. [2025-09-23T22:18:31.312688] [INFO ] [MAIN ] CWH: Loaded 51415 primary data records. [2025-09-23T22:18:32.063470] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:32.064504] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52401 primary records. [2025-09-23T22:18:32.065034] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-23T22:18:32.098058] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:32.099587] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49427 primary records. [2025-09-23T22:18:32.100288] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-23T22:18:32.110580] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-09-23T22:18:32.110735] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-23T22:18:32.115906] [INFO ] [MAIN ] Derivative Progress: 475/2077 symbols completed. CWAN took 1.2s. Estimated remaining: 10m 27s. Rate: 153.3 symbols/min [2025-09-23T22:18:32.117420] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:32.134238] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:32.135510] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51415 primary records. [2025-09-23T22:18:32.136561] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-23T22:18:32.137551] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-09-23T22:18:32.138046] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-23T22:18:32.141275] [INFO ] [MAIN ] Derivative Progress: 476/2077 symbols completed. CWK took 1.1s. Estimated remaining: 10m 25s. Rate: 153.6 symbols/min [2025-09-23T22:18:32.141857] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:32.165712] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-09-23T22:18:32.165959] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-23T22:18:32.168422] [INFO ] [MAIN ] Derivative Progress: 477/2077 symbols completed. CWH took 1.2s. Estimated remaining: 10m 24s. Rate: 153.9 symbols/min [2025-09-23T22:18:32.168894] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:32.180813] [DEBUG] [LOCAL ] CWT: Loaded 27855 existing records from primary storage. [2025-09-23T22:18:32.187076] [INFO ] [MAIN ] CWT: Loaded 27855 primary data records. [2025-09-23T22:18:32.245528] [DEBUG] [LOCAL ] CXE: Loaded 7248 existing records from primary storage. [2025-09-23T22:18:32.271541] [INFO ] [MAIN ] CXE: Loaded 7248 primary data records. [2025-09-23T22:18:32.673920] [DEBUG] [LOCAL ] CX: Loaded 52840 existing records from primary storage. [2025-09-23T22:18:32.728908] [INFO ] [MAIN ] CX: Loaded 52840 primary data records. [2025-09-23T22:18:33.237612] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:33.239443] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 27855 primary records. [2025-09-23T22:18:33.239564] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-23T22:18:33.268022] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:33.269195] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 7248 primary records. [2025-09-23T22:18:33.269905] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-23T22:18:33.284184] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-09-23T22:18:33.285041] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-23T22:18:33.287417] [INFO ] [MAIN ] Derivative Progress: 478/2077 symbols completed. CWT took 1.2s. Estimated remaining: 10m 26s. Rate: 153.3 symbols/min [2025-09-23T22:18:33.293196] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-09-23T22:18:33.293332] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-23T22:18:33.295695] [INFO ] [MAIN ] Derivative Progress: 479/2077 symbols completed. CXE took 1.1s. Estimated remaining: 10m 24s. Rate: 153.6 symbols/min [2025-09-23T22:18:33.308415] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:33.309021] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52840 primary records. [2025-09-23T22:18:33.309086] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-23T22:18:33.323924] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-09-23T22:18:33.323999] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-23T22:18:33.326680] [INFO ] [MAIN ] Derivative Progress: 480/2077 symbols completed. CX took 1.2s. Estimated remaining: 10m 22s. Rate: 153.9 symbols/min [2025-09-23T22:18:33.327365] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:33.327444] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:33.327582] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:33.335000] [DEBUG] [LOCAL ] CXH: Loaded 4406 existing records from primary storage. [2025-09-23T22:18:33.335142] [INFO ] [MAIN ] CXH: Loaded 4406 primary data records. [2025-09-23T22:18:33.573481] [DEBUG] [LOCAL ] CXT: Loaded 31082 existing records from primary storage. [2025-09-23T22:18:33.703493] [INFO ] [MAIN ] CXT: Loaded 31082 primary data records. [2025-09-23T22:18:33.756634] [DEBUG] [LOCAL ] CXM: Loaded 47985 existing records from primary storage. [2025-09-23T22:18:33.785666] [INFO ] [MAIN ] CXM: Loaded 47985 primary data records. [2025-09-23T22:18:34.366882] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7833 incomplete bins [2025-09-23T22:18:34.368149] [INFO ] [MAIN ] CXH: Generated 1781 derivative records from 4406 primary records. [2025-09-23T22:18:34.368538] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-23T22:18:34.391301] [DEBUG] [LOCAL ] CXH: Derivative data saved (1781 records). [2025-09-23T22:18:34.392239] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-23T22:18:34.395089] [INFO ] [MAIN ] Derivative Progress: 481/2077 symbols completed. CXH took 1.1s. Estimated remaining: 10m 24s. Rate: 153.4 symbols/min [2025-09-23T22:18:34.408778] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:34.409405] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:34.411323] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 31082 primary records. [2025-09-23T22:18:34.411674] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-23T22:18:34.429969] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-09-23T22:18:34.430203] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-23T22:18:34.433406] [INFO ] [MAIN ] Derivative Progress: 482/2077 symbols completed. CXT took 1.1s. Estimated remaining: 10m 23s. Rate: 153.7 symbols/min [2025-09-23T22:18:34.434896] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:34.452780] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:34.453588] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47985 primary records. [2025-09-23T22:18:34.453761] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-23T22:18:34.489347] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-09-23T22:18:34.489517] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-23T22:18:34.492056] [INFO ] [MAIN ] Derivative Progress: 483/2077 symbols completed. CXM took 1.2s. Estimated remaining: 10m 21s. Rate: 153.9 symbols/min [2025-09-23T22:18:34.492600] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:34.513673] [DEBUG] [LOCAL ] CYD: Loaded 26605 existing records from primary storage. [2025-09-23T22:18:34.515214] [INFO ] [MAIN ] CYD: Loaded 26605 primary data records. [2025-09-23T22:18:34.515943] [DEBUG] [LOCAL ] CXW: Loaded 44386 existing records from primary storage. [2025-09-23T22:18:34.527351] [INFO ] [MAIN ] CXW: Loaded 44386 primary data records. [2025-09-23T22:18:35.198445] [DEBUG] [LOCAL ] CYH: Loaded 47841 existing records from primary storage. [2025-09-23T22:18:35.207321] [INFO ] [MAIN ] CYH: Loaded 47841 primary data records. [2025-09-23T22:18:35.538555] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:35.540305] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 44386 primary records. [2025-09-23T22:18:35.553438] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-23T22:18:35.553830] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:35.555725] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26605 primary records. [2025-09-23T22:18:35.555927] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-23T22:18:35.588521] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-09-23T22:18:35.589225] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-23T22:18:35.592764] [INFO ] [MAIN ] Derivative Progress: 484/2077 symbols completed. CYD took 1.2s. Estimated remaining: 10m 23s. Rate: 153.4 symbols/min [2025-09-23T22:18:35.593747] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:35.596354] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-09-23T22:18:35.596556] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-23T22:18:35.599000] [INFO ] [MAIN ] Derivative Progress: 485/2077 symbols completed. CXW took 1.2s. Estimated remaining: 10m 22s. Rate: 153.7 symbols/min [2025-09-23T22:18:35.599911] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:35.618021] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:35.618886] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47841 primary records. [2025-09-23T22:18:35.619057] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-23T22:18:35.639516] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-09-23T22:18:35.639783] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-23T22:18:35.642294] [INFO ] [MAIN ] Derivative Progress: 486/2077 symbols completed. CYH took 1.1s. Estimated remaining: 10m 20s. Rate: 153.9 symbols/min [2025-09-23T22:18:35.642699] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:35.712989] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-23T22:18:35.713350] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-09-23T22:18:35.847499] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-09-23T22:18:35.848097] [INFO ] [MAIN ] D: Loaded 53647 primary data records. [2025-09-23T22:18:36.153763] [DEBUG] [LOCAL ] DAN: Loaded 49032 existing records from primary storage. [2025-09-23T22:18:36.174827] [INFO ] [MAIN ] DAN: Loaded 49032 primary data records. [2025-09-23T22:18:36.742295] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:36.743938] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-09-23T22:18:36.745221] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-23T22:18:36.781827] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-09-23T22:18:36.781958] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-23T22:18:36.784625] [INFO ] [MAIN ] Derivative Progress: 487/2077 symbols completed. DAL took 1.2s. Estimated remaining: 10m 22s. Rate: 153.3 symbols/min [2025-09-23T22:18:36.786103] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:36.786475] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:36.788763] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53647 primary records. [2025-09-23T22:18:36.790306] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-23T22:18:36.817025] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:36.818991] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49032 primary records. [2025-09-23T22:18:36.819104] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-23T22:18:36.849154] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-09-23T22:18:36.851491] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-23T22:18:36.855035] [INFO ] [MAIN ] Derivative Progress: 488/2077 symbols completed. DAN took 1.2s. Estimated remaining: 10m 21s. Rate: 153.6 symbols/min [2025-09-23T22:18:36.855364] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:36.856200] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-09-23T22:18:36.856743] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-23T22:18:36.860250] [INFO ] [MAIN ] Derivative Progress: 489/2077 symbols completed. D took 1.3s. Estimated remaining: 10m 19s. Rate: 153.9 symbols/min [2025-09-23T22:18:36.851408] [DEBUG] [LOCAL ] DAO: Loaded 21242 existing records from primary storage. [2025-09-23T22:18:36.860545] [INFO ] [MAIN ] DAO: Loaded 21242 primary data records. [2025-09-23T22:18:36.860926] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:37.219171] [DEBUG] [LOCAL ] DAVA: Loaded 40534 existing records from primary storage. [2025-09-23T22:18:37.221168] [INFO ] [MAIN ] DAVA: Loaded 40534 primary data records. [2025-09-23T22:18:37.222122] [DEBUG] [LOCAL ] DAR: Loaded 51855 existing records from primary storage. [2025-09-23T22:18:37.222338] [INFO ] [MAIN ] DAR: Loaded 51855 primary data records. [2025-09-23T22:18:37.916534] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:37.917524] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 21242 primary records. [2025-09-23T22:18:37.917714] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-23T22:18:37.941987] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-09-23T22:18:37.942598] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-23T22:18:37.944855] [INFO ] [MAIN ] Derivative Progress: 490/2077 symbols completed. DAO took 1.2s. Estimated remaining: 10m 21s. Rate: 153.4 symbols/min [2025-09-23T22:18:37.945284] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:37.976087] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:37.982277] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 40534 primary records. [2025-09-23T22:18:37.982977] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-23T22:18:37.983317] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:37.984255] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51855 primary records. [2025-09-23T22:18:37.984830] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-23T22:18:38.015086] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-09-23T22:18:38.026192] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-23T22:18:38.029879] [INFO ] [MAIN ] Derivative Progress: 491/2077 symbols completed. DAR took 1.2s. Estimated remaining: 10m 20s. Rate: 153.6 symbols/min [2025-09-23T22:18:38.030544] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:38.031300] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-09-23T22:18:38.031460] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-23T22:18:38.034507] [INFO ] [MAIN ] Derivative Progress: 492/2077 symbols completed. DAVA took 1.2s. Estimated remaining: 10m 18s. Rate: 153.9 symbols/min [2025-09-23T22:18:38.035009] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:38.052354] [DEBUG] [LOCAL ] DAY: Loaded 49894 existing records from primary storage. [2025-09-23T22:18:38.055200] [INFO ] [MAIN ] DAY: Loaded 49894 primary data records. [2025-09-23T22:18:38.128018] [DEBUG] [LOCAL ] DBL: Loaded 9081 existing records from primary storage. [2025-09-23T22:18:38.140832] [INFO ] [MAIN ] DBL: Loaded 9081 primary data records. [2025-09-23T22:18:38.408387] [DEBUG] [LOCAL ] DBI: Loaded 45060 existing records from primary storage. [2025-09-23T22:18:38.545856] [INFO ] [MAIN ] DBI: Loaded 45060 primary data records. [2025-09-23T22:18:39.076261] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:39.077725] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49894 primary records. [2025-09-23T22:18:39.079857] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-23T22:18:39.110587] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:39.110813] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-09-23T22:18:39.110915] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-23T22:18:39.113895] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9081 primary records. [2025-09-23T22:18:39.113036] [INFO ] [MAIN ] Derivative Progress: 493/2077 symbols completed. DAY took 1.2s. Estimated remaining: 10m 20s. Rate: 153.4 symbols/min [2025-09-23T22:18:39.114438] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-23T22:18:39.145176] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-09-23T22:18:39.144564] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:39.146030] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 45060 primary records. [2025-09-23T22:18:39.145312] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-23T22:18:39.148220] [INFO ] [MAIN ] Derivative Progress: 494/2077 symbols completed. DBL took 1.1s. Estimated remaining: 10m 18s. Rate: 153.6 symbols/min [2025-09-23T22:18:39.148368] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-23T22:18:39.164979] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-09-23T22:18:39.165047] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-23T22:18:39.167765] [INFO ] [MAIN ] Derivative Progress: 495/2077 symbols completed. DBI took 1.1s. Estimated remaining: 10m 17s. Rate: 153.9 symbols/min [2025-09-23T22:18:39.168396] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:39.168547] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:39.168675] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:39.184814] [DEBUG] [LOCAL ] DCO: Loaded 13718 existing records from primary storage. [2025-09-23T22:18:39.185052] [INFO ] [MAIN ] DCO: Loaded 13718 primary data records. [2025-09-23T22:18:39.418263] [DEBUG] [LOCAL ] DCI: Loaded 37606 existing records from primary storage. [2025-09-23T22:18:39.555990] [INFO ] [MAIN ] DCI: Loaded 37606 primary data records. [2025-09-23T22:18:39.623617] [DEBUG] [LOCAL ] DD: Loaded 52827 existing records from primary storage. [2025-09-23T22:18:39.636549] [INFO ] [MAIN ] DD: Loaded 52827 primary data records. [2025-09-23T22:18:40.213156] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:40.214053] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13718 primary records. [2025-09-23T22:18:40.214509] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-23T22:18:40.232437] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-09-23T22:18:40.232988] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-23T22:18:40.235323] [INFO ] [MAIN ] Derivative Progress: 496/2077 symbols completed. DCO took 1.1s. Estimated remaining: 10m 18s. Rate: 153.4 symbols/min [2025-09-23T22:18:40.235948] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:40.268319] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:40.269503] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52827 primary records. [2025-09-23T22:18:40.268784] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:40.269599] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-23T22:18:40.270729] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37606 primary records. [2025-09-23T22:18:40.271365] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-23T22:18:40.306283] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-09-23T22:18:40.320211] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-23T22:18:40.323225] [INFO ] [MAIN ] Derivative Progress: 497/2077 symbols completed. DD took 1.2s. Estimated remaining: 10m 17s. Rate: 153.6 symbols/min [2025-09-23T22:18:40.324662] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:40.327895] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-09-23T22:18:40.328274] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-23T22:18:40.332096] [INFO ] [MAIN ] Derivative Progress: 498/2077 symbols completed. DCI took 1.2s. Estimated remaining: 10m 15s. Rate: 153.9 symbols/min [2025-09-23T22:18:40.332625] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:40.349777] [DEBUG] [LOCAL ] DDD: Loaded 50863 existing records from primary storage. [2025-09-23T22:18:40.350227] [INFO ] [MAIN ] DDD: Loaded 50863 primary data records. [2025-09-23T22:18:40.462020] [DEBUG] [LOCAL ] DDS: Loaded 13255 existing records from primary storage. [2025-09-23T22:18:40.475559] [INFO ] [MAIN ] DDS: Loaded 13255 primary data records. [2025-09-23T22:18:40.785306] [DEBUG] [LOCAL ] DDL: Loaded 36276 existing records from primary storage. [2025-09-23T22:18:40.799070] [INFO ] [MAIN ] DDL: Loaded 36276 primary data records. [2025-09-23T22:18:41.406310] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:41.406945] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:41.407883] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 13255 primary records. [2025-09-23T22:18:41.408736] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50863 primary records. [2025-09-23T22:18:41.408911] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-23T22:18:41.408126] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-23T22:18:41.439287] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-09-23T22:18:41.440066] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-23T22:18:41.443870] [INFO ] [MAIN ] Derivative Progress: 499/2077 symbols completed. DDS took 1.1s. Estimated remaining: 10m 17s. Rate: 153.4 symbols/min [2025-09-23T22:18:41.445297] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:41.462131] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:41.462878] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-09-23T22:18:41.463576] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36276 primary records. [2025-09-23T22:18:41.463703] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-23T22:18:41.463782] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-23T22:18:41.466277] [INFO ] [MAIN ] Derivative Progress: 500/2077 symbols completed. DDD took 1.2s. Estimated remaining: 10m 16s. Rate: 153.7 symbols/min [2025-09-23T22:18:41.466837] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:41.483248] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-09-23T22:18:41.483381] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-23T22:18:41.486105] [INFO ] [MAIN ] Derivative Progress: 501/2077 symbols completed. DDL took 1.2s. Estimated remaining: 10m 14s. Rate: 154.0 symbols/min [2025-09-23T22:18:41.486482] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:41.552094] [DEBUG] [LOCAL ] DEA: Loaded 41499 existing records from primary storage. [2025-09-23T22:18:41.567616] [INFO ] [MAIN ] DEA: Loaded 41499 primary data records. [2025-09-23T22:18:41.592223] [DEBUG] [LOCAL ] DE: Loaded 47738 existing records from primary storage. [2025-09-23T22:18:41.616559] [INFO ] [MAIN ] DE: Loaded 47738 primary data records. [2025-09-23T22:18:41.811501] [DEBUG] [LOCAL ] DECK: Loaded 53303 existing records from primary storage. [2025-09-23T22:18:41.867742] [INFO ] [MAIN ] DECK: Loaded 53303 primary data records. [2025-09-23T22:18:42.565797] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:42.566949] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47738 primary records. [2025-09-23T22:18:42.567405] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-23T22:18:42.596079] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:42.600973] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 41499 primary records. [2025-09-23T22:18:42.601456] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-23T22:18:42.646023] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-09-23T22:18:42.648339] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:42.649175] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53303 primary records. [2025-09-23T22:18:42.647889] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-09-23T22:18:42.649346] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-23T22:18:42.651805] [INFO ] [MAIN ] Derivative Progress: 502/2077 symbols completed. DEA took 1.2s. Estimated remaining: 10m 16s. Rate: 153.3 symbols/min [2025-09-23T22:18:42.651947] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-23T22:18:42.649446] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-23T22:18:42.655154] [INFO ] [MAIN ] Derivative Progress: 503/2077 symbols completed. DE took 1.2s. Estimated remaining: 10m 15s. Rate: 153.6 symbols/min [2025-09-23T22:18:42.656155] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:42.656822] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:42.675036] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-09-23T22:18:42.675146] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-23T22:18:42.677499] [INFO ] [MAIN ] Derivative Progress: 504/2077 symbols completed. DECK took 1.2s. Estimated remaining: 10m 13s. Rate: 153.9 symbols/min [2025-09-23T22:18:42.677888] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:42.740862] [DEBUG] [LOCAL ] DFH: Loaded 32858 existing records from primary storage. [2025-09-23T22:18:42.754782] [INFO ] [MAIN ] DFH: Loaded 32858 primary data records. [2025-09-23T22:18:42.801634] [DEBUG] [LOCAL ] DEO: Loaded 49010 existing records from primary storage. [2025-09-23T22:18:42.807155] [INFO ] [MAIN ] DEO: Loaded 49010 primary data records. [2025-09-23T22:18:42.951021] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-09-23T22:18:42.974323] [INFO ] [MAIN ] DELL: Loaded 53735 primary data records. [2025-09-23T22:18:43.793313] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:43.795039] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 49010 primary records. [2025-09-23T22:18:43.795886] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-23T22:18:43.792953] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:43.798439] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32858 primary records. [2025-09-23T22:18:43.805891] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-23T22:18:43.825057] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:43.838412] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53735 primary records. [2025-09-23T22:18:43.840259] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-09-23T22:18:43.839759] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-23T22:18:43.840856] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-23T22:18:43.845071] [INFO ] [MAIN ] Derivative Progress: 505/2077 symbols completed. DEO took 1.2s. Estimated remaining: 10m 15s. Rate: 153.3 symbols/min [2025-09-23T22:18:43.853248] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:43.864153] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-09-23T22:18:43.864301] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-09-23T22:18:43.864393] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-23T22:18:43.867835] [INFO ] [MAIN ] Derivative Progress: 506/2077 symbols completed. DELL took 1.2s. Estimated remaining: 10m 14s. Rate: 153.6 symbols/min [2025-09-23T22:18:43.864609] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-23T22:18:43.870288] [INFO ] [MAIN ] Derivative Progress: 507/2077 symbols completed. DFH took 1.2s. Estimated remaining: 10m 12s. Rate: 153.9 symbols/min [2025-09-23T22:18:43.870229] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:43.870667] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:43.895384] [DEBUG] [LOCAL ] DFIN: Loaded 23344 existing records from primary storage. [2025-09-23T22:18:43.899771] [DEBUG] [LOCAL ] DFP: Loaded 11666 existing records from primary storage. [2025-09-23T22:18:43.899503] [INFO ] [MAIN ] DFIN: Loaded 23344 primary data records. [2025-09-23T22:18:43.899947] [INFO ] [MAIN ] DFP: Loaded 11666 primary data records. [2025-09-23T22:18:44.420254] [DEBUG] [LOCAL ] DG: Loaded 53308 existing records from primary storage. [2025-09-23T22:18:44.420661] [INFO ] [MAIN ] DG: Loaded 53308 primary data records. [2025-09-23T22:18:44.877840] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:44.879765] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11666 primary records. [2025-09-23T22:18:44.880203] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-23T22:18:44.914585] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:44.915459] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-09-23T22:18:44.915812] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-23T22:18:44.916702] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 23344 primary records. [2025-09-23T22:18:44.918721] [INFO ] [MAIN ] Derivative Progress: 508/2077 symbols completed. DFP took 1.0s. Estimated remaining: 10m 14s. Rate: 153.4 symbols/min [2025-09-23T22:18:44.918851] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-23T22:18:44.943038] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-09-23T22:18:44.943109] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-23T22:18:44.945381] [INFO ] [MAIN ] Derivative Progress: 509/2077 symbols completed. DFIN took 1.1s. Estimated remaining: 10m 12s. Rate: 153.7 symbols/min [2025-09-23T22:18:44.960625] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:44.961196] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53308 primary records. [2025-09-23T22:18:44.961255] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-23T22:18:44.976600] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-09-23T22:18:44.976691] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-23T22:18:44.979251] [INFO ] [MAIN ] Derivative Progress: 510/2077 symbols completed. DG took 1.1s. Estimated remaining: 10m 11s. Rate: 154.0 symbols/min [2025-09-23T22:18:44.979852] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:44.980154] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:44.979952] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:45.001807] [DEBUG] [LOCAL ] DHF: Loaded 20704 existing records from primary storage. [2025-09-23T22:18:45.002036] [INFO ] [MAIN ] DHF: Loaded 20704 primary data records. [2025-09-23T22:18:45.350530] [DEBUG] [LOCAL ] DGX: Loaded 45287 existing records from primary storage. [2025-09-23T22:18:45.351514] [INFO ] [MAIN ] DGX: Loaded 45287 primary data records. [2025-09-23T22:18:45.400492] [DEBUG] [LOCAL ] DHI: Loaded 53376 existing records from primary storage. [2025-09-23T22:18:45.423769] [INFO ] [MAIN ] DHI: Loaded 53376 primary data records. [2025-09-23T22:18:46.064707] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:46.067235] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 20704 primary records. [2025-09-23T22:18:46.068862] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-23T22:18:46.091416] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-09-23T22:18:46.091560] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-23T22:18:46.094082] [INFO ] [MAIN ] Derivative Progress: 511/2077 symbols completed. DHF took 1.1s. Estimated remaining: 10m 13s. Rate: 153.4 symbols/min [2025-09-23T22:18:46.094755] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:46.114278] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:46.115145] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 45287 primary records. [2025-09-23T22:18:46.115322] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-23T22:18:46.128841] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:46.130275] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53376 primary records. [2025-09-23T22:18:46.130455] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-23T22:18:46.154943] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-09-23T22:18:46.155057] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-23T22:18:46.159683] [INFO ] [MAIN ] Derivative Progress: 512/2077 symbols completed. DGX took 1.2s. Estimated remaining: 10m 11s. Rate: 153.7 symbols/min [2025-09-23T22:18:46.160143] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:46.165635] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-09-23T22:18:46.165849] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-23T22:18:46.168469] [INFO ] [MAIN ] Derivative Progress: 513/2077 symbols completed. DHI took 1.2s. Estimated remaining: 10m 10s. Rate: 153.9 symbols/min [2025-09-23T22:18:46.168843] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:46.189776] [DEBUG] [LOCAL ] DIAX: Loaded 12421 existing records from primary storage. [2025-09-23T22:18:46.189894] [INFO ] [MAIN ] DIAX: Loaded 12421 primary data records. [2025-09-23T22:18:46.318813] [DEBUG] [LOCAL ] DHT: Loaded 47960 existing records from primary storage. [2025-09-23T22:18:46.329989] [INFO ] [MAIN ] DHT: Loaded 47960 primary data records. [2025-09-23T22:18:46.644959] [DEBUG] [LOCAL ] DIN: Loaded 37264 existing records from primary storage. [2025-09-23T22:18:46.649630] [INFO ] [MAIN ] DIN: Loaded 37264 primary data records. [2025-09-23T22:18:47.197692] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:47.198508] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 12421 primary records. [2025-09-23T22:18:47.198675] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-23T22:18:47.232851] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-09-23T22:18:47.231466] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:47.233369] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-23T22:18:47.234111] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47960 primary records. [2025-09-23T22:18:47.236778] [INFO ] [MAIN ] Derivative Progress: 514/2077 symbols completed. DIAX took 1.1s. Estimated remaining: 10m 11s. Rate: 153.4 symbols/min [2025-09-23T22:18:47.234455] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-23T22:18:47.238034] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:47.258181] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-09-23T22:18:47.275805] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-23T22:18:47.275701] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:47.279378] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37264 primary records. [2025-09-23T22:18:47.279529] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-23T22:18:47.278608] [INFO ] [MAIN ] Derivative Progress: 515/2077 symbols completed. DHT took 1.2s. Estimated remaining: 10m 10s. Rate: 153.7 symbols/min [2025-09-23T22:18:47.279776] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:47.297493] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-09-23T22:18:47.311518] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-23T22:18:47.314511] [INFO ] [MAIN ] Derivative Progress: 516/2077 symbols completed. DIN took 1.1s. Estimated remaining: 10m 8s. Rate: 154.0 symbols/min [2025-09-23T22:18:47.314891] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:47.339413] [DEBUG] [LOCAL ] DINO: Loaded 52963 existing records from primary storage. [2025-09-23T22:18:47.339729] [INFO ] [MAIN ] DINO: Loaded 52963 primary data records. [2025-09-23T22:18:47.722936] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-23T22:18:47.723141] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-09-23T22:18:47.723970] [DEBUG] [LOCAL ] DK: Loaded 49391 existing records from primary storage. [2025-09-23T22:18:47.761921] [INFO ] [MAIN ] DK: Loaded 49391 primary data records. [2025-09-23T22:18:48.372199] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:48.373573] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52963 primary records. [2025-09-23T22:18:48.374213] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-23T22:18:48.393082] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-09-23T22:18:48.393440] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-23T22:18:48.396348] [INFO ] [MAIN ] Derivative Progress: 517/2077 symbols completed. DINO took 1.2s. Estimated remaining: 10m 10s. Rate: 153.4 symbols/min [2025-09-23T22:18:48.399674] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:48.414378] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:48.415453] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-09-23T22:18:48.415758] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-23T22:18:48.446868] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:48.448245] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49391 primary records. [2025-09-23T22:18:48.451317] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-09-23T22:18:48.449177] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-23T22:18:48.451547] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-23T22:18:48.454548] [INFO ] [MAIN ] Derivative Progress: 518/2077 symbols completed. DIS took 1.2s. Estimated remaining: 10m 9s. Rate: 153.7 symbols/min [2025-09-23T22:18:48.455094] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:48.472124] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-09-23T22:18:48.473731] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-23T22:18:48.476350] [INFO ] [MAIN ] Derivative Progress: 519/2077 symbols completed. DK took 1.2s. Estimated remaining: 10m 7s. Rate: 154.0 symbols/min [2025-09-23T22:18:48.487673] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:48.491541] [DEBUG] [LOCAL ] DLNG: Loaded 6188 existing records from primary storage. [2025-09-23T22:18:48.491773] [INFO ] [MAIN ] DLNG: Loaded 6188 primary data records. [2025-09-23T22:18:48.623615] [DEBUG] [LOCAL ] DKS: Loaded 49949 existing records from primary storage. [2025-09-23T22:18:48.639504] [INFO ] [MAIN ] DKS: Loaded 49949 primary data records. [2025-09-23T22:18:49.011885] [DEBUG] [LOCAL ] DLR: Loaded 51180 existing records from primary storage. [2025-09-23T22:18:49.029623] [INFO ] [MAIN ] DLR: Loaded 51180 primary data records. [2025-09-23T22:18:49.380913] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:49.529286] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6188 primary records. [2025-09-23T22:18:49.545024] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-23T22:18:49.563187] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-09-23T22:18:49.563587] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-23T22:18:49.565865] [INFO ] [MAIN ] Derivative Progress: 520/2077 symbols completed. DLNG took 1.1s. Estimated remaining: 10m 9s. Rate: 153.4 symbols/min [2025-09-23T22:18:49.566901] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:49.587509] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:49.588561] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49949 primary records. [2025-09-23T22:18:49.588747] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-23T22:18:49.629975] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-09-23T22:18:49.629886] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:49.630677] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-23T22:18:49.631524] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 51180 primary records. [2025-09-23T22:18:49.642240] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-23T22:18:49.633939] [INFO ] [MAIN ] Derivative Progress: 521/2077 symbols completed. DKS took 1.2s. Estimated remaining: 10m 7s. Rate: 153.7 symbols/min [2025-09-23T22:18:49.643892] [DEBUG] [LOCAL ] DLX: Loaded 29096 existing records from primary storage. [2025-09-23T22:18:49.654682] [INFO ] [MAIN ] DLX: Loaded 29096 primary data records. [2025-09-23T22:18:49.652071] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:49.752143] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-09-23T22:18:49.768112] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-23T22:18:49.770593] [INFO ] [MAIN ] Derivative Progress: 522/2077 symbols completed. DLR took 1.3s. Estimated remaining: 10m 6s. Rate: 153.9 symbols/min [2025-09-23T22:18:49.782422] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:49.966137] [DEBUG] [LOCAL ] DLY: Loaded 19442 existing records from primary storage. [2025-09-23T22:18:49.982688] [DEBUG] [LOCAL ] DMA: Loaded 4506 existing records from primary storage. [2025-09-23T22:18:49.979964] [INFO ] [MAIN ] DLY: Loaded 19442 primary data records. [2025-09-23T22:18:49.982914] [INFO ] [MAIN ] DMA: Loaded 4506 primary data records. [2025-09-23T22:18:50.618072] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:50.619396] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 29096 primary records. [2025-09-23T22:18:50.620207] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-23T22:18:50.637561] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-09-23T22:18:50.638592] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-23T22:18:50.641418] [INFO ] [MAIN ] Derivative Progress: 523/2077 symbols completed. DLX took 1.1s. Estimated remaining: 10m 7s. Rate: 153.5 symbols/min [2025-09-23T22:18:50.655665] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:18:50.656419] [INFO ] [MAIN ] DMA: Generated 1793 derivative records from 4506 primary records. [2025-09-23T22:18:50.657210] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-23T22:18:50.682085] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:50.683594] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 19442 primary records. [2025-09-23T22:18:50.684388] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-23T22:18:50.686325] [DEBUG] [LOCAL ] DMA: Derivative data saved (1793 records). [2025-09-23T22:18:50.686582] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-23T22:18:50.696128] [INFO ] [MAIN ] Derivative Progress: 524/2077 symbols completed. DMA took 0.9s. Estimated remaining: 10m 6s. Rate: 153.8 symbols/min [2025-09-23T22:18:50.703779] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-09-23T22:18:50.703856] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-23T22:18:50.706435] [INFO ] [MAIN ] Derivative Progress: 525/2077 symbols completed. DLY took 1.1s. Estimated remaining: 10m 4s. Rate: 154.1 symbols/min [2025-09-23T22:18:50.706954] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:50.707088] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:50.707506] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:50.721269] [DEBUG] [LOCAL ] DMB: Loaded 10158 existing records from primary storage. [2025-09-23T22:18:50.725236] [INFO ] [MAIN ] DMB: Loaded 10158 primary data records. [2025-09-23T22:18:50.725168] [DEBUG] [LOCAL ] DMO: Loaded 9855 existing records from primary storage. [2025-09-23T22:18:50.725352] [INFO ] [MAIN ] DMO: Loaded 9855 primary data records. [2025-09-23T22:18:51.234512] [DEBUG] [LOCAL ] DNA: Loaded 48395 existing records from primary storage. [2025-09-23T22:18:51.254825] [INFO ] [MAIN ] DNA: Loaded 48395 primary data records. [2025-09-23T22:18:51.743173] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:51.756583] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9855 primary records. [2025-09-23T22:18:51.757113] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:51.757824] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10158 primary records. [2025-09-23T22:18:51.757916] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-23T22:18:51.757213] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-23T22:18:51.791139] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-09-23T22:18:51.792798] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-09-23T22:18:51.792901] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-23T22:18:51.795017] [INFO ] [MAIN ] Derivative Progress: 526/2077 symbols completed. DMO took 1.1s. Estimated remaining: 10m 6s. Rate: 153.5 symbols/min [2025-09-23T22:18:51.792746] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-23T22:18:51.798242] [INFO ] [MAIN ] Derivative Progress: 527/2077 symbols completed. DMB took 1.1s. Estimated remaining: 10m 5s. Rate: 153.8 symbols/min [2025-09-23T22:18:51.798439] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:51.798737] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:51.815897] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:51.816770] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48395 primary records. [2025-09-23T22:18:51.816939] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-23T22:18:51.833920] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-09-23T22:18:51.834118] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-23T22:18:51.836909] [INFO ] [MAIN ] Derivative Progress: 528/2077 symbols completed. DNA took 1.1s. Estimated remaining: 10m 3s. Rate: 154.1 symbols/min [2025-09-23T22:18:51.837233] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:51.868338] [DEBUG] [LOCAL ] DNP: Loaded 33340 existing records from primary storage. [2025-09-23T22:18:51.868484] [INFO ] [MAIN ] DNP: Loaded 33340 primary data records. [2025-09-23T22:18:51.988056] [DEBUG] [LOCAL ] DNOW: Loaded 43520 existing records from primary storage. [2025-09-23T22:18:52.033141] [INFO ] [MAIN ] DNOW: Loaded 43520 primary data records. [2025-09-23T22:18:52.335883] [DEBUG] [LOCAL ] DOCN: Loaded 50488 existing records from primary storage. [2025-09-23T22:18:52.340320] [INFO ] [MAIN ] DOCN: Loaded 50488 primary data records. [2025-09-23T22:18:52.917497] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:52.920297] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33340 primary records. [2025-09-23T22:18:52.920414] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-23T22:18:52.952897] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:52.955486] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43520 primary records. [2025-09-23T22:18:52.956119] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-23T22:18:52.958280] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-09-23T22:18:52.958757] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-23T22:18:52.961226] [INFO ] [MAIN ] Derivative Progress: 529/2077 symbols completed. DNP took 1.2s. Estimated remaining: 10m 5s. Rate: 153.5 symbols/min [2025-09-23T22:18:52.962315] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:52.987672] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:52.988958] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50488 primary records. [2025-09-23T22:18:52.989399] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-23T22:18:53.008473] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-09-23T22:18:53.009750] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-23T22:18:53.013045] [INFO ] [MAIN ] Derivative Progress: 530/2077 symbols completed. DNOW took 1.2s. Estimated remaining: 10m 4s. Rate: 153.8 symbols/min [2025-09-23T22:18:53.013602] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:53.015161] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-09-23T22:18:53.015741] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-23T22:18:53.018506] [INFO ] [MAIN ] Derivative Progress: 531/2077 symbols completed. DOCN took 1.2s. Estimated remaining: 10m 2s. Rate: 154.1 symbols/min [2025-09-23T22:18:53.018846] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:53.088134] [DEBUG] [LOCAL ] DOUG: Loaded 34780 existing records from primary storage. [2025-09-23T22:18:53.088278] [INFO ] [MAIN ] DOUG: Loaded 34780 primary data records. [2025-09-23T22:18:53.132188] [DEBUG] [LOCAL ] DOCS: Loaded 51264 existing records from primary storage. [2025-09-23T22:18:53.174692] [DEBUG] [LOCAL ] DOLE: Loaded 37844 existing records from primary storage. [2025-09-23T22:18:53.187954] [INFO ] [MAIN ] DOCS: Loaded 51264 primary data records. [2025-09-23T22:18:53.188014] [INFO ] [MAIN ] DOLE: Loaded 37844 primary data records. [2025-09-23T22:18:54.096826] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:54.098183] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34780 primary records. [2025-09-23T22:18:54.099151] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-23T22:18:54.144799] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-09-23T22:18:54.145511] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:54.146373] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 51264 primary records. [2025-09-23T22:18:54.146483] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-23T22:18:54.145139] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:54.146582] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-23T22:18:54.149384] [INFO ] [MAIN ] Derivative Progress: 532/2077 symbols completed. DOUG took 1.1s. Estimated remaining: 10m 4s. Rate: 153.5 symbols/min [2025-09-23T22:18:54.150955] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 37844 primary records. [2025-09-23T22:18:54.158574] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-23T22:18:54.158739] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:54.183154] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-09-23T22:18:54.183564] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-23T22:18:54.186340] [INFO ] [MAIN ] Derivative Progress: 533/2077 symbols completed. DOCS took 1.2s. Estimated remaining: 10m 2s. Rate: 153.8 symbols/min [2025-09-23T22:18:54.186881] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:54.188196] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-09-23T22:18:54.188264] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-23T22:18:54.191144] [INFO ] [MAIN ] Derivative Progress: 534/2077 symbols completed. DOLE took 1.2s. Estimated remaining: 10m 1s. Rate: 154.1 symbols/min [2025-09-23T22:18:54.191949] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:54.218449] [DEBUG] [LOCAL ] DPG: Loaded 13368 existing records from primary storage. [2025-09-23T22:18:54.218748] [INFO ] [MAIN ] DPG: Loaded 13368 primary data records. [2025-09-23T22:18:54.365569] [DEBUG] [LOCAL ] DOV: Loaded 45742 existing records from primary storage. [2025-09-23T22:18:54.395268] [INFO ] [MAIN ] DOV: Loaded 45742 primary data records. [2025-09-23T22:18:54.580403] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-23T22:18:54.608066] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-09-23T22:18:55.268408] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:55.271146] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13368 primary records. [2025-09-23T22:18:55.271557] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-23T22:18:55.291252] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-09-23T22:18:55.291682] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-23T22:18:55.295506] [INFO ] [MAIN ] Derivative Progress: 535/2077 symbols completed. DPG took 1.1s. Estimated remaining: 10m 3s. Rate: 153.5 symbols/min [2025-09-23T22:18:55.295938] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:55.317581] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:55.331094] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:55.332168] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45742 primary records. [2025-09-23T22:18:55.333396] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-09-23T22:18:55.333542] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-23T22:18:55.333697] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-23T22:18:55.366746] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-09-23T22:18:55.376294] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-23T22:18:55.379737] [INFO ] [MAIN ] Derivative Progress: 536/2077 symbols completed. DOV took 1.2s. Estimated remaining: 10m 1s. Rate: 153.8 symbols/min [2025-09-23T22:18:55.381059] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:55.383808] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-09-23T22:18:55.384032] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-23T22:18:55.386721] [INFO ] [MAIN ] Derivative Progress: 537/2077 symbols completed. DOW took 1.2s. Estimated remaining: 9m 60s. Rate: 154.0 symbols/min [2025-09-23T22:18:55.387206] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:55.400128] [DEBUG] [LOCAL ] DRD: Loaded 36687 existing records from primary storage. [2025-09-23T22:18:55.400375] [INFO ] [MAIN ] DRD: Loaded 36687 primary data records. [2025-09-23T22:18:55.509994] [DEBUG] [LOCAL ] DRLL: Loaded 9710 existing records from primary storage. [2025-09-23T22:18:55.513563] [INFO ] [MAIN ] DRLL: Loaded 9710 primary data records. [2025-09-23T22:18:55.921675] [DEBUG] [LOCAL ] DRI: Loaded 47866 existing records from primary storage. [2025-09-23T22:18:55.945355] [INFO ] [MAIN ] DRI: Loaded 47866 primary data records. [2025-09-23T22:18:56.411242] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:56.413752] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 36687 primary records. [2025-09-23T22:18:56.415585] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-23T22:18:56.444935] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:56.448058] [INFO ] [MAIN ] DRLL: Generated 1794 derivative records from 9710 primary records. [2025-09-23T22:18:56.449215] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-23T22:18:56.466389] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-09-23T22:18:56.466514] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-23T22:18:56.472466] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1794 records). [2025-09-23T22:18:56.471124] [INFO ] [MAIN ] Derivative Progress: 538/2077 symbols completed. DRD took 1.2s. Estimated remaining: 10m 1s. Rate: 153.5 symbols/min [2025-09-23T22:18:56.472690] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-23T22:18:56.476044] [INFO ] [MAIN ] Derivative Progress: 539/2077 symbols completed. DRLL took 1.1s. Estimated remaining: 9m 60s. Rate: 153.8 symbols/min [2025-09-23T22:18:56.492401] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:56.493200] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47866 primary records. [2025-09-23T22:18:56.493263] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-23T22:18:56.509942] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-09-23T22:18:56.510091] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-23T22:18:56.512834] [INFO ] [MAIN ] Derivative Progress: 540/2077 symbols completed. DRI took 1.1s. Estimated remaining: 9m 59s. Rate: 154.1 symbols/min [2025-09-23T22:18:56.513812] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:56.513754] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:56.514100] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:56.519633] [DEBUG] [LOCAL ] DSMC: Loaded 1954 existing records from primary storage. [2025-09-23T22:18:56.519862] [INFO ] [MAIN ] DSMC: Loaded 1954 primary data records. [2025-09-23T22:18:56.621130] [DEBUG] [LOCAL ] DSM: Loaded 15765 existing records from primary storage. [2025-09-23T22:18:56.651486] [INFO ] [MAIN ] DSM: Loaded 15765 primary data records. [2025-09-23T22:18:56.701118] [DEBUG] [LOCAL ] DSL: Loaded 28179 existing records from primary storage. [2025-09-23T22:18:56.740959] [INFO ] [MAIN ] DSL: Loaded 28179 primary data records. [2025-09-23T22:18:57.581307] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:18:57.583792] [INFO ] [MAIN ] DSMC: Generated 1793 derivative records from 1954 primary records. [2025-09-23T22:18:57.584071] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-23T22:18:57.599723] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1793 records). [2025-09-23T22:18:57.600177] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-23T22:18:57.602325] [INFO ] [MAIN ] Derivative Progress: 541/2077 symbols completed. DSMC took 1.1s. Estimated remaining: 10m 0s. Rate: 153.6 symbols/min [2025-09-23T22:18:57.602994] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:57.624191] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:57.633432] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28179 primary records. [2025-09-23T22:18:57.633667] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-23T22:18:57.639946] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:57.653520] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 15765 primary records. [2025-09-23T22:18:57.654868] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-23T22:18:57.668844] [DEBUG] [LOCAL ] DSU: Loaded 21929 existing records from primary storage. [2025-09-23T22:18:57.675411] [INFO ] [MAIN ] DSU: Loaded 21929 primary data records. [2025-09-23T22:18:57.717961] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-09-23T22:18:57.730432] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-23T22:18:57.740966] [INFO ] [MAIN ] Derivative Progress: 542/2077 symbols completed. DSL took 1.2s. Estimated remaining: 9m 59s. Rate: 153.7 symbols/min [2025-09-23T22:18:57.760794] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:57.792185] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-09-23T22:18:57.803370] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-23T22:18:57.816432] [INFO ] [MAIN ] Derivative Progress: 543/2077 symbols completed. DSM took 1.3s. Estimated remaining: 9m 58s. Rate: 154.0 symbols/min [2025-09-23T22:18:57.844153] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:58.018334] [DEBUG] [LOCAL ] DSX: Loaded 24442 existing records from primary storage. [2025-09-23T22:18:58.018633] [INFO ] [MAIN ] DSX: Loaded 24442 primary data records. [2025-09-23T22:18:58.358672] [DEBUG] [LOCAL ] DT: Loaded 52944 existing records from primary storage. [2025-09-23T22:18:58.359039] [INFO ] [MAIN ] DT: Loaded 52944 primary data records. [2025-09-23T22:18:58.483841] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:58.506568] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 21929 primary records. [2025-09-23T22:18:58.511925] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-23T22:18:58.705509] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-09-23T22:18:58.706162] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-23T22:18:58.708352] [INFO ] [MAIN ] Derivative Progress: 544/2077 symbols completed. DSU took 1.1s. Estimated remaining: 9m 59s. Rate: 153.6 symbols/min [2025-09-23T22:18:58.709025] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:58.732014] [DEBUG] [LOCAL ] DTB: Loaded 4728 existing records from primary storage. [2025-09-23T22:18:58.729271] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:58.733018] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24442 primary records. [2025-09-23T22:18:58.732326] [INFO ] [MAIN ] DTB: Loaded 4728 primary data records. [2025-09-23T22:18:58.733116] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-23T22:18:58.905472] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-09-23T22:18:58.929950] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-23T22:18:58.932942] [INFO ] [MAIN ] Derivative Progress: 545/2077 symbols completed. DSX took 1.2s. Estimated remaining: 9m 58s. Rate: 153.7 symbols/min [2025-09-23T22:18:58.949360] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:58.955751] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:59.078294] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52944 primary records. [2025-09-23T22:18:59.079353] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-23T22:18:59.101026] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-09-23T22:18:59.101234] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-23T22:18:59.103783] [INFO ] [MAIN ] Derivative Progress: 546/2077 symbols completed. DT took 1.3s. Estimated remaining: 9m 57s. Rate: 153.9 symbols/min [2025-09-23T22:18:59.105697] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:59.127272] [DEBUG] [LOCAL ] DTG: Loaded 5902 existing records from primary storage. [2025-09-23T22:18:59.127744] [INFO ] [MAIN ] DTG: Loaded 5902 primary data records. [2025-09-23T22:18:59.251075] [DEBUG] [LOCAL ] DTE: Loaded 47998 existing records from primary storage. [2025-09-23T22:18:59.260425] [INFO ] [MAIN ] DTE: Loaded 47998 primary data records. [2025-09-23T22:18:59.287396] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:59.349630] [INFO ] [MAIN ] DTB: Generated 1794 derivative records from 4728 primary records. [2025-09-23T22:18:59.385512] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-23T22:18:59.621499] [DEBUG] [LOCAL ] DTB: Derivative data saved (1794 records). [2025-09-23T22:18:59.622778] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-23T22:18:59.626870] [INFO ] [MAIN ] Derivative Progress: 547/2077 symbols completed. DTB took 0.9s. Estimated remaining: 9m 57s. Rate: 153.8 symbols/min [2025-09-23T22:18:59.643206] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:18:59.943420] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:18:59.944449] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5902 primary records. [2025-09-23T22:18:59.944534] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-23T22:18:59.974244] [DEBUG] [LOCAL ] DTM: Loaded 44507 existing records from primary storage. [2025-09-23T22:18:59.975515] [INFO ] [MAIN ] DTM: Loaded 44507 primary data records. [2025-09-23T22:19:00.021266] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-09-23T22:19:00.022500] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-23T22:19:00.038219] [INFO ] [MAIN ] Derivative Progress: 548/2077 symbols completed. DTG took 0.9s. Estimated remaining: 9m 57s. Rate: 153.8 symbols/min [2025-09-23T22:19:00.054578] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:00.125449] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:00.167796] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47998 primary records. [2025-09-23T22:19:00.185752] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-23T22:19:00.196804] [DEBUG] [LOCAL ] DTW: Loaded 4899 existing records from primary storage. [2025-09-23T22:19:00.204610] [INFO ] [MAIN ] DTW: Loaded 4899 primary data records. [2025-09-23T22:19:00.474064] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-09-23T22:19:00.491909] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-23T22:19:00.494672] [INFO ] [MAIN ] Derivative Progress: 549/2077 symbols completed. DTE took 1.6s. Estimated remaining: 9m 56s. Rate: 153.7 symbols/min [2025-09-23T22:19:00.503948] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:00.683764] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:00.685330] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 44507 primary records. [2025-09-23T22:19:00.685870] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-23T22:19:00.738531] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:19:00.740230] [INFO ] [MAIN ] DTW: Generated 1793 derivative records from 4899 primary records. [2025-09-23T22:19:00.740423] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-23T22:19:00.741796] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-09-23T22:19:00.742524] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-23T22:19:00.753415] [INFO ] [MAIN ] Derivative Progress: 550/2077 symbols completed. DTM took 1.1s. Estimated remaining: 9m 56s. Rate: 153.8 symbols/min [2025-09-23T22:19:00.757109] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:00.779236] [DEBUG] [LOCAL ] DUK: Loaded 53460 existing records from primary storage. [2025-09-23T22:19:00.779433] [INFO ] [MAIN ] DUK: Loaded 53460 primary data records. [2025-09-23T22:19:00.816564] [DEBUG] [LOCAL ] DTW: Derivative data saved (1793 records). [2025-09-23T22:19:00.849392] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-23T22:19:00.857043] [INFO ] [MAIN ] Derivative Progress: 551/2077 symbols completed. DTW took 0.8s. Estimated remaining: 9m 54s. Rate: 154.0 symbols/min [2025-09-23T22:19:00.894995] [DEBUG] [LOCAL ] DUKB: Loaded 6375 existing records from primary storage. [2025-09-23T22:19:00.895535] [INFO ] [MAIN ] DUKB: Loaded 6375 primary data records. [2025-09-23T22:19:00.895254] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:01.463127] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:01.464213] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53460 primary records. [2025-09-23T22:19:01.464307] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-23T22:19:01.465176] [DEBUG] [LOCAL ] DV: Loaded 51272 existing records from primary storage. [2025-09-23T22:19:01.466200] [INFO ] [MAIN ] DV: Loaded 51272 primary data records. [2025-09-23T22:19:01.576358] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:01.582515] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6375 primary records. [2025-09-23T22:19:01.595092] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-23T22:19:01.649841] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-09-23T22:19:01.666038] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-23T22:19:01.712700] [INFO ] [MAIN ] Derivative Progress: 552/2077 symbols completed. DUK took 1.2s. Estimated remaining: 9m 55s. Rate: 153.7 symbols/min [2025-09-23T22:19:01.879537] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:01.897267] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-09-23T22:19:01.898204] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-23T22:19:01.900578] [INFO ] [MAIN ] Derivative Progress: 553/2077 symbols completed. DUKB took 1.1s. Estimated remaining: 9m 54s. Rate: 153.8 symbols/min [2025-09-23T22:19:01.927950] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:01.928867] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51272 primary records. [2025-09-23T22:19:01.940686] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-23T22:19:01.958466] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-09-23T22:19:01.958809] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-23T22:19:01.961400] [INFO ] [MAIN ] Derivative Progress: 554/2077 symbols completed. DV took 1.1s. Estimated remaining: 9m 53s. Rate: 154.1 symbols/min [2025-09-23T22:19:01.976589] [DEBUG] [LOCAL ] DVA: Loaded 41451 existing records from primary storage. [2025-09-23T22:19:01.976849] [INFO ] [MAIN ] DVA: Loaded 41451 primary data records. [2025-09-23T22:19:02.304528] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:02.305176] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41451 primary records. [2025-09-23T22:19:02.305238] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-23T22:19:02.321137] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-09-23T22:19:02.321199] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-23T22:19:02.323354] [INFO ] [MAIN ] Derivative Progress: 555/2077 symbols completed. DVA took 0.4s. Estimated remaining: 9m 53s. Rate: 154.1 symbols/min [2025-09-23T22:19:02.324347] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:02.324188] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:02.324525] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:02.420811] [DEBUG] [LOCAL ] DXC: Loaded 49661 existing records from primary storage. [2025-09-23T22:19:02.421180] [INFO ] [MAIN ] DXC: Loaded 49661 primary data records. [2025-09-23T22:19:02.558336] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-23T22:19:02.563320] [DEBUG] [LOCAL ] DX: Loaded 52482 existing records from primary storage. [2025-09-23T22:19:02.563898] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-09-23T22:19:02.595216] [INFO ] [MAIN ] DX: Loaded 52482 primary data records. [2025-09-23T22:19:03.422187] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:03.423539] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49661 primary records. [2025-09-23T22:19:03.423715] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-23T22:19:03.458280] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-09-23T22:19:03.460458] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-23T22:19:03.459443] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:03.461437] [INFO ] [MAIN ] DVN: Generated 1794 derivative records from 53699 primary records. [2025-09-23T22:19:03.463281] [INFO ] [MAIN ] Derivative Progress: 556/2077 symbols completed. DXC took 1.1s. Estimated remaining: 9m 54s. Rate: 153.6 symbols/min [2025-09-23T22:19:03.475910] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:03.477125] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-23T22:19:03.477920] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:03.479347] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52482 primary records. [2025-09-23T22:19:03.486532] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-23T22:19:03.508118] [DEBUG] [LOCAL ] DVN: Derivative data saved (1794 records). [2025-09-23T22:19:03.508448] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-23T22:19:03.510627] [INFO ] [MAIN ] Derivative Progress: 557/2077 symbols completed. DVN took 1.2s. Estimated remaining: 9m 53s. Rate: 153.8 symbols/min [2025-09-23T22:19:03.511667] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:03.515024] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-09-23T22:19:03.515154] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-23T22:19:03.518374] [INFO ] [MAIN ] Derivative Progress: 558/2077 symbols completed. DX took 1.2s. Estimated remaining: 9m 52s. Rate: 154.1 symbols/min [2025-09-23T22:19:03.518782] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:03.545050] [DEBUG] [LOCAL ] DXYZ: Loaded 36762 existing records from primary storage. [2025-09-23T22:19:03.545357] [INFO ] [MAIN ] DXYZ: Loaded 36762 primary data records. [2025-09-23T22:19:03.685076] [DEBUG] [LOCAL ] DY: Loaded 29868 existing records from primary storage. [2025-09-23T22:19:03.685879] [INFO ] [MAIN ] DY: Loaded 29868 primary data records. [2025-09-23T22:19:03.764069] [DEBUG] [LOCAL ] E: Loaded 33441 existing records from primary storage. [2025-09-23T22:19:03.840764] [INFO ] [MAIN ] E: Loaded 33441 primary data records. [2025-09-23T22:19:04.601892] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:04.603180] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 36762 primary records. [2025-09-23T22:19:04.604511] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-23T22:19:04.649742] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-09-23T22:19:04.640984] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:04.656093] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 29868 primary records. [2025-09-23T22:19:04.654930] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-23T22:19:04.656693] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:04.656816] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-23T22:19:04.657572] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33441 primary records. [2025-09-23T22:19:04.657701] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-23T22:19:04.659606] [INFO ] [MAIN ] Derivative Progress: 559/2077 symbols completed. DXYZ took 1.2s. Estimated remaining: 9m 53s. Rate: 153.5 symbols/min [2025-09-23T22:19:04.661271] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:04.691453] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-09-23T22:19:04.692381] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-23T22:19:04.695083] [INFO ] [MAIN ] Derivative Progress: 560/2077 symbols completed. E took 1.2s. Estimated remaining: 9m 52s. Rate: 153.8 symbols/min [2025-09-23T22:19:04.695940] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:04.699058] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-09-23T22:19:04.699218] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-23T22:19:04.701387] [INFO ] [MAIN ] Derivative Progress: 561/2077 symbols completed. DY took 1.2s. Estimated remaining: 9m 50s. Rate: 154.1 symbols/min [2025-09-23T22:19:04.702945] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:04.706955] [DEBUG] [LOCAL ] EAI: Loaded 3975 existing records from primary storage. [2025-09-23T22:19:04.707514] [INFO ] [MAIN ] EAI: Loaded 3975 primary data records. [2025-09-23T22:19:04.861063] [DEBUG] [LOCAL ] EAF: Loaded 43932 existing records from primary storage. [2025-09-23T22:19:04.876873] [INFO ] [MAIN ] EAF: Loaded 43932 primary data records. [2025-09-23T22:19:04.990200] [DEBUG] [LOCAL ] EARN: Loaded 30366 existing records from primary storage. [2025-09-23T22:19:05.150546] [INFO ] [MAIN ] EARN: Loaded 30366 primary data records. [2025-09-23T22:19:05.716150] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:05.717292] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3975 primary records. [2025-09-23T22:19:05.718556] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-23T22:19:05.737231] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-09-23T22:19:05.745168] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-23T22:19:05.751927] [INFO ] [MAIN ] Derivative Progress: 562/2077 symbols completed. EAI took 1.1s. Estimated remaining: 9m 52s. Rate: 153.6 symbols/min [2025-09-23T22:19:05.752521] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:05.752279] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:05.753450] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 43932 primary records. [2025-09-23T22:19:05.754824] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-23T22:19:05.782626] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:05.784453] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 30366 primary records. [2025-09-23T22:19:05.784842] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-23T22:19:05.799562] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-09-23T22:19:05.800295] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-23T22:19:05.803113] [INFO ] [MAIN ] Derivative Progress: 563/2077 symbols completed. EAF took 1.1s. Estimated remaining: 9m 50s. Rate: 153.8 symbols/min [2025-09-23T22:19:05.805460] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:05.817141] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-09-23T22:19:05.817330] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-23T22:19:05.819971] [INFO ] [MAIN ] Derivative Progress: 564/2077 symbols completed. EARN took 1.1s. Estimated remaining: 9m 49s. Rate: 154.1 symbols/min [2025-09-23T22:19:05.820395] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:05.834522] [DEBUG] [LOCAL ] EB: Loaded 37872 existing records from primary storage. [2025-09-23T22:19:05.834955] [INFO ] [MAIN ] EB: Loaded 37872 primary data records. [2025-09-23T22:19:05.960470] [DEBUG] [LOCAL ] EBF: Loaded 19531 existing records from primary storage. [2025-09-23T22:19:05.960677] [INFO ] [MAIN ] EBF: Loaded 19531 primary data records. [2025-09-23T22:19:06.296496] [DEBUG] [LOCAL ] EBR: Loaded 43083 existing records from primary storage. [2025-09-23T22:19:06.311232] [INFO ] [MAIN ] EBR: Loaded 43083 primary data records. [2025-09-23T22:19:06.849421] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:06.850558] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 37872 primary records. [2025-09-23T22:19:06.852667] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-23T22:19:06.875672] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-09-23T22:19:06.875915] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-23T22:19:06.878340] [INFO ] [MAIN ] Derivative Progress: 565/2077 symbols completed. EB took 1.1s. Estimated remaining: 9m 50s. Rate: 153.6 symbols/min [2025-09-23T22:19:06.879142] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:06.894400] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:06.896346] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19531 primary records. [2025-09-23T22:19:06.896593] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-23T22:19:06.910339] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:06.919020] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43083 primary records. [2025-09-23T22:19:06.925439] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-23T22:19:06.940527] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-09-23T22:19:06.941252] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-23T22:19:06.943852] [INFO ] [MAIN ] Derivative Progress: 566/2077 symbols completed. EBF took 1.1s. Estimated remaining: 9m 49s. Rate: 153.9 symbols/min [2025-09-23T22:19:06.945091] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:06.958868] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-09-23T22:19:06.959109] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-23T22:19:06.961833] [INFO ] [MAIN ] Derivative Progress: 567/2077 symbols completed. EBR took 1.1s. Estimated remaining: 9m 48s. Rate: 154.1 symbols/min [2025-09-23T22:19:06.962242] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:06.987465] [DEBUG] [LOCAL ] EBS: Loaded 46807 existing records from primary storage. [2025-09-23T22:19:06.987751] [INFO ] [MAIN ] EBS: Loaded 46807 primary data records. [2025-09-23T22:19:07.131105] [DEBUG] [LOCAL ] ECAT: Loaded 29687 existing records from primary storage. [2025-09-23T22:19:07.142034] [INFO ] [MAIN ] ECAT: Loaded 29687 primary data records. [2025-09-23T22:19:07.437139] [DEBUG] [LOCAL ] EC: Loaded 49369 existing records from primary storage. [2025-09-23T22:19:07.458231] [INFO ] [MAIN ] EC: Loaded 49369 primary data records. [2025-09-23T22:19:08.055795] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:08.057038] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46807 primary records. [2025-09-23T22:19:08.057368] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-23T22:19:08.092744] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-09-23T22:19:08.091117] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:08.093812] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29687 primary records. [2025-09-23T22:19:08.094694] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-23T22:19:08.098016] [INFO ] [MAIN ] Derivative Progress: 568/2077 symbols completed. EBS took 1.2s. Estimated remaining: 9m 49s. Rate: 153.6 symbols/min [2025-09-23T22:19:08.095731] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-23T22:19:08.111814] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:08.120140] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49369 primary records. [2025-09-23T22:19:08.120229] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-23T22:19:08.143204] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-09-23T22:19:08.143729] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-23T22:19:08.144068] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-09-23T22:19:08.146255] [INFO ] [MAIN ] Derivative Progress: 569/2077 symbols completed. ECAT took 1.2s. Estimated remaining: 9m 48s. Rate: 153.8 symbols/min [2025-09-23T22:19:08.146370] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-23T22:19:08.149303] [INFO ] [MAIN ] Derivative Progress: 570/2077 symbols completed. EC took 1.2s. Estimated remaining: 9m 47s. Rate: 154.1 symbols/min [2025-09-23T22:19:08.150055] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:08.150312] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:08.150179] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:08.172719] [DEBUG] [LOCAL ] ECO: Loaded 18531 existing records from primary storage. [2025-09-23T22:19:08.173066] [INFO ] [MAIN ] ECO: Loaded 18531 primary data records. [2025-09-23T22:19:08.360040] [DEBUG] [LOCAL ] ECC: Loaded 43440 existing records from primary storage. [2025-09-23T22:19:08.374267] [DEBUG] [LOCAL ] ECG: Loaded 34265 existing records from primary storage. [2025-09-23T22:19:08.374440] [INFO ] [MAIN ] ECC: Loaded 43440 primary data records. [2025-09-23T22:19:08.374673] [INFO ] [MAIN ] ECG: Loaded 34265 primary data records. [2025-09-23T22:19:09.172412] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:09.173712] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18531 primary records. [2025-09-23T22:19:09.173973] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-23T22:19:09.210526] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-09-23T22:19:09.218986] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:09.219312] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-23T22:19:09.227763] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43440 primary records. [2025-09-23T22:19:09.228023] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-23T22:19:09.228322] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:09.222290] [INFO ] [MAIN ] Derivative Progress: 571/2077 symbols completed. ECO took 1.1s. Estimated remaining: 9m 48s. Rate: 153.6 symbols/min [2025-09-23T22:19:09.229320] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 34265 primary records. [2025-09-23T22:19:09.230047] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:09.230798] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-23T22:19:09.267698] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-09-23T22:19:09.268616] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-23T22:19:09.271374] [INFO ] [MAIN ] Derivative Progress: 572/2077 symbols completed. ECC took 1.1s. Estimated remaining: 9m 47s. Rate: 153.9 symbols/min [2025-09-23T22:19:09.272685] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:09.275342] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-09-23T22:19:09.275570] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-23T22:19:09.279143] [INFO ] [MAIN ] Derivative Progress: 573/2077 symbols completed. ECG took 1.1s. Estimated remaining: 9m 45s. Rate: 154.1 symbols/min [2025-09-23T22:19:09.279826] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:09.314426] [DEBUG] [LOCAL ] ECVT: Loaded 43046 existing records from primary storage. [2025-09-23T22:19:09.324393] [INFO ] [MAIN ] ECVT: Loaded 43046 primary data records. [2025-09-23T22:19:09.440786] [DEBUG] [LOCAL ] EDD: Loaded 27154 existing records from primary storage. [2025-09-23T22:19:09.459683] [INFO ] [MAIN ] EDD: Loaded 27154 primary data records. [2025-09-23T22:19:09.619052] [DEBUG] [LOCAL ] ED: Loaded 52803 existing records from primary storage. [2025-09-23T22:19:09.764527] [INFO ] [MAIN ] ED: Loaded 52803 primary data records. [2025-09-23T22:19:10.400280] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:10.404841] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43046 primary records. [2025-09-23T22:19:10.405261] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-23T22:19:10.434036] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:10.437926] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27154 primary records. [2025-09-23T22:19:10.438035] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-23T22:19:10.443982] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-09-23T22:19:10.451199] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-23T22:19:10.470040] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:10.475073] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52803 primary records. [2025-09-23T22:19:10.475705] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-23T22:19:10.473041] [INFO ] [MAIN ] Derivative Progress: 574/2077 symbols completed. ECVT took 1.2s. Estimated remaining: 9m 47s. Rate: 153.6 symbols/min [2025-09-23T22:19:10.477509] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:10.487618] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-09-23T22:19:10.489393] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-23T22:19:10.496438] [INFO ] [MAIN ] Derivative Progress: 575/2077 symbols completed. EDD took 1.2s. Estimated remaining: 9m 46s. Rate: 153.8 symbols/min [2025-09-23T22:19:10.498388] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:10.507469] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-09-23T22:19:10.507840] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-23T22:19:10.510720] [INFO ] [MAIN ] Derivative Progress: 576/2077 symbols completed. ED took 1.2s. Estimated remaining: 9m 44s. Rate: 154.1 symbols/min [2025-09-23T22:19:10.511050] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:10.518896] [DEBUG] [LOCAL ] EDF: Loaded 13537 existing records from primary storage. [2025-09-23T22:19:10.519095] [INFO ] [MAIN ] EDF: Loaded 13537 primary data records. [2025-09-23T22:19:10.649811] [DEBUG] [LOCAL ] EDN: Loaded 18115 existing records from primary storage. [2025-09-23T22:19:10.661092] [INFO ] [MAIN ] EDN: Loaded 18115 primary data records. [2025-09-23T22:19:11.004214] [DEBUG] [LOCAL ] EDU: Loaded 45060 existing records from primary storage. [2025-09-23T22:19:11.016438] [INFO ] [MAIN ] EDU: Loaded 45060 primary data records. [2025-09-23T22:19:11.558504] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:11.559863] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13537 primary records. [2025-09-23T22:19:11.560291] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-23T22:19:11.588299] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-09-23T22:19:11.593377] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-23T22:19:11.595628] [INFO ] [MAIN ] Derivative Progress: 577/2077 symbols completed. EDF took 1.1s. Estimated remaining: 9m 46s. Rate: 153.6 symbols/min [2025-09-23T22:19:11.596052] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:11.596614] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:11.597716] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18115 primary records. [2025-09-23T22:19:11.597953] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-23T22:19:11.615338] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-09-23T22:19:11.617108] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-23T22:19:11.619488] [INFO ] [MAIN ] Derivative Progress: 578/2077 symbols completed. EDN took 1.1s. Estimated remaining: 9m 45s. Rate: 153.9 symbols/min [2025-09-23T22:19:11.619836] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:11.633329] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:11.634982] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 45060 primary records. [2025-09-23T22:19:11.635187] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-23T22:19:11.649046] [DEBUG] [LOCAL ] EEA: Loaded 2710 existing records from primary storage. [2025-09-23T22:19:11.649673] [INFO ] [MAIN ] EEA: Loaded 2710 primary data records. [2025-09-23T22:19:11.725259] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-09-23T22:19:11.742247] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-23T22:19:11.763708] [INFO ] [MAIN ] Derivative Progress: 579/2077 symbols completed. EDU took 1.3s. Estimated remaining: 9m 44s. Rate: 154.0 symbols/min [2025-09-23T22:19:11.778776] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:11.855469] [DEBUG] [LOCAL ] EE: Loaded 32586 existing records from primary storage. [2025-09-23T22:19:11.855712] [INFO ] [MAIN ] EE: Loaded 32586 primary data records. [2025-09-23T22:19:12.075710] [DEBUG] [LOCAL ] EEX: Loaded 12091 existing records from primary storage. [2025-09-23T22:19:12.095710] [INFO ] [MAIN ] EEX: Loaded 12091 primary data records. [2025-09-23T22:19:12.756684] [DEBUG] [MAIN ] EEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:12.758448] [INFO ] [MAIN ] EEA: Generated 1794 derivative records from 2710 primary records. [2025-09-23T22:19:12.758777] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-23T22:19:12.785932] [DEBUG] [LOCAL ] EEA: Derivative data saved (1794 records). [2025-09-23T22:19:12.789196] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-23T22:19:12.793865] [INFO ] [MAIN ] Derivative Progress: 580/2077 symbols completed. EEA took 1.2s. Estimated remaining: 9m 45s. Rate: 153.6 symbols/min [2025-09-23T22:19:12.794688] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:12.822920] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:12.824409] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32586 primary records. [2025-09-23T22:19:12.837187] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-23T22:19:12.851310] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:12.852481] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 12091 primary records. [2025-09-23T22:19:12.853385] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-23T22:19:12.885627] [DEBUG] [LOCAL ] EFR: Loaded 14232 existing records from primary storage. [2025-09-23T22:19:12.891902] [INFO ] [MAIN ] EFR: Loaded 14232 primary data records. [2025-09-23T22:19:13.017634] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-09-23T22:19:13.039840] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-23T22:19:13.016705] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-09-23T22:19:13.061186] [INFO ] [MAIN ] Derivative Progress: 581/2077 symbols completed. EE took 1.5s. Estimated remaining: 9m 44s. Rate: 153.7 symbols/min [2025-09-23T22:19:13.056865] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-23T22:19:13.078593] [INFO ] [MAIN ] Derivative Progress: 582/2077 symbols completed. EEX took 1.3s. Estimated remaining: 9m 43s. Rate: 153.9 symbols/min [2025-09-23T22:19:13.078933] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:13.084581] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:13.416221] [DEBUG] [LOCAL ] EFXT: Loaded 29358 existing records from primary storage. [2025-09-23T22:19:13.416953] [INFO ] [MAIN ] EFXT: Loaded 29358 primary data records. [2025-09-23T22:19:13.570253] [DEBUG] [LOCAL ] EFX: Loaded 44864 existing records from primary storage. [2025-09-23T22:19:13.604473] [INFO ] [MAIN ] EFX: Loaded 44864 primary data records. [2025-09-23T22:19:13.799016] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:13.965802] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 14232 primary records. [2025-09-23T22:19:13.999048] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-23T22:19:14.059344] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-09-23T22:19:14.082758] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-23T22:19:14.104616] [INFO ] [MAIN ] Derivative Progress: 583/2077 symbols completed. EFR took 1.3s. Estimated remaining: 9m 44s. Rate: 153.5 symbols/min [2025-09-23T22:19:14.289452] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:14.291002] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29358 primary records. [2025-09-23T22:19:14.291863] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-23T22:19:14.310357] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-09-23T22:19:14.310684] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-23T22:19:14.313934] [INFO ] [MAIN ] Derivative Progress: 584/2077 symbols completed. EFXT took 1.2s. Estimated remaining: 9m 43s. Rate: 153.6 symbols/min [2025-09-23T22:19:14.330020] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:14.330759] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44864 primary records. [2025-09-23T22:19:14.330824] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-23T22:19:14.347038] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-09-23T22:19:14.347102] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-23T22:19:14.349452] [INFO ] [MAIN ] Derivative Progress: 585/2077 symbols completed. EFX took 1.3s. Estimated remaining: 9m 42s. Rate: 153.9 symbols/min [2025-09-23T22:19:14.350460] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:14.350991] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:14.351163] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:14.396136] [DEBUG] [LOCAL ] EG: Loaded 28707 existing records from primary storage. [2025-09-23T22:19:14.396382] [INFO ] [MAIN ] EG: Loaded 28707 primary data records. [2025-09-23T22:19:14.604380] [DEBUG] [LOCAL ] EGO: Loaded 51496 existing records from primary storage. [2025-09-23T22:19:14.602631] [DEBUG] [LOCAL ] EGY: Loaded 42328 existing records from primary storage. [2025-09-23T22:19:14.640046] [INFO ] [MAIN ] EGO: Loaded 51496 primary data records. [2025-09-23T22:19:14.639843] [INFO ] [MAIN ] EGY: Loaded 42328 primary data records. [2025-09-23T22:19:15.497625] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:15.498542] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 28707 primary records. [2025-09-23T22:19:15.498732] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-23T22:19:15.517509] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-09-23T22:19:15.517608] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-23T22:19:15.519604] [INFO ] [MAIN ] Derivative Progress: 586/2077 symbols completed. EG took 1.2s. Estimated remaining: 9m 43s. Rate: 153.3 symbols/min [2025-09-23T22:19:15.520267] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:15.553388] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:15.553124] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:15.554232] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 42328 primary records. [2025-09-23T22:19:15.554390] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-23T22:19:15.555025] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51496 primary records. [2025-09-23T22:19:15.555821] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-23T22:19:15.596509] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-09-23T22:19:15.595703] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-09-23T22:19:15.596764] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-23T22:19:15.599004] [INFO ] [MAIN ] Derivative Progress: 587/2077 symbols completed. EGY took 1.2s. Estimated remaining: 9m 42s. Rate: 153.6 symbols/min [2025-09-23T22:19:15.599278] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:15.599420] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-23T22:19:15.603686] [INFO ] [MAIN ] Derivative Progress: 588/2077 symbols completed. EGO took 1.3s. Estimated remaining: 9m 41s. Rate: 153.8 symbols/min [2025-09-23T22:19:15.604320] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:15.618301] [DEBUG] [LOCAL ] EHC: Loaded 41442 existing records from primary storage. [2025-09-23T22:19:15.618595] [INFO ] [MAIN ] EHC: Loaded 41442 primary data records. [2025-09-23T22:19:15.738751] [DEBUG] [LOCAL ] EHI: Loaded 10315 existing records from primary storage. [2025-09-23T22:19:15.742811] [INFO ] [MAIN ] EHI: Loaded 10315 primary data records. [2025-09-23T22:19:15.787924] [DEBUG] [LOCAL ] EIC: Loaded 24236 existing records from primary storage. [2025-09-23T22:19:15.853682] [INFO ] [MAIN ] EIC: Loaded 24236 primary data records. [2025-09-23T22:19:16.696980] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:16.698345] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41442 primary records. [2025-09-23T22:19:16.698606] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-23T22:19:16.719348] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-09-23T22:19:16.719858] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-23T22:19:16.723516] [INFO ] [MAIN ] Derivative Progress: 589/2077 symbols completed. EHC took 1.2s. Estimated remaining: 9m 42s. Rate: 153.3 symbols/min [2025-09-23T22:19:16.724102] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:16.747914] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:16.761961] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10315 primary records. [2025-09-23T22:19:16.762469] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-23T22:19:16.763085] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:16.765296] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 24236 primary records. [2025-09-23T22:19:16.765895] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-23T22:19:16.813269] [DEBUG] [LOCAL ] EIG: Loaded 20345 existing records from primary storage. [2025-09-23T22:19:16.813474] [INFO ] [MAIN ] EIG: Loaded 20345 primary data records. [2025-09-23T22:19:16.812753] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-09-23T22:19:16.813778] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-23T22:19:16.812101] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-09-23T22:19:16.819352] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-23T22:19:16.823043] [INFO ] [MAIN ] Derivative Progress: 590/2077 symbols completed. EHI took 1.2s. Estimated remaining: 9m 41s. Rate: 153.5 symbols/min [2025-09-23T22:19:16.829900] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:16.832724] [INFO ] [MAIN ] Derivative Progress: 591/2077 symbols completed. EIC took 1.2s. Estimated remaining: 9m 40s. Rate: 153.8 symbols/min [2025-09-23T22:19:16.864336] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:17.188677] [DEBUG] [LOCAL ] EIX: Loaded 53345 existing records from primary storage. [2025-09-23T22:19:17.189675] [INFO ] [MAIN ] EIX: Loaded 53345 primary data records. [2025-09-23T22:19:17.318700] [DEBUG] [LOCAL ] EL: Loaded 53403 existing records from primary storage. [2025-09-23T22:19:17.335699] [INFO ] [MAIN ] EL: Loaded 53403 primary data records. [2025-09-23T22:19:17.649839] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:17.662001] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20345 primary records. [2025-09-23T22:19:17.672361] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-23T22:19:17.857412] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-09-23T22:19:17.862980] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-23T22:19:17.876248] [INFO ] [MAIN ] Derivative Progress: 592/2077 symbols completed. EIG took 1.2s. Estimated remaining: 9m 41s. Rate: 153.3 symbols/min [2025-09-23T22:19:17.876955] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:17.905534] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:17.906848] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53345 primary records. [2025-09-23T22:19:17.906995] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-23T22:19:17.940397] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-09-23T22:19:17.940762] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-23T22:19:17.942609] [INFO ] [MAIN ] Derivative Progress: 593/2077 symbols completed. EIX took 1.1s. Estimated remaining: 9m 40s. Rate: 153.6 symbols/min [2025-09-23T22:19:17.943187] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:17.956231] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:17.956912] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53403 primary records. [2025-09-23T22:19:17.957194] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-23T22:19:17.989086] [DEBUG] [LOCAL ] ELAN: Loaded 53196 existing records from primary storage. [2025-09-23T22:19:17.992359] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-09-23T22:19:17.992684] [DEBUG] [LOCAL ] ELC: Loaded 3497 existing records from primary storage. [2025-09-23T22:19:17.992497] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-23T22:19:17.992786] [INFO ] [MAIN ] ELC: Loaded 3497 primary data records. [2025-09-23T22:19:17.995463] [INFO ] [MAIN ] Derivative Progress: 594/2077 symbols completed. EL took 1.1s. Estimated remaining: 9m 39s. Rate: 153.8 symbols/min [2025-09-23T22:19:17.995808] [INFO ] [MAIN ] ELAN: Loaded 53196 primary data records. [2025-09-23T22:19:17.995743] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:18.630559] [DEBUG] [LOCAL ] ELF: Loaded 52288 existing records from primary storage. [2025-09-23T22:19:18.632449] [INFO ] [MAIN ] ELF: Loaded 52288 primary data records. [2025-09-23T22:19:19.040520] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:19:19.042501] [INFO ] [MAIN ] ELC: Generated 1793 derivative records from 3497 primary records. [2025-09-23T22:19:19.043535] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-23T22:19:19.070179] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:19.074555] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53196 primary records. [2025-09-23T22:19:19.075281] [DEBUG] [LOCAL ] ELC: Derivative data saved (1793 records). [2025-09-23T22:19:19.075904] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-23T22:19:19.078356] [INFO ] [MAIN ] Derivative Progress: 595/2077 symbols completed. ELC took 1.1s. Estimated remaining: 9m 40s. Rate: 153.3 symbols/min [2025-09-23T22:19:19.076171] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-23T22:19:19.078790] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:19.099165] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-09-23T22:19:19.099816] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-23T22:19:19.103161] [INFO ] [MAIN ] Derivative Progress: 596/2077 symbols completed. ELAN took 1.2s. Estimated remaining: 9m 39s. Rate: 153.6 symbols/min [2025-09-23T22:19:19.103624] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:19.140312] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:19.141261] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52288 primary records. [2025-09-23T22:19:19.141383] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-23T22:19:19.173397] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-09-23T22:19:19.173601] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-23T22:19:19.176072] [INFO ] [MAIN ] Derivative Progress: 597/2077 symbols completed. ELF took 1.2s. Estimated remaining: 9m 37s. Rate: 153.8 symbols/min [2025-09-23T22:19:19.176383] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:19.186777] [DEBUG] [LOCAL ] ELP: Loaded 25828 existing records from primary storage. [2025-09-23T22:19:19.196738] [INFO ] [MAIN ] ELP: Loaded 25828 primary data records. [2025-09-23T22:19:19.211434] [DEBUG] [LOCAL ] ELME: Loaded 39265 existing records from primary storage. [2025-09-23T22:19:19.219388] [INFO ] [MAIN ] ELME: Loaded 39265 primary data records. [2025-09-23T22:19:19.835823] [DEBUG] [LOCAL ] ELS: Loaded 49399 existing records from primary storage. [2025-09-23T22:19:19.836370] [INFO ] [MAIN ] ELS: Loaded 49399 primary data records. [2025-09-23T22:19:20.197410] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:20.200262] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25828 primary records. [2025-09-23T22:19:20.200509] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-23T22:19:20.231403] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:20.233387] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39265 primary records. [2025-09-23T22:19:20.233758] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-23T22:19:20.250424] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-09-23T22:19:20.253749] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-23T22:19:20.256948] [INFO ] [MAIN ] Derivative Progress: 598/2077 symbols completed. ELP took 1.2s. Estimated remaining: 9m 39s. Rate: 153.3 symbols/min [2025-09-23T22:19:20.258050] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-09-23T22:19:20.258346] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-23T22:19:20.260878] [INFO ] [MAIN ] Derivative Progress: 599/2077 symbols completed. ELME took 1.2s. Estimated remaining: 9m 37s. Rate: 153.6 symbols/min [2025-09-23T22:19:20.278025] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:20.278825] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49399 primary records. [2025-09-23T22:19:20.278890] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-23T22:19:20.294749] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-09-23T22:19:20.294820] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-23T22:19:20.297257] [INFO ] [MAIN ] Derivative Progress: 600/2077 symbols completed. ELS took 1.1s. Estimated remaining: 9m 36s. Rate: 153.8 symbols/min [2025-09-23T22:19:20.298255] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:20.298345] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:20.298116] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:20.350059] [DEBUG] [LOCAL ] EMD: Loaded 21115 existing records from primary storage. [2025-09-23T22:19:20.350375] [INFO ] [MAIN ] EMD: Loaded 21115 primary data records. [2025-09-23T22:19:20.372425] [DEBUG] [LOCAL ] EME: Loaded 31702 existing records from primary storage. [2025-09-23T22:19:20.403581] [INFO ] [MAIN ] EME: Loaded 31702 primary data records. [2025-09-23T22:19:20.732318] [DEBUG] [LOCAL ] ELV: Loaded 50571 existing records from primary storage. [2025-09-23T22:19:20.747313] [INFO ] [MAIN ] ELV: Loaded 50571 primary data records. [2025-09-23T22:19:21.461192] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:21.462211] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 21115 primary records. [2025-09-23T22:19:21.462426] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-23T22:19:21.477550] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:21.485791] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31702 primary records. [2025-09-23T22:19:21.486043] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-23T22:19:21.503037] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-09-23T22:19:21.503161] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-23T22:19:21.509126] [INFO ] [MAIN ] Derivative Progress: 601/2077 symbols completed. EMD took 1.2s. Estimated remaining: 9m 38s. Rate: 153.3 symbols/min [2025-09-23T22:19:21.514111] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:21.514171] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-09-23T22:19:21.514567] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-23T22:19:21.517144] [INFO ] [MAIN ] Derivative Progress: 602/2077 symbols completed. EME took 1.2s. Estimated remaining: 9m 36s. Rate: 153.5 symbols/min [2025-09-23T22:19:21.519189] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:21.529743] [DEBUG] [LOCAL ] EMF: Loaded 3595 existing records from primary storage. [2025-09-23T22:19:21.543072] [INFO ] [MAIN ] EMF: Loaded 3595 primary data records. [2025-09-23T22:19:21.543711] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:21.556555] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50571 primary records. [2025-09-23T22:19:21.591545] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-23T22:19:21.752323] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-09-23T22:19:21.875674] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-23T22:19:21.891035] [INFO ] [MAIN ] Derivative Progress: 603/2077 symbols completed. ELV took 1.6s. Estimated remaining: 9m 36s. Rate: 153.5 symbols/min [2025-09-23T22:19:21.891573] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:21.913003] [DEBUG] [LOCAL ] EMN: Loaded 50354 existing records from primary storage. [2025-09-23T22:19:21.913217] [INFO ] [MAIN ] EMN: Loaded 50354 primary data records. [2025-09-23T22:19:22.279491] [DEBUG] [LOCAL ] EMR: Loaded 53256 existing records from primary storage. [2025-09-23T22:19:22.280510] [INFO ] [MAIN ] EMR: Loaded 53256 primary data records. [2025-09-23T22:19:22.286310] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:22.293730] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3595 primary records. [2025-09-23T22:19:22.304667] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-23T22:19:22.403953] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-09-23T22:19:22.453254] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-23T22:19:22.490165] [INFO ] [MAIN ] Derivative Progress: 604/2077 symbols completed. EMF took 1.0s. Estimated remaining: 9m 36s. Rate: 153.4 symbols/min [2025-09-23T22:19:22.540596] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:22.647708] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:22.649266] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50354 primary records. [2025-09-23T22:19:22.649730] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-23T22:19:22.668051] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-09-23T22:19:22.669528] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-23T22:19:22.672273] [INFO ] [MAIN ] Derivative Progress: 605/2077 symbols completed. EMN took 1.2s. Estimated remaining: 9m 35s. Rate: 153.5 symbols/min [2025-09-23T22:19:22.672757] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:22.678866] [DEBUG] [LOCAL ] ENFY: Loaded 3059 existing records from primary storage. [2025-09-23T22:19:22.679110] [INFO ] [MAIN ] ENFY: Loaded 3059 primary data records. [2025-09-23T22:19:22.835260] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:22.867683] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53256 primary records. [2025-09-23T22:19:22.899381] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-23T22:19:22.929810] [DEBUG] [LOCAL ] ENB: Loaded 53518 existing records from primary storage. [2025-09-23T22:19:22.937600] [INFO ] [MAIN ] ENB: Loaded 53518 primary data records. [2025-09-23T22:19:23.199343] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-09-23T22:19:23.219610] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-23T22:19:23.222587] [INFO ] [MAIN ] Derivative Progress: 606/2077 symbols completed. EMR took 1.3s. Estimated remaining: 9m 35s. Rate: 153.4 symbols/min [2025-09-23T22:19:23.242666] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:23.328193] [DEBUG] [LOCAL ] ENO: Loaded 1954 existing records from primary storage. [2025-09-23T22:19:23.443324] [INFO ] [MAIN ] ENO: Loaded 1954 primary data records. [2025-09-23T22:19:23.791459] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:23.793147] [INFO ] [MAIN ] ENFY: Generated 1794 derivative records from 3059 primary records. [2025-09-23T22:19:23.794712] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-23T22:19:23.828991] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:23.830009] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1794 records). [2025-09-23T22:19:23.831085] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53518 primary records. [2025-09-23T22:19:23.831514] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-23T22:19:23.833630] [INFO ] [MAIN ] Derivative Progress: 607/2077 symbols completed. ENFY took 1.2s. Estimated remaining: 9m 35s. Rate: 153.3 symbols/min [2025-09-23T22:19:23.831610] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-23T22:19:23.844979] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:23.855619] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-09-23T22:19:23.855834] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-23T22:19:23.858277] [INFO ] [MAIN ] Derivative Progress: 608/2077 symbols completed. ENB took 1.4s. Estimated remaining: 9m 34s. Rate: 153.5 symbols/min [2025-09-23T22:19:23.859179] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:23.881930] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:23.883078] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 1954 primary records. [2025-09-23T22:19:23.883272] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-23T22:19:23.911157] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-09-23T22:19:23.911427] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-23T22:19:23.914221] [INFO ] [MAIN ] Derivative Progress: 609/2077 symbols completed. ENO took 0.7s. Estimated remaining: 9m 33s. Rate: 153.7 symbols/min [2025-09-23T22:19:23.914678] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:23.944091] [DEBUG] [LOCAL ] ENOV: Loaded 45210 existing records from primary storage. [2025-09-23T22:19:23.944297] [INFO ] [MAIN ] ENOV: Loaded 45210 primary data records. [2025-09-23T22:19:24.082174] [DEBUG] [LOCAL ] ENR: Loaded 42760 existing records from primary storage. [2025-09-23T22:19:24.093333] [INFO ] [MAIN ] ENR: Loaded 42760 primary data records. [2025-09-23T22:19:24.218589] [DEBUG] [LOCAL ] ENS: Loaded 29449 existing records from primary storage. [2025-09-23T22:19:24.268506] [INFO ] [MAIN ] ENS: Loaded 29449 primary data records. [2025-09-23T22:19:24.965517] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:24.967301] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 45210 primary records. [2025-09-23T22:19:24.968409] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-23T22:19:25.004942] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-09-23T22:19:25.008167] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:25.006944] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-23T22:19:25.010540] [INFO ] [MAIN ] Derivative Progress: 610/2077 symbols completed. ENOV took 1.2s. Estimated remaining: 9m 34s. Rate: 153.3 symbols/min [2025-09-23T22:19:25.010899] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:25.011937] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 42760 primary records. [2025-09-23T22:19:25.012239] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-23T22:19:25.040960] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:25.043690] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29449 primary records. [2025-09-23T22:19:25.043890] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-23T22:19:25.045695] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-09-23T22:19:25.046229] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-23T22:19:25.048724] [INFO ] [MAIN ] Derivative Progress: 611/2077 symbols completed. ENR took 1.2s. Estimated remaining: 9m 33s. Rate: 153.5 symbols/min [2025-09-23T22:19:25.056528] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:25.065455] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-09-23T22:19:25.073604] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-23T22:19:25.076356] [INFO ] [MAIN ] Derivative Progress: 612/2077 symbols completed. ENS took 1.2s. Estimated remaining: 9m 32s. Rate: 153.7 symbols/min [2025-09-23T22:19:25.076738] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:25.092192] [DEBUG] [LOCAL ] ENVA: Loaded 25785 existing records from primary storage. [2025-09-23T22:19:25.092502] [INFO ] [MAIN ] ENVA: Loaded 25785 primary data records. [2025-09-23T22:19:25.167596] [DEBUG] [LOCAL ] EOD: Loaded 13989 existing records from primary storage. [2025-09-23T22:19:25.174335] [INFO ] [MAIN ] EOD: Loaded 13989 primary data records. [2025-09-23T22:19:25.774405] [DEBUG] [LOCAL ] EOG: Loaded 53341 existing records from primary storage. [2025-09-23T22:19:25.775166] [INFO ] [MAIN ] EOG: Loaded 53341 primary data records. [2025-09-23T22:19:26.116822] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:26.118460] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25785 primary records. [2025-09-23T22:19:26.118717] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-23T22:19:26.140141] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-09-23T22:19:26.153615] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-23T22:19:26.157385] [INFO ] [MAIN ] Derivative Progress: 613/2077 symbols completed. ENVA took 1.1s. Estimated remaining: 9m 33s. Rate: 153.3 symbols/min [2025-09-23T22:19:26.158392] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:26.159160] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 13989 primary records. [2025-09-23T22:19:26.159378] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-23T22:19:26.176787] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-09-23T22:19:26.176858] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-23T22:19:26.179296] [INFO ] [MAIN ] Derivative Progress: 614/2077 symbols completed. EOD took 1.1s. Estimated remaining: 9m 32s. Rate: 153.5 symbols/min [2025-09-23T22:19:26.195215] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:26.195941] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53341 primary records. [2025-09-23T22:19:26.196014] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-23T22:19:26.212267] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-09-23T22:19:26.212333] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-23T22:19:26.214486] [INFO ] [MAIN ] Derivative Progress: 615/2077 symbols completed. EOG took 1.1s. Estimated remaining: 9m 31s. Rate: 153.8 symbols/min [2025-09-23T22:19:26.215102] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:26.215258] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:26.215763] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:26.232838] [DEBUG] [LOCAL ] EOI: Loaded 10531 existing records from primary storage. [2025-09-23T22:19:26.233119] [INFO ] [MAIN ] EOI: Loaded 10531 primary data records. [2025-09-23T22:19:26.323388] [DEBUG] [LOCAL ] EOS: Loaded 15392 existing records from primary storage. [2025-09-23T22:19:26.347729] [INFO ] [MAIN ] EOS: Loaded 15392 primary data records. [2025-09-23T22:19:26.358916] [DEBUG] [LOCAL ] EPAC: Loaded 27051 existing records from primary storage. [2025-09-23T22:19:26.359116] [INFO ] [MAIN ] EPAC: Loaded 27051 primary data records. [2025-09-23T22:19:27.273552] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:27.274394] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10531 primary records. [2025-09-23T22:19:27.274510] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-23T22:19:27.296878] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-09-23T22:19:27.311437] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:27.311531] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-23T22:19:27.314044] [INFO ] [MAIN ] Derivative Progress: 616/2077 symbols completed. EOI took 1.1s. Estimated remaining: 9m 32s. Rate: 153.3 symbols/min [2025-09-23T22:19:27.315038] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15392 primary records. [2025-09-23T22:19:27.322999] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-23T22:19:27.328196] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:27.328763] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:27.330093] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 27051 primary records. [2025-09-23T22:19:27.330688] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-23T22:19:27.363673] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-09-23T22:19:27.363872] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-23T22:19:27.363599] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-09-23T22:19:27.364047] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-23T22:19:27.366322] [INFO ] [MAIN ] Derivative Progress: 617/2077 symbols completed. EOS took 1.2s. Estimated remaining: 9m 31s. Rate: 153.5 symbols/min [2025-09-23T22:19:27.369103] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:27.369251] [INFO ] [MAIN ] Derivative Progress: 618/2077 symbols completed. EPAC took 1.2s. Estimated remaining: 9m 29s. Rate: 153.8 symbols/min [2025-09-23T22:19:27.369859] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:27.419259] [DEBUG] [LOCAL ] EPAM: Loaded 39711 existing records from primary storage. [2025-09-23T22:19:27.419561] [INFO ] [MAIN ] EPAM: Loaded 39711 primary data records. [2025-09-23T22:19:27.495183] [DEBUG] [LOCAL ] EPC: Loaded 39891 existing records from primary storage. [2025-09-23T22:19:27.519575] [INFO ] [MAIN ] EPC: Loaded 39891 primary data records. [2025-09-23T22:19:27.687176] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-23T22:19:27.706606] [INFO ] [MAIN ] EPD: Loaded 53616 primary data records. [2025-09-23T22:19:28.427453] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:28.440401] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39711 primary records. [2025-09-23T22:19:28.440790] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-23T22:19:28.441852] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:28.442466] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39891 primary records. [2025-09-23T22:19:28.443309] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-23T22:19:28.474557] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-09-23T22:19:28.476286] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-23T22:19:28.479639] [INFO ] [MAIN ] Derivative Progress: 619/2077 symbols completed. EPAM took 1.2s. Estimated remaining: 9m 31s. Rate: 153.3 symbols/min [2025-09-23T22:19:28.480107] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:28.483356] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-09-23T22:19:28.483719] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-23T22:19:28.486393] [INFO ] [MAIN ] Derivative Progress: 620/2077 symbols completed. EPC took 1.1s. Estimated remaining: 9m 29s. Rate: 153.6 symbols/min [2025-09-23T22:19:28.499256] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:28.500345] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:28.501260] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53616 primary records. [2025-09-23T22:19:28.501522] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-23T22:19:28.522257] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-09-23T22:19:28.522447] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-23T22:19:28.525017] [INFO ] [MAIN ] Derivative Progress: 621/2077 symbols completed. EPD took 1.2s. Estimated remaining: 9m 28s. Rate: 153.8 symbols/min [2025-09-23T22:19:28.525391] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:28.569680] [DEBUG] [LOCAL ] EPRT: Loaded 48693 existing records from primary storage. [2025-09-23T22:19:28.569979] [INFO ] [MAIN ] EPRT: Loaded 48693 primary data records. [2025-09-23T22:19:28.715074] [DEBUG] [LOCAL ] EPR: Loaded 44248 existing records from primary storage. [2025-09-23T22:19:28.715916] [INFO ] [MAIN ] EPR: Loaded 44248 primary data records. [2025-09-23T22:19:29.024670] [DEBUG] [LOCAL ] EQH: Loaded 52669 existing records from primary storage. [2025-09-23T22:19:29.053662] [INFO ] [MAIN ] EQH: Loaded 52669 primary data records. [2025-09-23T22:19:29.659289] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:29.661704] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48693 primary records. [2025-09-23T22:19:29.662254] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-23T22:19:29.698239] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:29.700960] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 44248 primary records. [2025-09-23T22:19:29.701327] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-23T22:19:29.701058] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-09-23T22:19:29.704840] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-23T22:19:29.707731] [INFO ] [MAIN ] Derivative Progress: 622/2077 symbols completed. EPRT took 1.2s. Estimated remaining: 9m 30s. Rate: 153.3 symbols/min [2025-09-23T22:19:29.716915] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:29.734019] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:29.736150] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52669 primary records. [2025-09-23T22:19:29.736588] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-23T22:19:29.753051] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-09-23T22:19:29.753878] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-23T22:19:29.756496] [INFO ] [MAIN ] Derivative Progress: 623/2077 symbols completed. EPR took 1.3s. Estimated remaining: 9m 28s. Rate: 153.5 symbols/min [2025-09-23T22:19:29.757022] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:29.760632] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-09-23T22:19:29.760860] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-23T22:19:29.763236] [INFO ] [MAIN ] Derivative Progress: 624/2077 symbols completed. EQH took 1.2s. Estimated remaining: 9m 27s. Rate: 153.7 symbols/min [2025-09-23T22:19:29.763618] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:29.818089] [DEBUG] [LOCAL ] EQNR: Loaded 53041 existing records from primary storage. [2025-09-23T22:19:29.818355] [INFO ] [MAIN ] EQNR: Loaded 53041 primary data records. [2025-09-23T22:19:30.013333] [DEBUG] [LOCAL ] EQR: Loaded 51413 existing records from primary storage. [2025-09-23T22:19:30.051303] [INFO ] [MAIN ] EQR: Loaded 51413 primary data records. [2025-09-23T22:19:30.174144] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-23T22:19:30.207927] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-09-23T22:19:30.846735] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:30.848367] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53041 primary records. [2025-09-23T22:19:30.848594] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-23T22:19:30.872338] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-09-23T22:19:30.886902] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:30.887134] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-23T22:19:30.890032] [INFO ] [MAIN ] Derivative Progress: 625/2077 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 28s. Rate: 153.3 symbols/min [2025-09-23T22:19:30.890405] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:30.887815] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51413 primary records. [2025-09-23T22:19:30.891171] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-23T22:19:30.904910] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:30.916235] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-09-23T22:19:30.918466] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-23T22:19:30.934764] [DEBUG] [LOCAL ] EQV: Loaded 2828 existing records from primary storage. [2025-09-23T22:19:30.935427] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-09-23T22:19:30.935785] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-23T22:19:30.935084] [INFO ] [MAIN ] EQV: Loaded 2828 primary data records. [2025-09-23T22:19:30.944979] [INFO ] [MAIN ] Derivative Progress: 626/2077 symbols completed. EQR took 1.2s. Estimated remaining: 9m 27s. Rate: 153.5 symbols/min [2025-09-23T22:19:30.945937] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:31.017898] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-09-23T22:19:31.041716] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-23T22:19:31.055457] [INFO ] [MAIN ] Derivative Progress: 627/2077 symbols completed. EQT took 1.3s. Estimated remaining: 9m 26s. Rate: 153.7 symbols/min [2025-09-23T22:19:31.055937] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:31.296952] [DEBUG] [LOCAL ] ERJ: Loaded 50792 existing records from primary storage. [2025-09-23T22:19:31.297269] [INFO ] [MAIN ] ERJ: Loaded 50792 primary data records. [2025-09-23T22:19:31.420253] [DEBUG] [LOCAL ] ERO: Loaded 41133 existing records from primary storage. [2025-09-23T22:19:31.461450] [INFO ] [MAIN ] ERO: Loaded 41133 primary data records. [2025-09-23T22:19:31.555169] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:31.697281] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2828 primary records. [2025-09-23T22:19:31.723510] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-23T22:19:31.987252] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-09-23T22:19:31.987798] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-23T22:19:31.989860] [INFO ] [MAIN ] Derivative Progress: 628/2077 symbols completed. EQV took 1.1s. Estimated remaining: 9m 27s. Rate: 153.3 symbols/min [2025-09-23T22:19:32.010222] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:32.011157] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50792 primary records. [2025-09-23T22:19:32.011237] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-23T22:19:32.028993] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-09-23T22:19:32.029291] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-23T22:19:32.031204] [INFO ] [MAIN ] Derivative Progress: 629/2077 symbols completed. ERJ took 1.1s. Estimated remaining: 9m 26s. Rate: 153.5 symbols/min [2025-09-23T22:19:32.047127] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:32.047689] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41133 primary records. [2025-09-23T22:19:32.047752] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-23T22:19:32.063058] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-09-23T22:19:32.063116] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-23T22:19:32.065595] [INFO ] [MAIN ] Derivative Progress: 630/2077 symbols completed. ERO took 1.0s. Estimated remaining: 9m 25s. Rate: 153.8 symbols/min [2025-09-23T22:19:32.066200] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:32.066363] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:32.066509] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:32.093164] [DEBUG] [LOCAL ] ESE: Loaded 16640 existing records from primary storage. [2025-09-23T22:19:32.093399] [INFO ] [MAIN ] ESE: Loaded 16640 primary data records. [2025-09-23T22:19:32.192383] [DEBUG] [LOCAL ] ESAB: Loaded 26041 existing records from primary storage. [2025-09-23T22:19:32.210785] [INFO ] [MAIN ] ESAB: Loaded 26041 primary data records. [2025-09-23T22:19:32.534430] [DEBUG] [LOCAL ] ES: Loaded 52528 existing records from primary storage. [2025-09-23T22:19:32.559417] [INFO ] [MAIN ] ES: Loaded 52528 primary data records. [2025-09-23T22:19:33.088541] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:33.090490] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16640 primary records. [2025-09-23T22:19:33.090702] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-23T22:19:33.120256] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:33.121721] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26041 primary records. [2025-09-23T22:19:33.121930] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-23T22:19:33.132886] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-09-23T22:19:33.133866] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-23T22:19:33.136705] [INFO ] [MAIN ] Derivative Progress: 631/2077 symbols completed. ESE took 1.1s. Estimated remaining: 9m 26s. Rate: 153.3 symbols/min [2025-09-23T22:19:33.139549] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:33.159210] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:33.161216] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-09-23T22:19:33.161081] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52528 primary records. [2025-09-23T22:19:33.161383] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-23T22:19:33.163394] [INFO ] [MAIN ] Derivative Progress: 632/2077 symbols completed. ESAB took 1.1s. Estimated remaining: 9m 25s. Rate: 153.6 symbols/min [2025-09-23T22:19:33.161334] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-23T22:19:33.163700] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:33.181405] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-09-23T22:19:33.181673] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-23T22:19:33.184231] [INFO ] [MAIN ] Derivative Progress: 633/2077 symbols completed. ES took 1.1s. Estimated remaining: 9m 23s. Rate: 153.8 symbols/min [2025-09-23T22:19:33.184576] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:33.230679] [DEBUG] [LOCAL ] ESI: Loaded 50856 existing records from primary storage. [2025-09-23T22:19:33.241723] [INFO ] [MAIN ] ESI: Loaded 50856 primary data records. [2025-09-23T22:19:33.242326] [DEBUG] [LOCAL ] ESNT: Loaded 38672 existing records from primary storage. [2025-09-23T22:19:33.274317] [INFO ] [MAIN ] ESNT: Loaded 38672 primary data records. [2025-09-23T22:19:33.556335] [DEBUG] [LOCAL ] ESRT: Loaded 46352 existing records from primary storage. [2025-09-23T22:19:33.562261] [INFO ] [MAIN ] ESRT: Loaded 46352 primary data records. [2025-09-23T22:19:34.255039] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:34.256320] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38672 primary records. [2025-09-23T22:19:34.256984] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-23T22:19:34.256918] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:34.257618] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50856 primary records. [2025-09-23T22:19:34.258966] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-23T22:19:34.304544] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:34.305944] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-09-23T22:19:34.306710] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46352 primary records. [2025-09-23T22:19:34.307057] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-23T22:19:34.307110] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-23T22:19:34.310576] [INFO ] [MAIN ] Derivative Progress: 634/2077 symbols completed. ESNT took 1.1s. Estimated remaining: 9m 25s. Rate: 153.3 symbols/min [2025-09-23T22:19:34.318316] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:34.326495] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-09-23T22:19:34.326862] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-23T22:19:34.329659] [INFO ] [MAIN ] Derivative Progress: 635/2077 symbols completed. ESI took 1.2s. Estimated remaining: 9m 23s. Rate: 153.6 symbols/min [2025-09-23T22:19:34.331019] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:34.331118] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-09-23T22:19:34.331493] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-23T22:19:34.334256] [INFO ] [MAIN ] Derivative Progress: 636/2077 symbols completed. ESRT took 1.1s. Estimated remaining: 9m 22s. Rate: 153.8 symbols/min [2025-09-23T22:19:34.334736] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:34.355898] [DEBUG] [LOCAL ] ETB: Loaded 11919 existing records from primary storage. [2025-09-23T22:19:34.356043] [INFO ] [MAIN ] ETB: Loaded 11919 primary data records. [2025-09-23T22:19:34.463747] [DEBUG] [LOCAL ] ESS: Loaded 30026 existing records from primary storage. [2025-09-23T22:19:34.492115] [INFO ] [MAIN ] ESS: Loaded 30026 primary data records. [2025-09-23T22:19:34.710321] [DEBUG] [LOCAL ] ESTC: Loaded 50162 existing records from primary storage. [2025-09-23T22:19:34.843564] [INFO ] [MAIN ] ESTC: Loaded 50162 primary data records. [2025-09-23T22:19:35.460410] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:35.461592] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 11919 primary records. [2025-09-23T22:19:35.462878] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-23T22:19:35.497333] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-09-23T22:19:35.497810] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-23T22:19:35.497599] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:35.498833] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 30026 primary records. [2025-09-23T22:19:35.499101] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-23T22:19:35.501405] [INFO ] [MAIN ] Derivative Progress: 637/2077 symbols completed. ETB took 1.2s. Estimated remaining: 9m 24s. Rate: 153.3 symbols/min [2025-09-23T22:19:35.503820] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:35.533829] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:35.535028] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50162 primary records. [2025-09-23T22:19:35.535583] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-23T22:19:35.536477] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-09-23T22:19:35.536701] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-23T22:19:35.539331] [INFO ] [MAIN ] Derivative Progress: 638/2077 symbols completed. ESS took 1.2s. Estimated remaining: 9m 22s. Rate: 153.5 symbols/min [2025-09-23T22:19:35.540268] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:35.566299] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-09-23T22:19:35.576136] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-23T22:19:35.580218] [INFO ] [MAIN ] Derivative Progress: 639/2077 symbols completed. ESTC took 1.2s. Estimated remaining: 9m 21s. Rate: 153.8 symbols/min [2025-09-23T22:19:35.581183] [DEBUG] [LOCAL ] ETD: Loaded 27418 existing records from primary storage. [2025-09-23T22:19:35.585150] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:35.585293] [INFO ] [MAIN ] ETD: Loaded 27418 primary data records. [2025-09-23T22:19:35.666672] [DEBUG] [LOCAL ] ETG: Loaded 16618 existing records from primary storage. [2025-09-23T22:19:35.706487] [INFO ] [MAIN ] ETG: Loaded 16618 primary data records. [2025-09-23T22:19:35.880533] [DEBUG] [LOCAL ] ETJ: Loaded 16617 existing records from primary storage. [2025-09-23T22:19:35.988961] [INFO ] [MAIN ] ETJ: Loaded 16617 primary data records. [2025-09-23T22:19:36.600352] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:36.601265] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27418 primary records. [2025-09-23T22:19:36.602152] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-23T22:19:36.637449] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:36.638941] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16618 primary records. [2025-09-23T22:19:36.639361] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-23T22:19:36.641398] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-09-23T22:19:36.641855] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-23T22:19:36.655820] [INFO ] [MAIN ] Derivative Progress: 640/2077 symbols completed. ETD took 1.2s. Estimated remaining: 9m 22s. Rate: 153.3 symbols/min [2025-09-23T22:19:36.656690] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:36.677903] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-09-23T22:19:36.678060] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-23T22:19:36.677499] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:36.681435] [INFO ] [MAIN ] Derivative Progress: 641/2077 symbols completed. ETG took 1.1s. Estimated remaining: 9m 21s. Rate: 153.6 symbols/min [2025-09-23T22:19:36.678960] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16617 primary records. [2025-09-23T22:19:36.681660] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-23T22:19:36.682172] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:36.704525] [DEBUG] [LOCAL ] ETO: Loaded 6492 existing records from primary storage. [2025-09-23T22:19:36.705871] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-09-23T22:19:36.706188] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-23T22:19:36.706108] [INFO ] [MAIN ] ETO: Loaded 6492 primary data records. [2025-09-23T22:19:36.708836] [INFO ] [MAIN ] Derivative Progress: 642/2077 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 20s. Rate: 153.8 symbols/min [2025-09-23T22:19:36.714372] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:37.050597] [DEBUG] [LOCAL ] ETN: Loaded 52836 existing records from primary storage. [2025-09-23T22:19:37.058269] [INFO ] [MAIN ] ETN: Loaded 52836 primary data records. [2025-09-23T22:19:37.236608] [DEBUG] [LOCAL ] ETR: Loaded 53225 existing records from primary storage. [2025-09-23T22:19:37.267022] [INFO ] [MAIN ] ETR: Loaded 53225 primary data records. [2025-09-23T22:19:37.827956] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:37.829257] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6492 primary records. [2025-09-23T22:19:37.829396] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-23T22:19:37.848201] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-09-23T22:19:37.849395] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-23T22:19:37.853090] [INFO ] [MAIN ] Derivative Progress: 643/2077 symbols completed. ETO took 1.2s. Estimated remaining: 9m 21s. Rate: 153.3 symbols/min [2025-09-23T22:19:37.871163] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:37.872018] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52836 primary records. [2025-09-23T22:19:37.872281] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-23T22:19:37.904723] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-09-23T22:19:37.904966] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-23T22:19:37.907385] [INFO ] [MAIN ] Derivative Progress: 644/2077 symbols completed. ETN took 1.3s. Estimated remaining: 9m 20s. Rate: 153.5 symbols/min [2025-09-23T22:19:37.907675] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:37.908473] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53225 primary records. [2025-09-23T22:19:37.908535] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-23T22:19:37.924085] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-09-23T22:19:37.924146] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-23T22:19:37.926806] [INFO ] [MAIN ] Derivative Progress: 645/2077 symbols completed. ETR took 1.2s. Estimated remaining: 9m 19s. Rate: 153.8 symbols/min [2025-09-23T22:19:37.927331] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:37.927576] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:37.927416] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:37.935708] [DEBUG] [LOCAL ] ETX: Loaded 4964 existing records from primary storage. [2025-09-23T22:19:37.935878] [INFO ] [MAIN ] ETX: Loaded 4964 primary data records. [2025-09-23T22:19:38.060780] [DEBUG] [LOCAL ] ETV: Loaded 21362 existing records from primary storage. [2025-09-23T22:19:38.078422] [INFO ] [MAIN ] ETV: Loaded 21362 primary data records. [2025-09-23T22:19:38.107125] [DEBUG] [LOCAL ] ETW: Loaded 25080 existing records from primary storage. [2025-09-23T22:19:38.314340] [INFO ] [MAIN ] ETW: Loaded 25080 primary data records. [2025-09-23T22:19:38.951416] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:38.952687] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 4964 primary records. [2025-09-23T22:19:38.953241] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-23T22:19:38.974865] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-09-23T22:19:38.976038] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-23T22:19:38.978399] [INFO ] [MAIN ] Derivative Progress: 646/2077 symbols completed. ETX took 1.1s. Estimated remaining: 9m 20s. Rate: 153.4 symbols/min [2025-09-23T22:19:38.979423] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:38.994100] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:38.995070] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21362 primary records. [2025-09-23T22:19:38.995400] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-23T22:19:39.027050] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:39.033532] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25080 primary records. [2025-09-23T22:19:39.035549] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-23T22:19:39.035400] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-09-23T22:19:39.035920] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-23T22:19:39.040057] [INFO ] [MAIN ] Derivative Progress: 647/2077 symbols completed. ETV took 1.1s. Estimated remaining: 9m 19s. Rate: 153.6 symbols/min [2025-09-23T22:19:39.040543] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:39.060761] [DEBUG] [LOCAL ] ETY: Loaded 22694 existing records from primary storage. [2025-09-23T22:19:39.062334] [INFO ] [MAIN ] ETY: Loaded 22694 primary data records. [2025-09-23T22:19:39.100871] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-09-23T22:19:39.113049] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-23T22:19:39.142341] [INFO ] [MAIN ] Derivative Progress: 648/2077 symbols completed. ETW took 1.2s. Estimated remaining: 9m 18s. Rate: 153.7 symbols/min [2025-09-23T22:19:39.159331] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:39.188610] [DEBUG] [LOCAL ] EVC: Loaded 19546 existing records from primary storage. [2025-09-23T22:19:39.199978] [INFO ] [MAIN ] EVC: Loaded 19546 primary data records. [2025-09-23T22:19:39.604312] [DEBUG] [LOCAL ] EVEX: Loaded 29806 existing records from primary storage. [2025-09-23T22:19:39.663087] [INFO ] [MAIN ] EVEX: Loaded 29806 primary data records. [2025-09-23T22:19:40.111924] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:40.112894] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 22694 primary records. [2025-09-23T22:19:40.113676] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-23T22:19:40.151214] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:40.153278] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 19546 primary records. [2025-09-23T22:19:40.153858] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-09-23T22:19:40.154138] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-23T22:19:40.154066] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-23T22:19:40.156621] [INFO ] [MAIN ] Derivative Progress: 649/2077 symbols completed. ETY took 1.2s. Estimated remaining: 9m 19s. Rate: 153.4 symbols/min [2025-09-23T22:19:40.158244] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:40.179307] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-09-23T22:19:40.179744] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-23T22:19:40.188334] [INFO ] [MAIN ] Derivative Progress: 650/2077 symbols completed. EVC took 1.1s. Estimated remaining: 9m 18s. Rate: 153.6 symbols/min [2025-09-23T22:19:40.184833] [DEBUG] [LOCAL ] EVF: Loaded 9163 existing records from primary storage. [2025-09-23T22:19:40.189367] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:40.189745] [INFO ] [MAIN ] EVF: Loaded 9163 primary data records. [2025-09-23T22:19:40.259886] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:40.310442] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 29806 primary records. [2025-09-23T22:19:40.310673] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-23T22:19:40.331311] [DEBUG] [LOCAL ] EVG: Loaded 5777 existing records from primary storage. [2025-09-23T22:19:40.366427] [INFO ] [MAIN ] EVG: Loaded 5777 primary data records. [2025-09-23T22:19:40.642509] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-09-23T22:19:40.643574] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-23T22:19:40.657297] [INFO ] [MAIN ] Derivative Progress: 651/2077 symbols completed. EVEX took 1.5s. Estimated remaining: 9m 17s. Rate: 153.5 symbols/min [2025-09-23T22:19:40.688608] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:40.882765] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:40.894966] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9163 primary records. [2025-09-23T22:19:40.895197] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-23T22:19:40.930223] [DEBUG] [LOCAL ] EVH: Loaded 49348 existing records from primary storage. [2025-09-23T22:19:40.930699] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-09-23T22:19:40.939105] [INFO ] [MAIN ] EVH: Loaded 49348 primary data records. [2025-09-23T22:19:40.944007] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-23T22:19:40.952627] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:40.946831] [INFO ] [MAIN ] Derivative Progress: 652/2077 symbols completed. EVF took 0.8s. Estimated remaining: 9m 17s. Rate: 153.6 symbols/min [2025-09-23T22:19:40.953527] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5777 primary records. [2025-09-23T22:19:40.960609] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-23T22:19:41.019680] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:41.265700] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-09-23T22:19:41.266162] [DEBUG] [LOCAL ] EVN: Loaded 10996 existing records from primary storage. [2025-09-23T22:19:41.275201] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-23T22:19:41.275326] [INFO ] [MAIN ] EVN: Loaded 10996 primary data records. [2025-09-23T22:19:41.278078] [INFO ] [MAIN ] Derivative Progress: 653/2077 symbols completed. EVG took 1.1s. Estimated remaining: 9m 16s. Rate: 153.6 symbols/min [2025-09-23T22:19:41.278456] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:41.654945] [DEBUG] [LOCAL ] EVR: Loaded 35659 existing records from primary storage. [2025-09-23T22:19:41.668820] [INFO ] [MAIN ] EVR: Loaded 35659 primary data records. [2025-09-23T22:19:41.690375] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:41.719567] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49348 primary records. [2025-09-23T22:19:41.757839] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-23T22:19:42.004873] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-09-23T22:19:42.005344] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-23T22:19:42.015618] [INFO ] [MAIN ] Derivative Progress: 654/2077 symbols completed. EVH took 1.3s. Estimated remaining: 9m 17s. Rate: 153.4 symbols/min [2025-09-23T22:19:42.021520] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:42.022084] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:42.022953] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10996 primary records. [2025-09-23T22:19:42.023634] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-23T22:19:42.044537] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-09-23T22:19:42.044726] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-23T22:19:42.047808] [INFO ] [MAIN ] Derivative Progress: 655/2077 symbols completed. EVN took 1.0s. Estimated remaining: 9m 15s. Rate: 153.6 symbols/min [2025-09-23T22:19:42.048616] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:42.072149] [DEBUG] [LOCAL ] EVTC: Loaded 26511 existing records from primary storage. [2025-09-23T22:19:42.080308] [INFO ] [MAIN ] EVTC: Loaded 26511 primary data records. [2025-09-23T22:19:42.085892] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:42.120743] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 35659 primary records. [2025-09-23T22:19:42.133973] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-23T22:19:42.266047] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-09-23T22:19:42.298890] [DEBUG] [LOCAL ] EVTL: Loaded 37168 existing records from primary storage. [2025-09-23T22:19:42.298039] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-23T22:19:42.301633] [INFO ] [MAIN ] Derivative Progress: 656/2077 symbols completed. EVR took 1.0s. Estimated remaining: 9m 15s. Rate: 153.7 symbols/min [2025-09-23T22:19:42.301779] [INFO ] [MAIN ] EVTL: Loaded 37168 primary data records. [2025-09-23T22:19:42.346357] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:42.779173] [DEBUG] [LOCAL ] EVTR: Loaded 23118 existing records from primary storage. [2025-09-23T22:19:42.779433] [INFO ] [MAIN ] EVTR: Loaded 23118 primary data records. [2025-09-23T22:19:42.953218] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:42.987361] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26511 primary records. [2025-09-23T22:19:42.987678] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-23T22:19:43.127834] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-09-23T22:19:43.128268] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-23T22:19:43.131396] [INFO ] [MAIN ] Derivative Progress: 657/2077 symbols completed. EVTC took 1.1s. Estimated remaining: 9m 15s. Rate: 153.4 symbols/min [2025-09-23T22:19:43.131951] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:43.151070] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:43.152846] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 37168 primary records. [2025-09-23T22:19:43.153053] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-23T22:19:43.173363] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-09-23T22:19:43.173588] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-23T22:19:43.176092] [INFO ] [MAIN ] Derivative Progress: 658/2077 symbols completed. EVTL took 1.1s. Estimated remaining: 9m 14s. Rate: 153.7 symbols/min [2025-09-23T22:19:43.194327] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:19:43.195328] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 23118 primary records. [2025-09-23T22:19:43.195696] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-23T22:19:43.243286] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-23T22:19:43.243565] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-09-23T22:19:43.243792] [INFO ] [MAIN ] EW: Loaded 53396 primary data records. [2025-09-23T22:19:43.244032] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-23T22:19:43.246926] [INFO ] [MAIN ] Derivative Progress: 659/2077 symbols completed. EVTR took 0.9s. Estimated remaining: 9m 13s. Rate: 153.8 symbols/min [2025-09-23T22:19:43.551893] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:43.552491] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53396 primary records. [2025-09-23T22:19:43.552552] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-23T22:19:43.568097] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-09-23T22:19:43.568168] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-23T22:19:43.570252] [INFO ] [MAIN ] Derivative Progress: 660/2077 symbols completed. EW took 0.4s. Estimated remaining: 9m 13s. Rate: 153.9 symbols/min [2025-09-23T22:19:43.570956] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:43.571417] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:43.571220] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:43.637951] [DEBUG] [LOCAL ] EXG: Loaded 34386 existing records from primary storage. [2025-09-23T22:19:43.637427] [DEBUG] [LOCAL ] EXP: Loaded 30120 existing records from primary storage. [2025-09-23T22:19:43.638265] [INFO ] [MAIN ] EXG: Loaded 34386 primary data records. [2025-09-23T22:19:43.638441] [INFO ] [MAIN ] EXP: Loaded 30120 primary data records. [2025-09-23T22:19:43.825052] [DEBUG] [LOCAL ] EXK: Loaded 53111 existing records from primary storage. [2025-09-23T22:19:43.849841] [INFO ] [MAIN ] EXK: Loaded 53111 primary data records. [2025-09-23T22:19:44.676521] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:44.678781] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34386 primary records. [2025-09-23T22:19:44.678965] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-23T22:19:44.708693] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:44.711239] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 30120 primary records. [2025-09-23T22:19:44.711495] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-23T22:19:44.726810] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:44.729119] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53111 primary records. [2025-09-23T22:19:44.729285] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-23T22:19:44.738481] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-09-23T22:19:44.741442] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-23T22:19:44.753135] [INFO ] [MAIN ] Derivative Progress: 661/2077 symbols completed. EXG took 1.2s. Estimated remaining: 9m 14s. Rate: 153.4 symbols/min [2025-09-23T22:19:44.756752] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:44.766107] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-09-23T22:19:44.767311] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-23T22:19:44.771064] [INFO ] [MAIN ] Derivative Progress: 662/2077 symbols completed. EXP took 1.2s. Estimated remaining: 9m 13s. Rate: 153.6 symbols/min [2025-09-23T22:19:44.771957] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:44.774973] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-09-23T22:19:44.775324] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-23T22:19:44.783951] [INFO ] [MAIN ] Derivative Progress: 663/2077 symbols completed. EXK took 1.2s. Estimated remaining: 9m 11s. Rate: 153.9 symbols/min [2025-09-23T22:19:44.784490] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:44.857753] [DEBUG] [LOCAL ] EXPD: Loaded 48158 existing records from primary storage. [2025-09-23T22:19:44.858731] [INFO ] [MAIN ] EXPD: Loaded 48158 primary data records. [2025-09-23T22:19:44.945462] [DEBUG] [LOCAL ] EXR: Loaded 45526 existing records from primary storage. [2025-09-23T22:19:44.971872] [INFO ] [MAIN ] EXR: Loaded 45526 primary data records. [2025-09-23T22:19:45.000233] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-23T22:19:45.011085] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-09-23T22:19:46.003225] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:46.004385] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 48158 primary records. [2025-09-23T22:19:46.004694] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-23T22:19:46.023748] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-09-23T22:19:46.024140] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-23T22:19:46.026523] [INFO ] [MAIN ] Derivative Progress: 664/2077 symbols completed. EXPD took 1.3s. Estimated remaining: 9m 13s. Rate: 153.3 symbols/min [2025-09-23T22:19:46.027173] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:46.047773] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:46.050228] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-09-23T22:19:46.050450] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-23T22:19:46.086616] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:46.088789] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45526 primary records. [2025-09-23T22:19:46.088881] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-23T22:19:46.108920] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-09-23T22:19:46.109052] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-23T22:19:46.112429] [INFO ] [MAIN ] Derivative Progress: 665/2077 symbols completed. EXR took 1.3s. Estimated remaining: 9m 12s. Rate: 153.5 symbols/min [2025-09-23T22:19:46.125221] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-09-23T22:19:46.125690] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-23T22:19:46.125362] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:46.128463] [INFO ] [MAIN ] Derivative Progress: 666/2077 symbols completed. F took 1.3s. Estimated remaining: 9m 11s. Rate: 153.8 symbols/min [2025-09-23T22:19:46.129474] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:46.147359] [DEBUG] [LOCAL ] FAF: Loaded 42006 existing records from primary storage. [2025-09-23T22:19:46.147856] [INFO ] [MAIN ] FAF: Loaded 42006 primary data records. [2025-09-23T22:19:46.295098] [DEBUG] [LOCAL ] FBK: Loaded 25604 existing records from primary storage. [2025-09-23T22:19:46.330484] [INFO ] [MAIN ] FBK: Loaded 25604 primary data records. [2025-09-23T22:19:46.676969] [DEBUG] [LOCAL ] FBIN: Loaded 50411 existing records from primary storage. [2025-09-23T22:19:46.718992] [INFO ] [MAIN ] FBIN: Loaded 50411 primary data records. [2025-09-23T22:19:47.227443] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:47.228914] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 42006 primary records. [2025-09-23T22:19:47.229265] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-23T22:19:47.249679] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-09-23T22:19:47.250986] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-23T22:19:47.254421] [INFO ] [MAIN ] Derivative Progress: 667/2077 symbols completed. FAF took 1.2s. Estimated remaining: 9m 12s. Rate: 153.3 symbols/min [2025-09-23T22:19:47.255508] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:47.272264] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:47.273564] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 25604 primary records. [2025-09-23T22:19:47.273966] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-23T22:19:47.296122] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-09-23T22:19:47.296305] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-23T22:19:47.312089] [INFO ] [MAIN ] Derivative Progress: 668/2077 symbols completed. FBK took 1.2s. Estimated remaining: 9m 11s. Rate: 153.5 symbols/min [2025-09-23T22:19:47.312517] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:47.313964] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50411 primary records. [2025-09-23T22:19:47.313000] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:47.314796] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-23T22:19:47.343369] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-09-23T22:19:47.343576] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-23T22:19:47.347474] [INFO ] [MAIN ] Derivative Progress: 669/2077 symbols completed. FBIN took 1.2s. Estimated remaining: 9m 10s. Rate: 153.7 symbols/min [2025-09-23T22:19:47.348011] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:47.375800] [DEBUG] [LOCAL ] FBP: Loaded 46254 existing records from primary storage. [2025-09-23T22:19:47.376222] [INFO ] [MAIN ] FBP: Loaded 46254 primary data records. [2025-09-23T22:19:47.483496] [DEBUG] [LOCAL ] FC: Loaded 15388 existing records from primary storage. [2025-09-23T22:19:47.501921] [INFO ] [MAIN ] FC: Loaded 15388 primary data records. [2025-09-23T22:19:47.626260] [DEBUG] [LOCAL ] FBRT: Loaded 34381 existing records from primary storage. [2025-09-23T22:19:47.709340] [INFO ] [MAIN ] FBRT: Loaded 34381 primary data records. [2025-09-23T22:19:48.460314] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:48.461605] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 46254 primary records. [2025-09-23T22:19:48.461855] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-23T22:19:48.491070] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-09-23T22:19:48.491193] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-23T22:19:48.493511] [INFO ] [MAIN ] Derivative Progress: 670/2077 symbols completed. FBP took 1.2s. Estimated remaining: 9m 11s. Rate: 153.3 symbols/min [2025-09-23T22:19:48.499752] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:48.500810] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:48.502302] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15388 primary records. [2025-09-23T22:19:48.502393] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-23T22:19:48.533314] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:48.535026] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 34381 primary records. [2025-09-23T22:19:48.535689] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-23T22:19:48.550544] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-09-23T22:19:48.552139] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-23T22:19:48.554579] [INFO ] [MAIN ] Derivative Progress: 671/2077 symbols completed. FC took 1.2s. Estimated remaining: 9m 10s. Rate: 153.5 symbols/min [2025-09-23T22:19:48.556415] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:48.559812] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-09-23T22:19:48.569724] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-23T22:19:48.573664] [INFO ] [MAIN ] Derivative Progress: 672/2077 symbols completed. FBRT took 1.3s. Estimated remaining: 9m 9s. Rate: 153.7 symbols/min [2025-09-23T22:19:48.574191] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:48.597503] [DEBUG] [LOCAL ] FCF: Loaded 39757 existing records from primary storage. [2025-09-23T22:19:48.597823] [INFO ] [MAIN ] FCF: Loaded 39757 primary data records. [2025-09-23T22:19:48.710351] [DEBUG] [LOCAL ] FCN: Loaded 26312 existing records from primary storage. [2025-09-23T22:19:48.722761] [INFO ] [MAIN ] FCN: Loaded 26312 primary data records. [2025-09-23T22:19:48.895134] [DEBUG] [LOCAL ] FCPT: Loaded 37424 existing records from primary storage. [2025-09-23T22:19:49.032245] [INFO ] [MAIN ] FCPT: Loaded 37424 primary data records. [2025-09-23T22:19:49.567215] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:49.568639] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39757 primary records. [2025-09-23T22:19:49.568940] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-23T22:19:49.591598] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-09-23T22:19:49.591944] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-23T22:19:49.594539] [INFO ] [MAIN ] Derivative Progress: 673/2077 symbols completed. FCF took 1.1s. Estimated remaining: 9m 9s. Rate: 153.3 symbols/min [2025-09-23T22:19:49.608828] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:49.609835] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26312 primary records. [2025-09-23T22:19:49.610004] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-23T22:19:49.638478] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:49.640015] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37424 primary records. [2025-09-23T22:19:49.640326] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-23T22:19:49.659923] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-09-23T22:19:49.660047] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-09-23T22:19:49.660262] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-23T22:19:49.660339] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-23T22:19:49.662977] [INFO ] [MAIN ] Derivative Progress: 674/2077 symbols completed. FCN took 1.1s. Estimated remaining: 9m 8s. Rate: 153.5 symbols/min [2025-09-23T22:19:49.665904] [INFO ] [MAIN ] Derivative Progress: 675/2077 symbols completed. FCPT took 1.1s. Estimated remaining: 9m 7s. Rate: 153.7 symbols/min [2025-09-23T22:19:49.666752] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:49.666944] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:49.667037] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:49.684147] [DEBUG] [LOCAL ] FCT: Loaded 14327 existing records from primary storage. [2025-09-23T22:19:49.684403] [INFO ] [MAIN ] FCT: Loaded 14327 primary data records. [2025-09-23T22:19:49.807860] [DEBUG] [LOCAL ] FDP: Loaded 30430 existing records from primary storage. [2025-09-23T22:19:49.824633] [INFO ] [MAIN ] FDP: Loaded 30430 primary data records. [2025-09-23T22:19:50.187678] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-23T22:19:50.211126] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-09-23T22:19:50.690563] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:50.692629] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14327 primary records. [2025-09-23T22:19:50.692951] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-23T22:19:50.727990] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:50.730044] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30430 primary records. [2025-09-23T22:19:50.730168] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-09-23T22:19:50.730317] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-23T22:19:50.730257] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-23T22:19:50.732573] [INFO ] [MAIN ] Derivative Progress: 676/2077 symbols completed. FCT took 1.1s. Estimated remaining: 9m 8s. Rate: 153.3 symbols/min [2025-09-23T22:19:50.733347] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:50.757276] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-09-23T22:19:50.757715] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-23T22:19:50.760403] [INFO ] [MAIN ] Derivative Progress: 677/2077 symbols completed. FDP took 1.1s. Estimated remaining: 9m 7s. Rate: 153.6 symbols/min [2025-09-23T22:19:50.773186] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:50.773557] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:50.774865] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-09-23T22:19:50.774945] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-23T22:19:50.800896] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-09-23T22:19:50.800966] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-23T22:19:50.803443] [INFO ] [MAIN ] Derivative Progress: 678/2077 symbols completed. FCX took 1.1s. Estimated remaining: 9m 6s. Rate: 153.8 symbols/min [2025-09-23T22:19:50.803853] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:50.814197] [DEBUG] [LOCAL ] FDS: Loaded 26130 existing records from primary storage. [2025-09-23T22:19:50.814500] [INFO ] [MAIN ] FDS: Loaded 26130 primary data records. [2025-09-23T22:19:51.166863] [DEBUG] [LOCAL ] FDX: Loaded 51622 existing records from primary storage. [2025-09-23T22:19:51.167723] [INFO ] [MAIN ] FDX: Loaded 51622 primary data records. [2025-09-23T22:19:51.262726] [DEBUG] [LOCAL ] FE: Loaded 53435 existing records from primary storage. [2025-09-23T22:19:51.268525] [INFO ] [MAIN ] FE: Loaded 53435 primary data records. [2025-09-23T22:19:51.818864] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:51.820611] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 26130 primary records. [2025-09-23T22:19:51.821764] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-23T22:19:51.845558] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-09-23T22:19:51.845930] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-23T22:19:51.848710] [INFO ] [MAIN ] Derivative Progress: 679/2077 symbols completed. FDS took 1.1s. Estimated remaining: 9m 7s. Rate: 153.4 symbols/min [2025-09-23T22:19:51.862471] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:51.862669] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:51.863694] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51622 primary records. [2025-09-23T22:19:51.864376] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-23T22:19:51.881771] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-09-23T22:19:51.882140] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-23T22:19:51.885250] [INFO ] [MAIN ] Derivative Progress: 680/2077 symbols completed. FDX took 1.1s. Estimated remaining: 9m 6s. Rate: 153.6 symbols/min [2025-09-23T22:19:51.886593] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:51.900991] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:19:51.901801] [INFO ] [MAIN ] FE: Generated 1793 derivative records from 53435 primary records. [2025-09-23T22:19:51.901932] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-23T22:19:51.927667] [DEBUG] [LOCAL ] FET: Loaded 12690 existing records from primary storage. [2025-09-23T22:19:51.928594] [DEBUG] [LOCAL ] FE: Derivative data saved (1793 records). [2025-09-23T22:19:51.928703] [INFO ] [MAIN ] FET: Loaded 12690 primary data records. [2025-09-23T22:19:51.928860] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-23T22:19:51.942847] [INFO ] [MAIN ] Derivative Progress: 681/2077 symbols completed. FE took 1.1s. Estimated remaining: 9m 5s. Rate: 153.8 symbols/min [2025-09-23T22:19:51.979638] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:52.096411] [DEBUG] [LOCAL ] FERG: Loaded 49033 existing records from primary storage. [2025-09-23T22:19:52.118985] [INFO ] [MAIN ] FERG: Loaded 49033 primary data records. [2025-09-23T22:19:52.362816] [DEBUG] [LOCAL ] FF: Loaded 25538 existing records from primary storage. [2025-09-23T22:19:52.371922] [INFO ] [MAIN ] FF: Loaded 25538 primary data records. [2025-09-23T22:19:52.975391] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:19:52.977016] [INFO ] [MAIN ] FET: Generated 1793 derivative records from 12690 primary records. [2025-09-23T22:19:52.977258] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-23T22:19:52.998294] [DEBUG] [LOCAL ] FET: Derivative data saved (1793 records). [2025-09-23T22:19:52.999507] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-23T22:19:53.002187] [INFO ] [MAIN ] Derivative Progress: 682/2077 symbols completed. FET took 1.1s. Estimated remaining: 9m 6s. Rate: 153.4 symbols/min [2025-09-23T22:19:53.011237] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:53.020295] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:53.021363] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 49033 primary records. [2025-09-23T22:19:53.021581] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-23T22:19:53.045200] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:53.050624] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 25538 primary records. [2025-09-23T22:19:53.054841] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-23T22:19:53.054741] [DEBUG] [LOCAL ] FFA: Loaded 5632 existing records from primary storage. [2025-09-23T22:19:53.056289] [INFO ] [MAIN ] FFA: Loaded 5632 primary data records. [2025-09-23T22:19:53.146827] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-09-23T22:19:53.171792] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-23T22:19:53.192184] [INFO ] [MAIN ] Derivative Progress: 683/2077 symbols completed. FERG took 1.3s. Estimated remaining: 9m 5s. Rate: 153.5 symbols/min [2025-09-23T22:19:53.208548] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:53.230971] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-09-23T22:19:53.253250] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-23T22:19:53.283299] [INFO ] [MAIN ] Derivative Progress: 684/2077 symbols completed. FF took 1.3s. Estimated remaining: 9m 4s. Rate: 153.7 symbols/min [2025-09-23T22:19:53.289538] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:53.430218] [DEBUG] [LOCAL ] FFC: Loaded 16600 existing records from primary storage. [2025-09-23T22:19:53.430746] [INFO ] [MAIN ] FFC: Loaded 16600 primary data records. [2025-09-23T22:19:53.583885] [DEBUG] [LOCAL ] FFWM: Loaded 36225 existing records from primary storage. [2025-09-23T22:19:53.594697] [INFO ] [MAIN ] FFWM: Loaded 36225 primary data records. [2025-09-23T22:19:53.912377] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:53.924237] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5632 primary records. [2025-09-23T22:19:53.930170] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-23T22:19:54.168867] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-09-23T22:19:54.169488] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-23T22:19:54.171498] [INFO ] [MAIN ] Derivative Progress: 685/2077 symbols completed. FFA took 1.2s. Estimated remaining: 9m 4s. Rate: 153.4 symbols/min [2025-09-23T22:19:54.172991] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:54.193181] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:54.200292] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16600 primary records. [2025-09-23T22:19:54.200612] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-23T22:19:54.223469] [DEBUG] [LOCAL ] FG: Loaded 22512 existing records from primary storage. [2025-09-23T22:19:54.224748] [INFO ] [MAIN ] FG: Loaded 22512 primary data records. [2025-09-23T22:19:54.226637] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-09-23T22:19:54.227716] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-23T22:19:54.230855] [INFO ] [MAIN ] Derivative Progress: 686/2077 symbols completed. FFC took 1.0s. Estimated remaining: 9m 3s. Rate: 153.6 symbols/min [2025-09-23T22:19:54.262334] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:54.338541] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:54.350772] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 36225 primary records. [2025-09-23T22:19:54.356205] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-23T22:19:54.402237] [DEBUG] [LOCAL ] FGN: Loaded 3923 existing records from primary storage. [2025-09-23T22:19:54.410389] [INFO ] [MAIN ] FGN: Loaded 3923 primary data records. [2025-09-23T22:19:54.755828] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-09-23T22:19:54.873267] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-23T22:19:54.876213] [INFO ] [MAIN ] Derivative Progress: 687/2077 symbols completed. FFWM took 1.6s. Estimated remaining: 9m 4s. Rate: 153.4 symbols/min [2025-09-23T22:19:54.876791] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:54.900420] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:54.901397] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22512 primary records. [2025-09-23T22:19:54.901483] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-23T22:19:54.954828] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-09-23T22:19:54.956393] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-23T22:19:54.956191] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:54.958468] [INFO ] [MAIN ] Derivative Progress: 688/2077 symbols completed. FG took 0.8s. Estimated remaining: 9m 3s. Rate: 153.6 symbols/min [2025-09-23T22:19:54.959416] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3923 primary records. [2025-09-23T22:19:54.960350] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-23T22:19:54.960228] [DEBUG] [LOCAL ] FHI: Loaded 40816 existing records from primary storage. [2025-09-23T22:19:54.960962] [INFO ] [MAIN ] FHI: Loaded 40816 primary data records. [2025-09-23T22:19:55.083028] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-09-23T22:19:55.083230] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-23T22:19:55.085897] [INFO ] [MAIN ] Derivative Progress: 689/2077 symbols completed. FGN took 0.8s. Estimated remaining: 9m 2s. Rate: 153.8 symbols/min [2025-09-23T22:19:55.300303] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:55.301045] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 40816 primary records. [2025-09-23T22:19:55.301109] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-23T22:19:55.317287] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-09-23T22:19:55.317385] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-23T22:19:55.319428] [INFO ] [MAIN ] Derivative Progress: 690/2077 symbols completed. FHI took 0.4s. Estimated remaining: 9m 1s. Rate: 153.9 symbols/min [2025-09-23T22:19:55.320146] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:55.320785] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:55.321014] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:55.345255] [DEBUG] [LOCAL ] FICO: Loaded 20466 existing records from primary storage. [2025-09-23T22:19:55.345527] [INFO ] [MAIN ] FICO: Loaded 20466 primary data records. [2025-09-23T22:19:55.712749] [DEBUG] [LOCAL ] FHN: Loaded 53369 existing records from primary storage. [2025-09-23T22:19:55.713852] [INFO ] [MAIN ] FHN: Loaded 53369 primary data records. [2025-09-23T22:19:55.714905] [DEBUG] [LOCAL ] FI: Loaded 53505 existing records from primary storage. [2025-09-23T22:19:55.728716] [INFO ] [MAIN ] FI: Loaded 53505 primary data records. [2025-09-23T22:19:56.424664] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:19:56.427140] [INFO ] [MAIN ] FICO: Generated 1793 derivative records from 20466 primary records. [2025-09-23T22:19:56.427452] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-23T22:19:56.451634] [DEBUG] [LOCAL ] FICO: Derivative data saved (1793 records). [2025-09-23T22:19:56.451916] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-23T22:19:56.455567] [INFO ] [MAIN ] Derivative Progress: 691/2077 symbols completed. FICO took 1.1s. Estimated remaining: 9m 2s. Rate: 153.4 symbols/min [2025-09-23T22:19:56.456928] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:56.488113] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:56.488568] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:56.489560] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53369 primary records. [2025-09-23T22:19:56.490454] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53505 primary records. [2025-09-23T22:19:56.490593] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-23T22:19:56.490726] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-23T22:19:56.521829] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-09-23T22:19:56.522293] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-23T22:19:56.525601] [INFO ] [MAIN ] Derivative Progress: 692/2077 symbols completed. FI took 1.2s. Estimated remaining: 9m 1s. Rate: 153.6 symbols/min [2025-09-23T22:19:56.527771] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:56.530731] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-09-23T22:19:56.530928] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-23T22:19:56.532936] [INFO ] [MAIN ] Derivative Progress: 693/2077 symbols completed. FHN took 1.2s. Estimated remaining: 8m 60s. Rate: 153.8 symbols/min [2025-09-23T22:19:56.533309] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:56.554662] [DEBUG] [LOCAL ] FINS: Loaded 8218 existing records from primary storage. [2025-09-23T22:19:56.555378] [INFO ] [MAIN ] FINS: Loaded 8218 primary data records. [2025-09-23T22:19:56.657493] [DEBUG] [LOCAL ] FIGS: Loaded 48950 existing records from primary storage. [2025-09-23T22:19:56.669031] [INFO ] [MAIN ] FIGS: Loaded 48950 primary data records. [2025-09-23T22:19:56.785026] [DEBUG] [LOCAL ] FIHL: Loaded 40370 existing records from primary storage. [2025-09-23T22:19:56.842123] [INFO ] [MAIN ] FIHL: Loaded 40370 primary data records. [2025-09-23T22:19:57.576422] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:57.581925] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8218 primary records. [2025-09-23T22:19:57.583321] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:57.584399] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-23T22:19:57.585348] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48950 primary records. [2025-09-23T22:19:57.586245] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-23T22:19:57.619024] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-09-23T22:19:57.619334] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-23T22:19:57.623320] [INFO ] [MAIN ] Derivative Progress: 694/2077 symbols completed. FIGS took 1.2s. Estimated remaining: 9m 1s. Rate: 153.4 symbols/min [2025-09-23T22:19:57.624035] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:57.623765] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-09-23T22:19:57.624775] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-23T22:19:57.626903] [INFO ] [MAIN ] Derivative Progress: 695/2077 symbols completed. FINS took 1.1s. Estimated remaining: 8m 60s. Rate: 153.6 symbols/min [2025-09-23T22:19:57.628553] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:57.643200] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:57.644056] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 40370 primary records. [2025-09-23T22:19:57.644204] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-23T22:19:57.661202] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-09-23T22:19:57.661830] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-23T22:19:57.665080] [INFO ] [MAIN ] Derivative Progress: 696/2077 symbols completed. FIHL took 1.1s. Estimated remaining: 8m 59s. Rate: 153.8 symbols/min [2025-09-23T22:19:57.665447] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:57.718551] [DEBUG] [LOCAL ] FINV: Loaded 45120 existing records from primary storage. [2025-09-23T22:19:57.718965] [INFO ] [MAIN ] FINV: Loaded 45120 primary data records. [2025-09-23T22:19:57.819342] [DEBUG] [LOCAL ] FIX: Loaded 30519 existing records from primary storage. [2025-09-23T22:19:57.820201] [DEBUG] [LOCAL ] FIS: Loaded 53366 existing records from primary storage. [2025-09-23T22:19:57.844030] [INFO ] [MAIN ] FIX: Loaded 30519 primary data records. [2025-09-23T22:19:57.847795] [INFO ] [MAIN ] FIS: Loaded 53366 primary data records. [2025-09-23T22:19:58.753466] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:58.754720] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45120 primary records. [2025-09-23T22:19:58.755115] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-23T22:19:58.788114] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:58.790365] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-09-23T22:19:58.790501] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-23T22:19:58.791901] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53366 primary records. [2025-09-23T22:19:58.794018] [INFO ] [MAIN ] Derivative Progress: 697/2077 symbols completed. FINV took 1.2s. Estimated remaining: 8m 60s. Rate: 153.4 symbols/min [2025-09-23T22:19:58.794546] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-23T22:19:58.794425] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:58.817616] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:58.824215] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 30519 primary records. [2025-09-23T22:19:58.824539] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-23T22:19:58.829833] [DEBUG] [LOCAL ] FLC: Loaded 5537 existing records from primary storage. [2025-09-23T22:19:58.830461] [INFO ] [MAIN ] FLC: Loaded 5537 primary data records. [2025-09-23T22:19:58.859020] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-09-23T22:19:58.882565] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-23T22:19:58.890322] [INFO ] [MAIN ] Derivative Progress: 698/2077 symbols completed. FIS took 1.3s. Estimated remaining: 8m 59s. Rate: 153.6 symbols/min [2025-09-23T22:19:58.931537] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:58.994937] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-09-23T22:19:59.027361] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-23T22:19:59.145510] [INFO ] [MAIN ] Derivative Progress: 699/2077 symbols completed. FIX took 1.5s. Estimated remaining: 8m 58s. Rate: 153.7 symbols/min [2025-09-23T22:19:59.154483] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:59.195089] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:19:59.195989] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5537 primary records. [2025-09-23T22:19:59.203830] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-23T22:19:59.227393] [DEBUG] [LOCAL ] FLG: Loaded 53329 existing records from primary storage. [2025-09-23T22:19:59.239315] [INFO ] [MAIN ] FLG: Loaded 53329 primary data records. [2025-09-23T22:19:59.253775] [DEBUG] [LOCAL ] FLNG: Loaded 34056 existing records from primary storage. [2025-09-23T22:19:59.273921] [INFO ] [MAIN ] FLNG: Loaded 34056 primary data records. [2025-09-23T22:19:59.393704] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-09-23T22:19:59.410960] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-23T22:19:59.444148] [INFO ] [MAIN ] Derivative Progress: 700/2077 symbols completed. FLC took 0.6s. Estimated remaining: 8m 57s. Rate: 153.7 symbols/min [2025-09-23T22:19:59.459018] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:19:59.897630] [DEBUG] [LOCAL ] FLO: Loaded 51894 existing records from primary storage. [2025-09-23T22:19:59.898253] [INFO ] [MAIN ] FLO: Loaded 51894 primary data records. [2025-09-23T22:20:00.020453] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:00.048390] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:00.037273] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53329 primary records. [2025-09-23T22:20:00.054254] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 34056 primary records. [2025-09-23T22:20:00.059477] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-23T22:20:00.064712] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-23T22:20:00.310688] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-09-23T22:20:00.311433] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-23T22:20:00.314081] [INFO ] [MAIN ] Derivative Progress: 701/2077 symbols completed. FLNG took 1.2s. Estimated remaining: 8m 58s. Rate: 153.5 symbols/min [2025-09-23T22:20:00.314626] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:00.322922] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-09-23T22:20:00.323264] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-23T22:20:00.325615] [INFO ] [MAIN ] Derivative Progress: 702/2077 symbols completed. FLG took 1.4s. Estimated remaining: 8m 57s. Rate: 153.7 symbols/min [2025-09-23T22:20:00.326823] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:00.350737] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:00.351460] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51894 primary records. [2025-09-23T22:20:00.351524] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-23T22:20:00.381671] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-09-23T22:20:00.381880] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-23T22:20:00.384178] [INFO ] [MAIN ] Derivative Progress: 703/2077 symbols completed. FLO took 0.9s. Estimated remaining: 8m 56s. Rate: 153.9 symbols/min [2025-09-23T22:20:00.411581] [DEBUG] [LOCAL ] FLR: Loaded 53120 existing records from primary storage. [2025-09-23T22:20:00.411833] [INFO ] [MAIN ] FLR: Loaded 53120 primary data records. [2025-09-23T22:20:00.532491] [DEBUG] [LOCAL ] FLS: Loaded 50186 existing records from primary storage. [2025-09-23T22:20:00.538308] [INFO ] [MAIN ] FLS: Loaded 50186 primary data records. [2025-09-23T22:20:01.086390] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:01.087457] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53120 primary records. [2025-09-23T22:20:01.087691] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-23T22:20:01.106817] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-09-23T22:20:01.107029] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-23T22:20:01.121551] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:01.121209] [INFO ] [MAIN ] Derivative Progress: 704/2077 symbols completed. FLR took 0.8s. Estimated remaining: 8m 56s. Rate: 153.7 symbols/min [2025-09-23T22:20:01.122297] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50186 primary records. [2025-09-23T22:20:01.122556] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-23T22:20:01.138443] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-09-23T22:20:01.138520] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-23T22:20:01.140752] [INFO ] [MAIN ] Derivative Progress: 705/2077 symbols completed. FLS took 0.8s. Estimated remaining: 8m 55s. Rate: 153.9 symbols/min [2025-09-23T22:20:01.141486] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:01.141598] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:01.141729] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:01.167840] [DEBUG] [LOCAL ] FLXR: Loaded 19843 existing records from primary storage. [2025-09-23T22:20:01.168074] [INFO ] [MAIN ] FLXR: Loaded 19843 primary data records. [2025-09-23T22:20:01.389689] [DEBUG] [LOCAL ] FLUT: Loaded 50884 existing records from primary storage. [2025-09-23T22:20:01.395982] [INFO ] [MAIN ] FLUT: Loaded 50884 primary data records. [2025-09-23T22:20:01.680877] [DEBUG] [LOCAL ] FMC: Loaded 51787 existing records from primary storage. [2025-09-23T22:20:01.693082] [INFO ] [MAIN ] FMC: Loaded 51787 primary data records. [2025-09-23T22:20:02.421000] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:02.423041] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 19843 primary records. [2025-09-23T22:20:02.423193] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-23T22:20:02.444939] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-09-23T22:20:02.445568] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-23T22:20:02.448511] [INFO ] [MAIN ] Derivative Progress: 706/2077 symbols completed. FLXR took 1.3s. Estimated remaining: 8m 56s. Rate: 153.4 symbols/min [2025-09-23T22:20:02.451360] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:02.472953] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:02.474462] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50884 primary records. [2025-09-23T22:20:02.478571] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-23T22:20:02.478928] [DEBUG] [LOCAL ] FMN: Loaded 6172 existing records from primary storage. [2025-09-23T22:20:02.480581] [INFO ] [MAIN ] FMN: Loaded 6172 primary data records. [2025-09-23T22:20:02.556140] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-09-23T22:20:02.598862] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-23T22:20:02.623255] [INFO ] [MAIN ] Derivative Progress: 707/2077 symbols completed. FLUT took 1.5s. Estimated remaining: 8m 56s. Rate: 153.5 symbols/min [2025-09-23T22:20:02.661042] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:02.700044] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:02.721295] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51787 primary records. [2025-09-23T22:20:02.850121] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-23T22:20:02.885839] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-09-23T22:20:02.886129] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-23T22:20:02.888311] [INFO ] [MAIN ] Derivative Progress: 708/2077 symbols completed. FMC took 1.7s. Estimated remaining: 8m 55s. Rate: 153.5 symbols/min [2025-09-23T22:20:02.888978] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:02.902200] [DEBUG] [LOCAL ] FMS: Loaded 30385 existing records from primary storage. [2025-09-23T22:20:02.902780] [INFO ] [MAIN ] FMS: Loaded 30385 primary data records. [2025-09-23T22:20:03.153624] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:03.267030] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 6172 primary records. [2025-09-23T22:20:03.288422] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-23T22:20:03.290700] [DEBUG] [LOCAL ] FMX: Loaded 40734 existing records from primary storage. [2025-09-23T22:20:03.291066] [INFO ] [MAIN ] FMX: Loaded 40734 primary data records. [2025-09-23T22:20:03.404595] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-09-23T22:20:03.424400] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-23T22:20:03.435984] [INFO ] [MAIN ] Derivative Progress: 709/2077 symbols completed. FMN took 1.0s. Estimated remaining: 8m 55s. Rate: 153.5 symbols/min [2025-09-23T22:20:03.487891] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:03.631381] [DEBUG] [LOCAL ] FMY: Loaded 1382 existing records from primary storage. [2025-09-23T22:20:03.631986] [INFO ] [MAIN ] FMY: Loaded 1382 primary data records. [2025-09-23T22:20:03.823925] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:03.837148] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30385 primary records. [2025-09-23T22:20:03.840637] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-23T22:20:04.006166] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-09-23T22:20:04.019978] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:04.019406] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-23T22:20:04.021961] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40734 primary records. [2025-09-23T22:20:04.024794] [INFO ] [MAIN ] Derivative Progress: 710/2077 symbols completed. FMS took 1.4s. Estimated remaining: 8m 55s. Rate: 153.3 symbols/min [2025-09-23T22:20:04.025020] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-23T22:20:04.025317] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:04.048957] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-09-23T22:20:04.050844] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-23T22:20:04.053186] [INFO ] [MAIN ] Derivative Progress: 711/2077 symbols completed. FMX took 1.2s. Estimated remaining: 8m 54s. Rate: 153.6 symbols/min [2025-09-23T22:20:04.061753] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:04.067259] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-09-23T22:20:04.068313] [INFO ] [MAIN ] FMY: Generated 1790 derivative records from 1382 primary records. [2025-09-23T22:20:04.068499] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-23T22:20:04.091730] [DEBUG] [LOCAL ] FMY: Derivative data saved (1790 records). [2025-09-23T22:20:04.091882] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-23T22:20:04.094140] [INFO ] [MAIN ] Derivative Progress: 712/2077 symbols completed. FMY took 0.6s. Estimated remaining: 8m 53s. Rate: 153.7 symbols/min [2025-09-23T22:20:04.095210] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:04.108988] [DEBUG] [LOCAL ] FN: Loaded 39497 existing records from primary storage. [2025-09-23T22:20:04.109260] [INFO ] [MAIN ] FN: Loaded 39497 primary data records. [2025-09-23T22:20:04.469836] [DEBUG] [LOCAL ] FNB: Loaded 52450 existing records from primary storage. [2025-09-23T22:20:04.484402] [INFO ] [MAIN ] FNB: Loaded 52450 primary data records. [2025-09-23T22:20:04.506546] [DEBUG] [LOCAL ] FND: Loaded 52147 existing records from primary storage. [2025-09-23T22:20:04.523032] [INFO ] [MAIN ] FND: Loaded 52147 primary data records. [2025-09-23T22:20:05.218409] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:05.220190] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 39497 primary records. [2025-09-23T22:20:05.220292] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-23T22:20:05.240789] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-09-23T22:20:05.241037] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-23T22:20:05.243543] [INFO ] [MAIN ] Derivative Progress: 713/2077 symbols completed. FN took 1.2s. Estimated remaining: 8m 54s. Rate: 153.3 symbols/min [2025-09-23T22:20:05.244147] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:05.266031] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:05.279266] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:05.279006] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52147 primary records. [2025-09-23T22:20:05.279962] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52450 primary records. [2025-09-23T22:20:05.280127] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-23T22:20:05.280073] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-23T22:20:05.312478] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-09-23T22:20:05.312027] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-09-23T22:20:05.312584] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-23T22:20:05.312684] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-23T22:20:05.314517] [INFO ] [MAIN ] Derivative Progress: 714/2077 symbols completed. FNB took 1.3s. Estimated remaining: 8m 53s. Rate: 153.5 symbols/min [2025-09-23T22:20:05.328161] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:05.328225] [INFO ] [MAIN ] Derivative Progress: 715/2077 symbols completed. FND took 1.2s. Estimated remaining: 8m 52s. Rate: 153.7 symbols/min [2025-09-23T22:20:05.329311] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:05.349297] [DEBUG] [LOCAL ] FNF: Loaded 49223 existing records from primary storage. [2025-09-23T22:20:05.349607] [INFO ] [MAIN ] FNF: Loaded 49223 primary data records. [2025-09-23T22:20:05.434625] [DEBUG] [LOCAL ] FOA: Loaded 13184 existing records from primary storage. [2025-09-23T22:20:05.446174] [INFO ] [MAIN ] FOA: Loaded 13184 primary data records. [2025-09-23T22:20:05.784084] [DEBUG] [LOCAL ] FNV: Loaded 46430 existing records from primary storage. [2025-09-23T22:20:05.825793] [INFO ] [MAIN ] FNV: Loaded 46430 primary data records. [2025-09-23T22:20:06.342139] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:06.343689] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 49223 primary records. [2025-09-23T22:20:06.343793] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-23T22:20:06.358470] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:06.368152] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13184 primary records. [2025-09-23T22:20:06.368248] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-23T22:20:06.392620] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-09-23T22:20:06.393688] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-23T22:20:06.409134] [INFO ] [MAIN ] Derivative Progress: 716/2077 symbols completed. FOA took 1.1s. Estimated remaining: 8m 53s. Rate: 153.3 symbols/min [2025-09-23T22:20:06.410781] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:06.412346] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-09-23T22:20:06.412509] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-23T22:20:06.414526] [INFO ] [MAIN ] Derivative Progress: 717/2077 symbols completed. FNF took 1.2s. Estimated remaining: 8m 51s. Rate: 153.5 symbols/min [2025-09-23T22:20:06.411842] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:06.415866] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46430 primary records. [2025-09-23T22:20:06.416181] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-23T22:20:06.416511] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:06.443045] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-09-23T22:20:06.443206] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-23T22:20:06.442904] [DEBUG] [LOCAL ] FOF: Loaded 8395 existing records from primary storage. [2025-09-23T22:20:06.445585] [INFO ] [MAIN ] Derivative Progress: 718/2077 symbols completed. FNV took 1.1s. Estimated remaining: 8m 50s. Rate: 153.7 symbols/min [2025-09-23T22:20:06.445958] [INFO ] [MAIN ] FOF: Loaded 8395 primary data records. [2025-09-23T22:20:06.571833] [DEBUG] [LOCAL ] FOR: Loaded 20132 existing records from primary storage. [2025-09-23T22:20:06.577748] [INFO ] [MAIN ] FOR: Loaded 20132 primary data records. [2025-09-23T22:20:07.180389] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:07.181952] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8395 primary records. [2025-09-23T22:20:07.182023] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-23T22:20:07.198791] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-09-23T22:20:07.198929] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-23T22:20:07.201127] [INFO ] [MAIN ] Derivative Progress: 719/2077 symbols completed. FOF took 0.8s. Estimated remaining: 8m 51s. Rate: 153.5 symbols/min [2025-09-23T22:20:07.222573] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:07.223205] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 20132 primary records. [2025-09-23T22:20:07.223265] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-23T22:20:07.238979] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-09-23T22:20:07.239055] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-23T22:20:07.241301] [INFO ] [MAIN ] Derivative Progress: 720/2077 symbols completed. FOR took 0.8s. Estimated remaining: 8m 50s. Rate: 153.7 symbols/min [2025-09-23T22:20:07.241944] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:07.241819] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:07.242487] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:07.276114] [DEBUG] [LOCAL ] FPF: Loaded 17613 existing records from primary storage. [2025-09-23T22:20:07.278128] [INFO ] [MAIN ] FPF: Loaded 17613 primary data records. [2025-09-23T22:20:07.277889] [DEBUG] [LOCAL ] FPH: Loaded 19740 existing records from primary storage. [2025-09-23T22:20:07.309819] [INFO ] [MAIN ] FPH: Loaded 19740 primary data records. [2025-09-23T22:20:07.658847] [DEBUG] [LOCAL ] FOUR: Loaded 49524 existing records from primary storage. [2025-09-23T22:20:07.822725] [INFO ] [MAIN ] FOUR: Loaded 49524 primary data records. [2025-09-23T22:20:08.329802] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:08.330344] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:08.331463] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 17613 primary records. [2025-09-23T22:20:08.332417] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19740 primary records. [2025-09-23T22:20:08.332533] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-23T22:20:08.332607] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-23T22:20:08.364139] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-09-23T22:20:08.364913] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-23T22:20:08.367722] [INFO ] [MAIN ] Derivative Progress: 721/2077 symbols completed. FPH took 1.1s. Estimated remaining: 8m 51s. Rate: 153.3 symbols/min [2025-09-23T22:20:08.368944] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:08.376386] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-09-23T22:20:08.377228] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-23T22:20:08.380283] [INFO ] [MAIN ] Derivative Progress: 722/2077 symbols completed. FPF took 1.1s. Estimated remaining: 8m 50s. Rate: 153.5 symbols/min [2025-09-23T22:20:08.380681] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:08.394761] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:08.395529] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49524 primary records. [2025-09-23T22:20:08.395800] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-23T22:20:08.425883] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-09-23T22:20:08.426040] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-23T22:20:08.428346] [INFO ] [MAIN ] Derivative Progress: 723/2077 symbols completed. FOUR took 1.2s. Estimated remaining: 8m 48s. Rate: 153.7 symbols/min [2025-09-23T22:20:08.428749] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:08.444552] [DEBUG] [LOCAL ] FPI: Loaded 31151 existing records from primary storage. [2025-09-23T22:20:08.444841] [INFO ] [MAIN ] FPI: Loaded 31151 primary data records. [2025-09-23T22:20:08.597090] [DEBUG] [LOCAL ] FRA: Loaded 14584 existing records from primary storage. [2025-09-23T22:20:08.597349] [INFO ] [MAIN ] FRA: Loaded 14584 primary data records. [2025-09-23T22:20:08.772351] [DEBUG] [LOCAL ] FR: Loaded 46597 existing records from primary storage. [2025-09-23T22:20:08.952083] [INFO ] [MAIN ] FR: Loaded 46597 primary data records. [2025-09-23T22:20:09.528077] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:09.529024] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31151 primary records. [2025-09-23T22:20:09.529245] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-23T22:20:09.562676] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:09.564343] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14584 primary records. [2025-09-23T22:20:09.565245] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-23T22:20:09.576980] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-09-23T22:20:09.580093] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-23T22:20:09.583018] [INFO ] [MAIN ] Derivative Progress: 724/2077 symbols completed. FPI took 1.2s. Estimated remaining: 8m 50s. Rate: 153.3 symbols/min [2025-09-23T22:20:09.583307] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:09.604433] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-09-23T22:20:09.604352] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:09.604620] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-23T22:20:09.605562] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46597 primary records. [2025-09-23T22:20:09.612715] [INFO ] [MAIN ] Derivative Progress: 725/2077 symbols completed. FRA took 1.2s. Estimated remaining: 8m 48s. Rate: 153.5 symbols/min [2025-09-23T22:20:09.613173] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:09.613264] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-23T22:20:09.633245] [DEBUG] [LOCAL ] FRGE: Loaded 18585 existing records from primary storage. [2025-09-23T22:20:09.634881] [INFO ] [MAIN ] FRGE: Loaded 18585 primary data records. [2025-09-23T22:20:09.712685] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-09-23T22:20:09.734542] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-23T22:20:09.737091] [INFO ] [MAIN ] Derivative Progress: 726/2077 symbols completed. FR took 1.4s. Estimated remaining: 8m 48s. Rate: 153.6 symbols/min [2025-09-23T22:20:09.748142] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:09.970438] [DEBUG] [LOCAL ] FRO: Loaded 51894 existing records from primary storage. [2025-09-23T22:20:09.971388] [INFO ] [MAIN ] FRO: Loaded 51894 primary data records. [2025-09-23T22:20:10.308543] [DEBUG] [LOCAL ] FRT: Loaded 42360 existing records from primary storage. [2025-09-23T22:20:10.309601] [INFO ] [MAIN ] FRT: Loaded 42360 primary data records. [2025-09-23T22:20:10.514854] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:10.619149] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 18585 primary records. [2025-09-23T22:20:10.633016] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-23T22:20:10.652013] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-09-23T22:20:10.653580] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-23T22:20:10.656500] [INFO ] [MAIN ] Derivative Progress: 727/2077 symbols completed. FRGE took 1.1s. Estimated remaining: 8m 48s. Rate: 153.4 symbols/min [2025-09-23T22:20:10.657197] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:10.673338] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:10.674252] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51894 primary records. [2025-09-23T22:20:10.674431] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-23T22:20:10.693634] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-09-23T22:20:10.694460] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-23T22:20:10.700873] [INFO ] [MAIN ] Derivative Progress: 728/2077 symbols completed. FRO took 1.1s. Estimated remaining: 8m 47s. Rate: 153.5 symbols/min [2025-09-23T22:20:10.701449] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:10.723861] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:10.724924] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 42360 primary records. [2025-09-23T22:20:10.725186] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-23T22:20:10.752319] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-09-23T22:20:10.753055] [DEBUG] [LOCAL ] FSCO: Loaded 36851 existing records from primary storage. [2025-09-23T22:20:10.752471] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-23T22:20:10.755479] [INFO ] [MAIN ] Derivative Progress: 729/2077 symbols completed. FRT took 1.0s. Estimated remaining: 8m 46s. Rate: 153.7 symbols/min [2025-09-23T22:20:10.755928] [INFO ] [MAIN ] FSCO: Loaded 36851 primary data records. [2025-09-23T22:20:10.755850] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:11.124279] [DEBUG] [LOCAL ] FSK: Loaded 49398 existing records from primary storage. [2025-09-23T22:20:11.135496] [INFO ] [MAIN ] FSK: Loaded 49398 primary data records. [2025-09-23T22:20:11.202358] [DEBUG] [LOCAL ] FSLY: Loaded 51274 existing records from primary storage. [2025-09-23T22:20:11.242707] [INFO ] [MAIN ] FSLY: Loaded 51274 primary data records. [2025-09-23T22:20:11.796971] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:11.798295] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 36851 primary records. [2025-09-23T22:20:11.798428] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-23T22:20:11.819899] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-09-23T22:20:11.832530] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-23T22:20:11.835589] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:11.836518] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49398 primary records. [2025-09-23T22:20:11.836612] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-23T22:20:11.835259] [INFO ] [MAIN ] Derivative Progress: 730/2077 symbols completed. FSCO took 1.2s. Estimated remaining: 8m 47s. Rate: 153.4 symbols/min [2025-09-23T22:20:11.845501] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:11.866253] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-09-23T22:20:11.871953] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-23T22:20:11.871865] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:11.874947] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51274 primary records. [2025-09-23T22:20:11.875154] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-23T22:20:11.873885] [INFO ] [MAIN ] Derivative Progress: 731/2077 symbols completed. FSK took 1.2s. Estimated remaining: 8m 46s. Rate: 153.5 symbols/min [2025-09-23T22:20:11.875366] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:11.894169] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-09-23T22:20:11.894476] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-23T22:20:11.897187] [INFO ] [MAIN ] Derivative Progress: 732/2077 symbols completed. FSLY took 1.1s. Estimated remaining: 8m 45s. Rate: 153.7 symbols/min [2025-09-23T22:20:11.897560] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:11.925054] [DEBUG] [LOCAL ] FT: Loaded 6291 existing records from primary storage. [2025-09-23T22:20:11.925208] [INFO ] [MAIN ] FT: Loaded 6291 primary data records. [2025-09-23T22:20:12.066405] [DEBUG] [LOCAL ] FSS: Loaded 34552 existing records from primary storage. [2025-09-23T22:20:12.084446] [DEBUG] [LOCAL ] FSM: Loaded 53288 existing records from primary storage. [2025-09-23T22:20:12.108424] [INFO ] [MAIN ] FSS: Loaded 34552 primary data records. [2025-09-23T22:20:12.133859] [INFO ] [MAIN ] FSM: Loaded 53288 primary data records. [2025-09-23T22:20:12.969553] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:12.972812] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6291 primary records. [2025-09-23T22:20:12.973065] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-23T22:20:12.989997] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-09-23T22:20:12.990208] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-23T22:20:12.992338] [INFO ] [MAIN ] Derivative Progress: 733/2077 symbols completed. FT took 1.1s. Estimated remaining: 8m 46s. Rate: 153.4 symbols/min [2025-09-23T22:20:13.024443] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:13.024698] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:13.025590] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53288 primary records. [2025-09-23T22:20:13.026432] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 34552 primary records. [2025-09-23T22:20:13.026601] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-23T22:20:13.026531] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-23T22:20:13.059578] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-09-23T22:20:13.060141] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-23T22:20:13.060390] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-09-23T22:20:13.060526] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-23T22:20:13.063506] [INFO ] [MAIN ] Derivative Progress: 734/2077 symbols completed. FSM took 1.2s. Estimated remaining: 8m 45s. Rate: 153.5 symbols/min [2025-09-23T22:20:13.066304] [INFO ] [MAIN ] Derivative Progress: 735/2077 symbols completed. FSS took 1.2s. Estimated remaining: 8m 44s. Rate: 153.7 symbols/min [2025-09-23T22:20:13.067778] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:13.068041] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:13.068571] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:13.081764] [DEBUG] [LOCAL ] FTHY: Loaded 11693 existing records from primary storage. [2025-09-23T22:20:13.082016] [INFO ] [MAIN ] FTHY: Loaded 11693 primary data records. [2025-09-23T22:20:13.247168] [DEBUG] [LOCAL ] FTK: Loaded 32220 existing records from primary storage. [2025-09-23T22:20:13.264898] [INFO ] [MAIN ] FTK: Loaded 32220 primary data records. [2025-09-23T22:20:13.547583] [DEBUG] [LOCAL ] FTI: Loaded 53303 existing records from primary storage. [2025-09-23T22:20:13.559959] [INFO ] [MAIN ] FTI: Loaded 53303 primary data records. [2025-09-23T22:20:14.103608] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:14.105922] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 11693 primary records. [2025-09-23T22:20:14.106569] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-23T22:20:14.128027] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-09-23T22:20:14.128471] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-23T22:20:14.130977] [INFO ] [MAIN ] Derivative Progress: 736/2077 symbols completed. FTHY took 1.1s. Estimated remaining: 8m 45s. Rate: 153.4 symbols/min [2025-09-23T22:20:14.131195] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:14.149308] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:14.150157] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32220 primary records. [2025-09-23T22:20:14.150401] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-23T22:20:14.178869] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:14.180199] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53303 primary records. [2025-09-23T22:20:14.180527] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-23T22:20:14.192007] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-09-23T22:20:14.194593] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-23T22:20:14.199900] [INFO ] [MAIN ] Derivative Progress: 737/2077 symbols completed. FTK took 1.1s. Estimated remaining: 8m 44s. Rate: 153.6 symbols/min [2025-09-23T22:20:14.200220] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:14.211054] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-09-23T22:20:14.211334] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-23T22:20:14.213861] [INFO ] [MAIN ] Derivative Progress: 738/2077 symbols completed. FTI took 1.1s. Estimated remaining: 8m 43s. Rate: 153.8 symbols/min [2025-09-23T22:20:14.214252] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:14.218298] [DEBUG] [LOCAL ] FTWO: Loaded 1776 existing records from primary storage. [2025-09-23T22:20:14.229570] [INFO ] [MAIN ] FTWO: Loaded 1776 primary data records. [2025-09-23T22:20:14.268278] [DEBUG] [LOCAL ] FTS: Loaded 42123 existing records from primary storage. [2025-09-23T22:20:14.296583] [INFO ] [MAIN ] FTS: Loaded 42123 primary data records. [2025-09-23T22:20:14.908334] [DEBUG] [LOCAL ] FTV: Loaded 52917 existing records from primary storage. [2025-09-23T22:20:14.909145] [INFO ] [MAIN ] FTV: Loaded 52917 primary data records. [2025-09-23T22:20:15.257538] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:20:15.259306] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1776 primary records. [2025-09-23T22:20:15.259497] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-23T22:20:15.285541] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:15.288404] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42123 primary records. [2025-09-23T22:20:15.289417] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-23T22:20:15.291661] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-09-23T22:20:15.300222] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-23T22:20:15.302589] [INFO ] [MAIN ] Derivative Progress: 739/2077 symbols completed. FTWO took 1.1s. Estimated remaining: 8m 43s. Rate: 153.4 symbols/min [2025-09-23T22:20:15.306348] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:15.311294] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-09-23T22:20:15.311915] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-23T22:20:15.314400] [INFO ] [MAIN ] Derivative Progress: 740/2077 symbols completed. FTS took 1.2s. Estimated remaining: 8m 42s. Rate: 153.6 symbols/min [2025-09-23T22:20:15.316061] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:15.332587] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:15.333402] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52917 primary records. [2025-09-23T22:20:15.333673] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-23T22:20:15.351702] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-09-23T22:20:15.351780] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-23T22:20:15.354166] [INFO ] [MAIN ] Derivative Progress: 741/2077 symbols completed. FTV took 1.2s. Estimated remaining: 8m 41s. Rate: 153.8 symbols/min [2025-09-23T22:20:15.354686] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:15.391731] [DEBUG] [LOCAL ] FUL: Loaded 32980 existing records from primary storage. [2025-09-23T22:20:15.391958] [INFO ] [MAIN ] FUL: Loaded 32980 primary data records. [2025-09-23T22:20:15.519276] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-23T22:20:15.559632] [INFO ] [MAIN ] FUBO: Loaded 53700 primary data records. [2025-09-23T22:20:15.856158] [DEBUG] [LOCAL ] FUN: Loaded 51566 existing records from primary storage. [2025-09-23T22:20:15.864140] [INFO ] [MAIN ] FUN: Loaded 51566 primary data records. [2025-09-23T22:20:16.412583] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:16.414249] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32980 primary records. [2025-09-23T22:20:16.414384] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-23T22:20:16.432633] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-09-23T22:20:16.433362] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-23T22:20:16.440891] [INFO ] [MAIN ] Derivative Progress: 742/2077 symbols completed. FUL took 1.1s. Estimated remaining: 8m 42s. Rate: 153.4 symbols/min [2025-09-23T22:20:16.441590] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:16.456448] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:16.457365] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53700 primary records. [2025-09-23T22:20:16.457550] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-23T22:20:16.493121] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:16.494530] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51566 primary records. [2025-09-23T22:20:16.502364] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-09-23T22:20:16.502503] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-23T22:20:16.501479] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-23T22:20:16.505379] [INFO ] [MAIN ] Derivative Progress: 743/2077 symbols completed. FUBO took 1.2s. Estimated remaining: 8m 41s. Rate: 153.6 symbols/min [2025-09-23T22:20:16.506465] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:16.505991] [DEBUG] [LOCAL ] FVR: Loaded 22125 existing records from primary storage. [2025-09-23T22:20:16.506905] [INFO ] [MAIN ] FVR: Loaded 22125 primary data records. [2025-09-23T22:20:16.627488] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-09-23T22:20:16.639629] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-23T22:20:16.642405] [INFO ] [MAIN ] Derivative Progress: 744/2077 symbols completed. FUN took 1.3s. Estimated remaining: 8m 40s. Rate: 153.7 symbols/min [2025-09-23T22:20:16.648851] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:16.853597] [DEBUG] [LOCAL ] FXED: Loaded 1225 existing records from primary storage. [2025-09-23T22:20:16.853831] [INFO ] [MAIN ] FXED: Loaded 1225 primary data records. [2025-09-23T22:20:16.854806] [DEBUG] [LOCAL ] FVRR: Loaded 40210 existing records from primary storage. [2025-09-23T22:20:16.867618] [INFO ] [MAIN ] FVRR: Loaded 40210 primary data records. [2025-09-23T22:20:17.527076] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:17.528129] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 22125 primary records. [2025-09-23T22:20:17.528311] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-23T22:20:17.545972] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-09-23T22:20:17.546059] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-23T22:20:17.548208] [INFO ] [MAIN ] Derivative Progress: 745/2077 symbols completed. FVR took 1.1s. Estimated remaining: 8m 41s. Rate: 153.4 symbols/min [2025-09-23T22:20:17.548466] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:17.565623] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:17.568778] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40210 primary records. [2025-09-23T22:20:17.569018] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-23T22:20:17.593924] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:20:17.594986] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1225 primary records. [2025-09-23T22:20:17.595516] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-23T22:20:17.613131] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-09-23T22:20:17.613054] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-09-23T22:20:17.613242] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-23T22:20:17.613394] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-23T22:20:17.615878] [INFO ] [MAIN ] Derivative Progress: 746/2077 symbols completed. FVRR took 1.1s. Estimated remaining: 8m 40s. Rate: 153.6 symbols/min [2025-09-23T22:20:17.616283] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:17.618847] [INFO ] [MAIN ] Derivative Progress: 747/2077 symbols completed. FXED took 1.0s. Estimated remaining: 8m 39s. Rate: 153.8 symbols/min [2025-09-23T22:20:17.619077] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:17.636891] [DEBUG] [LOCAL ] GAM: Loaded 4195 existing records from primary storage. [2025-09-23T22:20:17.637017] [INFO ] [MAIN ] GAM: Loaded 4195 primary data records. [2025-09-23T22:20:17.765856] [DEBUG] [LOCAL ] G: Loaded 49763 existing records from primary storage. [2025-09-23T22:20:17.771747] [INFO ] [MAIN ] G: Loaded 49763 primary data records. [2025-09-23T22:20:18.071246] [DEBUG] [LOCAL ] GAB: Loaded 27947 existing records from primary storage. [2025-09-23T22:20:18.084859] [INFO ] [MAIN ] GAB: Loaded 27947 primary data records. [2025-09-23T22:20:18.628257] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:18.629199] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4195 primary records. [2025-09-23T22:20:18.629477] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-23T22:20:18.659723] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:18.660803] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49763 primary records. [2025-09-23T22:20:18.661024] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-23T22:20:18.679996] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-09-23T22:20:18.680693] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-23T22:20:18.683082] [INFO ] [MAIN ] Derivative Progress: 748/2077 symbols completed. GAM took 1.1s. Estimated remaining: 8m 40s. Rate: 153.5 symbols/min [2025-09-23T22:20:18.685594] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-09-23T22:20:18.687440] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-23T22:20:18.689944] [INFO ] [MAIN ] Derivative Progress: 749/2077 symbols completed. G took 1.1s. Estimated remaining: 8m 39s. Rate: 153.7 symbols/min [2025-09-23T22:20:18.703196] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:18.703883] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27947 primary records. [2025-09-23T22:20:18.703947] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-23T22:20:18.719909] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-09-23T22:20:18.719987] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-23T22:20:18.722531] [INFO ] [MAIN ] Derivative Progress: 750/2077 symbols completed. GAB took 1.1s. Estimated remaining: 8m 38s. Rate: 153.8 symbols/min [2025-09-23T22:20:18.723304] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:18.723228] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:18.723380] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:18.744361] [DEBUG] [LOCAL ] GBAB: Loaded 13017 existing records from primary storage. [2025-09-23T22:20:18.744499] [INFO ] [MAIN ] GBAB: Loaded 13017 primary data records. [2025-09-23T22:20:18.833931] [DEBUG] [LOCAL ] GATX: Loaded 18146 existing records from primary storage. [2025-09-23T22:20:18.855628] [INFO ] [MAIN ] GATX: Loaded 18146 primary data records. [2025-09-23T22:20:19.282930] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-23T22:20:19.294161] [INFO ] [MAIN ] GAP: Loaded 53655 primary data records. [2025-09-23T22:20:19.805797] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:19.815123] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 13017 primary records. [2025-09-23T22:20:19.822379] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:19.823603] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18146 primary records. [2025-09-23T22:20:19.823910] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-23T22:20:19.822081] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-23T22:20:19.857357] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-09-23T22:20:19.859576] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-23T22:20:19.862141] [INFO ] [MAIN ] Derivative Progress: 751/2077 symbols completed. GBAB took 1.1s. Estimated remaining: 8m 38s. Rate: 153.5 symbols/min [2025-09-23T22:20:19.865322] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:19.867812] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-09-23T22:20:19.868132] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-23T22:20:19.870806] [INFO ] [MAIN ] Derivative Progress: 752/2077 symbols completed. GATX took 1.1s. Estimated remaining: 8m 37s. Rate: 153.7 symbols/min [2025-09-23T22:20:19.884243] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:19.884596] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:19.886091] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53655 primary records. [2025-09-23T22:20:19.886298] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-23T22:20:19.904955] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-09-23T22:20:19.905092] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-23T22:20:19.909233] [INFO ] [MAIN ] Derivative Progress: 753/2077 symbols completed. GAP took 1.2s. Estimated remaining: 8m 36s. Rate: 153.8 symbols/min [2025-09-23T22:20:19.909726] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:19.963569] [DEBUG] [LOCAL ] GBTG: Loaded 40353 existing records from primary storage. [2025-09-23T22:20:19.963777] [INFO ] [MAIN ] GBTG: Loaded 40353 primary data records. [2025-09-23T22:20:19.964742] [DEBUG] [LOCAL ] GBCI: Loaded 40099 existing records from primary storage. [2025-09-23T22:20:19.976225] [INFO ] [MAIN ] GBCI: Loaded 40099 primary data records. [2025-09-23T22:20:20.265016] [DEBUG] [LOCAL ] GBX: Loaded 29268 existing records from primary storage. [2025-09-23T22:20:20.298914] [INFO ] [MAIN ] GBX: Loaded 29268 primary data records. [2025-09-23T22:20:21.012823] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:21.021284] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40353 primary records. [2025-09-23T22:20:21.026208] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-23T22:20:21.027180] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:21.028113] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40099 primary records. [2025-09-23T22:20:21.028206] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-23T22:20:21.060255] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-09-23T22:20:21.060599] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-23T22:20:21.063521] [INFO ] [MAIN ] Derivative Progress: 754/2077 symbols completed. GBCI took 1.2s. Estimated remaining: 8m 37s. Rate: 153.4 symbols/min [2025-09-23T22:20:21.064517] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:21.075187] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-09-23T22:20:21.080214] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-23T22:20:21.080627] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:21.083858] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29268 primary records. [2025-09-23T22:20:21.083982] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-23T22:20:21.082909] [INFO ] [MAIN ] Derivative Progress: 755/2077 symbols completed. GBTG took 1.2s. Estimated remaining: 8m 36s. Rate: 153.6 symbols/min [2025-09-23T22:20:21.084503] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:21.102636] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-09-23T22:20:21.102748] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-23T22:20:21.105452] [INFO ] [MAIN ] Derivative Progress: 756/2077 symbols completed. GBX took 1.2s. Estimated remaining: 8m 35s. Rate: 153.8 symbols/min [2025-09-23T22:20:21.105899] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:21.141378] [DEBUG] [LOCAL ] GCO: Loaded 25688 existing records from primary storage. [2025-09-23T22:20:21.141732] [INFO ] [MAIN ] GCO: Loaded 25688 primary data records. [2025-09-23T22:20:21.211898] [DEBUG] [LOCAL ] GCTS: Loaded 19810 existing records from primary storage. [2025-09-23T22:20:21.212562] [DEBUG] [LOCAL ] GCI: Loaded 44222 existing records from primary storage. [2025-09-23T22:20:21.235970] [INFO ] [MAIN ] GCI: Loaded 44222 primary data records. [2025-09-23T22:20:21.235853] [INFO ] [MAIN ] GCTS: Loaded 19810 primary data records. [2025-09-23T22:20:22.157216] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:22.171953] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44222 primary records. [2025-09-23T22:20:22.172373] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-23T22:20:22.172665] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:22.174308] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 25688 primary records. [2025-09-23T22:20:22.200282] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-23T22:20:22.197408] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:22.202758] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 19810 primary records. [2025-09-23T22:20:22.204407] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-23T22:20:22.235833] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-09-23T22:20:22.236691] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-23T22:20:22.239851] [INFO ] [MAIN ] Derivative Progress: 757/2077 symbols completed. GCI took 1.2s. Estimated remaining: 8m 36s. Rate: 153.4 symbols/min [2025-09-23T22:20:22.243512] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:22.242158] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-09-23T22:20:22.245415] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-09-23T22:20:22.244861] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-23T22:20:22.248187] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-23T22:20:22.248082] [INFO ] [MAIN ] Derivative Progress: 758/2077 symbols completed. GCTS took 1.1s. Estimated remaining: 8m 35s. Rate: 153.6 symbols/min [2025-09-23T22:20:22.251001] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:22.251201] [INFO ] [MAIN ] Derivative Progress: 759/2077 symbols completed. GCO took 1.2s. Estimated remaining: 8m 34s. Rate: 153.8 symbols/min [2025-09-23T22:20:22.251857] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:22.259419] [DEBUG] [LOCAL ] GCV: Loaded 7128 existing records from primary storage. [2025-09-23T22:20:22.259603] [INFO ] [MAIN ] GCV: Loaded 7128 primary data records. [2025-09-23T22:20:22.626568] [DEBUG] [LOCAL ] GDDY: Loaded 49746 existing records from primary storage. [2025-09-23T22:20:22.640276] [INFO ] [MAIN ] GDDY: Loaded 49746 primary data records. [2025-09-23T22:20:22.702084] [DEBUG] [LOCAL ] GD: Loaded 47274 existing records from primary storage. [2025-09-23T22:20:22.717366] [INFO ] [MAIN ] GD: Loaded 47274 primary data records. [2025-09-23T22:20:23.359925] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:23.361613] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7128 primary records. [2025-09-23T22:20:23.362483] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-23T22:20:23.380612] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-09-23T22:20:23.380840] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-23T22:20:23.383526] [INFO ] [MAIN ] Derivative Progress: 760/2077 symbols completed. GCV took 1.1s. Estimated remaining: 8m 35s. Rate: 153.5 symbols/min [2025-09-23T22:20:23.384077] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:23.406125] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:23.407149] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49746 primary records. [2025-09-23T22:20:23.410580] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-23T22:20:23.410470] [DEBUG] [LOCAL ] GDIV: Loaded 3705 existing records from primary storage. [2025-09-23T22:20:23.410871] [INFO ] [MAIN ] GDIV: Loaded 3705 primary data records. [2025-09-23T22:20:23.576126] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-09-23T22:20:23.581622] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:23.592122] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-23T22:20:23.597990] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47274 primary records. [2025-09-23T22:20:23.603391] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-23T22:20:23.616056] [INFO ] [MAIN ] Derivative Progress: 761/2077 symbols completed. GDDY took 1.4s. Estimated remaining: 8m 34s. Rate: 153.5 symbols/min [2025-09-23T22:20:23.621956] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:23.837545] [DEBUG] [LOCAL ] GDL: Loaded 2482 existing records from primary storage. [2025-09-23T22:20:23.838835] [INFO ] [MAIN ] GDL: Loaded 2482 primary data records. [2025-09-23T22:20:23.941336] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-09-23T22:20:23.972099] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-23T22:20:23.992300] [INFO ] [MAIN ] Derivative Progress: 762/2077 symbols completed. GD took 1.7s. Estimated remaining: 8m 34s. Rate: 153.5 symbols/min [2025-09-23T22:20:23.999146] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:24.244982] [DEBUG] [LOCAL ] GDO: Loaded 6025 existing records from primary storage. [2025-09-23T22:20:24.252001] [INFO ] [MAIN ] GDO: Loaded 6025 primary data records. [2025-09-23T22:20:24.310532] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:20:24.336992] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3705 primary records. [2025-09-23T22:20:24.404005] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-23T22:20:24.592850] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-09-23T22:20:24.593790] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-09-23T22:20:24.612859] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-23T22:20:24.615547] [INFO ] [MAIN ] Derivative Progress: 763/2077 symbols completed. GDIV took 1.2s. Estimated remaining: 8m 34s. Rate: 153.4 symbols/min [2025-09-23T22:20:24.600577] [INFO ] [MAIN ] GDL: Generated 1790 derivative records from 2482 primary records. [2025-09-23T22:20:24.622321] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-23T22:20:24.791060] [DEBUG] [LOCAL ] GDL: Derivative data saved (1790 records). [2025-09-23T22:20:24.791234] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-23T22:20:24.794817] [INFO ] [MAIN ] Derivative Progress: 764/2077 symbols completed. GDL took 1.2s. Estimated remaining: 8m 33s. Rate: 153.5 symbols/min [2025-09-23T22:20:24.885810] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:24.886632] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 6025 primary records. [2025-09-23T22:20:24.886732] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-23T22:20:24.905471] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-09-23T22:20:24.905628] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-23T22:20:24.908539] [INFO ] [MAIN ] Derivative Progress: 765/2077 symbols completed. GDO took 0.9s. Estimated remaining: 8m 32s. Rate: 153.7 symbols/min [2025-09-23T22:20:24.909678] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:24.909995] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:24.910101] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:24.946685] [DEBUG] [LOCAL ] GDV: Loaded 19729 existing records from primary storage. [2025-09-23T22:20:24.946931] [INFO ] [MAIN ] GDV: Loaded 19729 primary data records. [2025-09-23T22:20:25.164266] [DEBUG] [LOCAL ] GDOT: Loaded 38662 existing records from primary storage. [2025-09-23T22:20:25.166398] [INFO ] [MAIN ] GDOT: Loaded 38662 primary data records. [2025-09-23T22:20:25.198600] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-23T22:20:25.221158] [INFO ] [MAIN ] GE: Loaded 53713 primary data records. [2025-09-23T22:20:26.068528] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:26.069894] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19729 primary records. [2025-09-23T22:20:26.070230] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-23T22:20:26.112472] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:26.118368] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38662 primary records. [2025-09-23T22:20:26.117207] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-09-23T22:20:26.118518] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-23T22:20:26.118762] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-23T22:20:26.120912] [INFO ] [MAIN ] Derivative Progress: 766/2077 symbols completed. GDV took 1.2s. Estimated remaining: 8m 33s. Rate: 153.3 symbols/min [2025-09-23T22:20:26.122319] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:26.123270] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:26.123085] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53713 primary records. [2025-09-23T22:20:26.123687] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-23T22:20:26.151881] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-09-23T22:20:26.152297] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-23T22:20:26.155225] [INFO ] [MAIN ] Derivative Progress: 767/2077 symbols completed. GDOT took 1.2s. Estimated remaining: 8m 32s. Rate: 153.4 symbols/min [2025-09-23T22:20:26.155987] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:26.165367] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-09-23T22:20:26.165575] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-23T22:20:26.168370] [INFO ] [MAIN ] Derivative Progress: 768/2077 symbols completed. GE took 1.3s. Estimated remaining: 8m 31s. Rate: 153.6 symbols/min [2025-09-23T22:20:26.168833] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:26.176977] [DEBUG] [LOCAL ] GEF: Loaded 20743 existing records from primary storage. [2025-09-23T22:20:26.177238] [INFO ] [MAIN ] GEF: Loaded 20743 primary data records. [2025-09-23T22:20:26.383298] [DEBUG] [LOCAL ] GEL: Loaded 34033 existing records from primary storage. [2025-09-23T22:20:26.487288] [INFO ] [MAIN ] GEL: Loaded 34033 primary data records. [2025-09-23T22:20:26.644490] [DEBUG] [LOCAL ] GENI: Loaded 52913 existing records from primary storage. [2025-09-23T22:20:26.645554] [INFO ] [MAIN ] GENI: Loaded 52913 primary data records. [2025-09-23T22:20:27.192327] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:27.193679] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20743 primary records. [2025-09-23T22:20:27.193828] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-23T22:20:27.214887] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-09-23T22:20:27.215590] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-23T22:20:27.220003] [INFO ] [MAIN ] Derivative Progress: 769/2077 symbols completed. GEF took 1.1s. Estimated remaining: 8m 32s. Rate: 153.3 symbols/min [2025-09-23T22:20:27.222390] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:27.238859] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:27.239774] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 34033 primary records. [2025-09-23T22:20:27.240042] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-23T22:20:27.279216] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-09-23T22:20:27.279838] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-23T22:20:27.282843] [INFO ] [MAIN ] Derivative Progress: 770/2077 symbols completed. GEL took 1.1s. Estimated remaining: 8m 31s. Rate: 153.5 symbols/min [2025-09-23T22:20:27.280096] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:27.284110] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:27.283805] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52913 primary records. [2025-09-23T22:20:27.284633] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-23T22:20:27.314993] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-09-23T22:20:27.315302] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-23T22:20:27.319060] [INFO ] [MAIN ] Derivative Progress: 771/2077 symbols completed. GENI took 1.2s. Estimated remaining: 8m 30s. Rate: 153.6 symbols/min [2025-09-23T22:20:27.319552] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:27.343386] [DEBUG] [LOCAL ] GEO: Loaded 52152 existing records from primary storage. [2025-09-23T22:20:27.343761] [INFO ] [MAIN ] GEO: Loaded 52152 primary data records. [2025-09-23T22:20:27.525996] [DEBUG] [LOCAL ] GES: Loaded 40095 existing records from primary storage. [2025-09-23T22:20:27.524905] [DEBUG] [LOCAL ] GETY: Loaded 36040 existing records from primary storage. [2025-09-23T22:20:27.575410] [INFO ] [MAIN ] GETY: Loaded 36040 primary data records. [2025-09-23T22:20:27.555567] [INFO ] [MAIN ] GES: Loaded 40095 primary data records. [2025-09-23T22:20:28.409174] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:28.410775] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 52152 primary records. [2025-09-23T22:20:28.411361] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-23T22:20:28.439875] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-09-23T22:20:28.452861] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-23T22:20:28.453178] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:28.456415] [INFO ] [MAIN ] Derivative Progress: 772/2077 symbols completed. GEO took 1.2s. Estimated remaining: 8m 31s. Rate: 153.3 symbols/min [2025-09-23T22:20:28.458603] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 36040 primary records. [2025-09-23T22:20:28.458832] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:28.459938] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-23T22:20:28.484374] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:28.492262] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 40095 primary records. [2025-09-23T22:20:28.491425] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-09-23T22:20:28.492564] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-23T22:20:28.492529] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-23T22:20:28.495759] [INFO ] [MAIN ] Derivative Progress: 773/2077 symbols completed. GETY took 1.2s. Estimated remaining: 8m 30s. Rate: 153.4 symbols/min [2025-09-23T22:20:28.496664] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:28.515621] [DEBUG] [LOCAL ] GF: Loaded 3269 existing records from primary storage. [2025-09-23T22:20:28.517506] [INFO ] [MAIN ] GF: Loaded 3269 primary data records. [2025-09-23T22:20:28.529391] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-09-23T22:20:28.539015] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-23T22:20:28.563754] [INFO ] [MAIN ] Derivative Progress: 774/2077 symbols completed. GES took 1.3s. Estimated remaining: 8m 29s. Rate: 153.6 symbols/min [2025-09-23T22:20:28.576100] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:28.856553] [DEBUG] [LOCAL ] GEV: Loaded 53146 existing records from primary storage. [2025-09-23T22:20:28.857485] [INFO ] [MAIN ] GEV: Loaded 53146 primary data records. [2025-09-23T22:20:28.973558] [DEBUG] [LOCAL ] GFF: Loaded 30900 existing records from primary storage. [2025-09-23T22:20:28.994703] [INFO ] [MAIN ] GFF: Loaded 30900 primary data records. [2025-09-23T22:20:29.546890] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:29.549042] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 3269 primary records. [2025-09-23T22:20:29.549708] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-23T22:20:29.566488] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-09-23T22:20:29.566722] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-23T22:20:29.569260] [INFO ] [MAIN ] Derivative Progress: 775/2077 symbols completed. GF took 1.1s. Estimated remaining: 8m 30s. Rate: 153.3 symbols/min [2025-09-23T22:20:29.569730] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:29.592268] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:29.593369] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53146 primary records. [2025-09-23T22:20:29.596228] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-23T22:20:29.625034] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:29.627064] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30900 primary records. [2025-09-23T22:20:29.627738] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-23T22:20:29.639812] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-09-23T22:20:29.642581] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-23T22:20:29.659051] [INFO ] [MAIN ] Derivative Progress: 776/2077 symbols completed. GEV took 1.2s. Estimated remaining: 8m 29s. Rate: 153.4 symbols/min [2025-09-23T22:20:29.659861] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:29.668372] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-09-23T22:20:29.668528] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-23T22:20:29.671359] [INFO ] [MAIN ] Derivative Progress: 777/2077 symbols completed. GFF took 1.1s. Estimated remaining: 8m 28s. Rate: 153.6 symbols/min [2025-09-23T22:20:29.672768] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:29.690609] [DEBUG] [LOCAL ] GFI: Loaded 53106 existing records from primary storage. [2025-09-23T22:20:29.690913] [INFO ] [MAIN ] GFI: Loaded 53106 primary data records. [2025-09-23T22:20:30.042957] [DEBUG] [LOCAL ] GFL: Loaded 48045 existing records from primary storage. [2025-09-23T22:20:30.043904] [INFO ] [MAIN ] GFL: Loaded 48045 primary data records. [2025-09-23T22:20:30.108859] [DEBUG] [LOCAL ] GGB: Loaded 51019 existing records from primary storage. [2025-09-23T22:20:30.120683] [INFO ] [MAIN ] GGB: Loaded 51019 primary data records. [2025-09-23T22:20:30.745067] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:30.747263] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53106 primary records. [2025-09-23T22:20:30.747445] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-23T22:20:30.772303] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-09-23T22:20:30.774018] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-23T22:20:30.778505] [INFO ] [MAIN ] Derivative Progress: 778/2077 symbols completed. GFI took 1.2s. Estimated remaining: 8m 28s. Rate: 153.3 symbols/min [2025-09-23T22:20:30.793368] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:30.794677] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 48045 primary records. [2025-09-23T22:20:30.794881] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-23T22:20:30.830187] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-09-23T22:20:30.829897] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:30.830336] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-23T22:20:30.831471] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51019 primary records. [2025-09-23T22:20:30.833718] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-23T22:20:30.833553] [INFO ] [MAIN ] Derivative Progress: 779/2077 symbols completed. GFL took 1.2s. Estimated remaining: 8m 28s. Rate: 153.4 symbols/min [2025-09-23T22:20:30.850358] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-09-23T22:20:30.850488] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-23T22:20:30.853247] [INFO ] [MAIN ] Derivative Progress: 780/2077 symbols completed. GGB took 1.2s. Estimated remaining: 8m 27s. Rate: 153.6 symbols/min [2025-09-23T22:20:30.854448] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:30.854233] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:30.855903] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:30.862300] [DEBUG] [LOCAL ] GGZ: Loaded 2462 existing records from primary storage. [2025-09-23T22:20:30.862466] [INFO ] [MAIN ] GGZ: Loaded 2462 primary data records. [2025-09-23T22:20:30.986184] [DEBUG] [LOCAL ] GGT: Loaded 14153 existing records from primary storage. [2025-09-23T22:20:30.986738] [INFO ] [MAIN ] GGT: Loaded 14153 primary data records. [2025-09-23T22:20:31.349756] [DEBUG] [LOCAL ] GGG: Loaded 40996 existing records from primary storage. [2025-09-23T22:20:31.364335] [INFO ] [MAIN ] GGG: Loaded 40996 primary data records. [2025-09-23T22:20:31.959000] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:31.960693] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2462 primary records. [2025-09-23T22:20:31.960804] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-23T22:20:31.991314] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-09-23T22:20:31.991989] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-23T22:20:31.991890] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:20:31.994900] [INFO ] [MAIN ] Derivative Progress: 781/2077 symbols completed. GGZ took 1.1s. Estimated remaining: 8m 27s. Rate: 153.3 symbols/min [2025-09-23T22:20:31.995291] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:31.996055] [INFO ] [MAIN ] GGT: Generated 1793 derivative records from 14153 primary records. [2025-09-23T22:20:31.996462] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-23T22:20:32.013148] [DEBUG] [LOCAL ] GGT: Derivative data saved (1793 records). [2025-09-23T22:20:32.013454] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-23T22:20:32.015854] [INFO ] [MAIN ] Derivative Progress: 782/2077 symbols completed. GGT took 1.2s. Estimated remaining: 8m 26s. Rate: 153.4 symbols/min [2025-09-23T22:20:32.016385] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:32.019037] [DEBUG] [LOCAL ] GHC: Loaded 2627 existing records from primary storage. [2025-09-23T22:20:32.019432] [INFO ] [MAIN ] GHC: Loaded 2627 primary data records. [2025-09-23T22:20:32.108850] [DEBUG] [LOCAL ] GHI: Loaded 6895 existing records from primary storage. [2025-09-23T22:20:32.120256] [INFO ] [MAIN ] GHI: Loaded 6895 primary data records. [2025-09-23T22:20:32.187237] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:32.237171] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40996 primary records. [2025-09-23T22:20:32.278901] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-23T22:20:32.656555] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-09-23T22:20:32.656896] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-23T22:20:32.659845] [INFO ] [MAIN ] Derivative Progress: 783/2077 symbols completed. GGG took 1.8s. Estimated remaining: 8m 26s. Rate: 153.3 symbols/min [2025-09-23T22:20:32.660779] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:32.669178] [DEBUG] [LOCAL ] GHLD: Loaded 4110 existing records from primary storage. [2025-09-23T22:20:32.669876] [INFO ] [MAIN ] GHLD: Loaded 4110 primary data records. [2025-09-23T22:20:32.875441] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-23T22:20:32.882921] [INFO ] [MAIN ] GHC: Generated 1791 derivative records from 2627 primary records. [2025-09-23T22:20:32.883051] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-23T22:20:33.052820] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:33.054730] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 6895 primary records. [2025-09-23T22:20:33.055207] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-23T22:20:33.072286] [DEBUG] [LOCAL ] GHC: Derivative data saved (1791 records). [2025-09-23T22:20:33.074417] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-23T22:20:33.077319] [INFO ] [MAIN ] Derivative Progress: 784/2077 symbols completed. GHC took 1.1s. Estimated remaining: 8m 26s. Rate: 153.3 symbols/min [2025-09-23T22:20:33.080140] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:33.084282] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-09-23T22:20:33.085395] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-23T22:20:33.089426] [INFO ] [MAIN ] Derivative Progress: 785/2077 symbols completed. GHI took 1.1s. Estimated remaining: 8m 25s. Rate: 153.5 symbols/min [2025-09-23T22:20:33.090232] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:33.108224] [DEBUG] [LOCAL ] GHM: Loaded 14136 existing records from primary storage. [2025-09-23T22:20:33.110351] [INFO ] [MAIN ] GHM: Loaded 14136 primary data records. [2025-09-23T22:20:33.177781] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:33.213882] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4110 primary records. [2025-09-23T22:20:33.235430] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-23T22:20:33.256532] [DEBUG] [LOCAL ] GHY: Loaded 20835 existing records from primary storage. [2025-09-23T22:20:33.272789] [INFO ] [MAIN ] GHY: Loaded 20835 primary data records. [2025-09-23T22:20:33.604056] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-09-23T22:20:33.605450] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-23T22:20:33.609789] [INFO ] [MAIN ] Derivative Progress: 786/2077 symbols completed. GHLD took 0.9s. Estimated remaining: 8m 25s. Rate: 153.4 symbols/min [2025-09-23T22:20:33.610957] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:33.922817] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:33.924325] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14136 primary records. [2025-09-23T22:20:33.934292] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-23T22:20:33.938109] [DEBUG] [LOCAL ] GIB: Loaded 32109 existing records from primary storage. [2025-09-23T22:20:33.938372] [INFO ] [MAIN ] GIB: Loaded 32109 primary data records. [2025-09-23T22:20:34.073191] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-09-23T22:20:34.119330] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:34.128738] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20835 primary records. [2025-09-23T22:20:34.118862] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-23T22:20:34.163295] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-23T22:20:34.157026] [INFO ] [MAIN ] Derivative Progress: 787/2077 symbols completed. GHM took 1.1s. Estimated remaining: 8m 25s. Rate: 153.3 symbols/min [2025-09-23T22:20:34.163678] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:34.323624] [DEBUG] [LOCAL ] GIC: Loaded 13706 existing records from primary storage. [2025-09-23T22:20:34.325397] [INFO ] [MAIN ] GIC: Loaded 13706 primary data records. [2025-09-23T22:20:34.338736] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-09-23T22:20:34.354715] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-23T22:20:34.369706] [INFO ] [MAIN ] Derivative Progress: 788/2077 symbols completed. GHY took 1.3s. Estimated remaining: 8m 24s. Rate: 153.4 symbols/min [2025-09-23T22:20:34.406833] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:34.684999] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:34.696411] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 32109 primary records. [2025-09-23T22:20:34.696606] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-23T22:20:34.716307] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-09-23T22:20:34.716610] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-23T22:20:34.738600] [INFO ] [MAIN ] Derivative Progress: 789/2077 symbols completed. GIB took 1.1s. Estimated remaining: 8m 24s. Rate: 153.4 symbols/min [2025-09-23T22:20:34.740321] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:34.740014] [DEBUG] [LOCAL ] GIL: Loaded 43161 existing records from primary storage. [2025-09-23T22:20:34.741572] [INFO ] [MAIN ] GIL: Loaded 43161 primary data records. [2025-09-23T22:20:35.076367] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:35.077186] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13706 primary records. [2025-09-23T22:20:35.077381] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-23T22:20:35.119037] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-09-23T22:20:35.118593] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-09-23T22:20:35.119331] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-23T22:20:35.119436] [INFO ] [MAIN ] GIS: Loaded 53675 primary data records. [2025-09-23T22:20:35.122433] [INFO ] [MAIN ] Derivative Progress: 790/2077 symbols completed. GIC took 1.0s. Estimated remaining: 8m 23s. Rate: 153.5 symbols/min [2025-09-23T22:20:35.122947] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:35.467507] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:35.469406] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43161 primary records. [2025-09-23T22:20:35.469568] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-23T22:20:35.502531] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-09-23T22:20:35.503746] [DEBUG] [LOCAL ] GKOS: Loaded 43115 existing records from primary storage. [2025-09-23T22:20:35.504149] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-23T22:20:35.506929] [INFO ] [MAIN ] GKOS: Loaded 43115 primary data records. [2025-09-23T22:20:35.506822] [INFO ] [MAIN ] Derivative Progress: 791/2077 symbols completed. GIL took 1.1s. Estimated remaining: 8m 23s. Rate: 153.5 symbols/min [2025-09-23T22:20:35.507733] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:35.625603] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:35.638466] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53675 primary records. [2025-09-23T22:20:35.638698] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-23T22:20:35.929432] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-09-23T22:20:35.929614] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-23T22:20:35.932929] [INFO ] [MAIN ] Derivative Progress: 792/2077 symbols completed. GIS took 1.2s. Estimated remaining: 8m 22s. Rate: 153.4 symbols/min [2025-09-23T22:20:35.930354] [DEBUG] [LOCAL ] GL: Loaded 37987 existing records from primary storage. [2025-09-23T22:20:35.934377] [INFO ] [MAIN ] GL: Loaded 37987 primary data records. [2025-09-23T22:20:35.935117] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:36.291460] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:36.293006] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 43115 primary records. [2025-09-23T22:20:36.294456] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-23T22:20:36.324572] [DEBUG] [LOCAL ] GLOB: Loaded 47351 existing records from primary storage. [2025-09-23T22:20:36.325767] [INFO ] [MAIN ] GLOB: Loaded 47351 primary data records. [2025-09-23T22:20:36.412473] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-09-23T22:20:36.423512] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-23T22:20:36.426035] [INFO ] [MAIN ] Derivative Progress: 793/2077 symbols completed. GKOS took 1.3s. Estimated remaining: 8m 22s. Rate: 153.4 symbols/min [2025-09-23T22:20:36.544813] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:36.675991] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37987 primary records. [2025-09-23T22:20:36.676634] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-23T22:20:36.696027] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-09-23T22:20:36.696192] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-23T22:20:36.698734] [INFO ] [MAIN ] Derivative Progress: 794/2077 symbols completed. GL took 1.2s. Estimated remaining: 8m 22s. Rate: 153.4 symbols/min [2025-09-23T22:20:36.719161] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:36.719848] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47351 primary records. [2025-09-23T22:20:36.719912] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-23T22:20:36.738434] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-09-23T22:20:36.738495] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-23T22:20:36.740901] [INFO ] [MAIN ] Derivative Progress: 795/2077 symbols completed. GLOB took 0.8s. Estimated remaining: 8m 21s. Rate: 153.6 symbols/min [2025-09-23T22:20:36.741885] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:36.741596] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:36.742094] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:36.754996] [DEBUG] [LOCAL ] GLP: Loaded 9512 existing records from primary storage. [2025-09-23T22:20:36.755173] [INFO ] [MAIN ] GLP: Loaded 9512 primary data records. [2025-09-23T22:20:37.115013] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-23T22:20:37.116853] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-09-23T22:20:37.139370] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-23T22:20:37.162522] [INFO ] [MAIN ] GM: Loaded 53728 primary data records. [2025-09-23T22:20:37.777389] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:37.778891] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9512 primary records. [2025-09-23T22:20:37.779000] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-23T22:20:37.801715] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-09-23T22:20:37.802285] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-23T22:20:37.804695] [INFO ] [MAIN ] Derivative Progress: 796/2077 symbols completed. GLP took 1.1s. Estimated remaining: 8m 21s. Rate: 153.3 symbols/min [2025-09-23T22:20:37.805541] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:37.831908] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:37.832920] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-09-23T22:20:37.832999] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-23T22:20:37.860411] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:37.862479] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53728 primary records. [2025-09-23T22:20:37.862878] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-23T22:20:37.873256] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-09-23T22:20:37.877917] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-23T22:20:37.880332] [INFO ] [MAIN ] Derivative Progress: 797/2077 symbols completed. GLW took 1.1s. Estimated remaining: 8m 21s. Rate: 153.4 symbols/min [2025-09-23T22:20:37.881601] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:37.900433] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-09-23T22:20:37.900722] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-23T22:20:37.903374] [INFO ] [MAIN ] Derivative Progress: 798/2077 symbols completed. GM took 1.2s. Estimated remaining: 8m 20s. Rate: 153.6 symbols/min [2025-09-23T22:20:37.903826] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:37.921513] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-09-23T22:20:37.921806] [INFO ] [MAIN ] GME: Loaded 53762 primary data records. [2025-09-23T22:20:38.241425] [DEBUG] [LOCAL ] GMED: Loaded 48308 existing records from primary storage. [2025-09-23T22:20:38.180313] [DEBUG] [LOCAL ] GMRE: Loaded 37709 existing records from primary storage. [2025-09-23T22:20:38.241682] [INFO ] [MAIN ] GMRE: Loaded 37709 primary data records. [2025-09-23T22:20:38.322240] [INFO ] [MAIN ] GMED: Loaded 48308 primary data records. [2025-09-23T22:20:39.006333] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:39.007475] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53762 primary records. [2025-09-23T22:20:39.007605] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-23T22:20:39.027073] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-09-23T22:20:39.027416] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-23T22:20:39.029354] [INFO ] [MAIN ] Derivative Progress: 799/2077 symbols completed. GME took 1.2s. Estimated remaining: 8m 20s. Rate: 153.3 symbols/min [2025-09-23T22:20:39.029848] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:39.047993] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:39.048956] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48308 primary records. [2025-09-23T22:20:39.049130] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-23T22:20:39.080098] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-09-23T22:20:39.085968] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:39.086062] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-23T22:20:39.086930] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37709 primary records. [2025-09-23T22:20:39.095741] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-23T22:20:39.096377] [DEBUG] [LOCAL ] GNE: Loaded 17661 existing records from primary storage. [2025-09-23T22:20:39.095541] [INFO ] [MAIN ] Derivative Progress: 800/2077 symbols completed. GMED took 1.2s. Estimated remaining: 8m 19s. Rate: 153.4 symbols/min [2025-09-23T22:20:39.096865] [INFO ] [MAIN ] GNE: Loaded 17661 primary data records. [2025-09-23T22:20:39.097462] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:39.267733] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-09-23T22:20:39.307544] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-23T22:20:39.422177] [INFO ] [MAIN ] Derivative Progress: 801/2077 symbols completed. GMRE took 1.5s. Estimated remaining: 8m 19s. Rate: 153.5 symbols/min [2025-09-23T22:20:39.427109] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:39.459058] [DEBUG] [LOCAL ] GNK: Loaded 40652 existing records from primary storage. [2025-09-23T22:20:39.459582] [INFO ] [MAIN ] GNK: Loaded 40652 primary data records. [2025-09-23T22:20:39.841236] [DEBUG] [LOCAL ] GNL: Loaded 47288 existing records from primary storage. [2025-09-23T22:20:39.841969] [INFO ] [MAIN ] GNL: Loaded 47288 primary data records. [2025-09-23T22:20:40.007386] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:40.023935] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17661 primary records. [2025-09-23T22:20:40.049992] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-23T22:20:40.244581] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-09-23T22:20:40.245195] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-23T22:20:40.248036] [INFO ] [MAIN ] Derivative Progress: 802/2077 symbols completed. GNE took 1.2s. Estimated remaining: 8m 19s. Rate: 153.2 symbols/min [2025-09-23T22:20:40.249376] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:40.268490] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:40.269335] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40652 primary records. [2025-09-23T22:20:40.269571] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-23T22:20:40.290319] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-09-23T22:20:40.290464] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-23T22:20:40.293007] [INFO ] [MAIN ] Derivative Progress: 803/2077 symbols completed. GNK took 1.2s. Estimated remaining: 8m 18s. Rate: 153.4 symbols/min [2025-09-23T22:20:40.293512] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:40.318137] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:40.318972] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 47288 primary records. [2025-09-23T22:20:40.319059] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-23T22:20:40.337414] [DEBUG] [LOCAL ] GNT: Loaded 8021 existing records from primary storage. [2025-09-23T22:20:40.339309] [INFO ] [MAIN ] GNT: Loaded 8021 primary data records. [2025-09-23T22:20:40.411261] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-09-23T22:20:40.420289] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-23T22:20:40.421351] [DEBUG] [LOCAL ] GNRC: Loaded 45194 existing records from primary storage. [2025-09-23T22:20:40.421467] [INFO ] [MAIN ] GNRC: Loaded 45194 primary data records. [2025-09-23T22:20:40.435911] [INFO ] [MAIN ] Derivative Progress: 804/2077 symbols completed. GNL took 1.0s. Estimated remaining: 8m 17s. Rate: 153.5 symbols/min [2025-09-23T22:20:40.513216] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:40.835152] [DEBUG] [LOCAL ] GNTY: Loaded 7173 existing records from primary storage. [2025-09-23T22:20:40.836095] [INFO ] [MAIN ] GNTY: Loaded 7173 primary data records. [2025-09-23T22:20:41.309007] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:41.311239] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8021 primary records. [2025-09-23T22:20:41.312230] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-23T22:20:41.337808] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:41.339696] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45194 primary records. [2025-09-23T22:20:41.340044] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-23T22:20:41.358369] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-09-23T22:20:41.358589] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-23T22:20:41.362218] [INFO ] [MAIN ] Derivative Progress: 805/2077 symbols completed. GNT took 1.1s. Estimated remaining: 8m 18s. Rate: 153.3 symbols/min [2025-09-23T22:20:41.364119] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:41.365974] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-09-23T22:20:41.366095] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-23T22:20:41.369114] [INFO ] [MAIN ] Derivative Progress: 806/2077 symbols completed. GNRC took 1.1s. Estimated remaining: 8m 17s. Rate: 153.5 symbols/min [2025-09-23T22:20:41.369613] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:41.383048] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-23T22:20:41.383785] [INFO ] [MAIN ] GNTY: Generated 1791 derivative records from 7173 primary records. [2025-09-23T22:20:41.383953] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-23T22:20:41.399280] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1791 records). [2025-09-23T22:20:41.399417] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-23T22:20:41.401902] [INFO ] [MAIN ] Derivative Progress: 807/2077 symbols completed. GNTY took 0.9s. Estimated remaining: 8m 16s. Rate: 153.6 symbols/min [2025-09-23T22:20:41.402277] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:41.458540] [DEBUG] [LOCAL ] GOF: Loaded 42873 existing records from primary storage. [2025-09-23T22:20:41.467277] [INFO ] [MAIN ] GOF: Loaded 42873 primary data records. [2025-09-23T22:20:41.499779] [DEBUG] [LOCAL ] GOLF: Loaded 31727 existing records from primary storage. [2025-09-23T22:20:41.505027] [INFO ] [MAIN ] GOLF: Loaded 31727 primary data records. [2025-09-23T22:20:41.576280] [DEBUG] [LOCAL ] GNW: Loaded 51348 existing records from primary storage. [2025-09-23T22:20:41.631798] [INFO ] [MAIN ] GNW: Loaded 51348 primary data records. [2025-09-23T22:20:42.495268] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:42.500853] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:42.501603] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42873 primary records. [2025-09-23T22:20:42.502306] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31727 primary records. [2025-09-23T22:20:42.502377] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-23T22:20:42.501748] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-23T22:20:42.536072] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-09-23T22:20:42.537035] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-23T22:20:42.554152] [INFO ] [MAIN ] Derivative Progress: 808/2077 symbols completed. GOLF took 1.2s. Estimated remaining: 8m 17s. Rate: 153.3 symbols/min [2025-09-23T22:20:42.554826] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:42.557127] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51348 primary records. [2025-09-23T22:20:42.556311] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-09-23T22:20:42.557226] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-23T22:20:42.557450] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-23T22:20:42.560109] [INFO ] [MAIN ] Derivative Progress: 809/2077 symbols completed. GOF took 1.2s. Estimated remaining: 8m 16s. Rate: 153.4 symbols/min [2025-09-23T22:20:42.574729] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-09-23T22:20:42.574834] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-23T22:20:42.577770] [INFO ] [MAIN ] Derivative Progress: 810/2077 symbols completed. GNW took 1.2s. Estimated remaining: 8m 15s. Rate: 153.6 symbols/min [2025-09-23T22:20:42.578446] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:42.578598] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:42.579158] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:42.653506] [DEBUG] [LOCAL ] GOTU: Loaded 39025 existing records from primary storage. [2025-09-23T22:20:42.653812] [INFO ] [MAIN ] GOTU: Loaded 39025 primary data records. [2025-09-23T22:20:42.654576] [DEBUG] [LOCAL ] GOOS: Loaded 45569 existing records from primary storage. [2025-09-23T22:20:42.666320] [INFO ] [MAIN ] GOOS: Loaded 45569 primary data records. [2025-09-23T22:20:42.869033] [DEBUG] [LOCAL ] GPC: Loaded 46703 existing records from primary storage. [2025-09-23T22:20:42.897998] [INFO ] [MAIN ] GPC: Loaded 46703 primary data records. [2025-09-23T22:20:43.631686] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:43.645226] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 45569 primary records. [2025-09-23T22:20:43.646825] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-23T22:20:43.646707] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:43.647606] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 39025 primary records. [2025-09-23T22:20:43.649510] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-23T22:20:43.690372] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:43.692740] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46703 primary records. [2025-09-23T22:20:43.693590] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-23T22:20:43.710698] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-09-23T22:20:43.713755] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-23T22:20:43.717363] [INFO ] [MAIN ] Derivative Progress: 811/2077 symbols completed. GOTU took 1.1s. Estimated remaining: 8m 16s. Rate: 153.3 symbols/min [2025-09-23T22:20:43.713603] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-09-23T22:20:43.720261] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-23T22:20:43.721687] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-09-23T22:20:43.721922] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:43.722045] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-23T22:20:43.723947] [INFO ] [MAIN ] Derivative Progress: 812/2077 symbols completed. GOOS took 1.1s. Estimated remaining: 8m 15s. Rate: 153.5 symbols/min [2025-09-23T22:20:43.727607] [INFO ] [MAIN ] Derivative Progress: 813/2077 symbols completed. GPC took 1.1s. Estimated remaining: 8m 14s. Rate: 153.6 symbols/min [2025-09-23T22:20:43.727769] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:43.728752] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:43.736191] [DEBUG] [LOCAL ] GPJA: Loaded 4086 existing records from primary storage. [2025-09-23T22:20:43.736575] [INFO ] [MAIN ] GPJA: Loaded 4086 primary data records. [2025-09-23T22:20:43.874420] [DEBUG] [LOCAL ] GPMT: Loaded 26759 existing records from primary storage. [2025-09-23T22:20:43.890142] [INFO ] [MAIN ] GPMT: Loaded 26759 primary data records. [2025-09-23T22:20:44.261020] [DEBUG] [LOCAL ] GPK: Loaded 52678 existing records from primary storage. [2025-09-23T22:20:44.355725] [INFO ] [MAIN ] GPK: Loaded 52678 primary data records. [2025-09-23T22:20:44.768787] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:44.770938] [INFO ] [MAIN ] GPJA: Generated 1794 derivative records from 4086 primary records. [2025-09-23T22:20:44.771178] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-23T22:20:44.802979] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:44.805018] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26759 primary records. [2025-09-23T22:20:44.806382] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1794 records). [2025-09-23T22:20:44.805810] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-23T22:20:44.806677] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-23T22:20:44.808617] [INFO ] [MAIN ] Derivative Progress: 814/2077 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 14s. Rate: 153.3 symbols/min [2025-09-23T22:20:44.809767] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:44.828467] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-09-23T22:20:44.829456] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-23T22:20:44.832233] [INFO ] [MAIN ] Derivative Progress: 815/2077 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 13s. Rate: 153.5 symbols/min [2025-09-23T22:20:44.832829] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:44.846031] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:44.846717] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52678 primary records. [2025-09-23T22:20:44.846909] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-23T22:20:44.864335] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-09-23T22:20:44.878578] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-23T22:20:44.881408] [INFO ] [MAIN ] Derivative Progress: 816/2077 symbols completed. GPK took 1.2s. Estimated remaining: 8m 12s. Rate: 153.6 symbols/min [2025-09-23T22:20:44.886353] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:44.897468] [DEBUG] [LOCAL ] GPOR: Loaded 22959 existing records from primary storage. [2025-09-23T22:20:44.898267] [INFO ] [MAIN ] GPOR: Loaded 22959 primary data records. [2025-09-23T22:20:44.990877] [DEBUG] [LOCAL ] GPN: Loaded 52113 existing records from primary storage. [2025-09-23T22:20:44.996161] [INFO ] [MAIN ] GPN: Loaded 52113 primary data records. [2025-09-23T22:20:45.232054] [DEBUG] [LOCAL ] GPRK: Loaded 39112 existing records from primary storage. [2025-09-23T22:20:45.253031] [INFO ] [MAIN ] GPRK: Loaded 39112 primary data records. [2025-09-23T22:20:45.888221] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:45.903227] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 22959 primary records. [2025-09-23T22:20:45.904580] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:45.905530] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52113 primary records. [2025-09-23T22:20:45.904238] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-23T22:20:45.905883] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-23T22:20:45.936964] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-09-23T22:20:45.940012] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-23T22:20:45.944945] [INFO ] [MAIN ] Derivative Progress: 817/2077 symbols completed. GPN took 1.1s. Estimated remaining: 8m 13s. Rate: 153.3 symbols/min [2025-09-23T22:20:45.946849] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:45.946602] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-09-23T22:20:45.947319] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-23T22:20:45.949729] [INFO ] [MAIN ] Derivative Progress: 818/2077 symbols completed. GPOR took 1.1s. Estimated remaining: 8m 12s. Rate: 153.5 symbols/min [2025-09-23T22:20:45.950064] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:45.963220] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:45.964173] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39112 primary records. [2025-09-23T22:20:45.964356] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-23T22:20:45.984567] [DEBUG] [LOCAL ] GRC: Loaded 8886 existing records from primary storage. [2025-09-23T22:20:45.985543] [INFO ] [MAIN ] GRC: Loaded 8886 primary data records. [2025-09-23T22:20:46.082227] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-09-23T22:20:46.087583] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-23T22:20:46.104549] [INFO ] [MAIN ] Derivative Progress: 819/2077 symbols completed. GPRK took 1.2s. Estimated remaining: 8m 11s. Rate: 153.6 symbols/min [2025-09-23T22:20:46.108636] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:46.136192] [DEBUG] [LOCAL ] GRBK: Loaded 27075 existing records from primary storage. [2025-09-23T22:20:46.147835] [INFO ] [MAIN ] GRBK: Loaded 27075 primary data records. [2025-09-23T22:20:46.440377] [DEBUG] [LOCAL ] GRDN: Loaded 19693 existing records from primary storage. [2025-09-23T22:20:46.451968] [INFO ] [MAIN ] GRDN: Loaded 19693 primary data records. [2025-09-23T22:20:47.028175] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:47.030016] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 8886 primary records. [2025-09-23T22:20:47.030438] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-23T22:20:47.049792] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-09-23T22:20:47.049897] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-23T22:20:47.054328] [INFO ] [MAIN ] Derivative Progress: 820/2077 symbols completed. GRC took 1.1s. Estimated remaining: 8m 12s. Rate: 153.4 symbols/min [2025-09-23T22:20:47.054635] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:47.078517] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:47.079534] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 27075 primary records. [2025-09-23T22:20:47.079721] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-23T22:20:47.111159] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-09-23T22:20:47.108769] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:47.112509] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 19693 primary records. [2025-09-23T22:20:47.111617] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-23T22:20:47.116788] [INFO ] [MAIN ] Derivative Progress: 821/2077 symbols completed. GRBK took 1.2s. Estimated remaining: 8m 11s. Rate: 153.5 symbols/min [2025-09-23T22:20:47.116890] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-23T22:20:47.118288] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:47.147478] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-09-23T22:20:47.147555] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-23T22:20:47.149928] [INFO ] [MAIN ] Derivative Progress: 822/2077 symbols completed. GRDN took 1.0s. Estimated remaining: 8m 10s. Rate: 153.7 symbols/min [2025-09-23T22:20:47.150222] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:47.167512] [DEBUG] [LOCAL ] GRMN: Loaded 41489 existing records from primary storage. [2025-09-23T22:20:47.167782] [INFO ] [MAIN ] GRMN: Loaded 41489 primary data records. [2025-09-23T22:20:47.426808] [DEBUG] [LOCAL ] GRNT: Loaded 33785 existing records from primary storage. [2025-09-23T22:20:47.427025] [INFO ] [MAIN ] GRNT: Loaded 33785 primary data records. [2025-09-23T22:20:47.482938] [DEBUG] [LOCAL ] GRND: Loaded 50047 existing records from primary storage. [2025-09-23T22:20:47.551288] [INFO ] [MAIN ] GRND: Loaded 50047 primary data records. [2025-09-23T22:20:48.329584] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:48.331157] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 41489 primary records. [2025-09-23T22:20:48.331278] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-23T22:20:48.354232] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-09-23T22:20:48.354571] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-23T22:20:48.356681] [INFO ] [MAIN ] Derivative Progress: 823/2077 symbols completed. GRMN took 1.3s. Estimated remaining: 8m 11s. Rate: 153.3 symbols/min [2025-09-23T22:20:48.379313] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:48.380207] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33785 primary records. [2025-09-23T22:20:48.392925] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-23T22:20:48.392851] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:48.394140] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50047 primary records. [2025-09-23T22:20:48.394420] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-23T22:20:48.422695] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-09-23T22:20:48.423481] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-23T22:20:48.426628] [INFO ] [MAIN ] Derivative Progress: 824/2077 symbols completed. GRNT took 1.3s. Estimated remaining: 8m 10s. Rate: 153.4 symbols/min [2025-09-23T22:20:48.428913] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-09-23T22:20:48.429005] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-23T22:20:48.431719] [INFO ] [MAIN ] Derivative Progress: 825/2077 symbols completed. GRND took 1.3s. Estimated remaining: 8m 9s. Rate: 153.6 symbols/min [2025-09-23T22:20:48.432344] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:48.432396] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:48.432491] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:48.441170] [DEBUG] [LOCAL ] GRX: Loaded 4444 existing records from primary storage. [2025-09-23T22:20:48.441306] [INFO ] [MAIN ] GRX: Loaded 4444 primary data records. [2025-09-23T22:20:48.524944] [DEBUG] [LOCAL ] GROV: Loaded 9074 existing records from primary storage. [2025-09-23T22:20:48.551906] [INFO ] [MAIN ] GROV: Loaded 9074 primary data records. [2025-09-23T22:20:49.084051] [DEBUG] [LOCAL ] GS: Loaded 52068 existing records from primary storage. [2025-09-23T22:20:49.086865] [INFO ] [MAIN ] GS: Loaded 52068 primary data records. [2025-09-23T22:20:49.444389] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:49.444911] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:49.446719] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 9074 primary records. [2025-09-23T22:20:49.445900] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4444 primary records. [2025-09-23T22:20:49.446973] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-23T22:20:49.446830] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-23T22:20:49.478917] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-09-23T22:20:49.483133] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-23T22:20:49.482960] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-09-23T22:20:49.485497] [INFO ] [MAIN ] Derivative Progress: 826/2077 symbols completed. GRX took 1.1s. Estimated remaining: 8m 10s. Rate: 153.3 symbols/min [2025-09-23T22:20:49.485942] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-23T22:20:49.488726] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:49.488621] [INFO ] [MAIN ] Derivative Progress: 827/2077 symbols completed. GROV took 1.1s. Estimated remaining: 8m 9s. Rate: 153.5 symbols/min [2025-09-23T22:20:49.489052] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:49.508540] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:49.509582] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 52068 primary records. [2025-09-23T22:20:49.509721] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-23T22:20:49.537814] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-09-23T22:20:49.537967] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-23T22:20:49.540477] [INFO ] [MAIN ] Derivative Progress: 828/2077 symbols completed. GS took 1.1s. Estimated remaining: 8m 8s. Rate: 153.7 symbols/min [2025-09-23T22:20:49.541007] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:49.569626] [DEBUG] [LOCAL ] GSBD: Loaded 39136 existing records from primary storage. [2025-09-23T22:20:49.569978] [INFO ] [MAIN ] GSBD: Loaded 39136 primary data records. [2025-09-23T22:20:49.691355] [DEBUG] [LOCAL ] GSK: Loaded 53493 existing records from primary storage. [2025-09-23T22:20:49.705327] [INFO ] [MAIN ] GSK: Loaded 53493 primary data records. [2025-09-23T22:20:49.873371] [DEBUG] [LOCAL ] GSL: Loaded 33536 existing records from primary storage. [2025-09-23T22:20:49.915546] [INFO ] [MAIN ] GSL: Loaded 33536 primary data records. [2025-09-23T22:20:50.632791] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:50.634946] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39136 primary records. [2025-09-23T22:20:50.635081] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-23T22:20:50.633915] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:50.637223] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53493 primary records. [2025-09-23T22:20:50.637857] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-23T22:20:50.665447] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-09-23T22:20:50.668689] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-23T22:20:50.671057] [INFO ] [MAIN ] Derivative Progress: 829/2077 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 8s. Rate: 153.3 symbols/min [2025-09-23T22:20:50.675196] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-09-23T22:20:50.675859] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-23T22:20:50.691374] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:50.686385] [INFO ] [MAIN ] Derivative Progress: 830/2077 symbols completed. GSK took 1.2s. Estimated remaining: 8m 7s. Rate: 153.5 symbols/min [2025-09-23T22:20:50.691923] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:50.693366] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:50.694405] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33536 primary records. [2025-09-23T22:20:50.694592] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-23T22:20:50.714526] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-09-23T22:20:50.714759] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-23T22:20:50.718831] [INFO ] [MAIN ] Derivative Progress: 831/2077 symbols completed. GSL took 1.2s. Estimated remaining: 8m 7s. Rate: 153.7 symbols/min [2025-09-23T22:20:50.719215] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:50.770116] [DEBUG] [LOCAL ] GTLS: Loaded 42996 existing records from primary storage. [2025-09-23T22:20:50.770703] [INFO ] [MAIN ] GTLS: Loaded 42996 primary data records. [2025-09-23T22:20:50.907456] [DEBUG] [LOCAL ] GTES: Loaded 50681 existing records from primary storage. [2025-09-23T22:20:50.913223] [INFO ] [MAIN ] GTES: Loaded 50681 primary data records. [2025-09-23T22:20:51.034559] [DEBUG] [LOCAL ] GTN: Loaded 45680 existing records from primary storage. [2025-09-23T22:20:51.040382] [INFO ] [MAIN ] GTN: Loaded 45680 primary data records. [2025-09-23T22:20:51.813328] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:51.817622] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 42996 primary records. [2025-09-23T22:20:51.817882] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-23T22:20:51.846878] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:51.848934] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50681 primary records. [2025-09-23T22:20:51.849668] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-23T22:20:51.848151] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-09-23T22:20:51.850920] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-23T22:20:51.854677] [INFO ] [MAIN ] Derivative Progress: 832/2077 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 7s. Rate: 153.3 symbols/min [2025-09-23T22:20:51.863556] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:51.882845] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:51.884746] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45680 primary records. [2025-09-23T22:20:51.886170] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-23T22:20:51.886227] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-09-23T22:20:51.886809] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-23T22:20:51.889606] [INFO ] [MAIN ] Derivative Progress: 833/2077 symbols completed. GTES took 1.2s. Estimated remaining: 8m 6s. Rate: 153.5 symbols/min [2025-09-23T22:20:51.900937] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:51.907807] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-09-23T22:20:51.908113] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-23T22:20:51.910631] [INFO ] [MAIN ] Derivative Progress: 834/2077 symbols completed. GTN took 1.2s. Estimated remaining: 8m 5s. Rate: 153.6 symbols/min [2025-09-23T22:20:51.919062] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:51.929052] [DEBUG] [LOCAL ] GUG: Loaded 12019 existing records from primary storage. [2025-09-23T22:20:51.929192] [INFO ] [MAIN ] GUG: Loaded 12019 primary data records. [2025-09-23T22:20:52.026315] [DEBUG] [LOCAL ] GTY: Loaded 30403 existing records from primary storage. [2025-09-23T22:20:52.060145] [DEBUG] [LOCAL ] GUT: Loaded 15489 existing records from primary storage. [2025-09-23T22:20:52.060339] [INFO ] [MAIN ] GTY: Loaded 30403 primary data records. [2025-09-23T22:20:52.060412] [INFO ] [MAIN ] GUT: Loaded 15489 primary data records. [2025-09-23T22:20:52.998858] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:52.999880] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12019 primary records. [2025-09-23T22:20:53.000077] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-23T22:20:53.022622] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-09-23T22:20:53.023100] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-23T22:20:53.034588] [INFO ] [MAIN ] Derivative Progress: 835/2077 symbols completed. GUG took 1.1s. Estimated remaining: 8m 6s. Rate: 153.3 symbols/min [2025-09-23T22:20:53.041835] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:53.043086] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15489 primary records. [2025-09-23T22:20:53.050673] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-23T22:20:53.042215] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:53.056780] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:53.057852] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30403 primary records. [2025-09-23T22:20:53.068531] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-23T22:20:53.074132] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-09-23T22:20:53.074302] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-23T22:20:53.077246] [INFO ] [MAIN ] Derivative Progress: 836/2077 symbols completed. GUT took 1.2s. Estimated remaining: 8m 5s. Rate: 153.5 symbols/min [2025-09-23T22:20:53.089832] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:53.095182] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-09-23T22:20:53.095454] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-23T22:20:53.098211] [INFO ] [MAIN ] Derivative Progress: 837/2077 symbols completed. GTY took 1.2s. Estimated remaining: 8m 4s. Rate: 153.6 symbols/min [2025-09-23T22:20:53.098624] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:53.122865] [DEBUG] [LOCAL ] GWH: Loaded 15438 existing records from primary storage. [2025-09-23T22:20:53.123108] [INFO ] [MAIN ] GWH: Loaded 15438 primary data records. [2025-09-23T22:20:53.240435] [DEBUG] [LOCAL ] GVA: Loaded 33873 existing records from primary storage. [2025-09-23T22:20:53.252850] [INFO ] [MAIN ] GVA: Loaded 33873 primary data records. [2025-09-23T22:20:53.565543] [DEBUG] [LOCAL ] GWRE: Loaded 41107 existing records from primary storage. [2025-09-23T22:20:53.581496] [INFO ] [MAIN ] GWRE: Loaded 41107 primary data records. [2025-09-23T22:20:54.218134] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:54.231328] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 15438 primary records. [2025-09-23T22:20:54.231602] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:54.232308] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 33873 primary records. [2025-09-23T22:20:54.232393] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-23T22:20:54.232464] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-23T22:20:54.258183] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-09-23T22:20:54.263042] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-23T22:20:54.266696] [INFO ] [MAIN ] Derivative Progress: 838/2077 symbols completed. GWH took 1.2s. Estimated remaining: 8m 5s. Rate: 153.3 symbols/min [2025-09-23T22:20:54.270779] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-09-23T22:20:54.270930] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-23T22:20:54.273310] [INFO ] [MAIN ] Derivative Progress: 839/2077 symbols completed. GVA took 1.2s. Estimated remaining: 8m 4s. Rate: 153.5 symbols/min [2025-09-23T22:20:54.288772] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:54.289396] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 41107 primary records. [2025-09-23T22:20:54.289727] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-23T22:20:54.307147] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-09-23T22:20:54.307294] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-23T22:20:54.310033] [INFO ] [MAIN ] Derivative Progress: 840/2077 symbols completed. GWRE took 1.2s. Estimated remaining: 8m 3s. Rate: 153.6 symbols/min [2025-09-23T22:20:54.310813] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:54.310988] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:54.310900] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:54.316459] [DEBUG] [LOCAL ] GYLD: Loaded 1553 existing records from primary storage. [2025-09-23T22:20:54.316785] [INFO ] [MAIN ] GYLD: Loaded 1553 primary data records. [2025-09-23T22:20:54.487699] [DEBUG] [LOCAL ] GWW: Loaded 19907 existing records from primary storage. [2025-09-23T22:20:54.518601] [INFO ] [MAIN ] GWW: Loaded 19907 primary data records. [2025-09-23T22:20:54.826629] [DEBUG] [LOCAL ] GXO: Loaded 47612 existing records from primary storage. [2025-09-23T22:20:54.831306] [INFO ] [MAIN ] GXO: Loaded 47612 primary data records. [2025-09-23T22:20:55.382141] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:20:55.383500] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1553 primary records. [2025-09-23T22:20:55.383629] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-23T22:20:55.404581] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-09-23T22:20:55.405077] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-23T22:20:55.407716] [INFO ] [MAIN ] Derivative Progress: 841/2077 symbols completed. GYLD took 1.1s. Estimated remaining: 8m 4s. Rate: 153.3 symbols/min [2025-09-23T22:20:55.415985] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:55.422834] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:55.424221] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19907 primary records. [2025-09-23T22:20:55.424580] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-23T22:20:55.460285] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-09-23T22:20:55.460893] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-23T22:20:55.461205] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:55.463613] [INFO ] [MAIN ] Derivative Progress: 842/2077 symbols completed. GWW took 1.2s. Estimated remaining: 8m 3s. Rate: 153.4 symbols/min [2025-09-23T22:20:55.464779] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47612 primary records. [2025-09-23T22:20:55.465021] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-23T22:20:55.463950] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:55.486101] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-09-23T22:20:55.486231] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-23T22:20:55.488902] [INFO ] [MAIN ] Derivative Progress: 843/2077 symbols completed. GXO took 1.2s. Estimated remaining: 8m 2s. Rate: 153.6 symbols/min [2025-09-23T22:20:55.489284] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:55.529907] [DEBUG] [LOCAL ] H: Loaded 44881 existing records from primary storage. [2025-09-23T22:20:55.530486] [INFO ] [MAIN ] H: Loaded 44881 primary data records. [2025-09-23T22:20:55.645968] [DEBUG] [LOCAL ] HAE: Loaded 39544 existing records from primary storage. [2025-09-23T22:20:55.658081] [INFO ] [MAIN ] HAE: Loaded 39544 primary data records. [2025-09-23T22:20:55.759781] [DEBUG] [LOCAL ] HAFN: Loaded 43614 existing records from primary storage. [2025-09-23T22:20:55.966426] [INFO ] [MAIN ] HAFN: Loaded 43614 primary data records. [2025-09-23T22:20:56.558128] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:56.559475] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44881 primary records. [2025-09-23T22:20:56.560039] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-23T22:20:56.583263] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-09-23T22:20:56.583459] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-23T22:20:56.585706] [INFO ] [MAIN ] Derivative Progress: 844/2077 symbols completed. H took 1.2s. Estimated remaining: 8m 3s. Rate: 153.3 symbols/min [2025-09-23T22:20:56.586108] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:56.604627] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:56.605528] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39544 primary records. [2025-09-23T22:20:56.605718] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-23T22:20:56.646005] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:56.647713] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-09-23T22:20:56.647923] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-23T22:20:56.647601] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43614 primary records. [2025-09-23T22:20:56.650610] [INFO ] [MAIN ] Derivative Progress: 845/2077 symbols completed. HAE took 1.2s. Estimated remaining: 8m 2s. Rate: 153.4 symbols/min [2025-09-23T22:20:56.650994] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-23T22:20:56.651297] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:56.684121] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-09-23T22:20:56.684323] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-23T22:20:56.687223] [INFO ] [MAIN ] Derivative Progress: 846/2077 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 1s. Rate: 153.6 symbols/min [2025-09-23T22:20:56.687634] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:56.712457] [DEBUG] [LOCAL ] HBB: Loaded 6910 existing records from primary storage. [2025-09-23T22:20:56.712678] [INFO ] [MAIN ] HBB: Loaded 6910 primary data records. [2025-09-23T22:20:56.713478] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-23T22:20:56.761810] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-09-23T22:20:56.980635] [DEBUG] [LOCAL ] HASI: Loaded 47221 existing records from primary storage. [2025-09-23T22:20:56.994639] [INFO ] [MAIN ] HASI: Loaded 47221 primary data records. [2025-09-23T22:20:57.788781] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:57.794384] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:57.795186] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6910 primary records. [2025-09-23T22:20:57.795320] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-23T22:20:57.796155] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-09-23T22:20:57.797092] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-23T22:20:57.823071] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-09-23T22:20:57.829206] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-23T22:20:57.832394] [INFO ] [MAIN ] Derivative Progress: 847/2077 symbols completed. HBB took 1.1s. Estimated remaining: 8m 2s. Rate: 153.3 symbols/min [2025-09-23T22:20:57.833117] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:57.834547] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-09-23T22:20:57.834932] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-23T22:20:57.839308] [INFO ] [MAIN ] Derivative Progress: 848/2077 symbols completed. HAL took 1.3s. Estimated remaining: 8m 1s. Rate: 153.4 symbols/min [2025-09-23T22:20:57.852552] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:57.852464] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:57.853832] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47221 primary records. [2025-09-23T22:20:57.853903] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-23T22:20:57.870828] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-09-23T22:20:57.870897] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-23T22:20:57.873530] [INFO ] [MAIN ] Derivative Progress: 849/2077 symbols completed. HASI took 1.2s. Estimated remaining: 7m 60s. Rate: 153.6 symbols/min [2025-09-23T22:20:57.873887] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:57.946134] [DEBUG] [LOCAL ] HBM: Loaded 52903 existing records from primary storage. [2025-09-23T22:20:57.946920] [INFO ] [MAIN ] HBM: Loaded 52903 primary data records. [2025-09-23T22:20:58.052822] [DEBUG] [LOCAL ] HBI: Loaded 53017 existing records from primary storage. [2025-09-23T22:20:58.072035] [DEBUG] [LOCAL ] HCA: Loaded 47271 existing records from primary storage. [2025-09-23T22:20:58.084455] [INFO ] [MAIN ] HBI: Loaded 53017 primary data records. [2025-09-23T22:20:58.096680] [INFO ] [MAIN ] HCA: Loaded 47271 primary data records. [2025-09-23T22:20:58.995256] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:58.996242] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52903 primary records. [2025-09-23T22:20:58.997438] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-23T22:20:59.015866] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-09-23T22:20:59.016318] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-23T22:20:59.018209] [INFO ] [MAIN ] Derivative Progress: 850/2077 symbols completed. HBM took 1.2s. Estimated remaining: 8m 0s. Rate: 153.2 symbols/min [2025-09-23T22:20:59.018732] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:59.047454] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:59.053514] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 53017 primary records. [2025-09-23T22:20:59.053923] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:20:59.054107] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-23T22:20:59.054963] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 47271 primary records. [2025-09-23T22:20:59.055892] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-23T22:20:59.071336] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-09-23T22:20:59.071804] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-23T22:20:59.083188] [INFO ] [MAIN ] Derivative Progress: 851/2077 symbols completed. HBI took 1.3s. Estimated remaining: 7m 60s. Rate: 153.4 symbols/min [2025-09-23T22:20:59.086532] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:59.101467] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-09-23T22:20:59.101618] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-23T22:20:59.104041] [INFO ] [MAIN ] Derivative Progress: 852/2077 symbols completed. HCA took 1.2s. Estimated remaining: 7m 59s. Rate: 153.6 symbols/min [2025-09-23T22:20:59.104440] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:20:59.128491] [DEBUG] [LOCAL ] HCI: Loaded 13926 existing records from primary storage. [2025-09-23T22:20:59.128634] [INFO ] [MAIN ] HCI: Loaded 13926 primary data records. [2025-09-23T22:20:59.150314] [DEBUG] [LOCAL ] HCC: Loaded 45383 existing records from primary storage. [2025-09-23T22:20:59.172518] [INFO ] [MAIN ] HCC: Loaded 45383 primary data records. [2025-09-23T22:20:59.782687] [DEBUG] [LOCAL ] HD: Loaded 53520 existing records from primary storage. [2025-09-23T22:20:59.782983] [INFO ] [MAIN ] HD: Loaded 53520 primary data records. [2025-09-23T22:21:00.130383] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:00.130954] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:00.131975] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45383 primary records. [2025-09-23T22:21:00.133520] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 13926 primary records. [2025-09-23T22:21:00.132612] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-23T22:21:00.134566] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-23T22:21:00.153394] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-09-23T22:21:00.165949] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-23T22:21:00.170984] [INFO ] [MAIN ] Derivative Progress: 853/2077 symbols completed. HCC took 1.2s. Estimated remaining: 7m 59s. Rate: 153.3 symbols/min [2025-09-23T22:21:00.173409] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-09-23T22:21:00.173810] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-23T22:21:00.176233] [INFO ] [MAIN ] Derivative Progress: 854/2077 symbols completed. HCI took 1.1s. Estimated remaining: 7m 58s. Rate: 153.4 symbols/min [2025-09-23T22:21:00.193072] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:00.193767] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53520 primary records. [2025-09-23T22:21:00.193828] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-23T22:21:00.210560] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-09-23T22:21:00.210684] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-23T22:21:00.213383] [INFO ] [MAIN ] Derivative Progress: 855/2077 symbols completed. HD took 1.1s. Estimated remaining: 7m 57s. Rate: 153.6 symbols/min [2025-09-23T22:21:00.214790] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:00.214464] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:00.214209] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:00.258736] [DEBUG] [LOCAL ] HEI: Loaded 32626 existing records from primary storage. [2025-09-23T22:21:00.258888] [INFO ] [MAIN ] HEI: Loaded 32626 primary data records. [2025-09-23T22:21:00.397597] [DEBUG] [LOCAL ] HE: Loaded 49238 existing records from primary storage. [2025-09-23T22:21:00.397976] [INFO ] [MAIN ] HE: Loaded 49238 primary data records. [2025-09-23T22:21:00.533323] [DEBUG] [LOCAL ] HDB: Loaded 51936 existing records from primary storage. [2025-09-23T22:21:00.578260] [INFO ] [MAIN ] HDB: Loaded 51936 primary data records. [2025-09-23T22:21:01.425636] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:01.428236] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 32626 primary records. [2025-09-23T22:21:01.429014] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-23T22:21:01.447687] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-09-23T22:21:01.448326] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-23T22:21:01.450187] [INFO ] [MAIN ] Derivative Progress: 856/2077 symbols completed. HEI took 1.2s. Estimated remaining: 7m 58s. Rate: 153.2 symbols/min [2025-09-23T22:21:01.450943] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:01.469973] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:01.472890] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51936 primary records. [2025-09-23T22:21:01.472998] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-23T22:21:01.478122] [DEBUG] [LOCAL ] HEQ: Loaded 6183 existing records from primary storage. [2025-09-23T22:21:01.485912] [INFO ] [MAIN ] HEQ: Loaded 6183 primary data records. [2025-09-23T22:21:01.504854] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:01.552224] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 49238 primary records. [2025-09-23T22:21:01.575016] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-23T22:21:01.649698] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-09-23T22:21:01.686564] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-23T22:21:01.854140] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-09-23T22:21:01.854332] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-23T22:21:01.856802] [INFO ] [MAIN ] Derivative Progress: 857/2077 symbols completed. HE took 1.6s. Estimated remaining: 7m 58s. Rate: 153.2 symbols/min [2025-09-23T22:21:01.861618] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:01.862005] [INFO ] [MAIN ] Derivative Progress: 858/2077 symbols completed. HDB took 1.6s. Estimated remaining: 7m 57s. Rate: 153.4 symbols/min [2025-09-23T22:21:01.862782] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:01.902993] [DEBUG] [LOCAL ] HFRO: Loaded 17383 existing records from primary storage. [2025-09-23T22:21:01.903552] [INFO ] [MAIN ] HFRO: Loaded 17383 primary data records. [2025-09-23T22:21:01.997159] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:02.033740] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6183 primary records. [2025-09-23T22:21:02.059399] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-23T22:21:02.081441] [DEBUG] [LOCAL ] HESM: Loaded 48167 existing records from primary storage. [2025-09-23T22:21:02.097597] [INFO ] [MAIN ] HESM: Loaded 48167 primary data records. [2025-09-23T22:21:02.412239] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-09-23T22:21:02.430874] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-23T22:21:02.438370] [INFO ] [MAIN ] Derivative Progress: 859/2077 symbols completed. HEQ took 1.0s. Estimated remaining: 7m 57s. Rate: 153.3 symbols/min [2025-09-23T22:21:02.450522] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:02.661715] [DEBUG] [LOCAL ] HGER: Loaded 13005 existing records from primary storage. [2025-09-23T22:21:02.661857] [INFO ] [MAIN ] HGER: Loaded 13005 primary data records. [2025-09-23T22:21:02.873508] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:02.874530] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17383 primary records. [2025-09-23T22:21:03.055312] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-23T22:21:03.081903] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-09-23T22:21:03.082195] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-23T22:21:03.085420] [INFO ] [MAIN ] Derivative Progress: 860/2077 symbols completed. HFRO took 1.2s. Estimated remaining: 7m 57s. Rate: 153.2 symbols/min [2025-09-23T22:21:03.088571] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:03.103763] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:03.104540] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48167 primary records. [2025-09-23T22:21:03.107067] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-23T22:21:03.126013] [DEBUG] [LOCAL ] HGLB: Loaded 9713 existing records from primary storage. [2025-09-23T22:21:03.129636] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-09-23T22:21:03.128619] [INFO ] [MAIN ] HGLB: Loaded 9713 primary data records. [2025-09-23T22:21:03.129872] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-23T22:21:03.132098] [INFO ] [MAIN ] Derivative Progress: 861/2077 symbols completed. HESM took 1.3s. Estimated remaining: 7m 56s. Rate: 153.3 symbols/min [2025-09-23T22:21:03.144214] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:03.357307] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:03.472181] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 13005 primary records. [2025-09-23T22:21:03.472498] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-23T22:21:03.504289] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-09-23T22:21:03.504455] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-23T22:21:03.507171] [INFO ] [MAIN ] Derivative Progress: 862/2077 symbols completed. HGER took 1.1s. Estimated remaining: 7m 55s. Rate: 153.3 symbols/min [2025-09-23T22:21:03.507396] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:03.509157] [DEBUG] [LOCAL ] HGV: Loaded 46971 existing records from primary storage. [2025-09-23T22:21:03.509525] [INFO ] [MAIN ] HGV: Loaded 46971 primary data records. [2025-09-23T22:21:03.806830] [DEBUG] [LOCAL ] HHH: Loaded 32677 existing records from primary storage. [2025-09-23T22:21:03.865245] [INFO ] [MAIN ] HHH: Loaded 32677 primary data records. [2025-09-23T22:21:03.916755] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:03.945513] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9713 primary records. [2025-09-23T22:21:03.984922] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-23T22:21:04.205209] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-09-23T22:21:04.206104] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-23T22:21:04.209695] [INFO ] [MAIN ] Derivative Progress: 863/2077 symbols completed. HGLB took 1.1s. Estimated remaining: 7m 55s. Rate: 153.2 symbols/min [2025-09-23T22:21:04.210818] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:04.235383] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:04.236706] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46971 primary records. [2025-09-23T22:21:04.236894] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-23T22:21:04.277820] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-09-23T22:21:04.283027] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:04.283900] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32677 primary records. [2025-09-23T22:21:04.283224] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-23T22:21:04.286300] [INFO ] [MAIN ] Derivative Progress: 864/2077 symbols completed. HGV took 1.1s. Estimated remaining: 7m 55s. Rate: 153.3 symbols/min [2025-09-23T22:21:04.286433] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-23T22:21:04.287509] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:04.314707] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-09-23T22:21:04.315173] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-23T22:21:04.319157] [DEBUG] [LOCAL ] HI: Loaded 35121 existing records from primary storage. [2025-09-23T22:21:04.318185] [INFO ] [MAIN ] Derivative Progress: 865/2077 symbols completed. HHH took 0.8s. Estimated remaining: 7m 54s. Rate: 153.5 symbols/min [2025-09-23T22:21:04.319449] [INFO ] [MAIN ] HI: Loaded 35121 primary data records. [2025-09-23T22:21:04.324959] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:04.699534] [DEBUG] [LOCAL ] HII: Loaded 35268 existing records from primary storage. [2025-09-23T22:21:04.699779] [INFO ] [MAIN ] HII: Loaded 35268 primary data records. [2025-09-23T22:21:04.829103] [DEBUG] [LOCAL ] HIG: Loaded 51268 existing records from primary storage. [2025-09-23T22:21:04.840071] [INFO ] [MAIN ] HIG: Loaded 51268 primary data records. [2025-09-23T22:21:05.393407] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:05.395220] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35121 primary records. [2025-09-23T22:21:05.395984] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-23T22:21:05.415337] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-09-23T22:21:05.415469] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-23T22:21:05.417821] [INFO ] [MAIN ] Derivative Progress: 866/2077 symbols completed. HI took 1.2s. Estimated remaining: 7m 54s. Rate: 153.2 symbols/min [2025-09-23T22:21:05.418702] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:05.437934] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:05.440296] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 35268 primary records. [2025-09-23T22:21:05.440572] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-23T22:21:05.461883] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:05.470306] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51268 primary records. [2025-09-23T22:21:05.475817] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-23T22:21:05.476275] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-09-23T22:21:05.477363] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-23T22:21:05.479752] [INFO ] [MAIN ] Derivative Progress: 867/2077 symbols completed. HII took 1.2s. Estimated remaining: 7m 53s. Rate: 153.3 symbols/min [2025-09-23T22:21:05.487510] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:05.497308] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-09-23T22:21:05.510981] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-23T22:21:05.513758] [INFO ] [MAIN ] Derivative Progress: 868/2077 symbols completed. HIG took 1.2s. Estimated remaining: 7m 53s. Rate: 153.5 symbols/min [2025-09-23T22:21:05.534388] [DEBUG] [LOCAL ] HIO: Loaded 23711 existing records from primary storage. [2025-09-23T22:21:05.534755] [INFO ] [MAIN ] HIO: Loaded 23711 primary data records. [2025-09-23T22:21:05.612827] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-23T22:21:05.624370] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-09-23T22:21:06.177687] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:06.178427] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 23711 primary records. [2025-09-23T22:21:06.178623] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-23T22:21:06.207696] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:06.208700] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-09-23T22:21:06.209317] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-09-23T22:21:06.209388] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-23T22:21:06.211613] [INFO ] [MAIN ] Derivative Progress: 869/2077 symbols completed. HIO took 0.7s. Estimated remaining: 7m 53s. Rate: 153.4 symbols/min [2025-09-23T22:21:06.211880] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-23T22:21:06.227593] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-09-23T22:21:06.227677] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-23T22:21:06.229775] [INFO ] [MAIN ] Derivative Progress: 870/2077 symbols completed. HIMS took 0.8s. Estimated remaining: 7m 52s. Rate: 153.5 symbols/min [2025-09-23T22:21:06.230450] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:06.230516] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:06.231055] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:06.253012] [DEBUG] [LOCAL ] HIX: Loaded 20270 existing records from primary storage. [2025-09-23T22:21:06.257585] [INFO ] [MAIN ] HIX: Loaded 20270 primary data records. [2025-09-23T22:21:06.373595] [DEBUG] [LOCAL ] HIPO: Loaded 22692 existing records from primary storage. [2025-09-23T22:21:06.378212] [INFO ] [MAIN ] HIPO: Loaded 22692 primary data records. [2025-09-23T22:21:06.702787] [DEBUG] [LOCAL ] HIW: Loaded 44739 existing records from primary storage. [2025-09-23T22:21:06.703601] [INFO ] [MAIN ] HIW: Loaded 44739 primary data records. [2025-09-23T22:21:07.305897] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:07.309203] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20270 primary records. [2025-09-23T22:21:07.309346] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-23T22:21:07.335210] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:07.336428] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22692 primary records. [2025-09-23T22:21:07.337534] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-23T22:21:07.357918] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-09-23T22:21:07.358023] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-09-23T22:21:07.358189] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-23T22:21:07.359322] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-23T22:21:07.361535] [INFO ] [MAIN ] Derivative Progress: 871/2077 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 52s. Rate: 153.2 symbols/min [2025-09-23T22:21:07.361888] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:07.365276] [INFO ] [MAIN ] Derivative Progress: 872/2077 symbols completed. HIX took 1.1s. Estimated remaining: 7m 51s. Rate: 153.4 symbols/min [2025-09-23T22:21:07.366689] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:07.380389] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:07.381257] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44739 primary records. [2025-09-23T22:21:07.381375] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-23T22:21:07.401844] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-09-23T22:21:07.401928] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-23T22:21:07.404470] [INFO ] [MAIN ] Derivative Progress: 873/2077 symbols completed. HIW took 1.2s. Estimated remaining: 7m 51s. Rate: 153.5 symbols/min [2025-09-23T22:21:07.404883] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:07.413477] [DEBUG] [LOCAL ] HKD: Loaded 18303 existing records from primary storage. [2025-09-23T22:21:07.413776] [INFO ] [MAIN ] HKD: Loaded 18303 primary data records. [2025-09-23T22:21:07.778867] [DEBUG] [LOCAL ] HLF: Loaded 48724 existing records from primary storage. [2025-09-23T22:21:07.779565] [INFO ] [MAIN ] HLF: Loaded 48724 primary data records. [2025-09-23T22:21:07.802485] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-23T22:21:07.820872] [INFO ] [MAIN ] HL: Loaded 53670 primary data records. [2025-09-23T22:21:08.493867] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:08.494825] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18303 primary records. [2025-09-23T22:21:08.494926] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-23T22:21:08.515614] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-09-23T22:21:08.515894] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-23T22:21:08.520257] [INFO ] [MAIN ] Derivative Progress: 874/2077 symbols completed. HKD took 1.2s. Estimated remaining: 7m 51s. Rate: 153.2 symbols/min [2025-09-23T22:21:08.521269] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:08.546285] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:08.548780] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53670 primary records. [2025-09-23T22:21:08.549595] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-23T22:21:08.575746] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:08.584765] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48724 primary records. [2025-09-23T22:21:08.588801] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-23T22:21:08.588957] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-09-23T22:21:08.589903] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-23T22:21:08.592593] [INFO ] [MAIN ] Derivative Progress: 875/2077 symbols completed. HL took 1.2s. Estimated remaining: 7m 50s. Rate: 153.3 symbols/min [2025-09-23T22:21:08.612484] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:08.614847] [DEBUG] [LOCAL ] HLI: Loaded 31220 existing records from primary storage. [2025-09-23T22:21:08.618834] [INFO ] [MAIN ] HLI: Loaded 31220 primary data records. [2025-09-23T22:21:08.634187] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-09-23T22:21:08.643913] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-23T22:21:08.661861] [INFO ] [MAIN ] Derivative Progress: 876/2077 symbols completed. HLF took 1.3s. Estimated remaining: 7m 49s. Rate: 153.5 symbols/min [2025-09-23T22:21:08.695531] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:08.951752] [DEBUG] [LOCAL ] HLIO: Loaded 28199 existing records from primary storage. [2025-09-23T22:21:08.951989] [INFO ] [MAIN ] HLIO: Loaded 28199 primary data records. [2025-09-23T22:21:09.069337] [DEBUG] [LOCAL ] HLLY: Loaded 33384 existing records from primary storage. [2025-09-23T22:21:09.080242] [INFO ] [MAIN ] HLLY: Loaded 33384 primary data records. [2025-09-23T22:21:09.648341] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:09.649507] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 31220 primary records. [2025-09-23T22:21:09.651213] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-23T22:21:09.688449] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-09-23T22:21:09.688225] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:09.689346] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28199 primary records. [2025-09-23T22:21:09.689570] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-23T22:21:09.688668] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-23T22:21:09.691987] [INFO ] [MAIN ] Derivative Progress: 877/2077 symbols completed. HLI took 1.2s. Estimated remaining: 7m 50s. Rate: 153.2 symbols/min [2025-09-23T22:21:09.693539] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:09.712771] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-09-23T22:21:09.713006] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-23T22:21:09.714961] [INFO ] [MAIN ] Derivative Progress: 878/2077 symbols completed. HLIO took 1.1s. Estimated remaining: 7m 49s. Rate: 153.4 symbols/min [2025-09-23T22:21:09.715440] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:09.730919] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:09.731593] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33384 primary records. [2025-09-23T22:21:09.731684] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-23T22:21:09.747859] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-09-23T22:21:09.748026] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-23T22:21:09.750595] [INFO ] [MAIN ] Derivative Progress: 879/2077 symbols completed. HLLY took 1.1s. Estimated remaining: 7m 48s. Rate: 153.5 symbols/min [2025-09-23T22:21:09.751048] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:09.818201] [DEBUG] [LOCAL ] HLN: Loaded 53090 existing records from primary storage. [2025-09-23T22:21:09.818530] [INFO ] [MAIN ] HLN: Loaded 53090 primary data records. [2025-09-23T22:21:09.954254] [DEBUG] [LOCAL ] HLX: Loaded 48067 existing records from primary storage. [2025-09-23T22:21:09.953250] [DEBUG] [LOCAL ] HLT: Loaded 50736 existing records from primary storage. [2025-09-23T22:21:09.964970] [INFO ] [MAIN ] HLT: Loaded 50736 primary data records. [2025-09-23T22:21:09.964890] [INFO ] [MAIN ] HLX: Loaded 48067 primary data records. [2025-09-23T22:21:10.794253] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:10.795101] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53090 primary records. [2025-09-23T22:21:10.795271] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-23T22:21:10.812189] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-09-23T22:21:10.812448] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-23T22:21:10.815900] [INFO ] [MAIN ] Derivative Progress: 880/2077 symbols completed. HLN took 1.1s. Estimated remaining: 7m 49s. Rate: 153.2 symbols/min [2025-09-23T22:21:10.816863] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:10.840548] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:10.846427] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 48067 primary records. [2025-09-23T22:21:10.846570] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-23T22:21:10.845566] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:10.847618] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50736 primary records. [2025-09-23T22:21:10.848142] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-23T22:21:10.877819] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-09-23T22:21:10.879279] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-09-23T22:21:10.879483] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-23T22:21:10.879429] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-23T22:21:10.881764] [INFO ] [MAIN ] Derivative Progress: 881/2077 symbols completed. HLX took 1.1s. Estimated remaining: 7m 48s. Rate: 153.4 symbols/min [2025-09-23T22:21:10.884732] [INFO ] [MAIN ] Derivative Progress: 882/2077 symbols completed. HLT took 1.2s. Estimated remaining: 7m 47s. Rate: 153.5 symbols/min [2025-09-23T22:21:10.884957] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:10.884830] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:10.922305] [DEBUG] [LOCAL ] HMC: Loaded 46861 existing records from primary storage. [2025-09-23T22:21:10.922450] [INFO ] [MAIN ] HMC: Loaded 46861 primary data records. [2025-09-23T22:21:10.985688] [DEBUG] [LOCAL ] HMN: Loaded 23395 existing records from primary storage. [2025-09-23T22:21:11.006269] [INFO ] [MAIN ] HMN: Loaded 23395 primary data records. [2025-09-23T22:21:11.245025] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-09-23T22:21:11.255851] [INFO ] [MAIN ] HMY: Loaded 53136 primary data records. [2025-09-23T22:21:11.947553] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:11.949287] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46861 primary records. [2025-09-23T22:21:11.949700] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-23T22:21:11.975236] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:11.976367] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23395 primary records. [2025-09-23T22:21:11.976851] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-23T22:21:11.989295] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-09-23T22:21:11.989603] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-23T22:21:11.995757] [INFO ] [MAIN ] Derivative Progress: 883/2077 symbols completed. HMC took 1.2s. Estimated remaining: 7m 48s. Rate: 153.2 symbols/min [2025-09-23T22:21:12.001373] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-09-23T22:21:12.002071] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-23T22:21:12.004441] [INFO ] [MAIN ] Derivative Progress: 884/2077 symbols completed. HMN took 1.1s. Estimated remaining: 7m 47s. Rate: 153.4 symbols/min [2025-09-23T22:21:12.016928] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:12.017467] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53136 primary records. [2025-09-23T22:21:12.017525] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-23T22:21:12.032519] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-09-23T22:21:12.032588] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-23T22:21:12.035098] [INFO ] [MAIN ] Derivative Progress: 885/2077 symbols completed. HMY took 1.2s. Estimated remaining: 7m 46s. Rate: 153.6 symbols/min [2025-09-23T22:21:12.035723] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:12.035988] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:12.035589] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:12.100083] [DEBUG] [LOCAL ] HNI: Loaded 28779 existing records from primary storage. [2025-09-23T22:21:12.114242] [INFO ] [MAIN ] HNI: Loaded 28779 primary data records. [2025-09-23T22:21:12.115170] [DEBUG] [LOCAL ] HOG: Loaded 51251 existing records from primary storage. [2025-09-23T22:21:12.160323] [INFO ] [MAIN ] HOG: Loaded 51251 primary data records. [2025-09-23T22:21:12.236908] [DEBUG] [LOCAL ] HOMB: Loaded 43632 existing records from primary storage. [2025-09-23T22:21:12.283162] [INFO ] [MAIN ] HOMB: Loaded 43632 primary data records. [2025-09-23T22:21:13.115516] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:13.131228] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 28779 primary records. [2025-09-23T22:21:13.130426] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:13.131529] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-23T22:21:13.133171] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51251 primary records. [2025-09-23T22:21:13.146351] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-23T22:21:13.146856] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:13.155903] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43632 primary records. [2025-09-23T22:21:13.161981] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-23T22:21:13.163540] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-09-23T22:21:13.177979] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-23T22:21:13.188073] [INFO ] [MAIN ] Derivative Progress: 886/2077 symbols completed. HNI took 1.2s. Estimated remaining: 7m 46s. Rate: 153.2 symbols/min [2025-09-23T22:21:13.188881] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-09-23T22:21:13.192343] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-23T22:21:13.195562] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:13.195945] [INFO ] [MAIN ] Derivative Progress: 887/2077 symbols completed. HOG took 1.2s. Estimated remaining: 7m 45s. Rate: 153.4 symbols/min [2025-09-23T22:21:13.197095] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:13.201883] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-09-23T22:21:13.201961] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-23T22:21:13.204598] [INFO ] [MAIN ] Derivative Progress: 888/2077 symbols completed. HOMB took 1.2s. Estimated remaining: 7m 45s. Rate: 153.6 symbols/min [2025-09-23T22:21:13.204869] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:13.216830] [DEBUG] [LOCAL ] HOV: Loaded 13783 existing records from primary storage. [2025-09-23T22:21:13.217030] [INFO ] [MAIN ] HOV: Loaded 13783 primary data records. [2025-09-23T22:21:13.589998] [DEBUG] [LOCAL ] HOUS: Loaded 44099 existing records from primary storage. [2025-09-23T22:21:13.590717] [INFO ] [MAIN ] HOUS: Loaded 44099 primary data records. [2025-09-23T22:21:13.678530] [DEBUG] [LOCAL ] HP: Loaded 51614 existing records from primary storage. [2025-09-23T22:21:13.692208] [INFO ] [MAIN ] HP: Loaded 51614 primary data records. [2025-09-23T22:21:14.231167] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:14.232755] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13783 primary records. [2025-09-23T22:21:14.232969] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-23T22:21:14.250413] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-09-23T22:21:14.251567] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-23T22:21:14.254309] [INFO ] [MAIN ] Derivative Progress: 889/2077 symbols completed. HOV took 1.1s. Estimated remaining: 7m 45s. Rate: 153.3 symbols/min [2025-09-23T22:21:14.254905] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:14.273353] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:14.274148] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 44099 primary records. [2025-09-23T22:21:14.274420] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-23T22:21:14.308557] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-09-23T22:21:14.309081] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:14.309280] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-23T22:21:14.311945] [INFO ] [MAIN ] Derivative Progress: 890/2077 symbols completed. HOUS took 1.1s. Estimated remaining: 7m 44s. Rate: 153.4 symbols/min [2025-09-23T22:21:14.310021] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51614 primary records. [2025-09-23T22:21:14.312269] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:14.312413] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-23T22:21:14.335402] [DEBUG] [LOCAL ] HPF: Loaded 7292 existing records from primary storage. [2025-09-23T22:21:14.350075] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-09-23T22:21:14.350171] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-23T22:21:14.349507] [INFO ] [MAIN ] HPF: Loaded 7292 primary data records. [2025-09-23T22:21:14.352734] [INFO ] [MAIN ] Derivative Progress: 891/2077 symbols completed. HP took 1.1s. Estimated remaining: 7m 43s. Rate: 153.6 symbols/min [2025-09-23T22:21:14.353049] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:14.478489] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-23T22:21:14.494730] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-09-23T22:21:14.570410] [DEBUG] [LOCAL ] HPI: Loaded 10123 existing records from primary storage. [2025-09-23T22:21:14.771349] [INFO ] [MAIN ] HPI: Loaded 10123 primary data records. [2025-09-23T22:21:15.425340] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:15.426819] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7292 primary records. [2025-09-23T22:21:15.427025] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-23T22:21:15.464246] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-09-23T22:21:15.463362] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:15.465309] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-09-23T22:21:15.464723] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-23T22:21:15.465701] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-23T22:21:15.467724] [INFO ] [MAIN ] Derivative Progress: 892/2077 symbols completed. HPF took 1.2s. Estimated remaining: 7m 44s. Rate: 153.2 symbols/min [2025-09-23T22:21:15.468071] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:15.488519] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-09-23T22:21:15.488836] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-23T22:21:15.491316] [INFO ] [MAIN ] Derivative Progress: 893/2077 symbols completed. HPE took 1.2s. Estimated remaining: 7m 43s. Rate: 153.4 symbols/min [2025-09-23T22:21:15.504596] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:15.505550] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:15.506410] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10123 primary records. [2025-09-23T22:21:15.506626] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-23T22:21:15.526248] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-09-23T22:21:15.526782] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-23T22:21:15.529349] [INFO ] [MAIN ] Derivative Progress: 894/2077 symbols completed. HPI took 1.2s. Estimated remaining: 7m 42s. Rate: 153.6 symbols/min [2025-09-23T22:21:15.529702] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:15.558129] [DEBUG] [LOCAL ] HPS: Loaded 10223 existing records from primary storage. [2025-09-23T22:21:15.558462] [INFO ] [MAIN ] HPS: Loaded 10223 primary data records. [2025-09-23T22:21:15.647712] [DEBUG] [LOCAL ] HPP: Loaded 50822 existing records from primary storage. [2025-09-23T22:21:15.673846] [INFO ] [MAIN ] HPP: Loaded 50822 primary data records. [2025-09-23T22:21:15.856195] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-23T22:21:15.886006] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-09-23T22:21:16.579758] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:16.580554] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10223 primary records. [2025-09-23T22:21:16.578763] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:16.580758] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-23T22:21:16.581458] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 50822 primary records. [2025-09-23T22:21:16.589425] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-23T22:21:16.595420] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:16.607451] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-09-23T22:21:16.614854] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-23T22:21:16.624237] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-09-23T22:21:16.624545] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-23T22:21:16.626829] [INFO ] [MAIN ] Derivative Progress: 895/2077 symbols completed. HPS took 1.1s. Estimated remaining: 7m 43s. Rate: 153.3 symbols/min [2025-09-23T22:21:16.637969] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:16.643089] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-09-23T22:21:16.644024] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-23T22:21:16.647034] [INFO ] [MAIN ] Derivative Progress: 896/2077 symbols completed. HPQ took 1.1s. Estimated remaining: 7m 42s. Rate: 153.4 symbols/min [2025-09-23T22:21:16.647981] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:16.649818] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-09-23T22:21:16.650021] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-23T22:21:16.652282] [INFO ] [MAIN ] Derivative Progress: 897/2077 symbols completed. HPP took 1.2s. Estimated remaining: 7m 41s. Rate: 153.6 symbols/min [2025-09-23T22:21:16.652538] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:16.672354] [DEBUG] [LOCAL ] HQL: Loaded 15826 existing records from primary storage. [2025-09-23T22:21:16.672484] [INFO ] [MAIN ] HQL: Loaded 15826 primary data records. [2025-09-23T22:21:16.763273] [DEBUG] [LOCAL ] HQH: Loaded 24832 existing records from primary storage. [2025-09-23T22:21:16.785439] [INFO ] [MAIN ] HQH: Loaded 24832 primary data records. [2025-09-23T22:21:17.141427] [DEBUG] [LOCAL ] HR: Loaded 51956 existing records from primary storage. [2025-09-23T22:21:17.158020] [INFO ] [MAIN ] HR: Loaded 51956 primary data records. [2025-09-23T22:21:17.803121] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:17.804949] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 15826 primary records. [2025-09-23T22:21:17.806193] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-23T22:21:17.847066] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-09-23T22:21:17.847849] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-23T22:21:17.847766] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:17.850481] [INFO ] [MAIN ] Derivative Progress: 898/2077 symbols completed. HQL took 1.2s. Estimated remaining: 7m 42s. Rate: 153.2 symbols/min [2025-09-23T22:21:17.851669] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 24832 primary records. [2025-09-23T22:21:17.852330] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-23T22:21:17.899421] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:17.903038] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-09-23T22:21:17.903394] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51956 primary records. [2025-09-23T22:21:17.903742] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-23T22:21:17.907498] [INFO ] [MAIN ] Derivative Progress: 899/2077 symbols completed. HQH took 1.3s. Estimated remaining: 7m 41s. Rate: 153.4 symbols/min [2025-09-23T22:21:17.908068] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-23T22:21:17.928744] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-09-23T22:21:17.928938] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-23T22:21:17.932838] [INFO ] [MAIN ] Derivative Progress: 900/2077 symbols completed. HR took 1.3s. Estimated remaining: 7m 40s. Rate: 153.5 symbols/min [2025-09-23T22:21:17.933886] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:17.934310] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:17.934470] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:18.034000] [DEBUG] [LOCAL ] HRI: Loaded 33171 existing records from primary storage. [2025-09-23T22:21:18.034414] [INFO ] [MAIN ] HRI: Loaded 33171 primary data records. [2025-09-23T22:21:18.144185] [DEBUG] [LOCAL ] HRL: Loaded 53088 existing records from primary storage. [2025-09-23T22:21:18.197311] [DEBUG] [LOCAL ] HRB: Loaded 48618 existing records from primary storage. [2025-09-23T22:21:18.190929] [INFO ] [MAIN ] HRL: Loaded 53088 primary data records. [2025-09-23T22:21:18.208586] [INFO ] [MAIN ] HRB: Loaded 48618 primary data records. [2025-09-23T22:21:19.303797] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:19.305526] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 33171 primary records. [2025-09-23T22:21:19.305741] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-23T22:21:19.338353] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-09-23T22:21:19.338481] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-23T22:21:19.336932] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:19.339981] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48618 primary records. [2025-09-23T22:21:19.341850] [INFO ] [MAIN ] Derivative Progress: 901/2077 symbols completed. HRI took 1.4s. Estimated remaining: 7m 41s. Rate: 153.1 symbols/min [2025-09-23T22:21:19.342054] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-23T22:21:19.343204] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:19.368543] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:19.372500] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53088 primary records. [2025-09-23T22:21:19.372942] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-23T22:21:19.373995] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-09-23T22:21:19.375015] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-23T22:21:19.389639] [INFO ] [MAIN ] Derivative Progress: 902/2077 symbols completed. HRB took 1.5s. Estimated remaining: 7m 40s. Rate: 153.2 symbols/min [2025-09-23T22:21:19.390732] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:19.405763] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-09-23T22:21:19.406011] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-23T22:21:19.408541] [INFO ] [MAIN ] Derivative Progress: 903/2077 symbols completed. HRL took 1.5s. Estimated remaining: 7m 39s. Rate: 153.4 symbols/min [2025-09-23T22:21:19.409008] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:19.425084] [DEBUG] [LOCAL ] HRTG: Loaded 32918 existing records from primary storage. [2025-09-23T22:21:19.425232] [INFO ] [MAIN ] HRTG: Loaded 32918 primary data records. [2025-09-23T22:21:19.555395] [DEBUG] [LOCAL ] HSHP: Loaded 15671 existing records from primary storage. [2025-09-23T22:21:19.566236] [INFO ] [MAIN ] HSHP: Loaded 15671 primary data records. [2025-09-23T22:21:19.913554] [DEBUG] [LOCAL ] HSBC: Loaded 51156 existing records from primary storage. [2025-09-23T22:21:19.920725] [INFO ] [MAIN ] HSBC: Loaded 51156 primary data records. [2025-09-23T22:21:20.531143] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:20.532544] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 32918 primary records. [2025-09-23T22:21:20.532836] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-23T22:21:20.554550] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-09-23T22:21:20.554990] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-23T22:21:20.564667] [INFO ] [MAIN ] Derivative Progress: 904/2077 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 40s. Rate: 153.1 symbols/min [2025-09-23T22:21:20.565037] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:20.570900] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:20.571561] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15671 primary records. [2025-09-23T22:21:20.571854] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-23T22:21:20.603522] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:20.604069] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-09-23T22:21:20.604201] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-23T22:21:20.604938] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 51156 primary records. [2025-09-23T22:21:20.607727] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-23T22:21:20.607539] [INFO ] [MAIN ] Derivative Progress: 905/2077 symbols completed. HSHP took 1.2s. Estimated remaining: 7m 39s. Rate: 153.2 symbols/min [2025-09-23T22:21:20.608798] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:20.625448] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-09-23T22:21:20.625600] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-23T22:21:20.632376] [INFO ] [MAIN ] Derivative Progress: 906/2077 symbols completed. HSBC took 1.2s. Estimated remaining: 7m 38s. Rate: 153.4 symbols/min [2025-09-23T22:21:20.632765] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:20.649424] [DEBUG] [LOCAL ] HTD: Loaded 13506 existing records from primary storage. [2025-09-23T22:21:20.649598] [INFO ] [MAIN ] HTD: Loaded 13506 primary data records. [2025-09-23T22:21:20.782389] [DEBUG] [LOCAL ] HSY: Loaded 50459 existing records from primary storage. [2025-09-23T22:21:20.793281] [INFO ] [MAIN ] HSY: Loaded 50459 primary data records. [2025-09-23T22:21:21.178819] [DEBUG] [LOCAL ] HTGC: Loaded 47566 existing records from primary storage. [2025-09-23T22:21:21.179492] [INFO ] [MAIN ] HTGC: Loaded 47566 primary data records. [2025-09-23T22:21:21.690937] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:21.692095] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13506 primary records. [2025-09-23T22:21:21.692308] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-23T22:21:21.730163] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:21.731460] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50459 primary records. [2025-09-23T22:21:21.731600] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-23T22:21:21.729788] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-09-23T22:21:21.732600] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-23T22:21:21.735312] [INFO ] [MAIN ] Derivative Progress: 907/2077 symbols completed. HTD took 1.1s. Estimated remaining: 7m 39s. Rate: 153.1 symbols/min [2025-09-23T22:21:21.742955] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:21.755021] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-09-23T22:21:21.755311] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-23T22:21:21.757708] [INFO ] [MAIN ] Derivative Progress: 908/2077 symbols completed. HSY took 1.2s. Estimated remaining: 7m 38s. Rate: 153.2 symbols/min [2025-09-23T22:21:21.766532] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:21.772061] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:21.773061] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47566 primary records. [2025-09-23T22:21:21.773532] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-23T22:21:21.803370] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-09-23T22:21:21.803731] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-23T22:21:21.806492] [INFO ] [MAIN ] Derivative Progress: 909/2077 symbols completed. HTGC took 1.2s. Estimated remaining: 7m 37s. Rate: 153.4 symbols/min [2025-09-23T22:21:21.806962] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:21.819828] [DEBUG] [LOCAL ] HTH: Loaded 32495 existing records from primary storage. [2025-09-23T22:21:21.820099] [INFO ] [MAIN ] HTH: Loaded 32495 primary data records. [2025-09-23T22:21:22.193233] [DEBUG] [LOCAL ] HUBB: Loaded 37249 existing records from primary storage. [2025-09-23T22:21:22.199929] [INFO ] [MAIN ] HUBB: Loaded 37249 primary data records. [2025-09-23T22:21:22.222638] [DEBUG] [LOCAL ] HUBS: Loaded 39541 existing records from primary storage. [2025-09-23T22:21:22.242610] [INFO ] [MAIN ] HUBS: Loaded 39541 primary data records. [2025-09-23T22:21:22.853708] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:22.854686] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32495 primary records. [2025-09-23T22:21:22.854824] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-23T22:21:22.873795] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-09-23T22:21:22.874085] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-23T22:21:22.876464] [INFO ] [MAIN ] Derivative Progress: 910/2077 symbols completed. HTH took 1.1s. Estimated remaining: 7m 37s. Rate: 153.1 symbols/min [2025-09-23T22:21:22.877400] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:22.910728] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:22.910433] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:22.911592] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 37249 primary records. [2025-09-23T22:21:22.912255] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39541 primary records. [2025-09-23T22:21:22.912355] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-23T22:21:22.912489] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-23T22:21:22.945973] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-09-23T22:21:22.946441] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-09-23T22:21:22.946751] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-23T22:21:22.946844] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-23T22:21:22.958837] [INFO ] [MAIN ] Derivative Progress: 911/2077 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 37s. Rate: 153.2 symbols/min [2025-09-23T22:21:22.961514] [INFO ] [MAIN ] Derivative Progress: 912/2077 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 36s. Rate: 153.4 symbols/min [2025-09-23T22:21:22.961707] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:22.961967] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:22.981432] [DEBUG] [LOCAL ] HUM: Loaded 48892 existing records from primary storage. [2025-09-23T22:21:22.981749] [INFO ] [MAIN ] HUM: Loaded 48892 primary data records. [2025-09-23T22:21:23.321302] [DEBUG] [LOCAL ] HUYA: Loaded 44441 existing records from primary storage. [2025-09-23T22:21:23.329825] [INFO ] [MAIN ] HUYA: Loaded 44441 primary data records. [2025-09-23T22:21:23.390318] [DEBUG] [LOCAL ] HUN: Loaded 53203 existing records from primary storage. [2025-09-23T22:21:23.396497] [INFO ] [MAIN ] HUN: Loaded 53203 primary data records. [2025-09-23T22:21:23.984480] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:23.985690] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 48892 primary records. [2025-09-23T22:21:23.986018] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-23T22:21:24.006335] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-09-23T22:21:24.007903] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-23T22:21:24.011030] [INFO ] [MAIN ] Derivative Progress: 913/2077 symbols completed. HUM took 1.1s. Estimated remaining: 7m 36s. Rate: 153.1 symbols/min [2025-09-23T22:21:24.047545] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:24.047370] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:24.048369] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53203 primary records. [2025-09-23T22:21:24.049020] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 44441 primary records. [2025-09-23T22:21:24.049135] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-23T22:21:24.049177] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-23T22:21:24.081356] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-09-23T22:21:24.081935] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-23T22:21:24.085099] [INFO ] [MAIN ] Derivative Progress: 914/2077 symbols completed. HUYA took 1.1s. Estimated remaining: 7m 35s. Rate: 153.2 symbols/min [2025-09-23T22:21:24.086603] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-09-23T22:21:24.086694] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-23T22:21:24.089173] [INFO ] [MAIN ] Derivative Progress: 915/2077 symbols completed. HUN took 1.1s. Estimated remaining: 7m 34s. Rate: 153.4 symbols/min [2025-09-23T22:21:24.089935] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:24.089831] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:24.089998] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:24.108857] [DEBUG] [LOCAL ] HVT: Loaded 16034 existing records from primary storage. [2025-09-23T22:21:24.108991] [INFO ] [MAIN ] HVT: Loaded 16034 primary data records. [2025-09-23T22:21:24.504172] [DEBUG] [LOCAL ] HXL: Loaded 46079 existing records from primary storage. [2025-09-23T22:21:24.505618] [INFO ] [MAIN ] HXL: Loaded 46079 primary data records. [2025-09-23T22:21:24.608621] [DEBUG] [LOCAL ] HWM: Loaded 53013 existing records from primary storage. [2025-09-23T22:21:24.632685] [INFO ] [MAIN ] HWM: Loaded 53013 primary data records. [2025-09-23T22:21:25.181857] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:25.183907] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 16034 primary records. [2025-09-23T22:21:25.184507] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-23T22:21:25.203368] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-09-23T22:21:25.204125] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-23T22:21:25.207101] [INFO ] [MAIN ] Derivative Progress: 916/2077 symbols completed. HVT took 1.1s. Estimated remaining: 7m 35s. Rate: 153.1 symbols/min [2025-09-23T22:21:25.207620] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:25.229044] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:25.229901] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 46079 primary records. [2025-09-23T22:21:25.230104] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-23T22:21:25.235997] [DEBUG] [LOCAL ] HY: Loaded 10134 existing records from primary storage. [2025-09-23T22:21:25.247240] [INFO ] [MAIN ] HY: Loaded 10134 primary data records. [2025-09-23T22:21:25.390524] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:25.393951] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 53013 primary records. [2025-09-23T22:21:25.394120] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-23T22:21:25.393109] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-09-23T22:21:25.405586] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-23T22:21:25.417988] [INFO ] [MAIN ] Derivative Progress: 917/2077 symbols completed. HXL took 1.3s. Estimated remaining: 7m 34s. Rate: 153.2 symbols/min [2025-09-23T22:21:25.418278] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:25.620806] [DEBUG] [LOCAL ] HYI: Loaded 8893 existing records from primary storage. [2025-09-23T22:21:25.621939] [INFO ] [MAIN ] HYI: Loaded 8893 primary data records. [2025-09-23T22:21:25.627201] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-09-23T22:21:25.634912] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-23T22:21:25.660371] [INFO ] [MAIN ] Derivative Progress: 918/2077 symbols completed. HWM took 1.6s. Estimated remaining: 7m 34s. Rate: 153.2 symbols/min [2025-09-23T22:21:25.681327] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:25.987911] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:25.989059] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10134 primary records. [2025-09-23T22:21:25.990201] [DEBUG] [LOCAL ] HYT: Loaded 33213 existing records from primary storage. [2025-09-23T22:21:25.990553] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-23T22:21:25.990427] [INFO ] [MAIN ] HYT: Loaded 33213 primary data records. [2025-09-23T22:21:26.097241] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-09-23T22:21:26.117783] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-23T22:21:26.130046] [INFO ] [MAIN ] Derivative Progress: 919/2077 symbols completed. HY took 0.9s. Estimated remaining: 7m 33s. Rate: 153.2 symbols/min [2025-09-23T22:21:26.141434] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:26.370888] [DEBUG] [LOCAL ] HYTR: Loaded 3182 existing records from primary storage. [2025-09-23T22:21:26.394240] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:26.393910] [INFO ] [MAIN ] HYTR: Loaded 3182 primary data records. [2025-09-23T22:21:26.395105] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 8893 primary records. [2025-09-23T22:21:26.395353] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-23T22:21:26.583930] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-09-23T22:21:26.596583] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-23T22:21:26.642483] [INFO ] [MAIN ] Derivative Progress: 920/2077 symbols completed. HYI took 1.2s. Estimated remaining: 7m 33s. Rate: 153.2 symbols/min [2025-09-23T22:21:26.769745] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:26.796171] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:26.797108] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33213 primary records. [2025-09-23T22:21:26.797480] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-23T22:21:26.825816] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-09-23T22:21:26.826126] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-23T22:21:26.828424] [INFO ] [MAIN ] Derivative Progress: 921/2077 symbols completed. HYT took 1.2s. Estimated remaining: 7m 33s. Rate: 153.2 symbols/min [2025-09-23T22:21:26.828881] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:26.842397] [DEBUG] [LOCAL ] HZO: Loaded 29357 existing records from primary storage. [2025-09-23T22:21:26.842772] [INFO ] [MAIN ] HZO: Loaded 29357 primary data records. [2025-09-23T22:21:26.909935] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:21:26.953569] [DEBUG] [LOCAL ] IAE: Loaded 5892 existing records from primary storage. [2025-09-23T22:21:26.948171] [INFO ] [MAIN ] HYTR: Generated 1792 derivative records from 3182 primary records. [2025-09-23T22:21:26.960050] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-23T22:21:26.959847] [INFO ] [MAIN ] IAE: Loaded 5892 primary data records. [2025-09-23T22:21:27.197974] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1792 records). [2025-09-23T22:21:27.240627] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-23T22:21:27.372704] [INFO ] [MAIN ] Derivative Progress: 922/2077 symbols completed. HYTR took 1.2s. Estimated remaining: 7m 32s. Rate: 153.2 symbols/min [2025-09-23T22:21:27.508852] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:27.544118] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:27.544929] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29357 primary records. [2025-09-23T22:21:27.552701] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-23T22:21:27.558429] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:27.566435] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 5892 primary records. [2025-09-23T22:21:27.567601] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-23T22:21:27.595889] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-09-23T22:21:27.599781] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-23T22:21:27.601881] [INFO ] [MAIN ] Derivative Progress: 923/2077 symbols completed. HZO took 0.8s. Estimated remaining: 7m 32s. Rate: 153.2 symbols/min [2025-09-23T22:21:27.602235] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:27.609701] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-09-23T22:21:27.623102] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-23T22:21:27.625834] [INFO ] [MAIN ] Derivative Progress: 924/2077 symbols completed. IAE took 0.8s. Estimated remaining: 7m 31s. Rate: 153.4 symbols/min [2025-09-23T22:21:27.627432] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:27.629116] [DEBUG] [LOCAL ] IAG: Loaded 53442 existing records from primary storage. [2025-09-23T22:21:27.629441] [INFO ] [MAIN ] IAG: Loaded 53442 primary data records. [2025-09-23T22:21:27.998426] [DEBUG] [LOCAL ] IBM: Loaded 53639 existing records from primary storage. [2025-09-23T22:21:27.999785] [INFO ] [MAIN ] IBM: Loaded 53639 primary data records. [2025-09-23T22:21:28.020379] [DEBUG] [LOCAL ] IBN: Loaded 52892 existing records from primary storage. [2025-09-23T22:21:28.071679] [INFO ] [MAIN ] IBN: Loaded 52892 primary data records. [2025-09-23T22:21:28.671485] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:28.680986] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53442 primary records. [2025-09-23T22:21:28.682262] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-23T22:21:28.703798] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-09-23T22:21:28.704270] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-23T22:21:28.706518] [INFO ] [MAIN ] Derivative Progress: 925/2077 symbols completed. IAG took 1.2s. Estimated remaining: 7m 31s. Rate: 153.1 symbols/min [2025-09-23T22:21:28.707476] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:28.731945] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:28.733003] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53639 primary records. [2025-09-23T22:21:28.744791] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-23T22:21:28.745962] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:28.746786] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52892 primary records. [2025-09-23T22:21:28.747101] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-23T22:21:28.782868] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-09-23T22:21:28.791247] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-23T22:21:28.794006] [INFO ] [MAIN ] Derivative Progress: 926/2077 symbols completed. IBN took 1.2s. Estimated remaining: 7m 31s. Rate: 153.2 symbols/min [2025-09-23T22:21:28.795429] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:28.798567] [DEBUG] [LOCAL ] IBP: Loaded 29338 existing records from primary storage. [2025-09-23T22:21:28.799358] [INFO ] [MAIN ] IBP: Loaded 29338 primary data records. [2025-09-23T22:21:28.799897] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-09-23T22:21:28.811681] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-23T22:21:28.813866] [INFO ] [MAIN ] Derivative Progress: 927/2077 symbols completed. IBM took 1.2s. Estimated remaining: 7m 30s. Rate: 153.4 symbols/min [2025-09-23T22:21:28.846515] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:29.123855] [DEBUG] [LOCAL ] IBTA: Loaded 38052 existing records from primary storage. [2025-09-23T22:21:29.124042] [INFO ] [MAIN ] IBTA: Loaded 38052 primary data records. [2025-09-23T22:21:29.362435] [DEBUG] [LOCAL ] ICE: Loaded 53019 existing records from primary storage. [2025-09-23T22:21:29.388933] [INFO ] [MAIN ] ICE: Loaded 53019 primary data records. [2025-09-23T22:21:29.846412] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:29.847400] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 29338 primary records. [2025-09-23T22:21:29.847606] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-23T22:21:29.867850] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-09-23T22:21:29.871336] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-23T22:21:29.873603] [INFO ] [MAIN ] Derivative Progress: 928/2077 symbols completed. IBP took 1.2s. Estimated remaining: 7m 30s. Rate: 153.1 symbols/min [2025-09-23T22:21:29.886885] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:29.887693] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 38052 primary records. [2025-09-23T22:21:29.887843] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-23T22:21:29.906699] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-09-23T22:21:29.906794] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-23T22:21:29.909043] [INFO ] [MAIN ] Derivative Progress: 929/2077 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 29s. Rate: 153.3 symbols/min [2025-09-23T22:21:29.921536] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:29.922121] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53019 primary records. [2025-09-23T22:21:29.922182] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-23T22:21:29.938111] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-09-23T22:21:29.938171] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-23T22:21:29.940345] [INFO ] [MAIN ] Derivative Progress: 930/2077 symbols completed. ICE took 1.1s. Estimated remaining: 7m 29s. Rate: 153.4 symbols/min [2025-09-23T22:21:29.941078] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:29.941142] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:29.941249] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:29.952414] [DEBUG] [LOCAL ] IDE: Loaded 8535 existing records from primary storage. [2025-09-23T22:21:29.952540] [INFO ] [MAIN ] IDE: Loaded 8535 primary data records. [2025-09-23T22:21:30.164252] [DEBUG] [LOCAL ] IDA: Loaded 32000 existing records from primary storage. [2025-09-23T22:21:30.340808] [DEBUG] [LOCAL ] ICL: Loaded 38666 existing records from primary storage. [2025-09-23T22:21:30.341115] [INFO ] [MAIN ] ICL: Loaded 38666 primary data records. [2025-09-23T22:21:30.340939] [INFO ] [MAIN ] IDA: Loaded 32000 primary data records. [2025-09-23T22:21:30.989735] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:30.990698] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8535 primary records. [2025-09-23T22:21:30.991875] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-23T22:21:31.011440] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-09-23T22:21:31.011806] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-23T22:21:31.013961] [INFO ] [MAIN ] Derivative Progress: 931/2077 symbols completed. IDE took 1.1s. Estimated remaining: 7m 29s. Rate: 153.1 symbols/min [2025-09-23T22:21:31.014771] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:31.045340] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:31.066569] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:31.067677] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32000 primary records. [2025-09-23T22:21:31.066211] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38666 primary records. [2025-09-23T22:21:31.067832] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-23T22:21:31.067939] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-23T22:21:31.075977] [DEBUG] [LOCAL ] IDT: Loaded 17675 existing records from primary storage. [2025-09-23T22:21:31.076161] [INFO ] [MAIN ] IDT: Loaded 17675 primary data records. [2025-09-23T22:21:31.240059] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-09-23T22:21:31.270488] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-09-23T22:21:31.261601] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-23T22:21:31.297101] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-23T22:21:31.303166] [INFO ] [MAIN ] Derivative Progress: 932/2077 symbols completed. ICL took 1.4s. Estimated remaining: 7m 29s. Rate: 153.2 symbols/min [2025-09-23T22:21:31.306147] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:31.306049] [INFO ] [MAIN ] Derivative Progress: 933/2077 symbols completed. IDA took 1.4s. Estimated remaining: 7m 28s. Rate: 153.3 symbols/min [2025-09-23T22:21:31.423156] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:31.450917] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:31.451633] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 17675 primary records. [2025-09-23T22:21:31.451835] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-23T22:21:31.490815] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-09-23T22:21:31.502374] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-23T22:21:31.506231] [DEBUG] [LOCAL ] IEX: Loaded 38405 existing records from primary storage. [2025-09-23T22:21:31.504750] [INFO ] [MAIN ] Derivative Progress: 934/2077 symbols completed. IDT took 0.5s. Estimated remaining: 7m 27s. Rate: 153.4 symbols/min [2025-09-23T22:21:31.506535] [INFO ] [MAIN ] IEX: Loaded 38405 primary data records. [2025-09-23T22:21:31.506810] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:31.578517] [DEBUG] [LOCAL ] IFF: Loaded 50969 existing records from primary storage. [2025-09-23T22:21:31.610016] [INFO ] [MAIN ] IFF: Loaded 50969 primary data records. [2025-09-23T22:21:31.750513] [DEBUG] [LOCAL ] IFN: Loaded 18212 existing records from primary storage. [2025-09-23T22:21:31.792735] [INFO ] [MAIN ] IFN: Loaded 18212 primary data records. [2025-09-23T22:21:32.546923] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:32.548121] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38405 primary records. [2025-09-23T22:21:32.548580] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-23T22:21:32.574999] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:32.577527] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 50969 primary records. [2025-09-23T22:21:32.578114] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-23T22:21:32.592788] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-09-23T22:21:32.595981] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-23T22:21:32.599992] [INFO ] [MAIN ] Derivative Progress: 935/2077 symbols completed. IEX took 1.3s. Estimated remaining: 7m 27s. Rate: 153.1 symbols/min [2025-09-23T22:21:32.611216] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:32.612601] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-09-23T22:21:32.617836] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-23T22:21:32.620508] [INFO ] [MAIN ] Derivative Progress: 936/2077 symbols completed. IFF took 1.2s. Estimated remaining: 7m 27s. Rate: 153.3 symbols/min [2025-09-23T22:21:32.621210] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:32.621306] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:32.622322] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18212 primary records. [2025-09-23T22:21:32.622631] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-23T22:21:32.651834] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-09-23T22:21:32.652304] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-23T22:21:32.654784] [INFO ] [MAIN ] Derivative Progress: 937/2077 symbols completed. IFN took 1.1s. Estimated remaining: 7m 26s. Rate: 153.4 symbols/min [2025-09-23T22:21:32.652164] [DEBUG] [LOCAL ] IGA: Loaded 9692 existing records from primary storage. [2025-09-23T22:21:32.655188] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:32.655400] [INFO ] [MAIN ] IGA: Loaded 9692 primary data records. [2025-09-23T22:21:32.705115] [DEBUG] [LOCAL ] IFS: Loaded 23131 existing records from primary storage. [2025-09-23T22:21:32.730419] [INFO ] [MAIN ] IFS: Loaded 23131 primary data records. [2025-09-23T22:21:32.851169] [DEBUG] [LOCAL ] IGD: Loaded 18878 existing records from primary storage. [2025-09-23T22:21:32.883393] [INFO ] [MAIN ] IGD: Loaded 18878 primary data records. [2025-09-23T22:21:33.670211] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:33.671805] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9692 primary records. [2025-09-23T22:21:33.672202] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-23T22:21:33.691269] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-09-23T22:21:33.691940] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-23T22:21:33.695330] [INFO ] [MAIN ] Derivative Progress: 938/2077 symbols completed. IGA took 1.1s. Estimated remaining: 7m 26s. Rate: 153.2 symbols/min [2025-09-23T22:21:33.696087] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:33.727972] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:33.728284] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:33.729120] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 18878 primary records. [2025-09-23T22:21:33.729432] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-23T22:21:33.732897] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 23131 primary records. [2025-09-23T22:21:33.734109] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-23T22:21:33.733779] [DEBUG] [LOCAL ] IGI: Loaded 3685 existing records from primary storage. [2025-09-23T22:21:33.742177] [INFO ] [MAIN ] IGI: Loaded 3685 primary data records. [2025-09-23T22:21:33.885676] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-09-23T22:21:33.896613] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-23T22:21:33.902917] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-09-23T22:21:33.910459] [INFO ] [MAIN ] Derivative Progress: 939/2077 symbols completed. IFS took 1.3s. Estimated remaining: 7m 26s. Rate: 153.2 symbols/min [2025-09-23T22:21:33.908178] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-23T22:21:33.918041] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:33.918131] [INFO ] [MAIN ] Derivative Progress: 940/2077 symbols completed. IGD took 1.3s. Estimated remaining: 7m 25s. Rate: 153.4 symbols/min [2025-09-23T22:21:33.918475] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:34.114234] [DEBUG] [LOCAL ] IH: Loaded 3505 existing records from primary storage. [2025-09-23T22:21:34.115670] [INFO ] [MAIN ] IH: Loaded 3505 primary data records. [2025-09-23T22:21:34.280823] [DEBUG] [LOCAL ] IGR: Loaded 30548 existing records from primary storage. [2025-09-23T22:21:34.334365] [INFO ] [MAIN ] IGR: Loaded 30548 primary data records. [2025-09-23T22:21:34.830227] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:34.831368] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3685 primary records. [2025-09-23T22:21:34.832089] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-23T22:21:34.865118] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-09-23T22:21:34.866049] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:34.866933] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 3505 primary records. [2025-09-23T22:21:34.866130] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-23T22:21:34.867116] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-23T22:21:34.869276] [INFO ] [MAIN ] Derivative Progress: 941/2077 symbols completed. IGI took 1.2s. Estimated remaining: 7m 25s. Rate: 153.2 symbols/min [2025-09-23T22:21:34.870909] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:34.893429] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-09-23T22:21:34.893534] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-23T22:21:34.893345] [DEBUG] [LOCAL ] IHD: Loaded 7247 existing records from primary storage. [2025-09-23T22:21:34.896065] [INFO ] [MAIN ] Derivative Progress: 942/2077 symbols completed. IH took 1.0s. Estimated remaining: 7m 24s. Rate: 153.3 symbols/min [2025-09-23T22:21:34.893812] [INFO ] [MAIN ] IHD: Loaded 7247 primary data records. [2025-09-23T22:21:34.896842] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:35.041427] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:35.083792] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30548 primary records. [2025-09-23T22:21:35.108494] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-23T22:21:35.238158] [DEBUG] [LOCAL ] IHG: Loaded 24663 existing records from primary storage. [2025-09-23T22:21:35.238435] [INFO ] [MAIN ] IHG: Loaded 24663 primary data records. [2025-09-23T22:21:35.305618] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-09-23T22:21:35.313970] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-23T22:21:35.337846] [INFO ] [MAIN ] Derivative Progress: 943/2077 symbols completed. IGR took 1.4s. Estimated remaining: 7m 24s. Rate: 153.3 symbols/min [2025-09-23T22:21:35.581902] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:35.582942] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7247 primary records. [2025-09-23T22:21:35.583047] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-23T22:21:35.599013] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-09-23T22:21:35.599103] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-23T22:21:35.601204] [INFO ] [MAIN ] Derivative Progress: 944/2077 symbols completed. IHD took 0.7s. Estimated remaining: 7m 23s. Rate: 153.3 symbols/min [2025-09-23T22:21:35.618732] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:35.619275] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24663 primary records. [2025-09-23T22:21:35.619335] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-23T22:21:35.635036] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-09-23T22:21:35.635140] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-23T22:21:35.637723] [INFO ] [MAIN ] Derivative Progress: 945/2077 symbols completed. IHG took 0.7s. Estimated remaining: 7m 23s. Rate: 153.5 symbols/min [2025-09-23T22:21:35.638868] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:35.639101] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:35.639230] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:35.647114] [DEBUG] [LOCAL ] IIF: Loaded 5769 existing records from primary storage. [2025-09-23T22:21:35.647225] [INFO ] [MAIN ] IIF: Loaded 5769 primary data records. [2025-09-23T22:21:35.763327] [DEBUG] [LOCAL ] IIIN: Loaded 16764 existing records from primary storage. [2025-09-23T22:21:35.811215] [INFO ] [MAIN ] IIIN: Loaded 16764 primary data records. [2025-09-23T22:21:36.109310] [DEBUG] [LOCAL ] IHS: Loaded 39033 existing records from primary storage. [2025-09-23T22:21:36.139210] [INFO ] [MAIN ] IHS: Loaded 39033 primary data records. [2025-09-23T22:21:36.685552] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:36.686479] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5769 primary records. [2025-09-23T22:21:36.686720] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-23T22:21:36.706764] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-09-23T22:21:36.706980] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-23T22:21:36.709559] [INFO ] [MAIN ] Derivative Progress: 946/2077 symbols completed. IIF took 1.1s. Estimated remaining: 7m 23s. Rate: 153.2 symbols/min [2025-09-23T22:21:36.723219] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:36.724348] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16764 primary records. [2025-09-23T22:21:36.723391] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:36.724716] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-23T22:21:36.755752] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-09-23T22:21:36.756049] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-23T22:21:36.759986] [INFO ] [MAIN ] Derivative Progress: 947/2077 symbols completed. IIIN took 1.1s. Estimated remaining: 7m 22s. Rate: 153.3 symbols/min [2025-09-23T22:21:36.760479] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:36.781523] [DEBUG] [LOCAL ] IIM: Loaded 15910 existing records from primary storage. [2025-09-23T22:21:36.782098] [INFO ] [MAIN ] IIM: Loaded 15910 primary data records. [2025-09-23T22:21:36.781928] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:36.783132] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 39033 primary records. [2025-09-23T22:21:36.789197] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-23T22:21:36.986346] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-09-23T22:21:36.987815] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-23T22:21:37.010166] [INFO ] [MAIN ] Derivative Progress: 948/2077 symbols completed. IHS took 1.4s. Estimated remaining: 7m 22s. Rate: 153.4 symbols/min [2025-09-23T22:21:37.007732] [DEBUG] [LOCAL ] IIPR: Loaded 29629 existing records from primary storage. [2025-09-23T22:21:37.118768] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:37.132732] [INFO ] [MAIN ] IIPR: Loaded 29629 primary data records. [2025-09-23T22:21:37.463009] [DEBUG] [LOCAL ] IMAX: Loaded 42766 existing records from primary storage. [2025-09-23T22:21:37.463615] [INFO ] [MAIN ] IMAX: Loaded 42766 primary data records. [2025-09-23T22:21:37.621448] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:37.669777] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15910 primary records. [2025-09-23T22:21:37.675392] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-23T22:21:37.827841] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:37.828765] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29629 primary records. [2025-09-23T22:21:37.828991] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-23T22:21:37.826591] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-09-23T22:21:37.829268] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-23T22:21:37.832491] [INFO ] [MAIN ] Derivative Progress: 949/2077 symbols completed. IIM took 1.1s. Estimated remaining: 7m 22s. Rate: 153.2 symbols/min [2025-09-23T22:21:37.840164] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:37.849857] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-09-23T22:21:37.850245] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-23T22:21:37.852751] [INFO ] [MAIN ] Derivative Progress: 950/2077 symbols completed. IIPR took 1.1s. Estimated remaining: 7m 21s. Rate: 153.4 symbols/min [2025-09-23T22:21:37.853164] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:37.869099] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:37.869920] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42766 primary records. [2025-09-23T22:21:37.869983] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-23T22:21:37.886433] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-09-23T22:21:37.886577] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-23T22:21:37.888714] [INFO ] [MAIN ] Derivative Progress: 951/2077 symbols completed. IMAX took 0.9s. Estimated remaining: 7m 20s. Rate: 153.5 symbols/min [2025-09-23T22:21:37.889183] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:37.937414] [DEBUG] [LOCAL ] INFA: Loaded 50032 existing records from primary storage. [2025-09-23T22:21:37.937667] [INFO ] [MAIN ] INFA: Loaded 50032 primary data records. [2025-09-23T22:21:38.055749] [DEBUG] [LOCAL ] INFY: Loaded 53600 existing records from primary storage. [2025-09-23T22:21:38.071860] [INFO ] [MAIN ] INFY: Loaded 53600 primary data records. [2025-09-23T22:21:38.414494] [DEBUG] [LOCAL ] ING: Loaded 50806 existing records from primary storage. [2025-09-23T22:21:38.425738] [INFO ] [MAIN ] ING: Loaded 50806 primary data records. [2025-09-23T22:21:38.976053] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:38.977427] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 50032 primary records. [2025-09-23T22:21:38.977896] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-23T22:21:39.002170] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-09-23T22:21:39.002830] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-23T22:21:39.005100] [INFO ] [MAIN ] Derivative Progress: 952/2077 symbols completed. INFA took 1.2s. Estimated remaining: 7m 21s. Rate: 153.2 symbols/min [2025-09-23T22:21:39.018625] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:39.019721] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53600 primary records. [2025-09-23T22:21:39.020089] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-23T22:21:39.018290] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:39.039221] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-09-23T22:21:39.041273] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-23T22:21:39.043797] [INFO ] [MAIN ] Derivative Progress: 953/2077 symbols completed. INFY took 1.2s. Estimated remaining: 7m 20s. Rate: 153.4 symbols/min [2025-09-23T22:21:39.044326] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:39.058062] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:39.059139] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50806 primary records. [2025-09-23T22:21:39.059293] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-23T22:21:39.085545] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-09-23T22:21:39.085717] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-23T22:21:39.088586] [INFO ] [MAIN ] Derivative Progress: 954/2077 symbols completed. ING took 1.2s. Estimated remaining: 7m 19s. Rate: 153.5 symbols/min [2025-09-23T22:21:39.098868] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:39.099886] [DEBUG] [LOCAL ] INGM: Loaded 28874 existing records from primary storage. [2025-09-23T22:21:39.099960] [INFO ] [MAIN ] INGM: Loaded 28874 primary data records. [2025-09-23T22:21:39.422356] [DEBUG] [LOCAL ] INGR: Loaded 33372 existing records from primary storage. [2025-09-23T22:21:39.431310] [INFO ] [MAIN ] INGR: Loaded 33372 primary data records. [2025-09-23T22:21:39.536293] [DEBUG] [LOCAL ] INN: Loaded 41945 existing records from primary storage. [2025-09-23T22:21:39.554051] [INFO ] [MAIN ] INN: Loaded 41945 primary data records. [2025-09-23T22:21:40.077306] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:40.087226] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28874 primary records. [2025-09-23T22:21:40.087691] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-23T22:21:40.111098] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-09-23T22:21:40.111996] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-23T22:21:40.114406] [INFO ] [MAIN ] Derivative Progress: 955/2077 symbols completed. INGM took 1.1s. Estimated remaining: 7m 19s. Rate: 153.3 symbols/min [2025-09-23T22:21:40.115454] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:40.133866] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:40.135260] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33372 primary records. [2025-09-23T22:21:40.135518] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-23T22:21:40.173194] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:40.175514] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41945 primary records. [2025-09-23T22:21:40.179100] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-23T22:21:40.180074] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-09-23T22:21:40.180223] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-23T22:21:40.183601] [INFO ] [MAIN ] Derivative Progress: 956/2077 symbols completed. INGR took 1.1s. Estimated remaining: 7m 18s. Rate: 153.4 symbols/min [2025-09-23T22:21:40.185109] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:40.208674] [DEBUG] [LOCAL ] INSP: Loaded 36869 existing records from primary storage. [2025-09-23T22:21:40.209676] [INFO ] [MAIN ] INSP: Loaded 36869 primary data records. [2025-09-23T22:21:40.251556] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-09-23T22:21:40.290423] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-23T22:21:40.309410] [INFO ] [MAIN ] Derivative Progress: 957/2077 symbols completed. INN took 1.2s. Estimated remaining: 7m 18s. Rate: 153.5 symbols/min [2025-09-23T22:21:40.320857] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:40.569311] [DEBUG] [LOCAL ] INSW: Loaded 40407 existing records from primary storage. [2025-09-23T22:21:40.570094] [INFO ] [MAIN ] INSW: Loaded 40407 primary data records. [2025-09-23T22:21:40.947454] [DEBUG] [LOCAL ] INVH: Loaded 53139 existing records from primary storage. [2025-09-23T22:21:40.956288] [INFO ] [MAIN ] INVH: Loaded 53139 primary data records. [2025-09-23T22:21:41.159936] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:41.283872] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 36869 primary records. [2025-09-23T22:21:41.284376] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-23T22:21:41.311959] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-09-23T22:21:41.320118] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-23T22:21:41.322466] [INFO ] [MAIN ] Derivative Progress: 958/2077 symbols completed. INSP took 1.2s. Estimated remaining: 7m 18s. Rate: 153.2 symbols/min [2025-09-23T22:21:41.328489] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:41.329438] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 40407 primary records. [2025-09-23T22:21:41.329786] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-23T22:21:41.361392] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-09-23T22:21:41.361732] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-23T22:21:41.361602] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:41.364185] [INFO ] [MAIN ] Derivative Progress: 959/2077 symbols completed. INSW took 1.2s. Estimated remaining: 7m 17s. Rate: 153.4 symbols/min [2025-09-23T22:21:41.364974] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53139 primary records. [2025-09-23T22:21:41.365288] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-23T22:21:41.380531] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-09-23T22:21:41.380611] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-23T22:21:41.383004] [INFO ] [MAIN ] Derivative Progress: 960/2077 symbols completed. INVH took 1.1s. Estimated remaining: 7m 17s. Rate: 153.5 symbols/min [2025-09-23T22:21:41.383735] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:41.383833] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:41.384782] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:41.417359] [DEBUG] [LOCAL ] INVX: Loaded 28970 existing records from primary storage. [2025-09-23T22:21:41.417586] [INFO ] [MAIN ] INVX: Loaded 28970 primary data records. [2025-09-23T22:21:41.657059] [DEBUG] [LOCAL ] IP: Loaded 53323 existing records from primary storage. [2025-09-23T22:21:41.657307] [INFO ] [MAIN ] IP: Loaded 53323 primary data records. [2025-09-23T22:21:41.780447] [DEBUG] [LOCAL ] IOT: Loaded 53471 existing records from primary storage. [2025-09-23T22:21:41.798367] [INFO ] [MAIN ] IOT: Loaded 53471 primary data records. [2025-09-23T22:21:42.500053] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:42.501816] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 28970 primary records. [2025-09-23T22:21:42.502130] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-23T22:21:42.523725] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-09-23T22:21:42.524128] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-23T22:21:42.526109] [INFO ] [MAIN ] Derivative Progress: 961/2077 symbols completed. INVX took 1.1s. Estimated remaining: 7m 17s. Rate: 153.2 symbols/min [2025-09-23T22:21:42.526592] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:42.545685] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:42.547252] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53471 primary records. [2025-09-23T22:21:42.547460] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-23T22:21:42.570595] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:42.574333] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53323 primary records. [2025-09-23T22:21:42.574701] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-23T22:21:42.594832] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-09-23T22:21:42.595378] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-23T22:21:42.599094] [INFO ] [MAIN ] Derivative Progress: 962/2077 symbols completed. IP took 1.2s. Estimated remaining: 7m 16s. Rate: 153.4 symbols/min [2025-09-23T22:21:42.600388] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-09-23T22:21:42.600533] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-23T22:21:42.601102] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:42.603820] [INFO ] [MAIN ] Derivative Progress: 963/2077 symbols completed. IOT took 1.2s. Estimated remaining: 7m 15s. Rate: 153.5 symbols/min [2025-09-23T22:21:42.604515] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:42.642002] [DEBUG] [LOCAL ] IPI: Loaded 21223 existing records from primary storage. [2025-09-23T22:21:42.642193] [INFO ] [MAIN ] IPI: Loaded 21223 primary data records. [2025-09-23T22:21:42.725451] [DEBUG] [LOCAL ] IQI: Loaded 18001 existing records from primary storage. [2025-09-23T22:21:42.733889] [INFO ] [MAIN ] IQI: Loaded 18001 primary data records. [2025-09-23T22:21:42.824887] [DEBUG] [LOCAL ] IPG: Loaded 53332 existing records from primary storage. [2025-09-23T22:21:42.944526] [INFO ] [MAIN ] IPG: Loaded 53332 primary data records. [2025-09-23T22:21:43.660626] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:43.662118] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21223 primary records. [2025-09-23T22:21:43.662580] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-23T22:21:43.689140] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:43.696561] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 18001 primary records. [2025-09-23T22:21:43.697461] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-23T22:21:43.736176] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-09-23T22:21:43.737421] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-23T22:21:43.737846] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:43.743149] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-09-23T22:21:43.742072] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53332 primary records. [2025-09-23T22:21:43.743390] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-23T22:21:43.740595] [INFO ] [MAIN ] Derivative Progress: 964/2077 symbols completed. IPI took 1.1s. Estimated remaining: 7m 16s. Rate: 153.2 symbols/min [2025-09-23T22:21:43.746279] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-23T22:21:43.746578] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:43.747254] [INFO ] [MAIN ] Derivative Progress: 965/2077 symbols completed. IQI took 1.1s. Estimated remaining: 7m 15s. Rate: 153.4 symbols/min [2025-09-23T22:21:43.748463] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:43.767293] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-09-23T22:21:43.767427] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-23T22:21:43.770103] [INFO ] [MAIN ] Derivative Progress: 966/2077 symbols completed. IPG took 1.2s. Estimated remaining: 7m 14s. Rate: 153.5 symbols/min [2025-09-23T22:21:43.770517] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:43.848887] [DEBUG] [LOCAL ] IQV: Loaded 50310 existing records from primary storage. [2025-09-23T22:21:43.849083] [INFO ] [MAIN ] IQV: Loaded 50310 primary data records. [2025-09-23T22:21:43.982260] [DEBUG] [LOCAL ] IRM: Loaded 49478 existing records from primary storage. [2025-09-23T22:21:43.988687] [DEBUG] [LOCAL ] IR: Loaded 52696 existing records from primary storage. [2025-09-23T22:21:43.988864] [INFO ] [MAIN ] IR: Loaded 52696 primary data records. [2025-09-23T22:21:43.999407] [INFO ] [MAIN ] IRM: Loaded 49478 primary data records. [2025-09-23T22:21:44.893108] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:44.894383] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50310 primary records. [2025-09-23T22:21:44.894704] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-23T22:21:44.913587] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-09-23T22:21:44.913942] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-23T22:21:44.915983] [INFO ] [MAIN ] Derivative Progress: 967/2077 symbols completed. IQV took 1.2s. Estimated remaining: 7m 15s. Rate: 153.2 symbols/min [2025-09-23T22:21:44.917409] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:44.944169] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:44.949817] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52696 primary records. [2025-09-23T22:21:44.950146] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-23T22:21:44.950468] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:44.951888] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49478 primary records. [2025-09-23T22:21:44.952349] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-23T22:21:44.987035] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-09-23T22:21:44.994064] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-23T22:21:44.997218] [INFO ] [MAIN ] Derivative Progress: 968/2077 symbols completed. IRM took 1.2s. Estimated remaining: 7m 14s. Rate: 153.3 symbols/min [2025-09-23T22:21:44.999834] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:45.000798] [DEBUG] [LOCAL ] IRS: Loaded 21668 existing records from primary storage. [2025-09-23T22:21:45.002406] [INFO ] [MAIN ] IRS: Loaded 21668 primary data records. [2025-09-23T22:21:45.026764] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-09-23T22:21:45.057131] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-23T22:21:45.081845] [INFO ] [MAIN ] Derivative Progress: 969/2077 symbols completed. IR took 1.3s. Estimated remaining: 7m 13s. Rate: 153.5 symbols/min [2025-09-23T22:21:45.100427] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:45.350173] [DEBUG] [LOCAL ] ISD: Loaded 15567 existing records from primary storage. [2025-09-23T22:21:45.350346] [INFO ] [MAIN ] ISD: Loaded 15567 primary data records. [2025-09-23T22:21:45.476223] [DEBUG] [LOCAL ] IRT: Loaded 50392 existing records from primary storage. [2025-09-23T22:21:45.480513] [INFO ] [MAIN ] IRT: Loaded 50392 primary data records. [2025-09-23T22:21:46.039297] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:46.041083] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 21668 primary records. [2025-09-23T22:21:46.041311] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-23T22:21:46.065218] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-09-23T22:21:46.065392] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-23T22:21:46.067958] [INFO ] [MAIN ] Derivative Progress: 970/2077 symbols completed. IRS took 1.2s. Estimated remaining: 7m 13s. Rate: 153.2 symbols/min [2025-09-23T22:21:46.069286] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:46.083817] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:46.085569] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15567 primary records. [2025-09-23T22:21:46.085731] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-23T22:21:46.107599] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:46.113111] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50392 primary records. [2025-09-23T22:21:46.113277] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-23T22:21:46.116396] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-09-23T22:21:46.124325] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-23T22:21:46.129250] [INFO ] [MAIN ] Derivative Progress: 971/2077 symbols completed. ISD took 1.0s. Estimated remaining: 7m 13s. Rate: 153.4 symbols/min [2025-09-23T22:21:46.130848] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:46.135189] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-09-23T22:21:46.135602] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-23T22:21:46.138170] [INFO ] [MAIN ] Derivative Progress: 972/2077 symbols completed. IRT took 1.1s. Estimated remaining: 7m 12s. Rate: 153.5 symbols/min [2025-09-23T22:21:46.138556] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:46.175932] [DEBUG] [LOCAL ] IT: Loaded 41528 existing records from primary storage. [2025-09-23T22:21:46.176089] [INFO ] [MAIN ] IT: Loaded 41528 primary data records. [2025-09-23T22:21:46.255470] [DEBUG] [LOCAL ] ITGR: Loaded 31561 existing records from primary storage. [2025-09-23T22:21:46.302988] [INFO ] [MAIN ] ITGR: Loaded 31561 primary data records. [2025-09-23T22:21:46.635218] [DEBUG] [LOCAL ] ITUB: Loaded 53304 existing records from primary storage. [2025-09-23T22:21:46.649972] [INFO ] [MAIN ] ITUB: Loaded 53304 primary data records. [2025-09-23T22:21:47.231131] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:47.232162] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 41528 primary records. [2025-09-23T22:21:47.232429] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-23T22:21:47.264826] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-09-23T22:21:47.270000] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-23T22:21:47.271535] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:47.273015] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31561 primary records. [2025-09-23T22:21:47.273801] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-23T22:21:47.276088] [INFO ] [MAIN ] Derivative Progress: 973/2077 symbols completed. IT took 1.2s. Estimated remaining: 7m 12s. Rate: 153.2 symbols/min [2025-09-23T22:21:47.299252] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:47.302818] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53304 primary records. [2025-09-23T22:21:47.303131] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-23T22:21:47.321584] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-09-23T22:21:47.322418] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-23T22:21:47.325170] [INFO ] [MAIN ] Derivative Progress: 974/2077 symbols completed. ITGR took 1.2s. Estimated remaining: 7m 12s. Rate: 153.3 symbols/min [2025-09-23T22:21:47.327861] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-09-23T22:21:47.327930] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-23T22:21:47.330315] [INFO ] [MAIN ] Derivative Progress: 975/2077 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 11s. Rate: 153.5 symbols/min [2025-09-23T22:21:47.330993] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:47.331170] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:47.331357] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:47.378472] [DEBUG] [LOCAL ] IVT: Loaded 30966 existing records from primary storage. [2025-09-23T22:21:47.387892] [INFO ] [MAIN ] IVT: Loaded 30966 primary data records. [2025-09-23T22:21:47.533001] [DEBUG] [LOCAL ] IVR: Loaded 47868 existing records from primary storage. [2025-09-23T22:21:47.525759] [DEBUG] [LOCAL ] ITW: Loaded 46324 existing records from primary storage. [2025-09-23T22:21:47.548741] [INFO ] [MAIN ] ITW: Loaded 46324 primary data records. [2025-09-23T22:21:47.538327] [INFO ] [MAIN ] IVR: Loaded 47868 primary data records. [2025-09-23T22:21:48.374702] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:48.375417] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30966 primary records. [2025-09-23T22:21:48.375590] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-23T22:21:48.398977] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-09-23T22:21:48.425045] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:48.424575] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-23T22:21:48.427904] [INFO ] [MAIN ] Derivative Progress: 976/2077 symbols completed. IVT took 1.1s. Estimated remaining: 7m 11s. Rate: 153.2 symbols/min [2025-09-23T22:21:48.425920] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47868 primary records. [2025-09-23T22:21:48.428236] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:48.428166] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-23T22:21:48.428899] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:48.429740] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 46324 primary records. [2025-09-23T22:21:48.430509] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-23T22:21:48.460218] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-09-23T22:21:48.460876] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-23T22:21:48.464344] [INFO ] [MAIN ] Derivative Progress: 977/2077 symbols completed. ITW took 1.1s. Estimated remaining: 7m 10s. Rate: 153.4 symbols/min [2025-09-23T22:21:48.466042] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:48.467625] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-09-23T22:21:48.467732] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-23T22:21:48.470758] [INFO ] [MAIN ] Derivative Progress: 978/2077 symbols completed. IVR took 1.1s. Estimated remaining: 7m 10s. Rate: 153.5 symbols/min [2025-09-23T22:21:48.471078] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:48.503972] [DEBUG] [LOCAL ] IX: Loaded 22600 existing records from primary storage. [2025-09-23T22:21:48.504152] [INFO ] [MAIN ] IX: Loaded 22600 primary data records. [2025-09-23T22:21:48.642524] [DEBUG] [LOCAL ] IVZ: Loaded 53139 existing records from primary storage. [2025-09-23T22:21:48.647252] [INFO ] [MAIN ] IVZ: Loaded 53139 primary data records. [2025-09-23T22:21:48.757476] [DEBUG] [LOCAL ] J: Loaded 40439 existing records from primary storage. [2025-09-23T22:21:48.796418] [INFO ] [MAIN ] J: Loaded 40439 primary data records. [2025-09-23T22:21:49.557304] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:49.558175] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22600 primary records. [2025-09-23T22:21:49.559174] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-23T22:21:49.580823] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-09-23T22:21:49.593758] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-23T22:21:49.594836] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:49.596812] [INFO ] [MAIN ] Derivative Progress: 979/2077 symbols completed. IX took 1.1s. Estimated remaining: 7m 10s. Rate: 153.2 symbols/min [2025-09-23T22:21:49.597391] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:49.610498] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53139 primary records. [2025-09-23T22:21:49.611688] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-23T22:21:49.612003] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:49.613706] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40439 primary records. [2025-09-23T22:21:49.614032] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-23T22:21:49.638576] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-09-23T22:21:49.641349] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-23T22:21:49.646140] [INFO ] [MAIN ] Derivative Progress: 980/2077 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 9s. Rate: 153.4 symbols/min [2025-09-23T22:21:49.646470] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:49.649994] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-09-23T22:21:49.650243] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-23T22:21:49.653208] [INFO ] [MAIN ] Derivative Progress: 981/2077 symbols completed. J took 1.2s. Estimated remaining: 7m 8s. Rate: 153.5 symbols/min [2025-09-23T22:21:49.653617] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:49.685106] [DEBUG] [LOCAL ] JBGS: Loaded 42430 existing records from primary storage. [2025-09-23T22:21:49.695442] [INFO ] [MAIN ] JBGS: Loaded 42430 primary data records. [2025-09-23T22:21:49.821026] [DEBUG] [LOCAL ] JBI: Loaded 44004 existing records from primary storage. [2025-09-23T22:21:49.827144] [INFO ] [MAIN ] JBI: Loaded 44004 primary data records. [2025-09-23T22:21:50.129252] [DEBUG] [LOCAL ] JBL: Loaded 48368 existing records from primary storage. [2025-09-23T22:21:50.142102] [INFO ] [MAIN ] JBL: Loaded 48368 primary data records. [2025-09-23T22:21:50.687227] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:50.688690] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42430 primary records. [2025-09-23T22:21:50.689361] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-23T22:21:50.721582] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-09-23T22:21:50.721968] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-23T22:21:50.724246] [INFO ] [MAIN ] Derivative Progress: 982/2077 symbols completed. JBGS took 1.1s. Estimated remaining: 7m 9s. Rate: 153.2 symbols/min [2025-09-23T22:21:50.724784] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:50.721823] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:50.726227] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 44004 primary records. [2025-09-23T22:21:50.726608] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-23T22:21:50.766188] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-09-23T22:21:50.766570] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-23T22:21:50.769069] [INFO ] [MAIN ] Derivative Progress: 983/2077 symbols completed. JBI took 1.1s. Estimated remaining: 7m 8s. Rate: 153.4 symbols/min [2025-09-23T22:21:50.769455] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:50.770427] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48368 primary records. [2025-09-23T22:21:50.770637] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-23T22:21:50.770579] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:50.796044] [DEBUG] [LOCAL ] JBND: Loaded 25406 existing records from primary storage. [2025-09-23T22:21:50.798551] [INFO ] [MAIN ] JBND: Loaded 25406 primary data records. [2025-09-23T22:21:50.798982] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-09-23T22:21:50.811565] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-23T22:21:50.824941] [INFO ] [MAIN ] Derivative Progress: 984/2077 symbols completed. JBL took 1.2s. Estimated remaining: 7m 7s. Rate: 153.5 symbols/min [2025-09-23T22:21:50.846029] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:50.872466] [DEBUG] [LOCAL ] JCE: Loaded 6442 existing records from primary storage. [2025-09-23T22:21:50.889418] [INFO ] [MAIN ] JCE: Loaded 6442 primary data records. [2025-09-23T22:21:51.504327] [DEBUG] [LOCAL ] JCI: Loaded 53548 existing records from primary storage. [2025-09-23T22:21:51.505254] [INFO ] [MAIN ] JCI: Loaded 53548 primary data records. [2025-09-23T22:21:51.667176] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:51.718213] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 25406 primary records. [2025-09-23T22:21:51.726105] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-23T22:21:51.884078] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:51.887768] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6442 primary records. [2025-09-23T22:21:51.888143] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-23T22:21:51.900136] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-09-23T22:21:51.904840] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-23T22:21:51.908155] [INFO ] [MAIN ] Derivative Progress: 985/2077 symbols completed. JBND took 1.2s. Estimated remaining: 7m 8s. Rate: 153.2 symbols/min [2025-09-23T22:21:51.911582] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:51.916181] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-09-23T22:21:51.916320] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-23T22:21:51.919061] [INFO ] [MAIN ] Derivative Progress: 986/2077 symbols completed. JCE took 1.1s. Estimated remaining: 7m 7s. Rate: 153.4 symbols/min [2025-09-23T22:21:51.920831] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:51.949154] [DEBUG] [LOCAL ] JEQ: Loaded 9100 existing records from primary storage. [2025-09-23T22:21:51.948912] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:51.949968] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53548 primary records. [2025-09-23T22:21:51.950109] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-23T22:21:51.950458] [INFO ] [MAIN ] JEQ: Loaded 9100 primary data records. [2025-09-23T22:21:52.097428] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-09-23T22:21:52.103388] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-23T22:21:52.121607] [INFO ] [MAIN ] Derivative Progress: 987/2077 symbols completed. JCI took 1.3s. Estimated remaining: 7m 6s. Rate: 153.5 symbols/min [2025-09-23T22:21:52.122573] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:52.180091] [DEBUG] [LOCAL ] JEF: Loaded 50003 existing records from primary storage. [2025-09-23T22:21:52.192364] [INFO ] [MAIN ] JEF: Loaded 50003 primary data records. [2025-09-23T22:21:52.726846] [DEBUG] [LOCAL ] JFR: Loaded 30403 existing records from primary storage. [2025-09-23T22:21:52.737486] [INFO ] [MAIN ] JFR: Loaded 30403 primary data records. [2025-09-23T22:21:53.114408] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:53.128596] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 9100 primary records. [2025-09-23T22:21:53.129022] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-23T22:21:53.146760] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-09-23T22:21:53.147114] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-23T22:21:53.150386] [INFO ] [MAIN ] Derivative Progress: 988/2077 symbols completed. JEQ took 1.2s. Estimated remaining: 7m 6s. Rate: 153.2 symbols/min [2025-09-23T22:21:53.168474] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:53.169374] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50003 primary records. [2025-09-23T22:21:53.169925] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-23T22:21:53.188205] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-09-23T22:21:53.188508] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-23T22:21:53.191270] [INFO ] [MAIN ] Derivative Progress: 989/2077 symbols completed. JEF took 1.3s. Estimated remaining: 7m 6s. Rate: 153.3 symbols/min [2025-09-23T22:21:53.206525] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:53.207176] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30403 primary records. [2025-09-23T22:21:53.207237] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-23T22:21:53.222143] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-09-23T22:21:53.222219] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-23T22:21:53.224765] [INFO ] [MAIN ] Derivative Progress: 990/2077 symbols completed. JFR took 1.1s. Estimated remaining: 7m 5s. Rate: 153.5 symbols/min [2025-09-23T22:21:53.225527] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:53.225838] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:53.225626] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:53.237025] [DEBUG] [LOCAL ] JHI: Loaded 3572 existing records from primary storage. [2025-09-23T22:21:53.237166] [INFO ] [MAIN ] JHI: Loaded 3572 primary data records. [2025-09-23T22:21:53.274364] [DEBUG] [LOCAL ] JGH: Loaded 10944 existing records from primary storage. [2025-09-23T22:21:53.310395] [INFO ] [MAIN ] JGH: Loaded 10944 primary data records. [2025-09-23T22:21:53.734894] [DEBUG] [LOCAL ] JHG: Loaded 47972 existing records from primary storage. [2025-09-23T22:21:53.760198] [INFO ] [MAIN ] JHG: Loaded 47972 primary data records. [2025-09-23T22:21:54.299055] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:54.299915] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3572 primary records. [2025-09-23T22:21:54.300171] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-23T22:21:54.322436] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-09-23T22:21:54.322870] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-23T22:21:54.325728] [INFO ] [MAIN ] Derivative Progress: 991/2077 symbols completed. JHI took 1.1s. Estimated remaining: 7m 5s. Rate: 153.2 symbols/min [2025-09-23T22:21:54.326337] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:54.341060] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:54.341926] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 10944 primary records. [2025-09-23T22:21:54.343372] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-23T22:21:54.348385] [DEBUG] [LOCAL ] JHS: Loaded 2865 existing records from primary storage. [2025-09-23T22:21:54.355665] [INFO ] [MAIN ] JHS: Loaded 2865 primary data records. [2025-09-23T22:21:54.464573] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-09-23T22:21:54.475689] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-23T22:21:54.485589] [INFO ] [MAIN ] Derivative Progress: 992/2077 symbols completed. JGH took 1.3s. Estimated remaining: 7m 5s. Rate: 153.3 symbols/min [2025-09-23T22:21:54.491763] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:54.572720] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:54.689838] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47972 primary records. [2025-09-23T22:21:54.690637] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-23T22:21:54.710354] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-09-23T22:21:54.710835] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-23T22:21:54.714998] [INFO ] [MAIN ] Derivative Progress: 993/2077 symbols completed. JHG took 1.5s. Estimated remaining: 7m 4s. Rate: 153.4 symbols/min [2025-09-23T22:21:54.716108] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:54.759077] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:54.759991] [DEBUG] [LOCAL ] JILL: Loaded 16755 existing records from primary storage. [2025-09-23T22:21:54.761551] [INFO ] [MAIN ] JILL: Loaded 16755 primary data records. [2025-09-23T22:21:54.760940] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2865 primary records. [2025-09-23T22:21:54.761797] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-23T22:21:54.859363] [DEBUG] [LOCAL ] JHX: Loaded 50123 existing records from primary storage. [2025-09-23T22:21:54.868032] [INFO ] [MAIN ] JHX: Loaded 50123 primary data records. [2025-09-23T22:21:54.979306] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-09-23T22:21:55.044064] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-23T22:21:55.081756] [INFO ] [MAIN ] Derivative Progress: 994/2077 symbols completed. JHS took 0.8s. Estimated remaining: 7m 4s. Rate: 153.4 symbols/min [2025-09-23T22:21:55.086229] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:55.481309] [DEBUG] [LOCAL ] JKS: Loaded 40129 existing records from primary storage. [2025-09-23T22:21:55.480709] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:55.481766] [INFO ] [MAIN ] JKS: Loaded 40129 primary data records. [2025-09-23T22:21:55.483482] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16755 primary records. [2025-09-23T22:21:55.515811] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-23T22:21:55.578294] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:55.597505] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 50123 primary records. [2025-09-23T22:21:55.615955] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-23T22:21:55.620516] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-09-23T22:21:55.621488] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-23T22:21:55.636629] [INFO ] [MAIN ] Derivative Progress: 995/2077 symbols completed. JILL took 0.9s. Estimated remaining: 7m 3s. Rate: 153.3 symbols/min [2025-09-23T22:21:55.656286] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:55.838429] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-09-23T22:21:55.838601] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-23T22:21:55.841595] [INFO ] [MAIN ] Derivative Progress: 996/2077 symbols completed. JHX took 1.4s. Estimated remaining: 7m 3s. Rate: 153.4 symbols/min [2025-09-23T22:21:55.842100] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:55.858583] [DEBUG] [LOCAL ] JLS: Loaded 4092 existing records from primary storage. [2025-09-23T22:21:55.858962] [INFO ] [MAIN ] JLS: Loaded 4092 primary data records. [2025-09-23T22:21:55.963074] [DEBUG] [LOCAL ] JLL: Loaded 32090 existing records from primary storage. [2025-09-23T22:21:55.980001] [INFO ] [MAIN ] JLL: Loaded 32090 primary data records. [2025-09-23T22:21:56.373369] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:56.394165] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 40129 primary records. [2025-09-23T22:21:56.394460] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-23T22:21:56.531245] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-09-23T22:21:56.531987] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-23T22:21:56.534413] [INFO ] [MAIN ] Derivative Progress: 997/2077 symbols completed. JKS took 1.4s. Estimated remaining: 7m 3s. Rate: 153.3 symbols/min [2025-09-23T22:21:56.536690] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:56.577445] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:56.579300] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4092 primary records. [2025-09-23T22:21:56.578405] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:56.579416] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-23T22:21:56.580566] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 32090 primary records. [2025-09-23T22:21:56.580700] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-23T22:21:56.629393] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-09-23T22:21:56.630155] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-23T22:21:56.630039] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-09-23T22:21:56.645521] [INFO ] [MAIN ] Derivative Progress: 998/2077 symbols completed. JLL took 1.0s. Estimated remaining: 7m 2s. Rate: 153.4 symbols/min [2025-09-23T22:21:56.646752] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-23T22:21:56.647103] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:56.649606] [INFO ] [MAIN ] Derivative Progress: 999/2077 symbols completed. JLS took 0.8s. Estimated remaining: 7m 1s. Rate: 153.5 symbols/min [2025-09-23T22:21:56.650965] [DEBUG] [LOCAL ] JMIA: Loaded 50490 existing records from primary storage. [2025-09-23T22:21:56.651366] [INFO ] [MAIN ] JMIA: Loaded 50490 primary data records. [2025-09-23T22:21:56.651450] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:57.003402] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-23T22:21:57.003930] [INFO ] [MAIN ] JOBY: Loaded 53799 primary data records. [2025-09-23T22:21:57.121244] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-23T22:21:57.135335] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-09-23T22:21:57.221188] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:57.240173] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50490 primary records. [2025-09-23T22:21:57.256699] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-23T22:21:57.707593] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-09-23T22:21:57.708504] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-23T22:21:57.710943] [INFO ] [MAIN ] Derivative Progress: 1000/2077 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 2s. Rate: 153.3 symbols/min [2025-09-23T22:21:57.712299] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:57.743826] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:57.747544] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53799 primary records. [2025-09-23T22:21:57.754499] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-23T22:21:57.776073] [DEBUG] [LOCAL ] JOE: Loaded 24662 existing records from primary storage. [2025-09-23T22:21:57.783022] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:57.785442] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-09-23T22:21:57.785847] [INFO ] [MAIN ] JOE: Loaded 24662 primary data records. [2025-09-23T22:21:57.786142] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-23T22:21:57.787740] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-09-23T22:21:57.837565] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-23T22:21:57.859855] [INFO ] [MAIN ] Derivative Progress: 1001/2077 symbols completed. JOBY took 1.2s. Estimated remaining: 7m 1s. Rate: 153.4 symbols/min [2025-09-23T22:21:57.869118] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-09-23T22:21:57.888979] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:57.889121] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-23T22:21:57.901954] [INFO ] [MAIN ] Derivative Progress: 1002/2077 symbols completed. JNJ took 1.3s. Estimated remaining: 7m 0s. Rate: 153.5 symbols/min [2025-09-23T22:21:57.921435] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:58.007080] [DEBUG] [LOCAL ] JOF: Loaded 7131 existing records from primary storage. [2025-09-23T22:21:58.013709] [INFO ] [MAIN ] JOF: Loaded 7131 primary data records. [2025-09-23T22:21:58.450283] [DEBUG] [LOCAL ] JPC: Loaded 37051 existing records from primary storage. [2025-09-23T22:21:58.459202] [INFO ] [MAIN ] JPC: Loaded 37051 primary data records. [2025-09-23T22:21:58.674319] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:58.790816] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24662 primary records. [2025-09-23T22:21:58.797002] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-23T22:21:58.827939] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:58.829702] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 7131 primary records. [2025-09-23T22:21:58.830120] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-23T22:21:58.832362] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-09-23T22:21:58.832706] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-23T22:21:58.842087] [INFO ] [MAIN ] Derivative Progress: 1003/2077 symbols completed. JOE took 1.1s. Estimated remaining: 7m 0s. Rate: 153.3 symbols/min [2025-09-23T22:21:58.852189] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-09-23T22:21:58.852302] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-23T22:21:58.854255] [INFO ] [MAIN ] Derivative Progress: 1004/2077 symbols completed. JOF took 1.0s. Estimated remaining: 6m 60s. Rate: 153.4 symbols/min [2025-09-23T22:21:58.869555] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:58.870211] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37051 primary records. [2025-09-23T22:21:58.870272] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-23T22:21:58.885527] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-09-23T22:21:58.885596] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-23T22:21:58.888037] [INFO ] [MAIN ] Derivative Progress: 1005/2077 symbols completed. JPC took 1.0s. Estimated remaining: 6m 59s. Rate: 153.6 symbols/min [2025-09-23T22:21:58.888746] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:58.888964] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:58.888670] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:21:58.907456] [DEBUG] [LOCAL ] JRI: Loaded 14888 existing records from primary storage. [2025-09-23T22:21:58.907943] [INFO ] [MAIN ] JRI: Loaded 14888 primary data records. [2025-09-23T22:21:59.094133] [DEBUG] [LOCAL ] JQC: Loaded 33665 existing records from primary storage. [2025-09-23T22:21:59.121255] [INFO ] [MAIN ] JQC: Loaded 33665 primary data records. [2025-09-23T22:21:59.342686] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-23T22:21:59.355755] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-09-23T22:21:59.961511] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:21:59.962578] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 14888 primary records. [2025-09-23T22:21:59.963159] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-23T22:21:59.983112] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-09-23T22:21:59.983512] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-23T22:21:59.985907] [INFO ] [MAIN ] Derivative Progress: 1006/2077 symbols completed. JRI took 1.1s. Estimated remaining: 6m 59s. Rate: 153.3 symbols/min [2025-09-23T22:21:59.986465] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:00.007854] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:00.009144] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33665 primary records. [2025-09-23T22:22:00.009540] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-23T22:22:00.015546] [DEBUG] [LOCAL ] JRS: Loaded 11097 existing records from primary storage. [2025-09-23T22:22:00.022849] [INFO ] [MAIN ] JRS: Loaded 11097 primary data records. [2025-09-23T22:22:00.155163] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:00.157593] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-09-23T22:22:00.158514] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-09-23T22:22:00.169066] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-23T22:22:00.184735] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-23T22:22:00.204826] [INFO ] [MAIN ] Derivative Progress: 1007/2077 symbols completed. JQC took 1.3s. Estimated remaining: 6m 59s. Rate: 153.4 symbols/min [2025-09-23T22:22:00.236917] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:00.407460] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-09-23T22:22:00.407618] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-23T22:22:00.410744] [INFO ] [MAIN ] Derivative Progress: 1008/2077 symbols completed. JPM took 1.5s. Estimated remaining: 6m 58s. Rate: 153.4 symbols/min [2025-09-23T22:22:00.412352] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:00.453222] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:00.454140] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11097 primary records. [2025-09-23T22:22:00.454343] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-23T22:22:00.471074] [DEBUG] [LOCAL ] JXN: Loaded 46012 existing records from primary storage. [2025-09-23T22:22:00.471554] [INFO ] [MAIN ] JXN: Loaded 46012 primary data records. [2025-09-23T22:22:00.643875] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-09-23T22:22:00.703532] [DEBUG] [LOCAL ] K: Loaded 49850 existing records from primary storage. [2025-09-23T22:22:00.709483] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-23T22:22:00.819373] [INFO ] [MAIN ] Derivative Progress: 1009/2077 symbols completed. JRS took 0.8s. Estimated remaining: 6m 58s. Rate: 153.4 symbols/min [2025-09-23T22:22:00.827483] [INFO ] [MAIN ] K: Loaded 49850 primary data records. [2025-09-23T22:22:00.863804] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:01.045056] [DEBUG] [LOCAL ] KAI: Loaded 13631 existing records from primary storage. [2025-09-23T22:22:01.049282] [INFO ] [MAIN ] KAI: Loaded 13631 primary data records. [2025-09-23T22:22:01.540380] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:01.542602] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 46012 primary records. [2025-09-23T22:22:01.542990] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-23T22:22:01.566863] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-09-23T22:22:01.567371] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-23T22:22:01.569860] [INFO ] [MAIN ] Derivative Progress: 1010/2077 symbols completed. JXN took 1.4s. Estimated remaining: 6m 58s. Rate: 153.3 symbols/min [2025-09-23T22:22:01.570143] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:01.584718] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:01.586805] [INFO ] [MAIN ] K: Generated 1794 derivative records from 49850 primary records. [2025-09-23T22:22:01.589224] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-23T22:22:01.623130] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:01.623691] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-09-23T22:22:01.624472] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13631 primary records. [2025-09-23T22:22:01.624693] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-23T22:22:01.624848] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-23T22:22:01.627180] [INFO ] [MAIN ] Derivative Progress: 1011/2077 symbols completed. K took 1.2s. Estimated remaining: 6m 57s. Rate: 153.4 symbols/min [2025-09-23T22:22:01.638846] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:01.666061] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-09-23T22:22:01.667768] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-23T22:22:01.670283] [INFO ] [MAIN ] Derivative Progress: 1012/2077 symbols completed. KAI took 0.8s. Estimated remaining: 6m 56s. Rate: 153.5 symbols/min [2025-09-23T22:22:01.670679] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:01.672323] [DEBUG] [LOCAL ] KAR: Loaded 39918 existing records from primary storage. [2025-09-23T22:22:01.672709] [INFO ] [MAIN ] KAR: Loaded 39918 primary data records. [2025-09-23T22:22:01.815850] [DEBUG] [LOCAL ] KB: Loaded 24164 existing records from primary storage. [2025-09-23T22:22:01.822374] [INFO ] [MAIN ] KB: Loaded 24164 primary data records. [2025-09-23T22:22:01.921887] [DEBUG] [LOCAL ] KBDC: Loaded 20649 existing records from primary storage. [2025-09-23T22:22:01.999940] [INFO ] [MAIN ] KBDC: Loaded 20649 primary data records. [2025-09-23T22:22:02.726105] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:02.726326] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:02.727404] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 24164 primary records. [2025-09-23T22:22:02.727614] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-23T22:22:02.729154] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 39918 primary records. [2025-09-23T22:22:02.729669] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-23T22:22:02.769607] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:02.772322] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 20649 primary records. [2025-09-23T22:22:02.772679] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-23T22:22:02.792472] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-09-23T22:22:02.793336] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-23T22:22:02.796030] [INFO ] [MAIN ] Derivative Progress: 1013/2077 symbols completed. KAR took 1.2s. Estimated remaining: 6m 57s. Rate: 153.3 symbols/min [2025-09-23T22:22:02.796879] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-09-23T22:22:02.797242] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-23T22:22:02.799588] [INFO ] [MAIN ] Derivative Progress: 1014/2077 symbols completed. KB took 1.2s. Estimated remaining: 6m 56s. Rate: 153.4 symbols/min [2025-09-23T22:22:02.797475] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:02.800902] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:02.804463] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-09-23T22:22:02.804673] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-23T22:22:02.807732] [INFO ] [MAIN ] Derivative Progress: 1015/2077 symbols completed. KBDC took 1.1s. Estimated remaining: 6m 55s. Rate: 153.6 symbols/min [2025-09-23T22:22:02.808176] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:02.898066] [DEBUG] [LOCAL ] KBH: Loaded 48899 existing records from primary storage. [2025-09-23T22:22:02.896979] [DEBUG] [LOCAL ] KBR: Loaded 48140 existing records from primary storage. [2025-09-23T22:22:02.898297] [INFO ] [MAIN ] KBR: Loaded 48140 primary data records. [2025-09-23T22:22:02.898532] [INFO ] [MAIN ] KBH: Loaded 48899 primary data records. [2025-09-23T22:22:03.138071] [DEBUG] [LOCAL ] KD: Loaded 52293 existing records from primary storage. [2025-09-23T22:22:03.173050] [INFO ] [MAIN ] KD: Loaded 52293 primary data records. [2025-09-23T22:22:03.987256] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:03.990795] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48140 primary records. [2025-09-23T22:22:03.991130] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-23T22:22:04.018899] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:04.023586] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48899 primary records. [2025-09-23T22:22:04.025528] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-23T22:22:04.027187] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-09-23T22:22:04.028160] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-23T22:22:04.030165] [INFO ] [MAIN ] Derivative Progress: 1016/2077 symbols completed. KBR took 1.2s. Estimated remaining: 6m 55s. Rate: 153.2 symbols/min [2025-09-23T22:22:04.030502] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:04.060364] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:04.063905] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52293 primary records. [2025-09-23T22:22:04.064808] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-23T22:22:04.082553] [DEBUG] [LOCAL ] KEN: Loaded 4759 existing records from primary storage. [2025-09-23T22:22:04.083315] [INFO ] [MAIN ] KEN: Loaded 4759 primary data records. [2025-09-23T22:22:04.082708] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-09-23T22:22:04.097352] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-23T22:22:04.104833] [INFO ] [MAIN ] Derivative Progress: 1017/2077 symbols completed. KBH took 1.3s. Estimated remaining: 6m 55s. Rate: 153.4 symbols/min [2025-09-23T22:22:04.129629] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:04.188502] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-09-23T22:22:04.201777] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-23T22:22:04.207592] [INFO ] [MAIN ] Derivative Progress: 1018/2077 symbols completed. KD took 1.4s. Estimated remaining: 6m 54s. Rate: 153.5 symbols/min [2025-09-23T22:22:04.308336] [DEBUG] [LOCAL ] KEP: Loaded 30525 existing records from primary storage. [2025-09-23T22:22:04.386404] [INFO ] [MAIN ] KEP: Loaded 30525 primary data records. [2025-09-23T22:22:04.754595] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:04.756789] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4759 primary records. [2025-09-23T22:22:04.757060] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-23T22:22:04.777013] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-09-23T22:22:04.777107] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-23T22:22:04.779119] [INFO ] [MAIN ] Derivative Progress: 1019/2077 symbols completed. KEN took 0.7s. Estimated remaining: 6m 54s. Rate: 153.4 symbols/min [2025-09-23T22:22:04.797099] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:04.797860] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 30525 primary records. [2025-09-23T22:22:04.797923] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-23T22:22:04.814121] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-09-23T22:22:04.814255] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-23T22:22:04.816426] [INFO ] [MAIN ] Derivative Progress: 1020/2077 symbols completed. KEP took 0.7s. Estimated remaining: 6m 53s. Rate: 153.5 symbols/min [2025-09-23T22:22:04.817097] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:04.817361] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:04.817492] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:04.823314] [DEBUG] [LOCAL ] KF: Loaded 2471 existing records from primary storage. [2025-09-23T22:22:04.823494] [INFO ] [MAIN ] KF: Loaded 2471 primary data records. [2025-09-23T22:22:05.174923] [DEBUG] [LOCAL ] KEX: Loaded 37961 existing records from primary storage. [2025-09-23T22:22:05.188045] [INFO ] [MAIN ] KEX: Loaded 37961 primary data records. [2025-09-23T22:22:05.228133] [DEBUG] [LOCAL ] KEYS: Loaded 43332 existing records from primary storage. [2025-09-23T22:22:05.258413] [INFO ] [MAIN ] KEYS: Loaded 43332 primary data records. [2025-09-23T22:22:05.929759] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:05.931363] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2471 primary records. [2025-09-23T22:22:05.931756] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-23T22:22:05.948006] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-09-23T22:22:05.948925] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-23T22:22:05.951068] [INFO ] [MAIN ] Derivative Progress: 1021/2077 symbols completed. KF took 1.1s. Estimated remaining: 6m 53s. Rate: 153.3 symbols/min [2025-09-23T22:22:05.951762] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:05.971146] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:05.971898] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 37961 primary records. [2025-09-23T22:22:05.972205] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-23T22:22:05.998896] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-09-23T22:22:06.006444] [DEBUG] [LOCAL ] KFRC: Loaded 19348 existing records from primary storage. [2025-09-23T22:22:06.005930] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-23T22:22:06.006608] [INFO ] [MAIN ] KFRC: Loaded 19348 primary data records. [2025-09-23T22:22:06.008677] [INFO ] [MAIN ] Derivative Progress: 1022/2077 symbols completed. KEX took 1.2s. Estimated remaining: 6m 53s. Rate: 153.4 symbols/min [2025-09-23T22:22:06.009328] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:06.062106] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:06.094870] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43332 primary records. [2025-09-23T22:22:06.134587] [DEBUG] [LOCAL ] KFS: Loaded 8312 existing records from primary storage. [2025-09-23T22:22:06.134308] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-23T22:22:06.155752] [INFO ] [MAIN ] KFS: Loaded 8312 primary data records. [2025-09-23T22:22:06.503764] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-09-23T22:22:06.504076] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-23T22:22:06.508623] [INFO ] [MAIN ] Derivative Progress: 1023/2077 symbols completed. KEYS took 1.7s. Estimated remaining: 6m 52s. Rate: 153.3 symbols/min [2025-09-23T22:22:06.509045] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:06.751293] [DEBUG] [LOCAL ] KFY: Loaded 30672 existing records from primary storage. [2025-09-23T22:22:06.751895] [INFO ] [MAIN ] KFY: Loaded 30672 primary data records. [2025-09-23T22:22:06.798999] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:06.832423] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19348 primary records. [2025-09-23T22:22:06.849999] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-23T22:22:06.928133] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:06.927839] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-09-23T22:22:06.942022] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-23T22:22:06.944145] [INFO ] [MAIN ] Derivative Progress: 1024/2077 symbols completed. KFRC took 1.0s. Estimated remaining: 6m 52s. Rate: 153.3 symbols/min [2025-09-23T22:22:06.944393] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:06.941966] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8312 primary records. [2025-09-23T22:22:06.953572] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-23T22:22:07.118937] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-09-23T22:22:07.119250] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-23T22:22:07.121517] [INFO ] [MAIN ] Derivative Progress: 1025/2077 symbols completed. KFS took 1.1s. Estimated remaining: 6m 51s. Rate: 153.4 symbols/min [2025-09-23T22:22:07.122074] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:07.162441] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:07.163314] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30672 primary records. [2025-09-23T22:22:07.163380] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-23T22:22:07.181228] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-09-23T22:22:07.181588] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-23T22:22:07.183880] [INFO ] [MAIN ] Derivative Progress: 1026/2077 symbols completed. KFY took 0.7s. Estimated remaining: 6m 51s. Rate: 153.5 symbols/min [2025-09-23T22:22:07.184362] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:07.202572] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-23T22:22:07.212347] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-09-23T22:22:07.337815] [DEBUG] [LOCAL ] KGS: Loaded 45785 existing records from primary storage. [2025-09-23T22:22:07.348996] [INFO ] [MAIN ] KGS: Loaded 45785 primary data records. [2025-09-23T22:22:07.764491] [DEBUG] [LOCAL ] KIM: Loaded 53067 existing records from primary storage. [2025-09-23T22:22:07.793495] [INFO ] [MAIN ] KIM: Loaded 53067 primary data records. [2025-09-23T22:22:08.254825] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:08.257226] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-09-23T22:22:08.257540] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-23T22:22:08.282469] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:08.283292] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45785 primary records. [2025-09-23T22:22:08.283579] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-23T22:22:08.303679] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-09-23T22:22:08.303964] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-23T22:22:08.307032] [INFO ] [MAIN ] Derivative Progress: 1027/2077 symbols completed. KGS took 1.2s. Estimated remaining: 6m 51s. Rate: 153.3 symbols/min [2025-09-23T22:22:08.307637] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:08.308969] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-09-23T22:22:08.309197] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-23T22:22:08.311190] [INFO ] [MAIN ] Derivative Progress: 1028/2077 symbols completed. KGC took 1.4s. Estimated remaining: 6m 50s. Rate: 153.4 symbols/min [2025-09-23T22:22:08.311784] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:08.328503] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:08.329243] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53067 primary records. [2025-09-23T22:22:08.329420] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-23T22:22:08.358936] [DEBUG] [LOCAL ] KIO: Loaded 21283 existing records from primary storage. [2025-09-23T22:22:08.358381] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-09-23T22:22:08.359037] [INFO ] [MAIN ] KIO: Loaded 21283 primary data records. [2025-09-23T22:22:08.359135] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-23T22:22:08.361876] [INFO ] [MAIN ] Derivative Progress: 1029/2077 symbols completed. KIM took 1.2s. Estimated remaining: 6m 50s. Rate: 153.5 symbols/min [2025-09-23T22:22:08.373602] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:08.485282] [DEBUG] [LOCAL ] KKRS: Loaded 5751 existing records from primary storage. [2025-09-23T22:22:08.525382] [INFO ] [MAIN ] KKRS: Loaded 5751 primary data records. [2025-09-23T22:22:08.716233] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-09-23T22:22:08.757080] [INFO ] [MAIN ] KKR: Loaded 53502 primary data records. [2025-09-23T22:22:09.395057] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:09.397139] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21283 primary records. [2025-09-23T22:22:09.397519] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-23T22:22:09.415295] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-09-23T22:22:09.415952] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-23T22:22:09.418250] [INFO ] [MAIN ] Derivative Progress: 1030/2077 symbols completed. KIO took 1.1s. Estimated remaining: 6m 50s. Rate: 153.3 symbols/min [2025-09-23T22:22:09.418900] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:09.438780] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:09.441552] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5751 primary records. [2025-09-23T22:22:09.441925] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-23T22:22:09.470965] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:09.471461] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-09-23T22:22:09.472417] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53502 primary records. [2025-09-23T22:22:09.472556] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-23T22:22:09.473103] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-23T22:22:09.484925] [INFO ] [MAIN ] Derivative Progress: 1031/2077 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 49s. Rate: 153.4 symbols/min [2025-09-23T22:22:09.485849] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:09.515343] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-09-23T22:22:09.516380] [DEBUG] [LOCAL ] KLC: Loaded 36503 existing records from primary storage. [2025-09-23T22:22:09.516524] [INFO ] [MAIN ] KLC: Loaded 36503 primary data records. [2025-09-23T22:22:09.516745] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-23T22:22:09.531296] [INFO ] [MAIN ] Derivative Progress: 1032/2077 symbols completed. KKR took 1.2s. Estimated remaining: 6m 48s. Rate: 153.5 symbols/min [2025-09-23T22:22:09.564162] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:09.683115] [DEBUG] [LOCAL ] KMPB: Loaded 3582 existing records from primary storage. [2025-09-23T22:22:09.722262] [INFO ] [MAIN ] KMPB: Loaded 3582 primary data records. [2025-09-23T22:22:09.766607] [DEBUG] [LOCAL ] KLG: Loaded 41973 existing records from primary storage. [2025-09-23T22:22:09.896082] [INFO ] [MAIN ] KLG: Loaded 41973 primary data records. [2025-09-23T22:22:10.547692] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:10.549129] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36503 primary records. [2025-09-23T22:22:10.549556] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-23T22:22:10.567580] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-09-23T22:22:10.568639] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-23T22:22:10.570746] [INFO ] [MAIN ] Derivative Progress: 1033/2077 symbols completed. KLC took 1.2s. Estimated remaining: 6m 49s. Rate: 153.3 symbols/min [2025-09-23T22:22:10.595964] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:22:10.597087] [INFO ] [MAIN ] KMPB: Generated 1793 derivative records from 3582 primary records. [2025-09-23T22:22:10.597921] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-23T22:22:10.626948] [DEBUG] [MAIN ] KLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:10.630300] [INFO ] [MAIN ] KLG: Generated 1794 derivative records from 41973 primary records. [2025-09-23T22:22:10.630366] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1793 records). [2025-09-23T22:22:10.630462] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-23T22:22:10.630602] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-23T22:22:10.634010] [INFO ] [MAIN ] Derivative Progress: 1034/2077 symbols completed. KMPB took 1.1s. Estimated remaining: 6m 48s. Rate: 153.4 symbols/min [2025-09-23T22:22:10.657337] [DEBUG] [LOCAL ] KLG: Derivative data saved (1794 records). [2025-09-23T22:22:10.657505] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-23T22:22:10.661006] [INFO ] [MAIN ] Derivative Progress: 1035/2077 symbols completed. KLG took 1.2s. Estimated remaining: 6m 47s. Rate: 153.5 symbols/min [2025-09-23T22:22:10.661879] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:10.662054] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:10.661983] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:10.726829] [DEBUG] [LOCAL ] KMPR: Loaded 38267 existing records from primary storage. [2025-09-23T22:22:10.727169] [INFO ] [MAIN ] KMPR: Loaded 38267 primary data records. [2025-09-23T22:22:10.847192] [DEBUG] [LOCAL ] KMX: Loaded 53112 existing records from primary storage. [2025-09-23T22:22:10.872725] [INFO ] [MAIN ] KMX: Loaded 53112 primary data records. [2025-09-23T22:22:10.894570] [DEBUG] [LOCAL ] KMT: Loaded 43103 existing records from primary storage. [2025-09-23T22:22:10.986066] [INFO ] [MAIN ] KMT: Loaded 43103 primary data records. [2025-09-23T22:22:11.939098] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:12.129196] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 38267 primary records. [2025-09-23T22:22:12.145274] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-23T22:22:12.184544] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-09-23T22:22:12.185982] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-23T22:22:12.188982] [INFO ] [MAIN ] Derivative Progress: 1036/2077 symbols completed. KMPR took 1.5s. Estimated remaining: 6m 48s. Rate: 153.1 symbols/min [2025-09-23T22:22:12.189909] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:12.212176] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:22:12.213130] [INFO ] [MAIN ] KMX: Generated 1793 derivative records from 53112 primary records. [2025-09-23T22:22:12.213330] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-23T22:22:12.228521] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:12.229785] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 43103 primary records. [2025-09-23T22:22:12.229883] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-23T22:22:12.246911] [DEBUG] [LOCAL ] KMX: Derivative data saved (1793 records). [2025-09-23T22:22:12.258983] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-23T22:22:12.271247] [INFO ] [MAIN ] Derivative Progress: 1037/2077 symbols completed. KMX took 1.6s. Estimated remaining: 6m 47s. Rate: 153.2 symbols/min [2025-09-23T22:22:12.278994] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:12.281724] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-09-23T22:22:12.283581] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-23T22:22:12.301244] [INFO ] [MAIN ] Derivative Progress: 1038/2077 symbols completed. KMT took 1.6s. Estimated remaining: 6m 46s. Rate: 153.4 symbols/min [2025-09-23T22:22:12.304120] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:12.305960] [DEBUG] [LOCAL ] KN: Loaded 38940 existing records from primary storage. [2025-09-23T22:22:12.306169] [INFO ] [MAIN ] KN: Loaded 38940 primary data records. [2025-09-23T22:22:12.424830] [DEBUG] [LOCAL ] KNOP: Loaded 9921 existing records from primary storage. [2025-09-23T22:22:12.428965] [INFO ] [MAIN ] KNOP: Loaded 9921 primary data records. [2025-09-23T22:22:12.809289] [DEBUG] [LOCAL ] KNF: Loaded 35846 existing records from primary storage. [2025-09-23T22:22:12.821859] [INFO ] [MAIN ] KNF: Loaded 35846 primary data records. [2025-09-23T22:22:13.375347] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:13.376482] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38940 primary records. [2025-09-23T22:22:13.376806] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-23T22:22:13.405034] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-09-23T22:22:13.405440] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-23T22:22:13.407706] [INFO ] [MAIN ] Derivative Progress: 1039/2077 symbols completed. KN took 1.2s. Estimated remaining: 6m 47s. Rate: 153.1 symbols/min [2025-09-23T22:22:13.421081] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:13.421920] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:13.422717] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 9921 primary records. [2025-09-23T22:22:13.423010] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-23T22:22:13.442744] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-09-23T22:22:13.442886] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-23T22:22:13.445366] [INFO ] [MAIN ] Derivative Progress: 1040/2077 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 46s. Rate: 153.2 symbols/min [2025-09-23T22:22:13.453517] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:13.463576] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:13.464502] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 35846 primary records. [2025-09-23T22:22:13.464664] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-23T22:22:13.485231] [DEBUG] [LOCAL ] KNSL: Loaded 18092 existing records from primary storage. [2025-09-23T22:22:13.486220] [INFO ] [MAIN ] KNSL: Loaded 18092 primary data records. [2025-09-23T22:22:13.581813] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-09-23T22:22:13.610258] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-23T22:22:13.612887] [INFO ] [MAIN ] Derivative Progress: 1041/2077 symbols completed. KNF took 1.3s. Estimated remaining: 6m 45s. Rate: 153.3 symbols/min [2025-09-23T22:22:13.613799] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:13.828797] [DEBUG] [LOCAL ] KNTK: Loaded 46111 existing records from primary storage. [2025-09-23T22:22:13.829134] [INFO ] [MAIN ] KNTK: Loaded 46111 primary data records. [2025-09-23T22:22:14.245067] [DEBUG] [LOCAL ] KNX: Loaded 52600 existing records from primary storage. [2025-09-23T22:22:14.246031] [INFO ] [MAIN ] KNX: Loaded 52600 primary data records. [2025-09-23T22:22:14.330966] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:14.331898] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18092 primary records. [2025-09-23T22:22:14.332038] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-23T22:22:14.424281] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-09-23T22:22:14.462920] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-23T22:22:14.584223] [INFO ] [MAIN ] Derivative Progress: 1042/2077 symbols completed. KNSL took 1.2s. Estimated remaining: 6m 46s. Rate: 153.1 symbols/min [2025-09-23T22:22:14.586440] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:14.601756] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:14.602517] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46111 primary records. [2025-09-23T22:22:14.602664] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-23T22:22:14.620433] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-09-23T22:22:14.621061] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-23T22:22:14.623874] [INFO ] [MAIN ] Derivative Progress: 1043/2077 symbols completed. KNTK took 1.2s. Estimated remaining: 6m 45s. Rate: 153.2 symbols/min [2025-09-23T22:22:14.624428] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:14.666009] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:14.678916] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52600 primary records. [2025-09-23T22:22:14.679146] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-23T22:22:14.680516] [DEBUG] [LOCAL ] KODK: Loaded 43429 existing records from primary storage. [2025-09-23T22:22:14.680980] [INFO ] [MAIN ] KODK: Loaded 43429 primary data records. [2025-09-23T22:22:14.788842] [DEBUG] [LOCAL ] KOF: Loaded 25835 existing records from primary storage. [2025-09-23T22:22:14.803888] [INFO ] [MAIN ] KOF: Loaded 25835 primary data records. [2025-09-23T22:22:14.974788] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-09-23T22:22:14.986879] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-23T22:22:15.126542] [INFO ] [MAIN ] Derivative Progress: 1044/2077 symbols completed. KNX took 1.5s. Estimated remaining: 6m 45s. Rate: 153.2 symbols/min [2025-09-23T22:22:15.137048] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:15.378823] [DEBUG] [LOCAL ] KOP: Loaded 17936 existing records from primary storage. [2025-09-23T22:22:15.380394] [INFO ] [MAIN ] KOP: Loaded 17936 primary data records. [2025-09-23T22:22:15.597987] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:15.719030] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43429 primary records. [2025-09-23T22:22:15.719536] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-23T22:22:15.739344] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-09-23T22:22:15.741017] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-23T22:22:15.751283] [INFO ] [MAIN ] Derivative Progress: 1045/2077 symbols completed. KODK took 1.2s. Estimated remaining: 6m 44s. Rate: 153.1 symbols/min [2025-09-23T22:22:15.758019] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:15.757715] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:15.759537] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 25835 primary records. [2025-09-23T22:22:15.759823] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-23T22:22:15.778875] [DEBUG] [LOCAL ] KORE: Loaded 1946 existing records from primary storage. [2025-09-23T22:22:15.779936] [INFO ] [MAIN ] KORE: Loaded 1946 primary data records. [2025-09-23T22:22:15.820179] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-09-23T22:22:15.857034] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-23T22:22:15.871817] [INFO ] [MAIN ] Derivative Progress: 1046/2077 symbols completed. KOF took 1.2s. Estimated remaining: 6m 44s. Rate: 153.2 symbols/min [2025-09-23T22:22:15.892997] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:16.212388] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:16.222690] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17936 primary records. [2025-09-23T22:22:16.222973] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-23T22:22:16.263484] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-09-23T22:22:16.263980] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-23T22:22:16.266951] [INFO ] [MAIN ] Derivative Progress: 1047/2077 symbols completed. KOP took 1.1s. Estimated remaining: 6m 43s. Rate: 153.2 symbols/min [2025-09-23T22:22:16.267747] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:16.290295] [DEBUG] [LOCAL ] KOS: Loaded 53066 existing records from primary storage. [2025-09-23T22:22:16.290624] [INFO ] [MAIN ] KOS: Loaded 53066 primary data records. [2025-09-23T22:22:16.419670] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:16.436685] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 1946 primary records. [2025-09-23T22:22:16.479349] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-23T22:22:16.652947] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-09-23T22:22:16.669863] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-23T22:22:16.672532] [INFO ] [MAIN ] Derivative Progress: 1048/2077 symbols completed. KORE took 0.9s. Estimated remaining: 6m 43s. Rate: 153.2 symbols/min [2025-09-23T22:22:16.674780] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-23T22:22:16.675130] [INFO ] [MAIN ] KR: Loaded 53682 primary data records. [2025-09-23T22:22:16.999401] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:17.000896] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53066 primary records. [2025-09-23T22:22:17.001283] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-23T22:22:17.021265] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-09-23T22:22:17.021469] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-23T22:22:17.024066] [INFO ] [MAIN ] Derivative Progress: 1049/2077 symbols completed. KOS took 1.1s. Estimated remaining: 6m 43s. Rate: 153.2 symbols/min [2025-09-23T22:22:17.042491] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:17.043211] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53682 primary records. [2025-09-23T22:22:17.043272] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-23T22:22:17.059358] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-09-23T22:22:17.059488] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-23T22:22:17.061529] [INFO ] [MAIN ] Derivative Progress: 1050/2077 symbols completed. KR took 0.8s. Estimated remaining: 6m 42s. Rate: 153.3 symbols/min [2025-09-23T22:22:17.062214] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:17.062263] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:17.062792] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:17.109006] [DEBUG] [LOCAL ] KREF: Loaded 37022 existing records from primary storage. [2025-09-23T22:22:17.109281] [INFO ] [MAIN ] KREF: Loaded 37022 primary data records. [2025-09-23T22:22:17.291291] [DEBUG] [LOCAL ] KRC: Loaded 48420 existing records from primary storage. [2025-09-23T22:22:17.269171] [DEBUG] [LOCAL ] KRG: Loaded 49153 existing records from primary storage. [2025-09-23T22:22:17.345672] [INFO ] [MAIN ] KRG: Loaded 49153 primary data records. [2025-09-23T22:22:17.345474] [INFO ] [MAIN ] KRC: Loaded 48420 primary data records. [2025-09-23T22:22:18.122209] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:18.124481] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37022 primary records. [2025-09-23T22:22:18.124903] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-23T22:22:18.150483] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-09-23T22:22:18.151277] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-23T22:22:18.153583] [INFO ] [MAIN ] Derivative Progress: 1051/2077 symbols completed. KREF took 1.1s. Estimated remaining: 6m 42s. Rate: 153.1 symbols/min [2025-09-23T22:22:18.154477] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:18.175434] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:18.189803] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:18.191191] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48420 primary records. [2025-09-23T22:22:18.192279] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-23T22:22:18.192196] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49153 primary records. [2025-09-23T22:22:18.192887] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-23T22:22:18.228092] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-09-23T22:22:18.228690] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-23T22:22:18.231262] [INFO ] [MAIN ] Derivative Progress: 1052/2077 symbols completed. KRC took 1.2s. Estimated remaining: 6m 41s. Rate: 153.2 symbols/min [2025-09-23T22:22:18.231669] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:18.245130] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-09-23T22:22:18.245335] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-23T22:22:18.247998] [INFO ] [MAIN ] Derivative Progress: 1053/2077 symbols completed. KRG took 1.2s. Estimated remaining: 6m 41s. Rate: 153.3 symbols/min [2025-09-23T22:22:18.248359] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:18.264819] [DEBUG] [LOCAL ] KRP: Loaded 37613 existing records from primary storage. [2025-09-23T22:22:18.265362] [INFO ] [MAIN ] KRP: Loaded 37613 primary data records. [2025-09-23T22:22:18.664846] [DEBUG] [LOCAL ] KT: Loaded 45670 existing records from primary storage. [2025-09-23T22:22:18.680730] [INFO ] [MAIN ] KT: Loaded 45670 primary data records. [2025-09-23T22:22:18.703453] [DEBUG] [LOCAL ] KSS: Loaded 53608 existing records from primary storage. [2025-09-23T22:22:18.724531] [INFO ] [MAIN ] KSS: Loaded 53608 primary data records. [2025-09-23T22:22:19.335895] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:19.337531] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 37613 primary records. [2025-09-23T22:22:19.337675] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-23T22:22:19.359832] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-09-23T22:22:19.360056] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-23T22:22:19.362883] [INFO ] [MAIN ] Derivative Progress: 1054/2077 symbols completed. KRP took 1.2s. Estimated remaining: 6m 41s. Rate: 153.1 symbols/min [2025-09-23T22:22:19.363317] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:19.382070] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:19.382869] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45670 primary records. [2025-09-23T22:22:19.383030] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-23T22:22:19.407874] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:19.409689] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53608 primary records. [2025-09-23T22:22:19.409843] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-23T22:22:19.430564] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-09-23T22:22:19.429531] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-09-23T22:22:19.430723] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-23T22:22:19.433426] [INFO ] [MAIN ] Derivative Progress: 1055/2077 symbols completed. KSS took 1.2s. Estimated remaining: 6m 40s. Rate: 153.2 symbols/min [2025-09-23T22:22:19.433614] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-23T22:22:19.435852] [INFO ] [MAIN ] Derivative Progress: 1056/2077 symbols completed. KT took 1.2s. Estimated remaining: 6m 40s. Rate: 153.3 symbols/min [2025-09-23T22:22:19.435930] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:19.436282] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:19.467251] [DEBUG] [LOCAL ] KTB: Loaded 41133 existing records from primary storage. [2025-09-23T22:22:19.468281] [INFO ] [MAIN ] KTB: Loaded 41133 primary data records. [2025-09-23T22:22:19.498241] [DEBUG] [LOCAL ] KTF: Loaded 13055 existing records from primary storage. [2025-09-23T22:22:19.528848] [INFO ] [MAIN ] KTF: Loaded 13055 primary data records. [2025-09-23T22:22:19.837246] [DEBUG] [LOCAL ] KVYO: Loaded 49905 existing records from primary storage. [2025-09-23T22:22:19.986003] [INFO ] [MAIN ] KVYO: Loaded 49905 primary data records. [2025-09-23T22:22:20.594467] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:20.597424] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 41133 primary records. [2025-09-23T22:22:20.597929] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-23T22:22:20.626744] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:20.628919] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 13055 primary records. [2025-09-23T22:22:20.631757] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-23T22:22:20.652524] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-09-23T22:22:20.653171] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-23T22:22:20.655809] [INFO ] [MAIN ] Derivative Progress: 1057/2077 symbols completed. KTF took 1.2s. Estimated remaining: 6m 40s. Rate: 153.0 symbols/min [2025-09-23T22:22:20.656691] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-09-23T22:22:20.657144] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:20.657335] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-23T22:22:20.659378] [INFO ] [MAIN ] Derivative Progress: 1058/2077 symbols completed. KTB took 1.3s. Estimated remaining: 6m 39s. Rate: 153.2 symbols/min [2025-09-23T22:22:20.659587] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:20.690270] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:20.691531] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 49905 primary records. [2025-09-23T22:22:20.691707] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-23T22:22:20.730438] [DEBUG] [LOCAL ] KWR: Loaded 16787 existing records from primary storage. [2025-09-23T22:22:20.732903] [INFO ] [MAIN ] KWR: Loaded 16787 primary data records. [2025-09-23T22:22:20.835317] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-09-23T22:22:20.835488] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-23T22:22:20.847404] [INFO ] [MAIN ] Derivative Progress: 1059/2077 symbols completed. KVYO took 1.4s. Estimated remaining: 6m 39s. Rate: 153.2 symbols/min [2025-09-23T22:22:20.836124] [DEBUG] [LOCAL ] KW: Loaded 40660 existing records from primary storage. [2025-09-23T22:22:20.860331] [INFO ] [MAIN ] KW: Loaded 40660 primary data records. [2025-09-23T22:22:20.860669] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:21.398933] [DEBUG] [LOCAL ] KYN: Loaded 30159 existing records from primary storage. [2025-09-23T22:22:21.399750] [INFO ] [MAIN ] KYN: Loaded 30159 primary data records. [2025-09-23T22:22:21.563146] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:21.605616] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16787 primary records. [2025-09-23T22:22:21.626954] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-23T22:22:21.769671] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:21.771317] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40660 primary records. [2025-09-23T22:22:21.771779] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-23T22:22:21.773671] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-09-23T22:22:21.774026] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-23T22:22:21.776928] [INFO ] [MAIN ] Derivative Progress: 1060/2077 symbols completed. KWR took 1.1s. Estimated remaining: 6m 39s. Rate: 153.1 symbols/min [2025-09-23T22:22:21.777512] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:21.794304] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-09-23T22:22:21.794824] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-23T22:22:21.797118] [INFO ] [MAIN ] Derivative Progress: 1061/2077 symbols completed. KW took 1.1s. Estimated remaining: 6m 38s. Rate: 153.2 symbols/min [2025-09-23T22:22:21.797606] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:21.818213] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:21.819032] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30159 primary records. [2025-09-23T22:22:21.819154] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-23T22:22:21.847955] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-09-23T22:22:21.857367] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-23T22:22:21.859998] [INFO ] [MAIN ] Derivative Progress: 1062/2077 symbols completed. KYN took 1.0s. Estimated remaining: 6m 37s. Rate: 153.3 symbols/min [2025-09-23T22:22:21.860471] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:21.892838] [DEBUG] [LOCAL ] L: Loaded 40938 existing records from primary storage. [2025-09-23T22:22:21.893083] [INFO ] [MAIN ] L: Loaded 40938 primary data records. [2025-09-23T22:22:22.031111] [DEBUG] [LOCAL ] LAC: Loaded 52304 existing records from primary storage. [2025-09-23T22:22:22.060840] [INFO ] [MAIN ] LAC: Loaded 52304 primary data records. [2025-09-23T22:22:22.061829] [DEBUG] [LOCAL ] LAD: Loaded 23712 existing records from primary storage. [2025-09-23T22:22:22.092222] [INFO ] [MAIN ] LAD: Loaded 23712 primary data records. [2025-09-23T22:22:22.988911] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:22.990679] [INFO ] [MAIN ] L: Generated 1794 derivative records from 40938 primary records. [2025-09-23T22:22:22.990874] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-23T22:22:23.012756] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-09-23T22:22:23.013071] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-23T22:22:23.015298] [INFO ] [MAIN ] Derivative Progress: 1063/2077 symbols completed. L took 1.2s. Estimated remaining: 6m 38s. Rate: 153.0 symbols/min [2025-09-23T22:22:23.028787] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:23.029423] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52304 primary records. [2025-09-23T22:22:23.029500] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-23T22:22:23.061769] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-09-23T22:22:23.062368] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-23T22:22:23.065272] [INFO ] [MAIN ] Derivative Progress: 1064/2077 symbols completed. LAC took 1.3s. Estimated remaining: 6m 37s. Rate: 153.2 symbols/min [2025-09-23T22:22:23.065549] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:23.066334] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23712 primary records. [2025-09-23T22:22:23.066410] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-23T22:22:23.081803] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-09-23T22:22:23.081870] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-23T22:22:23.084269] [INFO ] [MAIN ] Derivative Progress: 1065/2077 symbols completed. LAD took 1.2s. Estimated remaining: 6m 36s. Rate: 153.3 symbols/min [2025-09-23T22:22:23.084936] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:23.085030] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:23.085354] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:23.090418] [DEBUG] [LOCAL ] LANV: Loaded 2730 existing records from primary storage. [2025-09-23T22:22:23.090672] [INFO ] [MAIN ] LANV: Loaded 2730 primary data records. [2025-09-23T22:22:23.194432] [DEBUG] [LOCAL ] LAW: Loaded 13871 existing records from primary storage. [2025-09-23T22:22:23.211834] [INFO ] [MAIN ] LAW: Loaded 13871 primary data records. [2025-09-23T22:22:23.607808] [DEBUG] [LOCAL ] LADR: Loaded 38692 existing records from primary storage. [2025-09-23T22:22:23.625604] [INFO ] [MAIN ] LADR: Loaded 38692 primary data records. [2025-09-23T22:22:24.158228] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-23T22:22:24.161083] [INFO ] [MAIN ] LANV: Generated 1791 derivative records from 2730 primary records. [2025-09-23T22:22:24.161351] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-23T22:22:24.187826] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:24.190842] [DEBUG] [LOCAL ] LANV: Derivative data saved (1791 records). [2025-09-23T22:22:24.192128] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 13871 primary records. [2025-09-23T22:22:24.192322] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-23T22:22:24.192534] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-23T22:22:24.196239] [INFO ] [MAIN ] Derivative Progress: 1066/2077 symbols completed. LANV took 1.1s. Estimated remaining: 6m 36s. Rate: 153.0 symbols/min [2025-09-23T22:22:24.204306] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:24.213789] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-09-23T22:22:24.214230] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-23T22:22:24.216847] [INFO ] [MAIN ] Derivative Progress: 1067/2077 symbols completed. LAW took 1.1s. Estimated remaining: 6m 36s. Rate: 153.2 symbols/min [2025-09-23T22:22:24.219996] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:24.234154] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:24.235174] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 38692 primary records. [2025-09-23T22:22:24.235339] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-23T22:22:24.254344] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-09-23T22:22:24.254688] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-23T22:22:24.260095] [INFO ] [MAIN ] Derivative Progress: 1068/2077 symbols completed. LADR took 1.2s. Estimated remaining: 6m 35s. Rate: 153.3 symbols/min [2025-09-23T22:22:24.260486] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:24.302970] [DEBUG] [LOCAL ] LAZ: Loaded 45286 existing records from primary storage. [2025-09-23T22:22:24.303520] [INFO ] [MAIN ] LAZ: Loaded 45286 primary data records. [2025-09-23T22:22:24.422807] [DEBUG] [LOCAL ] LB: Loaded 37675 existing records from primary storage. [2025-09-23T22:22:24.448704] [INFO ] [MAIN ] LB: Loaded 37675 primary data records. [2025-09-23T22:22:24.778591] [DEBUG] [LOCAL ] LBRT: Loaded 52920 existing records from primary storage. [2025-09-23T22:22:24.793993] [INFO ] [MAIN ] LBRT: Loaded 52920 primary data records. [2025-09-23T22:22:25.392591] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:25.393812] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 45286 primary records. [2025-09-23T22:22:25.394035] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-23T22:22:25.412072] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-09-23T22:22:25.412290] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-23T22:22:25.414358] [INFO ] [MAIN ] Derivative Progress: 1069/2077 symbols completed. LAZ took 1.2s. Estimated remaining: 6m 35s. Rate: 153.0 symbols/min [2025-09-23T22:22:25.414744] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:25.432380] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:25.433172] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37675 primary records. [2025-09-23T22:22:25.433437] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-23T22:22:25.462985] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:25.465345] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-09-23T22:22:25.466397] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-23T22:22:25.466239] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52920 primary records. [2025-09-23T22:22:25.468878] [INFO ] [MAIN ] Derivative Progress: 1070/2077 symbols completed. LB took 1.2s. Estimated remaining: 6m 35s. Rate: 153.1 symbols/min [2025-09-23T22:22:25.469294] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:25.469033] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-23T22:22:25.501291] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-09-23T22:22:25.501567] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-23T22:22:25.505207] [INFO ] [MAIN ] Derivative Progress: 1071/2077 symbols completed. LBRT took 1.2s. Estimated remaining: 6m 34s. Rate: 153.3 symbols/min [2025-09-23T22:22:25.505664] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:25.525581] [DEBUG] [LOCAL ] LC: Loaded 47948 existing records from primary storage. [2025-09-23T22:22:25.533577] [INFO ] [MAIN ] LC: Loaded 47948 primary data records. [2025-09-23T22:22:25.631085] [DEBUG] [LOCAL ] LCII: Loaded 28651 existing records from primary storage. [2025-09-23T22:22:25.662031] [INFO ] [MAIN ] LCII: Loaded 28651 primary data records. [2025-09-23T22:22:25.865181] [DEBUG] [LOCAL ] LDI: Loaded 43871 existing records from primary storage. [2025-09-23T22:22:25.890633] [INFO ] [MAIN ] LDI: Loaded 43871 primary data records. [2025-09-23T22:22:26.565978] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:26.567485] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 47948 primary records. [2025-09-23T22:22:26.567725] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-23T22:22:26.596872] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-09-23T22:22:26.602433] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:26.603323] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 28651 primary records. [2025-09-23T22:22:26.603614] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-23T22:22:26.602131] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-23T22:22:26.606162] [INFO ] [MAIN ] Derivative Progress: 1072/2077 symbols completed. LC took 1.2s. Estimated remaining: 6m 34s. Rate: 153.0 symbols/min [2025-09-23T22:22:26.614959] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:26.623985] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-09-23T22:22:26.624744] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-23T22:22:26.627488] [INFO ] [MAIN ] Derivative Progress: 1073/2077 symbols completed. LCII took 1.2s. Estimated remaining: 6m 33s. Rate: 153.1 symbols/min [2025-09-23T22:22:26.628100] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:26.646280] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:26.646995] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 43871 primary records. [2025-09-23T22:22:26.647110] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-23T22:22:26.669409] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-09-23T22:22:26.669562] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-23T22:22:26.672436] [INFO ] [MAIN ] Derivative Progress: 1074/2077 symbols completed. LDI took 1.2s. Estimated remaining: 6m 33s. Rate: 153.3 symbols/min [2025-09-23T22:22:26.672946] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:26.679311] [DEBUG] [LOCAL ] LDP: Loaded 12995 existing records from primary storage. [2025-09-23T22:22:26.679704] [INFO ] [MAIN ] LDP: Loaded 12995 primary data records. [2025-09-23T22:22:26.871925] [DEBUG] [LOCAL ] LDOS: Loaded 45814 existing records from primary storage. [2025-09-23T22:22:27.033042] [INFO ] [MAIN ] LDOS: Loaded 45814 primary data records. [2025-09-23T22:22:27.193882] [DEBUG] [LOCAL ] LEA: Loaded 41822 existing records from primary storage. [2025-09-23T22:22:27.245598] [INFO ] [MAIN ] LEA: Loaded 41822 primary data records. [2025-09-23T22:22:27.728559] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:27.741820] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12995 primary records. [2025-09-23T22:22:27.742128] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-23T22:22:27.771106] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-09-23T22:22:27.771958] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-23T22:22:27.774707] [INFO ] [MAIN ] Derivative Progress: 1075/2077 symbols completed. LDP took 1.1s. Estimated remaining: 6m 33s. Rate: 153.0 symbols/min [2025-09-23T22:22:27.775913] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:27.798882] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:27.799931] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45814 primary records. [2025-09-23T22:22:27.800152] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-23T22:22:27.840705] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:27.841673] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41822 primary records. [2025-09-23T22:22:27.840152] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-09-23T22:22:27.841927] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-23T22:22:27.842010] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-23T22:22:27.846258] [INFO ] [MAIN ] Derivative Progress: 1076/2077 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 32s. Rate: 153.1 symbols/min [2025-09-23T22:22:27.855300] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:27.882187] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-09-23T22:22:27.882381] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-23T22:22:27.885293] [INFO ] [MAIN ] Derivative Progress: 1077/2077 symbols completed. LEA took 1.2s. Estimated remaining: 6m 32s. Rate: 153.3 symbols/min [2025-09-23T22:22:27.885920] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:27.920161] [DEBUG] [LOCAL ] LEG: Loaded 50396 existing records from primary storage. [2025-09-23T22:22:27.921086] [INFO ] [MAIN ] LEG: Loaded 50396 primary data records. [2025-09-23T22:22:28.034973] [DEBUG] [LOCAL ] LEO: Loaded 17672 existing records from primary storage. [2025-09-23T22:22:28.075509] [INFO ] [MAIN ] LEO: Loaded 17672 primary data records. [2025-09-23T22:22:28.350101] [DEBUG] [LOCAL ] LEN: Loaded 53191 existing records from primary storage. [2025-09-23T22:22:28.372396] [INFO ] [MAIN ] LEN: Loaded 53191 primary data records. [2025-09-23T22:22:29.140518] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:29.149787] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50396 primary records. [2025-09-23T22:22:29.155041] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-23T22:22:29.155676] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:29.157026] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 17672 primary records. [2025-09-23T22:22:29.157743] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-23T22:22:29.186872] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-09-23T22:22:29.190592] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-23T22:22:29.195215] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-09-23T22:22:29.193841] [INFO ] [MAIN ] Derivative Progress: 1078/2077 symbols completed. LEG took 1.4s. Estimated remaining: 6m 32s. Rate: 152.9 symbols/min [2025-09-23T22:22:29.196535] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-23T22:22:29.200336] [INFO ] [MAIN ] Derivative Progress: 1079/2077 symbols completed. LEO took 1.3s. Estimated remaining: 6m 31s. Rate: 153.1 symbols/min [2025-09-23T22:22:29.213314] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:29.213970] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53191 primary records. [2025-09-23T22:22:29.214031] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-23T22:22:29.230584] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-09-23T22:22:29.230734] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-23T22:22:29.234509] [INFO ] [MAIN ] Derivative Progress: 1080/2077 symbols completed. LEN took 1.4s. Estimated remaining: 6m 30s. Rate: 153.2 symbols/min [2025-09-23T22:22:29.235314] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:29.235427] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:29.235119] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:29.266402] [DEBUG] [LOCAL ] LFT: Loaded 18057 existing records from primary storage. [2025-09-23T22:22:29.266710] [INFO ] [MAIN ] LFT: Loaded 18057 primary data records. [2025-09-23T22:22:29.265852] [DEBUG] [LOCAL ] LGI: Loaded 10013 existing records from primary storage. [2025-09-23T22:22:29.302568] [INFO ] [MAIN ] LGI: Loaded 10013 primary data records. [2025-09-23T22:22:29.798095] [DEBUG] [LOCAL ] LEVI: Loaded 51546 existing records from primary storage. [2025-09-23T22:22:29.913263] [INFO ] [MAIN ] LEVI: Loaded 51546 primary data records. [2025-09-23T22:22:30.272973] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:30.287166] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18057 primary records. [2025-09-23T22:22:30.288360] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:30.288005] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-23T22:22:30.291188] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10013 primary records. [2025-09-23T22:22:30.292101] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-23T22:22:30.325579] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-09-23T22:22:30.326174] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-23T22:22:30.328460] [INFO ] [MAIN ] Derivative Progress: 1081/2077 symbols completed. LFT took 1.1s. Estimated remaining: 6m 31s. Rate: 152.9 symbols/min [2025-09-23T22:22:30.329051] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-09-23T22:22:30.329511] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-23T22:22:30.329739] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:30.333065] [INFO ] [MAIN ] Derivative Progress: 1082/2077 symbols completed. LGI took 1.1s. Estimated remaining: 6m 30s. Rate: 153.1 symbols/min [2025-09-23T22:22:30.333813] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:30.360476] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:30.362455] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51546 primary records. [2025-09-23T22:22:30.363059] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-23T22:22:30.400528] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-09-23T22:22:30.400718] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-23T22:22:30.403671] [INFO ] [MAIN ] Derivative Progress: 1083/2077 symbols completed. LEVI took 1.2s. Estimated remaining: 6m 29s. Rate: 153.2 symbols/min [2025-09-23T22:22:30.404169] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:30.421856] [DEBUG] [LOCAL ] LH: Loaded 38380 existing records from primary storage. [2025-09-23T22:22:30.422127] [INFO ] [MAIN ] LH: Loaded 38380 primary data records. [2025-09-23T22:22:30.606545] [DEBUG] [LOCAL ] LHX: Loaded 48750 existing records from primary storage. [2025-09-23T22:22:30.649721] [DEBUG] [LOCAL ] LII: Loaded 28428 existing records from primary storage. [2025-09-23T22:22:30.641342] [INFO ] [MAIN ] LHX: Loaded 48750 primary data records. [2025-09-23T22:22:30.667538] [INFO ] [MAIN ] LII: Loaded 28428 primary data records. [2025-09-23T22:22:31.487048] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:31.488160] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 38380 primary records. [2025-09-23T22:22:31.488276] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-23T22:22:31.507238] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-09-23T22:22:31.507404] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-23T22:22:31.509604] [INFO ] [MAIN ] Derivative Progress: 1084/2077 symbols completed. LH took 1.2s. Estimated remaining: 6m 30s. Rate: 152.9 symbols/min [2025-09-23T22:22:31.510322] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:31.541248] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:31.541414] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:31.542189] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48750 primary records. [2025-09-23T22:22:31.542784] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 28428 primary records. [2025-09-23T22:22:31.542958] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-23T22:22:31.543036] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-23T22:22:31.584184] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-09-23T22:22:31.584873] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-23T22:22:31.588298] [INFO ] [MAIN ] Derivative Progress: 1085/2077 symbols completed. LII took 1.2s. Estimated remaining: 6m 29s. Rate: 153.0 symbols/min [2025-09-23T22:22:31.589620] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:31.591566] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-09-23T22:22:31.591821] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-23T22:22:31.595124] [INFO ] [MAIN ] Derivative Progress: 1086/2077 symbols completed. LHX took 1.3s. Estimated remaining: 6m 28s. Rate: 153.2 symbols/min [2025-09-23T22:22:31.595617] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:31.609610] [DEBUG] [LOCAL ] LION: Loaded 43086 existing records from primary storage. [2025-09-23T22:22:31.609847] [INFO ] [MAIN ] LION: Loaded 43086 primary data records. [2025-09-23T22:22:31.650901] [DEBUG] [LOCAL ] LITB: Loaded 4327 existing records from primary storage. [2025-09-23T22:22:31.651058] [INFO ] [MAIN ] LITB: Loaded 4327 primary data records. [2025-09-23T22:22:32.285498] [DEBUG] [LOCAL ] LLY: Loaded 53293 existing records from primary storage. [2025-09-23T22:22:32.286372] [INFO ] [MAIN ] LLY: Loaded 53293 primary data records. [2025-09-23T22:22:32.644098] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:32.645706] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 43086 primary records. [2025-09-23T22:22:32.646382] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-23T22:22:32.673515] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:32.675600] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4327 primary records. [2025-09-23T22:22:32.677369] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-23T22:22:32.680679] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-09-23T22:22:32.680988] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-23T22:22:32.688959] [INFO ] [MAIN ] Derivative Progress: 1087/2077 symbols completed. LION took 1.2s. Estimated remaining: 6m 28s. Rate: 152.9 symbols/min [2025-09-23T22:22:32.694720] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:32.696861] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-09-23T22:22:32.697246] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-23T22:22:32.700141] [INFO ] [MAIN ] Derivative Progress: 1088/2077 symbols completed. LITB took 1.1s. Estimated remaining: 6m 28s. Rate: 153.1 symbols/min [2025-09-23T22:22:32.700563] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:32.724056] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:32.725029] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53293 primary records. [2025-09-23T22:22:32.725168] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-23T22:22:32.743635] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-09-23T22:22:32.743819] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-23T22:22:32.746557] [INFO ] [MAIN ] Derivative Progress: 1089/2077 symbols completed. LLY took 1.2s. Estimated remaining: 6m 27s. Rate: 153.2 symbols/min [2025-09-23T22:22:32.747028] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:32.794869] [DEBUG] [LOCAL ] LMND: Loaded 51875 existing records from primary storage. [2025-09-23T22:22:32.795585] [INFO ] [MAIN ] LMND: Loaded 51875 primary data records. [2025-09-23T22:22:32.865725] [DEBUG] [LOCAL ] LMT: Loaded 49926 existing records from primary storage. [2025-09-23T22:22:32.879692] [INFO ] [MAIN ] LMT: Loaded 49926 primary data records. [2025-09-23T22:22:33.139068] [DEBUG] [LOCAL ] LNC: Loaded 51637 existing records from primary storage. [2025-09-23T22:22:33.144586] [INFO ] [MAIN ] LNC: Loaded 51637 primary data records. [2025-09-23T22:22:33.882762] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:33.884293] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51875 primary records. [2025-09-23T22:22:33.898914] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-23T22:22:33.899719] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:33.902097] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49926 primary records. [2025-09-23T22:22:33.916279] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-23T22:22:33.926711] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-09-23T22:22:33.928435] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-23T22:22:33.937856] [INFO ] [MAIN ] Derivative Progress: 1090/2077 symbols completed. LMND took 1.2s. Estimated remaining: 6m 27s. Rate: 152.9 symbols/min [2025-09-23T22:22:33.946807] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:33.962376] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-09-23T22:22:33.964382] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-23T22:22:33.968501] [INFO ] [MAIN ] Derivative Progress: 1091/2077 symbols completed. LMT took 1.3s. Estimated remaining: 6m 27s. Rate: 153.0 symbols/min [2025-09-23T22:22:33.969332] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:33.969015] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:33.970816] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51637 primary records. [2025-09-23T22:22:33.974332] [DEBUG] [LOCAL ] LND: Loaded 4996 existing records from primary storage. [2025-09-23T22:22:33.971131] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-23T22:22:33.975676] [INFO ] [MAIN ] LND: Loaded 4996 primary data records. [2025-09-23T22:22:34.128579] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-09-23T22:22:34.139689] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-23T22:22:34.147680] [INFO ] [MAIN ] Derivative Progress: 1092/2077 symbols completed. LNC took 1.4s. Estimated remaining: 6m 26s. Rate: 153.1 symbols/min [2025-09-23T22:22:34.175896] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:34.393974] [DEBUG] [LOCAL ] LNG: Loaded 51508 existing records from primary storage. [2025-09-23T22:22:34.394388] [INFO ] [MAIN ] LNG: Loaded 51508 primary data records. [2025-09-23T22:22:34.400858] [DEBUG] [LOCAL ] LNN: Loaded 11243 existing records from primary storage. [2025-09-23T22:22:34.401013] [INFO ] [MAIN ] LNN: Loaded 11243 primary data records. [2025-09-23T22:22:35.128602] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:35.130801] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4996 primary records. [2025-09-23T22:22:35.132032] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-23T22:22:35.151007] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-09-23T22:22:35.152701] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-23T22:22:35.155185] [INFO ] [MAIN ] Derivative Progress: 1093/2077 symbols completed. LND took 1.2s. Estimated remaining: 6m 26s. Rate: 152.9 symbols/min [2025-09-23T22:22:35.178962] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:35.179993] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51508 primary records. [2025-09-23T22:22:35.180158] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-23T22:22:35.195179] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:35.204013] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11243 primary records. [2025-09-23T22:22:35.208570] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-23T22:22:35.226537] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-09-23T22:22:35.227258] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-23T22:22:35.230027] [INFO ] [MAIN ] Derivative Progress: 1094/2077 symbols completed. LNG took 1.3s. Estimated remaining: 6m 25s. Rate: 153.0 symbols/min [2025-09-23T22:22:35.235433] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-09-23T22:22:35.235677] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-23T22:22:35.238638] [INFO ] [MAIN ] Derivative Progress: 1095/2077 symbols completed. LNN took 1.1s. Estimated remaining: 6m 25s. Rate: 153.1 symbols/min [2025-09-23T22:22:35.239761] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:35.239675] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:35.239916] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:35.247603] [DEBUG] [LOCAL ] LOCL: Loaded 3584 existing records from primary storage. [2025-09-23T22:22:35.247782] [INFO ] [MAIN ] LOCL: Loaded 3584 primary data records. [2025-09-23T22:22:35.465125] [DEBUG] [LOCAL ] LOB: Loaded 27535 existing records from primary storage. [2025-09-23T22:22:35.465577] [INFO ] [MAIN ] LOB: Loaded 27535 primary data records. [2025-09-23T22:22:35.643188] [DEBUG] [LOCAL ] LOAR: Loaded 41777 existing records from primary storage. [2025-09-23T22:22:35.698286] [INFO ] [MAIN ] LOAR: Loaded 41777 primary data records. [2025-09-23T22:22:36.299072] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:36.301111] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3584 primary records. [2025-09-23T22:22:36.301506] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-23T22:22:36.319436] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-09-23T22:22:36.319564] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-23T22:22:36.322100] [INFO ] [MAIN ] Derivative Progress: 1096/2077 symbols completed. LOCL took 1.1s. Estimated remaining: 6m 25s. Rate: 152.9 symbols/min [2025-09-23T22:22:36.323083] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:36.357045] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:36.358715] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 41777 primary records. [2025-09-23T22:22:36.357847] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:36.358939] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-23T22:22:36.360101] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27535 primary records. [2025-09-23T22:22:36.360877] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-23T22:22:36.398304] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-09-23T22:22:36.399904] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-23T22:22:36.404594] [INFO ] [MAIN ] Derivative Progress: 1097/2077 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 24s. Rate: 153.0 symbols/min [2025-09-23T22:22:36.406408] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:36.406797] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-09-23T22:22:36.407231] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-23T22:22:36.409998] [INFO ] [MAIN ] Derivative Progress: 1098/2077 symbols completed. LOB took 1.2s. Estimated remaining: 6m 24s. Rate: 153.1 symbols/min [2025-09-23T22:22:36.410485] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:36.422855] [DEBUG] [LOCAL ] LOMA: Loaded 31837 existing records from primary storage. [2025-09-23T22:22:36.423110] [INFO ] [MAIN ] LOMA: Loaded 31837 primary data records. [2025-09-23T22:22:36.786182] [DEBUG] [LOCAL ] LPG: Loaded 40171 existing records from primary storage. [2025-09-23T22:22:36.787382] [INFO ] [MAIN ] LPG: Loaded 40171 primary data records. [2025-09-23T22:22:36.789683] [DEBUG] [LOCAL ] LOW: Loaded 52961 existing records from primary storage. [2025-09-23T22:22:36.795639] [INFO ] [MAIN ] LOW: Loaded 52961 primary data records. [2025-09-23T22:22:37.527277] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:37.528465] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 31837 primary records. [2025-09-23T22:22:37.528567] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-23T22:22:37.551086] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-09-23T22:22:37.551429] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-23T22:22:37.553843] [INFO ] [MAIN ] Derivative Progress: 1099/2077 symbols completed. LOMA took 1.2s. Estimated remaining: 6m 24s. Rate: 152.9 symbols/min [2025-09-23T22:22:37.554184] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:37.606423] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:37.607416] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:37.608389] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 40171 primary records. [2025-09-23T22:22:37.617485] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52961 primary records. [2025-09-23T22:22:37.617781] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-23T22:22:37.618759] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-23T22:22:37.621052] [DEBUG] [LOCAL ] LPL: Loaded 25591 existing records from primary storage. [2025-09-23T22:22:37.630061] [INFO ] [MAIN ] LPL: Loaded 25591 primary data records. [2025-09-23T22:22:37.687057] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-09-23T22:22:37.695670] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-23T22:22:37.720205] [INFO ] [MAIN ] Derivative Progress: 1100/2077 symbols completed. LPG took 1.3s. Estimated remaining: 6m 23s. Rate: 153.0 symbols/min [2025-09-23T22:22:37.721353] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-09-23T22:22:37.733615] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:37.738936] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-23T22:22:37.765939] [INFO ] [MAIN ] Derivative Progress: 1101/2077 symbols completed. LOW took 1.4s. Estimated remaining: 6m 23s. Rate: 153.1 symbols/min [2025-09-23T22:22:37.772596] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:38.007330] [DEBUG] [LOCAL ] LPX: Loaded 39673 existing records from primary storage. [2025-09-23T22:22:38.007791] [INFO ] [MAIN ] LPX: Loaded 39673 primary data records. [2025-09-23T22:22:38.163902] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:38.180189] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 25591 primary records. [2025-09-23T22:22:38.180307] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-23T22:22:38.204444] [DEBUG] [LOCAL ] LRN: Loaded 40031 existing records from primary storage. [2025-09-23T22:22:38.212135] [INFO ] [MAIN ] LRN: Loaded 40031 primary data records. [2025-09-23T22:22:38.292490] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-09-23T22:22:38.431092] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-23T22:22:38.448839] [INFO ] [MAIN ] Derivative Progress: 1102/2077 symbols completed. LPL took 0.9s. Estimated remaining: 6m 22s. Rate: 153.0 symbols/min [2025-09-23T22:22:38.462149] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:38.749901] [DEBUG] [LOCAL ] LSPD: Loaded 43334 existing records from primary storage. [2025-09-23T22:22:38.750673] [INFO ] [MAIN ] LSPD: Loaded 43334 primary data records. [2025-09-23T22:22:38.763228] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:38.809685] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39673 primary records. [2025-09-23T22:22:38.837321] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-23T22:22:38.928436] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:38.939372] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 40031 primary records. [2025-09-23T22:22:38.972471] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-23T22:22:39.113344] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-09-23T22:22:39.115882] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-23T22:22:39.119268] [INFO ] [MAIN ] Derivative Progress: 1103/2077 symbols completed. LPX took 1.4s. Estimated remaining: 6m 22s. Rate: 152.9 symbols/min [2025-09-23T22:22:39.120512] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:39.124124] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-09-23T22:22:39.124418] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-23T22:22:39.127987] [INFO ] [MAIN ] Derivative Progress: 1104/2077 symbols completed. LRN took 1.4s. Estimated remaining: 6m 22s. Rate: 153.0 symbols/min [2025-09-23T22:22:39.128589] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:39.158875] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:39.159604] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 43334 primary records. [2025-09-23T22:22:39.159806] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-23T22:22:39.191586] [DEBUG] [LOCAL ] LTC: Loaded 29903 existing records from primary storage. [2025-09-23T22:22:39.192438] [INFO ] [MAIN ] LTC: Loaded 29903 primary data records. [2025-09-23T22:22:39.194185] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-09-23T22:22:39.194428] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-23T22:22:39.209303] [INFO ] [MAIN ] Derivative Progress: 1105/2077 symbols completed. LSPD took 0.7s. Estimated remaining: 6m 21s. Rate: 153.1 symbols/min [2025-09-23T22:22:39.279864] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:39.388939] [DEBUG] [LOCAL ] LTH: Loaded 51874 existing records from primary storage. [2025-09-23T22:22:39.416921] [INFO ] [MAIN ] LTH: Loaded 51874 primary data records. [2025-09-23T22:22:39.704291] [DEBUG] [LOCAL ] LTM: Loaded 36133 existing records from primary storage. [2025-09-23T22:22:39.752210] [INFO ] [MAIN ] LTM: Loaded 36133 primary data records. [2025-09-23T22:22:40.224460] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:40.226210] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 29903 primary records. [2025-09-23T22:22:40.226604] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-23T22:22:40.259691] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:40.261306] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51874 primary records. [2025-09-23T22:22:40.261706] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-23T22:22:40.261976] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-09-23T22:22:40.262940] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-23T22:22:40.272208] [INFO ] [MAIN ] Derivative Progress: 1106/2077 symbols completed. LTC took 1.2s. Estimated remaining: 6m 21s. Rate: 152.9 symbols/min [2025-09-23T22:22:40.273586] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:40.285243] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-09-23T22:22:40.285455] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-23T22:22:40.295489] [INFO ] [MAIN ] Derivative Progress: 1107/2077 symbols completed. LTH took 1.2s. Estimated remaining: 6m 20s. Rate: 153.0 symbols/min [2025-09-23T22:22:40.300677] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:40.301101] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:40.302024] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 36133 primary records. [2025-09-23T22:22:40.302253] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-23T22:22:40.319287] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-09-23T22:22:40.319512] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-23T22:22:40.322435] [INFO ] [MAIN ] Derivative Progress: 1108/2077 symbols completed. LTM took 1.1s. Estimated remaining: 6m 20s. Rate: 153.1 symbols/min [2025-09-23T22:22:40.370192] [DEBUG] [LOCAL ] LU: Loaded 48961 existing records from primary storage. [2025-09-23T22:22:40.370425] [INFO ] [MAIN ] LU: Loaded 48961 primary data records. [2025-09-23T22:22:40.514885] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-23T22:22:40.537089] [INFO ] [MAIN ] LUMN: Loaded 53634 primary data records. [2025-09-23T22:22:41.000589] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:41.001320] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48961 primary records. [2025-09-23T22:22:41.001476] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-23T22:22:41.018065] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-09-23T22:22:41.018824] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-23T22:22:41.021319] [INFO ] [MAIN ] Derivative Progress: 1109/2077 symbols completed. LU took 0.7s. Estimated remaining: 6m 20s. Rate: 153.0 symbols/min [2025-09-23T22:22:41.035131] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:41.035694] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53634 primary records. [2025-09-23T22:22:41.035756] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-23T22:22:41.050688] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-09-23T22:22:41.050745] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-23T22:22:41.053001] [INFO ] [MAIN ] Derivative Progress: 1110/2077 symbols completed. LUMN took 0.8s. Estimated remaining: 6m 19s. Rate: 153.2 symbols/min [2025-09-23T22:22:41.053582] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:41.053467] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:41.053747] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:41.077445] [DEBUG] [LOCAL ] LVWR: Loaded 17514 existing records from primary storage. [2025-09-23T22:22:41.077638] [INFO ] [MAIN ] LVWR: Loaded 17514 primary data records. [2025-09-23T22:22:41.436492] [DEBUG] [LOCAL ] LVS: Loaded 53568 existing records from primary storage. [2025-09-23T22:22:41.444821] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-23T22:22:41.445599] [INFO ] [MAIN ] LVS: Loaded 53568 primary data records. [2025-09-23T22:22:41.445729] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-09-23T22:22:42.136194] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:42.137129] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 17514 primary records. [2025-09-23T22:22:42.137880] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-23T22:22:42.170709] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-09-23T22:22:42.176751] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:42.176827] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-23T22:22:42.179447] [INFO ] [MAIN ] Derivative Progress: 1111/2077 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 19s. Rate: 152.9 symbols/min [2025-09-23T22:22:42.180452] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-09-23T22:22:42.193999] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-23T22:22:42.188590] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:42.194373] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:42.196358] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53568 primary records. [2025-09-23T22:22:42.203693] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-23T22:22:42.224121] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-09-23T22:22:42.224882] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-23T22:22:42.227564] [INFO ] [MAIN ] Derivative Progress: 1112/2077 symbols completed. LUV took 1.2s. Estimated remaining: 6m 18s. Rate: 153.0 symbols/min [2025-09-23T22:22:42.229800] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:42.232055] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-09-23T22:22:42.232245] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-23T22:22:42.235925] [INFO ] [MAIN ] Derivative Progress: 1113/2077 symbols completed. LVS took 1.2s. Estimated remaining: 6m 18s. Rate: 153.2 symbols/min [2025-09-23T22:22:42.236348] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:42.270276] [DEBUG] [LOCAL ] LXFR: Loaded 17121 existing records from primary storage. [2025-09-23T22:22:42.270520] [INFO ] [MAIN ] LXFR: Loaded 17121 primary data records. [2025-09-23T22:22:42.400915] [DEBUG] [LOCAL ] LW: Loaded 51202 existing records from primary storage. [2025-09-23T22:22:42.422434] [INFO ] [MAIN ] LW: Loaded 51202 primary data records. [2025-09-23T22:22:42.741181] [DEBUG] [LOCAL ] LXP: Loaded 50647 existing records from primary storage. [2025-09-23T22:22:42.770118] [INFO ] [MAIN ] LXP: Loaded 50647 primary data records. [2025-09-23T22:22:43.323575] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:43.324486] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 17121 primary records. [2025-09-23T22:22:43.325149] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-23T22:22:43.357700] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:43.363261] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-09-23T22:22:43.363397] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-23T22:22:43.365388] [INFO ] [MAIN ] Derivative Progress: 1114/2077 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 18s. Rate: 152.9 symbols/min [2025-09-23T22:22:43.362203] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51202 primary records. [2025-09-23T22:22:43.366137] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:43.366320] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-23T22:22:43.387796] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:43.392865] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50647 primary records. [2025-09-23T22:22:43.395750] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-23T22:22:43.402253] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-09-23T22:22:43.413978] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-23T22:22:43.419531] [INFO ] [MAIN ] Derivative Progress: 1115/2077 symbols completed. LW took 1.2s. Estimated remaining: 6m 17s. Rate: 153.0 symbols/min [2025-09-23T22:22:43.420180] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:43.432213] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-09-23T22:22:43.432348] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-23T22:22:43.435502] [INFO ] [MAIN ] Derivative Progress: 1116/2077 symbols completed. LXP took 1.2s. Estimated remaining: 6m 16s. Rate: 153.2 symbols/min [2025-09-23T22:22:43.436567] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:43.446795] [DEBUG] [LOCAL ] LXU: Loaded 32069 existing records from primary storage. [2025-09-23T22:22:43.446972] [INFO ] [MAIN ] LXU: Loaded 32069 primary data records. [2025-09-23T22:22:43.837336] [DEBUG] [LOCAL ] LYB: Loaded 53599 existing records from primary storage. [2025-09-23T22:22:43.837867] [INFO ] [MAIN ] LYB: Loaded 53599 primary data records. [2025-09-23T22:22:43.941912] [DEBUG] [LOCAL ] LYG: Loaded 52873 existing records from primary storage. [2025-09-23T22:22:43.955079] [INFO ] [MAIN ] LYG: Loaded 52873 primary data records. [2025-09-23T22:22:44.531055] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:44.532049] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 32069 primary records. [2025-09-23T22:22:44.532258] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-23T22:22:44.554300] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-09-23T22:22:44.554579] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-23T22:22:44.557039] [INFO ] [MAIN ] Derivative Progress: 1117/2077 symbols completed. LXU took 1.2s. Estimated remaining: 6m 17s. Rate: 152.9 symbols/min [2025-09-23T22:22:44.558572] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:44.576721] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:44.577628] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53599 primary records. [2025-09-23T22:22:44.577966] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-23T22:22:44.598197] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-09-23T22:22:44.607729] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-23T22:22:44.609811] [INFO ] [MAIN ] Derivative Progress: 1118/2077 symbols completed. LYB took 1.2s. Estimated remaining: 6m 16s. Rate: 153.0 symbols/min [2025-09-23T22:22:44.618278] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:44.617941] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:44.619298] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52873 primary records. [2025-09-23T22:22:44.619875] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-23T22:22:44.651935] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-09-23T22:22:44.652090] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-23T22:22:44.655722] [INFO ] [MAIN ] Derivative Progress: 1119/2077 symbols completed. LYG took 1.2s. Estimated remaining: 6m 15s. Rate: 153.1 symbols/min [2025-09-23T22:22:44.656130] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:44.678102] [DEBUG] [LOCAL ] LYV: Loaded 51188 existing records from primary storage. [2025-09-23T22:22:44.678407] [INFO ] [MAIN ] LYV: Loaded 51188 primary data records. [2025-09-23T22:22:44.794618] [DEBUG] [LOCAL ] LZM: Loaded 13552 existing records from primary storage. [2025-09-23T22:22:44.810043] [INFO ] [MAIN ] LZM: Loaded 13552 primary data records. [2025-09-23T22:22:44.815521] [DEBUG] [LOCAL ] LZB: Loaded 35589 existing records from primary storage. [2025-09-23T22:22:44.815680] [INFO ] [MAIN ] LZB: Loaded 35589 primary data records. [2025-09-23T22:22:45.674917] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:45.675727] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51188 primary records. [2025-09-23T22:22:45.676096] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-23T22:22:45.694082] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-09-23T22:22:45.694225] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-23T22:22:45.696712] [INFO ] [MAIN ] Derivative Progress: 1120/2077 symbols completed. LYV took 1.1s. Estimated remaining: 6m 16s. Rate: 152.9 symbols/min [2025-09-23T22:22:45.696968] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:45.729838] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:45.730411] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:45.732238] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 13552 primary records. [2025-09-23T22:22:45.731470] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35589 primary records. [2025-09-23T22:22:45.732453] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-23T22:22:45.732515] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-23T22:22:45.764787] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-09-23T22:22:45.765425] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-23T22:22:45.769014] [INFO ] [MAIN ] Derivative Progress: 1121/2077 symbols completed. LZB took 1.2s. Estimated remaining: 6m 15s. Rate: 153.0 symbols/min [2025-09-23T22:22:45.766035] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-09-23T22:22:45.769458] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-23T22:22:45.769614] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:45.772221] [INFO ] [MAIN ] Derivative Progress: 1122/2077 symbols completed. LZM took 1.1s. Estimated remaining: 6m 14s. Rate: 153.2 symbols/min [2025-09-23T22:22:45.772546] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:45.813971] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-23T22:22:45.814224] [INFO ] [MAIN ] M: Loaded 53536 primary data records. [2025-09-23T22:22:46.095865] [DEBUG] [LOCAL ] MA: Loaded 52574 existing records from primary storage. [2025-09-23T22:22:46.185826] [DEBUG] [LOCAL ] MAA: Loaded 42875 existing records from primary storage. [2025-09-23T22:22:46.205304] [INFO ] [MAIN ] MAA: Loaded 42875 primary data records. [2025-09-23T22:22:46.205203] [INFO ] [MAIN ] MA: Loaded 52574 primary data records. [2025-09-23T22:22:46.886528] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:46.888476] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53536 primary records. [2025-09-23T22:22:46.889336] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-23T22:22:46.908400] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-09-23T22:22:46.908789] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-23T22:22:46.910927] [INFO ] [MAIN ] Derivative Progress: 1123/2077 symbols completed. M took 1.2s. Estimated remaining: 6m 14s. Rate: 152.9 symbols/min [2025-09-23T22:22:46.929499] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:46.931516] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42875 primary records. [2025-09-23T22:22:46.931725] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-23T22:22:46.946066] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:46.954994] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52574 primary records. [2025-09-23T22:22:46.957696] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-23T22:22:46.975022] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-09-23T22:22:46.975313] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-23T22:22:46.977938] [INFO ] [MAIN ] Derivative Progress: 1124/2077 symbols completed. MAA took 1.2s. Estimated remaining: 6m 14s. Rate: 153.0 symbols/min [2025-09-23T22:22:46.981796] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-09-23T22:22:46.981859] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-23T22:22:46.984878] [INFO ] [MAIN ] Derivative Progress: 1125/2077 symbols completed. MA took 1.2s. Estimated remaining: 6m 13s. Rate: 153.1 symbols/min [2025-09-23T22:22:46.985368] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:46.985676] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:46.985720] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:47.035900] [DEBUG] [LOCAL ] MAGN: Loaded 34981 existing records from primary storage. [2025-09-23T22:22:47.036086] [INFO ] [MAIN ] MAGN: Loaded 34981 primary data records. [2025-09-23T22:22:47.179389] [DEBUG] [LOCAL ] MAIN: Loaded 41357 existing records from primary storage. [2025-09-23T22:22:47.180353] [DEBUG] [LOCAL ] MAC: Loaded 49711 existing records from primary storage. [2025-09-23T22:22:47.180435] [INFO ] [MAIN ] MAIN: Loaded 41357 primary data records. [2025-09-23T22:22:47.201694] [INFO ] [MAIN ] MAC: Loaded 49711 primary data records. [2025-09-23T22:22:48.091229] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:48.093731] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 34981 primary records. [2025-09-23T22:22:48.094035] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-23T22:22:48.108851] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:48.121807] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41357 primary records. [2025-09-23T22:22:48.124940] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-23T22:22:48.135176] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-09-23T22:22:48.135281] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-23T22:22:48.150041] [INFO ] [MAIN ] Derivative Progress: 1126/2077 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 13s. Rate: 152.9 symbols/min [2025-09-23T22:22:48.150534] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:48.151533] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:48.151455] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49711 primary records. [2025-09-23T22:22:48.157497] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-23T22:22:48.175929] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-09-23T22:22:48.177698] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-23T22:22:48.177498] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-09-23T22:22:48.180133] [INFO ] [MAIN ] Derivative Progress: 1127/2077 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 13s. Rate: 153.0 symbols/min [2025-09-23T22:22:48.180485] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:48.180267] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-23T22:22:48.183833] [INFO ] [MAIN ] Derivative Progress: 1128/2077 symbols completed. MAC took 1.2s. Estimated remaining: 6m 12s. Rate: 153.1 symbols/min [2025-09-23T22:22:48.184249] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:48.222125] [DEBUG] [LOCAL ] MANU: Loaded 27166 existing records from primary storage. [2025-09-23T22:22:48.222779] [INFO ] [MAIN ] MANU: Loaded 27166 primary data records. [2025-09-23T22:22:48.314223] [DEBUG] [LOCAL ] MAN: Loaded 43562 existing records from primary storage. [2025-09-23T22:22:48.331288] [INFO ] [MAIN ] MAN: Loaded 43562 primary data records. [2025-09-23T22:22:48.528182] [DEBUG] [LOCAL ] MAS: Loaded 52341 existing records from primary storage. [2025-09-23T22:22:48.533454] [INFO ] [MAIN ] MAS: Loaded 52341 primary data records. [2025-09-23T22:22:49.256311] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:49.256062] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:49.257609] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43562 primary records. [2025-09-23T22:22:49.257794] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-23T22:22:49.258616] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27166 primary records. [2025-09-23T22:22:49.259704] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-23T22:22:49.311101] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:49.314013] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52341 primary records. [2025-09-23T22:22:49.314355] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-23T22:22:49.316041] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-09-23T22:22:49.316916] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-23T22:22:49.321442] [INFO ] [MAIN ] Derivative Progress: 1129/2077 symbols completed. MANU took 1.1s. Estimated remaining: 6m 12s. Rate: 152.9 symbols/min [2025-09-23T22:22:49.321906] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-09-23T22:22:49.329544] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:49.329683] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-23T22:22:49.334390] [INFO ] [MAIN ] Derivative Progress: 1130/2077 symbols completed. MAN took 1.2s. Estimated remaining: 6m 11s. Rate: 153.0 symbols/min [2025-09-23T22:22:49.338589] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:49.343670] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-09-23T22:22:49.343862] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-23T22:22:49.346406] [INFO ] [MAIN ] Derivative Progress: 1131/2077 symbols completed. MAS took 1.2s. Estimated remaining: 6m 11s. Rate: 153.1 symbols/min [2025-09-23T22:22:49.346869] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:49.409779] [DEBUG] [LOCAL ] MATV: Loaded 37655 existing records from primary storage. [2025-09-23T22:22:49.409960] [INFO ] [MAIN ] MATV: Loaded 37655 primary data records. [2025-09-23T22:22:49.422589] [DEBUG] [LOCAL ] MAX: Loaded 30963 existing records from primary storage. [2025-09-23T22:22:49.433138] [INFO ] [MAIN ] MAX: Loaded 30963 primary data records. [2025-09-23T22:22:49.591284] [DEBUG] [LOCAL ] MATX: Loaded 31629 existing records from primary storage. [2025-09-23T22:22:49.634130] [INFO ] [MAIN ] MATX: Loaded 31629 primary data records. [2025-09-23T22:22:50.460447] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:50.461833] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 37655 primary records. [2025-09-23T22:22:50.474993] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-23T22:22:50.475370] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:50.476631] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30963 primary records. [2025-09-23T22:22:50.476762] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-23T22:22:50.527557] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-09-23T22:22:50.526796] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-09-23T22:22:50.528255] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-23T22:22:50.528139] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:50.528469] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-23T22:22:50.531015] [INFO ] [MAIN ] Derivative Progress: 1132/2077 symbols completed. MAX took 1.2s. Estimated remaining: 6m 11s. Rate: 152.9 symbols/min [2025-09-23T22:22:50.531369] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:50.532295] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31629 primary records. [2025-09-23T22:22:50.532415] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-23T22:22:50.535862] [INFO ] [MAIN ] Derivative Progress: 1133/2077 symbols completed. MATV took 1.2s. Estimated remaining: 6m 10s. Rate: 153.0 symbols/min [2025-09-23T22:22:50.536381] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:50.553126] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-09-23T22:22:50.553234] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-23T22:22:50.555909] [INFO ] [MAIN ] Derivative Progress: 1134/2077 symbols completed. MATX took 1.2s. Estimated remaining: 6m 9s. Rate: 153.1 symbols/min [2025-09-23T22:22:50.556313] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:50.592367] [DEBUG] [LOCAL ] MBI: Loaded 24755 existing records from primary storage. [2025-09-23T22:22:50.592566] [INFO ] [MAIN ] MBI: Loaded 24755 primary data records. [2025-09-23T22:22:50.768568] [DEBUG] [LOCAL ] MBC: Loaded 43093 existing records from primary storage. [2025-09-23T22:22:50.792758] [DEBUG] [LOCAL ] MC: Loaded 44325 existing records from primary storage. [2025-09-23T22:22:50.818990] [INFO ] [MAIN ] MC: Loaded 44325 primary data records. [2025-09-23T22:22:50.818870] [INFO ] [MAIN ] MBC: Loaded 43093 primary data records. [2025-09-23T22:22:51.587874] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:51.588673] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24755 primary records. [2025-09-23T22:22:51.588945] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-23T22:22:51.611071] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-09-23T22:22:51.611259] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-23T22:22:51.613517] [INFO ] [MAIN ] Derivative Progress: 1135/2077 symbols completed. MBI took 1.1s. Estimated remaining: 6m 10s. Rate: 152.9 symbols/min [2025-09-23T22:22:51.627548] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:51.627466] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:51.628557] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43093 primary records. [2025-09-23T22:22:51.629016] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-23T22:22:51.653088] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-09-23T22:22:51.653424] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-23T22:22:51.656028] [INFO ] [MAIN ] Derivative Progress: 1136/2077 symbols completed. MBC took 1.1s. Estimated remaining: 6m 9s. Rate: 153.0 symbols/min [2025-09-23T22:22:51.669901] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:51.669468] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:51.675328] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44325 primary records. [2025-09-23T22:22:51.675983] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-23T22:22:51.674577] [DEBUG] [LOCAL ] MCB: Loaded 11735 existing records from primary storage. [2025-09-23T22:22:51.676098] [INFO ] [MAIN ] MCB: Loaded 11735 primary data records. [2025-09-23T22:22:51.783785] [DEBUG] [LOCAL ] MCI: Loaded 6399 existing records from primary storage. [2025-09-23T22:22:51.791863] [INFO ] [MAIN ] MCI: Loaded 6399 primary data records. [2025-09-23T22:22:51.791757] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-09-23T22:22:51.799666] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-23T22:22:51.830000] [INFO ] [MAIN ] Derivative Progress: 1137/2077 symbols completed. MC took 1.3s. Estimated remaining: 6m 8s. Rate: 153.1 symbols/min [2025-09-23T22:22:51.842467] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:52.402971] [DEBUG] [LOCAL ] MCK: Loaded 39356 existing records from primary storage. [2025-09-23T22:22:52.403758] [INFO ] [MAIN ] MCK: Loaded 39356 primary data records. [2025-09-23T22:22:52.550076] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:52.578686] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11735 primary records. [2025-09-23T22:22:52.604131] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-23T22:22:52.744583] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:52.753878] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6399 primary records. [2025-09-23T22:22:52.756682] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-23T22:22:52.761830] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-09-23T22:22:52.762230] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-23T22:22:52.764268] [INFO ] [MAIN ] Derivative Progress: 1138/2077 symbols completed. MCB took 1.1s. Estimated remaining: 6m 8s. Rate: 152.9 symbols/min [2025-09-23T22:22:52.782449] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-09-23T22:22:52.782570] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-23T22:22:52.785105] [INFO ] [MAIN ] Derivative Progress: 1139/2077 symbols completed. MCI took 1.1s. Estimated remaining: 6m 8s. Rate: 153.0 symbols/min [2025-09-23T22:22:52.805079] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:52.805623] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 39356 primary records. [2025-09-23T22:22:52.805710] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-23T22:22:52.820543] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-09-23T22:22:52.820604] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-23T22:22:52.823098] [INFO ] [MAIN ] Derivative Progress: 1140/2077 symbols completed. MCK took 1.0s. Estimated remaining: 6m 7s. Rate: 153.2 symbols/min [2025-09-23T22:22:52.823811] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:52.823586] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:52.823920] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:52.836286] [DEBUG] [LOCAL ] MCN: Loaded 8126 existing records from primary storage. [2025-09-23T22:22:52.836463] [INFO ] [MAIN ] MCN: Loaded 8126 primary data records. [2025-09-23T22:22:52.896686] [DEBUG] [LOCAL ] MCR: Loaded 8801 existing records from primary storage. [2025-09-23T22:22:52.917380] [INFO ] [MAIN ] MCR: Loaded 8801 primary data records. [2025-09-23T22:22:53.340859] [DEBUG] [LOCAL ] MCO: Loaded 39575 existing records from primary storage. [2025-09-23T22:22:53.348556] [INFO ] [MAIN ] MCO: Loaded 39575 primary data records. [2025-09-23T22:22:53.805557] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:53.808686] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8126 primary records. [2025-09-23T22:22:53.810229] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-23T22:22:53.839251] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-09-23T22:22:53.839510] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-23T22:22:53.841871] [INFO ] [MAIN ] Derivative Progress: 1141/2077 symbols completed. MCN took 1.0s. Estimated remaining: 6m 7s. Rate: 152.9 symbols/min [2025-09-23T22:22:53.842402] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:53.839832] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:53.843664] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8801 primary records. [2025-09-23T22:22:53.843859] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-23T22:22:53.859213] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-09-23T22:22:53.861674] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-23T22:22:53.864286] [INFO ] [MAIN ] Derivative Progress: 1142/2077 symbols completed. MCR took 1.0s. Estimated remaining: 6m 6s. Rate: 153.1 symbols/min [2025-09-23T22:22:53.864811] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:53.887301] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:53.888106] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39575 primary records. [2025-09-23T22:22:53.888311] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-23T22:22:53.907766] [DEBUG] [LOCAL ] MCS: Loaded 21238 existing records from primary storage. [2025-09-23T22:22:53.912056] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-09-23T22:22:53.912263] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-23T22:22:53.915135] [INFO ] [MAIN ] Derivative Progress: 1143/2077 symbols completed. MCO took 1.1s. Estimated remaining: 6m 6s. Rate: 153.2 symbols/min [2025-09-23T22:22:53.910763] [INFO ] [MAIN ] MCS: Loaded 21238 primary data records. [2025-09-23T22:22:53.920844] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:54.074823] [DEBUG] [LOCAL ] MCY: Loaded 25182 existing records from primary storage. [2025-09-23T22:22:54.093318] [INFO ] [MAIN ] MCY: Loaded 25182 primary data records. [2025-09-23T22:22:54.498129] [DEBUG] [LOCAL ] MD: Loaded 38662 existing records from primary storage. [2025-09-23T22:22:54.620072] [INFO ] [MAIN ] MD: Loaded 38662 primary data records. [2025-09-23T22:22:54.973496] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:54.974424] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21238 primary records. [2025-09-23T22:22:54.975428] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-23T22:22:55.002299] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-09-23T22:22:55.005445] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-23T22:22:55.007977] [INFO ] [MAIN ] Derivative Progress: 1144/2077 symbols completed. MCS took 1.2s. Estimated remaining: 6m 6s. Rate: 152.9 symbols/min [2025-09-23T22:22:55.008523] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:55.032193] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:55.033325] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 25182 primary records. [2025-09-23T22:22:55.033724] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-23T22:22:55.049889] [DEBUG] [LOCAL ] MDST: Loaded 5492 existing records from primary storage. [2025-09-23T22:22:55.050147] [INFO ] [MAIN ] MDST: Loaded 5492 primary data records. [2025-09-23T22:22:55.115768] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-09-23T22:22:55.123846] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-23T22:22:55.170974] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:55.193966] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38662 primary records. [2025-09-23T22:22:55.192949] [INFO ] [MAIN ] Derivative Progress: 1145/2077 symbols completed. MCY took 1.3s. Estimated remaining: 6m 5s. Rate: 153.0 symbols/min [2025-09-23T22:22:55.199859] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-23T22:22:55.205578] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:55.418474] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-09-23T22:22:55.418771] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-23T22:22:55.421543] [INFO ] [MAIN ] Derivative Progress: 1146/2077 symbols completed. MD took 1.5s. Estimated remaining: 6m 5s. Rate: 153.1 symbols/min [2025-09-23T22:22:55.421968] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:55.463791] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:55.464698] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5492 primary records. [2025-09-23T22:22:55.464892] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-23T22:22:55.492082] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-09-23T22:22:55.493075] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-23T22:22:55.495335] [INFO ] [MAIN ] Derivative Progress: 1147/2077 symbols completed. MDST took 0.5s. Estimated remaining: 6m 4s. Rate: 153.2 symbols/min [2025-09-23T22:22:55.495667] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:55.516436] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-23T22:22:55.517243] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-09-23T22:22:55.596574] [DEBUG] [LOCAL ] MDU: Loaded 47881 existing records from primary storage. [2025-09-23T22:22:55.632749] [DEBUG] [LOCAL ] MDV: Loaded 8749 existing records from primary storage. [2025-09-23T22:22:55.611218] [INFO ] [MAIN ] MDU: Loaded 47881 primary data records. [2025-09-23T22:22:55.653804] [INFO ] [MAIN ] MDV: Loaded 8749 primary data records. [2025-09-23T22:22:56.508363] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:56.509265] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-09-23T22:22:56.509547] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-23T22:22:56.526368] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-09-23T22:22:56.526535] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-23T22:22:56.530308] [INFO ] [MAIN ] Derivative Progress: 1148/2077 symbols completed. MDT took 1.3s. Estimated remaining: 6m 4s. Rate: 153.0 symbols/min [2025-09-23T22:22:56.533379] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:56.559167] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:56.558904] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:56.560100] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8749 primary records. [2025-09-23T22:22:56.560738] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47881 primary records. [2025-09-23T22:22:56.560900] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-23T22:22:56.560847] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-23T22:22:56.595151] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-09-23T22:22:56.600690] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-23T22:22:56.603344] [INFO ] [MAIN ] Derivative Progress: 1149/2077 symbols completed. MDU took 1.2s. Estimated remaining: 6m 4s. Rate: 153.1 symbols/min [2025-09-23T22:22:56.603822] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-09-23T22:22:56.604188] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-23T22:22:56.604018] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:56.604631] [DEBUG] [LOCAL ] MEC: Loaded 16443 existing records from primary storage. [2025-09-23T22:22:56.607362] [INFO ] [MAIN ] Derivative Progress: 1150/2077 symbols completed. MDV took 1.1s. Estimated remaining: 6m 3s. Rate: 153.2 symbols/min [2025-09-23T22:22:56.607487] [INFO ] [MAIN ] MEC: Loaded 16443 primary data records. [2025-09-23T22:22:56.607979] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:56.806117] [DEBUG] [LOCAL ] MED: Loaded 21843 existing records from primary storage. [2025-09-23T22:22:56.824702] [INFO ] [MAIN ] MED: Loaded 21843 primary data records. [2025-09-23T22:22:56.948464] [DEBUG] [LOCAL ] MEG: Loaded 31984 existing records from primary storage. [2025-09-23T22:22:56.963044] [INFO ] [MAIN ] MEG: Loaded 31984 primary data records. [2025-09-23T22:22:57.597944] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:57.598931] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16443 primary records. [2025-09-23T22:22:57.599380] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-23T22:22:57.617777] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-09-23T22:22:57.618076] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-23T22:22:57.620149] [INFO ] [MAIN ] Derivative Progress: 1151/2077 symbols completed. MEC took 1.1s. Estimated remaining: 6m 3s. Rate: 153.0 symbols/min [2025-09-23T22:22:57.620517] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:57.638278] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:57.639803] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21843 primary records. [2025-09-23T22:22:57.640613] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-23T22:22:57.665313] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:57.666624] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31984 primary records. [2025-09-23T22:22:57.667453] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-23T22:22:57.677286] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-09-23T22:22:57.677411] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-23T22:22:57.687482] [INFO ] [MAIN ] Derivative Progress: 1152/2077 symbols completed. MED took 1.1s. Estimated remaining: 6m 2s. Rate: 153.1 symbols/min [2025-09-23T22:22:57.688965] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:57.702352] [DEBUG] [LOCAL ] MEGI: Loaded 20457 existing records from primary storage. [2025-09-23T22:22:57.703027] [INFO ] [MAIN ] MEGI: Loaded 20457 primary data records. [2025-09-23T22:22:57.736312] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-09-23T22:22:57.747965] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-23T22:22:57.762587] [INFO ] [MAIN ] Derivative Progress: 1153/2077 symbols completed. MEG took 1.2s. Estimated remaining: 6m 2s. Rate: 153.2 symbols/min [2025-09-23T22:22:57.909293] [DEBUG] [LOCAL ] MEI: Loaded 32587 existing records from primary storage. [2025-09-23T22:22:57.932562] [INFO ] [MAIN ] MEI: Loaded 32587 primary data records. [2025-09-23T22:22:58.441406] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:58.442264] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20457 primary records. [2025-09-23T22:22:58.442345] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-23T22:22:58.463173] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-09-23T22:22:58.463371] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-23T22:22:58.465689] [INFO ] [MAIN ] Derivative Progress: 1154/2077 symbols completed. MEGI took 0.8s. Estimated remaining: 6m 2s. Rate: 153.1 symbols/min [2025-09-23T22:22:58.482451] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:58.483114] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 32587 primary records. [2025-09-23T22:22:58.483176] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-23T22:22:58.498414] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-09-23T22:22:58.498565] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-23T22:22:58.500971] [INFO ] [MAIN ] Derivative Progress: 1155/2077 symbols completed. MEI took 0.8s. Estimated remaining: 6m 1s. Rate: 153.2 symbols/min [2025-09-23T22:22:58.502003] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:58.502237] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:58.503114] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:58.509529] [DEBUG] [LOCAL ] MFAN: Loaded 4253 existing records from primary storage. [2025-09-23T22:22:58.509717] [INFO ] [MAIN ] MFAN: Loaded 4253 primary data records. [2025-09-23T22:22:58.899178] [DEBUG] [LOCAL ] MFA: Loaded 45274 existing records from primary storage. [2025-09-23T22:22:58.900161] [INFO ] [MAIN ] MFA: Loaded 45274 primary data records. [2025-09-23T22:22:58.901330] [DEBUG] [LOCAL ] MET: Loaded 53316 existing records from primary storage. [2025-09-23T22:22:58.923793] [INFO ] [MAIN ] MET: Loaded 53316 primary data records. [2025-09-23T22:22:59.570766] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:59.572383] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4253 primary records. [2025-09-23T22:22:59.572747] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-23T22:22:59.592074] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-09-23T22:22:59.593296] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-23T22:22:59.596958] [INFO ] [MAIN ] Derivative Progress: 1156/2077 symbols completed. MFAN took 1.1s. Estimated remaining: 6m 1s. Rate: 153.0 symbols/min [2025-09-23T22:22:59.598101] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:59.611817] [DEBUG] [LOCAL ] MFAO: Loaded 3817 existing records from primary storage. [2025-09-23T22:22:59.613842] [INFO ] [MAIN ] MFAO: Loaded 3817 primary data records. [2025-09-23T22:22:59.634447] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:59.700425] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45274 primary records. [2025-09-23T22:22:59.715500] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:22:59.748226] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53316 primary records. [2025-09-23T22:22:59.751694] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-23T22:22:59.747286] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-23T22:22:59.978158] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-09-23T22:22:59.979881] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-23T22:22:59.983105] [INFO ] [MAIN ] Derivative Progress: 1157/2077 symbols completed. MET took 1.5s. Estimated remaining: 6m 1s. Rate: 153.0 symbols/min [2025-09-23T22:22:59.985037] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:22:59.988785] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-09-23T22:22:59.988880] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-23T22:22:59.991078] [INFO ] [MAIN ] Derivative Progress: 1158/2077 symbols completed. MFA took 1.5s. Estimated remaining: 6m 0s. Rate: 153.1 symbols/min [2025-09-23T22:22:59.991476] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:00.014870] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:00.015720] [INFO ] [MAIN ] MFAO: Generated 1794 derivative records from 3817 primary records. [2025-09-23T22:23:00.015930] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-23T22:23:00.044190] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1794 records). [2025-09-23T22:23:00.044445] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-23T22:23:00.046975] [INFO ] [MAIN ] Derivative Progress: 1159/2077 symbols completed. MFAO took 0.4s. Estimated remaining: 5m 59s. Rate: 153.2 symbols/min [2025-09-23T22:23:00.057440] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:00.075863] [DEBUG] [LOCAL ] MFC: Loaded 51316 existing records from primary storage. [2025-09-23T22:23:00.076602] [INFO ] [MAIN ] MFC: Loaded 51316 primary data records. [2025-09-23T22:23:00.183893] [DEBUG] [LOCAL ] MFG: Loaded 49036 existing records from primary storage. [2025-09-23T22:23:00.221362] [DEBUG] [LOCAL ] MFM: Loaded 14237 existing records from primary storage. [2025-09-23T22:23:00.222136] [INFO ] [MAIN ] MFM: Loaded 14237 primary data records. [2025-09-23T22:23:00.221610] [INFO ] [MAIN ] MFG: Loaded 49036 primary data records. [2025-09-23T22:23:01.218366] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:01.218852] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:01.220099] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51316 primary records. [2025-09-23T22:23:01.221244] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-23T22:23:01.221110] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14237 primary records. [2025-09-23T22:23:01.221363] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-23T22:23:01.253977] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-09-23T22:23:01.261761] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-23T22:23:01.273058] [INFO ] [MAIN ] Derivative Progress: 1160/2077 symbols completed. MFC took 1.3s. Estimated remaining: 5m 60s. Rate: 153.0 symbols/min [2025-09-23T22:23:01.274564] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:01.274169] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:01.275696] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49036 primary records. [2025-09-23T22:23:01.276807] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-23T22:23:01.279524] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-09-23T22:23:01.280016] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-23T22:23:01.282456] [INFO ] [MAIN ] Derivative Progress: 1161/2077 symbols completed. MFM took 1.2s. Estimated remaining: 5m 59s. Rate: 153.1 symbols/min [2025-09-23T22:23:01.293491] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:01.302911] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-09-23T22:23:01.303171] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-23T22:23:01.306542] [INFO ] [MAIN ] Derivative Progress: 1162/2077 symbols completed. MFG took 1.3s. Estimated remaining: 5m 58s. Rate: 153.2 symbols/min [2025-09-23T22:23:01.307066] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:01.316476] [DEBUG] [LOCAL ] MG: Loaded 16730 existing records from primary storage. [2025-09-23T22:23:01.316709] [INFO ] [MAIN ] MG: Loaded 16730 primary data records. [2025-09-23T22:23:01.319239] [DEBUG] [LOCAL ] MGF: Loaded 4103 existing records from primary storage. [2025-09-23T22:23:01.330603] [INFO ] [MAIN ] MGF: Loaded 4103 primary data records. [2025-09-23T22:23:01.970597] [DEBUG] [LOCAL ] MGA: Loaded 50649 existing records from primary storage. [2025-09-23T22:23:01.971442] [INFO ] [MAIN ] MGA: Loaded 50649 primary data records. [2025-09-23T22:23:02.362877] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:02.377692] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:02.377030] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16730 primary records. [2025-09-23T22:23:02.378052] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-23T22:23:02.378862] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4103 primary records. [2025-09-23T22:23:02.379737] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-23T22:23:02.413017] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-09-23T22:23:02.412513] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-09-23T22:23:02.413279] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-23T22:23:02.415752] [INFO ] [MAIN ] Derivative Progress: 1163/2077 symbols completed. MGF took 1.1s. Estimated remaining: 5m 59s. Rate: 153.0 symbols/min [2025-09-23T22:23:02.416110] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-23T22:23:02.416361] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:02.418477] [INFO ] [MAIN ] Derivative Progress: 1164/2077 symbols completed. MG took 1.1s. Estimated remaining: 5m 58s. Rate: 153.1 symbols/min [2025-09-23T22:23:02.419612] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:02.442755] [DEBUG] [LOCAL ] MGR: Loaded 5653 existing records from primary storage. [2025-09-23T22:23:02.442453] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:02.443761] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50649 primary records. [2025-09-23T22:23:02.443959] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-23T22:23:02.444027] [INFO ] [MAIN ] MGR: Loaded 5653 primary data records. [2025-09-23T22:23:02.600129] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-09-23T22:23:02.633767] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-23T22:23:02.640252] [INFO ] [MAIN ] Derivative Progress: 1165/2077 symbols completed. MGA took 1.4s. Estimated remaining: 5m 57s. Rate: 153.2 symbols/min [2025-09-23T22:23:02.657422] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:02.865383] [DEBUG] [LOCAL ] MGM: Loaded 53609 existing records from primary storage. [2025-09-23T22:23:02.866270] [INFO ] [MAIN ] MGM: Loaded 53609 primary data records. [2025-09-23T22:23:02.869252] [DEBUG] [LOCAL ] MGRB: Loaded 4083 existing records from primary storage. [2025-09-23T22:23:02.869608] [INFO ] [MAIN ] MGRB: Loaded 4083 primary data records. [2025-09-23T22:23:03.536733] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:03.537814] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5653 primary records. [2025-09-23T22:23:03.538176] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-23T22:23:03.559942] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-09-23T22:23:03.560292] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-23T22:23:03.563052] [INFO ] [MAIN ] Derivative Progress: 1166/2077 symbols completed. MGR took 1.1s. Estimated remaining: 5m 57s. Rate: 153.0 symbols/min [2025-09-23T22:23:03.571531] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:03.578337] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:03.579324] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53609 primary records. [2025-09-23T22:23:03.580333] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-23T22:23:03.586896] [DEBUG] [LOCAL ] MGRD: Loaded 2211 existing records from primary storage. [2025-09-23T22:23:03.615445] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-09-23T22:23:03.616053] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-23T22:23:03.606028] [INFO ] [MAIN ] MGRD: Loaded 2211 primary data records. [2025-09-23T22:23:03.615964] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:03.618582] [INFO ] [MAIN ] Derivative Progress: 1167/2077 symbols completed. MGM took 1.2s. Estimated remaining: 5m 57s. Rate: 153.1 symbols/min [2025-09-23T22:23:03.619743] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:03.619474] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4083 primary records. [2025-09-23T22:23:03.619933] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-23T22:23:03.752478] [DEBUG] [LOCAL ] MGRE: Loaded 6610 existing records from primary storage. [2025-09-23T22:23:03.758718] [INFO ] [MAIN ] MGRE: Loaded 6610 primary data records. [2025-09-23T22:23:03.916238] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-09-23T22:23:04.053577] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-23T22:23:04.083693] [INFO ] [MAIN ] Derivative Progress: 1168/2077 symbols completed. MGRB took 1.4s. Estimated remaining: 5m 56s. Rate: 153.1 symbols/min [2025-09-23T22:23:04.416028] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:04.417353] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2211 primary records. [2025-09-23T22:23:04.417610] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-23T22:23:04.451534] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:04.454702] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-09-23T22:23:04.454790] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-23T22:23:04.457160] [INFO ] [MAIN ] Derivative Progress: 1169/2077 symbols completed. MGRD took 0.9s. Estimated remaining: 5m 56s. Rate: 153.1 symbols/min [2025-09-23T22:23:04.454060] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6610 primary records. [2025-09-23T22:23:04.457460] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-23T22:23:04.474312] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-09-23T22:23:04.474463] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-23T22:23:04.477288] [INFO ] [MAIN ] Derivative Progress: 1170/2077 symbols completed. MGRE took 0.9s. Estimated remaining: 5m 55s. Rate: 153.2 symbols/min [2025-09-23T22:23:04.478291] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:04.478493] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:04.478843] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:04.498943] [DEBUG] [LOCAL ] MHF: Loaded 8663 existing records from primary storage. [2025-09-23T22:23:04.499236] [INFO ] [MAIN ] MHF: Loaded 8663 primary data records. [2025-09-23T22:23:04.575517] [DEBUG] [LOCAL ] MHD: Loaded 12118 existing records from primary storage. [2025-09-23T22:23:04.609431] [INFO ] [MAIN ] MHD: Loaded 12118 primary data records. [2025-09-23T22:23:04.965824] [DEBUG] [LOCAL ] MGY: Loaded 52427 existing records from primary storage. [2025-09-23T22:23:04.979431] [INFO ] [MAIN ] MGY: Loaded 52427 primary data records. [2025-09-23T22:23:05.747249] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:05.760125] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8663 primary records. [2025-09-23T22:23:05.760339] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-23T22:23:05.761137] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:05.761942] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12118 primary records. [2025-09-23T22:23:05.762548] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-23T22:23:05.805551] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-09-23T22:23:05.806749] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-23T22:23:05.808909] [INFO ] [MAIN ] Derivative Progress: 1171/2077 symbols completed. MHF took 1.3s. Estimated remaining: 5m 56s. Rate: 152.9 symbols/min [2025-09-23T22:23:05.809671] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:05.810116] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-09-23T22:23:05.806149] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:05.810995] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52427 primary records. [2025-09-23T22:23:05.811100] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-23T22:23:05.813560] [INFO ] [MAIN ] Derivative Progress: 1172/2077 symbols completed. MHD took 1.3s. Estimated remaining: 5m 55s. Rate: 153.0 symbols/min [2025-09-23T22:23:05.811155] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-23T22:23:05.814860] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:05.838275] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-09-23T22:23:05.837919] [DEBUG] [LOCAL ] MHN: Loaded 7787 existing records from primary storage. [2025-09-23T22:23:05.838419] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-23T22:23:05.838489] [INFO ] [MAIN ] MHN: Loaded 7787 primary data records. [2025-09-23T22:23:05.852706] [INFO ] [MAIN ] Derivative Progress: 1173/2077 symbols completed. MGY took 1.4s. Estimated remaining: 5m 54s. Rate: 153.1 symbols/min [2025-09-23T22:23:05.874346] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:06.196343] [DEBUG] [LOCAL ] MHO: Loaded 24390 existing records from primary storage. [2025-09-23T22:23:06.196634] [INFO ] [MAIN ] MHO: Loaded 24390 primary data records. [2025-09-23T22:23:06.197666] [DEBUG] [LOCAL ] MHK: Loaded 42523 existing records from primary storage. [2025-09-23T22:23:06.197890] [INFO ] [MAIN ] MHK: Loaded 42523 primary data records. [2025-09-23T22:23:06.888554] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:06.891071] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7787 primary records. [2025-09-23T22:23:06.892287] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-23T22:23:06.913127] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-09-23T22:23:06.913328] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-23T22:23:06.915888] [INFO ] [MAIN ] Derivative Progress: 1174/2077 symbols completed. MHN took 1.1s. Estimated remaining: 5m 54s. Rate: 152.9 symbols/min [2025-09-23T22:23:06.916395] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:06.959472] [DEBUG] [LOCAL ] MIN: Loaded 13122 existing records from primary storage. [2025-09-23T22:23:06.959802] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:06.960392] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:06.960102] [INFO ] [MAIN ] MIN: Loaded 13122 primary data records. [2025-09-23T22:23:06.961817] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42523 primary records. [2025-09-23T22:23:06.961907] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-23T22:23:06.961125] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 24390 primary records. [2025-09-23T22:23:06.982602] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-23T22:23:07.089913] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-09-23T22:23:07.094273] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-23T22:23:07.098067] [INFO ] [MAIN ] Derivative Progress: 1175/2077 symbols completed. MHK took 1.3s. Estimated remaining: 5m 54s. Rate: 153.0 symbols/min [2025-09-23T22:23:07.116259] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:07.141839] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-09-23T22:23:07.179001] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-23T22:23:07.185512] [INFO ] [MAIN ] Derivative Progress: 1176/2077 symbols completed. MHO took 1.3s. Estimated remaining: 5m 53s. Rate: 153.1 symbols/min [2025-09-23T22:23:07.293593] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:07.311841] [DEBUG] [LOCAL ] MITP: Loaded 2436 existing records from primary storage. [2025-09-23T22:23:07.312074] [INFO ] [MAIN ] MITP: Loaded 2436 primary data records. [2025-09-23T22:23:07.665694] [DEBUG] [LOCAL ] MIR: Loaded 50832 existing records from primary storage. [2025-09-23T22:23:07.666854] [INFO ] [MAIN ] MIR: Loaded 50832 primary data records. [2025-09-23T22:23:07.789931] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:07.791095] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13122 primary records. [2025-09-23T22:23:07.796595] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-23T22:23:07.990030] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-09-23T22:23:08.003702] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-23T22:23:08.006963] [INFO ] [MAIN ] Derivative Progress: 1177/2077 symbols completed. MIN took 1.1s. Estimated remaining: 5m 53s. Rate: 152.9 symbols/min [2025-09-23T22:23:08.011223] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:08.028430] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:23:08.029531] [INFO ] [MAIN ] MITP: Generated 1793 derivative records from 2436 primary records. [2025-09-23T22:23:08.029628] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-23T22:23:08.046355] [DEBUG] [LOCAL ] MITP: Derivative data saved (1793 records). [2025-09-23T22:23:08.046632] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-23T22:23:08.049413] [INFO ] [MAIN ] Derivative Progress: 1178/2077 symbols completed. MITP took 0.9s. Estimated remaining: 5m 52s. Rate: 153.0 symbols/min [2025-09-23T22:23:08.050329] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:08.070935] [DEBUG] [LOCAL ] MITT: Loaded 22872 existing records from primary storage. [2025-09-23T22:23:08.071271] [INFO ] [MAIN ] MITT: Loaded 22872 primary data records. [2025-09-23T22:23:08.136752] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:08.136361] [DEBUG] [LOCAL ] MIY: Loaded 5983 existing records from primary storage. [2025-09-23T22:23:08.142161] [INFO ] [MAIN ] MIY: Loaded 5983 primary data records. [2025-09-23T22:23:08.154356] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 50832 primary records. [2025-09-23T22:23:08.202685] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-23T22:23:08.776524] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-09-23T22:23:08.779147] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-23T22:23:08.782209] [INFO ] [MAIN ] Derivative Progress: 1179/2077 symbols completed. MIR took 1.7s. Estimated remaining: 5m 52s. Rate: 152.9 symbols/min [2025-09-23T22:23:08.782704] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:08.812455] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:08.813790] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22872 primary records. [2025-09-23T22:23:08.814260] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-23T22:23:08.845193] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:08.860354] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 5983 primary records. [2025-09-23T22:23:08.861295] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-23T22:23:08.864359] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-09-23T22:23:08.864512] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-23T22:23:08.877532] [INFO ] [MAIN ] Derivative Progress: 1180/2077 symbols completed. MITT took 0.9s. Estimated remaining: 5m 52s. Rate: 153.0 symbols/min [2025-09-23T22:23:08.879311] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:08.900401] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-09-23T22:23:08.900678] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-23T22:23:08.903318] [INFO ] [MAIN ] Derivative Progress: 1181/2077 symbols completed. MIY took 0.9s. Estimated remaining: 5m 51s. Rate: 153.2 symbols/min [2025-09-23T22:23:08.904845] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:08.904556] [DEBUG] [LOCAL ] MKC: Loaded 52433 existing records from primary storage. [2025-09-23T22:23:08.905458] [INFO ] [MAIN ] MKC: Loaded 52433 primary data records. [2025-09-23T22:23:09.229958] [DEBUG] [LOCAL ] MKL: Loaded 34101 existing records from primary storage. [2025-09-23T22:23:09.239314] [INFO ] [MAIN ] MKL: Loaded 34101 primary data records. [2025-09-23T22:23:09.404525] [DEBUG] [LOCAL ] MLI: Loaded 43850 existing records from primary storage. [2025-09-23T22:23:09.447415] [INFO ] [MAIN ] MLI: Loaded 43850 primary data records. [2025-09-23T22:23:09.908476] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:09.923552] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52433 primary records. [2025-09-23T22:23:09.924007] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-23T22:23:09.943263] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-09-23T22:23:09.945404] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-23T22:23:09.948383] [INFO ] [MAIN ] Derivative Progress: 1182/2077 symbols completed. MKC took 1.2s. Estimated remaining: 5m 51s. Rate: 152.9 symbols/min [2025-09-23T22:23:09.949038] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:09.964078] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:09.965109] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34101 primary records. [2025-09-23T22:23:09.965534] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-23T22:23:09.985254] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-09-23T22:23:09.985371] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-23T22:23:09.988162] [INFO ] [MAIN ] Derivative Progress: 1183/2077 symbols completed. MKL took 1.1s. Estimated remaining: 5m 50s. Rate: 153.1 symbols/min [2025-09-23T22:23:10.013016] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:10.013794] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43850 primary records. [2025-09-23T22:23:10.013915] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-23T22:23:10.040101] [DEBUG] [LOCAL ] MLM: Loaded 30849 existing records from primary storage. [2025-09-23T22:23:10.041290] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-09-23T22:23:10.041378] [INFO ] [MAIN ] MLM: Loaded 30849 primary data records. [2025-09-23T22:23:10.041531] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-23T22:23:10.110372] [INFO ] [MAIN ] Derivative Progress: 1184/2077 symbols completed. MLI took 1.2s. Estimated remaining: 5m 50s. Rate: 153.1 symbols/min [2025-09-23T22:23:10.363216] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:10.363934] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 30849 primary records. [2025-09-23T22:23:10.364000] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-23T22:23:10.379839] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-09-23T22:23:10.379899] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-23T22:23:10.382048] [INFO ] [MAIN ] Derivative Progress: 1185/2077 symbols completed. MLM took 0.4s. Estimated remaining: 5m 49s. Rate: 153.2 symbols/min [2025-09-23T22:23:10.382696] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:10.383211] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:10.382830] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:10.389027] [DEBUG] [LOCAL ] MLP: Loaded 3085 existing records from primary storage. [2025-09-23T22:23:10.389166] [INFO ] [MAIN ] MLP: Loaded 3085 primary data records. [2025-09-23T22:23:10.497889] [DEBUG] [LOCAL ] MLR: Loaded 12929 existing records from primary storage. [2025-09-23T22:23:10.517584] [INFO ] [MAIN ] MLR: Loaded 12929 primary data records. [2025-09-23T22:23:10.660050] [DEBUG] [LOCAL ] MLNK: Loaded 25677 existing records from primary storage. [2025-09-23T22:23:10.722667] [INFO ] [MAIN ] MLNK: Loaded 25677 primary data records. [2025-09-23T22:23:11.423693] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:11.425949] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 3085 primary records. [2025-09-23T22:23:11.426623] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-23T22:23:11.458096] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:11.459243] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12929 primary records. [2025-09-23T22:23:11.459702] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-09-23T22:23:11.459858] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-23T22:23:11.460179] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-23T22:23:11.463189] [INFO ] [MAIN ] Derivative Progress: 1186/2077 symbols completed. MLP took 1.1s. Estimated remaining: 5m 50s. Rate: 153.0 symbols/min [2025-09-23T22:23:11.463680] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:11.496132] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:11.497475] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25677 primary records. [2025-09-23T22:23:11.497919] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-23T22:23:11.499325] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-09-23T22:23:11.499822] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-23T22:23:11.502854] [INFO ] [MAIN ] Derivative Progress: 1187/2077 symbols completed. MLR took 1.1s. Estimated remaining: 5m 49s. Rate: 153.1 symbols/min [2025-09-23T22:23:11.510937] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:11.521503] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-09-23T22:23:11.521638] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-23T22:23:11.524282] [INFO ] [MAIN ] Derivative Progress: 1188/2077 symbols completed. MLNK took 1.1s. Estimated remaining: 5m 48s. Rate: 153.2 symbols/min [2025-09-23T22:23:11.527328] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:11.534893] [DEBUG] [LOCAL ] MMD: Loaded 11144 existing records from primary storage. [2025-09-23T22:23:11.535058] [INFO ] [MAIN ] MMD: Loaded 11144 primary data records. [2025-09-23T22:23:11.683812] [DEBUG] [LOCAL ] MMI: Loaded 15328 existing records from primary storage. [2025-09-23T22:23:11.706474] [DEBUG] [LOCAL ] MMC: Loaded 51808 existing records from primary storage. [2025-09-23T22:23:11.734053] [INFO ] [MAIN ] MMC: Loaded 51808 primary data records. [2025-09-23T22:23:11.725362] [INFO ] [MAIN ] MMI: Loaded 15328 primary data records. [2025-09-23T22:23:12.604130] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:12.605478] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11144 primary records. [2025-09-23T22:23:12.605708] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-23T22:23:12.626109] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-09-23T22:23:12.626384] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-23T22:23:12.628541] [INFO ] [MAIN ] Derivative Progress: 1189/2077 symbols completed. MMD took 1.1s. Estimated remaining: 5m 48s. Rate: 153.0 symbols/min [2025-09-23T22:23:12.629109] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:12.663372] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:12.664806] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51808 primary records. [2025-09-23T22:23:12.665180] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-23T22:23:12.665103] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:12.666027] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15328 primary records. [2025-09-23T22:23:12.666731] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-23T22:23:12.697208] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-09-23T22:23:12.698153] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-23T22:23:12.701176] [INFO ] [MAIN ] Derivative Progress: 1190/2077 symbols completed. MMC took 1.2s. Estimated remaining: 5m 48s. Rate: 153.1 symbols/min [2025-09-23T22:23:12.702533] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:12.704420] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-09-23T22:23:12.704724] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-23T22:23:12.707584] [INFO ] [MAIN ] Derivative Progress: 1191/2077 symbols completed. MMI took 1.2s. Estimated remaining: 5m 47s. Rate: 153.2 symbols/min [2025-09-23T22:23:12.708172] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:12.736315] [DEBUG] [LOCAL ] MMT: Loaded 11029 existing records from primary storage. [2025-09-23T22:23:12.737333] [INFO ] [MAIN ] MMT: Loaded 11029 primary data records. [2025-09-23T22:23:12.805955] [DEBUG] [LOCAL ] MMM: Loaded 53253 existing records from primary storage. [2025-09-23T22:23:12.831143] [INFO ] [MAIN ] MMM: Loaded 53253 primary data records. [2025-09-23T22:23:13.085192] [DEBUG] [LOCAL ] MMS: Loaded 33982 existing records from primary storage. [2025-09-23T22:23:13.095662] [INFO ] [MAIN ] MMS: Loaded 33982 primary data records. [2025-09-23T22:23:13.751283] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:13.753296] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 11029 primary records. [2025-09-23T22:23:13.755509] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-23T22:23:13.782667] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:13.786419] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53253 primary records. [2025-09-23T22:23:13.786605] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-23T22:23:13.786866] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-09-23T22:23:13.787564] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-23T22:23:13.789822] [INFO ] [MAIN ] Derivative Progress: 1192/2077 symbols completed. MMT took 1.1s. Estimated remaining: 5m 47s. Rate: 153.0 symbols/min [2025-09-23T22:23:13.790397] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:13.807909] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-09-23T22:23:13.808231] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-23T22:23:13.815438] [INFO ] [MAIN ] Derivative Progress: 1193/2077 symbols completed. MMM took 1.2s. Estimated remaining: 5m 46s. Rate: 153.1 symbols/min [2025-09-23T22:23:13.817491] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:13.837116] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:13.836815] [DEBUG] [LOCAL ] MMU: Loaded 16994 existing records from primary storage. [2025-09-23T22:23:13.837892] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33982 primary records. [2025-09-23T22:23:13.837981] [INFO ] [MAIN ] MMU: Loaded 16994 primary data records. [2025-09-23T22:23:13.838223] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-23T22:23:14.054496] [DEBUG] [LOCAL ] MNR: Loaded 24702 existing records from primary storage. [2025-09-23T22:23:14.054897] [INFO ] [MAIN ] MNR: Loaded 24702 primary data records. [2025-09-23T22:23:14.162348] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-09-23T22:23:14.208510] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-23T22:23:14.236453] [INFO ] [MAIN ] Derivative Progress: 1194/2077 symbols completed. MMS took 1.5s. Estimated remaining: 5m 46s. Rate: 153.1 symbols/min [2025-09-23T22:23:14.263879] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:14.524860] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:14.527063] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16994 primary records. [2025-09-23T22:23:14.537506] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-23T22:23:14.573997] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-09-23T22:23:14.577511] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-23T22:23:14.580241] [INFO ] [MAIN ] Derivative Progress: 1195/2077 symbols completed. MMU took 0.8s. Estimated remaining: 5m 46s. Rate: 153.1 symbols/min [2025-09-23T22:23:14.576611] [DEBUG] [LOCAL ] MNSO: Loaded 44382 existing records from primary storage. [2025-09-23T22:23:14.580848] [INFO ] [MAIN ] MNSO: Loaded 44382 primary data records. [2025-09-23T22:23:14.581016] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:14.644527] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:14.674385] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24702 primary records. [2025-09-23T22:23:14.692141] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-23T22:23:14.984722] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-09-23T22:23:14.986102] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-23T22:23:14.989065] [INFO ] [MAIN ] Derivative Progress: 1196/2077 symbols completed. MNR took 1.2s. Estimated remaining: 5m 45s. Rate: 153.1 symbols/min [2025-09-23T22:23:14.989504] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:15.011332] [DEBUG] [LOCAL ] MOD: Loaded 45597 existing records from primary storage. [2025-09-23T22:23:15.011705] [INFO ] [MAIN ] MOD: Loaded 45597 primary data records. [2025-09-23T22:23:15.381538] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:15.380728] [DEBUG] [LOCAL ] MODG: Loaded 51574 existing records from primary storage. [2025-09-23T22:23:15.382370] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44382 primary records. [2025-09-23T22:23:15.382562] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-23T22:23:15.382637] [INFO ] [MAIN ] MODG: Loaded 51574 primary data records. [2025-09-23T22:23:15.556287] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-09-23T22:23:15.704327] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-23T22:23:15.707978] [INFO ] [MAIN ] Derivative Progress: 1197/2077 symbols completed. MNSO took 1.4s. Estimated remaining: 5m 45s. Rate: 153.0 symbols/min [2025-09-23T22:23:15.708270] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:15.729163] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:15.729991] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 45597 primary records. [2025-09-23T22:23:15.730169] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-23T22:23:15.760871] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-09-23T22:23:15.761009] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-23T22:23:15.763455] [INFO ] [MAIN ] Derivative Progress: 1198/2077 symbols completed. MOD took 1.2s. Estimated remaining: 5m 45s. Rate: 153.1 symbols/min [2025-09-23T22:23:15.776181] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:15.776809] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51574 primary records. [2025-09-23T22:23:15.776922] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-23T22:23:15.802988] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-09-23T22:23:15.804209] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-23T22:23:15.806708] [INFO ] [MAIN ] Derivative Progress: 1199/2077 symbols completed. MODG took 0.8s. Estimated remaining: 5m 44s. Rate: 153.2 symbols/min [2025-09-23T22:23:15.807736] [DEBUG] [LOCAL ] MOH: Loaded 41771 existing records from primary storage. [2025-09-23T22:23:15.807828] [INFO ] [MAIN ] MOH: Loaded 41771 primary data records. [2025-09-23T22:23:16.122171] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:16.122779] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 41771 primary records. [2025-09-23T22:23:16.122840] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-23T22:23:16.138369] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-09-23T22:23:16.138436] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-23T22:23:16.140608] [INFO ] [MAIN ] Derivative Progress: 1200/2077 symbols completed. MOH took 0.4s. Estimated remaining: 5m 43s. Rate: 153.2 symbols/min [2025-09-23T22:23:16.141298] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:16.141620] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:16.141486] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:16.166025] [DEBUG] [LOCAL ] MOV: Loaded 22219 existing records from primary storage. [2025-09-23T22:23:16.166196] [INFO ] [MAIN ] MOV: Loaded 22219 primary data records. [2025-09-23T22:23:16.513892] [DEBUG] [LOCAL ] MOS: Loaded 53506 existing records from primary storage. [2025-09-23T22:23:16.529246] [INFO ] [MAIN ] MOS: Loaded 53506 primary data records. [2025-09-23T22:23:16.550979] [DEBUG] [LOCAL ] MP: Loaded 53663 existing records from primary storage. [2025-09-23T22:23:16.588471] [INFO ] [MAIN ] MP: Loaded 53663 primary data records. [2025-09-23T22:23:17.264211] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:17.265537] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 22219 primary records. [2025-09-23T22:23:17.266067] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-23T22:23:17.285690] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-09-23T22:23:17.287211] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-23T22:23:17.289677] [INFO ] [MAIN ] Derivative Progress: 1201/2077 symbols completed. MOV took 1.1s. Estimated remaining: 5m 44s. Rate: 153.0 symbols/min [2025-09-23T22:23:17.291097] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:17.314973] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:17.316425] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53506 primary records. [2025-09-23T22:23:17.316557] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-23T22:23:17.319539] [DEBUG] [LOCAL ] MPA: Loaded 5226 existing records from primary storage. [2025-09-23T22:23:17.322754] [INFO ] [MAIN ] MPA: Loaded 5226 primary data records. [2025-09-23T22:23:17.422683] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:17.436146] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53663 primary records. [2025-09-23T22:23:17.448243] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-23T22:23:17.467750] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-09-23T22:23:17.483600] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-23T22:23:17.516942] [INFO ] [MAIN ] Derivative Progress: 1202/2077 symbols completed. MOS took 1.4s. Estimated remaining: 5m 43s. Rate: 153.0 symbols/min [2025-09-23T22:23:17.560212] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:17.686126] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-09-23T22:23:17.686293] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-23T22:23:17.689079] [INFO ] [MAIN ] Derivative Progress: 1203/2077 symbols completed. MP took 1.5s. Estimated remaining: 5m 43s. Rate: 153.1 symbols/min [2025-09-23T22:23:17.689907] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:17.713135] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:23:17.713878] [INFO ] [MAIN ] MPA: Generated 1793 derivative records from 5226 primary records. [2025-09-23T22:23:17.713981] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-23T22:23:17.733509] [DEBUG] [LOCAL ] MPA: Derivative data saved (1793 records). [2025-09-23T22:23:17.733759] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-23T22:23:17.735683] [INFO ] [MAIN ] Derivative Progress: 1204/2077 symbols completed. MPA took 0.4s. Estimated remaining: 5m 42s. Rate: 153.2 symbols/min [2025-09-23T22:23:17.735964] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:17.759066] [DEBUG] [LOCAL ] MPV: Loaded 5142 existing records from primary storage. [2025-09-23T22:23:17.772337] [INFO ] [MAIN ] MPV: Loaded 5142 primary data records. [2025-09-23T22:23:17.910934] [DEBUG] [LOCAL ] MPC: Loaded 52130 existing records from primary storage. [2025-09-23T22:23:17.922492] [INFO ] [MAIN ] MPC: Loaded 52130 primary data records. [2025-09-23T22:23:17.917265] [DEBUG] [LOCAL ] MPLX: Loaded 50738 existing records from primary storage. [2025-09-23T22:23:17.972954] [INFO ] [MAIN ] MPLX: Loaded 50738 primary data records. [2025-09-23T22:23:18.801937] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:18.803302] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 5142 primary records. [2025-09-23T22:23:18.803481] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-23T22:23:18.823035] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-09-23T22:23:18.823288] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-23T22:23:18.825125] [INFO ] [MAIN ] Derivative Progress: 1205/2077 symbols completed. MPV took 1.1s. Estimated remaining: 5m 42s. Rate: 153.0 symbols/min [2025-09-23T22:23:18.825468] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:18.840044] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:18.841158] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52130 primary records. [2025-09-23T22:23:18.841379] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-23T22:23:18.865623] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-09-23T22:23:18.865978] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-23T22:23:18.876298] [INFO ] [MAIN ] Derivative Progress: 1206/2077 symbols completed. MPC took 1.3s. Estimated remaining: 5m 41s. Rate: 153.1 symbols/min [2025-09-23T22:23:18.881678] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:18.882969] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:18.884125] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50738 primary records. [2025-09-23T22:23:18.884310] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-23T22:23:18.902511] [DEBUG] [LOCAL ] MPX: Loaded 4195 existing records from primary storage. [2025-09-23T22:23:18.903189] [INFO ] [MAIN ] MPX: Loaded 4195 primary data records. [2025-09-23T22:23:19.038013] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-09-23T22:23:19.073377] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-23T22:23:19.199165] [INFO ] [MAIN ] Derivative Progress: 1207/2077 symbols completed. MPLX took 1.5s. Estimated remaining: 5m 41s. Rate: 153.1 symbols/min [2025-09-23T22:23:19.252323] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:19.251661] [DEBUG] [LOCAL ] MPW: Loaded 53506 existing records from primary storage. [2025-09-23T22:23:19.253191] [INFO ] [MAIN ] MPW: Loaded 53506 primary data records. [2025-09-23T22:23:19.372805] [DEBUG] [LOCAL ] MQT: Loaded 8399 existing records from primary storage. [2025-09-23T22:23:19.383883] [INFO ] [MAIN ] MQT: Loaded 8399 primary data records. [2025-09-23T22:23:19.926858] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:19.928463] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4195 primary records. [2025-09-23T22:23:19.928762] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-23T22:23:19.963942] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:19.963402] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-09-23T22:23:19.964966] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53506 primary records. [2025-09-23T22:23:19.965391] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-23T22:23:19.965686] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-23T22:23:19.968392] [INFO ] [MAIN ] Derivative Progress: 1208/2077 symbols completed. MPX took 1.1s. Estimated remaining: 5m 41s. Rate: 153.0 symbols/min [2025-09-23T22:23:19.969594] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:19.987507] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-09-23T22:23:19.988177] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-23T22:23:19.990464] [INFO ] [MAIN ] Derivative Progress: 1209/2077 symbols completed. MPW took 1.2s. Estimated remaining: 5m 40s. Rate: 153.1 symbols/min [2025-09-23T22:23:19.991107] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:20.009598] [DEBUG] [LOCAL ] MQY: Loaded 16742 existing records from primary storage. [2025-09-23T22:23:20.009865] [INFO ] [MAIN ] MQY: Loaded 16742 primary data records. [2025-09-23T22:23:20.088422] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:20.120251] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8399 primary records. [2025-09-23T22:23:20.132134] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-23T22:23:20.377871] [DEBUG] [LOCAL ] MRC: Loaded 37580 existing records from primary storage. [2025-09-23T22:23:20.378804] [INFO ] [MAIN ] MRC: Loaded 37580 primary data records. [2025-09-23T22:23:20.415129] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-09-23T22:23:20.450821] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-23T22:23:20.472510] [INFO ] [MAIN ] Derivative Progress: 1210/2077 symbols completed. MQT took 1.2s. Estimated remaining: 5m 40s. Rate: 153.1 symbols/min [2025-09-23T22:23:20.496581] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:20.753561] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:20.755974] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16742 primary records. [2025-09-23T22:23:20.756205] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-23T22:23:20.776694] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-09-23T22:23:20.777855] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-23T22:23:20.786873] [INFO ] [MAIN ] Derivative Progress: 1211/2077 symbols completed. MQY took 0.8s. Estimated remaining: 5m 39s. Rate: 153.1 symbols/min [2025-09-23T22:23:20.802812] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:20.808568] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-23T22:23:20.810375] [INFO ] [MAIN ] MRK: Loaded 53789 primary data records. [2025-09-23T22:23:20.914699] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:20.933870] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37580 primary records. [2025-09-23T22:23:20.946579] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-23T22:23:21.070060] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-09-23T22:23:21.236150] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-23T22:23:21.238783] [INFO ] [MAIN ] Derivative Progress: 1212/2077 symbols completed. MRC took 1.2s. Estimated remaining: 5m 39s. Rate: 153.1 symbols/min [2025-09-23T22:23:21.239247] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:21.277427] [DEBUG] [LOCAL ] MS: Loaded 53693 existing records from primary storage. [2025-09-23T22:23:21.279844] [DEBUG] [LOCAL ] MSA: Loaded 18742 existing records from primary storage. [2025-09-23T22:23:21.279976] [INFO ] [MAIN ] MS: Loaded 53693 primary data records. [2025-09-23T22:23:21.280829] [INFO ] [MAIN ] MSA: Loaded 18742 primary data records. [2025-09-23T22:23:21.461757] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:21.514597] [INFO ] [MAIN ] MRK: Generated 1794 derivative records from 53789 primary records. [2025-09-23T22:23:21.537223] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-23T22:23:21.954284] [DEBUG] [LOCAL ] MRK: Derivative data saved (1794 records). [2025-09-23T22:23:21.954833] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-23T22:23:21.957419] [INFO ] [MAIN ] Derivative Progress: 1213/2077 symbols completed. MRK took 1.5s. Estimated remaining: 5m 39s. Rate: 153.0 symbols/min [2025-09-23T22:23:21.984004] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:21.985047] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18742 primary records. [2025-09-23T22:23:21.985249] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-23T22:23:22.015077] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:22.019485] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53693 primary records. [2025-09-23T22:23:22.019591] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-23T22:23:22.018685] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-09-23T22:23:22.020059] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-23T22:23:22.022083] [INFO ] [MAIN ] Derivative Progress: 1214/2077 symbols completed. MSA took 0.8s. Estimated remaining: 5m 38s. Rate: 153.1 symbols/min [2025-09-23T22:23:22.043957] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-09-23T22:23:22.044349] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-23T22:23:22.047238] [INFO ] [MAIN ] Derivative Progress: 1215/2077 symbols completed. MS took 1.2s. Estimated remaining: 5m 38s. Rate: 153.2 symbols/min [2025-09-23T22:23:22.048497] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:22.048757] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:22.048422] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:22.072894] [DEBUG] [LOCAL ] MSB: Loaded 7854 existing records from primary storage. [2025-09-23T22:23:22.073110] [INFO ] [MAIN ] MSB: Loaded 7854 primary data records. [2025-09-23T22:23:22.162194] [DEBUG] [LOCAL ] MSD: Loaded 15585 existing records from primary storage. [2025-09-23T22:23:22.183497] [INFO ] [MAIN ] MSD: Loaded 15585 primary data records. [2025-09-23T22:23:22.427331] [DEBUG] [LOCAL ] MSCI: Loaded 34875 existing records from primary storage. [2025-09-23T22:23:22.577997] [INFO ] [MAIN ] MSCI: Loaded 34875 primary data records. [2025-09-23T22:23:23.227539] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:23.229828] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7854 primary records. [2025-09-23T22:23:23.230323] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-23T22:23:23.264431] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-09-23T22:23:23.270396] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-23T22:23:23.270299] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:23.273578] [INFO ] [MAIN ] Derivative Progress: 1216/2077 symbols completed. MSB took 1.2s. Estimated remaining: 5m 38s. Rate: 152.9 symbols/min [2025-09-23T22:23:23.274611] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 15585 primary records. [2025-09-23T22:23:23.276299] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:23.276889] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-23T22:23:23.313712] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-09-23T22:23:23.314352] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:23.315297] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34875 primary records. [2025-09-23T22:23:23.315453] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-23T22:23:23.315503] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-23T22:23:23.317921] [INFO ] [MAIN ] Derivative Progress: 1217/2077 symbols completed. MSD took 1.3s. Estimated remaining: 5m 37s. Rate: 153.1 symbols/min [2025-09-23T22:23:23.319313] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:23.347769] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-09-23T22:23:23.366692] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-23T22:23:23.371874] [INFO ] [MAIN ] Derivative Progress: 1218/2077 symbols completed. MSCI took 1.3s. Estimated remaining: 5m 37s. Rate: 153.2 symbols/min [2025-09-23T22:23:23.372501] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:23.386820] [DEBUG] [LOCAL ] MSGE: Loaded 27130 existing records from primary storage. [2025-09-23T22:23:23.398191] [INFO ] [MAIN ] MSGE: Loaded 27130 primary data records. [2025-09-23T22:23:23.442391] [DEBUG] [LOCAL ] MSDL: Loaded 38020 existing records from primary storage. [2025-09-23T22:23:23.474351] [INFO ] [MAIN ] MSDL: Loaded 38020 primary data records. [2025-09-23T22:23:23.573281] [DEBUG] [LOCAL ] MSGS: Loaded 16869 existing records from primary storage. [2025-09-23T22:23:23.624150] [INFO ] [MAIN ] MSGS: Loaded 16869 primary data records. [2025-09-23T22:23:24.480391] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:24.482908] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 27130 primary records. [2025-09-23T22:23:24.485385] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-23T22:23:24.512441] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:24.515070] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38020 primary records. [2025-09-23T22:23:24.515410] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-23T22:23:24.535509] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-09-23T22:23:24.535671] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-23T22:23:24.539000] [INFO ] [MAIN ] Derivative Progress: 1219/2077 symbols completed. MSDL took 1.3s. Estimated remaining: 5m 37s. Rate: 152.9 symbols/min [2025-09-23T22:23:24.541211] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-09-23T22:23:24.541883] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-23T22:23:24.541702] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:24.544887] [INFO ] [MAIN ] Derivative Progress: 1220/2077 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 36s. Rate: 153.0 symbols/min [2025-09-23T22:23:24.545167] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:24.558711] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:24.560019] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 16869 primary records. [2025-09-23T22:23:24.560304] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-23T22:23:24.578440] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-09-23T22:23:24.578666] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-23T22:23:24.581944] [INFO ] [MAIN ] Derivative Progress: 1221/2077 symbols completed. MSGS took 1.2s. Estimated remaining: 5m 35s. Rate: 153.2 symbols/min [2025-09-23T22:23:24.582417] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:24.629177] [DEBUG] [LOCAL ] MSM: Loaded 35420 existing records from primary storage. [2025-09-23T22:23:24.629439] [INFO ] [MAIN ] MSM: Loaded 35420 primary data records. [2025-09-23T22:23:24.764796] [DEBUG] [LOCAL ] MSI: Loaded 40590 existing records from primary storage. [2025-09-23T22:23:24.778487] [INFO ] [MAIN ] MSI: Loaded 40590 primary data records. [2025-09-23T22:23:25.104444] [DEBUG] [LOCAL ] MT: Loaded 50737 existing records from primary storage. [2025-09-23T22:23:25.119098] [INFO ] [MAIN ] MT: Loaded 50737 primary data records. [2025-09-23T22:23:25.803668] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:25.804583] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35420 primary records. [2025-09-23T22:23:25.804822] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-23T22:23:25.837980] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:25.839469] [INFO ] [MAIN ] MSI: Generated 1794 derivative records from 40590 primary records. [2025-09-23T22:23:25.840060] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-23T22:23:25.842465] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-09-23T22:23:25.844149] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-23T22:23:25.846513] [INFO ] [MAIN ] Derivative Progress: 1222/2077 symbols completed. MSM took 1.3s. Estimated remaining: 5m 36s. Rate: 152.9 symbols/min [2025-09-23T22:23:25.847087] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:25.871880] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:25.876420] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50737 primary records. [2025-09-23T22:23:25.876867] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-23T22:23:25.876804] [DEBUG] [LOCAL ] MSI: Derivative data saved (1794 records). [2025-09-23T22:23:25.877967] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-23T22:23:25.880299] [INFO ] [MAIN ] Derivative Progress: 1223/2077 symbols completed. MSI took 1.3s. Estimated remaining: 5m 35s. Rate: 153.0 symbols/min [2025-09-23T22:23:25.880811] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:25.898921] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-09-23T22:23:25.899095] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-23T22:23:25.911883] [INFO ] [MAIN ] Derivative Progress: 1224/2077 symbols completed. MT took 1.3s. Estimated remaining: 5m 34s. Rate: 153.1 symbols/min [2025-09-23T22:23:25.912517] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:25.928466] [DEBUG] [LOCAL ] MTAL: Loaded 36328 existing records from primary storage. [2025-09-23T22:23:25.928704] [INFO ] [MAIN ] MTAL: Loaded 36328 primary data records. [2025-09-23T22:23:26.078332] [DEBUG] [LOCAL ] MTD: Loaded 15173 existing records from primary storage. [2025-09-23T22:23:26.139786] [INFO ] [MAIN ] MTD: Loaded 15173 primary data records. [2025-09-23T22:23:26.325701] [DEBUG] [LOCAL ] MTB: Loaded 47070 existing records from primary storage. [2025-09-23T22:23:26.341354] [INFO ] [MAIN ] MTB: Loaded 47070 primary data records. [2025-09-23T22:23:26.964276] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:26.965989] [INFO ] [MAIN ] MTAL: Generated 1794 derivative records from 36328 primary records. [2025-09-23T22:23:26.966244] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-23T22:23:27.001501] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1794 records). [2025-09-23T22:23:27.002096] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:27.002853] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15173 primary records. [2025-09-23T22:23:27.003097] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-23T22:23:27.005743] [INFO ] [MAIN ] Derivative Progress: 1225/2077 symbols completed. MTAL took 1.2s. Estimated remaining: 5m 34s. Rate: 152.9 symbols/min [2025-09-23T22:23:27.003034] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-23T22:23:27.006273] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:27.024740] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-09-23T22:23:27.024861] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-23T22:23:27.027177] [INFO ] [MAIN ] Derivative Progress: 1226/2077 symbols completed. MTD took 1.1s. Estimated remaining: 5m 34s. Rate: 153.0 symbols/min [2025-09-23T22:23:27.027480] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:27.048141] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:27.049095] [INFO ] [MAIN ] MTB: Generated 1794 derivative records from 47070 primary records. [2025-09-23T22:23:27.049259] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-23T22:23:27.069091] [DEBUG] [LOCAL ] MTB: Derivative data saved (1794 records). [2025-09-23T22:23:27.072603] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-23T22:23:27.075140] [INFO ] [MAIN ] Derivative Progress: 1227/2077 symbols completed. MTB took 1.2s. Estimated remaining: 5m 33s. Rate: 153.1 symbols/min [2025-09-23T22:23:27.075457] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:27.137049] [DEBUG] [LOCAL ] MTDR: Loaded 51550 existing records from primary storage. [2025-09-23T22:23:27.138028] [INFO ] [MAIN ] MTDR: Loaded 51550 primary data records. [2025-09-23T22:23:27.199159] [DEBUG] [LOCAL ] MTG: Loaded 51366 existing records from primary storage. [2025-09-23T22:23:27.257354] [INFO ] [MAIN ] MTG: Loaded 51366 primary data records. [2025-09-23T22:23:27.426517] [DEBUG] [LOCAL ] MTH: Loaded 43945 existing records from primary storage. [2025-09-23T22:23:27.435730] [INFO ] [MAIN ] MTH: Loaded 43945 primary data records. [2025-09-23T22:23:28.246968] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:28.262764] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:28.275272] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51366 primary records. [2025-09-23T22:23:28.262219] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51550 primary records. [2025-09-23T22:23:28.275739] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-23T22:23:28.276014] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:28.276899] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43945 primary records. [2025-09-23T22:23:28.276079] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-23T22:23:28.278387] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-23T22:23:28.322261] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-09-23T22:23:28.321237] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-09-23T22:23:28.323438] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-23T22:23:28.326553] [INFO ] [MAIN ] Derivative Progress: 1228/2077 symbols completed. MTDR took 1.3s. Estimated remaining: 5m 33s. Rate: 152.8 symbols/min [2025-09-23T22:23:28.323373] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-23T22:23:28.329921] [INFO ] [MAIN ] Derivative Progress: 1229/2077 symbols completed. MTH took 1.3s. Estimated remaining: 5m 33s. Rate: 153.0 symbols/min [2025-09-23T22:23:28.331457] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-09-23T22:23:28.331525] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-23T22:23:28.334054] [INFO ] [MAIN ] Derivative Progress: 1230/2077 symbols completed. MTG took 1.3s. Estimated remaining: 5m 32s. Rate: 153.1 symbols/min [2025-09-23T22:23:28.334727] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:28.334832] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:28.334977] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:28.364052] [DEBUG] [LOCAL ] MTRN: Loaded 18095 existing records from primary storage. [2025-09-23T22:23:28.364206] [INFO ] [MAIN ] MTRN: Loaded 18095 primary data records. [2025-09-23T22:23:28.486168] [DEBUG] [LOCAL ] MTUS: Loaded 28728 existing records from primary storage. [2025-09-23T22:23:28.490486] [INFO ] [MAIN ] MTUS: Loaded 28728 primary data records. [2025-09-23T22:23:28.604786] [DEBUG] [LOCAL ] MTN: Loaded 39014 existing records from primary storage. [2025-09-23T22:23:28.735814] [INFO ] [MAIN ] MTN: Loaded 39014 primary data records. [2025-09-23T22:23:29.381321] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:29.383154] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 18095 primary records. [2025-09-23T22:23:29.383621] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-23T22:23:29.419135] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:29.421402] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 28728 primary records. [2025-09-23T22:23:29.421520] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-09-23T22:23:29.421600] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-23T22:23:29.422417] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-23T22:23:29.425727] [INFO ] [MAIN ] Derivative Progress: 1231/2077 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 32s. Rate: 152.9 symbols/min [2025-09-23T22:23:29.433433] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:29.457632] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:29.459227] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 39014 primary records. [2025-09-23T22:23:29.459794] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-23T22:23:29.463168] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-09-23T22:23:29.463284] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-23T22:23:29.466550] [INFO ] [MAIN ] Derivative Progress: 1232/2077 symbols completed. MTUS took 1.1s. Estimated remaining: 5m 31s. Rate: 153.0 symbols/min [2025-09-23T22:23:29.486332] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:29.492730] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-09-23T22:23:29.492957] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-23T22:23:29.495968] [INFO ] [MAIN ] Derivative Progress: 1233/2077 symbols completed. MTN took 1.2s. Estimated remaining: 5m 31s. Rate: 153.1 symbols/min [2025-09-23T22:23:29.496611] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:29.512513] [DEBUG] [LOCAL ] MTW: Loaded 26521 existing records from primary storage. [2025-09-23T22:23:29.512824] [INFO ] [MAIN ] MTW: Loaded 26521 primary data records. [2025-09-23T22:23:29.648302] [DEBUG] [LOCAL ] MTX: Loaded 22897 existing records from primary storage. [2025-09-23T22:23:29.664044] [INFO ] [MAIN ] MTX: Loaded 22897 primary data records. [2025-09-23T22:23:30.040482] [DEBUG] [LOCAL ] MTZ: Loaded 43439 existing records from primary storage. [2025-09-23T22:23:30.058199] [INFO ] [MAIN ] MTZ: Loaded 43439 primary data records. [2025-09-23T22:23:30.655384] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:30.658767] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26521 primary records. [2025-09-23T22:23:30.659698] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-23T22:23:30.681158] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-09-23T22:23:30.681859] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-23T22:23:30.684131] [INFO ] [MAIN ] Derivative Progress: 1234/2077 symbols completed. MTW took 1.3s. Estimated remaining: 5m 31s. Rate: 152.8 symbols/min [2025-09-23T22:23:30.684884] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:30.708279] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:30.709098] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22897 primary records. [2025-09-23T22:23:30.712960] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-23T22:23:30.735614] [DEBUG] [LOCAL ] MUA: Loaded 12209 existing records from primary storage. [2025-09-23T22:23:30.744597] [INFO ] [MAIN ] MUA: Loaded 12209 primary data records. [2025-09-23T22:23:30.750692] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:30.783689] [INFO ] [MAIN ] MTZ: Generated 1794 derivative records from 43439 primary records. [2025-09-23T22:23:30.808321] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-23T22:23:30.845382] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-09-23T22:23:30.883073] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1794 records). [2025-09-23T22:23:30.888620] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-23T22:23:30.904193] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-23T22:23:30.933563] [INFO ] [MAIN ] Derivative Progress: 1235/2077 symbols completed. MTX took 1.4s. Estimated remaining: 5m 30s. Rate: 152.9 symbols/min [2025-09-23T22:23:30.962835] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:30.967582] [INFO ] [MAIN ] Derivative Progress: 1236/2077 symbols completed. MTZ took 1.4s. Estimated remaining: 5m 30s. Rate: 153.0 symbols/min [2025-09-23T22:23:31.076332] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:31.105827] [DEBUG] [LOCAL ] MUE: Loaded 11990 existing records from primary storage. [2025-09-23T22:23:31.106195] [INFO ] [MAIN ] MUE: Loaded 11990 primary data records. [2025-09-23T22:23:31.183007] [DEBUG] [LOCAL ] MUC: Loaded 20165 existing records from primary storage. [2025-09-23T22:23:31.195753] [INFO ] [MAIN ] MUC: Loaded 20165 primary data records. [2025-09-23T22:23:31.623635] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:31.631500] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 12209 primary records. [2025-09-23T22:23:31.659368] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-23T22:23:31.855690] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-09-23T22:23:31.856895] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-23T22:23:31.859536] [INFO ] [MAIN ] Derivative Progress: 1237/2077 symbols completed. MUA took 1.2s. Estimated remaining: 5m 30s. Rate: 152.8 symbols/min [2025-09-23T22:23:31.860237] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:31.880241] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:31.881101] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11990 primary records. [2025-09-23T22:23:31.881389] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-23T22:23:31.899536] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-09-23T22:23:31.900609] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-23T22:23:31.904197] [INFO ] [MAIN ] Derivative Progress: 1238/2077 symbols completed. MUE took 0.8s. Estimated remaining: 5m 29s. Rate: 152.9 symbols/min [2025-09-23T22:23:31.904572] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:31.919699] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:31.920576] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20165 primary records. [2025-09-23T22:23:31.921006] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-23T22:23:31.964520] [DEBUG] [LOCAL ] MUJ: Loaded 13307 existing records from primary storage. [2025-09-23T22:23:31.966983] [INFO ] [MAIN ] MUJ: Loaded 13307 primary data records. [2025-09-23T22:23:31.983736] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-09-23T22:23:32.006867] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-23T22:23:32.022197] [INFO ] [MAIN ] Derivative Progress: 1239/2077 symbols completed. MUC took 1.1s. Estimated remaining: 5m 29s. Rate: 153.0 symbols/min [2025-09-23T22:23:32.022765] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:32.019463] [DEBUG] [LOCAL ] MUFG: Loaded 52623 existing records from primary storage. [2025-09-23T22:23:32.023296] [INFO ] [MAIN ] MUFG: Loaded 52623 primary data records. [2025-09-23T22:23:32.690820] [DEBUG] [LOCAL ] MUR: Loaded 52929 existing records from primary storage. [2025-09-23T22:23:32.692208] [INFO ] [MAIN ] MUR: Loaded 52929 primary data records. [2025-09-23T22:23:33.040517] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:33.044303] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13307 primary records. [2025-09-23T22:23:33.044794] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-23T22:23:33.072209] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:33.074721] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52623 primary records. [2025-09-23T22:23:33.077496] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-09-23T22:23:33.077634] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-23T22:23:33.078508] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-23T22:23:33.080483] [INFO ] [MAIN ] Derivative Progress: 1240/2077 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 29s. Rate: 152.8 symbols/min [2025-09-23T22:23:33.080999] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:33.104634] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-09-23T22:23:33.111368] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-23T22:23:33.114258] [INFO ] [MAIN ] Derivative Progress: 1241/2077 symbols completed. MUFG took 1.3s. Estimated remaining: 5m 28s. Rate: 152.9 symbols/min [2025-09-23T22:23:33.127756] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:33.127559] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:33.128754] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52929 primary records. [2025-09-23T22:23:33.128905] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-23T22:23:33.150551] [DEBUG] [LOCAL ] MUSA: Loaded 24995 existing records from primary storage. [2025-09-23T22:23:33.152914] [INFO ] [MAIN ] MUSA: Loaded 24995 primary data records. [2025-09-23T22:23:33.233923] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-09-23T22:23:33.249726] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-23T22:23:33.252501] [INFO ] [MAIN ] Derivative Progress: 1242/2077 symbols completed. MUR took 1.2s. Estimated remaining: 5m 27s. Rate: 153.0 symbols/min [2025-09-23T22:23:33.271499] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:33.379454] [DEBUG] [LOCAL ] MUX: Loaded 42469 existing records from primary storage. [2025-09-23T22:23:33.517981] [DEBUG] [LOCAL ] MVF: Loaded 12776 existing records from primary storage. [2025-09-23T22:23:33.518165] [INFO ] [MAIN ] MUX: Loaded 42469 primary data records. [2025-09-23T22:23:33.518384] [INFO ] [MAIN ] MVF: Loaded 12776 primary data records. [2025-09-23T22:23:34.223260] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:34.225118] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 24995 primary records. [2025-09-23T22:23:34.225421] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-23T22:23:34.243746] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-09-23T22:23:34.244138] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-23T22:23:34.246384] [INFO ] [MAIN ] Derivative Progress: 1243/2077 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 27s. Rate: 152.8 symbols/min [2025-09-23T22:23:34.280702] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:34.281855] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12776 primary records. [2025-09-23T22:23:34.281942] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-23T22:23:34.280985] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:34.283485] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 42469 primary records. [2025-09-23T22:23:34.283866] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-23T22:23:34.308361] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-09-23T22:23:34.311155] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-23T22:23:34.313889] [INFO ] [MAIN ] Derivative Progress: 1244/2077 symbols completed. MVF took 1.0s. Estimated remaining: 5m 27s. Rate: 152.9 symbols/min [2025-09-23T22:23:34.319637] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-09-23T22:23:34.319823] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-23T22:23:34.322437] [INFO ] [MAIN ] Derivative Progress: 1245/2077 symbols completed. MUX took 1.2s. Estimated remaining: 5m 26s. Rate: 153.0 symbols/min [2025-09-23T22:23:34.323459] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:34.323091] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:34.323293] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:34.337562] [DEBUG] [LOCAL ] MVO: Loaded 9070 existing records from primary storage. [2025-09-23T22:23:34.337792] [INFO ] [MAIN ] MVO: Loaded 9070 primary data records. [2025-09-23T22:23:34.392044] [DEBUG] [LOCAL ] MVT: Loaded 10081 existing records from primary storage. [2025-09-23T22:23:34.414432] [INFO ] [MAIN ] MVT: Loaded 10081 primary data records. [2025-09-23T22:23:34.824148] [DEBUG] [LOCAL ] MWA: Loaded 47125 existing records from primary storage. [2025-09-23T22:23:34.864202] [INFO ] [MAIN ] MWA: Loaded 47125 primary data records. [2025-09-23T22:23:35.320006] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:35.321601] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 9070 primary records. [2025-09-23T22:23:35.322547] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-23T22:23:35.350284] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:35.351816] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10081 primary records. [2025-09-23T22:23:35.355354] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-09-23T22:23:35.355457] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-23T22:23:35.355693] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-23T22:23:35.358023] [INFO ] [MAIN ] Derivative Progress: 1246/2077 symbols completed. MVO took 1.0s. Estimated remaining: 5m 26s. Rate: 152.8 symbols/min [2025-09-23T22:23:35.359271] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:35.374956] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-09-23T22:23:35.375300] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-23T22:23:35.377785] [INFO ] [MAIN ] Derivative Progress: 1247/2077 symbols completed. MVT took 1.1s. Estimated remaining: 5m 26s. Rate: 153.0 symbols/min [2025-09-23T22:23:35.378351] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:35.401409] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:35.402283] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 47125 primary records. [2025-09-23T22:23:35.402476] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-23T22:23:35.417498] [DEBUG] [LOCAL ] MXF: Loaded 6002 existing records from primary storage. [2025-09-23T22:23:35.427846] [INFO ] [MAIN ] MXF: Loaded 6002 primary data records. [2025-09-23T22:23:35.429245] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-09-23T22:23:35.429775] [DEBUG] [LOCAL ] MX: Loaded 23049 existing records from primary storage. [2025-09-23T22:23:35.435741] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-23T22:23:35.453234] [INFO ] [MAIN ] Derivative Progress: 1248/2077 symbols completed. MWA took 1.1s. Estimated remaining: 5m 25s. Rate: 153.1 symbols/min [2025-09-23T22:23:35.463819] [INFO ] [MAIN ] MX: Loaded 23049 primary data records. [2025-09-23T22:23:35.475961] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:35.711533] [DEBUG] [LOCAL ] MYD: Loaded 13760 existing records from primary storage. [2025-09-23T22:23:35.777537] [INFO ] [MAIN ] MYD: Loaded 13760 primary data records. [2025-09-23T22:23:36.414450] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:36.417639] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 6002 primary records. [2025-09-23T22:23:36.417772] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-23T22:23:36.445940] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-09-23T22:23:36.445878] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:36.446099] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-23T22:23:36.446953] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 23049 primary records. [2025-09-23T22:23:36.449187] [INFO ] [MAIN ] Derivative Progress: 1249/2077 symbols completed. MXF took 1.1s. Estimated remaining: 5m 25s. Rate: 152.9 symbols/min [2025-09-23T22:23:36.447135] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-23T22:23:36.449555] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:36.470058] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-09-23T22:23:36.482477] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-23T22:23:36.485342] [INFO ] [MAIN ] Derivative Progress: 1250/2077 symbols completed. MX took 1.1s. Estimated remaining: 5m 24s. Rate: 153.0 symbols/min [2025-09-23T22:23:36.485769] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:36.486218] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:36.493057] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13760 primary records. [2025-09-23T22:23:36.493462] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-23T22:23:36.520234] [DEBUG] [LOCAL ] MYE: Loaded 25195 existing records from primary storage. [2025-09-23T22:23:36.521720] [INFO ] [MAIN ] MYE: Loaded 25195 primary data records. [2025-09-23T22:23:36.566910] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-09-23T22:23:36.588101] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-23T22:23:36.590853] [INFO ] [MAIN ] Derivative Progress: 1251/2077 symbols completed. MYD took 1.1s. Estimated remaining: 5m 24s. Rate: 153.1 symbols/min [2025-09-23T22:23:36.591173] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:36.588020] [DEBUG] [LOCAL ] MYI: Loaded 19317 existing records from primary storage. [2025-09-23T22:23:36.610860] [INFO ] [MAIN ] MYI: Loaded 19317 primary data records. [2025-09-23T22:23:36.809880] [DEBUG] [LOCAL ] MYN: Loaded 10315 existing records from primary storage. [2025-09-23T22:23:36.849720] [INFO ] [MAIN ] MYN: Loaded 10315 primary data records. [2025-09-23T22:23:37.512003] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:37.511745] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:37.513096] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19317 primary records. [2025-09-23T22:23:37.513723] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 25195 primary records. [2025-09-23T22:23:37.513814] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-23T22:23:37.513891] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-23T22:23:37.540083] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-09-23T22:23:37.543587] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-23T22:23:37.545850] [INFO ] [MAIN ] Derivative Progress: 1252/2077 symbols completed. MYE took 1.1s. Estimated remaining: 5m 24s. Rate: 152.9 symbols/min [2025-09-23T22:23:37.546545] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:37.561417] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:37.562817] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 10315 primary records. [2025-09-23T22:23:37.563595] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-23T22:23:37.580635] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-09-23T22:23:37.577193] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-09-23T22:23:37.580870] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-23T22:23:37.580825] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-23T22:23:37.583629] [INFO ] [MAIN ] Derivative Progress: 1253/2077 symbols completed. MYI took 1.1s. Estimated remaining: 5m 23s. Rate: 153.0 symbols/min [2025-09-23T22:23:37.586435] [INFO ] [MAIN ] Derivative Progress: 1254/2077 symbols completed. MYN took 1.0s. Estimated remaining: 5m 22s. Rate: 153.1 symbols/min [2025-09-23T22:23:37.586892] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:37.586988] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:37.643049] [DEBUG] [LOCAL ] NAC: Loaded 24661 existing records from primary storage. [2025-09-23T22:23:37.654600] [DEBUG] [LOCAL ] NAD: Loaded 34040 existing records from primary storage. [2025-09-23T22:23:37.654824] [INFO ] [MAIN ] NAD: Loaded 34040 primary data records. [2025-09-23T22:23:37.654142] [INFO ] [MAIN ] NAC: Loaded 24661 primary data records. [2025-09-23T22:23:37.655459] [DEBUG] [LOCAL ] NABL: Loaded 39949 existing records from primary storage. [2025-09-23T22:23:37.679760] [INFO ] [MAIN ] NABL: Loaded 39949 primary data records. [2025-09-23T22:23:38.660451] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:38.662006] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24661 primary records. [2025-09-23T22:23:38.661186] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:38.662685] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 34040 primary records. [2025-09-23T22:23:38.662916] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-23T22:23:38.663747] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-23T22:23:38.704753] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:38.709567] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 39949 primary records. [2025-09-23T22:23:38.708713] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-09-23T22:23:38.709926] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-23T22:23:38.710938] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-23T22:23:38.714325] [INFO ] [MAIN ] Derivative Progress: 1255/2077 symbols completed. NAC took 1.1s. Estimated remaining: 5m 23s. Rate: 152.9 symbols/min [2025-09-23T22:23:38.724823] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-09-23T22:23:38.725239] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:38.725507] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-23T22:23:38.727797] [INFO ] [MAIN ] Derivative Progress: 1256/2077 symbols completed. NAD took 1.1s. Estimated remaining: 5m 22s. Rate: 153.0 symbols/min [2025-09-23T22:23:38.729006] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:38.736801] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-09-23T22:23:38.737056] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-23T22:23:38.740039] [INFO ] [MAIN ] Derivative Progress: 1257/2077 symbols completed. NABL took 1.2s. Estimated remaining: 5m 21s. Rate: 153.1 symbols/min [2025-09-23T22:23:38.740350] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:38.745467] [DEBUG] [LOCAL ] NAN: Loaded 9048 existing records from primary storage. [2025-09-23T22:23:38.745608] [INFO ] [MAIN ] NAN: Loaded 9048 primary data records. [2025-09-23T22:23:39.078987] [DEBUG] [LOCAL ] NAT: Loaded 49132 existing records from primary storage. [2025-09-23T22:23:39.092585] [INFO ] [MAIN ] NAT: Loaded 49132 primary data records. [2025-09-23T22:23:39.092486] [DEBUG] [LOCAL ] NATL: Loaded 32802 existing records from primary storage. [2025-09-23T22:23:39.098502] [INFO ] [MAIN ] NATL: Loaded 32802 primary data records. [2025-09-23T22:23:39.754017] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:39.755193] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 9048 primary records. [2025-09-23T22:23:39.755297] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-23T22:23:39.773916] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-09-23T22:23:39.774353] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-23T22:23:39.777028] [INFO ] [MAIN ] Derivative Progress: 1258/2077 symbols completed. NAN took 1.1s. Estimated remaining: 5m 21s. Rate: 152.9 symbols/min [2025-09-23T22:23:39.795902] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:39.797954] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32802 primary records. [2025-09-23T22:23:39.798144] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-23T22:23:39.811213] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:39.812072] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49132 primary records. [2025-09-23T22:23:39.819164] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-23T22:23:39.842083] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-09-23T22:23:39.842560] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-09-23T22:23:39.842675] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-23T22:23:39.842751] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-23T22:23:39.845483] [INFO ] [MAIN ] Derivative Progress: 1259/2077 symbols completed. NATL took 1.1s. Estimated remaining: 5m 21s. Rate: 153.0 symbols/min [2025-09-23T22:23:39.847877] [INFO ] [MAIN ] Derivative Progress: 1260/2077 symbols completed. NAT took 1.1s. Estimated remaining: 5m 20s. Rate: 153.2 symbols/min [2025-09-23T22:23:39.848390] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:39.848568] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:39.849273] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:39.854199] [DEBUG] [LOCAL ] NAZ: Loaded 2624 existing records from primary storage. [2025-09-23T22:23:39.854408] [INFO ] [MAIN ] NAZ: Loaded 2624 primary data records. [2025-09-23T22:23:39.977333] [DEBUG] [LOCAL ] NBB: Loaded 8868 existing records from primary storage. [2025-09-23T22:23:39.993568] [INFO ] [MAIN ] NBB: Loaded 8868 primary data records. [2025-09-23T22:23:40.141877] [DEBUG] [LOCAL ] NBHC: Loaded 23147 existing records from primary storage. [2025-09-23T22:23:40.168132] [INFO ] [MAIN ] NBHC: Loaded 23147 primary data records. [2025-09-23T22:23:40.857231] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:40.858109] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2624 primary records. [2025-09-23T22:23:40.858374] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-23T22:23:40.875070] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-09-23T22:23:40.875213] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-23T22:23:40.877458] [INFO ] [MAIN ] Derivative Progress: 1261/2077 symbols completed. NAZ took 1.0s. Estimated remaining: 5m 20s. Rate: 153.0 symbols/min [2025-09-23T22:23:40.890682] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:40.893020] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:40.893744] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 8868 primary records. [2025-09-23T22:23:40.893997] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-23T22:23:40.907559] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:40.915091] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 23147 primary records. [2025-09-23T22:23:40.916271] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-23T22:23:40.930884] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-09-23T22:23:40.934510] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-23T22:23:40.937139] [INFO ] [MAIN ] Derivative Progress: 1262/2077 symbols completed. NBB took 1.1s. Estimated remaining: 5m 19s. Rate: 153.1 symbols/min [2025-09-23T22:23:40.937863] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:40.951777] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-09-23T22:23:40.951981] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-23T22:23:40.954701] [INFO ] [MAIN ] Derivative Progress: 1263/2077 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 19s. Rate: 153.2 symbols/min [2025-09-23T22:23:40.955101] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:40.959379] [DEBUG] [LOCAL ] NC: Loaded 1907 existing records from primary storage. [2025-09-23T22:23:40.973238] [INFO ] [MAIN ] NC: Loaded 1907 primary data records. [2025-09-23T22:23:41.012268] [DEBUG] [LOCAL ] NBR: Loaded 34912 existing records from primary storage. [2025-09-23T22:23:41.019252] [INFO ] [MAIN ] NBR: Loaded 34912 primary data records. [2025-09-23T22:23:41.084072] [DEBUG] [LOCAL ] NBXG: Loaded 22623 existing records from primary storage. [2025-09-23T22:23:41.109569] [INFO ] [MAIN ] NBXG: Loaded 22623 primary data records. [2025-09-23T22:23:42.001161] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:42.003239] [INFO ] [MAIN ] NC: Generated 1794 derivative records from 1907 primary records. [2025-09-23T22:23:42.003519] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-23T22:23:42.035367] [DEBUG] [LOCAL ] NC: Derivative data saved (1794 records). [2025-09-23T22:23:42.035471] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-23T22:23:42.037765] [INFO ] [MAIN ] Derivative Progress: 1264/2077 symbols completed. NC took 1.1s. Estimated remaining: 5m 19s. Rate: 153.0 symbols/min [2025-09-23T22:23:42.038240] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:42.042016] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:42.042993] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 34912 primary records. [2025-09-23T22:23:42.043085] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-23T22:23:42.067858] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:42.076579] [DEBUG] [LOCAL ] NCA: Loaded 10038 existing records from primary storage. [2025-09-23T22:23:42.076996] [INFO ] [MAIN ] NCA: Loaded 10038 primary data records. [2025-09-23T22:23:42.071382] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 22623 primary records. [2025-09-23T22:23:42.098510] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-23T22:23:42.193977] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-09-23T22:23:42.194139] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-23T22:23:42.200711] [INFO ] [MAIN ] Derivative Progress: 1265/2077 symbols completed. NBR took 1.3s. Estimated remaining: 5m 18s. Rate: 153.0 symbols/min [2025-09-23T22:23:42.202131] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:42.253193] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-09-23T22:23:42.330773] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-23T22:23:42.400479] [INFO ] [MAIN ] Derivative Progress: 1266/2077 symbols completed. NBXG took 1.5s. Estimated remaining: 5m 18s. Rate: 153.1 symbols/min [2025-09-23T22:23:42.400908] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:42.420600] [DEBUG] [LOCAL ] NCDL: Loaded 21570 existing records from primary storage. [2025-09-23T22:23:42.421084] [INFO ] [MAIN ] NCDL: Loaded 21570 primary data records. [2025-09-23T22:23:42.616823] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:42.633155] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10038 primary records. [2025-09-23T22:23:42.633311] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-23T22:23:42.790740] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-23T22:23:42.791988] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-09-23T22:23:42.862455] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-09-23T22:23:42.874782] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-23T22:23:42.887597] [INFO ] [MAIN ] Derivative Progress: 1267/2077 symbols completed. NCA took 0.8s. Estimated remaining: 5m 18s. Rate: 153.1 symbols/min [2025-09-23T22:23:42.905732] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:43.126996] [DEBUG] [LOCAL ] NCV: Loaded 13373 existing records from primary storage. [2025-09-23T22:23:43.127172] [INFO ] [MAIN ] NCV: Loaded 13373 primary data records. [2025-09-23T22:23:43.446607] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:43.448188] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21570 primary records. [2025-09-23T22:23:43.448424] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-23T22:23:43.467192] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-09-23T22:23:43.467591] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-23T22:23:43.471191] [INFO ] [MAIN ] Derivative Progress: 1268/2077 symbols completed. NCDL took 1.3s. Estimated remaining: 5m 17s. Rate: 153.0 symbols/min [2025-09-23T22:23:43.473224] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:43.491502] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:43.495471] [INFO ] [MAIN ] NCLH: Generated 1794 derivative records from 53753 primary records. [2025-09-23T22:23:43.495773] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-23T22:23:43.513949] [DEBUG] [LOCAL ] NCZ: Loaded 11753 existing records from primary storage. [2025-09-23T22:23:43.514312] [INFO ] [MAIN ] NCZ: Loaded 11753 primary data records. [2025-09-23T22:23:43.635973] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:43.636615] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1794 records). [2025-09-23T22:23:43.637846] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13373 primary records. [2025-09-23T22:23:43.643178] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-23T22:23:43.636782] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-23T22:23:43.650380] [INFO ] [MAIN ] Derivative Progress: 1269/2077 symbols completed. NCLH took 1.2s. Estimated remaining: 5m 17s. Rate: 153.1 symbols/min [2025-09-23T22:23:43.679866] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:43.896245] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-09-23T22:23:43.901742] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-23T22:23:43.904812] [INFO ] [MAIN ] Derivative Progress: 1270/2077 symbols completed. NCV took 1.0s. Estimated remaining: 5m 16s. Rate: 153.1 symbols/min [2025-09-23T22:23:43.906267] [DEBUG] [LOCAL ] NDMO: Loaded 16614 existing records from primary storage. [2025-09-23T22:23:43.905590] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:43.907008] [INFO ] [MAIN ] NDMO: Loaded 16614 primary data records. [2025-09-23T22:23:44.266701] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:44.268009] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 11753 primary records. [2025-09-23T22:23:44.268137] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-23T22:23:44.283789] [DEBUG] [LOCAL ] NE: Loaded 52390 existing records from primary storage. [2025-09-23T22:23:44.284692] [INFO ] [MAIN ] NE: Loaded 52390 primary data records. [2025-09-23T22:23:44.413951] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-09-23T22:23:44.415458] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-23T22:23:44.428013] [INFO ] [MAIN ] Derivative Progress: 1271/2077 symbols completed. NCZ took 1.0s. Estimated remaining: 5m 16s. Rate: 153.1 symbols/min [2025-09-23T22:23:44.486469] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:44.617271] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:44.626273] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16614 primary records. [2025-09-23T22:23:44.626356] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-23T22:23:44.646191] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-09-23T22:23:44.646477] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-23T22:23:44.649032] [INFO ] [MAIN ] Derivative Progress: 1272/2077 symbols completed. NDMO took 1.0s. Estimated remaining: 5m 15s. Rate: 153.1 symbols/min [2025-09-23T22:23:44.649415] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:44.677117] [DEBUG] [LOCAL ] NEA: Loaded 35279 existing records from primary storage. [2025-09-23T22:23:44.693100] [INFO ] [MAIN ] NEA: Loaded 35279 primary data records. [2025-09-23T22:23:44.693352] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:44.705354] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52390 primary records. [2025-09-23T22:23:44.730489] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-23T22:23:44.918944] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-09-23T22:23:44.967728] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-23T22:23:45.047631] [INFO ] [MAIN ] Derivative Progress: 1273/2077 symbols completed. NE took 1.1s. Estimated remaining: 5m 15s. Rate: 153.1 symbols/min [2025-09-23T22:23:45.054267] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-23T22:23:45.062547] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-09-23T22:23:45.382422] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:45.383262] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35279 primary records. [2025-09-23T22:23:45.384281] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-23T22:23:45.402303] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-09-23T22:23:45.402476] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-23T22:23:45.405794] [INFO ] [MAIN ] Derivative Progress: 1274/2077 symbols completed. NEA took 1.0s. Estimated remaining: 5m 15s. Rate: 153.1 symbols/min [2025-09-23T22:23:45.420054] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:45.420757] [INFO ] [MAIN ] NEE: Generated 1794 derivative records from 53707 primary records. [2025-09-23T22:23:45.420822] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-23T22:23:45.436563] [DEBUG] [LOCAL ] NEE: Derivative data saved (1794 records). [2025-09-23T22:23:45.436623] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-23T22:23:45.438949] [INFO ] [MAIN ] Derivative Progress: 1275/2077 symbols completed. NEE took 0.8s. Estimated remaining: 5m 14s. Rate: 153.2 symbols/min [2025-09-23T22:23:45.439776] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:45.440171] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:45.440290] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:45.451267] [DEBUG] [LOCAL ] NEU: Loaded 8116 existing records from primary storage. [2025-09-23T22:23:45.451467] [INFO ] [MAIN ] NEU: Loaded 8116 primary data records. [2025-09-23T22:23:45.814338] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-23T22:23:45.814577] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-09-23T22:23:45.815806] [DEBUG] [LOCAL ] NET: Loaded 53063 existing records from primary storage. [2025-09-23T22:23:45.817298] [INFO ] [MAIN ] NET: Loaded 53063 primary data records. [2025-09-23T22:23:46.458851] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:46.469135] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8116 primary records. [2025-09-23T22:23:46.469371] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-23T22:23:46.491905] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-09-23T22:23:46.493130] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-23T22:23:46.495547] [INFO ] [MAIN ] Derivative Progress: 1276/2077 symbols completed. NEU took 1.1s. Estimated remaining: 5m 14s. Rate: 153.0 symbols/min [2025-09-23T22:23:46.496016] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:46.501267] [DEBUG] [LOCAL ] NEUE: Loaded 2248 existing records from primary storage. [2025-09-23T22:23:46.502375] [INFO ] [MAIN ] NEUE: Loaded 2248 primary data records. [2025-09-23T22:23:46.622707] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:46.630423] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:46.634402] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 53063 primary records. [2025-09-23T22:23:46.635374] [INFO ] [MAIN ] NEM: Generated 1794 derivative records from 53708 primary records. [2025-09-23T22:23:46.634809] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-23T22:23:46.640702] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-23T22:23:46.864556] [DEBUG] [LOCAL ] NEM: Derivative data saved (1794 records). [2025-09-23T22:23:46.865596] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-23T22:23:46.868219] [INFO ] [MAIN ] Derivative Progress: 1277/2077 symbols completed. NEM took 1.4s. Estimated remaining: 5m 14s. Rate: 153.0 symbols/min [2025-09-23T22:23:46.868806] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:46.869692] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-09-23T22:23:46.870018] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-23T22:23:46.873591] [INFO ] [MAIN ] Derivative Progress: 1278/2077 symbols completed. NET took 1.4s. Estimated remaining: 5m 13s. Rate: 153.2 symbols/min [2025-09-23T22:23:46.874784] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:46.880999] [DEBUG] [LOCAL ] NEXA: Loaded 4075 existing records from primary storage. [2025-09-23T22:23:46.881395] [INFO ] [MAIN ] NEXA: Loaded 4075 primary data records. [2025-09-23T22:23:47.203240] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:23:47.213204] [INFO ] [MAIN ] NEUE: Generated 1793 derivative records from 2248 primary records. [2025-09-23T22:23:47.213517] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-23T22:23:47.235932] [DEBUG] [LOCAL ] NFG: Loaded 38470 existing records from primary storage. [2025-09-23T22:23:47.236556] [INFO ] [MAIN ] NFG: Loaded 38470 primary data records. [2025-09-23T22:23:47.329337] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1793 records). [2025-09-23T22:23:47.348977] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-23T22:23:47.351400] [INFO ] [MAIN ] Derivative Progress: 1279/2077 symbols completed. NEUE took 0.9s. Estimated remaining: 5m 13s. Rate: 153.1 symbols/min [2025-09-23T22:23:47.352026] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:47.574763] [DEBUG] [LOCAL ] NFJ: Loaded 20291 existing records from primary storage. [2025-09-23T22:23:47.576038] [INFO ] [MAIN ] NFJ: Loaded 20291 primary data records. [2025-09-23T22:23:47.622065] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:47.635394] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 4075 primary records. [2025-09-23T22:23:47.635504] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-23T22:23:47.796893] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-09-23T22:23:47.961198] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-23T22:23:47.964285] [INFO ] [MAIN ] Derivative Progress: 1280/2077 symbols completed. NEXA took 1.1s. Estimated remaining: 5m 12s. Rate: 153.1 symbols/min [2025-09-23T22:23:47.964940] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:47.987038] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:47.988153] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38470 primary records. [2025-09-23T22:23:47.988678] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-23T22:23:48.011403] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-09-23T22:23:48.011880] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-23T22:23:48.015031] [INFO ] [MAIN ] Derivative Progress: 1281/2077 symbols completed. NFG took 1.1s. Estimated remaining: 5m 12s. Rate: 153.2 symbols/min [2025-09-23T22:23:48.025823] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:48.056284] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:48.058387] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20291 primary records. [2025-09-23T22:23:48.058540] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-23T22:23:48.059341] [DEBUG] [LOCAL ] NGG: Loaded 46138 existing records from primary storage. [2025-09-23T22:23:48.060476] [INFO ] [MAIN ] NGG: Loaded 46138 primary data records. [2025-09-23T22:23:48.247047] [DEBUG] [LOCAL ] NGL: Loaded 30539 existing records from primary storage. [2025-09-23T22:23:48.277108] [INFO ] [MAIN ] NGL: Loaded 30539 primary data records. [2025-09-23T22:23:48.439323] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-09-23T22:23:48.466002] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-23T22:23:48.486418] [INFO ] [MAIN ] Derivative Progress: 1282/2077 symbols completed. NFJ took 1.1s. Estimated remaining: 5m 11s. Rate: 153.1 symbols/min [2025-09-23T22:23:48.502172] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:48.724177] [DEBUG] [LOCAL ] NGS: Loaded 11521 existing records from primary storage. [2025-09-23T22:23:48.724393] [INFO ] [MAIN ] NGS: Loaded 11521 primary data records. [2025-09-23T22:23:49.037978] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:49.052881] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46138 primary records. [2025-09-23T22:23:49.053140] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-23T22:23:49.073533] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-09-23T22:23:49.074107] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-23T22:23:49.076403] [INFO ] [MAIN ] Derivative Progress: 1283/2077 symbols completed. NGG took 1.1s. Estimated remaining: 5m 11s. Rate: 153.1 symbols/min [2025-09-23T22:23:49.077068] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:49.095690] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:49.096584] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30539 primary records. [2025-09-23T22:23:49.096836] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-23T22:23:49.113940] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-09-23T22:23:49.119358] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-23T22:23:49.121991] [INFO ] [MAIN ] Derivative Progress: 1284/2077 symbols completed. NGL took 1.1s. Estimated remaining: 5m 11s. Rate: 153.2 symbols/min [2025-09-23T22:23:49.122484] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:49.134556] [DEBUG] [LOCAL ] NGVC: Loaded 22329 existing records from primary storage. [2025-09-23T22:23:49.134790] [INFO ] [MAIN ] NGVC: Loaded 22329 primary data records. [2025-09-23T22:23:49.222507] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:49.252752] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11521 primary records. [2025-09-23T22:23:49.264241] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-23T22:23:49.338263] [DEBUG] [LOCAL ] NGVT: Loaded 24417 existing records from primary storage. [2025-09-23T22:23:49.357120] [INFO ] [MAIN ] NGVT: Loaded 24417 primary data records. [2025-09-23T22:23:49.619212] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-09-23T22:23:49.647982] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-23T22:23:49.657121] [INFO ] [MAIN ] Derivative Progress: 1285/2077 symbols completed. NGS took 1.2s. Estimated remaining: 5m 10s. Rate: 153.1 symbols/min [2025-09-23T22:23:49.657550] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:49.875486] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:49.882184] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22329 primary records. [2025-09-23T22:23:49.882367] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-23T22:23:49.908084] [DEBUG] [LOCAL ] NHI: Loaded 22081 existing records from primary storage. [2025-09-23T22:23:49.908835] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-09-23T22:23:49.909030] [INFO ] [MAIN ] NHI: Loaded 22081 primary data records. [2025-09-23T22:23:49.909301] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-23T22:23:49.916903] [INFO ] [MAIN ] Derivative Progress: 1286/2077 symbols completed. NGVC took 0.8s. Estimated remaining: 5m 10s. Rate: 153.2 symbols/min [2025-09-23T22:23:49.933718] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:50.037149] [DEBUG] [LOCAL ] NIC: Loaded 8869 existing records from primary storage. [2025-09-23T22:23:50.085767] [INFO ] [MAIN ] NIC: Loaded 8869 primary data records. [2025-09-23T22:23:50.128294] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:50.270984] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 24417 primary records. [2025-09-23T22:23:50.297205] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-23T22:23:50.410826] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-09-23T22:23:50.421632] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-23T22:23:50.424315] [INFO ] [MAIN ] Derivative Progress: 1287/2077 symbols completed. NGVT took 1.3s. Estimated remaining: 5m 9s. Rate: 153.2 symbols/min [2025-09-23T22:23:50.440008] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:50.608588] [DEBUG] [LOCAL ] NIE: Loaded 11612 existing records from primary storage. [2025-09-23T22:23:50.610449] [INFO ] [MAIN ] NIE: Loaded 11612 primary data records. [2025-09-23T22:23:50.729841] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:50.731709] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 22081 primary records. [2025-09-23T22:23:50.732102] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-23T22:23:50.951862] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-09-23T22:23:50.952759] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-23T22:23:50.955302] [INFO ] [MAIN ] Derivative Progress: 1288/2077 symbols completed. NHI took 1.3s. Estimated remaining: 5m 9s. Rate: 153.1 symbols/min [2025-09-23T22:23:50.968418] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:50.969545] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8869 primary records. [2025-09-23T22:23:50.969623] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-23T22:23:50.987214] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-09-23T22:23:50.987293] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-23T22:23:50.989862] [INFO ] [MAIN ] Derivative Progress: 1289/2077 symbols completed. NIC took 1.1s. Estimated remaining: 5m 9s. Rate: 153.2 symbols/min [2025-09-23T22:23:51.004870] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:51.005408] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11612 primary records. [2025-09-23T22:23:51.005466] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-23T22:23:51.020291] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-09-23T22:23:51.020355] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-23T22:23:51.022744] [INFO ] [MAIN ] Derivative Progress: 1290/2077 symbols completed. NIE took 0.6s. Estimated remaining: 5m 8s. Rate: 153.3 symbols/min [2025-09-23T22:23:51.023514] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:51.023443] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:51.023585] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:51.031007] [DEBUG] [LOCAL ] NIM: Loaded 4101 existing records from primary storage. [2025-09-23T22:23:51.031163] [INFO ] [MAIN ] NIM: Loaded 4101 primary data records. [2025-09-23T22:23:51.246330] [DEBUG] [LOCAL ] NINE: Loaded 28506 existing records from primary storage. [2025-09-23T22:23:51.367874] [INFO ] [MAIN ] NINE: Loaded 28506 primary data records. [2025-09-23T22:23:51.485251] [DEBUG] [LOCAL ] NJR: Loaded 38098 existing records from primary storage. [2025-09-23T22:23:51.496766] [INFO ] [MAIN ] NJR: Loaded 38098 primary data records. [2025-09-23T22:23:52.077882] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:52.079984] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 4101 primary records. [2025-09-23T22:23:52.080793] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-23T22:23:52.102023] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-09-23T22:23:52.102912] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-23T22:23:52.116849] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:52.119413] [INFO ] [MAIN ] Derivative Progress: 1291/2077 symbols completed. NIM took 1.1s. Estimated remaining: 5m 8s. Rate: 153.1 symbols/min [2025-09-23T22:23:52.120691] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28506 primary records. [2025-09-23T22:23:52.120973] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-23T22:23:52.121435] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:52.165806] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:52.166995] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 38098 primary records. [2025-09-23T22:23:52.165891] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-09-23T22:23:52.167152] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-23T22:23:52.167228] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-23T22:23:52.169455] [INFO ] [MAIN ] Derivative Progress: 1292/2077 symbols completed. NINE took 1.1s. Estimated remaining: 5m 7s. Rate: 153.2 symbols/min [2025-09-23T22:23:52.174715] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:52.176225] [DEBUG] [LOCAL ] NKX: Loaded 13537 existing records from primary storage. [2025-09-23T22:23:52.176755] [INFO ] [MAIN ] NKX: Loaded 13537 primary data records. [2025-09-23T22:23:52.307178] [DEBUG] [LOCAL ] NLOP: Loaded 11813 existing records from primary storage. [2025-09-23T22:23:52.311542] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-09-23T22:23:52.311977] [INFO ] [MAIN ] NLOP: Loaded 11813 primary data records. [2025-09-23T22:23:52.317284] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-23T22:23:52.350503] [INFO ] [MAIN ] Derivative Progress: 1293/2077 symbols completed. NJR took 1.3s. Estimated remaining: 5m 7s. Rate: 153.3 symbols/min [2025-09-23T22:23:52.437858] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:52.852259] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:52.853103] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13537 primary records. [2025-09-23T22:23:52.853574] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-23T22:23:52.872773] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-09-23T22:23:52.873144] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-23T22:23:52.882849] [INFO ] [MAIN ] Derivative Progress: 1294/2077 symbols completed. NKX took 0.8s. Estimated remaining: 5m 7s. Rate: 153.2 symbols/min [2025-09-23T22:23:52.902589] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:52.903003] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:52.903977] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11813 primary records. [2025-09-23T22:23:52.905170] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-23T22:23:52.904210] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-23T22:23:52.905751] [INFO ] [MAIN ] NLY: Loaded 53581 primary data records. [2025-09-23T22:23:53.028999] [DEBUG] [LOCAL ] NMAI: Loaded 13132 existing records from primary storage. [2025-09-23T22:23:53.034628] [INFO ] [MAIN ] NMAI: Loaded 13132 primary data records. [2025-09-23T22:23:53.193844] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-09-23T22:23:53.334350] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-23T22:23:53.351492] [INFO ] [MAIN ] Derivative Progress: 1295/2077 symbols completed. NLOP took 1.2s. Estimated remaining: 5m 6s. Rate: 153.2 symbols/min [2025-09-23T22:23:53.369046] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:53.614753] [DEBUG] [LOCAL ] NMCO: Loaded 16543 existing records from primary storage. [2025-09-23T22:23:53.615300] [INFO ] [MAIN ] NMCO: Loaded 16543 primary data records. [2025-09-23T22:23:53.779706] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:53.791632] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53581 primary records. [2025-09-23T22:23:53.802809] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-23T22:23:54.076675] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:54.079849] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 13132 primary records. [2025-09-23T22:23:54.082266] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-23T22:23:54.084751] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-09-23T22:23:54.094195] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-23T22:23:54.100913] [INFO ] [MAIN ] Derivative Progress: 1296/2077 symbols completed. NLY took 1.7s. Estimated remaining: 5m 6s. Rate: 153.1 symbols/min [2025-09-23T22:23:54.102452] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:54.112139] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-09-23T22:23:54.112526] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-23T22:23:54.115392] [INFO ] [MAIN ] Derivative Progress: 1297/2077 symbols completed. NMAI took 1.2s. Estimated remaining: 5m 5s. Rate: 153.2 symbols/min [2025-09-23T22:23:54.116572] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:54.122013] [DEBUG] [LOCAL ] NMG: Loaded 7560 existing records from primary storage. [2025-09-23T22:23:54.122421] [INFO ] [MAIN ] NMG: Loaded 7560 primary data records. [2025-09-23T22:23:54.179927] [DEBUG] [LOCAL ] NMI: Loaded 4064 existing records from primary storage. [2025-09-23T22:23:54.218547] [INFO ] [MAIN ] NMI: Loaded 4064 primary data records. [2025-09-23T22:23:54.309889] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:54.343921] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16543 primary records. [2025-09-23T22:23:54.425904] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-23T22:23:54.789257] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-09-23T22:23:54.789774] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-23T22:23:54.792198] [INFO ] [MAIN ] Derivative Progress: 1298/2077 symbols completed. NMCO took 1.4s. Estimated remaining: 5m 5s. Rate: 153.1 symbols/min [2025-09-23T22:23:54.793366] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:54.814859] [DEBUG] [LOCAL ] NMM: Loaded 14304 existing records from primary storage. [2025-09-23T22:23:54.816219] [INFO ] [MAIN ] NMM: Loaded 14304 primary data records. [2025-09-23T22:23:54.908877] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:54.915214] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 7560 primary records. [2025-09-23T22:23:54.928562] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-23T22:23:54.988557] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:55.002744] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4064 primary records. [2025-09-23T22:23:55.023487] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-23T22:23:55.211980] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-09-23T22:23:55.212578] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-23T22:23:55.215267] [INFO ] [MAIN ] Derivative Progress: 1299/2077 symbols completed. NMI took 1.1s. Estimated remaining: 5m 5s. Rate: 153.1 symbols/min [2025-09-23T22:23:55.215910] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:55.216767] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-09-23T22:23:55.217312] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-23T22:23:55.219415] [INFO ] [MAIN ] Derivative Progress: 1300/2077 symbols completed. NMG took 1.1s. Estimated remaining: 5m 4s. Rate: 153.2 symbols/min [2025-09-23T22:23:55.219755] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:55.227541] [DEBUG] [LOCAL ] NMS: Loaded 2884 existing records from primary storage. [2025-09-23T22:23:55.228137] [INFO ] [MAIN ] NMS: Loaded 2884 primary data records. [2025-09-23T22:23:55.579322] [DEBUG] [LOCAL ] NMR: Loaded 35045 existing records from primary storage. [2025-09-23T22:23:55.580764] [INFO ] [MAIN ] NMR: Loaded 35045 primary data records. [2025-09-23T22:23:55.719578] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:55.726533] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14304 primary records. [2025-09-23T22:23:55.763625] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-23T22:23:56.004939] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-09-23T22:23:56.019131] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-23T22:23:56.022182] [INFO ] [MAIN ] Derivative Progress: 1301/2077 symbols completed. NMM took 1.2s. Estimated remaining: 5m 4s. Rate: 153.1 symbols/min [2025-09-23T22:23:56.023086] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:56.022827] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:23:56.025038] [INFO ] [MAIN ] NMS: Generated 1792 derivative records from 2884 primary records. [2025-09-23T22:23:56.025300] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-23T22:23:56.045312] [DEBUG] [LOCAL ] NMS: Derivative data saved (1792 records). [2025-09-23T22:23:56.044592] [DEBUG] [LOCAL ] NMT: Loaded 2847 existing records from primary storage. [2025-09-23T22:23:56.045469] [INFO ] [MAIN ] NMT: Loaded 2847 primary data records. [2025-09-23T22:23:56.045590] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-23T22:23:56.069424] [INFO ] [MAIN ] Derivative Progress: 1302/2077 symbols completed. NMS took 0.8s. Estimated remaining: 5m 3s. Rate: 153.2 symbols/min [2025-09-23T22:23:56.099770] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:56.281957] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:56.296522] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35045 primary records. [2025-09-23T22:23:56.299547] [DEBUG] [LOCAL ] NMZ: Loaded 21604 existing records from primary storage. [2025-09-23T22:23:56.298442] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-23T22:23:56.300538] [INFO ] [MAIN ] NMZ: Loaded 21604 primary data records. [2025-09-23T22:23:56.536924] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-09-23T22:23:56.543527] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-23T22:23:56.553895] [INFO ] [MAIN ] Derivative Progress: 1303/2077 symbols completed. NMR took 1.3s. Estimated remaining: 5m 3s. Rate: 153.2 symbols/min [2025-09-23T22:23:56.787743] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:23:56.789086] [INFO ] [MAIN ] NMT: Generated 1792 derivative records from 2847 primary records. [2025-09-23T22:23:56.789229] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-23T22:23:56.805544] [DEBUG] [LOCAL ] NMT: Derivative data saved (1792 records). [2025-09-23T22:23:56.805773] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-23T22:23:56.808069] [INFO ] [MAIN ] Derivative Progress: 1304/2077 symbols completed. NMT took 0.8s. Estimated remaining: 5m 3s. Rate: 153.2 symbols/min [2025-09-23T22:23:56.823549] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:56.824391] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21604 primary records. [2025-09-23T22:23:56.824452] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-23T22:23:56.840505] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-09-23T22:23:56.840571] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-23T22:23:56.843499] [INFO ] [MAIN ] Derivative Progress: 1305/2077 symbols completed. NMZ took 0.7s. Estimated remaining: 5m 2s. Rate: 153.3 symbols/min [2025-09-23T22:23:56.844289] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:56.844224] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:56.844585] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:56.853955] [DEBUG] [LOCAL ] NNY: Loaded 5702 existing records from primary storage. [2025-09-23T22:23:56.854091] [INFO ] [MAIN ] NNY: Loaded 5702 primary data records. [2025-09-23T22:23:56.939636] [DEBUG] [LOCAL ] NNI: Loaded 9959 existing records from primary storage. [2025-09-23T22:23:56.967871] [INFO ] [MAIN ] NNI: Loaded 9959 primary data records. [2025-09-23T22:23:57.371689] [DEBUG] [LOCAL ] NNN: Loaded 48450 existing records from primary storage. [2025-09-23T22:23:57.501419] [INFO ] [MAIN ] NNN: Loaded 48450 primary data records. [2025-09-23T22:23:57.920007] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:57.933241] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5702 primary records. [2025-09-23T22:23:57.933509] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-23T22:23:57.934535] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:57.935964] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 9959 primary records. [2025-09-23T22:23:57.942888] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-23T22:23:57.983801] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-09-23T22:23:57.984925] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-09-23T22:23:57.985379] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-23T22:23:57.985467] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-23T22:23:57.987696] [INFO ] [MAIN ] Derivative Progress: 1306/2077 symbols completed. NNI took 1.1s. Estimated remaining: 5m 2s. Rate: 153.1 symbols/min [2025-09-23T22:23:57.985240] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:57.990793] [INFO ] [MAIN ] Derivative Progress: 1307/2077 symbols completed. NNY took 1.1s. Estimated remaining: 5m 1s. Rate: 153.2 symbols/min [2025-09-23T22:23:57.991696] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48450 primary records. [2025-09-23T22:23:57.990698] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:57.992087] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-23T22:23:57.992004] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:58.010792] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-09-23T22:23:58.010944] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-23T22:23:58.018856] [INFO ] [MAIN ] Derivative Progress: 1308/2077 symbols completed. NNN took 1.2s. Estimated remaining: 5m 1s. Rate: 153.3 symbols/min [2025-09-23T22:23:58.019276] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:58.036976] [DEBUG] [LOCAL ] NOAH: Loaded 20090 existing records from primary storage. [2025-09-23T22:23:58.037322] [INFO ] [MAIN ] NOAH: Loaded 20090 primary data records. [2025-09-23T22:23:58.037583] [DEBUG] [LOCAL ] NOA: Loaded 16275 existing records from primary storage. [2025-09-23T22:23:58.037787] [INFO ] [MAIN ] NOA: Loaded 16275 primary data records. [2025-09-23T22:23:58.695907] [DEBUG] [LOCAL ] NOC: Loaded 42599 existing records from primary storage. [2025-09-23T22:23:58.697436] [INFO ] [MAIN ] NOC: Loaded 42599 primary data records. [2025-09-23T22:23:59.053134] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:59.054406] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 16275 primary records. [2025-09-23T22:23:59.066966] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-23T22:23:59.068890] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:59.080821] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20090 primary records. [2025-09-23T22:23:59.082882] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-23T22:23:59.087673] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-09-23T22:23:59.088184] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-23T22:23:59.097578] [INFO ] [MAIN ] Derivative Progress: 1309/2077 symbols completed. NOA took 1.1s. Estimated remaining: 5m 1s. Rate: 153.1 symbols/min [2025-09-23T22:23:59.102009] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:59.109771] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-09-23T22:23:59.110544] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-23T22:23:59.113111] [INFO ] [MAIN ] Derivative Progress: 1310/2077 symbols completed. NOAH took 1.1s. Estimated remaining: 5m 0s. Rate: 153.3 symbols/min [2025-09-23T22:23:59.113718] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:59.127329] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:23:59.128151] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 42599 primary records. [2025-09-23T22:23:59.128297] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-23T22:23:59.144572] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-09-23T22:23:59.144994] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-23T22:23:59.147412] [INFO ] [MAIN ] Derivative Progress: 1311/2077 symbols completed. NOC took 1.1s. Estimated remaining: 4m 60s. Rate: 153.4 symbols/min [2025-09-23T22:23:59.147691] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:23:59.203048] [DEBUG] [LOCAL ] NOG: Loaded 51164 existing records from primary storage. [2025-09-23T22:23:59.203373] [INFO ] [MAIN ] NOG: Loaded 51164 primary data records. [2025-09-23T22:23:59.334442] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-23T22:23:59.334732] [INFO ] [MAIN ] NOK: Loaded 53621 primary data records. [2025-09-23T22:23:59.435481] [DEBUG] [LOCAL ] NOMD: Loaded 41396 existing records from primary storage. [2025-09-23T22:23:59.472993] [INFO ] [MAIN ] NOMD: Loaded 41396 primary data records. [2025-09-23T22:24:00.264853] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:00.265663] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51164 primary records. [2025-09-23T22:24:00.266162] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-23T22:24:00.285149] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-09-23T22:24:00.287087] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-23T22:24:00.289353] [INFO ] [MAIN ] Derivative Progress: 1312/2077 symbols completed. NOG took 1.2s. Estimated remaining: 4m 60s. Rate: 153.1 symbols/min [2025-09-23T22:24:00.290217] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:00.303588] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:00.304629] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53621 primary records. [2025-09-23T22:24:00.304910] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-23T22:24:00.323833] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-09-23T22:24:00.335878] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-23T22:24:00.345340] [INFO ] [MAIN ] Derivative Progress: 1313/2077 symbols completed. NOK took 1.2s. Estimated remaining: 4m 59s. Rate: 153.2 symbols/min [2025-09-23T22:24:00.345842] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:00.347089] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:00.346864] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 41396 primary records. [2025-09-23T22:24:00.347315] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-23T22:24:00.383140] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-09-23T22:24:00.383395] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-23T22:24:00.386755] [INFO ] [MAIN ] Derivative Progress: 1314/2077 symbols completed. NOMD took 1.2s. Estimated remaining: 4m 59s. Rate: 153.3 symbols/min [2025-09-23T22:24:00.388402] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:00.403300] [DEBUG] [LOCAL ] NOTE: Loaded 42980 existing records from primary storage. [2025-09-23T22:24:00.403634] [INFO ] [MAIN ] NOTE: Loaded 42980 primary data records. [2025-09-23T22:24:00.562923] [DEBUG] [LOCAL ] NPCT: Loaded 16832 existing records from primary storage. [2025-09-23T22:24:00.622752] [INFO ] [MAIN ] NPCT: Loaded 16832 primary data records. [2025-09-23T22:24:00.839572] [DEBUG] [LOCAL ] NOV: Loaded 53184 existing records from primary storage. [2025-09-23T22:24:00.857359] [INFO ] [MAIN ] NOV: Loaded 53184 primary data records. [2025-09-23T22:24:01.419973] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:01.421707] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 42980 primary records. [2025-09-23T22:24:01.422136] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-23T22:24:01.449730] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-09-23T22:24:01.450271] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-23T22:24:01.464881] [INFO ] [MAIN ] Derivative Progress: 1315/2077 symbols completed. NOTE took 1.2s. Estimated remaining: 4m 59s. Rate: 153.1 symbols/min [2025-09-23T22:24:01.473138] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:01.475148] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 16832 primary records. [2025-09-23T22:24:01.473987] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:01.475323] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-23T22:24:01.515023] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:01.521494] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53184 primary records. [2025-09-23T22:24:01.520079] [DEBUG] [LOCAL ] NPFD: Loaded 9670 existing records from primary storage. [2025-09-23T22:24:01.522245] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-23T22:24:01.522323] [INFO ] [MAIN ] NPFD: Loaded 9670 primary data records. [2025-09-23T22:24:01.522169] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-09-23T22:24:01.528840] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-23T22:24:01.556267] [INFO ] [MAIN ] Derivative Progress: 1316/2077 symbols completed. NPCT took 1.2s. Estimated remaining: 4m 58s. Rate: 153.2 symbols/min [2025-09-23T22:24:01.597360] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:01.710880] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-09-23T22:24:01.881150] [DEBUG] [LOCAL ] NPK: Loaded 8076 existing records from primary storage. [2025-09-23T22:24:01.875408] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-23T22:24:01.893417] [INFO ] [MAIN ] NPK: Loaded 8076 primary data records. [2025-09-23T22:24:01.893215] [INFO ] [MAIN ] Derivative Progress: 1317/2077 symbols completed. NOV took 1.5s. Estimated remaining: 4m 58s. Rate: 153.2 symbols/min [2025-09-23T22:24:01.893796] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:02.075132] [DEBUG] [LOCAL ] NPO: Loaded 12839 existing records from primary storage. [2025-09-23T22:24:02.085839] [INFO ] [MAIN ] NPO: Loaded 12839 primary data records. [2025-09-23T22:24:02.494295] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:02.529208] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9670 primary records. [2025-09-23T22:24:02.658034] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-23T22:24:02.683212] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-09-23T22:24:02.696300] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-23T22:24:02.699822] [INFO ] [MAIN ] Derivative Progress: 1318/2077 symbols completed. NPFD took 1.2s. Estimated remaining: 4m 57s. Rate: 153.1 symbols/min [2025-09-23T22:24:02.697370] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:02.700690] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8076 primary records. [2025-09-23T22:24:02.701113] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-23T22:24:02.718402] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-09-23T22:24:02.718486] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-23T22:24:02.721261] [INFO ] [MAIN ] Derivative Progress: 1319/2077 symbols completed. NPK took 1.1s. Estimated remaining: 4m 57s. Rate: 153.2 symbols/min [2025-09-23T22:24:02.737089] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:02.737741] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 12839 primary records. [2025-09-23T22:24:02.737806] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-23T22:24:02.753996] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-09-23T22:24:02.754058] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-23T22:24:02.756434] [INFO ] [MAIN ] Derivative Progress: 1320/2077 symbols completed. NPO took 0.9s. Estimated remaining: 4m 56s. Rate: 153.3 symbols/min [2025-09-23T22:24:02.757121] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:02.757229] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:02.757317] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:02.768818] [DEBUG] [LOCAL ] NPV: Loaded 5013 existing records from primary storage. [2025-09-23T22:24:02.769229] [INFO ] [MAIN ] NPV: Loaded 5013 primary data records. [2025-09-23T22:24:02.829796] [DEBUG] [LOCAL ] NQP: Loaded 9312 existing records from primary storage. [2025-09-23T22:24:02.851735] [INFO ] [MAIN ] NQP: Loaded 9312 primary data records. [2025-09-23T22:24:03.241564] [DEBUG] [LOCAL ] NPWR: Loaded 43187 existing records from primary storage. [2025-09-23T22:24:03.253703] [INFO ] [MAIN ] NPWR: Loaded 43187 primary data records. [2025-09-23T22:24:03.783185] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:03.797369] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5013 primary records. [2025-09-23T22:24:03.798134] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:03.799231] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9312 primary records. [2025-09-23T22:24:03.799328] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-23T22:24:03.800300] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-23T22:24:03.833771] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-09-23T22:24:03.834864] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-23T22:24:03.837419] [INFO ] [MAIN ] Derivative Progress: 1321/2077 symbols completed. NPV took 1.1s. Estimated remaining: 4m 56s. Rate: 153.1 symbols/min [2025-09-23T22:24:03.838045] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:03.840748] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-09-23T22:24:03.841162] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-23T22:24:03.843601] [INFO ] [MAIN ] Derivative Progress: 1322/2077 symbols completed. NQP took 1.1s. Estimated remaining: 4m 56s. Rate: 153.2 symbols/min [2025-09-23T22:24:03.845606] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:03.859854] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:03.860605] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 43187 primary records. [2025-09-23T22:24:03.860783] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-23T22:24:03.880034] [DEBUG] [LOCAL ] NREF: Loaded 7864 existing records from primary storage. [2025-09-23T22:24:03.880941] [INFO ] [MAIN ] NREF: Loaded 7864 primary data records. [2025-09-23T22:24:04.009356] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-09-23T22:24:04.012997] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-23T22:24:04.015729] [INFO ] [MAIN ] Derivative Progress: 1323/2077 symbols completed. NPWR took 1.3s. Estimated remaining: 4m 55s. Rate: 153.3 symbols/min [2025-09-23T22:24:04.016394] [DEBUG] [LOCAL ] NRDY: Loaded 33119 existing records from primary storage. [2025-09-23T22:24:04.017406] [INFO ] [MAIN ] NRDY: Loaded 33119 primary data records. [2025-09-23T22:24:04.017217] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:04.578958] [DEBUG] [LOCAL ] NRGV: Loaded 42910 existing records from primary storage. [2025-09-23T22:24:04.580030] [INFO ] [MAIN ] NRGV: Loaded 42910 primary data records. [2025-09-23T22:24:04.904102] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:04.905265] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7864 primary records. [2025-09-23T22:24:04.905617] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-23T22:24:04.924667] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-09-23T22:24:04.925007] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-23T22:24:04.927364] [INFO ] [MAIN ] Derivative Progress: 1324/2077 symbols completed. NREF took 1.1s. Estimated remaining: 4m 55s. Rate: 153.2 symbols/min [2025-09-23T22:24:04.930579] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:04.948165] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:04.949182] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 33119 primary records. [2025-09-23T22:24:04.949388] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-23T22:24:04.980463] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-09-23T22:24:04.981916] [DEBUG] [LOCAL ] NRK: Loaded 19632 existing records from primary storage. [2025-09-23T22:24:04.981542] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-23T22:24:04.982084] [INFO ] [MAIN ] NRK: Loaded 19632 primary data records. [2025-09-23T22:24:05.008987] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:04.997385] [INFO ] [MAIN ] Derivative Progress: 1325/2077 symbols completed. NRDY took 1.2s. Estimated remaining: 4m 54s. Rate: 153.2 symbols/min [2025-09-23T22:24:05.029377] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 42910 primary records. [2025-09-23T22:24:05.034620] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-23T22:24:05.053742] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:05.187833] [DEBUG] [LOCAL ] NRP: Loaded 4099 existing records from primary storage. [2025-09-23T22:24:05.198960] [INFO ] [MAIN ] NRP: Loaded 4099 primary data records. [2025-09-23T22:24:05.375070] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-09-23T22:24:05.389900] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-23T22:24:05.392567] [INFO ] [MAIN ] Derivative Progress: 1326/2077 symbols completed. NRGV took 1.4s. Estimated remaining: 4m 54s. Rate: 153.2 symbols/min [2025-09-23T22:24:05.392977] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:05.505181] [DEBUG] [LOCAL ] NRT: Loaded 4858 existing records from primary storage. [2025-09-23T22:24:05.511815] [INFO ] [MAIN ] NRT: Loaded 4858 primary data records. [2025-09-23T22:24:05.966164] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:05.966979] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 19632 primary records. [2025-09-23T22:24:05.967153] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-23T22:24:05.991151] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-09-23T22:24:05.991993] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-23T22:24:06.007894] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:06.007429] [INFO ] [MAIN ] Derivative Progress: 1327/2077 symbols completed. NRK took 1.1s. Estimated remaining: 4m 54s. Rate: 153.2 symbols/min [2025-09-23T22:24:06.009037] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4099 primary records. [2025-09-23T22:24:06.009295] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:06.009971] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-23T22:24:06.026948] [DEBUG] [LOCAL ] NRUC: Loaded 3074 existing records from primary storage. [2025-09-23T22:24:06.029127] [INFO ] [MAIN ] NRUC: Loaded 3074 primary data records. [2025-09-23T22:24:06.108755] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:06.108314] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-09-23T22:24:06.114939] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4858 primary records. [2025-09-23T22:24:06.114116] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-23T22:24:06.130226] [INFO ] [MAIN ] Derivative Progress: 1328/2077 symbols completed. NRP took 1.1s. Estimated remaining: 4m 53s. Rate: 153.3 symbols/min [2025-09-23T22:24:06.135633] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:06.127579] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-23T22:24:06.406123] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-09-23T22:24:06.406284] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-23T22:24:06.409091] [INFO ] [MAIN ] Derivative Progress: 1329/2077 symbols completed. NRT took 1.0s. Estimated remaining: 4m 53s. Rate: 153.3 symbols/min [2025-09-23T22:24:06.418503] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:06.435768] [DEBUG] [LOCAL ] NSP: Loaded 34921 existing records from primary storage. [2025-09-23T22:24:06.435988] [INFO ] [MAIN ] NSP: Loaded 34921 primary data records. [2025-09-23T22:24:06.554015] [DEBUG] [LOCAL ] NTB: Loaded 20685 existing records from primary storage. [2025-09-23T22:24:06.565162] [INFO ] [MAIN ] NTB: Loaded 20685 primary data records. [2025-09-23T22:24:06.926998] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:06.966820] [INFO ] [MAIN ] NRUC: Generated 1794 derivative records from 3074 primary records. [2025-09-23T22:24:07.082843] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-23T22:24:07.103758] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1794 records). [2025-09-23T22:24:07.104168] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-23T22:24:07.107958] [INFO ] [MAIN ] Derivative Progress: 1330/2077 symbols completed. NRUC took 1.1s. Estimated remaining: 4m 53s. Rate: 153.2 symbols/min [2025-09-23T22:24:07.108552] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:07.127376] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:07.128233] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 34921 primary records. [2025-09-23T22:24:07.128453] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-23T22:24:07.158691] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:07.160261] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20685 primary records. [2025-09-23T22:24:07.160595] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-23T22:24:07.190730] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-09-23T22:24:07.192423] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-09-23T22:24:07.192818] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-23T22:24:07.192904] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-23T22:24:07.195475] [INFO ] [MAIN ] Derivative Progress: 1331/2077 symbols completed. NSP took 1.1s. Estimated remaining: 4m 52s. Rate: 153.3 symbols/min [2025-09-23T22:24:07.198566] [INFO ] [MAIN ] Derivative Progress: 1332/2077 symbols completed. NTB took 0.8s. Estimated remaining: 4m 51s. Rate: 153.4 symbols/min [2025-09-23T22:24:07.198697] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:07.199173] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:07.217006] [DEBUG] [LOCAL ] NTR: Loaded 52579 existing records from primary storage. [2025-09-23T22:24:07.217190] [INFO ] [MAIN ] NTR: Loaded 52579 primary data records. [2025-09-23T22:24:07.556224] [DEBUG] [LOCAL ] NTST: Loaded 43542 existing records from primary storage. [2025-09-23T22:24:07.556932] [INFO ] [MAIN ] NTST: Loaded 43542 primary data records. [2025-09-23T22:24:07.653786] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-23T22:24:07.688551] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-09-23T22:24:08.270632] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:08.271857] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52579 primary records. [2025-09-23T22:24:08.272115] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-23T22:24:08.294072] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-09-23T22:24:08.295414] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-23T22:24:08.297886] [INFO ] [MAIN ] Derivative Progress: 1333/2077 symbols completed. NTR took 1.2s. Estimated remaining: 4m 51s. Rate: 153.2 symbols/min [2025-09-23T22:24:08.313945] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:08.314751] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 43542 primary records. [2025-09-23T22:24:08.314906] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-23T22:24:08.346068] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:08.347266] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-09-23T22:24:08.347570] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-23T22:24:08.348014] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-09-23T22:24:08.348467] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-23T22:24:08.350604] [INFO ] [MAIN ] Derivative Progress: 1334/2077 symbols completed. NTST took 1.2s. Estimated remaining: 4m 51s. Rate: 153.3 symbols/min [2025-09-23T22:24:08.366175] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-09-23T22:24:08.366270] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-23T22:24:08.369608] [INFO ] [MAIN ] Derivative Progress: 1335/2077 symbols completed. NU took 1.2s. Estimated remaining: 4m 50s. Rate: 153.4 symbols/min [2025-09-23T22:24:08.370219] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:08.370390] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:08.370503] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:08.396016] [DEBUG] [LOCAL ] NUV: Loaded 23239 existing records from primary storage. [2025-09-23T22:24:08.396306] [INFO ] [MAIN ] NUV: Loaded 23239 primary data records. [2025-09-23T22:24:08.579882] [DEBUG] [LOCAL ] NUS: Loaded 36464 existing records from primary storage. [2025-09-23T22:24:08.585338] [INFO ] [MAIN ] NUS: Loaded 36464 primary data records. [2025-09-23T22:24:08.753019] [DEBUG] [LOCAL ] NUVB: Loaded 51209 existing records from primary storage. [2025-09-23T22:24:08.885808] [INFO ] [MAIN ] NUVB: Loaded 51209 primary data records. [2025-09-23T22:24:09.446455] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:09.447458] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23239 primary records. [2025-09-23T22:24:09.447964] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-23T22:24:09.480135] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:09.482371] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36464 primary records. [2025-09-23T22:24:09.482964] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-23T22:24:09.485317] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-09-23T22:24:09.485703] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-23T22:24:09.498024] [INFO ] [MAIN ] Derivative Progress: 1336/2077 symbols completed. NUV took 1.1s. Estimated remaining: 4m 50s. Rate: 153.2 symbols/min [2025-09-23T22:24:09.499992] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:09.514018] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:09.516346] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51209 primary records. [2025-09-23T22:24:09.516731] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-23T22:24:09.520342] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-09-23T22:24:09.520843] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-23T22:24:09.523113] [INFO ] [MAIN ] Derivative Progress: 1337/2077 symbols completed. NUS took 1.2s. Estimated remaining: 4m 50s. Rate: 153.3 symbols/min [2025-09-23T22:24:09.523369] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:09.538141] [DEBUG] [LOCAL ] NUW: Loaded 7438 existing records from primary storage. [2025-09-23T22:24:09.538919] [INFO ] [MAIN ] NUW: Loaded 7438 primary data records. [2025-09-23T22:24:09.582145] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-09-23T22:24:09.582255] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-23T22:24:09.603211] [INFO ] [MAIN ] Derivative Progress: 1338/2077 symbols completed. NUVB took 1.2s. Estimated remaining: 4m 49s. Rate: 153.4 symbols/min [2025-09-23T22:24:09.623868] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:09.871006] [DEBUG] [LOCAL ] NVGS: Loaded 31106 existing records from primary storage. [2025-09-23T22:24:09.871938] [INFO ] [MAIN ] NVGS: Loaded 31106 primary data records. [2025-09-23T22:24:10.242605] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-23T22:24:10.243033] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-09-23T22:24:10.565559] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:10.567187] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7438 primary records. [2025-09-23T22:24:10.567495] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-23T22:24:10.601334] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-09-23T22:24:10.601745] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-23T22:24:10.602129] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:10.602868] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 31106 primary records. [2025-09-23T22:24:10.603048] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-23T22:24:10.605346] [INFO ] [MAIN ] Derivative Progress: 1339/2077 symbols completed. NUW took 1.1s. Estimated remaining: 4m 49s. Rate: 153.2 symbols/min [2025-09-23T22:24:10.606620] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:10.644093] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-09-23T22:24:10.643683] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:10.644907] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-09-23T22:24:10.645008] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-23T22:24:10.653419] [INFO ] [MAIN ] Derivative Progress: 1340/2077 symbols completed. NVGS took 1.1s. Estimated remaining: 4m 48s. Rate: 153.3 symbols/min [2025-09-23T22:24:10.650561] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-23T22:24:10.655098] [DEBUG] [LOCAL ] NVR: Loaded 19206 existing records from primary storage. [2025-09-23T22:24:10.655249] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:10.655533] [INFO ] [MAIN ] NVR: Loaded 19206 primary data records. [2025-09-23T22:24:10.714053] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-09-23T22:24:10.734965] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-23T22:24:10.749189] [INFO ] [MAIN ] Derivative Progress: 1341/2077 symbols completed. NVO took 1.1s. Estimated remaining: 4m 48s. Rate: 153.4 symbols/min [2025-09-23T22:24:10.760154] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:10.992622] [DEBUG] [LOCAL ] NVRI: Loaded 38782 existing records from primary storage. [2025-09-23T22:24:10.992951] [INFO ] [MAIN ] NVRI: Loaded 38782 primary data records. [2025-09-23T22:24:11.315776] [DEBUG] [LOCAL ] NVS: Loaded 51667 existing records from primary storage. [2025-09-23T22:24:11.324404] [INFO ] [MAIN ] NVS: Loaded 51667 primary data records. [2025-09-23T22:24:11.642159] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:11.642971] [INFO ] [MAIN ] NVR: Generated 1794 derivative records from 19206 primary records. [2025-09-23T22:24:11.643172] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-23T22:24:11.666333] [DEBUG] [LOCAL ] NVR: Derivative data saved (1794 records). [2025-09-23T22:24:11.666738] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-23T22:24:11.669088] [INFO ] [MAIN ] Derivative Progress: 1342/2077 symbols completed. NVR took 1.1s. Estimated remaining: 4m 48s. Rate: 153.2 symbols/min [2025-09-23T22:24:11.677526] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:11.683156] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:11.684019] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38782 primary records. [2025-09-23T22:24:11.684332] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-23T22:24:11.714757] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:11.715626] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-09-23T22:24:11.716449] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-23T22:24:11.716365] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51667 primary records. [2025-09-23T22:24:11.719474] [INFO ] [MAIN ] Derivative Progress: 1343/2077 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 47s. Rate: 153.3 symbols/min [2025-09-23T22:24:11.719693] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-23T22:24:11.721206] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:11.750352] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-09-23T22:24:11.750599] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-23T22:24:11.752927] [INFO ] [MAIN ] Derivative Progress: 1344/2077 symbols completed. NVS took 1.0s. Estimated remaining: 4m 47s. Rate: 153.4 symbols/min [2025-09-23T22:24:11.753409] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:11.774306] [DEBUG] [LOCAL ] NVST: Loaded 51650 existing records from primary storage. [2025-09-23T22:24:11.774563] [INFO ] [MAIN ] NVST: Loaded 51650 primary data records. [2025-09-23T22:24:12.117677] [DEBUG] [LOCAL ] NVT: Loaded 51600 existing records from primary storage. [2025-09-23T22:24:12.131354] [INFO ] [MAIN ] NVT: Loaded 51600 primary data records. [2025-09-23T22:24:12.153811] [DEBUG] [LOCAL ] NWG: Loaded 51614 existing records from primary storage. [2025-09-23T22:24:12.169746] [INFO ] [MAIN ] NWG: Loaded 51614 primary data records. [2025-09-23T22:24:12.808433] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:12.809512] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51650 primary records. [2025-09-23T22:24:12.809790] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-23T22:24:12.832149] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-09-23T22:24:12.833468] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-23T22:24:12.836093] [INFO ] [MAIN ] Derivative Progress: 1345/2077 symbols completed. NVST took 1.2s. Estimated remaining: 4m 47s. Rate: 153.2 symbols/min [2025-09-23T22:24:12.836769] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:12.850433] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:12.851556] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51600 primary records. [2025-09-23T22:24:12.851775] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-23T22:24:12.870969] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-09-23T22:24:12.871993] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-23T22:24:12.874120] [INFO ] [MAIN ] Derivative Progress: 1346/2077 symbols completed. NVT took 1.2s. Estimated remaining: 4m 46s. Rate: 153.3 symbols/min [2025-09-23T22:24:12.874525] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:12.888388] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:12.889172] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51614 primary records. [2025-09-23T22:24:12.889353] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-23T22:24:12.915859] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-09-23T22:24:12.915929] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-23T22:24:12.918271] [INFO ] [MAIN ] Derivative Progress: 1347/2077 symbols completed. NWG took 1.2s. Estimated remaining: 4m 45s. Rate: 153.4 symbols/min [2025-09-23T22:24:12.919193] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:12.928548] [DEBUG] [LOCAL ] NWN: Loaded 26869 existing records from primary storage. [2025-09-23T22:24:12.938340] [INFO ] [MAIN ] NWN: Loaded 26869 primary data records. [2025-09-23T22:24:12.985550] [DEBUG] [LOCAL ] NXC: Loaded 4210 existing records from primary storage. [2025-09-23T22:24:13.007283] [INFO ] [MAIN ] NXC: Loaded 4210 primary data records. [2025-09-23T22:24:13.061516] [DEBUG] [LOCAL ] NX: Loaded 33437 existing records from primary storage. [2025-09-23T22:24:13.073225] [INFO ] [MAIN ] NX: Loaded 33437 primary data records. [2025-09-23T22:24:13.916332] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:13.915582] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:13.919069] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26869 primary records. [2025-09-23T22:24:13.920524] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4210 primary records. [2025-09-23T22:24:13.920664] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-23T22:24:13.920827] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-23T22:24:13.954845] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:13.961296] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-09-23T22:24:13.960784] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33437 primary records. [2025-09-23T22:24:13.961402] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-23T22:24:13.966222] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-09-23T22:24:13.966420] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-23T22:24:13.968417] [INFO ] [MAIN ] Derivative Progress: 1348/2077 symbols completed. NWN took 1.1s. Estimated remaining: 4m 45s. Rate: 153.3 symbols/min [2025-09-23T22:24:13.966342] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-23T22:24:13.971179] [INFO ] [MAIN ] Derivative Progress: 1349/2077 symbols completed. NXC took 1.1s. Estimated remaining: 4m 45s. Rate: 153.4 symbols/min [2025-09-23T22:24:13.986368] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-09-23T22:24:13.986439] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-23T22:24:13.989056] [INFO ] [MAIN ] Derivative Progress: 1350/2077 symbols completed. NX took 1.1s. Estimated remaining: 4m 44s. Rate: 153.5 symbols/min [2025-09-23T22:24:13.989552] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:13.989818] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:13.989891] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:14.007551] [DEBUG] [LOCAL ] NXG: Loaded 10489 existing records from primary storage. [2025-09-23T22:24:14.007822] [INFO ] [MAIN ] NXG: Loaded 10489 primary data records. [2025-09-23T22:24:14.089797] [DEBUG] [LOCAL ] NXDT: Loaded 16417 existing records from primary storage. [2025-09-23T22:24:14.108510] [INFO ] [MAIN ] NXDT: Loaded 16417 primary data records. [2025-09-23T22:24:14.595051] [DEBUG] [LOCAL ] NXE: Loaded 52985 existing records from primary storage. [2025-09-23T22:24:14.717453] [INFO ] [MAIN ] NXE: Loaded 52985 primary data records. [2025-09-23T22:24:15.055762] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:15.056866] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10489 primary records. [2025-09-23T22:24:15.057581] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-23T22:24:15.090451] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:15.091737] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 16417 primary records. [2025-09-23T22:24:15.092165] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-23T22:24:15.105954] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-09-23T22:24:15.106724] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-23T22:24:15.110844] [INFO ] [MAIN ] Derivative Progress: 1351/2077 symbols completed. NXG took 1.1s. Estimated remaining: 4m 44s. Rate: 153.3 symbols/min [2025-09-23T22:24:15.111689] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:15.131199] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-09-23T22:24:15.131107] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:15.132053] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 52985 primary records. [2025-09-23T22:24:15.132218] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-23T22:24:15.132293] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-23T22:24:15.136733] [INFO ] [MAIN ] Derivative Progress: 1352/2077 symbols completed. NXDT took 1.1s. Estimated remaining: 4m 44s. Rate: 153.4 symbols/min [2025-09-23T22:24:15.141505] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:15.160781] [DEBUG] [LOCAL ] NXJ: Loaded 14965 existing records from primary storage. [2025-09-23T22:24:15.162262] [INFO ] [MAIN ] NXJ: Loaded 14965 primary data records. [2025-09-23T22:24:15.186357] [DEBUG] [LOCAL ] NXN: Loaded 2336 existing records from primary storage. [2025-09-23T22:24:15.203317] [INFO ] [MAIN ] NXN: Loaded 2336 primary data records. [2025-09-23T22:24:15.223962] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-09-23T22:24:15.255301] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-23T22:24:15.283846] [INFO ] [MAIN ] Derivative Progress: 1353/2077 symbols completed. NXE took 1.3s. Estimated remaining: 4m 43s. Rate: 153.4 symbols/min [2025-09-23T22:24:15.311621] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:15.664221] [DEBUG] [LOCAL ] NXP: Loaded 12323 existing records from primary storage. [2025-09-23T22:24:15.774664] [INFO ] [MAIN ] NXP: Loaded 12323 primary data records. [2025-09-23T22:24:16.202819] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:16.205339] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14965 primary records. [2025-09-23T22:24:16.206411] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-23T22:24:16.240216] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:16.242607] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2336 primary records. [2025-09-23T22:24:16.243114] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-23T22:24:16.262165] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-09-23T22:24:16.262956] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-23T22:24:16.266174] [INFO ] [MAIN ] Derivative Progress: 1354/2077 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 43s. Rate: 153.3 symbols/min [2025-09-23T22:24:16.267335] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:16.271576] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-09-23T22:24:16.272109] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-23T22:24:16.274723] [INFO ] [MAIN ] Derivative Progress: 1355/2077 symbols completed. NXN took 1.1s. Estimated remaining: 4m 42s. Rate: 153.4 symbols/min [2025-09-23T22:24:16.275543] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:16.307379] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:16.308578] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12323 primary records. [2025-09-23T22:24:16.308847] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-23T22:24:16.338224] [DEBUG] [LOCAL ] NXRT: Loaded 19024 existing records from primary storage. [2025-09-23T22:24:16.339680] [INFO ] [MAIN ] NXRT: Loaded 19024 primary data records. [2025-09-23T22:24:16.418073] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-09-23T22:24:16.436940] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-23T22:24:16.460826] [INFO ] [MAIN ] Derivative Progress: 1356/2077 symbols completed. NXP took 1.1s. Estimated remaining: 4m 42s. Rate: 153.4 symbols/min [2025-09-23T22:24:16.461557] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:16.574929] [DEBUG] [LOCAL ] NYT: Loaded 49929 existing records from primary storage. [2025-09-23T22:24:16.602620] [INFO ] [MAIN ] NYT: Loaded 49929 primary data records. [2025-09-23T22:24:16.941794] [DEBUG] [LOCAL ] NZF: Loaded 29085 existing records from primary storage. [2025-09-23T22:24:16.942035] [INFO ] [MAIN ] NZF: Loaded 29085 primary data records. [2025-09-23T22:24:17.692225] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:17.694108] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 19024 primary records. [2025-09-23T22:24:17.694892] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-23T22:24:17.716999] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-09-23T22:24:17.717304] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-23T22:24:17.720185] [INFO ] [MAIN ] Derivative Progress: 1357/2077 symbols completed. NXRT took 1.5s. Estimated remaining: 4m 42s. Rate: 153.2 symbols/min [2025-09-23T22:24:17.723823] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:17.740467] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:17.743181] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 49929 primary records. [2025-09-23T22:24:17.743417] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-23T22:24:17.768262] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:17.770803] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 29085 primary records. [2025-09-23T22:24:17.771203] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-23T22:24:17.775408] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-09-23T22:24:17.782811] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-23T22:24:17.786258] [INFO ] [MAIN ] Derivative Progress: 1358/2077 symbols completed. NYT took 1.5s. Estimated remaining: 4m 41s. Rate: 153.3 symbols/min [2025-09-23T22:24:17.789670] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:17.796418] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-09-23T22:24:17.796621] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-23T22:24:17.799170] [INFO ] [MAIN ] Derivative Progress: 1359/2077 symbols completed. NZF took 1.3s. Estimated remaining: 4m 41s. Rate: 153.4 symbols/min [2025-09-23T22:24:17.799570] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:17.828471] [DEBUG] [LOCAL ] OBK: Loaded 16316 existing records from primary storage. [2025-09-23T22:24:17.828672] [INFO ] [MAIN ] OBK: Loaded 16316 primary data records. [2025-09-23T22:24:17.948577] [DEBUG] [LOCAL ] OBDC: Loaded 51652 existing records from primary storage. [2025-09-23T22:24:17.960860] [INFO ] [MAIN ] OBDC: Loaded 51652 primary data records. [2025-09-23T22:24:18.288394] [DEBUG] [LOCAL ] OC: Loaded 44759 existing records from primary storage. [2025-09-23T22:24:18.294114] [INFO ] [MAIN ] OC: Loaded 44759 primary data records. [2025-09-23T22:24:18.848309] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:18.849892] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16316 primary records. [2025-09-23T22:24:18.850210] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-23T22:24:18.870879] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-09-23T22:24:18.871220] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-23T22:24:18.873466] [INFO ] [MAIN ] Derivative Progress: 1360/2077 symbols completed. OBK took 1.1s. Estimated remaining: 4m 41s. Rate: 153.2 symbols/min [2025-09-23T22:24:18.873929] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:18.888859] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:18.889889] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51652 primary records. [2025-09-23T22:24:18.890123] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-23T22:24:18.926055] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:18.925735] [DEBUG] [LOCAL ] OCFT: Loaded 8974 existing records from primary storage. [2025-09-23T22:24:18.927170] [INFO ] [MAIN ] OCFT: Loaded 8974 primary data records. [2025-09-23T22:24:18.939444] [INFO ] [MAIN ] OC: Generated 1794 derivative records from 44759 primary records. [2025-09-23T22:24:18.939556] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-23T22:24:18.992595] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-09-23T22:24:19.010082] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-23T22:24:19.014621] [INFO ] [MAIN ] Derivative Progress: 1361/2077 symbols completed. OBDC took 1.3s. Estimated remaining: 4m 40s. Rate: 153.3 symbols/min [2025-09-23T22:24:19.015165] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:19.028761] [DEBUG] [LOCAL ] OC: Derivative data saved (1794 records). [2025-09-23T22:24:19.040448] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-23T22:24:19.054060] [INFO ] [MAIN ] Derivative Progress: 1362/2077 symbols completed. OC took 1.3s. Estimated remaining: 4m 40s. Rate: 153.4 symbols/min [2025-09-23T22:24:19.054720] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:19.268266] [DEBUG] [LOCAL ] ODC: Loaded 8589 existing records from primary storage. [2025-09-23T22:24:19.275521] [INFO ] [MAIN ] ODC: Loaded 8589 primary data records. [2025-09-23T22:24:19.366167] [DEBUG] [LOCAL ] ODV: Loaded 25476 existing records from primary storage. [2025-09-23T22:24:19.383790] [INFO ] [MAIN ] ODV: Loaded 25476 primary data records. [2025-09-23T22:24:19.936319] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:19.938554] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 8974 primary records. [2025-09-23T22:24:19.938983] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-23T22:24:19.964574] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-09-23T22:24:19.965959] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-23T22:24:19.968497] [INFO ] [MAIN ] Derivative Progress: 1363/2077 symbols completed. OCFT took 1.1s. Estimated remaining: 4m 40s. Rate: 153.2 symbols/min [2025-09-23T22:24:19.985355] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:19.986170] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8589 primary records. [2025-09-23T22:24:19.986380] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-23T22:24:20.016757] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:20.018234] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 25476 primary records. [2025-09-23T22:24:20.018560] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-23T22:24:20.020438] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-09-23T22:24:20.020535] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-23T22:24:20.023145] [INFO ] [MAIN ] Derivative Progress: 1364/2077 symbols completed. ODC took 1.0s. Estimated remaining: 4m 39s. Rate: 153.3 symbols/min [2025-09-23T22:24:20.038937] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-09-23T22:24:20.039057] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-23T22:24:20.041729] [INFO ] [MAIN ] Derivative Progress: 1365/2077 symbols completed. ODV took 1.0s. Estimated remaining: 4m 38s. Rate: 153.4 symbols/min [2025-09-23T22:24:20.042477] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:20.042661] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:20.042545] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:20.065552] [DEBUG] [LOCAL ] OFG: Loaded 22215 existing records from primary storage. [2025-09-23T22:24:20.066222] [INFO ] [MAIN ] OFG: Loaded 22215 primary data records. [2025-09-23T22:24:20.248025] [DEBUG] [LOCAL ] OEC: Loaded 37160 existing records from primary storage. [2025-09-23T22:24:20.258477] [INFO ] [MAIN ] OEC: Loaded 37160 primary data records. [2025-09-23T22:24:20.277555] [DEBUG] [LOCAL ] OGE: Loaded 46423 existing records from primary storage. [2025-09-23T22:24:20.346696] [INFO ] [MAIN ] OGE: Loaded 46423 primary data records. [2025-09-23T22:24:21.149531] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:21.151689] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 22215 primary records. [2025-09-23T22:24:21.152096] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-23T22:24:21.189861] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:21.189969] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-09-23T22:24:21.190807] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37160 primary records. [2025-09-23T22:24:21.190990] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-23T22:24:21.191333] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-23T22:24:21.200136] [INFO ] [MAIN ] Derivative Progress: 1366/2077 symbols completed. OFG took 1.2s. Estimated remaining: 4m 38s. Rate: 153.2 symbols/min [2025-09-23T22:24:21.210602] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:21.230794] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:21.231514] [INFO ] [MAIN ] OGE: Generated 1794 derivative records from 46423 primary records. [2025-09-23T22:24:21.231934] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-23T22:24:21.241132] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-09-23T22:24:21.244622] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-23T22:24:21.248083] [INFO ] [MAIN ] Derivative Progress: 1367/2077 symbols completed. OEC took 1.2s. Estimated remaining: 4m 38s. Rate: 153.3 symbols/min [2025-09-23T22:24:21.249121] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:21.254319] [DEBUG] [LOCAL ] OGE: Derivative data saved (1794 records). [2025-09-23T22:24:21.254460] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-23T22:24:21.257341] [INFO ] [MAIN ] Derivative Progress: 1368/2077 symbols completed. OGE took 1.2s. Estimated remaining: 4m 37s. Rate: 153.4 symbols/min [2025-09-23T22:24:21.257697] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:21.311027] [DEBUG] [LOCAL ] OGN: Loaded 53127 existing records from primary storage. [2025-09-23T22:24:21.311362] [INFO ] [MAIN ] OGN: Loaded 53127 primary data records. [2025-09-23T22:24:21.443283] [DEBUG] [LOCAL ] OGS: Loaded 33914 existing records from primary storage. [2025-09-23T22:24:21.454017] [INFO ] [MAIN ] OGS: Loaded 33914 primary data records. [2025-09-23T22:24:21.760997] [DEBUG] [LOCAL ] OHI: Loaded 52107 existing records from primary storage. [2025-09-23T22:24:21.773996] [INFO ] [MAIN ] OHI: Loaded 52107 primary data records. [2025-09-23T22:24:22.307051] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:22.309212] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53127 primary records. [2025-09-23T22:24:22.309316] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-23T22:24:22.334234] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:22.335710] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 33914 primary records. [2025-09-23T22:24:22.336374] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-23T22:24:22.368143] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-09-23T22:24:22.367823] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:22.369291] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 52107 primary records. [2025-09-23T22:24:22.369859] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-23T22:24:22.369939] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-23T22:24:22.373284] [INFO ] [MAIN ] Derivative Progress: 1369/2077 symbols completed. OGN took 1.2s. Estimated remaining: 4m 37s. Rate: 153.2 symbols/min [2025-09-23T22:24:22.373977] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:22.374737] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-09-23T22:24:22.374908] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-23T22:24:22.378570] [INFO ] [MAIN ] Derivative Progress: 1370/2077 symbols completed. OGS took 1.1s. Estimated remaining: 4m 37s. Rate: 153.3 symbols/min [2025-09-23T22:24:22.389972] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:22.395306] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-09-23T22:24:22.395495] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-23T22:24:22.398154] [INFO ] [MAIN ] Derivative Progress: 1371/2077 symbols completed. OHI took 1.1s. Estimated remaining: 4m 36s. Rate: 153.4 symbols/min [2025-09-23T22:24:22.398464] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:22.411133] [DEBUG] [LOCAL ] OIA: Loaded 14010 existing records from primary storage. [2025-09-23T22:24:22.411290] [INFO ] [MAIN ] OIA: Loaded 14010 primary data records. [2025-09-23T22:24:22.650748] [DEBUG] [LOCAL ] OI: Loaded 47375 existing records from primary storage. [2025-09-23T22:24:22.781587] [INFO ] [MAIN ] OI: Loaded 47375 primary data records. [2025-09-23T22:24:22.881371] [DEBUG] [LOCAL ] OII: Loaded 42945 existing records from primary storage. [2025-09-23T22:24:22.898690] [INFO ] [MAIN ] OII: Loaded 42945 primary data records. [2025-09-23T22:24:23.410353] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:23.412220] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 14010 primary records. [2025-09-23T22:24:23.412592] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-23T22:24:23.431821] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-09-23T22:24:23.432150] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-23T22:24:23.434827] [INFO ] [MAIN ] Derivative Progress: 1372/2077 symbols completed. OIA took 1.0s. Estimated remaining: 4m 36s. Rate: 153.2 symbols/min [2025-09-23T22:24:23.435993] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:23.451684] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:23.452578] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47375 primary records. [2025-09-23T22:24:23.452749] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-23T22:24:23.480896] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:23.482167] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 42945 primary records. [2025-09-23T22:24:23.482828] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-23T22:24:23.498523] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-09-23T22:24:23.499633] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-23T22:24:23.502253] [INFO ] [MAIN ] Derivative Progress: 1373/2077 symbols completed. OI took 1.1s. Estimated remaining: 4m 35s. Rate: 153.3 symbols/min [2025-09-23T22:24:23.502752] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:23.517628] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-09-23T22:24:23.517851] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-23T22:24:23.520498] [INFO ] [MAIN ] Derivative Progress: 1374/2077 symbols completed. OII took 1.1s. Estimated remaining: 4m 35s. Rate: 153.4 symbols/min [2025-09-23T22:24:23.520965] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:23.534694] [DEBUG] [LOCAL ] OIS: Loaded 40687 existing records from primary storage. [2025-09-23T22:24:23.534831] [INFO ] [MAIN ] OIS: Loaded 40687 primary data records. [2025-09-23T22:24:23.909735] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-23T22:24:23.910600] [INFO ] [MAIN ] OKE: Loaded 53536 primary data records. [2025-09-23T22:24:24.033771] [DEBUG] [LOCAL ] OLN: Loaded 51742 existing records from primary storage. [2025-09-23T22:24:24.044700] [INFO ] [MAIN ] OLN: Loaded 51742 primary data records. [2025-09-23T22:24:24.623671] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:24.625390] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40687 primary records. [2025-09-23T22:24:24.625664] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-23T22:24:24.648007] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-09-23T22:24:24.648195] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-23T22:24:24.650546] [INFO ] [MAIN ] Derivative Progress: 1375/2077 symbols completed. OIS took 1.2s. Estimated remaining: 4m 35s. Rate: 153.2 symbols/min [2025-09-23T22:24:24.651836] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:24.668373] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:24.669372] [INFO ] [MAIN ] OKE: Generated 1794 derivative records from 53536 primary records. [2025-09-23T22:24:24.671853] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-23T22:24:24.689289] [DEBUG] [LOCAL ] OLP: Loaded 9720 existing records from primary storage. [2025-09-23T22:24:24.689856] [INFO ] [MAIN ] OLP: Loaded 9720 primary data records. [2025-09-23T22:24:24.795116] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:24.814437] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 51742 primary records. [2025-09-23T22:24:24.813794] [DEBUG] [LOCAL ] OKE: Derivative data saved (1794 records). [2025-09-23T22:24:24.814630] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-23T22:24:24.815046] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-23T22:24:24.838726] [INFO ] [MAIN ] Derivative Progress: 1376/2077 symbols completed. OKE took 1.3s. Estimated remaining: 4m 34s. Rate: 153.3 symbols/min [2025-09-23T22:24:24.877918] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:25.041337] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-09-23T22:24:25.041680] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-23T22:24:25.044884] [INFO ] [MAIN ] Derivative Progress: 1377/2077 symbols completed. OLN took 1.5s. Estimated remaining: 4m 34s. Rate: 153.3 symbols/min [2025-09-23T22:24:25.045402] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:25.078485] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:25.079240] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 9720 primary records. [2025-09-23T22:24:25.079560] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-23T22:24:25.131780] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-09-23T22:24:25.132931] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-23T22:24:25.134999] [INFO ] [MAIN ] Derivative Progress: 1378/2077 symbols completed. OLP took 0.5s. Estimated remaining: 4m 33s. Rate: 153.4 symbols/min [2025-09-23T22:24:25.136903] [DEBUG] [LOCAL ] OMC: Loaded 53294 existing records from primary storage. [2025-09-23T22:24:25.137045] [INFO ] [MAIN ] OMC: Loaded 53294 primary data records. [2025-09-23T22:24:25.244290] [DEBUG] [LOCAL ] OMF: Loaded 46272 existing records from primary storage. [2025-09-23T22:24:25.255214] [INFO ] [MAIN ] OMF: Loaded 46272 primary data records. [2025-09-23T22:24:25.783731] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:25.784722] [INFO ] [MAIN ] OMC: Generated 1794 derivative records from 53294 primary records. [2025-09-23T22:24:25.784824] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-23T22:24:25.801357] [DEBUG] [LOCAL ] OMC: Derivative data saved (1794 records). [2025-09-23T22:24:25.802795] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-23T22:24:25.805329] [INFO ] [MAIN ] Derivative Progress: 1379/2077 symbols completed. OMC took 0.9s. Estimated remaining: 4m 33s. Rate: 153.3 symbols/min [2025-09-23T22:24:25.818679] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:25.819388] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46272 primary records. [2025-09-23T22:24:25.819450] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-23T22:24:25.835311] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-09-23T22:24:25.835379] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-23T22:24:25.837378] [INFO ] [MAIN ] Derivative Progress: 1380/2077 symbols completed. OMF took 0.8s. Estimated remaining: 4m 33s. Rate: 153.4 symbols/min [2025-09-23T22:24:25.838179] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:25.837978] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:25.838126] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:25.849206] [DEBUG] [LOCAL ] ONIT: Loaded 7783 existing records from primary storage. [2025-09-23T22:24:25.849343] [INFO ] [MAIN ] ONIT: Loaded 7783 primary data records. [2025-09-23T22:24:26.075143] [DEBUG] [LOCAL ] ONL: Loaded 31829 existing records from primary storage. [2025-09-23T22:24:26.172752] [INFO ] [MAIN ] ONL: Loaded 31829 primary data records. [2025-09-23T22:24:26.204290] [DEBUG] [LOCAL ] OMI: Loaded 45856 existing records from primary storage. [2025-09-23T22:24:26.219091] [INFO ] [MAIN ] OMI: Loaded 45856 primary data records. [2025-09-23T22:24:26.966450] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:26.968399] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7783 primary records. [2025-09-23T22:24:26.969308] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-23T22:24:26.991338] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-09-23T22:24:26.992299] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-23T22:24:26.997368] [INFO ] [MAIN ] Derivative Progress: 1381/2077 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 33s. Rate: 153.2 symbols/min [2025-09-23T22:24:26.998273] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:27.035819] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:27.035353] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:27.037487] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 45856 primary records. [2025-09-23T22:24:27.036677] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 31829 primary records. [2025-09-23T22:24:27.037771] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-23T22:24:27.037694] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-23T22:24:27.079005] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-09-23T22:24:27.079110] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-09-23T22:24:27.095440] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-23T22:24:27.095321] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-23T22:24:27.097361] [INFO ] [MAIN ] Derivative Progress: 1382/2077 symbols completed. OMI took 1.3s. Estimated remaining: 4m 32s. Rate: 153.3 symbols/min [2025-09-23T22:24:27.100664] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:27.100921] [INFO ] [MAIN ] Derivative Progress: 1383/2077 symbols completed. ONL took 1.3s. Estimated remaining: 4m 31s. Rate: 153.4 symbols/min [2025-09-23T22:24:27.101681] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:27.122853] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-09-23T22:24:27.123153] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-09-23T22:24:27.257600] [DEBUG] [LOCAL ] ONTF: Loaded 23025 existing records from primary storage. [2025-09-23T22:24:27.297372] [INFO ] [MAIN ] ONTF: Loaded 23025 primary data records. [2025-09-23T22:24:27.526847] [DEBUG] [LOCAL ] ONTO: Loaded 46626 existing records from primary storage. [2025-09-23T22:24:27.537772] [INFO ] [MAIN ] ONTO: Loaded 46626 primary data records. [2025-09-23T22:24:28.222141] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:28.222428] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:28.223246] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 23025 primary records. [2025-09-23T22:24:28.223532] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-23T22:24:28.225266] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53613 primary records. [2025-09-23T22:24:28.225391] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-23T22:24:28.268630] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-09-23T22:24:28.274965] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-23T22:24:28.275051] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-09-23T22:24:28.277027] [INFO ] [MAIN ] Derivative Progress: 1384/2077 symbols completed. ONON took 1.3s. Estimated remaining: 4m 31s. Rate: 153.2 symbols/min [2025-09-23T22:24:28.274880] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:28.277178] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-23T22:24:28.278005] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 46626 primary records. [2025-09-23T22:24:28.278349] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:28.278134] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-23T22:24:28.280695] [INFO ] [MAIN ] Derivative Progress: 1385/2077 symbols completed. ONTF took 1.2s. Estimated remaining: 4m 31s. Rate: 153.3 symbols/min [2025-09-23T22:24:28.281467] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:28.301250] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-09-23T22:24:28.305921] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-23T22:24:28.312912] [INFO ] [MAIN ] Derivative Progress: 1386/2077 symbols completed. ONTO took 1.2s. Estimated remaining: 4m 30s. Rate: 153.4 symbols/min [2025-09-23T22:24:28.313264] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:28.329146] [DEBUG] [LOCAL ] OOMA: Loaded 19147 existing records from primary storage. [2025-09-23T22:24:28.329507] [DEBUG] [LOCAL ] OPAD: Loaded 19745 existing records from primary storage. [2025-09-23T22:24:28.329738] [INFO ] [MAIN ] OPAD: Loaded 19745 primary data records. [2025-09-23T22:24:28.329898] [INFO ] [MAIN ] OOMA: Loaded 19147 primary data records. [2025-09-23T22:24:29.048309] [DEBUG] [LOCAL ] OPFI: Loaded 46651 existing records from primary storage. [2025-09-23T22:24:29.048762] [INFO ] [MAIN ] OPFI: Loaded 46651 primary data records. [2025-09-23T22:24:29.392231] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:29.395158] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 19147 primary records. [2025-09-23T22:24:29.395513] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-23T22:24:29.423998] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:24:29.425366] [INFO ] [MAIN ] OPAD: Generated 1793 derivative records from 19745 primary records. [2025-09-23T22:24:29.425860] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-23T22:24:29.443112] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-09-23T22:24:29.443846] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-23T22:24:29.447371] [INFO ] [MAIN ] Derivative Progress: 1387/2077 symbols completed. OOMA took 1.2s. Estimated remaining: 4m 30s. Rate: 153.2 symbols/min [2025-09-23T22:24:29.448974] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:29.454440] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1793 records). [2025-09-23T22:24:29.454707] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-23T22:24:29.457466] [INFO ] [MAIN ] Derivative Progress: 1388/2077 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 30s. Rate: 153.3 symbols/min [2025-09-23T22:24:29.458147] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:29.472032] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:29.473171] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46651 primary records. [2025-09-23T22:24:29.473453] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-23T22:24:29.494700] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-09-23T22:24:29.494984] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-23T22:24:29.498263] [INFO ] [MAIN ] Derivative Progress: 1389/2077 symbols completed. OPFI took 1.2s. Estimated remaining: 4m 29s. Rate: 153.4 symbols/min [2025-09-23T22:24:29.498816] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:29.536829] [DEBUG] [LOCAL ] ORA: Loaded 32612 existing records from primary storage. [2025-09-23T22:24:29.550506] [INFO ] [MAIN ] ORA: Loaded 32612 primary data records. [2025-09-23T22:24:29.556750] [DEBUG] [LOCAL ] OR: Loaded 45995 existing records from primary storage. [2025-09-23T22:24:29.598715] [INFO ] [MAIN ] OR: Loaded 45995 primary data records. [2025-09-23T22:24:29.896462] [DEBUG] [LOCAL ] ORC: Loaded 52307 existing records from primary storage. [2025-09-23T22:24:29.931587] [INFO ] [MAIN ] ORC: Loaded 52307 primary data records. [2025-09-23T22:24:30.616981] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:30.620925] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 45995 primary records. [2025-09-23T22:24:30.622387] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-23T22:24:30.653841] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:30.655508] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 32612 primary records. [2025-09-23T22:24:30.670094] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:30.671473] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52307 primary records. [2025-09-23T22:24:30.663741] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-23T22:24:30.672006] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-23T22:24:30.674418] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-09-23T22:24:30.675046] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-23T22:24:30.678071] [INFO ] [MAIN ] Derivative Progress: 1390/2077 symbols completed. OR took 1.2s. Estimated remaining: 4m 29s. Rate: 153.2 symbols/min [2025-09-23T22:24:30.679131] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:30.710638] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-09-23T22:24:30.711204] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-09-23T22:24:30.711327] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-23T22:24:30.711440] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-23T22:24:30.713863] [INFO ] [MAIN ] Derivative Progress: 1391/2077 symbols completed. ORC took 1.2s. Estimated remaining: 4m 29s. Rate: 153.3 symbols/min [2025-09-23T22:24:30.719095] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:30.719187] [INFO ] [MAIN ] Derivative Progress: 1392/2077 symbols completed. ORA took 1.3s. Estimated remaining: 4m 28s. Rate: 153.4 symbols/min [2025-09-23T22:24:30.720023] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:30.744195] [DEBUG] [LOCAL ] ORN: Loaded 31707 existing records from primary storage. [2025-09-23T22:24:30.744427] [INFO ] [MAIN ] ORN: Loaded 31707 primary data records. [2025-09-23T22:24:31.154290] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-23T22:24:31.155114] [INFO ] [MAIN ] OSCR: Loaded 53722 primary data records. [2025-09-23T22:24:31.253927] [DEBUG] [LOCAL ] OTIS: Loaded 52712 existing records from primary storage. [2025-09-23T22:24:31.266307] [INFO ] [MAIN ] OTIS: Loaded 52712 primary data records. [2025-09-23T22:24:31.853587] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:31.856522] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 31707 primary records. [2025-09-23T22:24:31.857294] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-23T22:24:31.893483] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:31.897084] [INFO ] [MAIN ] OSCR: Generated 1794 derivative records from 53722 primary records. [2025-09-23T22:24:31.897627] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-23T22:24:31.920318] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-09-23T22:24:31.921202] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-23T22:24:31.936981] [INFO ] [MAIN ] Derivative Progress: 1393/2077 symbols completed. ORN took 1.3s. Estimated remaining: 4m 28s. Rate: 153.2 symbols/min [2025-09-23T22:24:31.938632] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:31.940094] [INFO ] [MAIN ] OTIS: Generated 1794 derivative records from 52712 primary records. [2025-09-23T22:24:31.940710] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-23T22:24:31.941393] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1794 records). [2025-09-23T22:24:31.942166] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-23T22:24:31.943964] [INFO ] [MAIN ] Derivative Progress: 1394/2077 symbols completed. OSCR took 1.2s. Estimated remaining: 4m 27s. Rate: 153.3 symbols/min [2025-09-23T22:24:31.959705] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1794 records). [2025-09-23T22:24:31.959810] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-23T22:24:31.962328] [INFO ] [MAIN ] Derivative Progress: 1395/2077 symbols completed. OTIS took 1.2s. Estimated remaining: 4m 27s. Rate: 153.4 symbols/min [2025-09-23T22:24:31.963343] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:31.964144] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:31.963561] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:32.054355] [DEBUG] [LOCAL ] OVV: Loaded 53516 existing records from primary storage. [2025-09-23T22:24:32.055228] [INFO ] [MAIN ] OVV: Loaded 53516 primary data records. [2025-09-23T22:24:32.121957] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-23T22:24:32.158041] [INFO ] [MAIN ] OWL: Loaded 53555 primary data records. [2025-09-23T22:24:32.197407] [DEBUG] [LOCAL ] OUT: Loaded 48091 existing records from primary storage. [2025-09-23T22:24:32.267214] [INFO ] [MAIN ] OUT: Loaded 48091 primary data records. [2025-09-23T22:24:33.095571] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:33.096989] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53516 primary records. [2025-09-23T22:24:33.097336] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:33.097838] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-23T22:24:33.099448] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53555 primary records. [2025-09-23T22:24:33.106934] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-23T22:24:33.143737] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:33.150035] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 48091 primary records. [2025-09-23T22:24:33.150812] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-23T22:24:33.152079] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-09-23T22:24:33.152939] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-23T22:24:33.155997] [INFO ] [MAIN ] Derivative Progress: 1396/2077 symbols completed. OVV took 1.2s. Estimated remaining: 4m 27s. Rate: 153.1 symbols/min [2025-09-23T22:24:33.163737] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:33.177913] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-09-23T22:24:33.178151] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-23T22:24:33.183008] [INFO ] [MAIN ] Derivative Progress: 1397/2077 symbols completed. OWL took 1.2s. Estimated remaining: 4m 26s. Rate: 153.2 symbols/min [2025-09-23T22:24:33.175034] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-09-23T22:24:33.183290] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:33.183575] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-23T22:24:33.187299] [INFO ] [MAIN ] Derivative Progress: 1398/2077 symbols completed. OUT took 1.2s. Estimated remaining: 4m 26s. Rate: 153.4 symbols/min [2025-09-23T22:24:33.187773] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:33.195122] [DEBUG] [LOCAL ] OWLT: Loaded 8989 existing records from primary storage. [2025-09-23T22:24:33.195283] [INFO ] [MAIN ] OWLT: Loaded 8989 primary data records. [2025-09-23T22:24:33.564670] [DEBUG] [LOCAL ] OXM: Loaded 33516 existing records from primary storage. [2025-09-23T22:24:33.565913] [INFO ] [MAIN ] OXM: Loaded 33516 primary data records. [2025-09-23T22:24:33.696016] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-23T22:24:33.717405] [INFO ] [MAIN ] PAAS: Loaded 53603 primary data records. [2025-09-23T22:24:34.232358] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:34.234550] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 8989 primary records. [2025-09-23T22:24:34.235139] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-23T22:24:34.256334] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-09-23T22:24:34.268949] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-23T22:24:34.271413] [INFO ] [MAIN ] Derivative Progress: 1399/2077 symbols completed. OWLT took 1.1s. Estimated remaining: 4m 26s. Rate: 153.2 symbols/min [2025-09-23T22:24:34.271853] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:34.272290] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:34.273133] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33516 primary records. [2025-09-23T22:24:34.273517] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-23T22:24:34.302746] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-09-23T22:24:34.303571] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-23T22:24:34.302183] [DEBUG] [LOCAL ] PAC: Loaded 11545 existing records from primary storage. [2025-09-23T22:24:34.305921] [INFO ] [MAIN ] Derivative Progress: 1400/2077 symbols completed. OXM took 1.1s. Estimated remaining: 4m 25s. Rate: 153.3 symbols/min [2025-09-23T22:24:34.306491] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:34.306217] [INFO ] [MAIN ] PAC: Loaded 11545 primary data records. [2025-09-23T22:24:34.325539] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:34.343027] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53603 primary records. [2025-09-23T22:24:34.376825] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-23T22:24:34.483403] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-09-23T22:24:34.552603] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-23T22:24:34.665519] [INFO ] [MAIN ] Derivative Progress: 1401/2077 symbols completed. PAAS took 1.5s. Estimated remaining: 4m 25s. Rate: 153.3 symbols/min [2025-09-23T22:24:34.681439] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:34.680396] [DEBUG] [LOCAL ] PACK: Loaded 32065 existing records from primary storage. [2025-09-23T22:24:34.681631] [INFO ] [MAIN ] PACK: Loaded 32065 primary data records. [2025-09-23T22:24:35.055231] [DEBUG] [LOCAL ] PACS: Loaded 34079 existing records from primary storage. [2025-09-23T22:24:35.055698] [INFO ] [MAIN ] PACS: Loaded 34079 primary data records. [2025-09-23T22:24:35.184945] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:24:35.202401] [INFO ] [MAIN ] PAC: Generated 1793 derivative records from 11545 primary records. [2025-09-23T22:24:35.220603] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-23T22:24:35.448708] [DEBUG] [LOCAL ] PAC: Derivative data saved (1793 records). [2025-09-23T22:24:35.449179] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-23T22:24:35.451886] [INFO ] [MAIN ] Derivative Progress: 1402/2077 symbols completed. PAC took 1.2s. Estimated remaining: 4m 24s. Rate: 153.2 symbols/min [2025-09-23T22:24:35.452374] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:35.467788] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:35.469386] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 32065 primary records. [2025-09-23T22:24:35.471122] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-23T22:24:35.498459] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-09-23T22:24:35.506409] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-23T22:24:35.509487] [INFO ] [MAIN ] Derivative Progress: 1403/2077 symbols completed. PACK took 1.2s. Estimated remaining: 4m 24s. Rate: 153.3 symbols/min [2025-09-23T22:24:35.506282] [DEBUG] [LOCAL ] PAG: Loaded 21938 existing records from primary storage. [2025-09-23T22:24:35.510047] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:35.518150] [INFO ] [MAIN ] PAG: Loaded 21938 primary data records. [2025-09-23T22:24:35.556905] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:35.594441] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 34079 primary records. [2025-09-23T22:24:35.622433] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-23T22:24:35.864488] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-09-23T22:24:35.866428] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-23T22:24:35.869336] [INFO ] [MAIN ] Derivative Progress: 1404/2077 symbols completed. PACS took 1.2s. Estimated remaining: 4m 23s. Rate: 153.3 symbols/min [2025-09-23T22:24:35.870432] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:35.891331] [DEBUG] [LOCAL ] PAGS: Loaded 52684 existing records from primary storage. [2025-09-23T22:24:35.894357] [DEBUG] [LOCAL ] PAI: Loaded 2707 existing records from primary storage. [2025-09-23T22:24:35.894626] [INFO ] [MAIN ] PAI: Loaded 2707 primary data records. [2025-09-23T22:24:35.894555] [INFO ] [MAIN ] PAGS: Loaded 52684 primary data records. [2025-09-23T22:24:36.526064] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:36.527623] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 21938 primary records. [2025-09-23T22:24:36.527814] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-23T22:24:36.548872] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-09-23T22:24:36.549742] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-23T22:24:36.551974] [INFO ] [MAIN ] Derivative Progress: 1405/2077 symbols completed. PAG took 1.1s. Estimated remaining: 4m 23s. Rate: 153.2 symbols/min [2025-09-23T22:24:36.552543] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:36.578043] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:36.586691] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52684 primary records. [2025-09-23T22:24:36.594758] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-23T22:24:36.600432] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:36.601892] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2707 primary records. [2025-09-23T22:24:36.620952] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-23T22:24:36.625270] [DEBUG] [LOCAL ] PAM: Loaded 27935 existing records from primary storage. [2025-09-23T22:24:36.626370] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-09-23T22:24:36.626543] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-23T22:24:36.626467] [INFO ] [MAIN ] PAM: Loaded 27935 primary data records. [2025-09-23T22:24:36.629144] [INFO ] [MAIN ] Derivative Progress: 1406/2077 symbols completed. PAGS took 1.1s. Estimated remaining: 4m 23s. Rate: 153.3 symbols/min [2025-09-23T22:24:36.657608] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:36.773518] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-09-23T22:24:36.809588] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-23T22:24:36.838729] [INFO ] [MAIN ] Derivative Progress: 1407/2077 symbols completed. PAI took 1.0s. Estimated remaining: 4m 22s. Rate: 153.3 symbols/min [2025-09-23T22:24:36.960227] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:36.973325] [DEBUG] [LOCAL ] PAR: Loaded 32612 existing records from primary storage. [2025-09-23T22:24:36.973671] [INFO ] [MAIN ] PAR: Loaded 32612 primary data records. [2025-09-23T22:24:37.352360] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:37.353995] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 27935 primary records. [2025-09-23T22:24:37.354240] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-23T22:24:37.370567] [DEBUG] [LOCAL ] PARR: Loaded 48351 existing records from primary storage. [2025-09-23T22:24:37.378281] [INFO ] [MAIN ] PARR: Loaded 48351 primary data records. [2025-09-23T22:24:37.494892] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-09-23T22:24:37.495244] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-23T22:24:37.497638] [INFO ] [MAIN ] Derivative Progress: 1408/2077 symbols completed. PAM took 0.9s. Estimated remaining: 4m 22s. Rate: 153.2 symbols/min [2025-09-23T22:24:37.593029] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:37.709396] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 32612 primary records. [2025-09-23T22:24:37.709555] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-23T22:24:37.729971] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-09-23T22:24:37.730342] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-23T22:24:37.732386] [INFO ] [MAIN ] Derivative Progress: 1409/2077 symbols completed. PAR took 1.1s. Estimated remaining: 4m 21s. Rate: 153.3 symbols/min [2025-09-23T22:24:37.749943] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:37.750566] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 48351 primary records. [2025-09-23T22:24:37.750626] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-23T22:24:37.766048] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-09-23T22:24:37.766124] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-23T22:24:37.768152] [INFO ] [MAIN ] Derivative Progress: 1410/2077 symbols completed. PARR took 0.8s. Estimated remaining: 4m 21s. Rate: 153.4 symbols/min [2025-09-23T22:24:37.769269] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:37.769087] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:37.769669] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:37.807453] [DEBUG] [LOCAL ] PAXS: Loaded 21016 existing records from primary storage. [2025-09-23T22:24:37.808134] [INFO ] [MAIN ] PAXS: Loaded 21016 primary data records. [2025-09-23T22:24:37.857325] [DEBUG] [LOCAL ] PAY: Loaded 38383 existing records from primary storage. [2025-09-23T22:24:37.877498] [INFO ] [MAIN ] PAY: Loaded 38383 primary data records. [2025-09-23T22:24:38.152639] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-23T22:24:38.178308] [INFO ] [MAIN ] PATH: Loaded 53678 primary data records. [2025-09-23T22:24:38.904091] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:38.911679] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:38.913339] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38383 primary records. [2025-09-23T22:24:38.914182] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 21016 primary records. [2025-09-23T22:24:38.914430] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-23T22:24:38.915503] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-23T22:24:38.949102] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:38.953572] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53678 primary records. [2025-09-23T22:24:38.956769] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-23T22:24:38.960402] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-09-23T22:24:38.968065] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-23T22:24:38.972040] [INFO ] [MAIN ] Derivative Progress: 1411/2077 symbols completed. PAY took 1.2s. Estimated remaining: 4m 21s. Rate: 153.2 symbols/min [2025-09-23T22:24:38.975978] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:38.978670] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-09-23T22:24:38.979185] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-23T22:24:38.981685] [INFO ] [MAIN ] Derivative Progress: 1412/2077 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 20s. Rate: 153.3 symbols/min [2025-09-23T22:24:38.982451] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:38.989974] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-09-23T22:24:38.990112] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-23T22:24:38.992442] [INFO ] [MAIN ] Derivative Progress: 1413/2077 symbols completed. PATH took 1.2s. Estimated remaining: 4m 20s. Rate: 153.4 symbols/min [2025-09-23T22:24:38.992773] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:39.047446] [DEBUG] [LOCAL ] PAYC: Loaded 36312 existing records from primary storage. [2025-09-23T22:24:39.047631] [INFO ] [MAIN ] PAYC: Loaded 36312 primary data records. [2025-09-23T22:24:39.177365] [DEBUG] [LOCAL ] PBA: Loaded 48964 existing records from primary storage. [2025-09-23T22:24:39.183111] [INFO ] [MAIN ] PBA: Loaded 48964 primary data records. [2025-09-23T22:24:39.188800] [DEBUG] [LOCAL ] PB: Loaded 41376 existing records from primary storage. [2025-09-23T22:24:39.199200] [INFO ] [MAIN ] PB: Loaded 41376 primary data records. [2025-09-23T22:24:40.032798] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:40.034122] [INFO ] [MAIN ] PAYC: Generated 1794 derivative records from 36312 primary records. [2025-09-23T22:24:40.034231] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-23T22:24:40.052299] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1794 records). [2025-09-23T22:24:40.052790] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-23T22:24:40.056557] [INFO ] [MAIN ] Derivative Progress: 1414/2077 symbols completed. PAYC took 1.1s. Estimated remaining: 4m 20s. Rate: 153.2 symbols/min [2025-09-23T22:24:40.058612] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:40.087235] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:40.088828] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 48964 primary records. [2025-09-23T22:24:40.087966] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:40.089712] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 41376 primary records. [2025-09-23T22:24:40.089872] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-23T22:24:40.090891] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-23T22:24:40.123664] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-09-23T22:24:40.124092] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-23T22:24:40.126553] [INFO ] [MAIN ] Derivative Progress: 1415/2077 symbols completed. PB took 1.1s. Estimated remaining: 4m 19s. Rate: 153.3 symbols/min [2025-09-23T22:24:40.127105] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:40.128809] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-09-23T22:24:40.129175] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-23T22:24:40.131472] [INFO ] [MAIN ] Derivative Progress: 1416/2077 symbols completed. PBA took 1.1s. Estimated remaining: 4m 19s. Rate: 153.4 symbols/min [2025-09-23T22:24:40.131949] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:40.179563] [DEBUG] [LOCAL ] PBF: Loaded 53092 existing records from primary storage. [2025-09-23T22:24:40.180264] [INFO ] [MAIN ] PBF: Loaded 53092 primary data records. [2025-09-23T22:24:40.265268] [DEBUG] [LOCAL ] PBH: Loaded 31622 existing records from primary storage. [2025-09-23T22:24:40.299521] [INFO ] [MAIN ] PBH: Loaded 31622 primary data records. [2025-09-23T22:24:40.611682] [DEBUG] [LOCAL ] PBI: Loaded 50044 existing records from primary storage. [2025-09-23T22:24:40.633135] [INFO ] [MAIN ] PBI: Loaded 50044 primary data records. [2025-09-23T22:24:41.141868] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:41.143183] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53092 primary records. [2025-09-23T22:24:41.143684] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-23T22:24:41.165030] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-09-23T22:24:41.178367] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:41.177603] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-23T22:24:41.180342] [INFO ] [MAIN ] Derivative Progress: 1417/2077 symbols completed. PBF took 1.1s. Estimated remaining: 4m 18s. Rate: 153.2 symbols/min [2025-09-23T22:24:41.181492] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 31622 primary records. [2025-09-23T22:24:41.181904] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-23T22:24:41.180733] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:41.214484] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:41.214184] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-09-23T22:24:41.215329] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 50044 primary records. [2025-09-23T22:24:41.215487] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-23T22:24:41.215413] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-23T22:24:41.218612] [INFO ] [MAIN ] Derivative Progress: 1418/2077 symbols completed. PBH took 1.1s. Estimated remaining: 4m 18s. Rate: 153.3 symbols/min [2025-09-23T22:24:41.226528] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:41.236453] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-09-23T22:24:41.236773] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-23T22:24:41.239168] [INFO ] [MAIN ] Derivative Progress: 1419/2077 symbols completed. PBI took 1.1s. Estimated remaining: 4m 17s. Rate: 153.4 symbols/min [2025-09-23T22:24:41.243797] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:41.265068] [DEBUG] [LOCAL ] PBT: Loaded 17399 existing records from primary storage. [2025-09-23T22:24:41.265207] [INFO ] [MAIN ] PBT: Loaded 17399 primary data records. [2025-09-23T22:24:41.335717] [DEBUG] [LOCAL ] PCF: Loaded 8660 existing records from primary storage. [2025-09-23T22:24:41.358300] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-09-23T22:24:41.365179] [INFO ] [MAIN ] PBR: Loaded 53713 primary data records. [2025-09-23T22:24:41.365108] [INFO ] [MAIN ] PCF: Loaded 8660 primary data records. [2025-09-23T22:24:42.294888] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:42.290031] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:42.295730] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8660 primary records. [2025-09-23T22:24:42.297116] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17399 primary records. [2025-09-23T22:24:42.297312] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-23T22:24:42.297964] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-23T22:24:42.297899] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:42.300782] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53713 primary records. [2025-09-23T22:24:42.308041] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-23T22:24:42.327631] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-09-23T22:24:42.335263] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-23T22:24:42.342394] [INFO ] [MAIN ] Derivative Progress: 1420/2077 symbols completed. PBT took 1.1s. Estimated remaining: 4m 17s. Rate: 153.2 symbols/min [2025-09-23T22:24:42.343902] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:42.354809] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-09-23T22:24:42.355007] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-23T22:24:42.357447] [INFO ] [MAIN ] Derivative Progress: 1421/2077 symbols completed. PBR took 1.2s. Estimated remaining: 4m 17s. Rate: 153.3 symbols/min [2025-09-23T22:24:42.357944] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-09-23T22:24:42.357840] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:42.358569] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-23T22:24:42.364285] [INFO ] [MAIN ] Derivative Progress: 1422/2077 symbols completed. PCF took 1.1s. Estimated remaining: 4m 16s. Rate: 153.4 symbols/min [2025-09-23T22:24:42.364754] [DEBUG] [LOCAL ] PCM: Loaded 6808 existing records from primary storage. [2025-09-23T22:24:42.365238] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:42.365395] [INFO ] [MAIN ] PCM: Loaded 6808 primary data records. [2025-09-23T22:24:42.581950] [DEBUG] [LOCAL ] PCN: Loaded 24269 existing records from primary storage. [2025-09-23T22:24:42.702606] [INFO ] [MAIN ] PCN: Loaded 24269 primary data records. [2025-09-23T22:24:42.857338] [DEBUG] [LOCAL ] PCOR: Loaded 48183 existing records from primary storage. [2025-09-23T22:24:42.898098] [INFO ] [MAIN ] PCOR: Loaded 48183 primary data records. [2025-09-23T22:24:43.407598] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:43.409162] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6808 primary records. [2025-09-23T22:24:43.409430] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-23T22:24:43.431037] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-09-23T22:24:43.432596] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-23T22:24:43.435502] [INFO ] [MAIN ] Derivative Progress: 1423/2077 symbols completed. PCM took 1.1s. Estimated remaining: 4m 16s. Rate: 153.2 symbols/min [2025-09-23T22:24:43.449109] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:43.449807] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24269 primary records. [2025-09-23T22:24:43.449964] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-23T22:24:43.467182] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-09-23T22:24:43.468045] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-23T22:24:43.470074] [INFO ] [MAIN ] Derivative Progress: 1424/2077 symbols completed. PCN took 1.1s. Estimated remaining: 4m 16s. Rate: 153.3 symbols/min [2025-09-23T22:24:43.483538] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:43.484136] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 48183 primary records. [2025-09-23T22:24:43.484198] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-23T22:24:43.499874] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-09-23T22:24:43.499935] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-23T22:24:43.502617] [INFO ] [MAIN ] Derivative Progress: 1425/2077 symbols completed. PCOR took 1.1s. Estimated remaining: 4m 15s. Rate: 153.4 symbols/min [2025-09-23T22:24:43.503148] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:43.503445] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:43.503385] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:43.521220] [DEBUG] [LOCAL ] PCQ: Loaded 11979 existing records from primary storage. [2025-09-23T22:24:43.521512] [INFO ] [MAIN ] PCQ: Loaded 11979 primary data records. [2025-09-23T22:24:43.887355] [DEBUG] [LOCAL ] PD: Loaded 47890 existing records from primary storage. [2025-09-23T22:24:43.889504] [DEBUG] [LOCAL ] PDI: Loaded 50218 existing records from primary storage. [2025-09-23T22:24:43.888369] [INFO ] [MAIN ] PD: Loaded 47890 primary data records. [2025-09-23T22:24:43.889731] [INFO ] [MAIN ] PDI: Loaded 50218 primary data records. [2025-09-23T22:24:44.540481] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:44.541893] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 11979 primary records. [2025-09-23T22:24:44.542013] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-23T22:24:44.563636] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-09-23T22:24:44.563881] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-23T22:24:44.578905] [INFO ] [MAIN ] Derivative Progress: 1426/2077 symbols completed. PCQ took 1.1s. Estimated remaining: 4m 15s. Rate: 153.2 symbols/min [2025-09-23T22:24:44.579498] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:44.580579] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50218 primary records. [2025-09-23T22:24:44.581841] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:44.581927] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-23T22:24:44.611788] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:44.613747] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 47890 primary records. [2025-09-23T22:24:44.614402] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-23T22:24:44.634140] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-09-23T22:24:44.638070] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-23T22:24:44.639248] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-09-23T22:24:44.641438] [INFO ] [MAIN ] Derivative Progress: 1427/2077 symbols completed. PDI took 1.1s. Estimated remaining: 4m 14s. Rate: 153.3 symbols/min [2025-09-23T22:24:44.639460] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-23T22:24:44.644494] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:44.644132] [INFO ] [MAIN ] Derivative Progress: 1428/2077 symbols completed. PD took 1.1s. Estimated remaining: 4m 14s. Rate: 153.4 symbols/min [2025-09-23T22:24:44.654142] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:44.670155] [DEBUG] [LOCAL ] PDM: Loaded 39851 existing records from primary storage. [2025-09-23T22:24:44.670396] [INFO ] [MAIN ] PDM: Loaded 39851 primary data records. [2025-09-23T22:24:44.809237] [DEBUG] [LOCAL ] PDS: Loaded 18197 existing records from primary storage. [2025-09-23T22:24:44.833096] [INFO ] [MAIN ] PDS: Loaded 18197 primary data records. [2025-09-23T22:24:45.087002] [DEBUG] [LOCAL ] PDO: Loaded 31798 existing records from primary storage. [2025-09-23T22:24:45.099710] [INFO ] [MAIN ] PDO: Loaded 31798 primary data records. [2025-09-23T22:24:45.686140] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:45.687947] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39851 primary records. [2025-09-23T22:24:45.688690] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-23T22:24:45.710326] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-09-23T22:24:45.710684] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-23T22:24:45.712889] [INFO ] [MAIN ] Derivative Progress: 1429/2077 symbols completed. PDM took 1.1s. Estimated remaining: 4m 14s. Rate: 153.2 symbols/min [2025-09-23T22:24:45.714254] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:45.730372] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:45.731398] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 18197 primary records. [2025-09-23T22:24:45.731632] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-23T22:24:45.749130] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-09-23T22:24:45.753115] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-23T22:24:45.756309] [INFO ] [MAIN ] Derivative Progress: 1430/2077 symbols completed. PDS took 1.1s. Estimated remaining: 4m 13s. Rate: 153.3 symbols/min [2025-09-23T22:24:45.757359] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:45.777782] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:45.778145] [DEBUG] [LOCAL ] PDT: Loaded 17267 existing records from primary storage. [2025-09-23T22:24:45.779241] [INFO ] [MAIN ] PDT: Loaded 17267 primary data records. [2025-09-23T22:24:45.779077] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31798 primary records. [2025-09-23T22:24:45.854423] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-23T22:24:45.895115] [DEBUG] [LOCAL ] PDX: Loaded 14342 existing records from primary storage. [2025-09-23T22:24:45.907734] [INFO ] [MAIN ] PDX: Loaded 14342 primary data records. [2025-09-23T22:24:46.210618] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-09-23T22:24:46.221229] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-23T22:24:46.239774] [INFO ] [MAIN ] Derivative Progress: 1431/2077 symbols completed. PDO took 1.6s. Estimated remaining: 4m 13s. Rate: 153.3 symbols/min [2025-09-23T22:24:46.254741] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:46.435489] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:46.436316] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17267 primary records. [2025-09-23T22:24:46.436410] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-23T22:24:46.481196] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-09-23T22:24:46.481794] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-23T22:24:46.481718] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:46.483948] [INFO ] [MAIN ] Derivative Progress: 1432/2077 symbols completed. PDT took 0.8s. Estimated remaining: 4m 12s. Rate: 153.4 symbols/min [2025-09-23T22:24:46.484270] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:46.485587] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14342 primary records. [2025-09-23T22:24:46.486154] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-23T22:24:46.511791] [DEBUG] [LOCAL ] PEB: Loaded 50733 existing records from primary storage. [2025-09-23T22:24:46.515144] [INFO ] [MAIN ] PEB: Loaded 50733 primary data records. [2025-09-23T22:24:46.643859] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-09-23T22:24:46.649975] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-23T22:24:46.662704] [INFO ] [MAIN ] Derivative Progress: 1433/2077 symbols completed. PDX took 0.9s. Estimated remaining: 4m 12s. Rate: 153.4 symbols/min [2025-09-23T22:24:46.649859] [DEBUG] [LOCAL ] PEN: Loaded 30520 existing records from primary storage. [2025-09-23T22:24:46.687582] [INFO ] [MAIN ] PEN: Loaded 30520 primary data records. [2025-09-23T22:24:46.687749] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:47.038962] [DEBUG] [LOCAL ] PEO: Loaded 10835 existing records from primary storage. [2025-09-23T22:24:47.044692] [INFO ] [MAIN ] PEO: Loaded 10835 primary data records. [2025-09-23T22:24:47.535343] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:47.538046] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50733 primary records. [2025-09-23T22:24:47.538568] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-23T22:24:47.560190] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-09-23T22:24:47.560455] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-23T22:24:47.562680] [INFO ] [MAIN ] Derivative Progress: 1434/2077 symbols completed. PEB took 1.3s. Estimated remaining: 4m 12s. Rate: 153.3 symbols/min [2025-09-23T22:24:47.570741] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:47.576534] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:47.577171] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 30520 primary records. [2025-09-23T22:24:47.577499] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-23T22:24:47.606358] [DEBUG] [LOCAL ] PERF: Loaded 14019 existing records from primary storage. [2025-09-23T22:24:47.601390] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-09-23T22:24:47.614165] [INFO ] [MAIN ] PERF: Loaded 14019 primary data records. [2025-09-23T22:24:47.606521] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-23T22:24:47.663214] [INFO ] [MAIN ] Derivative Progress: 1435/2077 symbols completed. PEN took 1.2s. Estimated remaining: 4m 11s. Rate: 153.4 symbols/min [2025-09-23T22:24:47.696753] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:47.675908] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:47.713462] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 10835 primary records. [2025-09-23T22:24:47.724699] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-23T22:24:47.928025] [DEBUG] [LOCAL ] PFD: Loaded 5136 existing records from primary storage. [2025-09-23T22:24:47.928956] [INFO ] [MAIN ] PFD: Loaded 5136 primary data records. [2025-09-23T22:24:47.994198] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-09-23T22:24:48.020896] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-23T22:24:48.057051] [INFO ] [MAIN ] Derivative Progress: 1436/2077 symbols completed. PEO took 1.4s. Estimated remaining: 4m 11s. Rate: 153.4 symbols/min [2025-09-23T22:24:48.058256] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:48.274771] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:48.275806] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14019 primary records. [2025-09-23T22:24:48.276026] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-23T22:24:48.306925] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-09-23T22:24:48.307245] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-23T22:24:48.329254] [INFO ] [MAIN ] Derivative Progress: 1437/2077 symbols completed. PERF took 0.8s. Estimated remaining: 4m 10s. Rate: 153.4 symbols/min [2025-09-23T22:24:48.335239] [DEBUG] [LOCAL ] PFGC: Loaded 46970 existing records from primary storage. [2025-09-23T22:24:48.334360] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:48.335576] [INFO ] [MAIN ] PFGC: Loaded 46970 primary data records. [2025-09-23T22:24:48.336512] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:48.336427] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5136 primary records. [2025-09-23T22:24:48.367903] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-23T22:24:48.458355] [DEBUG] [LOCAL ] PFH: Loaded 6888 existing records from primary storage. [2025-09-23T22:24:48.470441] [INFO ] [MAIN ] PFH: Loaded 6888 primary data records. [2025-09-23T22:24:48.614028] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-09-23T22:24:48.624510] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-23T22:24:48.627140] [INFO ] [MAIN ] Derivative Progress: 1438/2077 symbols completed. PFD took 1.0s. Estimated remaining: 4m 10s. Rate: 153.4 symbols/min [2025-09-23T22:24:48.980069] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:48.980880] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 46970 primary records. [2025-09-23T22:24:48.981030] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-23T22:24:48.997583] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-09-23T22:24:48.998433] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-23T22:24:49.001388] [INFO ] [MAIN ] Derivative Progress: 1439/2077 symbols completed. PFGC took 0.9s. Estimated remaining: 4m 10s. Rate: 153.4 symbols/min [2025-09-23T22:24:49.014769] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:49.015319] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6888 primary records. [2025-09-23T22:24:49.015377] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-23T22:24:49.030310] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-09-23T22:24:49.030368] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-23T22:24:49.032495] [INFO ] [MAIN ] Derivative Progress: 1440/2077 symbols completed. PFH took 0.7s. Estimated remaining: 4m 9s. Rate: 153.5 symbols/min [2025-09-23T22:24:49.033381] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:49.033331] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:49.033553] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:49.057684] [DEBUG] [LOCAL ] PFL: Loaded 13823 existing records from primary storage. [2025-09-23T22:24:49.057912] [INFO ] [MAIN ] PFL: Loaded 13823 primary data records. [2025-09-23T22:24:49.122985] [DEBUG] [LOCAL ] PFN: Loaded 21604 existing records from primary storage. [2025-09-23T22:24:49.137354] [INFO ] [MAIN ] PFN: Loaded 21604 primary data records. [2025-09-23T22:24:49.408525] [DEBUG] [LOCAL ] PFLT: Loaded 43594 existing records from primary storage. [2025-09-23T22:24:49.584577] [INFO ] [MAIN ] PFLT: Loaded 43594 primary data records. [2025-09-23T22:24:50.084082] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:50.098358] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 21604 primary records. [2025-09-23T22:24:50.099326] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:50.100230] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-23T22:24:50.101003] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13823 primary records. [2025-09-23T22:24:50.102160] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-23T22:24:50.134898] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-09-23T22:24:50.136892] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-23T22:24:50.137857] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-09-23T22:24:50.142232] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-23T22:24:50.141211] [INFO ] [MAIN ] Derivative Progress: 1441/2077 symbols completed. PFL took 1.1s. Estimated remaining: 4m 9s. Rate: 153.3 symbols/min [2025-09-23T22:24:50.145397] [INFO ] [MAIN ] Derivative Progress: 1442/2077 symbols completed. PFN took 1.1s. Estimated remaining: 4m 8s. Rate: 153.4 symbols/min [2025-09-23T22:24:50.145300] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:50.145929] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:50.160496] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:50.161761] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 43594 primary records. [2025-09-23T22:24:50.162094] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-23T22:24:50.182779] [DEBUG] [LOCAL ] PFO: Loaded 5868 existing records from primary storage. [2025-09-23T22:24:50.183788] [INFO ] [MAIN ] PFO: Loaded 5868 primary data records. [2025-09-23T22:24:50.234200] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-09-23T22:24:50.272340] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-23T22:24:50.308172] [INFO ] [MAIN ] Derivative Progress: 1443/2077 symbols completed. PFLT took 1.3s. Estimated remaining: 4m 8s. Rate: 153.5 symbols/min [2025-09-23T22:24:50.323579] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:50.324592] [DEBUG] [LOCAL ] PFS: Loaded 35755 existing records from primary storage. [2025-09-23T22:24:50.330464] [INFO ] [MAIN ] PFS: Loaded 35755 primary data records. [2025-09-23T22:24:50.861570] [DEBUG] [LOCAL ] PFSI: Loaded 28853 existing records from primary storage. [2025-09-23T22:24:50.862962] [INFO ] [MAIN ] PFSI: Loaded 28853 primary data records. [2025-09-23T22:24:51.246783] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:51.249822] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 5868 primary records. [2025-09-23T22:24:51.250210] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-23T22:24:51.272772] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:51.275727] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35755 primary records. [2025-09-23T22:24:51.276018] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-23T22:24:51.283569] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-09-23T22:24:51.283998] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-23T22:24:51.286366] [INFO ] [MAIN ] Derivative Progress: 1444/2077 symbols completed. PFO took 1.1s. Estimated remaining: 4m 8s. Rate: 153.3 symbols/min [2025-09-23T22:24:51.287317] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:51.322179] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:51.325308] [DEBUG] [LOCAL ] PGP: Loaded 5468 existing records from primary storage. [2025-09-23T22:24:51.326483] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-09-23T22:24:51.326621] [INFO ] [MAIN ] PGP: Loaded 5468 primary data records. [2025-09-23T22:24:51.327462] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 28853 primary records. [2025-09-23T22:24:51.339104] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-23T22:24:51.339008] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-23T22:24:51.362072] [INFO ] [MAIN ] Derivative Progress: 1445/2077 symbols completed. PFS took 1.2s. Estimated remaining: 4m 7s. Rate: 153.4 symbols/min [2025-09-23T22:24:51.375115] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:51.646611] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-09-23T22:24:51.665547] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-23T22:24:51.668085] [INFO ] [MAIN ] Derivative Progress: 1446/2077 symbols completed. PFSI took 1.3s. Estimated remaining: 4m 7s. Rate: 153.4 symbols/min [2025-09-23T22:24:51.668685] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:51.689224] [DEBUG] [LOCAL ] PGRE: Loaded 46370 existing records from primary storage. [2025-09-23T22:24:51.690605] [INFO ] [MAIN ] PGRE: Loaded 46370 primary data records. [2025-09-23T22:24:51.693810] [DEBUG] [LOCAL ] PGZ: Loaded 5388 existing records from primary storage. [2025-09-23T22:24:51.693941] [INFO ] [MAIN ] PGZ: Loaded 5388 primary data records. [2025-09-23T22:24:52.354083] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:52.355457] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5468 primary records. [2025-09-23T22:24:52.355610] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-23T22:24:52.376063] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-09-23T22:24:52.376626] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-23T22:24:52.379026] [INFO ] [MAIN ] Derivative Progress: 1447/2077 symbols completed. PGP took 1.1s. Estimated remaining: 4m 6s. Rate: 153.4 symbols/min [2025-09-23T22:24:52.379734] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:52.400602] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:52.401339] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46370 primary records. [2025-09-23T22:24:52.401602] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-23T22:24:52.429378] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:52.430835] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5388 primary records. [2025-09-23T22:24:52.431383] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-23T22:24:52.452930] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-09-23T22:24:52.453762] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-23T22:24:52.456138] [INFO ] [MAIN ] Derivative Progress: 1448/2077 symbols completed. PGRE took 1.1s. Estimated remaining: 4m 6s. Rate: 153.4 symbols/min [2025-09-23T22:24:52.457255] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:52.461793] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-09-23T22:24:52.475565] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-23T22:24:52.477956] [INFO ] [MAIN ] Derivative Progress: 1449/2077 symbols completed. PGZ took 0.8s. Estimated remaining: 4m 5s. Rate: 153.5 symbols/min [2025-09-23T22:24:52.478910] [DEBUG] [LOCAL ] PH: Loaded 38934 existing records from primary storage. [2025-09-23T22:24:52.479111] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:52.479239] [INFO ] [MAIN ] PH: Loaded 38934 primary data records. [2025-09-23T22:24:52.547942] [DEBUG] [LOCAL ] PHD: Loaded 9688 existing records from primary storage. [2025-09-23T22:24:52.578196] [INFO ] [MAIN ] PHD: Loaded 9688 primary data records. [2025-09-23T22:24:53.117809] [DEBUG] [LOCAL ] PHG: Loaded 46196 existing records from primary storage. [2025-09-23T22:24:53.118958] [INFO ] [MAIN ] PHG: Loaded 46196 primary data records. [2025-09-23T22:24:53.492142] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:53.505749] [INFO ] [MAIN ] PH: Generated 1794 derivative records from 38934 primary records. [2025-09-23T22:24:53.506244] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-23T22:24:53.506683] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:53.508275] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 9688 primary records. [2025-09-23T22:24:53.508601] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-23T22:24:53.541296] [DEBUG] [LOCAL ] PH: Derivative data saved (1794 records). [2025-09-23T22:24:53.542138] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-09-23T22:24:53.542427] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-23T22:24:53.542357] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-23T22:24:53.544804] [INFO ] [MAIN ] Derivative Progress: 1450/2077 symbols completed. PHD took 1.1s. Estimated remaining: 4m 5s. Rate: 153.4 symbols/min [2025-09-23T22:24:53.547514] [INFO ] [MAIN ] Derivative Progress: 1451/2077 symbols completed. PH took 1.2s. Estimated remaining: 4m 5s. Rate: 153.5 symbols/min [2025-09-23T22:24:53.547695] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:53.548011] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:53.565145] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:53.565835] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 46196 primary records. [2025-09-23T22:24:53.565945] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-23T22:24:53.604382] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-09-23T22:24:53.597119] [DEBUG] [LOCAL ] PHI: Loaded 14960 existing records from primary storage. [2025-09-23T22:24:53.604744] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-23T22:24:53.604631] [INFO ] [MAIN ] PHI: Loaded 14960 primary data records. [2025-09-23T22:24:53.607084] [INFO ] [MAIN ] Derivative Progress: 1452/2077 symbols completed. PHG took 1.1s. Estimated remaining: 4m 4s. Rate: 153.5 symbols/min [2025-09-23T22:24:53.612826] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:53.743702] [DEBUG] [LOCAL ] PHIN: Loaded 33279 existing records from primary storage. [2025-09-23T22:24:53.747712] [INFO ] [MAIN ] PHIN: Loaded 33279 primary data records. [2025-09-23T22:24:53.947902] [DEBUG] [LOCAL ] PHK: Loaded 26466 existing records from primary storage. [2025-09-23T22:24:54.064811] [INFO ] [MAIN ] PHK: Loaded 26466 primary data records. [2025-09-23T22:24:54.623584] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:54.624530] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 14960 primary records. [2025-09-23T22:24:54.624721] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-23T22:24:54.658011] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-09-23T22:24:54.657597] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:54.658765] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 33279 primary records. [2025-09-23T22:24:54.659096] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-23T22:24:54.661534] [INFO ] [MAIN ] Derivative Progress: 1453/2077 symbols completed. PHI took 1.1s. Estimated remaining: 4m 4s. Rate: 153.4 symbols/min [2025-09-23T22:24:54.659037] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-23T22:24:54.692699] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:54.694022] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-09-23T22:24:54.694123] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-23T22:24:54.696310] [INFO ] [MAIN ] Derivative Progress: 1454/2077 symbols completed. PHIN took 1.1s. Estimated remaining: 4m 4s. Rate: 153.5 symbols/min [2025-09-23T22:24:54.693762] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26466 primary records. [2025-09-23T22:24:54.696549] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-23T22:24:54.711799] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-09-23T22:24:54.711861] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-23T22:24:54.714272] [INFO ] [MAIN ] Derivative Progress: 1455/2077 symbols completed. PHK took 1.1s. Estimated remaining: 4m 3s. Rate: 153.6 symbols/min [2025-09-23T22:24:54.715147] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:54.715254] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:54.715098] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:54.732864] [DEBUG] [LOCAL ] PHT: Loaded 15501 existing records from primary storage. [2025-09-23T22:24:54.733199] [INFO ] [MAIN ] PHT: Loaded 15501 primary data records. [2025-09-23T22:24:54.959302] [DEBUG] [LOCAL ] PHR: Loaded 37465 existing records from primary storage. [2025-09-23T22:24:55.066453] [INFO ] [MAIN ] PHR: Loaded 37465 primary data records. [2025-09-23T22:24:55.066369] [DEBUG] [LOCAL ] PII: Loaded 49253 existing records from primary storage. [2025-09-23T22:24:55.066780] [INFO ] [MAIN ] PII: Loaded 49253 primary data records. [2025-09-23T22:24:55.756420] [DEBUG] [MAIN ] PHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:55.757825] [INFO ] [MAIN ] PHT: Generated 1794 derivative records from 15501 primary records. [2025-09-23T22:24:55.758273] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-23T22:24:55.776426] [DEBUG] [LOCAL ] PHT: Derivative data saved (1794 records). [2025-09-23T22:24:55.777540] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-23T22:24:55.780937] [INFO ] [MAIN ] Derivative Progress: 1456/2077 symbols completed. PHT took 1.1s. Estimated remaining: 4m 3s. Rate: 153.4 symbols/min [2025-09-23T22:24:55.784904] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:55.812023] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:55.815144] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 49253 primary records. [2025-09-23T22:24:55.815305] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-23T22:24:55.814215] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:55.816702] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37465 primary records. [2025-09-23T22:24:55.828274] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-23T22:24:55.831245] [DEBUG] [LOCAL ] PIM: Loaded 4751 existing records from primary storage. [2025-09-23T22:24:55.833053] [INFO ] [MAIN ] PIM: Loaded 4751 primary data records. [2025-09-23T22:24:55.848172] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-09-23T22:24:55.873782] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-23T22:24:55.912216] [INFO ] [MAIN ] Derivative Progress: 1457/2077 symbols completed. PII took 1.2s. Estimated remaining: 4m 2s. Rate: 153.5 symbols/min [2025-09-23T22:24:55.946309] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:56.049749] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-09-23T22:24:56.167751] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-23T22:24:56.170334] [INFO ] [MAIN ] Derivative Progress: 1458/2077 symbols completed. PHR took 1.5s. Estimated remaining: 4m 2s. Rate: 153.5 symbols/min [2025-09-23T22:24:56.176512] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:56.178287] [DEBUG] [LOCAL ] PINE: Loaded 14232 existing records from primary storage. [2025-09-23T22:24:56.179241] [INFO ] [MAIN ] PINE: Loaded 14232 primary data records. [2025-09-23T22:24:56.558385] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-23T22:24:56.559850] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:56.559970] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-09-23T22:24:56.561007] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4751 primary records. [2025-09-23T22:24:56.605552] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-23T22:24:56.751973] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-09-23T22:24:56.900941] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-23T22:24:56.904559] [INFO ] [MAIN ] Derivative Progress: 1459/2077 symbols completed. PIM took 1.1s. Estimated remaining: 4m 2s. Rate: 153.4 symbols/min [2025-09-23T22:24:56.918002] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:56.919916] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:56.921196] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14232 primary records. [2025-09-23T22:24:56.921846] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-23T22:24:56.939755] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-09-23T22:24:56.945368] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-23T22:24:56.947894] [INFO ] [MAIN ] Derivative Progress: 1460/2077 symbols completed. PINE took 1.0s. Estimated remaining: 4m 1s. Rate: 153.5 symbols/min [2025-09-23T22:24:56.948595] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:56.956254] [DEBUG] [LOCAL ] PIPR: Loaded 15253 existing records from primary storage. [2025-09-23T22:24:56.956853] [INFO ] [MAIN ] PIPR: Loaded 15253 primary data records. [2025-09-23T22:24:57.099981] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:57.104811] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-09-23T22:24:57.105294] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-23T22:24:57.148805] [DEBUG] [LOCAL ] PJT: Loaded 22543 existing records from primary storage. [2025-09-23T22:24:57.206964] [INFO ] [MAIN ] PJT: Loaded 22543 primary data records. [2025-09-23T22:24:57.212370] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-09-23T22:24:57.378270] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-23T22:24:57.392573] [INFO ] [MAIN ] Derivative Progress: 1461/2077 symbols completed. PINS took 1.2s. Estimated remaining: 4m 1s. Rate: 153.5 symbols/min [2025-09-23T22:24:57.410479] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:57.736957] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:57.752703] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 15253 primary records. [2025-09-23T22:24:57.754796] [DEBUG] [LOCAL ] PK: Loaded 52884 existing records from primary storage. [2025-09-23T22:24:57.755204] [INFO ] [MAIN ] PK: Loaded 52884 primary data records. [2025-09-23T22:24:57.755761] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-23T22:24:57.901156] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:57.914048] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 22543 primary records. [2025-09-23T22:24:57.925504] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-23T22:24:57.948286] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-09-23T22:24:57.956064] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-23T22:24:57.976772] [INFO ] [MAIN ] Derivative Progress: 1462/2077 symbols completed. PIPR took 1.1s. Estimated remaining: 4m 1s. Rate: 153.4 symbols/min [2025-09-23T22:24:58.005551] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:58.010567] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-09-23T22:24:58.059027] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-23T22:24:58.063594] [INFO ] [MAIN ] Derivative Progress: 1463/2077 symbols completed. PJT took 1.1s. Estimated remaining: 3m 60s. Rate: 153.5 symbols/min [2025-09-23T22:24:58.130729] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:58.152229] [DEBUG] [LOCAL ] PKE: Loaded 12563 existing records from primary storage. [2025-09-23T22:24:58.152803] [INFO ] [MAIN ] PKE: Loaded 12563 primary data records. [2025-09-23T22:24:58.481484] [DEBUG] [LOCAL ] PKG: Loaded 39286 existing records from primary storage. [2025-09-23T22:24:58.494882] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:58.496388] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52884 primary records. [2025-09-23T22:24:58.496794] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-23T22:24:58.496599] [INFO ] [MAIN ] PKG: Loaded 39286 primary data records. [2025-09-23T22:24:58.547830] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-09-23T22:24:58.565553] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-23T22:24:58.568127] [INFO ] [MAIN ] Derivative Progress: 1464/2077 symbols completed. PK took 1.2s. Estimated remaining: 3m 60s. Rate: 153.5 symbols/min [2025-09-23T22:24:58.580666] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:58.743751] [DEBUG] [LOCAL ] PKST: Loaded 19320 existing records from primary storage. [2025-09-23T22:24:58.853246] [INFO ] [MAIN ] PKST: Loaded 19320 primary data records. [2025-09-23T22:24:58.899908] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:58.927906] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 12563 primary records. [2025-09-23T22:24:58.928809] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-23T22:24:59.232055] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-09-23T22:24:59.232605] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-23T22:24:59.235119] [INFO ] [MAIN ] Derivative Progress: 1465/2077 symbols completed. PKE took 1.2s. Estimated remaining: 3m 59s. Rate: 153.4 symbols/min [2025-09-23T22:24:59.235773] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:59.256886] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:59.257868] [INFO ] [MAIN ] PKG: Generated 1794 derivative records from 39286 primary records. [2025-09-23T22:24:59.258095] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-23T22:24:59.282113] [DEBUG] [LOCAL ] PKG: Derivative data saved (1794 records). [2025-09-23T22:24:59.282310] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-23T22:24:59.284593] [INFO ] [MAIN ] Derivative Progress: 1466/2077 symbols completed. PKG took 1.2s. Estimated remaining: 3m 59s. Rate: 153.5 symbols/min [2025-09-23T22:24:59.285038] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:24:59.295814] [DEBUG] [LOCAL ] PKX: Loaded 25093 existing records from primary storage. [2025-09-23T22:24:59.296261] [INFO ] [MAIN ] PKX: Loaded 25093 primary data records. [2025-09-23T22:24:59.401960] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:24:59.420206] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 19320 primary records. [2025-09-23T22:24:59.425927] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-23T22:24:59.691455] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-09-23T22:24:59.706067] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-23T22:24:59.709956] [INFO ] [MAIN ] Derivative Progress: 1467/2077 symbols completed. PKST took 1.1s. Estimated remaining: 3m 58s. Rate: 153.5 symbols/min [2025-09-23T22:24:59.711416] [DEBUG] [LOCAL ] PL: Loaded 53113 existing records from primary storage. [2025-09-23T22:24:59.712467] [INFO ] [MAIN ] PL: Loaded 53113 primary data records. [2025-09-23T22:24:59.712231] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:00.086180] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:00.087138] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 25093 primary records. [2025-09-23T22:25:00.087207] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-23T22:25:00.120830] [DEBUG] [LOCAL ] PLD: Loaded 53484 existing records from primary storage. [2025-09-23T22:25:00.121716] [INFO ] [MAIN ] PLD: Loaded 53484 primary data records. [2025-09-23T22:25:00.136594] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-09-23T22:25:00.197861] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-23T22:25:00.217441] [INFO ] [MAIN ] Derivative Progress: 1468/2077 symbols completed. PKX took 1.0s. Estimated remaining: 3m 58s. Rate: 153.5 symbols/min [2025-09-23T22:25:00.451950] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:00.452769] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53113 primary records. [2025-09-23T22:25:00.452942] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-23T22:25:00.471339] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-09-23T22:25:00.471528] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-23T22:25:00.473614] [INFO ] [MAIN ] Derivative Progress: 1469/2077 symbols completed. PL took 1.2s. Estimated remaining: 3m 58s. Rate: 153.5 symbols/min [2025-09-23T22:25:00.492973] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:00.493576] [INFO ] [MAIN ] PLD: Generated 1794 derivative records from 53484 primary records. [2025-09-23T22:25:00.493634] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-23T22:25:00.509697] [DEBUG] [LOCAL ] PLD: Derivative data saved (1794 records). [2025-09-23T22:25:00.509797] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-23T22:25:00.512052] [INFO ] [MAIN ] Derivative Progress: 1470/2077 symbols completed. PLD took 0.8s. Estimated remaining: 3m 57s. Rate: 153.6 symbols/min [2025-09-23T22:25:00.512559] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:00.512723] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:00.512941] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:00.538748] [DEBUG] [LOCAL ] PLOW: Loaded 20551 existing records from primary storage. [2025-09-23T22:25:00.538990] [INFO ] [MAIN ] PLOW: Loaded 20551 primary data records. [2025-09-23T22:25:00.624898] [DEBUG] [LOCAL ] PML: Loaded 20499 existing records from primary storage. [2025-09-23T22:25:00.647959] [INFO ] [MAIN ] PML: Loaded 20499 primary data records. [2025-09-23T22:25:00.726198] [DEBUG] [LOCAL ] PLYM: Loaded 33267 existing records from primary storage. [2025-09-23T22:25:00.756146] [INFO ] [MAIN ] PLYM: Loaded 33267 primary data records. [2025-09-23T22:25:01.625076] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:01.626420] [INFO ] [MAIN ] PLOW: Generated 1794 derivative records from 20551 primary records. [2025-09-23T22:25:01.626892] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-23T22:25:01.661412] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:01.662976] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 20499 primary records. [2025-09-23T22:25:01.663430] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-23T22:25:01.680738] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:01.692619] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1794 records). [2025-09-23T22:25:01.694015] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-23T22:25:01.696705] [INFO ] [MAIN ] Derivative Progress: 1471/2077 symbols completed. PLOW took 1.2s. Estimated remaining: 3m 57s. Rate: 153.4 symbols/min [2025-09-23T22:25:01.694405] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 33267 primary records. [2025-09-23T22:25:01.697910] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:01.698054] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-23T22:25:01.722289] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-09-23T22:25:01.723409] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-23T22:25:01.726448] [INFO ] [MAIN ] Derivative Progress: 1472/2077 symbols completed. PML took 1.2s. Estimated remaining: 3m 57s. Rate: 153.5 symbols/min [2025-09-23T22:25:01.727699] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:01.745860] [DEBUG] [LOCAL ] PMM: Loaded 10568 existing records from primary storage. [2025-09-23T22:25:01.748548] [INFO ] [MAIN ] PMM: Loaded 10568 primary data records. [2025-09-23T22:25:01.745049] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-09-23T22:25:01.782743] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-23T22:25:01.798066] [DEBUG] [LOCAL ] PMO: Loaded 10393 existing records from primary storage. [2025-09-23T22:25:01.817054] [INFO ] [MAIN ] Derivative Progress: 1473/2077 symbols completed. PLYM took 1.3s. Estimated remaining: 3m 56s. Rate: 153.5 symbols/min [2025-09-23T22:25:01.824842] [INFO ] [MAIN ] PMO: Loaded 10393 primary data records. [2025-09-23T22:25:01.844760] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:02.525277] [DEBUG] [LOCAL ] PMT: Loaded 40341 existing records from primary storage. [2025-09-23T22:25:02.526357] [INFO ] [MAIN ] PMT: Loaded 40341 primary data records. [2025-09-23T22:25:02.886541] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:02.887807] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10568 primary records. [2025-09-23T22:25:02.896523] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-23T22:25:02.904228] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:02.905438] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10393 primary records. [2025-09-23T22:25:02.905997] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-23T22:25:02.942586] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-09-23T22:25:02.941876] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-09-23T22:25:02.943177] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-23T22:25:02.943313] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-23T22:25:02.945858] [INFO ] [MAIN ] Derivative Progress: 1474/2077 symbols completed. PMM took 1.2s. Estimated remaining: 3m 56s. Rate: 153.4 symbols/min [2025-09-23T22:25:02.949228] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:02.949722] [INFO ] [MAIN ] Derivative Progress: 1475/2077 symbols completed. PMO took 1.2s. Estimated remaining: 3m 55s. Rate: 153.5 symbols/min [2025-09-23T22:25:02.950307] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:02.977367] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:02.978497] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40341 primary records. [2025-09-23T22:25:02.982490] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-23T22:25:02.982394] [DEBUG] [LOCAL ] PNI: Loaded 6709 existing records from primary storage. [2025-09-23T22:25:02.982807] [INFO ] [MAIN ] PNI: Loaded 6709 primary data records. [2025-09-23T22:25:03.144754] [DEBUG] [LOCAL ] PNNT: Loaded 32872 existing records from primary storage. [2025-09-23T22:25:03.161075] [INFO ] [MAIN ] PNNT: Loaded 32872 primary data records. [2025-09-23T22:25:03.212286] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-09-23T22:25:03.237816] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-23T22:25:03.299864] [INFO ] [MAIN ] Derivative Progress: 1476/2077 symbols completed. PMT took 1.5s. Estimated remaining: 3m 55s. Rate: 153.5 symbols/min [2025-09-23T22:25:03.427090] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:03.760705] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:03.761856] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6709 primary records. [2025-09-23T22:25:03.762865] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-23T22:25:03.811844] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:03.812820] [DEBUG] [LOCAL ] PNW: Loaded 45908 existing records from primary storage. [2025-09-23T22:25:03.814312] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 32872 primary records. [2025-09-23T22:25:03.814785] [INFO ] [MAIN ] PNW: Loaded 45908 primary data records. [2025-09-23T22:25:03.815672] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-23T22:25:03.865282] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-09-23T22:25:03.868486] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-23T22:25:03.872219] [INFO ] [MAIN ] Derivative Progress: 1477/2077 symbols completed. PNI took 0.9s. Estimated remaining: 3m 55s. Rate: 153.4 symbols/min [2025-09-23T22:25:03.873690] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:03.946880] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-09-23T22:25:03.951034] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-23T22:25:03.953413] [INFO ] [MAIN ] Derivative Progress: 1478/2077 symbols completed. PNNT took 1.0s. Estimated remaining: 3m 54s. Rate: 153.5 symbols/min [2025-09-23T22:25:03.975413] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:04.206669] [DEBUG] [LOCAL ] POST: Loaded 38936 existing records from primary storage. [2025-09-23T22:25:04.207682] [INFO ] [MAIN ] POST: Loaded 38936 primary data records. [2025-09-23T22:25:04.581095] [DEBUG] [LOCAL ] PPG: Loaded 50698 existing records from primary storage. [2025-09-23T22:25:04.582553] [INFO ] [MAIN ] PPG: Loaded 50698 primary data records. [2025-09-23T22:25:04.772783] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:04.803495] [INFO ] [MAIN ] PNW: Generated 1794 derivative records from 45908 primary records. [2025-09-23T22:25:04.922511] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-23T22:25:04.957500] [DEBUG] [LOCAL ] PNW: Derivative data saved (1794 records). [2025-09-23T22:25:04.957803] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-23T22:25:04.968004] [INFO ] [MAIN ] Derivative Progress: 1479/2077 symbols completed. PNW took 1.5s. Estimated remaining: 3m 54s. Rate: 153.3 symbols/min [2025-09-23T22:25:04.974711] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:04.975089] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:04.976074] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38936 primary records. [2025-09-23T22:25:04.976311] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-23T22:25:05.004791] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-09-23T22:25:05.017694] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-23T22:25:05.020583] [INFO ] [MAIN ] Derivative Progress: 1480/2077 symbols completed. POST took 1.1s. Estimated remaining: 3m 53s. Rate: 153.4 symbols/min [2025-09-23T22:25:05.021415] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:05.022499] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:05.022238] [INFO ] [MAIN ] PPG: Generated 1794 derivative records from 50698 primary records. [2025-09-23T22:25:05.022845] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-23T22:25:05.045167] [DEBUG] [LOCAL ] PPT: Loaded 20146 existing records from primary storage. [2025-09-23T22:25:05.045801] [INFO ] [MAIN ] PPT: Loaded 20146 primary data records. [2025-09-23T22:25:05.161484] [DEBUG] [LOCAL ] PPG: Derivative data saved (1794 records). [2025-09-23T22:25:05.166195] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-23T22:25:05.169174] [INFO ] [MAIN ] Derivative Progress: 1481/2077 symbols completed. PPG took 1.2s. Estimated remaining: 3m 53s. Rate: 153.5 symbols/min [2025-09-23T22:25:05.176075] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:05.428184] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-23T22:25:05.428873] [INFO ] [MAIN ] PR: Loaded 53609 primary data records. [2025-09-23T22:25:05.552517] [DEBUG] [LOCAL ] PRA: Loaded 34870 existing records from primary storage. [2025-09-23T22:25:05.563054] [INFO ] [MAIN ] PRA: Loaded 34870 primary data records. [2025-09-23T22:25:06.162052] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:06.164502] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 20146 primary records. [2025-09-23T22:25:06.164929] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-23T22:25:06.187559] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-09-23T22:25:06.187898] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-23T22:25:06.190322] [INFO ] [MAIN ] Derivative Progress: 1482/2077 symbols completed. PPT took 1.2s. Estimated remaining: 3m 53s. Rate: 153.3 symbols/min [2025-09-23T22:25:06.203507] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:06.204012] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:06.205050] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53609 primary records. [2025-09-23T22:25:06.205241] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-23T22:25:06.235337] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:06.237181] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34870 primary records. [2025-09-23T22:25:06.237933] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-23T22:25:06.251779] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-09-23T22:25:06.252672] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-23T22:25:06.262297] [INFO ] [MAIN ] Derivative Progress: 1483/2077 symbols completed. PR took 1.2s. Estimated remaining: 3m 52s. Rate: 153.4 symbols/min [2025-09-23T22:25:06.267428] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-09-23T22:25:06.276299] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-23T22:25:06.278921] [INFO ] [MAIN ] Derivative Progress: 1484/2077 symbols completed. PRA took 1.1s. Estimated remaining: 3m 52s. Rate: 153.5 symbols/min [2025-09-23T22:25:06.279855] [DEBUG] [LOCAL ] PRG: Loaded 30129 existing records from primary storage. [2025-09-23T22:25:06.279935] [INFO ] [MAIN ] PRG: Loaded 30129 primary data records. [2025-09-23T22:25:06.607809] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:06.608517] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 30129 primary records. [2025-09-23T22:25:06.608584] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-23T22:25:06.625728] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-09-23T22:25:06.625882] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-23T22:25:06.628103] [INFO ] [MAIN ] Derivative Progress: 1485/2077 symbols completed. PRG took 0.4s. Estimated remaining: 3m 51s. Rate: 153.5 symbols/min [2025-09-23T22:25:06.628619] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:06.629064] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:06.629399] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:06.636783] [DEBUG] [LOCAL ] PRH: Loaded 4901 existing records from primary storage. [2025-09-23T22:25:06.636897] [INFO ] [MAIN ] PRH: Loaded 4901 primary data records. [2025-09-23T22:25:06.824152] [DEBUG] [LOCAL ] PRI: Loaded 18430 existing records from primary storage. [2025-09-23T22:25:06.857679] [INFO ] [MAIN ] PRI: Loaded 18430 primary data records. [2025-09-23T22:25:07.129540] [DEBUG] [LOCAL ] PRGO: Loaded 46900 existing records from primary storage. [2025-09-23T22:25:07.141231] [INFO ] [MAIN ] PRGO: Loaded 46900 primary data records. [2025-09-23T22:25:07.565551] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:07.681740] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4901 primary records. [2025-09-23T22:25:07.692075] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-23T22:25:07.718031] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-09-23T22:25:07.718435] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-23T22:25:07.734971] [INFO ] [MAIN ] Derivative Progress: 1486/2077 symbols completed. PRH took 1.1s. Estimated remaining: 3m 51s. Rate: 153.3 symbols/min [2025-09-23T22:25:07.736187] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:07.737727] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 18430 primary records. [2025-09-23T22:25:07.736852] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:07.738174] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-23T22:25:07.762168] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-09-23T22:25:07.762423] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-23T22:25:07.764922] [INFO ] [MAIN ] Derivative Progress: 1487/2077 symbols completed. PRI took 1.1s. Estimated remaining: 3m 51s. Rate: 153.4 symbols/min [2025-09-23T22:25:07.778624] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:07.779435] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:07.780922] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 46900 primary records. [2025-09-23T22:25:07.781152] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-23T22:25:07.816172] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-09-23T22:25:07.817072] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-23T22:25:07.832128] [INFO ] [MAIN ] Derivative Progress: 1488/2077 symbols completed. PRGO took 1.2s. Estimated remaining: 3m 50s. Rate: 153.5 symbols/min [2025-09-23T22:25:07.839509] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:07.840520] [DEBUG] [LOCAL ] PRIM: Loaded 44524 existing records from primary storage. [2025-09-23T22:25:07.841464] [INFO ] [MAIN ] PRIM: Loaded 44524 primary data records. [2025-09-23T22:25:07.841361] [DEBUG] [LOCAL ] PRLB: Loaded 20739 existing records from primary storage. [2025-09-23T22:25:07.841825] [INFO ] [MAIN ] PRLB: Loaded 20739 primary data records. [2025-09-23T22:25:08.521869] [DEBUG] [LOCAL ] PRM: Loaded 44606 existing records from primary storage. [2025-09-23T22:25:08.522228] [INFO ] [MAIN ] PRM: Loaded 44606 primary data records. [2025-09-23T22:25:08.892231] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:08.892920] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:08.893908] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20739 primary records. [2025-09-23T22:25:08.894778] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44524 primary records. [2025-09-23T22:25:08.895092] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-23T22:25:08.894944] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-23T22:25:08.931481] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-09-23T22:25:08.934200] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-09-23T22:25:08.933781] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-23T22:25:08.935351] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-23T22:25:08.938446] [INFO ] [MAIN ] Derivative Progress: 1489/2077 symbols completed. PRLB took 1.2s. Estimated remaining: 3m 50s. Rate: 153.3 symbols/min [2025-09-23T22:25:08.941475] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:08.941793] [INFO ] [MAIN ] Derivative Progress: 1490/2077 symbols completed. PRIM took 1.2s. Estimated remaining: 3m 50s. Rate: 153.4 symbols/min [2025-09-23T22:25:08.942622] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:08.957753] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:08.958722] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44606 primary records. [2025-09-23T22:25:08.958870] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-23T22:25:08.981135] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-09-23T22:25:08.981328] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-23T22:25:08.984028] [INFO ] [MAIN ] Derivative Progress: 1491/2077 symbols completed. PRM took 1.1s. Estimated remaining: 3m 49s. Rate: 153.5 symbols/min [2025-09-23T22:25:08.984501] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:09.002604] [DEBUG] [LOCAL ] PRT: Loaded 5306 existing records from primary storage. [2025-09-23T22:25:09.002920] [INFO ] [MAIN ] PRT: Loaded 5306 primary data records. [2025-09-23T22:25:09.162479] [DEBUG] [LOCAL ] PRO: Loaded 37644 existing records from primary storage. [2025-09-23T22:25:09.174125] [DEBUG] [LOCAL ] PRMB: Loaded 53179 existing records from primary storage. [2025-09-23T22:25:09.179505] [INFO ] [MAIN ] PRMB: Loaded 53179 primary data records. [2025-09-23T22:25:09.173078] [INFO ] [MAIN ] PRO: Loaded 37644 primary data records. [2025-09-23T22:25:10.415005] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:10.416892] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5306 primary records. [2025-09-23T22:25:10.417181] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-23T22:25:10.441118] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-09-23T22:25:10.441312] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-23T22:25:10.443346] [INFO ] [MAIN ] Derivative Progress: 1492/2077 symbols completed. PRT took 1.5s. Estimated remaining: 3m 49s. Rate: 153.2 symbols/min [2025-09-23T22:25:10.445161] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:10.477820] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:10.483590] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53179 primary records. [2025-09-23T22:25:10.484291] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:10.485094] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-23T22:25:10.486370] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 37644 primary records. [2025-09-23T22:25:10.487629] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-23T22:25:10.536155] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-09-23T22:25:10.536714] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-23T22:25:10.539263] [INFO ] [MAIN ] Derivative Progress: 1493/2077 symbols completed. PRO took 1.6s. Estimated remaining: 3m 49s. Rate: 153.3 symbols/min [2025-09-23T22:25:10.539596] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:10.540921] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-09-23T22:25:10.541003] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-23T22:25:10.543578] [INFO ] [MAIN ] Derivative Progress: 1494/2077 symbols completed. PRMB took 1.6s. Estimated remaining: 3m 48s. Rate: 153.4 symbols/min [2025-09-23T22:25:10.544145] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:10.562361] [DEBUG] [LOCAL ] PRU: Loaded 51508 existing records from primary storage. [2025-09-23T22:25:10.564275] [INFO ] [MAIN ] PRU: Loaded 51508 primary data records. [2025-09-23T22:25:10.616107] [DEBUG] [LOCAL ] PSBD: Loaded 6903 existing records from primary storage. [2025-09-23T22:25:10.640477] [INFO ] [MAIN ] PSBD: Loaded 6903 primary data records. [2025-09-23T22:25:11.014160] [DEBUG] [LOCAL ] PSA: Loaded 41914 existing records from primary storage. [2025-09-23T22:25:11.042937] [INFO ] [MAIN ] PSA: Loaded 41914 primary data records. [2025-09-23T22:25:11.552807] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:11.553810] [INFO ] [MAIN ] PRU: Generated 1794 derivative records from 51508 primary records. [2025-09-23T22:25:11.554149] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-23T22:25:11.587867] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:11.589879] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 6903 primary records. [2025-09-23T22:25:11.590734] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-23T22:25:11.591670] [DEBUG] [LOCAL ] PRU: Derivative data saved (1794 records). [2025-09-23T22:25:11.592888] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-23T22:25:11.595524] [INFO ] [MAIN ] Derivative Progress: 1495/2077 symbols completed. PRU took 1.2s. Estimated remaining: 3m 48s. Rate: 153.2 symbols/min [2025-09-23T22:25:11.606811] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:11.630191] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:11.631490] [INFO ] [MAIN ] PSA: Generated 1794 derivative records from 41914 primary records. [2025-09-23T22:25:11.631952] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-23T22:25:11.632188] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-09-23T22:25:11.635702] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-23T22:25:11.638132] [INFO ] [MAIN ] Derivative Progress: 1496/2077 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 47s. Rate: 153.3 symbols/min [2025-09-23T22:25:11.635591] [DEBUG] [LOCAL ] PSF: Loaded 6766 existing records from primary storage. [2025-09-23T22:25:11.639015] [INFO ] [MAIN ] PSF: Loaded 6766 primary data records. [2025-09-23T22:25:11.638966] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:11.826690] [DEBUG] [LOCAL ] PSA: Derivative data saved (1794 records). [2025-09-23T22:25:11.848746] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-23T22:25:11.851224] [INFO ] [MAIN ] Derivative Progress: 1497/2077 symbols completed. PSA took 1.3s. Estimated remaining: 3m 47s. Rate: 153.4 symbols/min [2025-09-23T22:25:11.851693] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:11.989013] [DEBUG] [LOCAL ] PSFE: Loaded 30507 existing records from primary storage. [2025-09-23T22:25:11.989758] [INFO ] [MAIN ] PSFE: Loaded 30507 primary data records. [2025-09-23T22:25:12.344007] [DEBUG] [LOCAL ] PSN: Loaded 46265 existing records from primary storage. [2025-09-23T22:25:12.344592] [INFO ] [MAIN ] PSN: Loaded 46265 primary data records. [2025-09-23T22:25:12.474961] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:12.529466] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6766 primary records. [2025-09-23T22:25:12.563879] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-23T22:25:12.770120] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:12.772215] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 30507 primary records. [2025-09-23T22:25:12.772670] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-09-23T22:25:12.772751] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-23T22:25:12.772864] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-23T22:25:12.775216] [INFO ] [MAIN ] Derivative Progress: 1498/2077 symbols completed. PSF took 1.2s. Estimated remaining: 3m 47s. Rate: 153.2 symbols/min [2025-09-23T22:25:12.794860] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-09-23T22:25:12.795055] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-23T22:25:12.797593] [INFO ] [MAIN ] Derivative Progress: 1499/2077 symbols completed. PSFE took 1.2s. Estimated remaining: 3m 46s. Rate: 153.3 symbols/min [2025-09-23T22:25:12.813198] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:12.813795] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 46265 primary records. [2025-09-23T22:25:12.813855] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-23T22:25:12.829134] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-09-23T22:25:12.829203] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-23T22:25:12.831468] [INFO ] [MAIN ] Derivative Progress: 1500/2077 symbols completed. PSN took 1.0s. Estimated remaining: 3m 46s. Rate: 153.4 symbols/min [2025-09-23T22:25:12.832090] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:12.832039] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:12.832278] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:12.890210] [DEBUG] [LOCAL ] PSQH: Loaded 34606 existing records from primary storage. [2025-09-23T22:25:12.890523] [INFO ] [MAIN ] PSQH: Loaded 34606 primary data records. [2025-09-23T22:25:12.978160] [DEBUG] [LOCAL ] PSO: Loaded 37473 existing records from primary storage. [2025-09-23T22:25:12.988757] [INFO ] [MAIN ] PSO: Loaded 37473 primary data records. [2025-09-23T22:25:13.080943] [DEBUG] [LOCAL ] PSTG: Loaded 52848 existing records from primary storage. [2025-09-23T22:25:13.101240] [INFO ] [MAIN ] PSTG: Loaded 52848 primary data records. [2025-09-23T22:25:13.897732] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:13.911616] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 34606 primary records. [2025-09-23T22:25:13.912105] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-23T22:25:13.911968] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:13.922065] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 37473 primary records. [2025-09-23T22:25:13.927927] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-23T22:25:13.956375] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:13.958420] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52848 primary records. [2025-09-23T22:25:13.958992] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-23T22:25:13.974353] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-09-23T22:25:13.974772] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-23T22:25:13.976991] [INFO ] [MAIN ] Derivative Progress: 1501/2077 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 46s. Rate: 153.2 symbols/min [2025-09-23T22:25:13.977478] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:13.979539] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-09-23T22:25:13.980243] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-23T22:25:13.982717] [INFO ] [MAIN ] Derivative Progress: 1502/2077 symbols completed. PSO took 1.2s. Estimated remaining: 3m 45s. Rate: 153.3 symbols/min [2025-09-23T22:25:13.983481] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:13.987669] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-09-23T22:25:13.987782] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-23T22:25:13.990674] [INFO ] [MAIN ] Derivative Progress: 1503/2077 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 44s. Rate: 153.4 symbols/min [2025-09-23T22:25:13.991163] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:14.006496] [DEBUG] [LOCAL ] PSTL: Loaded 20441 existing records from primary storage. [2025-09-23T22:25:14.006762] [INFO ] [MAIN ] PSTL: Loaded 20441 primary data records. [2025-09-23T22:25:14.124704] [DEBUG] [LOCAL ] PTA: Loaded 14961 existing records from primary storage. [2025-09-23T22:25:14.144700] [INFO ] [MAIN ] PTA: Loaded 14961 primary data records. [2025-09-23T22:25:14.476339] [DEBUG] [LOCAL ] PSX: Loaded 53130 existing records from primary storage. [2025-09-23T22:25:14.486928] [INFO ] [MAIN ] PSX: Loaded 53130 primary data records. [2025-09-23T22:25:15.056691] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:15.061371] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 20441 primary records. [2025-09-23T22:25:15.074929] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-23T22:25:15.076133] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:15.078122] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 14961 primary records. [2025-09-23T22:25:15.087142] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-23T22:25:15.129321] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:15.130903] [INFO ] [MAIN ] PSX: Generated 1794 derivative records from 53130 primary records. [2025-09-23T22:25:15.123041] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-09-23T22:25:15.131578] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-23T22:25:15.131485] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-09-23T22:25:15.131849] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-23T22:25:15.134060] [INFO ] [MAIN ] Derivative Progress: 1504/2077 symbols completed. PSTL took 1.2s. Estimated remaining: 3m 44s. Rate: 153.2 symbols/min [2025-09-23T22:25:15.131782] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-23T22:25:15.137692] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:15.137569] [INFO ] [MAIN ] Derivative Progress: 1505/2077 symbols completed. PTA took 1.1s. Estimated remaining: 3m 44s. Rate: 153.3 symbols/min [2025-09-23T22:25:15.138527] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:15.156395] [DEBUG] [LOCAL ] PSX: Derivative data saved (1794 records). [2025-09-23T22:25:15.156530] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-23T22:25:15.160079] [INFO ] [MAIN ] Derivative Progress: 1506/2077 symbols completed. PSX took 1.2s. Estimated remaining: 3m 43s. Rate: 153.4 symbols/min [2025-09-23T22:25:15.160506] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:15.204348] [DEBUG] [LOCAL ] PTY: Loaded 37388 existing records from primary storage. [2025-09-23T22:25:15.204499] [INFO ] [MAIN ] PTY: Loaded 37388 primary data records. [2025-09-23T22:25:15.333804] [DEBUG] [LOCAL ] PUK: Loaded 44922 existing records from primary storage. [2025-09-23T22:25:15.345044] [INFO ] [MAIN ] PUK: Loaded 44922 primary data records. [2025-09-23T22:25:15.444200] [DEBUG] [LOCAL ] PUMP: Loaded 49448 existing records from primary storage. [2025-09-23T22:25:15.614854] [INFO ] [MAIN ] PUMP: Loaded 49448 primary data records. [2025-09-23T22:25:16.235889] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:16.237454] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37388 primary records. [2025-09-23T22:25:16.237552] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-23T22:25:16.257426] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-09-23T22:25:16.257615] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-23T22:25:16.259734] [INFO ] [MAIN ] Derivative Progress: 1507/2077 symbols completed. PTY took 1.1s. Estimated remaining: 3m 43s. Rate: 153.2 symbols/min [2025-09-23T22:25:16.260225] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:16.274227] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:16.275156] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 44922 primary records. [2025-09-23T22:25:16.275478] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-23T22:25:16.294505] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-09-23T22:25:16.307240] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-23T22:25:16.309580] [INFO ] [MAIN ] Derivative Progress: 1508/2077 symbols completed. PUK took 1.2s. Estimated remaining: 3m 43s. Rate: 153.3 symbols/min [2025-09-23T22:25:16.310082] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:16.310255] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:16.311203] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49448 primary records. [2025-09-23T22:25:16.311602] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-23T22:25:16.332710] [DEBUG] [LOCAL ] PVL: Loaded 4739 existing records from primary storage. [2025-09-23T22:25:16.332855] [INFO ] [MAIN ] PVL: Loaded 4739 primary data records. [2025-09-23T22:25:16.332459] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-09-23T22:25:16.364738] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-23T22:25:16.367590] [INFO ] [MAIN ] Derivative Progress: 1509/2077 symbols completed. PUMP took 1.2s. Estimated remaining: 3m 42s. Rate: 153.4 symbols/min [2025-09-23T22:25:16.401057] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:16.732821] [DEBUG] [LOCAL ] PVH: Loaded 50472 existing records from primary storage. [2025-09-23T22:25:16.733152] [INFO ] [MAIN ] PVH: Loaded 50472 primary data records. [2025-09-23T22:25:16.950728] [DEBUG] [LOCAL ] PWR: Loaded 47387 existing records from primary storage. [2025-09-23T22:25:17.063170] [INFO ] [MAIN ] PWR: Loaded 47387 primary data records. [2025-09-23T22:25:17.282379] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:17.284023] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4739 primary records. [2025-09-23T22:25:17.284274] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-23T22:25:17.426985] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-09-23T22:25:17.428013] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-23T22:25:17.430487] [INFO ] [MAIN ] Derivative Progress: 1510/2077 symbols completed. PVL took 1.1s. Estimated remaining: 3m 42s. Rate: 153.2 symbols/min [2025-09-23T22:25:17.431845] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:17.450124] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:17.450934] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 50472 primary records. [2025-09-23T22:25:17.451040] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-23T22:25:17.468822] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-09-23T22:25:17.469014] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-23T22:25:17.471121] [INFO ] [MAIN ] Derivative Progress: 1511/2077 symbols completed. PVH took 1.2s. Estimated remaining: 3m 41s. Rate: 153.3 symbols/min [2025-09-23T22:25:17.479749] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:17.496067] [DEBUG] [LOCAL ] QD: Loaded 28013 existing records from primary storage. [2025-09-23T22:25:17.509401] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:17.509017] [INFO ] [MAIN ] QD: Loaded 28013 primary data records. [2025-09-23T22:25:17.510271] [INFO ] [MAIN ] PWR: Generated 1794 derivative records from 47387 primary records. [2025-09-23T22:25:17.510625] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-23T22:25:17.722700] [DEBUG] [LOCAL ] PWR: Derivative data saved (1794 records). [2025-09-23T22:25:17.758831] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-23T22:25:17.877131] [INFO ] [MAIN ] Derivative Progress: 1512/2077 symbols completed. PWR took 1.5s. Estimated remaining: 3m 41s. Rate: 153.3 symbols/min [2025-09-23T22:25:17.878230] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:17.879948] [DEBUG] [LOCAL ] QGEN: Loaded 49152 existing records from primary storage. [2025-09-23T22:25:17.880300] [INFO ] [MAIN ] QGEN: Loaded 49152 primary data records. [2025-09-23T22:25:18.241939] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-23T22:25:18.248340] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:18.249138] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 28013 primary records. [2025-09-23T22:25:18.249370] [INFO ] [MAIN ] QS: Loaded 53742 primary data records. [2025-09-23T22:25:18.249289] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-23T22:25:18.383766] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-09-23T22:25:18.394600] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-23T22:25:18.415968] [INFO ] [MAIN ] Derivative Progress: 1513/2077 symbols completed. QD took 1.0s. Estimated remaining: 3m 41s. Rate: 153.3 symbols/min [2025-09-23T22:25:18.598228] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:18.599734] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49152 primary records. [2025-09-23T22:25:18.600281] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-23T22:25:18.619439] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-09-23T22:25:18.619811] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-23T22:25:18.622359] [INFO ] [MAIN ] Derivative Progress: 1514/2077 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 40s. Rate: 153.3 symbols/min [2025-09-23T22:25:18.640370] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:18.641036] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53742 primary records. [2025-09-23T22:25:18.641098] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-23T22:25:18.656331] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-09-23T22:25:18.656430] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-23T22:25:18.658568] [INFO ] [MAIN ] Derivative Progress: 1515/2077 symbols completed. QS took 0.8s. Estimated remaining: 3m 40s. Rate: 153.4 symbols/min [2025-09-23T22:25:18.659340] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:18.659267] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:18.659827] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:18.699374] [DEBUG] [LOCAL ] QUAD: Loaded 23844 existing records from primary storage. [2025-09-23T22:25:18.699541] [INFO ] [MAIN ] QUAD: Loaded 23844 primary data records. [2025-09-23T22:25:18.822907] [DEBUG] [LOCAL ] QTWO: Loaded 39083 existing records from primary storage. [2025-09-23T22:25:18.856869] [INFO ] [MAIN ] QTWO: Loaded 39083 primary data records. [2025-09-23T22:25:18.874018] [DEBUG] [LOCAL ] QSR: Loaded 52407 existing records from primary storage. [2025-09-23T22:25:18.901257] [INFO ] [MAIN ] QSR: Loaded 52407 primary data records. [2025-09-23T22:25:19.782759] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:19.785381] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23844 primary records. [2025-09-23T22:25:19.786139] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-23T22:25:19.805360] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-09-23T22:25:19.805601] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-23T22:25:19.809128] [INFO ] [MAIN ] Derivative Progress: 1516/2077 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 40s. Rate: 153.2 symbols/min [2025-09-23T22:25:19.810236] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:19.844442] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:19.845080] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:19.848514] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52407 primary records. [2025-09-23T22:25:19.848739] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-23T22:25:19.850392] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 39083 primary records. [2025-09-23T22:25:19.850800] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-23T22:25:19.867115] [DEBUG] [LOCAL ] QVCC: Loaded 8951 existing records from primary storage. [2025-09-23T22:25:19.867255] [INFO ] [MAIN ] QVCC: Loaded 8951 primary data records. [2025-09-23T22:25:19.925008] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-09-23T22:25:19.937397] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-23T22:25:19.940570] [INFO ] [MAIN ] Derivative Progress: 1517/2077 symbols completed. QSR took 1.3s. Estimated remaining: 3m 39s. Rate: 153.3 symbols/min [2025-09-23T22:25:19.959024] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:19.965362] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-09-23T22:25:19.972389] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-23T22:25:19.975027] [INFO ] [MAIN ] Derivative Progress: 1518/2077 symbols completed. QTWO took 1.3s. Estimated remaining: 3m 39s. Rate: 153.4 symbols/min [2025-09-23T22:25:19.986030] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:20.031556] [DEBUG] [LOCAL ] QVCD: Loaded 4486 existing records from primary storage. [2025-09-23T22:25:20.067856] [INFO ] [MAIN ] QVCD: Loaded 4486 primary data records. [2025-09-23T22:25:20.553106] [DEBUG] [LOCAL ] QXO: Loaded 53175 existing records from primary storage. [2025-09-23T22:25:20.553749] [INFO ] [MAIN ] QXO: Loaded 53175 primary data records. [2025-09-23T22:25:20.769377] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:25:20.847344] [INFO ] [MAIN ] QVCC: Generated 1793 derivative records from 8951 primary records. [2025-09-23T22:25:20.922672] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-23T22:25:20.969151] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:25:20.971287] [INFO ] [MAIN ] QVCD: Generated 1793 derivative records from 4486 primary records. [2025-09-23T22:25:20.971597] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-23T22:25:20.990443] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1793 records). [2025-09-23T22:25:20.991563] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-23T22:25:20.994510] [INFO ] [MAIN ] Derivative Progress: 1519/2077 symbols completed. QVCD took 1.0s. Estimated remaining: 3m 38s. Rate: 153.2 symbols/min [2025-09-23T22:25:20.995533] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1793 records). [2025-09-23T22:25:20.996090] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-23T22:25:20.996538] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:20.999350] [INFO ] [MAIN ] Derivative Progress: 1520/2077 symbols completed. QVCC took 1.2s. Estimated remaining: 3m 38s. Rate: 153.3 symbols/min [2025-09-23T22:25:21.000057] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:21.027875] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:21.035283] [INFO ] [MAIN ] QXO: Generated 1794 derivative records from 53175 primary records. [2025-09-23T22:25:21.042282] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-23T22:25:21.059978] [DEBUG] [LOCAL ] QXO: Derivative data saved (1794 records). [2025-09-23T22:25:21.069517] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-23T22:25:21.073890] [INFO ] [MAIN ] Derivative Progress: 1521/2077 symbols completed. QXO took 1.1s. Estimated remaining: 3m 37s. Rate: 153.4 symbols/min [2025-09-23T22:25:21.087910] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:21.085821] [DEBUG] [LOCAL ] R: Loaded 29518 existing records from primary storage. [2025-09-23T22:25:21.088341] [INFO ] [MAIN ] R: Loaded 29518 primary data records. [2025-09-23T22:25:21.094718] [DEBUG] [LOCAL ] RA: Loaded 21578 existing records from primary storage. [2025-09-23T22:25:21.103832] [INFO ] [MAIN ] RA: Loaded 21578 primary data records. [2025-09-23T22:25:21.487093] [DEBUG] [LOCAL ] RACE: Loaded 32926 existing records from primary storage. [2025-09-23T22:25:21.601673] [INFO ] [MAIN ] RACE: Loaded 32926 primary data records. [2025-09-23T22:25:22.088630] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:22.102390] [INFO ] [MAIN ] R: Generated 1794 derivative records from 29518 primary records. [2025-09-23T22:25:22.103476] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:22.104576] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21578 primary records. [2025-09-23T22:25:22.104825] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-23T22:25:22.105044] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-23T22:25:22.134192] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-09-23T22:25:22.134430] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-23T22:25:22.136986] [INFO ] [MAIN ] Derivative Progress: 1522/2077 symbols completed. R took 1.1s. Estimated remaining: 3m 37s. Rate: 153.2 symbols/min [2025-09-23T22:25:22.137558] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:22.146453] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-09-23T22:25:22.158815] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-23T22:25:22.162195] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:22.161752] [INFO ] [MAIN ] Derivative Progress: 1523/2077 symbols completed. RA took 1.2s. Estimated remaining: 3m 37s. Rate: 153.3 symbols/min [2025-09-23T22:25:22.163218] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 32926 primary records. [2025-09-23T22:25:22.163540] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:22.163681] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-23T22:25:22.191799] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-09-23T22:25:22.191956] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-23T22:25:22.194972] [INFO ] [MAIN ] Derivative Progress: 1524/2077 symbols completed. RACE took 1.1s. Estimated remaining: 3m 36s. Rate: 153.4 symbols/min [2025-09-23T22:25:22.195367] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:22.209056] [DEBUG] [LOCAL ] RAMP: Loaded 37720 existing records from primary storage. [2025-09-23T22:25:22.209295] [INFO ] [MAIN ] RAMP: Loaded 37720 primary data records. [2025-09-23T22:25:22.338093] [DEBUG] [LOCAL ] RBC: Loaded 15141 existing records from primary storage. [2025-09-23T22:25:22.349157] [INFO ] [MAIN ] RBC: Loaded 15141 primary data records. [2025-09-23T22:25:22.648004] [DEBUG] [LOCAL ] RBA: Loaded 45974 existing records from primary storage. [2025-09-23T22:25:22.651997] [INFO ] [MAIN ] RBA: Loaded 45974 primary data records. [2025-09-23T22:25:23.229780] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:23.231218] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37720 primary records. [2025-09-23T22:25:23.231361] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-23T22:25:23.265660] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-09-23T22:25:23.266398] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:23.266661] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-23T22:25:23.267416] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15141 primary records. [2025-09-23T22:25:23.271343] [INFO ] [MAIN ] Derivative Progress: 1525/2077 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 36s. Rate: 153.3 symbols/min [2025-09-23T22:25:23.268368] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-23T22:25:23.272299] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:23.302350] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-09-23T22:25:23.302446] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-23T22:25:23.302283] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:23.304728] [INFO ] [MAIN ] Derivative Progress: 1526/2077 symbols completed. RBC took 1.1s. Estimated remaining: 3m 36s. Rate: 153.3 symbols/min [2025-09-23T22:25:23.305025] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:23.305999] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 45974 primary records. [2025-09-23T22:25:23.306438] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-23T22:25:23.326170] [DEBUG] [LOCAL ] RBOT: Loaded 5060 existing records from primary storage. [2025-09-23T22:25:23.327106] [INFO ] [MAIN ] RBOT: Loaded 5060 primary data records. [2025-09-23T22:25:23.371823] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-09-23T22:25:23.392847] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-23T22:25:23.413031] [INFO ] [MAIN ] Derivative Progress: 1527/2077 symbols completed. RBA took 1.2s. Estimated remaining: 3m 35s. Rate: 153.4 symbols/min [2025-09-23T22:25:23.449090] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:23.667802] [DEBUG] [LOCAL ] RBLX: Loaded 53719 existing records from primary storage. [2025-09-23T22:25:23.668194] [INFO ] [MAIN ] RBLX: Loaded 53719 primary data records. [2025-09-23T22:25:24.011240] [DEBUG] [LOCAL ] RBRK: Loaded 53115 existing records from primary storage. [2025-09-23T22:25:24.025257] [INFO ] [MAIN ] RBRK: Loaded 53115 primary data records. [2025-09-23T22:25:24.230580] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:24.262596] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5060 primary records. [2025-09-23T22:25:24.344030] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-23T22:25:24.372462] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-09-23T22:25:24.372965] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-23T22:25:24.376148] [INFO ] [MAIN ] Derivative Progress: 1528/2077 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 35s. Rate: 153.3 symbols/min [2025-09-23T22:25:24.392161] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:24.393097] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53719 primary records. [2025-09-23T22:25:24.393447] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-23T22:25:24.412127] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-09-23T22:25:24.412239] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-23T22:25:24.414749] [INFO ] [MAIN ] Derivative Progress: 1529/2077 symbols completed. RBLX took 1.1s. Estimated remaining: 3m 34s. Rate: 153.4 symbols/min [2025-09-23T22:25:24.429092] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:24.429639] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53115 primary records. [2025-09-23T22:25:24.429727] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-23T22:25:24.444866] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-09-23T22:25:24.444928] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-23T22:25:24.447342] [INFO ] [MAIN ] Derivative Progress: 1530/2077 symbols completed. RBRK took 1.0s. Estimated remaining: 3m 34s. Rate: 153.5 symbols/min [2025-09-23T22:25:24.448056] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:24.447970] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:24.448430] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:24.462292] [DEBUG] [LOCAL ] RCS: Loaded 11498 existing records from primary storage. [2025-09-23T22:25:24.462421] [INFO ] [MAIN ] RCS: Loaded 11498 primary data records. [2025-09-23T22:25:24.842192] [DEBUG] [LOCAL ] RC: Loaded 48995 existing records from primary storage. [2025-09-23T22:25:24.847572] [INFO ] [MAIN ] RC: Loaded 48995 primary data records. [2025-09-23T22:25:24.868314] [DEBUG] [LOCAL ] RCI: Loaded 48781 existing records from primary storage. [2025-09-23T22:25:24.903237] [INFO ] [MAIN ] RCI: Loaded 48781 primary data records. [2025-09-23T22:25:25.491488] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:25.493484] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11498 primary records. [2025-09-23T22:25:25.494046] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-23T22:25:25.514336] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-09-23T22:25:25.514805] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-23T22:25:25.517357] [INFO ] [MAIN ] Derivative Progress: 1531/2077 symbols completed. RCS took 1.1s. Estimated remaining: 3m 34s. Rate: 153.3 symbols/min [2025-09-23T22:25:25.531764] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:25.531306] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:25.532802] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48995 primary records. [2025-09-23T22:25:25.534575] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-23T22:25:25.560034] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:25.562258] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48781 primary records. [2025-09-23T22:25:25.562362] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-23T22:25:25.580556] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-09-23T22:25:25.581397] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-23T22:25:25.581943] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-09-23T22:25:25.584047] [INFO ] [MAIN ] Derivative Progress: 1532/2077 symbols completed. RC took 1.1s. Estimated remaining: 3m 33s. Rate: 153.4 symbols/min [2025-09-23T22:25:25.584265] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-23T22:25:25.584544] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:25.587397] [INFO ] [MAIN ] Derivative Progress: 1533/2077 symbols completed. RCI took 1.1s. Estimated remaining: 3m 33s. Rate: 153.5 symbols/min [2025-09-23T22:25:25.588073] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:25.618709] [DEBUG] [LOCAL ] RCUS: Loaded 42758 existing records from primary storage. [2025-09-23T22:25:25.619180] [INFO ] [MAIN ] RCUS: Loaded 42758 primary data records. [2025-09-23T22:25:25.855101] [DEBUG] [LOCAL ] RDN: Loaded 45255 existing records from primary storage. [2025-09-23T22:25:25.970708] [INFO ] [MAIN ] RDN: Loaded 45255 primary data records. [2025-09-23T22:25:25.972041] [DEBUG] [LOCAL ] RDDT: Loaded 53784 existing records from primary storage. [2025-09-23T22:25:25.986463] [INFO ] [MAIN ] RDDT: Loaded 53784 primary data records. [2025-09-23T22:25:26.601199] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:26.602757] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42758 primary records. [2025-09-23T22:25:26.603724] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-23T22:25:26.624882] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-09-23T22:25:26.625118] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-23T22:25:26.628892] [INFO ] [MAIN ] Derivative Progress: 1534/2077 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 33s. Rate: 153.3 symbols/min [2025-09-23T22:25:26.630397] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:26.648157] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:26.649053] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 45255 primary records. [2025-09-23T22:25:26.661417] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:26.662187] [INFO ] [MAIN ] RDDT: Generated 1794 derivative records from 53784 primary records. [2025-09-23T22:25:26.661674] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-23T22:25:26.662292] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-23T22:25:26.690525] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-09-23T22:25:26.690844] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-23T22:25:26.693307] [INFO ] [MAIN ] Derivative Progress: 1535/2077 symbols completed. RDN took 1.1s. Estimated remaining: 3m 32s. Rate: 153.4 symbols/min [2025-09-23T22:25:26.693876] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:26.697914] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1794 records). [2025-09-23T22:25:26.698094] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-23T22:25:26.700687] [INFO ] [MAIN ] Derivative Progress: 1536/2077 symbols completed. RDDT took 1.1s. Estimated remaining: 3m 31s. Rate: 153.5 symbols/min [2025-09-23T22:25:26.700999] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:26.773370] [DEBUG] [LOCAL ] RDW: Loaded 52003 existing records from primary storage. [2025-09-23T22:25:26.773731] [INFO ] [MAIN ] RDW: Loaded 52003 primary data records. [2025-09-23T22:25:26.841058] [DEBUG] [LOCAL ] RDY: Loaded 46799 existing records from primary storage. [2025-09-23T22:25:26.860421] [INFO ] [MAIN ] RDY: Loaded 46799 primary data records. [2025-09-23T22:25:26.951823] [DEBUG] [LOCAL ] RELX: Loaded 47846 existing records from primary storage. [2025-09-23T22:25:27.000176] [INFO ] [MAIN ] RELX: Loaded 47846 primary data records. [2025-09-23T22:25:27.789431] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:27.790475] [INFO ] [MAIN ] RDW: Generated 1794 derivative records from 52003 primary records. [2025-09-23T22:25:27.790738] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-23T22:25:27.807590] [DEBUG] [LOCAL ] RDW: Derivative data saved (1794 records). [2025-09-23T22:25:27.807859] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-23T22:25:27.809615] [INFO ] [MAIN ] Derivative Progress: 1537/2077 symbols completed. RDW took 1.2s. Estimated remaining: 3m 31s. Rate: 153.3 symbols/min [2025-09-23T22:25:27.810002] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:27.841840] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:27.842834] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 46799 primary records. [2025-09-23T22:25:27.843253] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-23T22:25:27.843182] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:27.844529] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 47846 primary records. [2025-09-23T22:25:27.844789] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-23T22:25:27.867551] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-09-23T22:25:27.867730] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-23T22:25:27.876176] [INFO ] [MAIN ] Derivative Progress: 1538/2077 symbols completed. RDY took 1.2s. Estimated remaining: 3m 31s. Rate: 153.4 symbols/min [2025-09-23T22:25:27.878342] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:27.892552] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-09-23T22:25:27.892741] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-23T22:25:27.897221] [INFO ] [MAIN ] Derivative Progress: 1539/2077 symbols completed. RELX took 1.2s. Estimated remaining: 3m 30s. Rate: 153.5 symbols/min [2025-09-23T22:25:27.897768] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:27.913337] [DEBUG] [LOCAL ] RERE: Loaded 41049 existing records from primary storage. [2025-09-23T22:25:27.913530] [INFO ] [MAIN ] RERE: Loaded 41049 primary data records. [2025-09-23T22:25:28.263116] [DEBUG] [LOCAL ] RES: Loaded 47526 existing records from primary storage. [2025-09-23T22:25:28.274963] [INFO ] [MAIN ] RES: Loaded 47526 primary data records. [2025-09-23T22:25:28.275925] [DEBUG] [LOCAL ] REVG: Loaded 41044 existing records from primary storage. [2025-09-23T22:25:28.298493] [INFO ] [MAIN ] REVG: Loaded 41044 primary data records. [2025-09-23T22:25:28.978867] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:28.980478] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41049 primary records. [2025-09-23T22:25:28.981415] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-23T22:25:29.016627] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-09-23T22:25:29.019373] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:29.020323] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-23T22:25:29.020247] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 47526 primary records. [2025-09-23T22:25:29.022715] [INFO ] [MAIN ] Derivative Progress: 1540/2077 symbols completed. RERE took 1.2s. Estimated remaining: 3m 30s. Rate: 153.3 symbols/min [2025-09-23T22:25:29.023102] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:29.023250] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-23T22:25:29.037621] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:29.047588] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 41044 primary records. [2025-09-23T22:25:29.051638] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-23T22:25:29.059473] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-09-23T22:25:29.059922] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-23T22:25:29.073825] [INFO ] [MAIN ] Derivative Progress: 1541/2077 symbols completed. RES took 1.2s. Estimated remaining: 3m 30s. Rate: 153.4 symbols/min [2025-09-23T22:25:29.080488] [DEBUG] [LOCAL ] REX: Loaded 13957 existing records from primary storage. [2025-09-23T22:25:29.080872] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:29.081276] [INFO ] [MAIN ] REX: Loaded 13957 primary data records. [2025-09-23T22:25:29.188837] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-09-23T22:25:29.194464] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-23T22:25:29.208408] [INFO ] [MAIN ] Derivative Progress: 1542/2077 symbols completed. REVG took 1.3s. Estimated remaining: 3m 29s. Rate: 153.4 symbols/min [2025-09-23T22:25:29.241150] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:29.433235] [DEBUG] [LOCAL ] REXR: Loaded 52083 existing records from primary storage. [2025-09-23T22:25:29.433597] [INFO ] [MAIN ] REXR: Loaded 52083 primary data records. [2025-09-23T22:25:29.759332] [DEBUG] [LOCAL ] REZI: Loaded 46870 existing records from primary storage. [2025-09-23T22:25:29.768619] [INFO ] [MAIN ] REZI: Loaded 46870 primary data records. [2025-09-23T22:25:29.910711] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:29.935603] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 13957 primary records. [2025-09-23T22:25:29.950854] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-23T22:25:30.119588] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-09-23T22:25:30.120398] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-23T22:25:30.122682] [INFO ] [MAIN ] Derivative Progress: 1543/2077 symbols completed. REX took 1.1s. Estimated remaining: 3m 29s. Rate: 153.3 symbols/min [2025-09-23T22:25:30.140001] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:30.140637] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52083 primary records. [2025-09-23T22:25:30.140831] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-23T22:25:30.157093] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-09-23T22:25:30.157353] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-23T22:25:30.159813] [INFO ] [MAIN ] Derivative Progress: 1544/2077 symbols completed. REXR took 1.1s. Estimated remaining: 3m 28s. Rate: 153.4 symbols/min [2025-09-23T22:25:30.175350] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:30.175972] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 46870 primary records. [2025-09-23T22:25:30.176032] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-23T22:25:30.191638] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-09-23T22:25:30.191723] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-23T22:25:30.194230] [INFO ] [MAIN ] Derivative Progress: 1545/2077 symbols completed. REZI took 1.0s. Estimated remaining: 3m 28s. Rate: 153.5 symbols/min [2025-09-23T22:25:30.194871] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:30.194736] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:30.195017] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:30.210591] [DEBUG] [LOCAL ] RFL: Loaded 10923 existing records from primary storage. [2025-09-23T22:25:30.214741] [INFO ] [MAIN ] RFL: Loaded 10923 primary data records. [2025-09-23T22:25:30.214671] [DEBUG] [LOCAL ] RFI: Loaded 10473 existing records from primary storage. [2025-09-23T22:25:30.214861] [INFO ] [MAIN ] RFI: Loaded 10473 primary data records. [2025-09-23T22:25:30.877952] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-23T22:25:30.878248] [INFO ] [MAIN ] RF: Loaded 53630 primary data records. [2025-09-23T22:25:31.207889] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:31.209422] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10473 primary records. [2025-09-23T22:25:31.221493] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-23T22:25:31.222856] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:31.234755] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 10923 primary records. [2025-09-23T22:25:31.238999] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-09-23T22:25:31.238069] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-23T22:25:31.239478] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-23T22:25:31.242070] [INFO ] [MAIN ] Derivative Progress: 1546/2077 symbols completed. RFI took 1.0s. Estimated remaining: 3m 28s. Rate: 153.3 symbols/min [2025-09-23T22:25:31.242320] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:31.264925] [DEBUG] [LOCAL ] RFM: Loaded 4145 existing records from primary storage. [2025-09-23T22:25:31.265086] [INFO ] [MAIN ] RFM: Loaded 4145 primary data records. [2025-09-23T22:25:31.261813] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-09-23T22:25:31.276511] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-23T22:25:31.304212] [INFO ] [MAIN ] Derivative Progress: 1547/2077 symbols completed. RFL took 1.1s. Estimated remaining: 3m 27s. Rate: 153.4 symbols/min [2025-09-23T22:25:31.311328] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:31.350446] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:31.351168] [INFO ] [MAIN ] RF: Generated 1794 derivative records from 53630 primary records. [2025-09-23T22:25:31.363728] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-23T22:25:31.460825] [DEBUG] [LOCAL ] RFMZ: Loaded 8678 existing records from primary storage. [2025-09-23T22:25:31.478722] [INFO ] [MAIN ] RFMZ: Loaded 8678 primary data records. [2025-09-23T22:25:31.646211] [DEBUG] [LOCAL ] RF: Derivative data saved (1794 records). [2025-09-23T22:25:31.668439] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-23T22:25:31.688391] [INFO ] [MAIN ] Derivative Progress: 1548/2077 symbols completed. RF took 1.5s. Estimated remaining: 3m 27s. Rate: 153.4 symbols/min [2025-09-23T22:25:31.700311] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:31.950237] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:31.951838] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4145 primary records. [2025-09-23T22:25:31.952121] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-23T22:25:31.969937] [DEBUG] [LOCAL ] RGA: Loaded 30163 existing records from primary storage. [2025-09-23T22:25:31.971073] [INFO ] [MAIN ] RGA: Loaded 30163 primary data records. [2025-09-23T22:25:31.989019] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-09-23T22:25:32.015172] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-23T22:25:32.024083] [INFO ] [MAIN ] Derivative Progress: 1549/2077 symbols completed. RFM took 0.8s. Estimated remaining: 3m 26s. Rate: 153.4 symbols/min [2025-09-23T22:25:32.024464] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:32.104562] [DEBUG] [LOCAL ] RGT: Loaded 2879 existing records from primary storage. [2025-09-23T22:25:32.122357] [INFO ] [MAIN ] RGT: Loaded 2879 primary data records. [2025-09-23T22:25:32.357491] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:32.383976] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8678 primary records. [2025-09-23T22:25:32.395632] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-23T22:25:32.623532] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-09-23T22:25:32.624511] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-23T22:25:32.627459] [INFO ] [MAIN ] Derivative Progress: 1550/2077 symbols completed. RFMZ took 1.3s. Estimated remaining: 3m 26s. Rate: 153.4 symbols/min [2025-09-23T22:25:32.629544] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:32.652985] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:32.666017] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 30163 primary records. [2025-09-23T22:25:32.666118] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-23T22:25:32.666810] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:32.667727] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2879 primary records. [2025-09-23T22:25:32.667870] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-23T22:25:32.706732] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-09-23T22:25:32.707385] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-23T22:25:32.710242] [INFO ] [MAIN ] Derivative Progress: 1551/2077 symbols completed. RGT took 0.7s. Estimated remaining: 3m 26s. Rate: 153.4 symbols/min [2025-09-23T22:25:32.710538] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:32.711446] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-09-23T22:25:32.711747] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-23T22:25:32.714103] [INFO ] [MAIN ] Derivative Progress: 1552/2077 symbols completed. RGA took 1.0s. Estimated remaining: 3m 25s. Rate: 153.5 symbols/min [2025-09-23T22:25:32.715119] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:32.730940] [DEBUG] [LOCAL ] RH: Loaded 47705 existing records from primary storage. [2025-09-23T22:25:32.731140] [INFO ] [MAIN ] RH: Loaded 47705 primary data records. [2025-09-23T22:25:33.115938] [DEBUG] [LOCAL ] RHI: Loaded 49275 existing records from primary storage. [2025-09-23T22:25:33.127833] [INFO ] [MAIN ] RHI: Loaded 49275 primary data records. [2025-09-23T22:25:33.150216] [DEBUG] [LOCAL ] RHP: Loaded 41815 existing records from primary storage. [2025-09-23T22:25:33.185528] [INFO ] [MAIN ] RHP: Loaded 41815 primary data records. [2025-09-23T22:25:33.755503] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:33.756443] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47705 primary records. [2025-09-23T22:25:33.757589] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-23T22:25:33.776412] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-09-23T22:25:33.776814] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-23T22:25:33.779509] [INFO ] [MAIN ] Derivative Progress: 1553/2077 symbols completed. RH took 1.2s. Estimated remaining: 3m 25s. Rate: 153.4 symbols/min [2025-09-23T22:25:33.780323] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:33.803255] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:33.804151] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49275 primary records. [2025-09-23T22:25:33.804422] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-23T22:25:33.824473] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-09-23T22:25:33.850331] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-23T22:25:33.853407] [INFO ] [MAIN ] Derivative Progress: 1554/2077 symbols completed. RHI took 1.1s. Estimated remaining: 3m 24s. Rate: 153.4 symbols/min [2025-09-23T22:25:33.854036] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:33.854992] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 41815 primary records. [2025-09-23T22:25:33.855336] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:33.855483] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-23T22:25:33.889805] [DEBUG] [LOCAL ] RIG: Loaded 53669 existing records from primary storage. [2025-09-23T22:25:33.890556] [INFO ] [MAIN ] RIG: Loaded 53669 primary data records. [2025-09-23T22:25:33.923097] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-09-23T22:25:33.958176] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-23T22:25:33.978806] [INFO ] [MAIN ] Derivative Progress: 1555/2077 symbols completed. RHP took 1.3s. Estimated remaining: 3m 24s. Rate: 153.5 symbols/min [2025-09-23T22:25:33.989608] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:34.234281] [DEBUG] [LOCAL ] RIO: Loaded 53394 existing records from primary storage. [2025-09-23T22:25:34.234453] [INFO ] [MAIN ] RIO: Loaded 53394 primary data records. [2025-09-23T22:25:34.577316] [DEBUG] [LOCAL ] RITM: Loaded 52820 existing records from primary storage. [2025-09-23T22:25:34.577779] [INFO ] [MAIN ] RITM: Loaded 52820 primary data records. [2025-09-23T22:25:34.733638] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:34.793283] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53669 primary records. [2025-09-23T22:25:34.885478] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-23T22:25:34.975926] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-09-23T22:25:34.977470] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-23T22:25:34.980497] [INFO ] [MAIN ] Derivative Progress: 1556/2077 symbols completed. RIG took 1.2s. Estimated remaining: 3m 24s. Rate: 153.4 symbols/min [2025-09-23T22:25:34.981465] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:34.995502] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:34.996876] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53394 primary records. [2025-09-23T22:25:34.997416] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-23T22:25:35.022828] [DEBUG] [LOCAL ] RIV: Loaded 11908 existing records from primary storage. [2025-09-23T22:25:35.023535] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-09-23T22:25:35.023482] [INFO ] [MAIN ] RIV: Loaded 11908 primary data records. [2025-09-23T22:25:35.023792] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-23T22:25:35.062562] [INFO ] [MAIN ] Derivative Progress: 1557/2077 symbols completed. RIO took 1.2s. Estimated remaining: 3m 23s. Rate: 153.4 symbols/min [2025-09-23T22:25:35.083010] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:35.151439] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:35.162615] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52820 primary records. [2025-09-23T22:25:35.173152] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-23T22:25:35.382411] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-09-23T22:25:35.383496] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-23T22:25:35.387011] [INFO ] [MAIN ] Derivative Progress: 1558/2077 symbols completed. RITM took 1.4s. Estimated remaining: 3m 23s. Rate: 153.5 symbols/min [2025-09-23T22:25:35.402498] [DEBUG] [LOCAL ] RJF: Loaded 47092 existing records from primary storage. [2025-09-23T22:25:35.402863] [INFO ] [MAIN ] RJF: Loaded 47092 primary data records. [2025-09-23T22:25:35.590790] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:35.712525] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 11908 primary records. [2025-09-23T22:25:35.713072] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-23T22:25:35.730574] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-09-23T22:25:35.730768] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-23T22:25:35.733261] [INFO ] [MAIN ] Derivative Progress: 1559/2077 symbols completed. RIV took 0.8s. Estimated remaining: 3m 23s. Rate: 153.5 symbols/min [2025-09-23T22:25:35.757698] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:35.758433] [INFO ] [MAIN ] RJF: Generated 1794 derivative records from 47092 primary records. [2025-09-23T22:25:35.758496] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-23T22:25:35.774985] [DEBUG] [LOCAL ] RJF: Derivative data saved (1794 records). [2025-09-23T22:25:35.775051] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-23T22:25:35.777773] [INFO ] [MAIN ] Derivative Progress: 1560/2077 symbols completed. RJF took 0.7s. Estimated remaining: 3m 22s. Rate: 153.6 symbols/min [2025-09-23T22:25:35.778491] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:35.778584] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:35.778729] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:35.831474] [DEBUG] [LOCAL ] RLI: Loaded 33304 existing records from primary storage. [2025-09-23T22:25:35.844692] [INFO ] [MAIN ] RLI: Loaded 33304 primary data records. [2025-09-23T22:25:35.943214] [DEBUG] [LOCAL ] RL: Loaded 41590 existing records from primary storage. [2025-09-23T22:25:35.970331] [INFO ] [MAIN ] RL: Loaded 41590 primary data records. [2025-09-23T22:25:36.025862] [DEBUG] [LOCAL ] RKT: Loaded 53721 existing records from primary storage. [2025-09-23T22:25:36.054355] [INFO ] [MAIN ] RKT: Loaded 53721 primary data records. [2025-09-23T22:25:36.914092] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:36.916629] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 33304 primary records. [2025-09-23T22:25:36.917788] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-23T22:25:36.932095] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:36.940398] [INFO ] [MAIN ] RL: Generated 1794 derivative records from 41590 primary records. [2025-09-23T22:25:36.945833] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-23T22:25:36.966060] [DEBUG] [LOCAL ] RL: Derivative data saved (1794 records). [2025-09-23T22:25:36.966817] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-23T22:25:36.969581] [INFO ] [MAIN ] Derivative Progress: 1561/2077 symbols completed. RL took 1.2s. Estimated remaining: 3m 22s. Rate: 153.4 symbols/min [2025-09-23T22:25:36.984266] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:36.985774] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-09-23T22:25:36.985256] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:36.987051] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53721 primary records. [2025-09-23T22:25:36.987244] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-23T22:25:36.987322] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-23T22:25:36.990070] [INFO ] [MAIN ] Derivative Progress: 1562/2077 symbols completed. RLI took 1.2s. Estimated remaining: 3m 21s. Rate: 153.4 symbols/min [2025-09-23T22:25:36.997919] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:37.006922] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-09-23T22:25:37.007025] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-23T22:25:37.009790] [INFO ] [MAIN ] Derivative Progress: 1563/2077 symbols completed. RKT took 1.2s. Estimated remaining: 3m 21s. Rate: 153.5 symbols/min [2025-09-23T22:25:37.010899] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:37.025507] [DEBUG] [LOCAL ] RLTY: Loaded 11117 existing records from primary storage. [2025-09-23T22:25:37.025762] [INFO ] [MAIN ] RLTY: Loaded 11117 primary data records. [2025-09-23T22:25:37.233563] [DEBUG] [LOCAL ] RLJ: Loaded 48245 existing records from primary storage. [2025-09-23T22:25:37.270139] [INFO ] [MAIN ] RLJ: Loaded 48245 primary data records. [2025-09-23T22:25:37.425169] [DEBUG] [LOCAL ] RLX: Loaded 48163 existing records from primary storage. [2025-09-23T22:25:37.437594] [INFO ] [MAIN ] RLX: Loaded 48163 primary data records. [2025-09-23T22:25:38.043575] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:38.044562] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11117 primary records. [2025-09-23T22:25:38.045975] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-23T22:25:38.078304] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:38.079974] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 48245 primary records. [2025-09-23T22:25:38.080243] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-23T22:25:38.089918] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-09-23T22:25:38.094888] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-23T22:25:38.098888] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-09-23T22:25:38.103185] [INFO ] [MAIN ] Derivative Progress: 1564/2077 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 21s. Rate: 153.4 symbols/min [2025-09-23T22:25:38.100744] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-23T22:25:38.105917] [INFO ] [MAIN ] Derivative Progress: 1565/2077 symbols completed. RLJ took 1.1s. Estimated remaining: 3m 20s. Rate: 153.5 symbols/min [2025-09-23T22:25:38.106144] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:38.106819] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:38.121308] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:38.122192] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48163 primary records. [2025-09-23T22:25:38.122378] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-23T22:25:38.141089] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-09-23T22:25:38.141262] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-23T22:25:38.143956] [INFO ] [MAIN ] Derivative Progress: 1566/2077 symbols completed. RLX took 1.1s. Estimated remaining: 3m 20s. Rate: 153.6 symbols/min [2025-09-23T22:25:38.144391] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:38.154274] [DEBUG] [LOCAL ] RM: Loaded 7685 existing records from primary storage. [2025-09-23T22:25:38.154491] [INFO ] [MAIN ] RM: Loaded 7685 primary data records. [2025-09-23T22:25:38.241103] [DEBUG] [LOCAL ] RMAX: Loaded 21919 existing records from primary storage. [2025-09-23T22:25:38.251578] [INFO ] [MAIN ] RMAX: Loaded 21919 primary data records. [2025-09-23T22:25:38.701680] [DEBUG] [LOCAL ] RMD: Loaded 42314 existing records from primary storage. [2025-09-23T22:25:38.819862] [INFO ] [MAIN ] RMD: Loaded 42314 primary data records. [2025-09-23T22:25:39.190848] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:39.192485] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7685 primary records. [2025-09-23T22:25:39.192897] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-23T22:25:39.227285] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:39.229261] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21919 primary records. [2025-09-23T22:25:39.229769] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-23T22:25:39.230748] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-09-23T22:25:39.231819] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-23T22:25:39.241761] [INFO ] [MAIN ] Derivative Progress: 1567/2077 symbols completed. RM took 1.1s. Estimated remaining: 3m 20s. Rate: 153.4 symbols/min [2025-09-23T22:25:39.247988] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:39.252231] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-09-23T22:25:39.252616] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-23T22:25:39.255165] [INFO ] [MAIN ] Derivative Progress: 1568/2077 symbols completed. RMAX took 1.1s. Estimated remaining: 3m 19s. Rate: 153.5 symbols/min [2025-09-23T22:25:39.255601] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:39.270582] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:39.271617] [INFO ] [MAIN ] RMD: Generated 1794 derivative records from 42314 primary records. [2025-09-23T22:25:39.271857] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-23T22:25:39.275133] [DEBUG] [LOCAL ] RMI: Loaded 4682 existing records from primary storage. [2025-09-23T22:25:39.275409] [INFO ] [MAIN ] RMI: Loaded 4682 primary data records. [2025-09-23T22:25:39.368447] [DEBUG] [LOCAL ] RMD: Derivative data saved (1794 records). [2025-09-23T22:25:39.383852] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-23T22:25:39.386899] [INFO ] [MAIN ] Derivative Progress: 1569/2077 symbols completed. RMD took 1.2s. Estimated remaining: 3m 19s. Rate: 153.5 symbols/min [2025-09-23T22:25:39.387421] [DEBUG] [LOCAL ] RMM: Loaded 10370 existing records from primary storage. [2025-09-23T22:25:39.404682] [INFO ] [MAIN ] RMM: Loaded 10370 primary data records. [2025-09-23T22:25:39.405288] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:39.678503] [DEBUG] [LOCAL ] RMMZ: Loaded 4843 existing records from primary storage. [2025-09-23T22:25:39.696457] [INFO ] [MAIN ] RMMZ: Loaded 4843 primary data records. [2025-09-23T22:25:40.252518] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:40.253474] [INFO ] [MAIN ] RMI: Generated 1794 derivative records from 4682 primary records. [2025-09-23T22:25:40.253706] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-23T22:25:40.297686] [DEBUG] [LOCAL ] RMI: Derivative data saved (1794 records). [2025-09-23T22:25:40.298325] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:40.298851] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:40.298566] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-23T22:25:40.302235] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10370 primary records. [2025-09-23T22:25:40.302326] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-23T22:25:40.301634] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4843 primary records. [2025-09-23T22:25:40.303141] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-23T22:25:40.300886] [INFO ] [MAIN ] Derivative Progress: 1570/2077 symbols completed. RMI took 1.1s. Estimated remaining: 3m 18s. Rate: 153.4 symbols/min [2025-09-23T22:25:40.326005] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-09-23T22:25:40.332293] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-09-23T22:25:40.332368] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-23T22:25:40.334996] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-23T22:25:40.335304] [INFO ] [MAIN ] Derivative Progress: 1571/2077 symbols completed. RMM took 1.1s. Estimated remaining: 3m 18s. Rate: 153.5 symbols/min [2025-09-23T22:25:40.338297] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:40.338440] [INFO ] [MAIN ] Derivative Progress: 1572/2077 symbols completed. RMMZ took 0.9s. Estimated remaining: 3m 17s. Rate: 153.6 symbols/min [2025-09-23T22:25:40.338855] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:40.338809] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:40.361846] [DEBUG] [LOCAL ] RMT: Loaded 17581 existing records from primary storage. [2025-09-23T22:25:40.362048] [INFO ] [MAIN ] RMT: Loaded 17581 primary data records. [2025-09-23T22:25:40.451038] [DEBUG] [LOCAL ] RNGR: Loaded 20429 existing records from primary storage. [2025-09-23T22:25:40.462210] [INFO ] [MAIN ] RNGR: Loaded 20429 primary data records. [2025-09-23T22:25:40.668790] [DEBUG] [LOCAL ] RNG: Loaded 48166 existing records from primary storage. [2025-09-23T22:25:40.680046] [INFO ] [MAIN ] RNG: Loaded 48166 primary data records. [2025-09-23T22:25:41.356988] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:41.358970] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17581 primary records. [2025-09-23T22:25:41.360759] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-23T22:25:41.391271] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-09-23T22:25:41.391786] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:41.391904] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-23T22:25:41.392759] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20429 primary records. [2025-09-23T22:25:41.395093] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-23T22:25:41.394869] [INFO ] [MAIN ] Derivative Progress: 1573/2077 symbols completed. RMT took 1.1s. Estimated remaining: 3m 17s. Rate: 153.4 symbols/min [2025-09-23T22:25:41.413443] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-09-23T22:25:41.413583] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-23T22:25:41.416354] [INFO ] [MAIN ] Derivative Progress: 1574/2077 symbols completed. RNGR took 1.1s. Estimated remaining: 3m 17s. Rate: 153.5 symbols/min [2025-09-23T22:25:41.428890] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:41.429452] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 48166 primary records. [2025-09-23T22:25:41.429510] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-23T22:25:41.444566] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-09-23T22:25:41.444623] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-23T22:25:41.447333] [INFO ] [MAIN ] Derivative Progress: 1575/2077 symbols completed. RNG took 1.1s. Estimated remaining: 3m 16s. Rate: 153.6 symbols/min [2025-09-23T22:25:41.447895] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:41.448109] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:41.448163] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:41.473215] [DEBUG] [LOCAL ] RNP: Loaded 15782 existing records from primary storage. [2025-09-23T22:25:41.473366] [INFO ] [MAIN ] RNP: Loaded 15782 primary data records. [2025-09-23T22:25:41.621439] [DEBUG] [LOCAL ] RNST: Loaded 37214 existing records from primary storage. [2025-09-23T22:25:41.627813] [INFO ] [MAIN ] RNST: Loaded 37214 primary data records. [2025-09-23T22:25:41.627729] [DEBUG] [LOCAL ] RNR: Loaded 34369 existing records from primary storage. [2025-09-23T22:25:41.633217] [INFO ] [MAIN ] RNR: Loaded 34369 primary data records. [2025-09-23T22:25:42.465778] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:42.469746] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 15782 primary records. [2025-09-23T22:25:42.470122] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-23T22:25:42.499685] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:42.506264] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 34369 primary records. [2025-09-23T22:25:42.507002] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-23T22:25:42.507084] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-09-23T22:25:42.508461] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-23T22:25:42.529340] [INFO ] [MAIN ] Derivative Progress: 1576/2077 symbols completed. RNP took 1.1s. Estimated remaining: 3m 16s. Rate: 153.4 symbols/min [2025-09-23T22:25:42.539076] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:42.539479] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-09-23T22:25:42.539613] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-23T22:25:42.542492] [INFO ] [MAIN ] Derivative Progress: 1577/2077 symbols completed. RNR took 1.1s. Estimated remaining: 3m 15s. Rate: 153.5 symbols/min [2025-09-23T22:25:42.539158] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:42.544031] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 37214 primary records. [2025-09-23T22:25:42.544488] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-23T22:25:42.544415] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:42.563119] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-09-23T22:25:42.563330] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-23T22:25:42.566217] [INFO ] [MAIN ] Derivative Progress: 1578/2077 symbols completed. RNST took 1.1s. Estimated remaining: 3m 15s. Rate: 153.6 symbols/min [2025-09-23T22:25:42.566705] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:42.584489] [DEBUG] [LOCAL ] ROG: Loaded 23161 existing records from primary storage. [2025-09-23T22:25:42.584789] [INFO ] [MAIN ] ROG: Loaded 23161 primary data records. [2025-09-23T22:25:42.963077] [DEBUG] [LOCAL ] ROK: Loaded 44010 existing records from primary storage. [2025-09-23T22:25:42.977856] [INFO ] [MAIN ] ROK: Loaded 44010 primary data records. [2025-09-23T22:25:42.978629] [DEBUG] [LOCAL ] ROL: Loaded 50275 existing records from primary storage. [2025-09-23T22:25:43.000474] [INFO ] [MAIN ] ROL: Loaded 50275 primary data records. [2025-09-23T22:25:43.647057] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:43.648251] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 23161 primary records. [2025-09-23T22:25:43.648533] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-23T22:25:43.668982] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-09-23T22:25:43.670594] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-23T22:25:43.685144] [INFO ] [MAIN ] Derivative Progress: 1579/2077 symbols completed. ROG took 1.1s. Estimated remaining: 3m 15s. Rate: 153.4 symbols/min [2025-09-23T22:25:43.691008] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:43.690901] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:43.704144] [INFO ] [MAIN ] ROK: Generated 1794 derivative records from 44010 primary records. [2025-09-23T22:25:43.704725] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-23T22:25:43.706041] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:43.707050] [INFO ] [MAIN ] ROL: Generated 1794 derivative records from 50275 primary records. [2025-09-23T22:25:43.707801] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-23T22:25:43.739238] [DEBUG] [LOCAL ] ROK: Derivative data saved (1794 records). [2025-09-23T22:25:43.739983] [DEBUG] [LOCAL ] ROL: Derivative data saved (1794 records). [2025-09-23T22:25:43.740108] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-23T22:25:43.740219] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-23T22:25:43.742676] [INFO ] [MAIN ] Derivative Progress: 1580/2077 symbols completed. ROK took 1.2s. Estimated remaining: 3m 14s. Rate: 153.5 symbols/min [2025-09-23T22:25:43.745991] [INFO ] [MAIN ] Derivative Progress: 1581/2077 symbols completed. ROL took 1.2s. Estimated remaining: 3m 14s. Rate: 153.6 symbols/min [2025-09-23T22:25:43.746080] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:43.746904] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:43.785620] [DEBUG] [LOCAL ] RPT: Loaded 19669 existing records from primary storage. [2025-09-23T22:25:43.785858] [INFO ] [MAIN ] RPT: Loaded 19669 primary data records. [2025-09-23T22:25:43.888938] [DEBUG] [LOCAL ] RQI: Loaded 29075 existing records from primary storage. [2025-09-23T22:25:43.894851] [DEBUG] [LOCAL ] RPM: Loaded 41108 existing records from primary storage. [2025-09-23T22:25:43.901186] [INFO ] [MAIN ] RPM: Loaded 41108 primary data records. [2025-09-23T22:25:43.901110] [INFO ] [MAIN ] RQI: Loaded 29075 primary data records. [2025-09-23T22:25:44.845415] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:44.846782] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19669 primary records. [2025-09-23T22:25:44.846984] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-23T22:25:44.867371] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-09-23T22:25:44.869215] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-23T22:25:44.883851] [INFO ] [MAIN ] Derivative Progress: 1582/2077 symbols completed. RPT took 1.1s. Estimated remaining: 3m 14s. Rate: 153.4 symbols/min [2025-09-23T22:25:44.884805] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:44.885886] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 41108 primary records. [2025-09-23T22:25:44.898555] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:44.893858] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-23T22:25:44.899954] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:44.901756] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 29075 primary records. [2025-09-23T22:25:44.902106] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-23T22:25:44.918398] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-09-23T22:25:44.918770] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-23T22:25:44.930042] [INFO ] [MAIN ] Derivative Progress: 1583/2077 symbols completed. RPM took 1.2s. Estimated remaining: 3m 13s. Rate: 153.5 symbols/min [2025-09-23T22:25:44.933579] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:44.938229] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-09-23T22:25:44.938420] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-23T22:25:44.941148] [INFO ] [MAIN ] Derivative Progress: 1584/2077 symbols completed. RQI took 1.2s. Estimated remaining: 3m 13s. Rate: 153.6 symbols/min [2025-09-23T22:25:44.941508] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:44.989765] [DEBUG] [LOCAL ] RS: Loaded 25564 existing records from primary storage. [2025-09-23T22:25:44.990069] [INFO ] [MAIN ] RS: Loaded 25564 primary data records. [2025-09-23T22:25:45.077259] [DEBUG] [LOCAL ] RRC: Loaded 52776 existing records from primary storage. [2025-09-23T22:25:45.117521] [INFO ] [MAIN ] RRC: Loaded 52776 primary data records. [2025-09-23T22:25:45.135253] [DEBUG] [LOCAL ] RRX: Loaded 41114 existing records from primary storage. [2025-09-23T22:25:45.146839] [INFO ] [MAIN ] RRX: Loaded 41114 primary data records. [2025-09-23T22:25:45.973537] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:45.974559] [INFO ] [MAIN ] RS: Generated 1794 derivative records from 25564 primary records. [2025-09-23T22:25:45.974918] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-23T22:25:45.992246] [DEBUG] [LOCAL ] RS: Derivative data saved (1794 records). [2025-09-23T22:25:45.992471] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-23T22:25:45.996195] [INFO ] [MAIN ] Derivative Progress: 1585/2077 symbols completed. RS took 1.1s. Estimated remaining: 3m 12s. Rate: 153.4 symbols/min [2025-09-23T22:25:45.998535] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:46.013230] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:46.027937] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 41114 primary records. [2025-09-23T22:25:46.027066] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:46.030836] [DEBUG] [LOCAL ] RSF: Loaded 4128 existing records from primary storage. [2025-09-23T22:25:46.030988] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-23T22:25:46.032041] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52776 primary records. [2025-09-23T22:25:46.032310] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-23T22:25:46.047786] [INFO ] [MAIN ] RSF: Loaded 4128 primary data records. [2025-09-23T22:25:46.092172] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-09-23T22:25:46.092622] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-23T22:25:46.096105] [INFO ] [MAIN ] Derivative Progress: 1586/2077 symbols completed. RRC took 1.2s. Estimated remaining: 3m 12s. Rate: 153.5 symbols/min [2025-09-23T22:25:46.123339] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:46.111093] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-09-23T22:25:46.149247] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-23T22:25:46.164078] [INFO ] [MAIN ] Derivative Progress: 1587/2077 symbols completed. RRX took 1.2s. Estimated remaining: 3m 11s. Rate: 153.6 symbols/min [2025-09-23T22:25:46.175670] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:46.437914] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:46.438699] [DEBUG] [LOCAL ] RSG: Loaded 47458 existing records from primary storage. [2025-09-23T22:25:46.439549] [INFO ] [MAIN ] RSG: Loaded 47458 primary data records. [2025-09-23T22:25:46.440358] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4128 primary records. [2025-09-23T22:25:46.452965] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-23T22:25:46.490845] [DEBUG] [LOCAL ] RSI: Loaded 47111 existing records from primary storage. [2025-09-23T22:25:46.524493] [INFO ] [MAIN ] RSI: Loaded 47111 primary data records. [2025-09-23T22:25:46.671918] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-09-23T22:25:46.692693] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-23T22:25:46.715111] [INFO ] [MAIN ] Derivative Progress: 1588/2077 symbols completed. RSF took 0.7s. Estimated remaining: 3m 11s. Rate: 153.6 symbols/min [2025-09-23T22:25:47.154523] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:47.155527] [INFO ] [MAIN ] RSG: Generated 1794 derivative records from 47458 primary records. [2025-09-23T22:25:47.155822] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-23T22:25:47.173718] [DEBUG] [LOCAL ] RSG: Derivative data saved (1794 records). [2025-09-23T22:25:47.174471] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-23T22:25:47.176510] [INFO ] [MAIN ] Derivative Progress: 1589/2077 symbols completed. RSG took 1.1s. Estimated remaining: 3m 11s. Rate: 153.5 symbols/min [2025-09-23T22:25:47.189376] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:47.189989] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 47111 primary records. [2025-09-23T22:25:47.190052] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-23T22:25:47.206341] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-09-23T22:25:47.206410] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-23T22:25:47.208708] [INFO ] [MAIN ] Derivative Progress: 1590/2077 symbols completed. RSI took 1.0s. Estimated remaining: 3m 10s. Rate: 153.6 symbols/min [2025-09-23T22:25:47.209252] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:47.209506] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:47.209731] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:47.256830] [DEBUG] [LOCAL ] RSKD: Loaded 34054 existing records from primary storage. [2025-09-23T22:25:47.268422] [INFO ] [MAIN ] RSKD: Loaded 34054 primary data records. [2025-09-23T22:25:47.313445] [DEBUG] [LOCAL ] RTO: Loaded 40294 existing records from primary storage. [2025-09-23T22:25:47.372749] [INFO ] [MAIN ] RTO: Loaded 40294 primary data records. [2025-09-23T22:25:47.442924] [DEBUG] [LOCAL ] RTX: Loaded 53710 existing records from primary storage. [2025-09-23T22:25:47.500444] [INFO ] [MAIN ] RTX: Loaded 53710 primary data records. [2025-09-23T22:25:48.266938] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:48.268061] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 34054 primary records. [2025-09-23T22:25:48.268403] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-23T22:25:48.300989] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:48.302838] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 40294 primary records. [2025-09-23T22:25:48.303945] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-09-23T22:25:48.303259] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-23T22:25:48.305935] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-23T22:25:48.316367] [INFO ] [MAIN ] Derivative Progress: 1591/2077 symbols completed. RSKD took 1.1s. Estimated remaining: 3m 10s. Rate: 153.5 symbols/min [2025-09-23T22:25:48.333142] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:48.335716] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:48.337559] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53710 primary records. [2025-09-23T22:25:48.338775] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-23T22:25:48.348249] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-09-23T22:25:48.349224] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-23T22:25:48.354174] [INFO ] [MAIN ] Derivative Progress: 1592/2077 symbols completed. RTO took 1.1s. Estimated remaining: 3m 10s. Rate: 153.5 symbols/min [2025-09-23T22:25:48.355666] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:48.359632] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-09-23T22:25:48.359839] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-23T22:25:48.362552] [INFO ] [MAIN ] Derivative Progress: 1593/2077 symbols completed. RTX took 1.2s. Estimated remaining: 3m 9s. Rate: 153.6 symbols/min [2025-09-23T22:25:48.362842] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:48.398623] [DEBUG] [LOCAL ] RVT: Loaded 27148 existing records from primary storage. [2025-09-23T22:25:48.398861] [INFO ] [MAIN ] RVT: Loaded 27148 primary data records. [2025-09-23T22:25:48.527965] [DEBUG] [LOCAL ] RVLV: Loaded 47858 existing records from primary storage. [2025-09-23T22:25:48.544616] [INFO ] [MAIN ] RVLV: Loaded 47858 primary data records. [2025-09-23T22:25:48.683454] [DEBUG] [LOCAL ] RVTY: Loaded 47580 existing records from primary storage. [2025-09-23T22:25:48.776974] [INFO ] [MAIN ] RVTY: Loaded 47580 primary data records. [2025-09-23T22:25:49.457715] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:49.460381] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 27148 primary records. [2025-09-23T22:25:49.462399] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-23T22:25:49.485733] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:49.490178] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 47858 primary records. [2025-09-23T22:25:49.490765] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-23T22:25:49.510470] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-09-23T22:25:49.511561] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-23T22:25:49.515168] [INFO ] [MAIN ] Derivative Progress: 1594/2077 symbols completed. RVT took 1.2s. Estimated remaining: 3m 9s. Rate: 153.4 symbols/min [2025-09-23T22:25:49.515837] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:49.518950] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-09-23T22:25:49.519097] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-23T22:25:49.521841] [INFO ] [MAIN ] Derivative Progress: 1595/2077 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 8s. Rate: 153.5 symbols/min [2025-09-23T22:25:49.522277] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:49.536025] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:49.536834] [INFO ] [MAIN ] RVTY: Generated 1794 derivative records from 47580 primary records. [2025-09-23T22:25:49.538358] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-23T22:25:49.563897] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1794 records). [2025-09-23T22:25:49.564049] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-23T22:25:49.566826] [INFO ] [MAIN ] Derivative Progress: 1596/2077 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 8s. Rate: 153.6 symbols/min [2025-09-23T22:25:49.567225] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:49.605211] [DEBUG] [LOCAL ] RWT: Loaded 40723 existing records from primary storage. [2025-09-23T22:25:49.605379] [INFO ] [MAIN ] RWT: Loaded 40723 primary data records. [2025-09-23T22:25:49.779603] [DEBUG] [LOCAL ] RXO: Loaded 47792 existing records from primary storage. [2025-09-23T22:25:49.797959] [INFO ] [MAIN ] RXO: Loaded 47792 primary data records. [2025-09-23T22:25:49.999583] [DEBUG] [LOCAL ] RY: Loaded 47921 existing records from primary storage. [2025-09-23T22:25:50.019509] [INFO ] [MAIN ] RY: Loaded 47921 primary data records. [2025-09-23T22:25:50.605183] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:50.606365] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40723 primary records. [2025-09-23T22:25:50.606558] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-23T22:25:50.627102] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-09-23T22:25:50.640413] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-23T22:25:50.642491] [INFO ] [MAIN ] Derivative Progress: 1597/2077 symbols completed. RWT took 1.1s. Estimated remaining: 3m 8s. Rate: 153.5 symbols/min [2025-09-23T22:25:50.643240] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:50.643330] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:50.644119] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 47792 primary records. [2025-09-23T22:25:50.644244] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-23T22:25:50.663974] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-09-23T22:25:50.664203] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-23T22:25:50.666562] [INFO ] [MAIN ] Derivative Progress: 1598/2077 symbols completed. RXO took 1.1s. Estimated remaining: 3m 7s. Rate: 153.5 symbols/min [2025-09-23T22:25:50.667037] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:50.680207] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:50.681016] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47921 primary records. [2025-09-23T22:25:50.681215] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-23T22:25:50.713010] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-09-23T22:25:50.713187] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-23T22:25:50.715974] [INFO ] [MAIN ] Derivative Progress: 1599/2077 symbols completed. RY took 1.1s. Estimated remaining: 3m 7s. Rate: 153.6 symbols/min [2025-09-23T22:25:50.716268] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:50.729224] [DEBUG] [LOCAL ] RYAM: Loaded 35249 existing records from primary storage. [2025-09-23T22:25:50.729755] [INFO ] [MAIN ] RYAM: Loaded 35249 primary data records. [2025-09-23T22:25:50.908023] [DEBUG] [LOCAL ] RYI: Loaded 21555 existing records from primary storage. [2025-09-23T22:25:50.926412] [INFO ] [MAIN ] RYI: Loaded 21555 primary data records. [2025-09-23T22:25:50.951781] [DEBUG] [LOCAL ] RYAN: Loaded 44116 existing records from primary storage. [2025-09-23T22:25:50.963386] [INFO ] [MAIN ] RYAN: Loaded 44116 primary data records. [2025-09-23T22:25:51.774227] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:51.775872] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35249 primary records. [2025-09-23T22:25:51.776394] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-23T22:25:51.796379] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-09-23T22:25:51.797259] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-23T22:25:51.799795] [INFO ] [MAIN ] Derivative Progress: 1600/2077 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 6s. Rate: 153.5 symbols/min [2025-09-23T22:25:51.800464] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:51.838634] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:51.840214] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44116 primary records. [2025-09-23T22:25:51.839324] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:51.841112] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-23T22:25:51.841052] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21555 primary records. [2025-09-23T22:25:51.841264] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-23T22:25:51.871993] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-09-23T22:25:51.872919] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-23T22:25:51.885452] [INFO ] [MAIN ] Derivative Progress: 1601/2077 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 6s. Rate: 153.5 symbols/min [2025-09-23T22:25:51.887330] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:51.888725] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-09-23T22:25:51.890894] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-23T22:25:51.893559] [INFO ] [MAIN ] Derivative Progress: 1602/2077 symbols completed. RYI took 1.2s. Estimated remaining: 3m 6s. Rate: 153.6 symbols/min [2025-09-23T22:25:51.896039] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:51.913157] [DEBUG] [LOCAL ] RZB: Loaded 6275 existing records from primary storage. [2025-09-23T22:25:51.916039] [INFO ] [MAIN ] RZB: Loaded 6275 primary data records. [2025-09-23T22:25:51.914239] [DEBUG] [LOCAL ] RYN: Loaded 45711 existing records from primary storage. [2025-09-23T22:25:51.959837] [INFO ] [MAIN ] RYN: Loaded 45711 primary data records. [2025-09-23T22:25:51.995450] [DEBUG] [LOCAL ] RZC: Loaded 6778 existing records from primary storage. [2025-09-23T22:25:52.015382] [INFO ] [MAIN ] RZC: Loaded 6778 primary data records. [2025-09-23T22:25:52.890936] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:25:52.892371] [INFO ] [MAIN ] RZB: Generated 1793 derivative records from 6275 primary records. [2025-09-23T22:25:52.899971] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-23T22:25:52.907022] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:52.909334] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45711 primary records. [2025-09-23T22:25:52.909469] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-23T22:25:52.944638] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:52.948231] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6778 primary records. [2025-09-23T22:25:52.948791] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-23T22:25:52.951329] [DEBUG] [LOCAL ] RZB: Derivative data saved (1793 records). [2025-09-23T22:25:52.951586] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-23T22:25:52.954906] [INFO ] [MAIN ] Derivative Progress: 1603/2077 symbols completed. RZB took 1.1s. Estimated remaining: 3m 5s. Rate: 153.5 symbols/min [2025-09-23T22:25:52.969288] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-09-23T22:25:52.969580] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-23T22:25:52.974227] [INFO ] [MAIN ] Derivative Progress: 1604/2077 symbols completed. RYN took 1.2s. Estimated remaining: 3m 5s. Rate: 153.6 symbols/min [2025-09-23T22:25:52.971783] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-09-23T22:25:52.974444] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-23T22:25:52.977292] [INFO ] [MAIN ] Derivative Progress: 1605/2077 symbols completed. RZC took 1.1s. Estimated remaining: 3m 4s. Rate: 153.7 symbols/min [2025-09-23T22:25:52.977923] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:52.978185] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:52.978264] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:52.989808] [DEBUG] [LOCAL ] SABA: Loaded 9229 existing records from primary storage. [2025-09-23T22:25:52.990124] [INFO ] [MAIN ] SABA: Loaded 9229 primary data records. [2025-09-23T22:25:53.399624] [DEBUG] [LOCAL ] SA: Loaded 43119 existing records from primary storage. [2025-09-23T22:25:53.401130] [INFO ] [MAIN ] SA: Loaded 43119 primary data records. [2025-09-23T22:25:53.400944] [DEBUG] [LOCAL ] S: Loaded 53545 existing records from primary storage. [2025-09-23T22:25:53.401340] [INFO ] [MAIN ] S: Loaded 53545 primary data records. [2025-09-23T22:25:54.030142] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:54.031728] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9229 primary records. [2025-09-23T22:25:54.031832] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-23T22:25:54.050923] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-09-23T22:25:54.051056] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-23T22:25:54.053387] [INFO ] [MAIN ] Derivative Progress: 1606/2077 symbols completed. SABA took 1.1s. Estimated remaining: 3m 4s. Rate: 153.5 symbols/min [2025-09-23T22:25:54.053921] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:54.089195] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:54.088961] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:54.090211] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53545 primary records. [2025-09-23T22:25:54.091145] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43119 primary records. [2025-09-23T22:25:54.090390] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-23T22:25:54.091297] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-23T22:25:54.128877] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-09-23T22:25:54.129779] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-23T22:25:54.132742] [INFO ] [MAIN ] Derivative Progress: 1607/2077 symbols completed. S took 1.2s. Estimated remaining: 3m 4s. Rate: 153.6 symbols/min [2025-09-23T22:25:54.133914] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:54.144987] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-09-23T22:25:54.145229] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-23T22:25:54.148597] [INFO ] [MAIN ] Derivative Progress: 1608/2077 symbols completed. SA took 1.2s. Estimated remaining: 3m 3s. Rate: 153.7 symbols/min [2025-09-23T22:25:54.149916] [DEBUG] [LOCAL ] SAFE: Loaded 30333 existing records from primary storage. [2025-09-23T22:25:54.150059] [INFO ] [MAIN ] SAFE: Loaded 30333 primary data records. [2025-09-23T22:25:54.149168] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:54.391490] [DEBUG] [LOCAL ] SAH: Loaded 22127 existing records from primary storage. [2025-09-23T22:25:54.511269] [DEBUG] [LOCAL ] SAM: Loaded 21593 existing records from primary storage. [2025-09-23T22:25:54.511400] [INFO ] [MAIN ] SAH: Loaded 22127 primary data records. [2025-09-23T22:25:54.517445] [INFO ] [MAIN ] SAM: Loaded 21593 primary data records. [2025-09-23T22:25:55.218137] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:55.220563] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30333 primary records. [2025-09-23T22:25:55.220987] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-23T22:25:55.244840] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-09-23T22:25:55.245546] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-23T22:25:55.259949] [INFO ] [MAIN ] Derivative Progress: 1609/2077 symbols completed. SAFE took 1.2s. Estimated remaining: 3m 3s. Rate: 153.5 symbols/min [2025-09-23T22:25:55.260700] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:55.261700] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 22127 primary records. [2025-09-23T22:25:55.262899] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-23T22:25:55.262056] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:55.293505] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:55.295117] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21593 primary records. [2025-09-23T22:25:55.295524] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-23T22:25:55.312736] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-09-23T22:25:55.313133] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-23T22:25:55.317406] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-09-23T22:25:55.317528] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-23T22:25:55.317302] [INFO ] [MAIN ] Derivative Progress: 1610/2077 symbols completed. SAH took 1.2s. Estimated remaining: 3m 2s. Rate: 153.6 symbols/min [2025-09-23T22:25:55.317852] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:55.320775] [INFO ] [MAIN ] Derivative Progress: 1611/2077 symbols completed. SAM took 1.2s. Estimated remaining: 3m 2s. Rate: 153.6 symbols/min [2025-09-23T22:25:55.321007] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:55.384372] [DEBUG] [LOCAL ] SAN: Loaded 53020 existing records from primary storage. [2025-09-23T22:25:55.384748] [INFO ] [MAIN ] SAN: Loaded 53020 primary data records. [2025-09-23T22:25:55.527481] [DEBUG] [LOCAL ] SAP: Loaded 50089 existing records from primary storage. [2025-09-23T22:25:55.531969] [INFO ] [MAIN ] SAP: Loaded 50089 primary data records. [2025-09-23T22:25:55.678103] [DEBUG] [LOCAL ] SAND: Loaded 51790 existing records from primary storage. [2025-09-23T22:25:55.678307] [INFO ] [MAIN ] SAND: Loaded 51790 primary data records. [2025-09-23T22:25:56.406096] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:56.407386] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 53020 primary records. [2025-09-23T22:25:56.408789] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-23T22:25:56.430678] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-09-23T22:25:56.434781] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-23T22:25:56.452758] [INFO ] [MAIN ] Derivative Progress: 1612/2077 symbols completed. SAN took 1.2s. Estimated remaining: 3m 2s. Rate: 153.5 symbols/min [2025-09-23T22:25:56.453758] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:56.463235] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:56.462904] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 50089 primary records. [2025-09-23T22:25:56.468911] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-23T22:25:56.469407] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:56.471614] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51790 primary records. [2025-09-23T22:25:56.472107] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-23T22:25:56.506690] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-09-23T22:25:56.507559] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-23T22:25:56.517131] [DEBUG] [LOCAL ] SAR: Loaded 16084 existing records from primary storage. [2025-09-23T22:25:56.516565] [INFO ] [MAIN ] Derivative Progress: 1613/2077 symbols completed. SAP took 1.2s. Estimated remaining: 3m 1s. Rate: 153.5 symbols/min [2025-09-23T22:25:56.517767] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:56.518765] [INFO ] [MAIN ] SAR: Loaded 16084 primary data records. [2025-09-23T22:25:56.543741] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-09-23T22:25:56.575698] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-23T22:25:56.600259] [INFO ] [MAIN ] Derivative Progress: 1614/2077 symbols completed. SAND took 1.3s. Estimated remaining: 3m 1s. Rate: 153.6 symbols/min [2025-09-23T22:25:56.634823] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:56.875916] [DEBUG] [LOCAL ] SARO: Loaded 48800 existing records from primary storage. [2025-09-23T22:25:56.876495] [INFO ] [MAIN ] SARO: Loaded 48800 primary data records. [2025-09-23T22:25:56.928429] [DEBUG] [LOCAL ] SB: Loaded 33273 existing records from primary storage. [2025-09-23T22:25:56.960101] [INFO ] [MAIN ] SB: Loaded 33273 primary data records. [2025-09-23T22:25:57.128939] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:57.141591] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16084 primary records. [2025-09-23T22:25:57.164363] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-23T22:25:57.630293] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-09-23T22:25:57.630788] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-23T22:25:57.632958] [INFO ] [MAIN ] Derivative Progress: 1615/2077 symbols completed. SAR took 1.2s. Estimated remaining: 3m 1s. Rate: 153.5 symbols/min [2025-09-23T22:25:57.634634] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:57.662328] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:57.663275] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33273 primary records. [2025-09-23T22:25:57.663506] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-23T22:25:57.704626] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:57.706145] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48800 primary records. [2025-09-23T22:25:57.707155] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-23T22:25:57.709844] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-09-23T22:25:57.718028] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-23T22:25:57.723514] [INFO ] [MAIN ] Derivative Progress: 1616/2077 symbols completed. SB took 1.1s. Estimated remaining: 3m 0s. Rate: 153.5 symbols/min [2025-09-23T22:25:57.736772] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:57.742555] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-09-23T22:25:57.742784] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-23T22:25:57.742230] [DEBUG] [LOCAL ] SBH: Loaded 49832 existing records from primary storage. [2025-09-23T22:25:57.745717] [INFO ] [MAIN ] SBH: Loaded 49832 primary data records. [2025-09-23T22:25:57.745588] [INFO ] [MAIN ] Derivative Progress: 1617/2077 symbols completed. SARO took 1.2s. Estimated remaining: 2m 60s. Rate: 153.6 symbols/min [2025-09-23T22:25:57.746133] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:57.849412] [DEBUG] [LOCAL ] SBI: Loaded 7771 existing records from primary storage. [2025-09-23T22:25:57.862307] [INFO ] [MAIN ] SBI: Loaded 7771 primary data records. [2025-09-23T22:25:57.927877] [DEBUG] [LOCAL ] SBR: Loaded 7181 existing records from primary storage. [2025-09-23T22:25:58.014916] [INFO ] [MAIN ] SBR: Loaded 7181 primary data records. [2025-09-23T22:25:58.780259] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:58.782387] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49832 primary records. [2025-09-23T22:25:58.782611] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-23T22:25:58.801126] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-09-23T22:25:58.801345] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-23T22:25:58.804585] [INFO ] [MAIN ] Derivative Progress: 1618/2077 symbols completed. SBH took 1.2s. Estimated remaining: 2m 59s. Rate: 153.5 symbols/min [2025-09-23T22:25:58.822034] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:58.823802] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7771 primary records. [2025-09-23T22:25:58.824808] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-23T22:25:58.839446] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:58.846215] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7181 primary records. [2025-09-23T22:25:58.847734] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-23T22:25:58.866834] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-09-23T22:25:58.868005] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-23T22:25:58.870829] [INFO ] [MAIN ] Derivative Progress: 1619/2077 symbols completed. SBI took 1.1s. Estimated remaining: 2m 59s. Rate: 153.5 symbols/min [2025-09-23T22:25:58.872756] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-09-23T22:25:58.872888] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-23T22:25:58.875387] [INFO ] [MAIN ] Derivative Progress: 1620/2077 symbols completed. SBR took 1.1s. Estimated remaining: 2m 58s. Rate: 153.6 symbols/min [2025-09-23T22:25:58.876108] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:58.876181] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:58.876332] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:58.894162] [DEBUG] [LOCAL ] SBSI: Loaded 14715 existing records from primary storage. [2025-09-23T22:25:58.894301] [INFO ] [MAIN ] SBSI: Loaded 14715 primary data records. [2025-09-23T22:25:59.241639] [DEBUG] [LOCAL ] SBS: Loaded 49477 existing records from primary storage. [2025-09-23T22:25:59.242844] [INFO ] [MAIN ] SBS: Loaded 49477 primary data records. [2025-09-23T22:25:59.243553] [DEBUG] [LOCAL ] SBSW: Loaded 52951 existing records from primary storage. [2025-09-23T22:25:59.254930] [INFO ] [MAIN ] SBSW: Loaded 52951 primary data records. [2025-09-23T22:25:59.932225] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:59.933921] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14715 primary records. [2025-09-23T22:25:59.934148] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-23T22:25:59.954606] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-09-23T22:25:59.955009] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-23T22:25:59.957597] [INFO ] [MAIN ] Derivative Progress: 1621/2077 symbols completed. SBSI took 1.1s. Estimated remaining: 2m 58s. Rate: 153.5 symbols/min [2025-09-23T22:25:59.958416] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:25:59.992935] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:59.993346] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:25:59.994201] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 52951 primary records. [2025-09-23T22:25:59.995129] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49477 primary records. [2025-09-23T22:25:59.995292] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-23T22:25:59.995382] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-23T22:26:00.024836] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-09-23T22:26:00.025261] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-23T22:26:00.028320] [INFO ] [MAIN ] Derivative Progress: 1622/2077 symbols completed. SBSW took 1.2s. Estimated remaining: 2m 58s. Rate: 153.6 symbols/min [2025-09-23T22:26:00.031070] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:00.031687] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-09-23T22:26:00.032189] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-23T22:26:00.034251] [INFO ] [MAIN ] Derivative Progress: 1623/2077 symbols completed. SBS took 1.2s. Estimated remaining: 2m 57s. Rate: 153.6 symbols/min [2025-09-23T22:26:00.034812] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:00.058874] [DEBUG] [LOCAL ] SCD: Loaded 12580 existing records from primary storage. [2025-09-23T22:26:00.059837] [INFO ] [MAIN ] SCD: Loaded 12580 primary data records. [2025-09-23T22:26:00.133134] [DEBUG] [LOCAL ] SCCO: Loaded 49382 existing records from primary storage. [2025-09-23T22:26:00.159579] [INFO ] [MAIN ] SCCO: Loaded 49382 primary data records. [2025-09-23T22:26:00.526670] [DEBUG] [LOCAL ] SCI: Loaded 46696 existing records from primary storage. [2025-09-23T22:26:00.599168] [INFO ] [MAIN ] SCI: Loaded 46696 primary data records. [2025-09-23T22:26:01.064332] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:01.077276] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12580 primary records. [2025-09-23T22:26:01.078142] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-23T22:26:01.078601] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:01.087551] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49382 primary records. [2025-09-23T22:26:01.087923] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-23T22:26:01.111615] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-09-23T22:26:01.113681] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-23T22:26:01.116722] [INFO ] [MAIN ] Derivative Progress: 1624/2077 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 57s. Rate: 153.5 symbols/min [2025-09-23T22:26:01.117580] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:01.117732] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-09-23T22:26:01.119056] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-23T22:26:01.121863] [INFO ] [MAIN ] Derivative Progress: 1625/2077 symbols completed. SCD took 1.1s. Estimated remaining: 2m 57s. Rate: 153.6 symbols/min [2025-09-23T22:26:01.122615] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:01.136639] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:01.137966] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46696 primary records. [2025-09-23T22:26:01.138069] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-23T22:26:01.162939] [DEBUG] [LOCAL ] SCL: Loaded 14790 existing records from primary storage. [2025-09-23T22:26:01.163864] [INFO ] [MAIN ] SCL: Loaded 14790 primary data records. [2025-09-23T22:26:01.257784] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-09-23T22:26:01.268611] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-23T22:26:01.278839] [INFO ] [MAIN ] Derivative Progress: 1626/2077 symbols completed. SCI took 1.2s. Estimated remaining: 2m 56s. Rate: 153.6 symbols/min [2025-09-23T22:26:01.282732] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:01.283419] [DEBUG] [LOCAL ] SCM: Loaded 19814 existing records from primary storage. [2025-09-23T22:26:01.294882] [INFO ] [MAIN ] SCM: Loaded 19814 primary data records. [2025-09-23T22:26:01.930975] [DEBUG] [LOCAL ] SCS: Loaded 43081 existing records from primary storage. [2025-09-23T22:26:01.941856] [INFO ] [MAIN ] SCS: Loaded 43081 primary data records. [2025-09-23T22:26:02.212014] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:02.241761] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14790 primary records. [2025-09-23T22:26:02.309624] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-23T22:26:02.532515] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:02.534370] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19814 primary records. [2025-09-23T22:26:02.534510] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-23T22:26:02.539551] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-09-23T22:26:02.553067] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-23T22:26:02.558301] [INFO ] [MAIN ] Derivative Progress: 1627/2077 symbols completed. SCL took 1.4s. Estimated remaining: 2m 56s. Rate: 153.4 symbols/min [2025-09-23T22:26:02.561453] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:02.568203] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-09-23T22:26:02.568530] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-23T22:26:02.571490] [INFO ] [MAIN ] Derivative Progress: 1628/2077 symbols completed. SCM took 1.4s. Estimated remaining: 2m 56s. Rate: 153.5 symbols/min [2025-09-23T22:26:02.572077] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:02.591192] [DEBUG] [LOCAL ] SDHC: Loaded 10495 existing records from primary storage. [2025-09-23T22:26:02.603474] [INFO ] [MAIN ] SDHC: Loaded 10495 primary data records. [2025-09-23T22:26:02.694665] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:02.733048] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43081 primary records. [2025-09-23T22:26:02.764557] [DEBUG] [LOCAL ] SD: Loaded 29043 existing records from primary storage. [2025-09-23T22:26:02.782513] [INFO ] [MAIN ] SD: Loaded 29043 primary data records. [2025-09-23T22:26:02.782755] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-23T22:26:03.346935] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-09-23T22:26:03.348230] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-23T22:26:03.350791] [INFO ] [MAIN ] Derivative Progress: 1629/2077 symbols completed. SCS took 2.1s. Estimated remaining: 2m 55s. Rate: 153.4 symbols/min [2025-09-23T22:26:03.351233] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:03.367411] [DEBUG] [LOCAL ] SDHY: Loaded 10534 existing records from primary storage. [2025-09-23T22:26:03.368022] [INFO ] [MAIN ] SDHY: Loaded 10534 primary data records. [2025-09-23T22:26:03.473570] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:03.492780] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10495 primary records. [2025-09-23T22:26:03.493364] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-23T22:26:03.773191] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-09-23T22:26:03.771940] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:03.774319] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 29043 primary records. [2025-09-23T22:26:03.774557] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-23T22:26:03.773452] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-23T22:26:03.777589] [INFO ] [MAIN ] Derivative Progress: 1630/2077 symbols completed. SDHC took 1.2s. Estimated remaining: 2m 55s. Rate: 153.4 symbols/min [2025-09-23T22:26:03.789431] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:03.798557] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-09-23T22:26:03.798745] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-23T22:26:03.801424] [INFO ] [MAIN ] Derivative Progress: 1631/2077 symbols completed. SD took 1.2s. Estimated remaining: 2m 54s. Rate: 153.5 symbols/min [2025-09-23T22:26:03.802011] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:03.821020] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:03.821892] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10534 primary records. [2025-09-23T22:26:03.822118] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-23T22:26:03.848481] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-09-23T22:26:03.848759] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-23T22:26:03.851252] [INFO ] [MAIN ] Derivative Progress: 1632/2077 symbols completed. SDHY took 0.5s. Estimated remaining: 2m 54s. Rate: 153.6 symbols/min [2025-09-23T22:26:03.852222] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:03.875842] [DEBUG] [LOCAL ] SDRL: Loaded 41969 existing records from primary storage. [2025-09-23T22:26:03.876254] [INFO ] [MAIN ] SDRL: Loaded 41969 primary data records. [2025-09-23T22:26:04.012798] [DEBUG] [LOCAL ] SEG: Loaded 13771 existing records from primary storage. [2025-09-23T22:26:04.007468] [DEBUG] [LOCAL ] SEE: Loaded 48350 existing records from primary storage. [2025-09-23T22:26:04.018608] [INFO ] [MAIN ] SEG: Loaded 13771 primary data records. [2025-09-23T22:26:04.065353] [INFO ] [MAIN ] SEE: Loaded 48350 primary data records. [2025-09-23T22:26:04.865681] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:04.869317] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41969 primary records. [2025-09-23T22:26:04.869504] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-23T22:26:04.893155] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-09-23T22:26:04.894197] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-23T22:26:04.896449] [INFO ] [MAIN ] Derivative Progress: 1633/2077 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 54s. Rate: 153.4 symbols/min [2025-09-23T22:26:04.912376] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:04.913237] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13771 primary records. [2025-09-23T22:26:04.913396] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-23T22:26:04.927438] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:04.938625] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48350 primary records. [2025-09-23T22:26:04.939332] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-23T22:26:04.956065] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-09-23T22:26:04.956356] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-23T22:26:04.959297] [INFO ] [MAIN ] Derivative Progress: 1634/2077 symbols completed. SEG took 1.1s. Estimated remaining: 2m 53s. Rate: 153.5 symbols/min [2025-09-23T22:26:04.961140] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-09-23T22:26:04.961205] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-23T22:26:04.963794] [INFO ] [MAIN ] Derivative Progress: 1635/2077 symbols completed. SEE took 1.2s. Estimated remaining: 2m 53s. Rate: 153.6 symbols/min [2025-09-23T22:26:04.964387] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:04.964327] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:04.964603] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:05.032239] [DEBUG] [LOCAL ] SEM: Loaded 42958 existing records from primary storage. [2025-09-23T22:26:05.044720] [INFO ] [MAIN ] SEM: Loaded 42958 primary data records. [2025-09-23T22:26:05.059259] [DEBUG] [LOCAL ] SEMR: Loaded 41612 existing records from primary storage. [2025-09-23T22:26:05.082203] [DEBUG] [LOCAL ] SEI: Loaded 49651 existing records from primary storage. [2025-09-23T22:26:05.098461] [INFO ] [MAIN ] SEMR: Loaded 41612 primary data records. [2025-09-23T22:26:05.139829] [INFO ] [MAIN ] SEI: Loaded 49651 primary data records. [2025-09-23T22:26:06.082490] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:06.083560] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42958 primary records. [2025-09-23T22:26:06.083845] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-23T22:26:06.133700] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:06.133186] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-09-23T22:26:06.134672] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-23T22:26:06.134557] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41612 primary records. [2025-09-23T22:26:06.137422] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-23T22:26:06.137085] [INFO ] [MAIN ] Derivative Progress: 1636/2077 symbols completed. SEM took 1.2s. Estimated remaining: 2m 52s. Rate: 153.4 symbols/min [2025-09-23T22:26:06.137817] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:06.138097] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:06.140305] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49651 primary records. [2025-09-23T22:26:06.140567] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-23T22:26:06.177615] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-09-23T22:26:06.178727] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-23T22:26:06.181739] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-09-23T22:26:06.181923] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-23T22:26:06.181613] [INFO ] [MAIN ] Derivative Progress: 1637/2077 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 52s. Rate: 153.5 symbols/min [2025-09-23T22:26:06.185499] [INFO ] [MAIN ] Derivative Progress: 1638/2077 symbols completed. SEI took 1.2s. Estimated remaining: 2m 52s. Rate: 153.6 symbols/min [2025-09-23T22:26:06.185987] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:06.185588] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:06.193066] [DEBUG] [LOCAL ] SFB: Loaded 4017 existing records from primary storage. [2025-09-23T22:26:06.193251] [INFO ] [MAIN ] SFB: Loaded 4017 primary data records. [2025-09-23T22:26:06.332532] [DEBUG] [LOCAL ] SFBS: Loaded 21335 existing records from primary storage. [2025-09-23T22:26:06.344714] [INFO ] [MAIN ] SFBS: Loaded 21335 primary data records. [2025-09-23T22:26:06.375071] [DEBUG] [LOCAL ] SF: Loaded 41832 existing records from primary storage. [2025-09-23T22:26:06.428234] [INFO ] [MAIN ] SF: Loaded 41832 primary data records. [2025-09-23T22:26:07.178746] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:07.179690] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4017 primary records. [2025-09-23T22:26:07.181416] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-23T22:26:07.199567] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-09-23T22:26:07.199903] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-23T22:26:07.202017] [INFO ] [MAIN ] Derivative Progress: 1639/2077 symbols completed. SFB took 1.0s. Estimated remaining: 2m 51s. Rate: 153.4 symbols/min [2025-09-23T22:26:07.202576] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:07.229759] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:07.235537] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21335 primary records. [2025-09-23T22:26:07.235667] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-23T22:26:07.236673] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:07.237819] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41832 primary records. [2025-09-23T22:26:07.238134] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-23T22:26:07.268585] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-09-23T22:26:07.269240] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-23T22:26:07.271811] [INFO ] [MAIN ] Derivative Progress: 1640/2077 symbols completed. SF took 1.1s. Estimated remaining: 2m 51s. Rate: 153.5 symbols/min [2025-09-23T22:26:07.272591] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:07.283933] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-09-23T22:26:07.284154] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-23T22:26:07.286784] [INFO ] [MAIN ] Derivative Progress: 1641/2077 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 50s. Rate: 153.6 symbols/min [2025-09-23T22:26:07.287128] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:07.303375] [DEBUG] [LOCAL ] SFL: Loaded 45358 existing records from primary storage. [2025-09-23T22:26:07.303709] [INFO ] [MAIN ] SFL: Loaded 45358 primary data records. [2025-09-23T22:26:07.655238] [DEBUG] [LOCAL ] SG: Loaded 53454 existing records from primary storage. [2025-09-23T22:26:07.656091] [DEBUG] [LOCAL ] SGHC: Loaded 45684 existing records from primary storage. [2025-09-23T22:26:07.656743] [INFO ] [MAIN ] SG: Loaded 53454 primary data records. [2025-09-23T22:26:07.657051] [INFO ] [MAIN ] SGHC: Loaded 45684 primary data records. [2025-09-23T22:26:08.343750] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:08.344782] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45358 primary records. [2025-09-23T22:26:08.347119] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-23T22:26:08.364591] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-09-23T22:26:08.364950] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-23T22:26:08.367921] [INFO ] [MAIN ] Derivative Progress: 1642/2077 symbols completed. SFL took 1.2s. Estimated remaining: 2m 50s. Rate: 153.4 symbols/min [2025-09-23T22:26:08.368579] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:08.392746] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:08.397069] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53454 primary records. [2025-09-23T22:26:08.397298] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-23T22:26:08.396214] [DEBUG] [LOCAL ] SGU: Loaded 6650 existing records from primary storage. [2025-09-23T22:26:08.410603] [INFO ] [MAIN ] SGU: Loaded 6650 primary data records. [2025-09-23T22:26:08.410981] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:08.456634] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 45684 primary records. [2025-09-23T22:26:08.456775] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-23T22:26:08.512809] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-09-23T22:26:08.525978] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-23T22:26:08.528795] [INFO ] [MAIN ] Derivative Progress: 1643/2077 symbols completed. SGHC took 1.2s. Estimated remaining: 2m 50s. Rate: 153.5 symbols/min [2025-09-23T22:26:08.551275] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:08.639607] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-09-23T22:26:08.639786] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-23T22:26:08.759696] [INFO ] [MAIN ] Derivative Progress: 1644/2077 symbols completed. SG took 1.5s. Estimated remaining: 2m 49s. Rate: 153.5 symbols/min [2025-09-23T22:26:08.761385] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:08.804728] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:26:08.805446] [INFO ] [MAIN ] SGU: Generated 1792 derivative records from 6650 primary records. [2025-09-23T22:26:08.805519] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-23T22:26:08.815269] [DEBUG] [LOCAL ] SHCO: Loaded 26193 existing records from primary storage. [2025-09-23T22:26:08.822294] [INFO ] [MAIN ] SHCO: Loaded 26193 primary data records. [2025-09-23T22:26:08.875435] [DEBUG] [LOCAL ] SHAK: Loaded 49171 existing records from primary storage. [2025-09-23T22:26:08.854909] [DEBUG] [LOCAL ] SGU: Derivative data saved (1792 records). [2025-09-23T22:26:08.880844] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-23T22:26:08.887788] [INFO ] [MAIN ] SHAK: Loaded 49171 primary data records. [2025-09-23T22:26:08.903595] [INFO ] [MAIN ] Derivative Progress: 1645/2077 symbols completed. SGU took 0.5s. Estimated remaining: 2m 49s. Rate: 153.6 symbols/min [2025-09-23T22:26:08.929557] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:09.520295] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-09-23T22:26:09.521301] [INFO ] [MAIN ] SHEL: Loaded 53672 primary data records. [2025-09-23T22:26:09.556712] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:09.587442] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 26193 primary records. [2025-09-23T22:26:09.617923] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-23T22:26:09.689833] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:09.701587] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 49171 primary records. [2025-09-23T22:26:09.726774] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-23T22:26:09.933874] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-09-23T22:26:09.934557] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-23T22:26:09.937503] [INFO ] [MAIN ] Derivative Progress: 1646/2077 symbols completed. SHCO took 1.2s. Estimated remaining: 2m 49s. Rate: 153.4 symbols/min [2025-09-23T22:26:09.946877] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:09.963376] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-09-23T22:26:09.963727] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-23T22:26:09.966771] [INFO ] [MAIN ] Derivative Progress: 1647/2077 symbols completed. SHAK took 1.4s. Estimated remaining: 2m 48s. Rate: 153.5 symbols/min [2025-09-23T22:26:09.968329] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:09.995456] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:09.996224] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53672 primary records. [2025-09-23T22:26:09.996287] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-23T22:26:10.014523] [DEBUG] [LOCAL ] SHG: Loaded 27061 existing records from primary storage. [2025-09-23T22:26:10.022896] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-09-23T22:26:10.023068] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-23T22:26:10.025366] [INFO ] [MAIN ] Derivative Progress: 1648/2077 symbols completed. SHEL took 1.1s. Estimated remaining: 2m 48s. Rate: 153.6 symbols/min [2025-09-23T22:26:10.020081] [INFO ] [MAIN ] SHG: Loaded 27061 primary data records. [2025-09-23T22:26:10.346438] [DEBUG] [LOCAL ] SHO: Loaded 49816 existing records from primary storage. [2025-09-23T22:26:10.360517] [INFO ] [MAIN ] SHO: Loaded 49816 primary data records. [2025-09-23T22:26:10.689265] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:10.690272] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 27061 primary records. [2025-09-23T22:26:10.690377] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-23T22:26:10.709581] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-09-23T22:26:10.709826] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-23T22:26:10.712126] [INFO ] [MAIN ] Derivative Progress: 1649/2077 symbols completed. SHG took 0.8s. Estimated remaining: 2m 47s. Rate: 153.5 symbols/min [2025-09-23T22:26:10.724608] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:10.725197] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49816 primary records. [2025-09-23T22:26:10.725258] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-23T22:26:10.740570] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-09-23T22:26:10.740664] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-23T22:26:10.743015] [INFO ] [MAIN ] Derivative Progress: 1650/2077 symbols completed. SHO took 0.8s. Estimated remaining: 2m 47s. Rate: 153.6 symbols/min [2025-09-23T22:26:10.743579] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:10.743922] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:10.744386] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:10.751372] [DEBUG] [LOCAL ] SHOC: Loaded 3779 existing records from primary storage. [2025-09-23T22:26:10.751547] [INFO ] [MAIN ] SHOC: Loaded 3779 primary data records. [2025-09-23T22:26:11.106201] [DEBUG] [LOCAL ] SID: Loaded 42227 existing records from primary storage. [2025-09-23T22:26:11.107168] [INFO ] [MAIN ] SID: Loaded 42227 primary data records. [2025-09-23T22:26:11.170865] [DEBUG] [LOCAL ] SHW: Loaded 50480 existing records from primary storage. [2025-09-23T22:26:11.193162] [INFO ] [MAIN ] SHW: Loaded 50480 primary data records. [2025-09-23T22:26:11.778381] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:11.780191] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3779 primary records. [2025-09-23T22:26:11.780593] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-23T22:26:11.799698] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-09-23T22:26:11.799945] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-23T22:26:11.802778] [INFO ] [MAIN ] Derivative Progress: 1651/2077 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 47s. Rate: 153.4 symbols/min [2025-09-23T22:26:11.803316] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:11.830850] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:11.833058] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42227 primary records. [2025-09-23T22:26:11.833336] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-23T22:26:11.858457] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:11.864924] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50480 primary records. [2025-09-23T22:26:11.866212] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-23T22:26:11.896296] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-09-23T22:26:11.897185] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-23T22:26:11.899724] [INFO ] [MAIN ] Derivative Progress: 1652/2077 symbols completed. SID took 1.2s. Estimated remaining: 2m 46s. Rate: 153.5 symbols/min [2025-09-23T22:26:11.900532] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:11.902985] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-09-23T22:26:11.903205] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-23T22:26:11.905861] [INFO ] [MAIN ] Derivative Progress: 1653/2077 symbols completed. SHW took 1.2s. Estimated remaining: 2m 46s. Rate: 153.6 symbols/min [2025-09-23T22:26:11.906694] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:11.922289] [DEBUG] [LOCAL ] SIG: Loaded 46565 existing records from primary storage. [2025-09-23T22:26:11.922707] [INFO ] [MAIN ] SIG: Loaded 46565 primary data records. [2025-09-23T22:26:12.096496] [DEBUG] [LOCAL ] SII: Loaded 23252 existing records from primary storage. [2025-09-23T22:26:12.111411] [DEBUG] [LOCAL ] SILA: Loaded 31402 existing records from primary storage. [2025-09-23T22:26:12.120314] [INFO ] [MAIN ] SII: Loaded 23252 primary data records. [2025-09-23T22:26:12.126938] [INFO ] [MAIN ] SILA: Loaded 31402 primary data records. [2025-09-23T22:26:13.018158] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:13.019057] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 46565 primary records. [2025-09-23T22:26:13.019281] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-23T22:26:13.040624] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-09-23T22:26:13.053045] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-23T22:26:13.055536] [INFO ] [MAIN ] Derivative Progress: 1654/2077 symbols completed. SIG took 1.3s. Estimated remaining: 2m 45s. Rate: 153.4 symbols/min [2025-09-23T22:26:13.056786] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:13.057712] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23252 primary records. [2025-09-23T22:26:13.056983] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:13.057976] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-23T22:26:13.079098] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-09-23T22:26:13.079329] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-23T22:26:13.082007] [INFO ] [MAIN ] Derivative Progress: 1655/2077 symbols completed. SII took 1.2s. Estimated remaining: 2m 45s. Rate: 153.5 symbols/min [2025-09-23T22:26:13.082574] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:13.096039] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:13.097076] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 31402 primary records. [2025-09-23T22:26:13.097295] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-23T22:26:13.123415] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-09-23T22:26:13.124080] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-23T22:26:13.127387] [INFO ] [MAIN ] Derivative Progress: 1656/2077 symbols completed. SILA took 1.2s. Estimated remaining: 2m 44s. Rate: 153.6 symbols/min [2025-09-23T22:26:13.127632] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:13.141562] [DEBUG] [LOCAL ] SITC: Loaded 41556 existing records from primary storage. [2025-09-23T22:26:13.149877] [INFO ] [MAIN ] SITC: Loaded 41556 primary data records. [2025-09-23T22:26:13.275948] [DEBUG] [LOCAL ] SITE: Loaded 35140 existing records from primary storage. [2025-09-23T22:26:13.292748] [INFO ] [MAIN ] SITE: Loaded 35140 primary data records. [2025-09-23T22:26:13.667174] [DEBUG] [LOCAL ] SJM: Loaded 50145 existing records from primary storage. [2025-09-23T22:26:13.693044] [INFO ] [MAIN ] SJM: Loaded 50145 primary data records. [2025-09-23T22:26:14.209875] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:14.211076] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41556 primary records. [2025-09-23T22:26:14.211871] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-23T22:26:14.252951] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-09-23T22:26:14.254514] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-23T22:26:14.253298] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:14.261072] [INFO ] [MAIN ] Derivative Progress: 1657/2077 symbols completed. SITC took 1.2s. Estimated remaining: 2m 44s. Rate: 153.4 symbols/min [2025-09-23T22:26:14.261960] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35140 primary records. [2025-09-23T22:26:14.262310] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-23T22:26:14.263681] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:14.281501] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-09-23T22:26:14.282786] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-23T22:26:14.286805] [INFO ] [MAIN ] Derivative Progress: 1658/2077 symbols completed. SITE took 1.2s. Estimated remaining: 2m 44s. Rate: 153.5 symbols/min [2025-09-23T22:26:14.288223] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:14.308137] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:14.309190] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50145 primary records. [2025-09-23T22:26:14.309358] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-23T22:26:14.335283] [DEBUG] [LOCAL ] SJT: Loaded 22089 existing records from primary storage. [2025-09-23T22:26:14.336192] [INFO ] [MAIN ] SJT: Loaded 22089 primary data records. [2025-09-23T22:26:14.382145] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-09-23T22:26:14.422726] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-23T22:26:14.462439] [INFO ] [MAIN ] Derivative Progress: 1659/2077 symbols completed. SJM took 1.3s. Estimated remaining: 2m 43s. Rate: 153.6 symbols/min [2025-09-23T22:26:14.463246] [DEBUG] [LOCAL ] SKE: Loaded 35554 existing records from primary storage. [2025-09-23T22:26:14.463449] [INFO ] [MAIN ] SKE: Loaded 35554 primary data records. [2025-09-23T22:26:14.474585] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:14.784210] [DEBUG] [LOCAL ] SKIL: Loaded 6390 existing records from primary storage. [2025-09-23T22:26:14.784706] [INFO ] [MAIN ] SKIL: Loaded 6390 primary data records. [2025-09-23T22:26:15.316344] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:15.317450] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22089 primary records. [2025-09-23T22:26:15.318458] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-23T22:26:15.338103] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-09-23T22:26:15.338263] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-23T22:26:15.340340] [INFO ] [MAIN ] Derivative Progress: 1660/2077 symbols completed. SJT took 1.1s. Estimated remaining: 2m 43s. Rate: 153.4 symbols/min [2025-09-23T22:26:15.340891] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:15.354488] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:15.355302] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 35554 primary records. [2025-09-23T22:26:15.355612] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-23T22:26:15.374038] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-09-23T22:26:15.374223] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-23T22:26:15.377026] [INFO ] [MAIN ] Derivative Progress: 1661/2077 symbols completed. SKE took 1.1s. Estimated remaining: 2m 43s. Rate: 153.5 symbols/min [2025-09-23T22:26:15.377289] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:15.393107] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:15.393842] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6390 primary records. [2025-09-23T22:26:15.394061] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-23T22:26:15.404121] [DEBUG] [LOCAL ] SKLZ: Loaded 11978 existing records from primary storage. [2025-09-23T22:26:15.412090] [INFO ] [MAIN ] SKLZ: Loaded 11978 primary data records. [2025-09-23T22:26:15.546154] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-09-23T22:26:15.546317] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-23T22:26:15.549047] [INFO ] [MAIN ] Derivative Progress: 1662/2077 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 42s. Rate: 153.6 symbols/min [2025-09-23T22:26:15.571440] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:15.764067] [DEBUG] [LOCAL ] SKM: Loaded 35200 existing records from primary storage. [2025-09-23T22:26:15.765171] [INFO ] [MAIN ] SKM: Loaded 35200 primary data records. [2025-09-23T22:26:16.168379] [DEBUG] [LOCAL ] SKT: Loaded 42618 existing records from primary storage. [2025-09-23T22:26:16.168902] [INFO ] [MAIN ] SKT: Loaded 42618 primary data records. [2025-09-23T22:26:16.335767] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:16.375780] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11978 primary records. [2025-09-23T22:26:16.376358] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-23T22:26:16.513103] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-09-23T22:26:16.514109] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-23T22:26:16.516342] [INFO ] [MAIN ] Derivative Progress: 1663/2077 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 42s. Rate: 153.4 symbols/min [2025-09-23T22:26:16.535710] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:16.536444] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35200 primary records. [2025-09-23T22:26:16.536625] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-23T22:26:16.556523] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-09-23T22:26:16.556849] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-23T22:26:16.572424] [INFO ] [MAIN ] Derivative Progress: 1664/2077 symbols completed. SKM took 1.2s. Estimated remaining: 2m 41s. Rate: 153.5 symbols/min [2025-09-23T22:26:16.572720] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:16.573540] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42618 primary records. [2025-09-23T22:26:16.573623] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-23T22:26:16.593576] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-09-23T22:26:16.593685] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-23T22:26:16.596009] [INFO ] [MAIN ] Derivative Progress: 1665/2077 symbols completed. SKT took 1.0s. Estimated remaining: 2m 41s. Rate: 153.6 symbols/min [2025-09-23T22:26:16.596553] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:16.597157] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:16.597206] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:16.645538] [DEBUG] [LOCAL ] SKY: Loaded 37730 existing records from primary storage. [2025-09-23T22:26:16.646018] [INFO ] [MAIN ] SKY: Loaded 37730 primary data records. [2025-09-23T22:26:16.744520] [DEBUG] [LOCAL ] SLF: Loaded 39010 existing records from primary storage. [2025-09-23T22:26:16.756516] [INFO ] [MAIN ] SLF: Loaded 39010 primary data records. [2025-09-23T22:26:16.869157] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-23T22:26:16.897055] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-09-23T22:26:17.636805] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:17.638205] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 37730 primary records. [2025-09-23T22:26:17.638363] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-23T22:26:17.652766] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:17.662598] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 39010 primary records. [2025-09-23T22:26:17.666859] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-23T22:26:17.689276] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:17.690240] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-09-23T22:26:17.690598] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-23T22:26:17.699496] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-09-23T22:26:17.699808] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-23T22:26:17.710015] [INFO ] [MAIN ] Derivative Progress: 1666/2077 symbols completed. SLF took 1.1s. Estimated remaining: 2m 41s. Rate: 153.4 symbols/min [2025-09-23T22:26:17.714699] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:17.719065] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-09-23T22:26:17.720159] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-09-23T22:26:17.720609] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-23T22:26:17.720673] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-23T22:26:17.723126] [INFO ] [MAIN ] Derivative Progress: 1667/2077 symbols completed. SLB took 1.1s. Estimated remaining: 2m 40s. Rate: 153.5 symbols/min [2025-09-23T22:26:17.726164] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:17.726353] [INFO ] [MAIN ] Derivative Progress: 1668/2077 symbols completed. SKY took 1.1s. Estimated remaining: 2m 40s. Rate: 153.6 symbols/min [2025-09-23T22:26:17.726894] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:17.797370] [DEBUG] [LOCAL ] SLGN: Loaded 40325 existing records from primary storage. [2025-09-23T22:26:17.798129] [INFO ] [MAIN ] SLGN: Loaded 40325 primary data records. [2025-09-23T22:26:17.903545] [DEBUG] [LOCAL ] SLQT: Loaded 43976 existing records from primary storage. [2025-09-23T22:26:17.926147] [INFO ] [MAIN ] SLQT: Loaded 43976 primary data records. [2025-09-23T22:26:17.939720] [DEBUG] [LOCAL ] SLG: Loaded 45568 existing records from primary storage. [2025-09-23T22:26:17.955555] [INFO ] [MAIN ] SLG: Loaded 45568 primary data records. [2025-09-23T22:26:18.831408] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:18.832350] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40325 primary records. [2025-09-23T22:26:18.832612] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-23T22:26:18.851488] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-09-23T22:26:18.853994] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-23T22:26:18.856863] [INFO ] [MAIN ] Derivative Progress: 1669/2077 symbols completed. SLGN took 1.1s. Estimated remaining: 2m 40s. Rate: 153.4 symbols/min [2025-09-23T22:26:18.857331] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:18.882764] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:18.891326] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45568 primary records. [2025-09-23T22:26:18.891903] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-23T22:26:18.891849] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:18.893449] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43976 primary records. [2025-09-23T22:26:18.893572] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-23T22:26:18.939987] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-09-23T22:26:18.940271] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-23T22:26:18.952773] [INFO ] [MAIN ] Derivative Progress: 1670/2077 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 39s. Rate: 153.5 symbols/min [2025-09-23T22:26:18.955049] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-09-23T22:26:18.955452] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-23T22:26:18.956071] [DEBUG] [LOCAL ] SLVM: Loaded 27970 existing records from primary storage. [2025-09-23T22:26:18.955265] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:18.958948] [INFO ] [MAIN ] SLVM: Loaded 27970 primary data records. [2025-09-23T22:26:18.958833] [INFO ] [MAIN ] Derivative Progress: 1671/2077 symbols completed. SLG took 1.2s. Estimated remaining: 2m 39s. Rate: 153.6 symbols/min [2025-09-23T22:26:18.982024] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:19.154281] [DEBUG] [LOCAL ] SMBK: Loaded 8249 existing records from primary storage. [2025-09-23T22:26:19.268542] [INFO ] [MAIN ] SMBK: Loaded 8249 primary data records. [2025-09-23T22:26:19.453031] [DEBUG] [LOCAL ] SM: Loaded 52323 existing records from primary storage. [2025-09-23T22:26:19.482250] [INFO ] [MAIN ] SM: Loaded 52323 primary data records. [2025-09-23T22:26:19.919069] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:19.920162] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27970 primary records. [2025-09-23T22:26:19.920329] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-23T22:26:19.937252] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-09-23T22:26:19.937538] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-23T22:26:19.939524] [INFO ] [MAIN ] Derivative Progress: 1672/2077 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 38s. Rate: 153.5 symbols/min [2025-09-23T22:26:19.940517] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:19.958136] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:19.961940] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8249 primary records. [2025-09-23T22:26:19.962156] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-23T22:26:19.979216] [DEBUG] [LOCAL ] SMC: Loaded 11481 existing records from primary storage. [2025-09-23T22:26:19.979549] [INFO ] [MAIN ] SMC: Loaded 11481 primary data records. [2025-09-23T22:26:20.091692] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-09-23T22:26:20.099466] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:20.102919] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-23T22:26:20.105260] [INFO ] [MAIN ] Derivative Progress: 1673/2077 symbols completed. SMBK took 1.1s. Estimated remaining: 2m 38s. Rate: 153.5 symbols/min [2025-09-23T22:26:20.105946] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:20.106629] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52323 primary records. [2025-09-23T22:26:20.117101] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-23T22:26:20.351936] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-09-23T22:26:20.352205] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-23T22:26:20.354894] [INFO ] [MAIN ] Derivative Progress: 1674/2077 symbols completed. SM took 1.4s. Estimated remaining: 2m 37s. Rate: 153.5 symbols/min [2025-09-23T22:26:20.355348] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:20.392123] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:20.406019] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11481 primary records. [2025-09-23T22:26:20.406251] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-23T22:26:20.407839] [DEBUG] [LOCAL ] SMFG: Loaded 48120 existing records from primary storage. [2025-09-23T22:26:20.408266] [INFO ] [MAIN ] SMFG: Loaded 48120 primary data records. [2025-09-23T22:26:20.548898] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-09-23T22:26:20.550109] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-23T22:26:20.549722] [DEBUG] [LOCAL ] SMG: Loaded 43981 existing records from primary storage. [2025-09-23T22:26:20.562630] [INFO ] [MAIN ] Derivative Progress: 1675/2077 symbols completed. SMC took 0.6s. Estimated remaining: 2m 37s. Rate: 153.6 symbols/min [2025-09-23T22:26:20.573040] [INFO ] [MAIN ] SMG: Loaded 43981 primary data records. [2025-09-23T22:26:20.600226] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:20.952009] [DEBUG] [LOCAL ] SMHI: Loaded 13940 existing records from primary storage. [2025-09-23T22:26:21.000728] [INFO ] [MAIN ] SMHI: Loaded 13940 primary data records. [2025-09-23T22:26:21.424095] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:21.425776] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48120 primary records. [2025-09-23T22:26:21.426676] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-23T22:26:21.458310] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-09-23T22:26:21.458947] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:21.459162] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-23T22:26:21.459929] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43981 primary records. [2025-09-23T22:26:21.462041] [INFO ] [MAIN ] Derivative Progress: 1676/2077 symbols completed. SMFG took 1.4s. Estimated remaining: 2m 37s. Rate: 153.5 symbols/min [2025-09-23T22:26:21.462541] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:21.460044] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-23T22:26:21.489017] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-09-23T22:26:21.489235] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-23T22:26:21.491916] [INFO ] [MAIN ] Derivative Progress: 1677/2077 symbols completed. SMG took 1.1s. Estimated remaining: 2m 36s. Rate: 153.6 symbols/min [2025-09-23T22:26:21.499924] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:21.505520] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:21.506264] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13940 primary records. [2025-09-23T22:26:21.513095] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-23T22:26:21.514347] [DEBUG] [LOCAL ] SMP: Loaded 19834 existing records from primary storage. [2025-09-23T22:26:21.514509] [INFO ] [MAIN ] SMP: Loaded 19834 primary data records. [2025-09-23T22:26:21.626924] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-09-23T22:26:21.633413] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-23T22:26:21.648381] [INFO ] [MAIN ] Derivative Progress: 1678/2077 symbols completed. SMHI took 1.0s. Estimated remaining: 2m 36s. Rate: 153.6 symbols/min [2025-09-23T22:26:21.881867] [DEBUG] [LOCAL ] SMRT: Loaded 44255 existing records from primary storage. [2025-09-23T22:26:21.882714] [INFO ] [MAIN ] SMRT: Loaded 44255 primary data records. [2025-09-23T22:26:22.258772] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:22.260115] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19834 primary records. [2025-09-23T22:26:22.260235] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-23T22:26:22.280237] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-09-23T22:26:22.280527] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-23T22:26:22.282763] [INFO ] [MAIN ] Derivative Progress: 1679/2077 symbols completed. SMP took 0.8s. Estimated remaining: 2m 36s. Rate: 153.6 symbols/min [2025-09-23T22:26:22.297626] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:22.298191] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 44255 primary records. [2025-09-23T22:26:22.298252] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-23T22:26:22.315766] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-09-23T22:26:22.315874] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-23T22:26:22.318111] [INFO ] [MAIN ] Derivative Progress: 1680/2077 symbols completed. SMRT took 0.8s. Estimated remaining: 2m 35s. Rate: 153.6 symbols/min [2025-09-23T22:26:22.318824] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:22.318591] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:22.319616] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:22.362299] [DEBUG] [LOCAL ] SMWB: Loaded 32980 existing records from primary storage. [2025-09-23T22:26:22.362456] [INFO ] [MAIN ] SMWB: Loaded 32980 primary data records. [2025-09-23T22:26:22.462094] [DEBUG] [LOCAL ] SNA: Loaded 26430 existing records from primary storage. [2025-09-23T22:26:22.484279] [INFO ] [MAIN ] SNA: Loaded 26430 primary data records. [2025-09-23T22:26:22.645675] [DEBUG] [LOCAL ] SN: Loaded 49836 existing records from primary storage. [2025-09-23T22:26:22.753939] [INFO ] [MAIN ] SN: Loaded 49836 primary data records. [2025-09-23T22:26:23.328577] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:23.329894] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32980 primary records. [2025-09-23T22:26:23.330090] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-23T22:26:23.365141] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:23.367202] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 26430 primary records. [2025-09-23T22:26:23.367386] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-23T22:26:23.375480] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-09-23T22:26:23.380308] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-23T22:26:23.383400] [INFO ] [MAIN ] Derivative Progress: 1681/2077 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 35s. Rate: 153.5 symbols/min [2025-09-23T22:26:23.391568] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:23.384293] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:23.396817] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49836 primary records. [2025-09-23T22:26:23.397976] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-23T22:26:23.401487] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-09-23T22:26:23.402169] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-23T22:26:23.404721] [INFO ] [MAIN ] Derivative Progress: 1682/2077 symbols completed. SNA took 1.1s. Estimated remaining: 2m 34s. Rate: 153.6 symbols/min [2025-09-23T22:26:23.412580] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:23.424768] [DEBUG] [LOCAL ] SNDA: Loaded 4700 existing records from primary storage. [2025-09-23T22:26:23.424902] [INFO ] [MAIN ] SNDA: Loaded 4700 primary data records. [2025-09-23T22:26:23.475415] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-09-23T22:26:23.475553] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-23T22:26:23.478284] [INFO ] [MAIN ] Derivative Progress: 1683/2077 symbols completed. SN took 1.2s. Estimated remaining: 2m 34s. Rate: 153.6 symbols/min [2025-09-23T22:26:23.491803] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:23.763539] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-23T22:26:23.772320] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-09-23T22:26:23.914117] [DEBUG] [LOCAL ] SNDR: Loaded 40672 existing records from primary storage. [2025-09-23T22:26:23.920426] [INFO ] [MAIN ] SNDR: Loaded 40672 primary data records. [2025-09-23T22:26:24.489116] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:26:24.491525] [INFO ] [MAIN ] SNDA: Generated 1792 derivative records from 4700 primary records. [2025-09-23T22:26:24.492920] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-23T22:26:24.510408] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1792 records). [2025-09-23T22:26:24.510722] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-23T22:26:24.513082] [INFO ] [MAIN ] Derivative Progress: 1684/2077 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 34s. Rate: 153.5 symbols/min [2025-09-23T22:26:24.513571] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:24.534144] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:24.535227] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-09-23T22:26:24.535490] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-23T22:26:24.577507] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:24.579393] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40672 primary records. [2025-09-23T22:26:24.580463] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-23T22:26:24.590490] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-09-23T22:26:24.594607] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-23T22:26:24.597290] [INFO ] [MAIN ] Derivative Progress: 1685/2077 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 33s. Rate: 153.6 symbols/min [2025-09-23T22:26:24.598478] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:24.614361] [DEBUG] [LOCAL ] SNN: Loaded 44348 existing records from primary storage. [2025-09-23T22:26:24.614840] [INFO ] [MAIN ] SNN: Loaded 44348 primary data records. [2025-09-23T22:26:24.637451] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-09-23T22:26:24.647768] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-23T22:26:24.650421] [INFO ] [MAIN ] Derivative Progress: 1686/2077 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 33s. Rate: 153.6 symbols/min [2025-09-23T22:26:24.663117] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:24.967132] [DEBUG] [LOCAL ] SNV: Loaded 48909 existing records from primary storage. [2025-09-23T22:26:24.968230] [INFO ] [MAIN ] SNV: Loaded 48909 primary data records. [2025-09-23T22:26:25.019461] [DEBUG] [LOCAL ] SNX: Loaded 39757 existing records from primary storage. [2025-09-23T22:26:25.041323] [INFO ] [MAIN ] SNX: Loaded 39757 primary data records. [2025-09-23T22:26:25.646494] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:25.647730] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44348 primary records. [2025-09-23T22:26:25.648012] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-23T22:26:25.675054] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-09-23T22:26:25.676906] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-23T22:26:25.679328] [INFO ] [MAIN ] Derivative Progress: 1687/2077 symbols completed. SNN took 1.2s. Estimated remaining: 2m 32s. Rate: 153.5 symbols/min [2025-09-23T22:26:25.679832] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:25.697579] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:25.698371] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48909 primary records. [2025-09-23T22:26:25.698665] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-23T22:26:25.727830] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:25.731130] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39757 primary records. [2025-09-23T22:26:25.732463] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-09-23T22:26:25.732410] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-23T22:26:25.732545] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-23T22:26:25.744230] [INFO ] [MAIN ] Derivative Progress: 1688/2077 symbols completed. SNV took 1.1s. Estimated remaining: 2m 32s. Rate: 153.6 symbols/min [2025-09-23T22:26:25.755911] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:25.773228] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-09-23T22:26:25.773526] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-23T22:26:25.776216] [INFO ] [MAIN ] Derivative Progress: 1689/2077 symbols completed. SNX took 1.1s. Estimated remaining: 2m 32s. Rate: 153.7 symbols/min [2025-09-23T22:26:25.777428] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:25.777205] [DEBUG] [LOCAL ] SOBO: Loaded 39661 existing records from primary storage. [2025-09-23T22:26:25.777677] [INFO ] [MAIN ] SOBO: Loaded 39661 primary data records. [2025-09-23T22:26:25.889166] [DEBUG] [LOCAL ] SOJC: Loaded 5072 existing records from primary storage. [2025-09-23T22:26:25.892895] [INFO ] [MAIN ] SOJC: Loaded 5072 primary data records. [2025-09-23T22:26:26.224874] [DEBUG] [LOCAL ] SOC: Loaded 50247 existing records from primary storage. [2025-09-23T22:26:26.237499] [INFO ] [MAIN ] SOC: Loaded 50247 primary data records. [2025-09-23T22:26:26.830100] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:26.831252] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39661 primary records. [2025-09-23T22:26:26.831484] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-23T22:26:26.865289] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-09-23T22:26:26.866141] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:26.866883] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 5072 primary records. [2025-09-23T22:26:26.866990] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-23T22:26:26.869275] [INFO ] [MAIN ] Derivative Progress: 1690/2077 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 31s. Rate: 153.5 symbols/min [2025-09-23T22:26:26.872140] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-23T22:26:26.871442] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:26.895746] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:26.899813] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50247 primary records. [2025-09-23T22:26:26.899905] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-23T22:26:26.925393] [DEBUG] [LOCAL ] SOJD: Loaded 12955 existing records from primary storage. [2025-09-23T22:26:26.926565] [INFO ] [MAIN ] SOJD: Loaded 12955 primary data records. [2025-09-23T22:26:26.932889] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-09-23T22:26:26.940631] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-23T22:26:26.954212] [INFO ] [MAIN ] Derivative Progress: 1691/2077 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 31s. Rate: 153.6 symbols/min [2025-09-23T22:26:26.960185] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:27.036461] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-09-23T22:26:27.062021] [DEBUG] [LOCAL ] SOJE: Loaded 9323 existing records from primary storage. [2025-09-23T22:26:27.062146] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-23T22:26:27.075589] [INFO ] [MAIN ] Derivative Progress: 1692/2077 symbols completed. SOC took 1.3s. Estimated remaining: 2m 30s. Rate: 153.6 symbols/min [2025-09-23T22:26:27.080856] [INFO ] [MAIN ] SOJE: Loaded 9323 primary data records. [2025-09-23T22:26:27.116844] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:27.422232] [DEBUG] [LOCAL ] SOL: Loaded 13538 existing records from primary storage. [2025-09-23T22:26:27.453010] [INFO ] [MAIN ] SOL: Loaded 13538 primary data records. [2025-09-23T22:26:27.924148] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:27.926180] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12955 primary records. [2025-09-23T22:26:27.926281] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-23T22:26:27.958324] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:27.959392] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9323 primary records. [2025-09-23T22:26:27.959964] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-23T22:26:27.960856] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-09-23T22:26:27.961094] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-23T22:26:27.963173] [INFO ] [MAIN ] Derivative Progress: 1693/2077 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 30s. Rate: 153.5 symbols/min [2025-09-23T22:26:27.980309] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-09-23T22:26:27.981164] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-23T22:26:27.984124] [INFO ] [MAIN ] Derivative Progress: 1694/2077 symbols completed. SOJE took 1.0s. Estimated remaining: 2m 30s. Rate: 153.6 symbols/min [2025-09-23T22:26:28.003203] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:28.004137] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13538 primary records. [2025-09-23T22:26:28.004224] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-23T22:26:28.023838] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-09-23T22:26:28.023946] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-23T22:26:28.026411] [INFO ] [MAIN ] Derivative Progress: 1695/2077 symbols completed. SOL took 0.9s. Estimated remaining: 2m 29s. Rate: 153.7 symbols/min [2025-09-23T22:26:28.027069] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:28.027279] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:28.027017] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:28.084317] [DEBUG] [LOCAL ] SOLV: Loaded 44106 existing records from primary storage. [2025-09-23T22:26:28.085106] [INFO ] [MAIN ] SOLV: Loaded 44106 primary data records. [2025-09-23T22:26:28.187022] [DEBUG] [LOCAL ] SON: Loaded 42880 existing records from primary storage. [2025-09-23T22:26:28.197559] [INFO ] [MAIN ] SON: Loaded 42880 primary data records. [2025-09-23T22:26:28.393751] [DEBUG] [LOCAL ] SONY: Loaded 53357 existing records from primary storage. [2025-09-23T22:26:28.556924] [INFO ] [MAIN ] SONY: Loaded 53357 primary data records. [2025-09-23T22:26:29.085008] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:29.086474] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 44106 primary records. [2025-09-23T22:26:29.086763] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-23T22:26:29.117881] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:29.119985] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 42880 primary records. [2025-09-23T22:26:29.120749] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-23T22:26:29.135919] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-09-23T22:26:29.140150] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-23T22:26:29.142103] [INFO ] [MAIN ] Derivative Progress: 1696/2077 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 29s. Rate: 153.5 symbols/min [2025-09-23T22:26:29.140073] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-09-23T22:26:29.142397] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:29.142548] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-23T22:26:29.147350] [INFO ] [MAIN ] Derivative Progress: 1697/2077 symbols completed. SON took 1.1s. Estimated remaining: 2m 28s. Rate: 153.6 symbols/min [2025-09-23T22:26:29.148030] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:29.164745] [DEBUG] [LOCAL ] SOR: Loaded 2927 existing records from primary storage. [2025-09-23T22:26:29.164663] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:29.165499] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53357 primary records. [2025-09-23T22:26:29.165583] [INFO ] [MAIN ] SOR: Loaded 2927 primary data records. [2025-09-23T22:26:29.204514] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-23T22:26:29.282460] [DEBUG] [LOCAL ] SOS: Loaded 7951 existing records from primary storage. [2025-09-23T22:26:29.286172] [INFO ] [MAIN ] SOS: Loaded 7951 primary data records. [2025-09-23T22:26:29.595522] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-09-23T22:26:29.607570] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-23T22:26:29.616360] [INFO ] [MAIN ] Derivative Progress: 1698/2077 symbols completed. SONY took 1.6s. Estimated remaining: 2m 28s. Rate: 153.6 symbols/min [2025-09-23T22:26:29.622055] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:29.817804] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:29.826881] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2927 primary records. [2025-09-23T22:26:29.827108] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-23T22:26:29.854867] [DEBUG] [LOCAL ] SPB: Loaded 34262 existing records from primary storage. [2025-09-23T22:26:29.867721] [INFO ] [MAIN ] SPB: Loaded 34262 primary data records. [2025-09-23T22:26:29.868211] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-09-23T22:26:29.868633] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-23T22:26:29.870763] [INFO ] [MAIN ] Derivative Progress: 1699/2077 symbols completed. SOR took 0.7s. Estimated remaining: 2m 28s. Rate: 153.6 symbols/min [2025-09-23T22:26:29.868522] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:29.882755] [INFO ] [MAIN ] SOS: Generated 1794 derivative records from 7951 primary records. [2025-09-23T22:26:29.901639] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:29.892739] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-23T22:26:29.984511] [DEBUG] [LOCAL ] SOS: Derivative data saved (1794 records). [2025-09-23T22:26:29.995886] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-23T22:26:29.998549] [INFO ] [MAIN ] Derivative Progress: 1700/2077 symbols completed. SOS took 0.9s. Estimated remaining: 2m 27s. Rate: 153.7 symbols/min [2025-09-23T22:26:30.004503] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:30.218686] [DEBUG] [LOCAL ] SPE: Loaded 6367 existing records from primary storage. [2025-09-23T22:26:30.219866] [INFO ] [MAIN ] SPE: Loaded 6367 primary data records. [2025-09-23T22:26:30.352218] [DEBUG] [LOCAL ] SPCE: Loaded 49829 existing records from primary storage. [2025-09-23T22:26:30.352455] [INFO ] [MAIN ] SPCE: Loaded 49829 primary data records. [2025-09-23T22:26:30.946528] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:30.947976] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34262 primary records. [2025-09-23T22:26:30.948353] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-23T22:26:30.967270] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-09-23T22:26:30.968071] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-23T22:26:30.970442] [INFO ] [MAIN ] Derivative Progress: 1701/2077 symbols completed. SPB took 1.4s. Estimated remaining: 2m 27s. Rate: 153.5 symbols/min [2025-09-23T22:26:30.971187] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:30.991358] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:30.992371] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6367 primary records. [2025-09-23T22:26:30.992664] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-23T22:26:31.010904] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-09-23T22:26:31.013981] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-23T22:26:31.018000] [INFO ] [MAIN ] Derivative Progress: 1702/2077 symbols completed. SPE took 1.0s. Estimated remaining: 2m 26s. Rate: 153.6 symbols/min [2025-09-23T22:26:31.018687] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:31.034132] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:31.034952] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49829 primary records. [2025-09-23T22:26:31.035031] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-23T22:26:31.064098] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-09-23T22:26:31.064335] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-23T22:26:31.067053] [INFO ] [MAIN ] Derivative Progress: 1703/2077 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 26s. Rate: 153.7 symbols/min [2025-09-23T22:26:31.067482] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:31.091965] [DEBUG] [LOCAL ] SPG: Loaded 50439 existing records from primary storage. [2025-09-23T22:26:31.092229] [INFO ] [MAIN ] SPG: Loaded 50439 primary data records. [2025-09-23T22:26:31.199969] [DEBUG] [LOCAL ] SPH: Loaded 18217 existing records from primary storage. [2025-09-23T22:26:31.218403] [INFO ] [MAIN ] SPH: Loaded 18217 primary data records. [2025-09-23T22:26:31.532886] [DEBUG] [LOCAL ] SPGI: Loaded 45815 existing records from primary storage. [2025-09-23T22:26:31.542831] [INFO ] [MAIN ] SPGI: Loaded 45815 primary data records. [2025-09-23T22:26:32.098326] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:32.099947] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50439 primary records. [2025-09-23T22:26:32.100086] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-23T22:26:32.120894] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-09-23T22:26:32.121271] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-23T22:26:32.123460] [INFO ] [MAIN ] Derivative Progress: 1704/2077 symbols completed. SPG took 1.2s. Estimated remaining: 2m 26s. Rate: 153.5 symbols/min [2025-09-23T22:26:32.131546] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:32.137442] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:32.138771] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 18217 primary records. [2025-09-23T22:26:32.139021] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-23T22:26:32.174183] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-09-23T22:26:32.174400] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:32.175400] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45815 primary records. [2025-09-23T22:26:32.175529] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-23T22:26:32.176180] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-23T22:26:32.179360] [INFO ] [MAIN ] Derivative Progress: 1705/2077 symbols completed. SPH took 1.1s. Estimated remaining: 2m 25s. Rate: 153.6 symbols/min [2025-09-23T22:26:32.190854] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:32.196249] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-09-23T22:26:32.196680] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-23T22:26:32.209434] [INFO ] [MAIN ] Derivative Progress: 1706/2077 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 25s. Rate: 153.7 symbols/min [2025-09-23T22:26:32.209827] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:32.228722] [DEBUG] [LOCAL ] SPMC: Loaded 5600 existing records from primary storage. [2025-09-23T22:26:32.229875] [INFO ] [MAIN ] SPMC: Loaded 5600 primary data records. [2025-09-23T22:26:32.252222] [DEBUG] [LOCAL ] SPHR: Loaded 40190 existing records from primary storage. [2025-09-23T22:26:32.263334] [INFO ] [MAIN ] SPHR: Loaded 40190 primary data records. [2025-09-23T22:26:32.499510] [DEBUG] [LOCAL ] SPIR: Loaded 37472 existing records from primary storage. [2025-09-23T22:26:32.615746] [INFO ] [MAIN ] SPIR: Loaded 37472 primary data records. [2025-09-23T22:26:33.229541] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:33.230452] [INFO ] [MAIN ] SPMC: Generated 1793 derivative records from 5600 primary records. [2025-09-23T22:26:33.231049] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-23T22:26:33.262975] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:33.263785] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1793 records). [2025-09-23T22:26:33.263947] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-23T22:26:33.265244] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40190 primary records. [2025-09-23T22:26:33.267784] [INFO ] [MAIN ] Derivative Progress: 1707/2077 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 25s. Rate: 153.5 symbols/min [2025-09-23T22:26:33.265778] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-23T22:26:33.269458] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:33.298729] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-09-23T22:26:33.298986] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-23T22:26:33.301575] [INFO ] [MAIN ] Derivative Progress: 1708/2077 symbols completed. SPHR took 1.2s. Estimated remaining: 2m 24s. Rate: 153.6 symbols/min [2025-09-23T22:26:33.302014] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:33.302910] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37472 primary records. [2025-09-23T22:26:33.303063] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-23T22:26:33.327402] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-09-23T22:26:33.327560] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-23T22:26:33.330365] [INFO ] [MAIN ] Derivative Progress: 1709/2077 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 24s. Rate: 153.7 symbols/min [2025-09-23T22:26:33.343803] [DEBUG] [LOCAL ] SPNT: Loaded 34862 existing records from primary storage. [2025-09-23T22:26:33.343906] [INFO ] [MAIN ] SPNT: Loaded 34862 primary data records. [2025-09-23T22:26:33.662471] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:33.663155] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34862 primary records. [2025-09-23T22:26:33.663219] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-23T22:26:33.679012] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-09-23T22:26:33.679075] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-23T22:26:33.681116] [INFO ] [MAIN ] Derivative Progress: 1710/2077 symbols completed. SPNT took 0.4s. Estimated remaining: 2m 23s. Rate: 153.7 symbols/min [2025-09-23T22:26:33.681631] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:33.682268] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:33.682338] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:33.692364] [DEBUG] [LOCAL ] SPRU: Loaded 8448 existing records from primary storage. [2025-09-23T22:26:33.692493] [INFO ] [MAIN ] SPRU: Loaded 8448 primary data records. [2025-09-23T22:26:34.054399] [DEBUG] [LOCAL ] SPR: Loaded 41283 existing records from primary storage. [2025-09-23T22:26:34.072055] [INFO ] [MAIN ] SPR: Loaded 41283 primary data records. [2025-09-23T22:26:34.107445] [DEBUG] [LOCAL ] SPOT: Loaded 50860 existing records from primary storage. [2025-09-23T22:26:34.148770] [INFO ] [MAIN ] SPOT: Loaded 50860 primary data records. [2025-09-23T22:26:34.767217] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:34.769181] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 8448 primary records. [2025-09-23T22:26:34.769413] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-23T22:26:34.787240] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-09-23T22:26:34.789356] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-23T22:26:34.792792] [INFO ] [MAIN ] Derivative Progress: 1711/2077 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 23s. Rate: 153.6 symbols/min [2025-09-23T22:26:34.793203] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:34.812824] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:34.813621] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41283 primary records. [2025-09-23T22:26:34.813825] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-23T22:26:34.844428] [DEBUG] [LOCAL ] SPXC: Loaded 23425 existing records from primary storage. [2025-09-23T22:26:34.844881] [INFO ] [MAIN ] SPXC: Loaded 23425 primary data records. [2025-09-23T22:26:34.869505] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-09-23T22:26:34.889806] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-23T22:26:34.925959] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:34.916429] [INFO ] [MAIN ] Derivative Progress: 1712/2077 symbols completed. SPR took 1.2s. Estimated remaining: 2m 23s. Rate: 153.6 symbols/min [2025-09-23T22:26:34.943940] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50860 primary records. [2025-09-23T22:26:34.943276] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:34.949278] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-23T22:26:35.173958] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-09-23T22:26:35.187794] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-23T22:26:35.190619] [INFO ] [MAIN ] Derivative Progress: 1713/2077 symbols completed. SPOT took 1.5s. Estimated remaining: 2m 22s. Rate: 153.6 symbols/min [2025-09-23T22:26:35.187353] [DEBUG] [LOCAL ] SPXX: Loaded 8932 existing records from primary storage. [2025-09-23T22:26:35.191024] [INFO ] [MAIN ] SPXX: Loaded 8932 primary data records. [2025-09-23T22:26:35.190978] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:35.538478] [DEBUG] [LOCAL ] SQM: Loaded 48546 existing records from primary storage. [2025-09-23T22:26:35.539034] [INFO ] [MAIN ] SQM: Loaded 48546 primary data records. [2025-09-23T22:26:35.621287] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:35.640775] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23425 primary records. [2025-09-23T22:26:35.657298] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-23T22:26:35.713344] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-09-23T22:26:35.730547] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-23T22:26:35.755270] [INFO ] [MAIN ] Derivative Progress: 1714/2077 symbols completed. SPXC took 1.0s. Estimated remaining: 2m 22s. Rate: 153.6 symbols/min [2025-09-23T22:26:35.755913] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:35.897248] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:35.898266] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 8932 primary records. [2025-09-23T22:26:35.898358] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-23T22:26:35.917990] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-09-23T22:26:35.918374] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-23T22:26:35.922297] [INFO ] [MAIN ] Derivative Progress: 1715/2077 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 21s. Rate: 153.7 symbols/min [2025-09-23T22:26:35.922750] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:35.946779] [DEBUG] [LOCAL ] SQNS: Loaded 25885 existing records from primary storage. [2025-09-23T22:26:35.948019] [INFO ] [MAIN ] SQNS: Loaded 25885 primary data records. [2025-09-23T22:26:36.022204] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:36.054546] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48546 primary records. [2025-09-23T22:26:36.059923] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-23T22:26:36.363076] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-09-23T22:26:36.362615] [DEBUG] [LOCAL ] SR: Loaded 32853 existing records from primary storage. [2025-09-23T22:26:36.363253] [INFO ] [MAIN ] SR: Loaded 32853 primary data records. [2025-09-23T22:26:36.364050] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-23T22:26:36.366480] [INFO ] [MAIN ] Derivative Progress: 1716/2077 symbols completed. SQM took 1.2s. Estimated remaining: 2m 21s. Rate: 153.6 symbols/min [2025-09-23T22:26:36.366776] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:36.738212] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:36.739907] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 25885 primary records. [2025-09-23T22:26:36.740152] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-23T22:26:36.776537] [DEBUG] [LOCAL ] SRE: Loaded 53426 existing records from primary storage. [2025-09-23T22:26:36.777548] [INFO ] [MAIN ] SRE: Loaded 53426 primary data records. [2025-09-23T22:26:36.819444] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-09-23T22:26:36.827336] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-23T22:26:36.835050] [INFO ] [MAIN ] Derivative Progress: 1717/2077 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 21s. Rate: 153.6 symbols/min [2025-09-23T22:26:36.841552] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:37.009476] [DEBUG] [LOCAL ] SREA: Loaded 10410 existing records from primary storage. [2025-09-23T22:26:37.010252] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:37.021701] [INFO ] [MAIN ] SREA: Loaded 10410 primary data records. [2025-09-23T22:26:37.161041] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32853 primary records. [2025-09-23T22:26:37.174180] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-23T22:26:37.460618] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-09-23T22:26:37.461071] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-23T22:26:37.463297] [INFO ] [MAIN ] Derivative Progress: 1718/2077 symbols completed. SR took 1.5s. Estimated remaining: 2m 20s. Rate: 153.6 symbols/min [2025-09-23T22:26:37.464121] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:37.488207] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:37.489056] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53426 primary records. [2025-09-23T22:26:37.489243] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-23T22:26:37.519530] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-09-23T22:26:37.527205] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-23T22:26:37.534749] [INFO ] [MAIN ] Derivative Progress: 1719/2077 symbols completed. SRE took 1.2s. Estimated remaining: 2m 20s. Rate: 153.6 symbols/min [2025-09-23T22:26:37.535455] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:37.537242] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10410 primary records. [2025-09-23T22:26:37.537487] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-23T22:26:37.538567] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:37.567114] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-09-23T22:26:37.568596] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-23T22:26:37.571220] [INFO ] [MAIN ] Derivative Progress: 1720/2077 symbols completed. SREA took 0.7s. Estimated remaining: 2m 19s. Rate: 153.7 symbols/min [2025-09-23T22:26:37.568406] [DEBUG] [LOCAL ] SRFM: Loaded 35552 existing records from primary storage. [2025-09-23T22:26:37.571615] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:37.571925] [INFO ] [MAIN ] SRFM: Loaded 35552 primary data records. [2025-09-23T22:26:37.714257] [DEBUG] [LOCAL ] SRG: Loaded 15799 existing records from primary storage. [2025-09-23T22:26:37.714704] [INFO ] [MAIN ] SRG: Loaded 15799 primary data records. [2025-09-23T22:26:37.870693] [DEBUG] [LOCAL ] SRI: Loaded 27526 existing records from primary storage. [2025-09-23T22:26:37.915703] [INFO ] [MAIN ] SRI: Loaded 27526 primary data records. [2025-09-23T22:26:38.636355] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:38.637360] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 35552 primary records. [2025-09-23T22:26:38.637546] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-23T22:26:38.666555] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-09-23T22:26:38.672415] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-23T22:26:38.672238] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:38.674693] [INFO ] [MAIN ] Derivative Progress: 1721/2077 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 19s. Rate: 153.6 symbols/min [2025-09-23T22:26:38.675847] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15799 primary records. [2025-09-23T22:26:38.676008] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:38.676134] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-23T22:26:38.713572] [DEBUG] [LOCAL ] SRV: Loaded 7620 existing records from primary storage. [2025-09-23T22:26:38.715309] [INFO ] [MAIN ] SRV: Loaded 7620 primary data records. [2025-09-23T22:26:38.714664] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:38.715818] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-09-23T22:26:38.727847] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-23T22:26:38.740577] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 27526 primary records. [2025-09-23T22:26:38.739674] [INFO ] [MAIN ] Derivative Progress: 1722/2077 symbols completed. SRG took 1.2s. Estimated remaining: 2m 19s. Rate: 153.6 symbols/min [2025-09-23T22:26:38.763585] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-23T22:26:38.783766] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:39.037436] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-09-23T22:26:39.038623] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-23T22:26:39.041385] [INFO ] [MAIN ] Derivative Progress: 1723/2077 symbols completed. SRI took 1.5s. Estimated remaining: 2m 18s. Rate: 153.7 symbols/min [2025-09-23T22:26:39.077775] [DEBUG] [LOCAL ] SSB: Loaded 42927 existing records from primary storage. [2025-09-23T22:26:39.078179] [INFO ] [MAIN ] SSB: Loaded 42927 primary data records. [2025-09-23T22:26:39.207637] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:39.218824] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7620 primary records. [2025-09-23T22:26:39.218909] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-23T22:26:39.409822] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-09-23T22:26:39.410011] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-23T22:26:39.412325] [INFO ] [MAIN ] Derivative Progress: 1724/2077 symbols completed. SRV took 0.7s. Estimated remaining: 2m 18s. Rate: 153.7 symbols/min [2025-09-23T22:26:39.435290] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:39.435983] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42927 primary records. [2025-09-23T22:26:39.436047] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-23T22:26:39.451598] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-09-23T22:26:39.451686] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-23T22:26:39.454289] [INFO ] [MAIN ] Derivative Progress: 1725/2077 symbols completed. SSB took 0.7s. Estimated remaining: 2m 17s. Rate: 153.7 symbols/min [2025-09-23T22:26:39.455440] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:39.455176] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:39.455249] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:39.470477] [DEBUG] [LOCAL ] SST: Loaded 12201 existing records from primary storage. [2025-09-23T22:26:39.470611] [INFO ] [MAIN ] SST: Loaded 12201 primary data records. [2025-09-23T22:26:39.599686] [DEBUG] [LOCAL ] SSD: Loaded 22321 existing records from primary storage. [2025-09-23T22:26:39.616257] [INFO ] [MAIN ] SSD: Loaded 22321 primary data records. [2025-09-23T22:26:39.803092] [DEBUG] [LOCAL ] SSL: Loaded 41199 existing records from primary storage. [2025-09-23T22:26:39.914042] [INFO ] [MAIN ] SSL: Loaded 41199 primary data records. [2025-09-23T22:26:40.496128] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:40.496995] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 12201 primary records. [2025-09-23T22:26:40.497360] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-23T22:26:40.533906] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:40.535700] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22321 primary records. [2025-09-23T22:26:40.536467] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-09-23T22:26:40.536259] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-23T22:26:40.537043] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-23T22:26:40.540100] [INFO ] [MAIN ] Derivative Progress: 1726/2077 symbols completed. SST took 1.1s. Estimated remaining: 2m 17s. Rate: 153.6 symbols/min [2025-09-23T22:26:40.541054] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:40.560763] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-09-23T22:26:40.561105] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-23T22:26:40.581307] [INFO ] [MAIN ] Derivative Progress: 1727/2077 symbols completed. SSD took 1.1s. Estimated remaining: 2m 17s. Rate: 153.7 symbols/min [2025-09-23T22:26:40.581768] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:40.590265] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:40.591102] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41199 primary records. [2025-09-23T22:26:40.591357] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-23T22:26:40.616902] [DEBUG] [LOCAL ] SSTK: Loaded 26629 existing records from primary storage. [2025-09-23T22:26:40.617080] [INFO ] [MAIN ] SSTK: Loaded 26629 primary data records. [2025-09-23T22:26:40.616346] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-09-23T22:26:40.617210] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-23T22:26:40.622595] [INFO ] [MAIN ] Derivative Progress: 1728/2077 symbols completed. SSL took 1.2s. Estimated remaining: 2m 16s. Rate: 153.7 symbols/min [2025-09-23T22:26:40.654017] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:40.947859] [DEBUG] [LOCAL ] ST: Loaded 49825 existing records from primary storage. [2025-09-23T22:26:40.948673] [INFO ] [MAIN ] ST: Loaded 49825 primary data records. [2025-09-23T22:26:41.146943] [DEBUG] [LOCAL ] STAG: Loaded 50045 existing records from primary storage. [2025-09-23T22:26:41.277416] [INFO ] [MAIN ] STAG: Loaded 50045 primary data records. [2025-09-23T22:26:41.499618] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:41.612024] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 26629 primary records. [2025-09-23T22:26:41.620917] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-23T22:26:41.657285] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-09-23T22:26:41.656894] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:41.657460] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-23T22:26:41.659888] [INFO ] [MAIN ] Derivative Progress: 1729/2077 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 16s. Rate: 153.6 symbols/min [2025-09-23T22:26:41.660687] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:41.661544] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49825 primary records. [2025-09-23T22:26:41.662669] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-23T22:26:41.682143] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-09-23T22:26:41.686613] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-23T22:26:41.689093] [INFO ] [MAIN ] Derivative Progress: 1730/2077 symbols completed. ST took 1.1s. Estimated remaining: 2m 15s. Rate: 153.7 symbols/min [2025-09-23T22:26:41.689756] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:41.700282] [DEBUG] [LOCAL ] STC: Loaded 17778 existing records from primary storage. [2025-09-23T22:26:41.712692] [INFO ] [MAIN ] STC: Loaded 17778 primary data records. [2025-09-23T22:26:41.713721] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:41.746735] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50045 primary records. [2025-09-23T22:26:41.772212] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-23T22:26:41.923634] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-09-23T22:26:42.040677] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-23T22:26:42.043555] [INFO ] [MAIN ] Derivative Progress: 1731/2077 symbols completed. STAG took 1.4s. Estimated remaining: 2m 15s. Rate: 153.7 symbols/min [2025-09-23T22:26:42.044556] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:42.058556] [DEBUG] [LOCAL ] STE: Loaded 35424 existing records from primary storage. [2025-09-23T22:26:42.058886] [INFO ] [MAIN ] STE: Loaded 35424 primary data records. [2025-09-23T22:26:42.263893] [DEBUG] [LOCAL ] STEL: Loaded 23688 existing records from primary storage. [2025-09-23T22:26:42.269415] [INFO ] [MAIN ] STEL: Loaded 23688 primary data records. [2025-09-23T22:26:42.558578] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:42.576091] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17778 primary records. [2025-09-23T22:26:42.600425] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-23T22:26:42.780378] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-09-23T22:26:42.780720] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-23T22:26:42.783773] [INFO ] [MAIN ] Derivative Progress: 1732/2077 symbols completed. STC took 1.1s. Estimated remaining: 2m 15s. Rate: 153.6 symbols/min [2025-09-23T22:26:42.785339] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:42.800533] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:42.801422] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35424 primary records. [2025-09-23T22:26:42.801761] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-23T22:26:42.819127] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-09-23T22:26:42.819473] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-23T22:26:42.822058] [INFO ] [MAIN ] Derivative Progress: 1733/2077 symbols completed. STE took 1.1s. Estimated remaining: 2m 14s. Rate: 153.7 symbols/min [2025-09-23T22:26:42.823446] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:42.847906] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:42.848601] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23688 primary records. [2025-09-23T22:26:42.848789] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-23T22:26:42.879088] [DEBUG] [LOCAL ] STEM: Loaded 39892 existing records from primary storage. [2025-09-23T22:26:42.879520] [INFO ] [MAIN ] STEM: Loaded 39892 primary data records. [2025-09-23T22:26:42.929478] [DEBUG] [LOCAL ] STEW: Loaded 16302 existing records from primary storage. [2025-09-23T22:26:42.934859] [INFO ] [MAIN ] STEW: Loaded 16302 primary data records. [2025-09-23T22:26:43.059015] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-09-23T22:26:43.064755] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-23T22:26:43.067372] [INFO ] [MAIN ] Derivative Progress: 1734/2077 symbols completed. STEL took 1.0s. Estimated remaining: 2m 14s. Rate: 153.7 symbols/min [2025-09-23T22:26:43.089841] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:43.510966] [DEBUG] [LOCAL ] STK: Loaded 9417 existing records from primary storage. [2025-09-23T22:26:43.511302] [INFO ] [MAIN ] STK: Loaded 9417 primary data records. [2025-09-23T22:26:43.850881] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:43.852506] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 39892 primary records. [2025-09-23T22:26:43.853294] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-23T22:26:43.885703] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:43.888537] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16302 primary records. [2025-09-23T22:26:43.888938] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-23T22:26:43.900252] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-09-23T22:26:43.900578] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-23T22:26:43.902804] [INFO ] [MAIN ] Derivative Progress: 1735/2077 symbols completed. STEM took 1.1s. Estimated remaining: 2m 14s. Rate: 153.6 symbols/min [2025-09-23T22:26:43.906330] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:43.913154] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-09-23T22:26:43.915358] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-23T22:26:43.918978] [INFO ] [MAIN ] Derivative Progress: 1736/2077 symbols completed. STEW took 1.1s. Estimated remaining: 2m 13s. Rate: 153.7 symbols/min [2025-09-23T22:26:43.919353] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:43.933926] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:43.934878] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9417 primary records. [2025-09-23T22:26:43.935109] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-23T22:26:43.956739] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-09-23T22:26:43.956980] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-23T22:26:43.960003] [INFO ] [MAIN ] Derivative Progress: 1737/2077 symbols completed. STK took 0.9s. Estimated remaining: 2m 13s. Rate: 153.8 symbols/min [2025-09-23T22:26:43.960455] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:44.032160] [DEBUG] [LOCAL ] STM: Loaded 53587 existing records from primary storage. [2025-09-23T22:26:44.033713] [INFO ] [MAIN ] STM: Loaded 53587 primary data records. [2025-09-23T22:26:44.056859] [DEBUG] [LOCAL ] STLA: Loaded 53543 existing records from primary storage. [2025-09-23T22:26:44.100074] [INFO ] [MAIN ] STLA: Loaded 53543 primary data records. [2025-09-23T22:26:44.110559] [DEBUG] [LOCAL ] STN: Loaded 23107 existing records from primary storage. [2025-09-23T22:26:44.116021] [INFO ] [MAIN ] STN: Loaded 23107 primary data records. [2025-09-23T22:26:45.025955] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:45.027140] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53587 primary records. [2025-09-23T22:26:45.027481] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-23T22:26:45.061674] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:45.074982] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:45.076381] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53543 primary records. [2025-09-23T22:26:45.077034] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-23T22:26:45.077907] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 23107 primary records. [2025-09-23T22:26:45.078801] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-23T22:26:45.076979] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-09-23T22:26:45.079412] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-23T22:26:45.081307] [INFO ] [MAIN ] Derivative Progress: 1738/2077 symbols completed. STM took 1.2s. Estimated remaining: 2m 12s. Rate: 153.6 symbols/min [2025-09-23T22:26:45.111827] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-09-23T22:26:45.112161] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-23T22:26:45.115008] [INFO ] [MAIN ] Derivative Progress: 1739/2077 symbols completed. STLA took 1.2s. Estimated remaining: 2m 12s. Rate: 153.7 symbols/min [2025-09-23T22:26:45.116335] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-09-23T22:26:45.116414] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-23T22:26:45.118763] [INFO ] [MAIN ] Derivative Progress: 1740/2077 symbols completed. STN took 1.2s. Estimated remaining: 2m 11s. Rate: 153.8 symbols/min [2025-09-23T22:26:45.119462] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:45.119721] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:45.119622] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:45.133540] [DEBUG] [LOCAL ] STRV: Loaded 11626 existing records from primary storage. [2025-09-23T22:26:45.133637] [INFO ] [MAIN ] STRV: Loaded 11626 primary data records. [2025-09-23T22:26:45.470271] [DEBUG] [LOCAL ] STNG: Loaded 44048 existing records from primary storage. [2025-09-23T22:26:45.470580] [INFO ] [MAIN ] STNG: Loaded 44048 primary data records. [2025-09-23T22:26:45.567422] [DEBUG] [LOCAL ] STT: Loaded 51108 existing records from primary storage. [2025-09-23T22:26:45.585561] [INFO ] [MAIN ] STT: Loaded 51108 primary data records. [2025-09-23T22:26:46.142133] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:46.143749] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11626 primary records. [2025-09-23T22:26:46.143989] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-23T22:26:46.170251] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-09-23T22:26:46.170966] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-23T22:26:46.173916] [INFO ] [MAIN ] Derivative Progress: 1741/2077 symbols completed. STRV took 1.1s. Estimated remaining: 2m 11s. Rate: 153.6 symbols/min [2025-09-23T22:26:46.174474] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:46.207507] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:46.207979] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:46.208734] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 51108 primary records. [2025-09-23T22:26:46.209343] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 44048 primary records. [2025-09-23T22:26:46.209561] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-23T22:26:46.209502] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-23T22:26:46.246895] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-09-23T22:26:46.254622] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-23T22:26:46.257453] [INFO ] [MAIN ] Derivative Progress: 1742/2077 symbols completed. STT took 1.1s. Estimated remaining: 2m 11s. Rate: 153.7 symbols/min [2025-09-23T22:26:46.258024] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:46.261160] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-09-23T22:26:46.261628] [DEBUG] [LOCAL ] STVN: Loaded 26321 existing records from primary storage. [2025-09-23T22:26:46.262201] [INFO ] [MAIN ] STVN: Loaded 26321 primary data records. [2025-09-23T22:26:46.262290] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-23T22:26:46.264908] [INFO ] [MAIN ] Derivative Progress: 1743/2077 symbols completed. STNG took 1.1s. Estimated remaining: 2m 10s. Rate: 153.8 symbols/min [2025-09-23T22:26:46.296181] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:46.380080] [DEBUG] [LOCAL ] STXD: Loaded 1325 existing records from primary storage. [2025-09-23T22:26:46.390593] [INFO ] [MAIN ] STXD: Loaded 1325 primary data records. [2025-09-23T22:26:46.915529] [DEBUG] [LOCAL ] STWD: Loaded 51900 existing records from primary storage. [2025-09-23T22:26:46.929308] [INFO ] [MAIN ] STWD: Loaded 51900 primary data records. [2025-09-23T22:26:47.253347] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:47.255209] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26321 primary records. [2025-09-23T22:26:47.255400] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-23T22:26:47.295050] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:47.295980] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-09-23T22:26:47.297068] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1325 primary records. [2025-09-23T22:26:47.297320] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-23T22:26:47.297572] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-23T22:26:47.300716] [INFO ] [MAIN ] Derivative Progress: 1744/2077 symbols completed. STVN took 1.1s. Estimated remaining: 2m 10s. Rate: 153.6 symbols/min [2025-09-23T22:26:47.307666] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:47.322100] [DEBUG] [LOCAL ] STXE: Loaded 2211 existing records from primary storage. [2025-09-23T22:26:47.322903] [INFO ] [MAIN ] STXE: Loaded 2211 primary data records. [2025-09-23T22:26:47.320115] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-09-23T22:26:47.365899] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-23T22:26:47.368465] [INFO ] [MAIN ] Derivative Progress: 1745/2077 symbols completed. STXD took 1.1s. Estimated remaining: 2m 10s. Rate: 153.7 symbols/min [2025-09-23T22:26:47.392981] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:47.402124] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:47.419959] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51900 primary records. [2025-09-23T22:26:47.420059] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-23T22:26:47.483569] [DEBUG] [LOCAL ] STXG: Loaded 2595 existing records from primary storage. [2025-09-23T22:26:47.505544] [INFO ] [MAIN ] STXG: Loaded 2595 primary data records. [2025-09-23T22:26:47.785526] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-09-23T22:26:47.820686] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-23T22:26:47.965320] [INFO ] [MAIN ] Derivative Progress: 1746/2077 symbols completed. STWD took 1.7s. Estimated remaining: 2m 9s. Rate: 153.7 symbols/min [2025-09-23T22:26:47.980110] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:47.984895] [DEBUG] [LOCAL ] STXK: Loaded 1513 existing records from primary storage. [2025-09-23T22:26:47.985638] [INFO ] [MAIN ] STXK: Loaded 1513 primary data records. [2025-09-23T22:26:48.106471] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:48.113297] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2211 primary records. [2025-09-23T22:26:48.123958] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-23T22:26:48.382341] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-09-23T22:26:48.383312] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-23T22:26:48.385846] [INFO ] [MAIN ] Derivative Progress: 1747/2077 symbols completed. STXE took 1.1s. Estimated remaining: 2m 9s. Rate: 153.7 symbols/min [2025-09-23T22:26:48.386215] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:48.402817] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:48.404315] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2595 primary records. [2025-09-23T22:26:48.404587] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-23T22:26:48.406878] [DEBUG] [LOCAL ] STXT: Loaded 2580 existing records from primary storage. [2025-09-23T22:26:48.407839] [INFO ] [MAIN ] STXT: Loaded 2580 primary data records. [2025-09-23T22:26:48.568948] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-09-23T22:26:48.584602] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-23T22:26:48.587140] [INFO ] [MAIN ] Derivative Progress: 1748/2077 symbols completed. STXG took 1.2s. Estimated remaining: 2m 8s. Rate: 153.7 symbols/min [2025-09-23T22:26:48.607509] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:48.768890] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:48.773568] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1513 primary records. [2025-09-23T22:26:48.771898] [DEBUG] [LOCAL ] STXV: Loaded 1635 existing records from primary storage. [2025-09-23T22:26:48.773731] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-23T22:26:48.774446] [INFO ] [MAIN ] STXV: Loaded 1635 primary data records. [2025-09-23T22:26:48.917499] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-09-23T22:26:48.922986] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-23T22:26:48.927160] [INFO ] [MAIN ] Derivative Progress: 1749/2077 symbols completed. STXK took 0.9s. Estimated remaining: 2m 8s. Rate: 153.7 symbols/min [2025-09-23T22:26:48.927744] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:49.121154] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:49.122361] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2580 primary records. [2025-09-23T22:26:49.122547] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-23T22:26:49.142628] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-09-23T22:26:49.142989] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-23T22:26:49.145346] [INFO ] [MAIN ] Derivative Progress: 1750/2077 symbols completed. STXT took 0.8s. Estimated remaining: 2m 8s. Rate: 153.8 symbols/min [2025-09-23T22:26:49.145975] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:49.180903] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:26:49.181600] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1635 primary records. [2025-09-23T22:26:49.182585] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-23T22:26:49.204829] [DEBUG] [LOCAL ] STZ: Loaded 52274 existing records from primary storage. [2025-09-23T22:26:49.204991] [INFO ] [MAIN ] STZ: Loaded 52274 primary data records. [2025-09-23T22:26:49.372915] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-09-23T22:26:49.405077] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-23T22:26:49.474558] [INFO ] [MAIN ] Derivative Progress: 1751/2077 symbols completed. STXV took 0.9s. Estimated remaining: 2m 7s. Rate: 153.8 symbols/min [2025-09-23T22:26:49.579786] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:49.583950] [DEBUG] [LOCAL ] SU: Loaded 53459 existing records from primary storage. [2025-09-23T22:26:49.584341] [INFO ] [MAIN ] SU: Loaded 53459 primary data records. [2025-09-23T22:26:49.928698] [DEBUG] [LOCAL ] SUI: Loaded 42060 existing records from primary storage. [2025-09-23T22:26:49.929766] [INFO ] [MAIN ] SUI: Loaded 42060 primary data records. [2025-09-23T22:26:50.000217] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:50.026812] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52274 primary records. [2025-09-23T22:26:50.037615] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-23T22:26:50.278147] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-09-23T22:26:50.278747] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-23T22:26:50.281095] [INFO ] [MAIN ] Derivative Progress: 1752/2077 symbols completed. STZ took 1.4s. Estimated remaining: 2m 7s. Rate: 153.7 symbols/min [2025-09-23T22:26:50.284614] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:50.300503] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:50.301518] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53459 primary records. [2025-09-23T22:26:50.301674] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-23T22:26:50.321464] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-09-23T22:26:50.321763] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-23T22:26:50.326755] [INFO ] [MAIN ] Derivative Progress: 1753/2077 symbols completed. SU took 1.2s. Estimated remaining: 2m 6s. Rate: 153.7 symbols/min [2025-09-23T22:26:50.342567] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:50.352050] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 42060 primary records. [2025-09-23T22:26:50.352179] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-23T22:26:50.378379] [DEBUG] [LOCAL ] SUN: Loaded 37359 existing records from primary storage. [2025-09-23T22:26:50.379199] [INFO ] [MAIN ] SUN: Loaded 37359 primary data records. [2025-09-23T22:26:50.380126] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-09-23T22:26:50.445618] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-23T22:26:50.454214] [INFO ] [MAIN ] Derivative Progress: 1754/2077 symbols completed. SUI took 0.9s. Estimated remaining: 2m 6s. Rate: 153.8 symbols/min [2025-09-23T22:26:50.734120] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:50.734867] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37359 primary records. [2025-09-23T22:26:50.734932] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-23T22:26:50.751096] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-09-23T22:26:50.751234] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-23T22:26:50.753382] [INFO ] [MAIN ] Derivative Progress: 1755/2077 symbols completed. SUN took 0.5s. Estimated remaining: 2m 6s. Rate: 153.8 symbols/min [2025-09-23T22:26:50.754029] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:50.754748] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:50.754812] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:50.835495] [DEBUG] [LOCAL ] SVV: Loaded 39460 existing records from primary storage. [2025-09-23T22:26:50.836234] [INFO ] [MAIN ] SVV: Loaded 39460 primary data records. [2025-09-23T22:26:50.836865] [DEBUG] [LOCAL ] SUZ: Loaded 45817 existing records from primary storage. [2025-09-23T22:26:50.842416] [INFO ] [MAIN ] SUZ: Loaded 45817 primary data records. [2025-09-23T22:26:50.915107] [DEBUG] [LOCAL ] SUPV: Loaded 47159 existing records from primary storage. [2025-09-23T22:26:50.946148] [INFO ] [MAIN ] SUPV: Loaded 47159 primary data records. [2025-09-23T22:26:51.812322] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:51.813894] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39460 primary records. [2025-09-23T22:26:51.814326] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-23T22:26:51.868606] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:51.870734] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-09-23T22:26:51.870273] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47159 primary records. [2025-09-23T22:26:51.871067] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-23T22:26:51.872900] [INFO ] [MAIN ] Derivative Progress: 1756/2077 symbols completed. SVV took 1.1s. Estimated remaining: 2m 5s. Rate: 153.7 symbols/min [2025-09-23T22:26:51.870993] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-23T22:26:51.870639] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:51.874191] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:51.875440] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45817 primary records. [2025-09-23T22:26:51.887262] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-23T22:26:51.907634] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-09-23T22:26:51.908493] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-23T22:26:51.911433] [INFO ] [MAIN ] Derivative Progress: 1757/2077 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 5s. Rate: 153.7 symbols/min [2025-09-23T22:26:51.919025] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:51.921274] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-09-23T22:26:51.921435] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-23T22:26:51.923788] [INFO ] [MAIN ] Derivative Progress: 1758/2077 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 4s. Rate: 153.8 symbols/min [2025-09-23T22:26:51.924215] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:51.975738] [DEBUG] [LOCAL ] SW: Loaded 53163 existing records from primary storage. [2025-09-23T22:26:51.982823] [INFO ] [MAIN ] SW: Loaded 53163 primary data records. [2025-09-23T22:26:52.134890] [DEBUG] [LOCAL ] SWX: Loaded 31378 existing records from primary storage. [2025-09-23T22:26:52.166624] [INFO ] [MAIN ] SWX: Loaded 31378 primary data records. [2025-09-23T22:26:52.236597] [DEBUG] [LOCAL ] SWK: Loaded 52470 existing records from primary storage. [2025-09-23T22:26:52.400041] [INFO ] [MAIN ] SWK: Loaded 52470 primary data records. [2025-09-23T22:26:53.016050] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:53.017166] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53163 primary records. [2025-09-23T22:26:53.017474] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-23T22:26:53.051480] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-09-23T22:26:53.053435] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-23T22:26:53.053266] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:53.056219] [INFO ] [MAIN ] Derivative Progress: 1759/2077 symbols completed. SW took 1.2s. Estimated remaining: 2m 4s. Rate: 153.7 symbols/min [2025-09-23T22:26:53.054413] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31378 primary records. [2025-09-23T22:26:53.056917] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-23T22:26:53.056727] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:53.070520] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:53.082909] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52470 primary records. [2025-09-23T22:26:53.090464] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-09-23T22:26:53.090679] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-23T22:26:53.093172] [INFO ] [MAIN ] Derivative Progress: 1760/2077 symbols completed. SWX took 1.2s. Estimated remaining: 2m 4s. Rate: 153.7 symbols/min [2025-09-23T22:26:53.090580] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-23T22:26:53.093506] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:53.114878] [DEBUG] [LOCAL ] SWZ: Loaded 6034 existing records from primary storage. [2025-09-23T22:26:53.115298] [INFO ] [MAIN ] SWZ: Loaded 6034 primary data records. [2025-09-23T22:26:53.122317] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-09-23T22:26:53.134016] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-23T22:26:53.154816] [INFO ] [MAIN ] Derivative Progress: 1761/2077 symbols completed. SWK took 1.2s. Estimated remaining: 2m 3s. Rate: 153.8 symbols/min [2025-09-23T22:26:53.168499] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:53.330778] [DEBUG] [LOCAL ] SXI: Loaded 11511 existing records from primary storage. [2025-09-23T22:26:53.382805] [INFO ] [MAIN ] SXI: Loaded 11511 primary data records. [2025-09-23T22:26:53.532638] [DEBUG] [LOCAL ] SXC: Loaded 41626 existing records from primary storage. [2025-09-23T22:26:53.547073] [INFO ] [MAIN ] SXC: Loaded 41626 primary data records. [2025-09-23T22:26:54.129245] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:54.130773] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6034 primary records. [2025-09-23T22:26:54.131197] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-23T22:26:54.151407] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-09-23T22:26:54.151572] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-23T22:26:54.153914] [INFO ] [MAIN ] Derivative Progress: 1762/2077 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 3s. Rate: 153.7 symbols/min [2025-09-23T22:26:54.166875] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:54.167931] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:54.170872] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41626 primary records. [2025-09-23T22:26:54.171097] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-23T22:26:54.196701] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:54.198030] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11511 primary records. [2025-09-23T22:26:54.198111] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-23T22:26:54.216072] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-09-23T22:26:54.216897] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-23T22:26:54.219048] [INFO ] [MAIN ] Derivative Progress: 1763/2077 symbols completed. SXI took 1.1s. Estimated remaining: 2m 3s. Rate: 153.8 symbols/min [2025-09-23T22:26:54.219733] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:54.222459] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-09-23T22:26:54.222925] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-23T22:26:54.225568] [INFO ] [MAIN ] Derivative Progress: 1764/2077 symbols completed. SXC took 1.1s. Estimated remaining: 2m 2s. Rate: 153.8 symbols/min [2025-09-23T22:26:54.226236] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:54.251087] [DEBUG] [LOCAL ] SXT: Loaded 29088 existing records from primary storage. [2025-09-23T22:26:54.251386] [INFO ] [MAIN ] SXT: Loaded 29088 primary data records. [2025-09-23T22:26:54.715064] [DEBUG] [LOCAL ] SYF: Loaded 53457 existing records from primary storage. [2025-09-23T22:26:54.716326] [INFO ] [MAIN ] SYF: Loaded 53457 primary data records. [2025-09-23T22:26:54.716216] [DEBUG] [LOCAL ] SYK: Loaded 47075 existing records from primary storage. [2025-09-23T22:26:54.716762] [INFO ] [MAIN ] SYK: Loaded 47075 primary data records. [2025-09-23T22:26:55.616790] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:55.619602] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29088 primary records. [2025-09-23T22:26:55.620100] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-23T22:26:55.654575] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-09-23T22:26:55.655459] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-23T22:26:55.659253] [INFO ] [MAIN ] Derivative Progress: 1765/2077 symbols completed. SXT took 1.5s. Estimated remaining: 2m 2s. Rate: 153.6 symbols/min [2025-09-23T22:26:55.660212] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:55.704242] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:55.706873] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53457 primary records. [2025-09-23T22:26:55.706993] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-23T22:26:55.708599] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:55.721871] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 47075 primary records. [2025-09-23T22:26:55.722703] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-23T22:26:55.742751] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-09-23T22:26:55.743589] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-23T22:26:55.746195] [INFO ] [MAIN ] Derivative Progress: 1766/2077 symbols completed. SYF took 1.5s. Estimated remaining: 2m 1s. Rate: 153.7 symbols/min [2025-09-23T22:26:55.747355] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:55.768193] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-09-23T22:26:55.768362] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-23T22:26:55.771627] [INFO ] [MAIN ] Derivative Progress: 1767/2077 symbols completed. SYK took 1.5s. Estimated remaining: 2m 1s. Rate: 153.8 symbols/min [2025-09-23T22:26:55.772226] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:55.799758] [DEBUG] [LOCAL ] SYY: Loaded 53237 existing records from primary storage. [2025-09-23T22:26:55.800301] [INFO ] [MAIN ] SYY: Loaded 53237 primary data records. [2025-09-23T22:26:56.187411] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-23T22:26:56.186454] [DEBUG] [LOCAL ] TAC: Loaded 42907 existing records from primary storage. [2025-09-23T22:26:56.188349] [INFO ] [MAIN ] TAC: Loaded 42907 primary data records. [2025-09-23T22:26:56.187584] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-09-23T22:26:56.872732] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:56.874209] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53237 primary records. [2025-09-23T22:26:56.874592] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-23T22:26:56.893547] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-09-23T22:26:56.894177] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-23T22:26:56.896850] [INFO ] [MAIN ] Derivative Progress: 1768/2077 symbols completed. SYY took 1.2s. Estimated remaining: 2m 1s. Rate: 153.6 symbols/min [2025-09-23T22:26:56.912916] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:56.913668] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-09-23T22:26:56.913747] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-23T22:26:56.943710] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:56.944947] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-09-23T22:26:56.944886] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42907 primary records. [2025-09-23T22:26:56.945062] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-23T22:26:56.947115] [INFO ] [MAIN ] Derivative Progress: 1769/2077 symbols completed. T took 1.2s. Estimated remaining: 2m 0s. Rate: 153.7 symbols/min [2025-09-23T22:26:56.945142] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-23T22:26:56.962414] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-09-23T22:26:56.962473] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-23T22:26:56.965115] [INFO ] [MAIN ] Derivative Progress: 1770/2077 symbols completed. TAC took 1.2s. Estimated remaining: 1m 60s. Rate: 153.7 symbols/min [2025-09-23T22:26:56.965897] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:56.965731] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:56.966101] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:57.045897] [DEBUG] [LOCAL ] TAK: Loaded 49893 existing records from primary storage. [2025-09-23T22:26:57.046190] [INFO ] [MAIN ] TAK: Loaded 49893 primary data records. [2025-09-23T22:26:57.182589] [DEBUG] [LOCAL ] TALO: Loaded 50828 existing records from primary storage. [2025-09-23T22:26:57.183241] [DEBUG] [LOCAL ] TAL: Loaded 52110 existing records from primary storage. [2025-09-23T22:26:57.183523] [INFO ] [MAIN ] TALO: Loaded 50828 primary data records. [2025-09-23T22:26:57.183695] [INFO ] [MAIN ] TAL: Loaded 52110 primary data records. [2025-09-23T22:26:58.031299] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:58.032372] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49893 primary records. [2025-09-23T22:26:58.032462] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-23T22:26:58.065618] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-09-23T22:26:58.066278] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:58.079042] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 52110 primary records. [2025-09-23T22:26:58.079283] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:58.078188] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-23T22:26:58.081959] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50828 primary records. [2025-09-23T22:26:58.079457] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-23T22:26:58.081250] [INFO ] [MAIN ] Derivative Progress: 1771/2077 symbols completed. TAK took 1.1s. Estimated remaining: 1m 60s. Rate: 153.6 symbols/min [2025-09-23T22:26:58.082623] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:58.082885] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-23T22:26:58.114285] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-09-23T22:26:58.114699] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-23T22:26:58.117938] [INFO ] [MAIN ] Derivative Progress: 1772/2077 symbols completed. TALO took 1.2s. Estimated remaining: 1m 59s. Rate: 153.7 symbols/min [2025-09-23T22:26:58.119272] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-09-23T22:26:58.119340] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-23T22:26:58.121617] [INFO ] [MAIN ] Derivative Progress: 1773/2077 symbols completed. TAL took 1.2s. Estimated remaining: 1m 59s. Rate: 153.8 symbols/min [2025-09-23T22:26:58.122020] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:58.118426] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:58.136053] [DEBUG] [LOCAL ] TBB: Loaded 11701 existing records from primary storage. [2025-09-23T22:26:58.136186] [INFO ] [MAIN ] TBB: Loaded 11701 primary data records. [2025-09-23T22:26:58.312618] [DEBUG] [LOCAL ] TBBB: Loaded 35773 existing records from primary storage. [2025-09-23T22:26:58.327455] [INFO ] [MAIN ] TBBB: Loaded 35773 primary data records. [2025-09-23T22:26:58.366733] [DEBUG] [LOCAL ] TAP: Loaded 52874 existing records from primary storage. [2025-09-23T22:26:58.366967] [INFO ] [MAIN ] TAP: Loaded 52874 primary data records. [2025-09-23T22:26:59.163112] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:59.165378] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11701 primary records. [2025-09-23T22:26:59.165637] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-23T22:26:59.189402] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-09-23T22:26:59.190361] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-23T22:26:59.205548] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:59.204818] [INFO ] [MAIN ] Derivative Progress: 1774/2077 symbols completed. TBB took 1.1s. Estimated remaining: 1m 58s. Rate: 153.6 symbols/min [2025-09-23T22:26:59.205977] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:59.218589] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35773 primary records. [2025-09-23T22:26:59.219741] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:26:59.219222] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-23T22:26:59.221007] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52874 primary records. [2025-09-23T22:26:59.221726] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-23T22:26:59.250587] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-09-23T22:26:59.251776] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-23T22:26:59.255610] [INFO ] [MAIN ] Derivative Progress: 1775/2077 symbols completed. TAP took 1.2s. Estimated remaining: 1m 58s. Rate: 153.7 symbols/min [2025-09-23T22:26:59.256810] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:59.264915] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-09-23T22:26:59.265907] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-23T22:26:59.268276] [INFO ] [MAIN ] Derivative Progress: 1776/2077 symbols completed. TBBB took 1.1s. Estimated remaining: 1m 57s. Rate: 153.8 symbols/min [2025-09-23T22:26:59.271236] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:26:59.271967] [DEBUG] [LOCAL ] TBN: Loaded 2967 existing records from primary storage. [2025-09-23T22:26:59.279338] [INFO ] [MAIN ] TBN: Loaded 2967 primary data records. [2025-09-23T22:26:59.336265] [DEBUG] [LOCAL ] TBI: Loaded 22596 existing records from primary storage. [2025-09-23T22:26:59.351588] [INFO ] [MAIN ] TBI: Loaded 22596 primary data records. [2025-09-23T22:26:59.939430] [DEBUG] [LOCAL ] TD: Loaded 52271 existing records from primary storage. [2025-09-23T22:26:59.939873] [INFO ] [MAIN ] TD: Loaded 52271 primary data records. [2025-09-23T22:27:00.063417] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:27:00.064945] [INFO ] [MAIN ] TBN: Generated 1792 derivative records from 2967 primary records. [2025-09-23T22:27:00.075871] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-23T22:27:00.282155] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:00.288472] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22596 primary records. [2025-09-23T22:27:00.288937] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-23T22:27:00.305500] [DEBUG] [LOCAL ] TBN: Derivative data saved (1792 records). [2025-09-23T22:27:00.306479] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-23T22:27:00.308865] [INFO ] [MAIN ] Derivative Progress: 1777/2077 symbols completed. TBN took 1.1s. Estimated remaining: 1m 57s. Rate: 153.6 symbols/min [2025-09-23T22:27:00.309868] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:00.314873] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-09-23T22:27:00.315113] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-23T22:27:00.317677] [INFO ] [MAIN ] Derivative Progress: 1778/2077 symbols completed. TBI took 1.1s. Estimated remaining: 1m 57s. Rate: 153.7 symbols/min [2025-09-23T22:27:00.318123] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:00.342830] [DEBUG] [LOCAL ] TDF: Loaded 6459 existing records from primary storage. [2025-09-23T22:27:00.343393] [INFO ] [MAIN ] TDF: Loaded 6459 primary data records. [2025-09-23T22:27:00.343580] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:00.355528] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52271 primary records. [2025-09-23T22:27:00.375217] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-23T22:27:00.567893] [DEBUG] [LOCAL ] TDC: Loaded 46900 existing records from primary storage. [2025-09-23T22:27:00.675755] [INFO ] [MAIN ] TDC: Loaded 46900 primary data records. [2025-09-23T22:27:00.707975] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-09-23T22:27:00.743478] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-23T22:27:00.755759] [INFO ] [MAIN ] Derivative Progress: 1779/2077 symbols completed. TD took 1.5s. Estimated remaining: 1m 56s. Rate: 153.7 symbols/min [2025-09-23T22:27:00.761468] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:01.066243] [DEBUG] [LOCAL ] TDG: Loaded 22145 existing records from primary storage. [2025-09-23T22:27:01.067190] [INFO ] [MAIN ] TDG: Loaded 22145 primary data records. [2025-09-23T22:27:01.148007] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:01.186718] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6459 primary records. [2025-09-23T22:27:01.207409] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-23T22:27:01.412706] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-09-23T22:27:01.413485] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-23T22:27:01.415929] [INFO ] [MAIN ] Derivative Progress: 1780/2077 symbols completed. TDF took 1.1s. Estimated remaining: 1m 56s. Rate: 153.6 symbols/min [2025-09-23T22:27:01.420916] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:01.437930] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:01.438926] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46900 primary records. [2025-09-23T22:27:01.439148] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-23T22:27:01.462927] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-09-23T22:27:01.463101] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-23T22:27:01.465442] [INFO ] [MAIN ] Derivative Progress: 1781/2077 symbols completed. TDC took 1.2s. Estimated remaining: 1m 56s. Rate: 153.7 symbols/min [2025-09-23T22:27:01.465999] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:01.483997] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:01.499100] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22145 primary records. [2025-09-23T22:27:01.499408] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-23T22:27:01.518116] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-09-23T22:27:01.518348] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-23T22:27:01.520974] [INFO ] [MAIN ] Derivative Progress: 1782/2077 symbols completed. TDG took 0.8s. Estimated remaining: 1m 55s. Rate: 153.8 symbols/min [2025-09-23T22:27:01.536475] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:01.537953] [DEBUG] [LOCAL ] TDOC: Loaded 53347 existing records from primary storage. [2025-09-23T22:27:01.538258] [INFO ] [MAIN ] TDOC: Loaded 53347 primary data records. [2025-09-23T22:27:01.761440] [DEBUG] [LOCAL ] TDS: Loaded 42808 existing records from primary storage. [2025-09-23T22:27:01.777683] [INFO ] [MAIN ] TDS: Loaded 42808 primary data records. [2025-09-23T22:27:01.980468] [DEBUG] [LOCAL ] TDW: Loaded 45501 existing records from primary storage. [2025-09-23T22:27:02.014501] [INFO ] [MAIN ] TDW: Loaded 45501 primary data records. [2025-09-23T22:27:02.536157] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:02.537200] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53347 primary records. [2025-09-23T22:27:02.537892] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-23T22:27:02.560993] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-09-23T22:27:02.561634] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-23T22:27:02.563889] [INFO ] [MAIN ] Derivative Progress: 1783/2077 symbols completed. TDOC took 1.1s. Estimated remaining: 1m 55s. Rate: 153.6 symbols/min [2025-09-23T22:27:02.577294] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:02.577979] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42808 primary records. [2025-09-23T22:27:02.578133] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-23T22:27:02.608091] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:02.609239] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45501 primary records. [2025-09-23T22:27:02.609476] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-23T22:27:02.610292] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-09-23T22:27:02.610579] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-23T22:27:02.612793] [INFO ] [MAIN ] Derivative Progress: 1784/2077 symbols completed. TDS took 1.1s. Estimated remaining: 1m 54s. Rate: 153.7 symbols/min [2025-09-23T22:27:02.627462] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-09-23T22:27:02.627524] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-23T22:27:02.630004] [INFO ] [MAIN ] Derivative Progress: 1785/2077 symbols completed. TDW took 1.1s. Estimated remaining: 1m 54s. Rate: 153.8 symbols/min [2025-09-23T22:27:02.630755] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:02.631016] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:02.630909] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:02.641350] [DEBUG] [LOCAL ] TEAF: Loaded 7325 existing records from primary storage. [2025-09-23T22:27:02.641479] [INFO ] [MAIN ] TEAF: Loaded 7325 primary data records. [2025-09-23T22:27:02.781409] [DEBUG] [LOCAL ] TDY: Loaded 22718 existing records from primary storage. [2025-09-23T22:27:02.842070] [INFO ] [MAIN ] TDY: Loaded 22718 primary data records. [2025-09-23T22:27:03.134828] [DEBUG] [LOCAL ] TECK: Loaded 53436 existing records from primary storage. [2025-09-23T22:27:03.135739] [INFO ] [MAIN ] TECK: Loaded 53436 primary data records. [2025-09-23T22:27:03.676467] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:03.678144] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7325 primary records. [2025-09-23T22:27:03.678286] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-23T22:27:03.696854] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-09-23T22:27:03.697157] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-23T22:27:03.701149] [INFO ] [MAIN ] Derivative Progress: 1786/2077 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 54s. Rate: 153.6 symbols/min [2025-09-23T22:27:03.702511] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:03.716866] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:03.717863] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22718 primary records. [2025-09-23T22:27:03.717994] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-23T22:27:03.749507] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:03.751119] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53436 primary records. [2025-09-23T22:27:03.752443] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-09-23T22:27:03.752684] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-23T22:27:03.752755] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-23T22:27:03.755071] [INFO ] [MAIN ] Derivative Progress: 1787/2077 symbols completed. TDY took 1.1s. Estimated remaining: 1m 53s. Rate: 153.7 symbols/min [2025-09-23T22:27:03.764848] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:03.781281] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-09-23T22:27:03.782151] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-23T22:27:03.794976] [INFO ] [MAIN ] Derivative Progress: 1788/2077 symbols completed. TECK took 1.2s. Estimated remaining: 1m 53s. Rate: 153.8 symbols/min [2025-09-23T22:27:03.796708] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:03.798740] [DEBUG] [LOCAL ] TEF: Loaded 37382 existing records from primary storage. [2025-09-23T22:27:03.799017] [INFO ] [MAIN ] TEF: Loaded 37382 primary data records. [2025-09-23T22:27:03.880679] [DEBUG] [LOCAL ] TEI: Loaded 20409 existing records from primary storage. [2025-09-23T22:27:03.904575] [INFO ] [MAIN ] TEI: Loaded 20409 primary data records. [2025-09-23T22:27:04.394802] [DEBUG] [LOCAL ] TEL: Loaded 51153 existing records from primary storage. [2025-09-23T22:27:04.471633] [INFO ] [MAIN ] TEL: Loaded 51153 primary data records. [2025-09-23T22:27:04.828714] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:04.831093] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37382 primary records. [2025-09-23T22:27:04.831232] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-23T22:27:04.863087] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:04.865269] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 20409 primary records. [2025-09-23T22:27:04.865467] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-23T22:27:04.883449] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-09-23T22:27:04.884392] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-09-23T22:27:04.884724] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-23T22:27:04.884497] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-23T22:27:04.887040] [INFO ] [MAIN ] Derivative Progress: 1789/2077 symbols completed. TEI took 1.1s. Estimated remaining: 1m 52s. Rate: 153.6 symbols/min [2025-09-23T22:27:04.887459] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:04.890057] [INFO ] [MAIN ] Derivative Progress: 1790/2077 symbols completed. TEF took 1.2s. Estimated remaining: 1m 52s. Rate: 153.7 symbols/min [2025-09-23T22:27:04.890766] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:04.908999] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:04.909930] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51153 primary records. [2025-09-23T22:27:04.910027] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-23T22:27:04.931789] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-09-23T22:27:04.932011] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-23T22:27:04.934691] [INFO ] [MAIN ] Derivative Progress: 1791/2077 symbols completed. TEL took 1.1s. Estimated remaining: 1m 52s. Rate: 153.8 symbols/min [2025-09-23T22:27:04.935046] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:04.951834] [DEBUG] [LOCAL ] TEO: Loaded 21923 existing records from primary storage. [2025-09-23T22:27:04.951979] [INFO ] [MAIN ] TEO: Loaded 21923 primary data records. [2025-09-23T22:27:05.075093] [DEBUG] [LOCAL ] TEN: Loaded 31081 existing records from primary storage. [2025-09-23T22:27:05.081085] [INFO ] [MAIN ] TEN: Loaded 31081 primary data records. [2025-09-23T22:27:05.466895] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-09-23T22:27:05.508567] [INFO ] [MAIN ] TEVA: Loaded 53633 primary data records. [2025-09-23T22:27:06.004079] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:06.005553] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 21923 primary records. [2025-09-23T22:27:06.006117] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-23T22:27:06.027581] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-09-23T22:27:06.029305] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-23T22:27:06.031834] [INFO ] [MAIN ] Derivative Progress: 1792/2077 symbols completed. TEO took 1.1s. Estimated remaining: 1m 51s. Rate: 153.6 symbols/min [2025-09-23T22:27:06.032549] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:06.046562] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:06.047808] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 31081 primary records. [2025-09-23T22:27:06.047934] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-23T22:27:06.079276] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-09-23T22:27:06.079562] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:06.080306] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53633 primary records. [2025-09-23T22:27:06.080415] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-23T22:27:06.082845] [INFO ] [MAIN ] Derivative Progress: 1793/2077 symbols completed. TEN took 1.2s. Estimated remaining: 1m 51s. Rate: 153.7 symbols/min [2025-09-23T22:27:06.080535] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-23T22:27:06.083222] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:06.101390] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-09-23T22:27:06.101571] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-23T22:27:06.104283] [INFO ] [MAIN ] Derivative Progress: 1794/2077 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 50s. Rate: 153.8 symbols/min [2025-09-23T22:27:06.104751] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:06.135438] [DEBUG] [LOCAL ] TEX: Loaded 44678 existing records from primary storage. [2025-09-23T22:27:06.135755] [INFO ] [MAIN ] TEX: Loaded 44678 primary data records. [2025-09-23T22:27:06.329978] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-23T22:27:06.349502] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-09-23T22:27:06.404247] [DEBUG] [LOCAL ] TFII: Loaded 34320 existing records from primary storage. [2025-09-23T22:27:06.549390] [INFO ] [MAIN ] TFII: Loaded 34320 primary data records. [2025-09-23T22:27:07.208553] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:07.209713] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 44678 primary records. [2025-09-23T22:27:07.209971] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-23T22:27:07.230596] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-09-23T22:27:07.231151] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-23T22:27:07.233132] [INFO ] [MAIN ] Derivative Progress: 1795/2077 symbols completed. TEX took 1.2s. Estimated remaining: 1m 50s. Rate: 153.6 symbols/min [2025-09-23T22:27:07.233755] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:07.246577] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:07.247794] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-09-23T22:27:07.249777] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-23T22:27:07.276128] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:07.280850] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 34320 primary records. [2025-09-23T22:27:07.281006] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-23T22:27:07.302003] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-09-23T22:27:07.305881] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-23T22:27:07.308412] [INFO ] [MAIN ] Derivative Progress: 1796/2077 symbols completed. TFC took 1.2s. Estimated remaining: 1m 50s. Rate: 153.7 symbols/min [2025-09-23T22:27:07.310108] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:07.320684] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-09-23T22:27:07.322041] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-23T22:27:07.322569] [DEBUG] [LOCAL ] TFIN: Loaded 23634 existing records from primary storage. [2025-09-23T22:27:07.322826] [INFO ] [MAIN ] TFIN: Loaded 23634 primary data records. [2025-09-23T22:27:07.327023] [INFO ] [MAIN ] Derivative Progress: 1797/2077 symbols completed. TFII took 1.2s. Estimated remaining: 1m 49s. Rate: 153.8 symbols/min [2025-09-23T22:27:07.327504] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:07.689324] [DEBUG] [LOCAL ] TFPM: Loaded 37335 existing records from primary storage. [2025-09-23T22:27:07.689595] [INFO ] [MAIN ] TFPM: Loaded 37335 primary data records. [2025-09-23T22:27:07.810633] [DEBUG] [LOCAL ] TFX: Loaded 37421 existing records from primary storage. [2025-09-23T22:27:07.815510] [INFO ] [MAIN ] TFX: Loaded 37421 primary data records. [2025-09-23T22:27:08.370541] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:08.371913] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23634 primary records. [2025-09-23T22:27:08.372380] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-23T22:27:08.391938] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-09-23T22:27:08.392697] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-23T22:27:08.395043] [INFO ] [MAIN ] Derivative Progress: 1798/2077 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 49s. Rate: 153.6 symbols/min [2025-09-23T22:27:08.412331] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:08.413408] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 37335 primary records. [2025-09-23T22:27:08.413492] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-23T22:27:08.431163] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-09-23T22:27:08.432234] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-23T22:27:08.435228] [INFO ] [MAIN ] Derivative Progress: 1799/2077 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 49s. Rate: 153.7 symbols/min [2025-09-23T22:27:08.448611] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:08.449305] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 37421 primary records. [2025-09-23T22:27:08.449381] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-23T22:27:08.465376] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-09-23T22:27:08.465441] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-23T22:27:08.468024] [INFO ] [MAIN ] Derivative Progress: 1800/2077 symbols completed. TFX took 1.1s. Estimated remaining: 1m 48s. Rate: 153.8 symbols/min [2025-09-23T22:27:08.468725] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:08.469050] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:08.469443] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:08.481617] [DEBUG] [LOCAL ] TG: Loaded 10498 existing records from primary storage. [2025-09-23T22:27:08.481838] [INFO ] [MAIN ] TG: Loaded 10498 primary data records. [2025-09-23T22:27:08.606396] [DEBUG] [LOCAL ] TGLS: Loaded 28378 existing records from primary storage. [2025-09-23T22:27:08.616823] [INFO ] [MAIN ] TGLS: Loaded 28378 primary data records. [2025-09-23T22:27:08.914881] [DEBUG] [LOCAL ] TGNA: Loaded 48720 existing records from primary storage. [2025-09-23T22:27:08.950762] [INFO ] [MAIN ] TGNA: Loaded 48720 primary data records. [2025-09-23T22:27:09.566028] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:09.567080] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10498 primary records. [2025-09-23T22:27:09.567384] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-23T22:27:09.589107] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-09-23T22:27:09.589325] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-23T22:27:09.591783] [INFO ] [MAIN ] Derivative Progress: 1801/2077 symbols completed. TG took 1.1s. Estimated remaining: 1m 48s. Rate: 153.6 symbols/min [2025-09-23T22:27:09.592300] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:09.606838] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:09.607741] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 28378 primary records. [2025-09-23T22:27:09.608219] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-23T22:27:09.639474] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:09.640779] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48720 primary records. [2025-09-23T22:27:09.641680] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-23T22:27:09.644318] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-09-23T22:27:09.652074] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-23T22:27:09.671049] [INFO ] [MAIN ] Derivative Progress: 1802/2077 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 47s. Rate: 153.7 symbols/min [2025-09-23T22:27:09.668410] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-09-23T22:27:09.671670] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:09.671564] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-23T22:27:09.674268] [INFO ] [MAIN ] Derivative Progress: 1803/2077 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 47s. Rate: 153.8 symbols/min [2025-09-23T22:27:09.674944] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:09.688895] [DEBUG] [LOCAL ] TGS: Loaded 32502 existing records from primary storage. [2025-09-23T22:27:09.689129] [INFO ] [MAIN ] TGS: Loaded 32502 primary data records. [2025-09-23T22:27:10.069491] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-23T22:27:10.071453] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-09-23T22:27:10.083898] [DEBUG] [LOCAL ] THC: Loaded 48112 existing records from primary storage. [2025-09-23T22:27:10.106127] [INFO ] [MAIN ] THC: Loaded 48112 primary data records. [2025-09-23T22:27:10.721053] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:10.723054] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32502 primary records. [2025-09-23T22:27:10.723702] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-23T22:27:10.743417] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-09-23T22:27:10.744464] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-23T22:27:10.747009] [INFO ] [MAIN ] Derivative Progress: 1804/2077 symbols completed. TGS took 1.2s. Estimated remaining: 1m 47s. Rate: 153.6 symbols/min [2025-09-23T22:27:10.747432] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:10.776780] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:10.785796] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 48112 primary records. [2025-09-23T22:27:10.791012] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-23T22:27:10.791682] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:10.793054] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-09-23T22:27:10.807764] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-23T22:27:10.809329] [DEBUG] [LOCAL ] THG: Loaded 21862 existing records from primary storage. [2025-09-23T22:27:10.812094] [INFO ] [MAIN ] THG: Loaded 21862 primary data records. [2025-09-23T22:27:10.817406] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-09-23T22:27:10.857449] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-23T22:27:10.872162] [INFO ] [MAIN ] Derivative Progress: 1805/2077 symbols completed. THC took 1.2s. Estimated remaining: 1m 46s. Rate: 153.7 symbols/min [2025-09-23T22:27:10.907281] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:10.936242] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-09-23T22:27:10.940211] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-23T22:27:10.942528] [INFO ] [MAIN ] Derivative Progress: 1806/2077 symbols completed. TGT took 1.3s. Estimated remaining: 1m 46s. Rate: 153.8 symbols/min [2025-09-23T22:27:10.948156] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:11.025895] [DEBUG] [LOCAL ] THIR: Loaded 2172 existing records from primary storage. [2025-09-23T22:27:11.130421] [DEBUG] [LOCAL ] THLV: Loaded 1623 existing records from primary storage. [2025-09-23T22:27:11.144579] [INFO ] [MAIN ] THLV: Loaded 1623 primary data records. [2025-09-23T22:27:11.144741] [INFO ] [MAIN ] THIR: Loaded 2172 primary data records. [2025-09-23T22:27:11.864099] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:11.865031] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21862 primary records. [2025-09-23T22:27:11.865340] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-23T22:27:11.883573] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-09-23T22:27:11.883811] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-23T22:27:11.886053] [INFO ] [MAIN ] Derivative Progress: 1807/2077 symbols completed. THG took 1.1s. Estimated remaining: 1m 45s. Rate: 153.6 symbols/min [2025-09-23T22:27:11.886434] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:11.920132] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:11.920523] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:27:11.921468] [INFO ] [MAIN ] THLV: Generated 1793 derivative records from 1623 primary records. [2025-09-23T22:27:11.922450] [INFO ] [MAIN ] THIR: Generated 1794 derivative records from 2172 primary records. [2025-09-23T22:27:11.922533] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-23T22:27:11.922726] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-23T22:27:11.949168] [DEBUG] [LOCAL ] THIR: Derivative data saved (1794 records). [2025-09-23T22:27:11.952800] [DEBUG] [LOCAL ] THLV: Derivative data saved (1793 records). [2025-09-23T22:27:11.952894] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-23T22:27:11.953098] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-23T22:27:11.955897] [INFO ] [MAIN ] Derivative Progress: 1808/2077 symbols completed. THLV took 1.0s. Estimated remaining: 1m 45s. Rate: 153.7 symbols/min [2025-09-23T22:27:11.958792] [INFO ] [MAIN ] Derivative Progress: 1809/2077 symbols completed. THIR took 1.1s. Estimated remaining: 1m 45s. Rate: 153.8 symbols/min [2025-09-23T22:27:11.956251] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:11.969493] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:11.987602] [DEBUG] [LOCAL ] THO: Loaded 42355 existing records from primary storage. [2025-09-23T22:27:11.992884] [INFO ] [MAIN ] THO: Loaded 42355 primary data records. [2025-09-23T22:27:12.094169] [DEBUG] [LOCAL ] THQ: Loaded 24507 existing records from primary storage. [2025-09-23T22:27:12.117909] [DEBUG] [LOCAL ] THR: Loaded 19961 existing records from primary storage. [2025-09-23T22:27:12.105515] [INFO ] [MAIN ] THQ: Loaded 24507 primary data records. [2025-09-23T22:27:12.118302] [INFO ] [MAIN ] THR: Loaded 19961 primary data records. [2025-09-23T22:27:12.969099] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:12.970352] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 42355 primary records. [2025-09-23T22:27:12.970827] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-23T22:27:12.992157] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-09-23T22:27:12.992627] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-23T22:27:13.019030] [INFO ] [MAIN ] Derivative Progress: 1810/2077 symbols completed. THO took 1.1s. Estimated remaining: 1m 44s. Rate: 153.7 symbols/min [2025-09-23T22:27:13.020121] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:13.021276] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:13.020953] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 24507 primary records. [2025-09-23T22:27:13.021580] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:13.022673] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-23T22:27:13.022554] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19961 primary records. [2025-09-23T22:27:13.023833] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-23T22:27:13.054764] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-09-23T22:27:13.056237] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-23T22:27:13.058795] [INFO ] [MAIN ] Derivative Progress: 1811/2077 symbols completed. THQ took 1.1s. Estimated remaining: 1m 44s. Rate: 153.7 symbols/min [2025-09-23T22:27:13.056113] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-09-23T22:27:13.059415] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:13.059333] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-23T22:27:13.062588] [INFO ] [MAIN ] Derivative Progress: 1812/2077 symbols completed. THR took 1.1s. Estimated remaining: 1m 43s. Rate: 153.8 symbols/min [2025-09-23T22:27:13.063215] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:13.112617] [DEBUG] [LOCAL ] THW: Loaded 19103 existing records from primary storage. [2025-09-23T22:27:13.112893] [INFO ] [MAIN ] THW: Loaded 19103 primary data records. [2025-09-23T22:27:13.113751] [DEBUG] [LOCAL ] THS: Loaded 37989 existing records from primary storage. [2025-09-23T22:27:13.136416] [INFO ] [MAIN ] THS: Loaded 37989 primary data records. [2025-09-23T22:27:13.202877] [DEBUG] [LOCAL ] TIMB: Loaded 36746 existing records from primary storage. [2025-09-23T22:27:13.234867] [INFO ] [MAIN ] TIMB: Loaded 36746 primary data records. [2025-09-23T22:27:14.106787] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:14.108153] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 37989 primary records. [2025-09-23T22:27:14.108482] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-23T22:27:14.130276] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-09-23T22:27:14.130509] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-23T22:27:14.132693] [INFO ] [MAIN ] Derivative Progress: 1813/2077 symbols completed. THS took 1.1s. Estimated remaining: 1m 43s. Rate: 153.7 symbols/min [2025-09-23T22:27:14.159499] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:14.160602] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19103 primary records. [2025-09-23T22:27:14.160961] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-23T22:27:14.160886] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:14.162457] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 36746 primary records. [2025-09-23T22:27:14.162533] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-23T22:27:14.191356] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-09-23T22:27:14.194561] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-09-23T22:27:14.194681] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-23T22:27:14.194782] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-23T22:27:14.197491] [INFO ] [MAIN ] Derivative Progress: 1814/2077 symbols completed. THW took 1.1s. Estimated remaining: 1m 43s. Rate: 153.7 symbols/min [2025-09-23T22:27:14.200481] [INFO ] [MAIN ] Derivative Progress: 1815/2077 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 42s. Rate: 153.8 symbols/min [2025-09-23T22:27:14.201107] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:14.201419] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:14.201365] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:14.209132] [DEBUG] [LOCAL ] TISI: Loaded 3847 existing records from primary storage. [2025-09-23T22:27:14.209261] [INFO ] [MAIN ] TISI: Loaded 3847 primary data records. [2025-09-23T22:27:14.575213] [DEBUG] [LOCAL ] TIXT: Loaded 31392 existing records from primary storage. [2025-09-23T22:27:14.576114] [INFO ] [MAIN ] TIXT: Loaded 31392 primary data records. [2025-09-23T22:27:14.704192] [DEBUG] [LOCAL ] TJX: Loaded 53672 existing records from primary storage. [2025-09-23T22:27:14.704503] [INFO ] [MAIN ] TJX: Loaded 53672 primary data records. [2025-09-23T22:27:15.289553] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:27:15.291383] [INFO ] [MAIN ] TISI: Generated 1793 derivative records from 3847 primary records. [2025-09-23T22:27:15.292356] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-23T22:27:15.311797] [DEBUG] [LOCAL ] TISI: Derivative data saved (1793 records). [2025-09-23T22:27:15.312178] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-23T22:27:15.314450] [INFO ] [MAIN ] Derivative Progress: 1816/2077 symbols completed. TISI took 1.1s. Estimated remaining: 1m 42s. Rate: 153.7 symbols/min [2025-09-23T22:27:15.316315] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:15.334451] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:15.335284] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31392 primary records. [2025-09-23T22:27:15.335726] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-23T22:27:15.354076] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-09-23T22:27:15.354342] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-23T22:27:15.357164] [INFO ] [MAIN ] Derivative Progress: 1817/2077 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 41s. Rate: 153.7 symbols/min [2025-09-23T22:27:15.370724] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:15.371316] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:15.372322] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53672 primary records. [2025-09-23T22:27:15.372524] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-23T22:27:15.402034] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-09-23T22:27:15.414482] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-23T22:27:15.417377] [INFO ] [MAIN ] Derivative Progress: 1818/2077 symbols completed. TJX took 1.2s. Estimated remaining: 1m 41s. Rate: 153.8 symbols/min [2025-09-23T22:27:15.418833] [DEBUG] [LOCAL ] TK: Loaded 39804 existing records from primary storage. [2025-09-23T22:27:15.419242] [INFO ] [MAIN ] TK: Loaded 39804 primary data records. [2025-09-23T22:27:15.419163] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:15.558114] [DEBUG] [LOCAL ] TKC: Loaded 38265 existing records from primary storage. [2025-09-23T22:27:15.563413] [INFO ] [MAIN ] TKC: Loaded 38265 primary data records. [2025-09-23T22:27:16.106073] [DEBUG] [LOCAL ] TKO: Loaded 44226 existing records from primary storage. [2025-09-23T22:27:16.107441] [INFO ] [MAIN ] TKO: Loaded 44226 primary data records. [2025-09-23T22:27:16.446242] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:16.447068] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39804 primary records. [2025-09-23T22:27:16.447259] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-23T22:27:16.466402] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-09-23T22:27:16.480801] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-23T22:27:16.481782] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:16.484785] [INFO ] [MAIN ] Derivative Progress: 1819/2077 symbols completed. TK took 1.2s. Estimated remaining: 1m 41s. Rate: 153.7 symbols/min [2025-09-23T22:27:16.482598] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 38265 primary records. [2025-09-23T22:27:16.485223] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:16.485745] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-23T22:27:16.505693] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-09-23T22:27:16.505950] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-23T22:27:16.508394] [INFO ] [MAIN ] Derivative Progress: 1820/2077 symbols completed. TKC took 1.1s. Estimated remaining: 1m 40s. Rate: 153.7 symbols/min [2025-09-23T22:27:16.508937] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:16.527454] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:16.528278] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 44226 primary records. [2025-09-23T22:27:16.528383] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-23T22:27:16.555750] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-09-23T22:27:16.555922] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-23T22:27:16.559297] [INFO ] [MAIN ] Derivative Progress: 1821/2077 symbols completed. TKO took 1.1s. Estimated remaining: 1m 40s. Rate: 153.8 symbols/min [2025-09-23T22:27:16.559740] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:16.575313] [DEBUG] [LOCAL ] TKR: Loaded 40151 existing records from primary storage. [2025-09-23T22:27:16.584150] [INFO ] [MAIN ] TKR: Loaded 40151 primary data records. [2025-09-23T22:27:16.664343] [DEBUG] [LOCAL ] TLYS: Loaded 16961 existing records from primary storage. [2025-09-23T22:27:16.701758] [INFO ] [MAIN ] TLYS: Loaded 16961 primary data records. [2025-09-23T22:27:16.710469] [DEBUG] [LOCAL ] TLK: Loaded 39553 existing records from primary storage. [2025-09-23T22:27:16.735564] [INFO ] [MAIN ] TLK: Loaded 39553 primary data records. [2025-09-23T22:27:17.646562] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:17.647802] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 40151 primary records. [2025-09-23T22:27:17.646928] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:17.649470] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16961 primary records. [2025-09-23T22:27:17.650281] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-23T22:27:17.648849] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-23T22:27:17.678792] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-09-23T22:27:17.684583] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-23T22:27:17.698232] [INFO ] [MAIN ] Derivative Progress: 1822/2077 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 40s. Rate: 153.7 symbols/min [2025-09-23T22:27:17.700282] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:17.704181] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:17.704317] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-09-23T22:27:17.704094] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 39553 primary records. [2025-09-23T22:27:17.704842] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-23T22:27:17.704971] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-23T22:27:17.707039] [INFO ] [MAIN ] Derivative Progress: 1823/2077 symbols completed. TKR took 1.2s. Estimated remaining: 1m 39s. Rate: 153.7 symbols/min [2025-09-23T22:27:17.708453] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:17.725313] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-09-23T22:27:17.725561] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-23T22:27:17.728716] [INFO ] [MAIN ] Derivative Progress: 1824/2077 symbols completed. TLK took 1.2s. Estimated remaining: 1m 39s. Rate: 153.8 symbols/min [2025-09-23T22:27:17.729119] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:17.761960] [DEBUG] [LOCAL ] TM: Loaded 36620 existing records from primary storage. [2025-09-23T22:27:17.775442] [INFO ] [MAIN ] TM: Loaded 36620 primary data records. [2025-09-23T22:27:17.937244] [DEBUG] [LOCAL ] TME: Loaded 53200 existing records from primary storage. [2025-09-23T22:27:17.938573] [DEBUG] [LOCAL ] TMHC: Loaded 45664 existing records from primary storage. [2025-09-23T22:27:17.937486] [INFO ] [MAIN ] TME: Loaded 53200 primary data records. [2025-09-23T22:27:17.949304] [INFO ] [MAIN ] TMHC: Loaded 45664 primary data records. [2025-09-23T22:27:18.819618] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:18.820452] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36620 primary records. [2025-09-23T22:27:18.821084] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-23T22:27:18.839898] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-09-23T22:27:18.840273] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-23T22:27:18.842230] [INFO ] [MAIN ] Derivative Progress: 1825/2077 symbols completed. TM took 1.1s. Estimated remaining: 1m 38s. Rate: 153.7 symbols/min [2025-09-23T22:27:18.842618] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:18.863364] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:18.876943] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45664 primary records. [2025-09-23T22:27:18.877215] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-23T22:27:18.877488] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:18.878825] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53200 primary records. [2025-09-23T22:27:18.878939] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-23T22:27:18.906502] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-09-23T22:27:18.908811] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-23T22:27:18.915455] [INFO ] [MAIN ] Derivative Progress: 1826/2077 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 38s. Rate: 153.7 symbols/min [2025-09-23T22:27:18.917422] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-09-23T22:27:18.917337] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:18.917544] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-23T22:27:18.920368] [INFO ] [MAIN ] Derivative Progress: 1827/2077 symbols completed. TME took 1.2s. Estimated remaining: 1m 38s. Rate: 153.8 symbols/min [2025-09-23T22:27:18.922955] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:18.949505] [DEBUG] [LOCAL ] TNC: Loaded 15269 existing records from primary storage. [2025-09-23T22:27:18.949757] [INFO ] [MAIN ] TNC: Loaded 15269 primary data records. [2025-09-23T22:27:19.098972] [DEBUG] [LOCAL ] TNET: Loaded 28910 existing records from primary storage. [2025-09-23T22:27:19.093072] [DEBUG] [LOCAL ] TMO: Loaded 52331 existing records from primary storage. [2025-09-23T22:27:19.104232] [INFO ] [MAIN ] TNET: Loaded 28910 primary data records. [2025-09-23T22:27:19.114628] [INFO ] [MAIN ] TMO: Loaded 52331 primary data records. [2025-09-23T22:27:20.003482] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:20.004375] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 15269 primary records. [2025-09-23T22:27:20.004868] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-23T22:27:20.038335] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:20.040545] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52331 primary records. [2025-09-23T22:27:20.043028] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-23T22:27:20.044247] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-09-23T22:27:20.045102] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-23T22:27:20.059136] [INFO ] [MAIN ] Derivative Progress: 1828/2077 symbols completed. TNC took 1.1s. Estimated remaining: 1m 37s. Rate: 153.6 symbols/min [2025-09-23T22:27:20.063960] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-09-23T22:27:20.077755] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-23T22:27:20.080698] [INFO ] [MAIN ] Derivative Progress: 1829/2077 symbols completed. TMO took 1.2s. Estimated remaining: 1m 37s. Rate: 153.7 symbols/min [2025-09-23T22:27:20.078053] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:20.081806] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28910 primary records. [2025-09-23T22:27:20.082041] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-23T22:27:20.098492] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-09-23T22:27:20.098631] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-23T22:27:20.101249] [INFO ] [MAIN ] Derivative Progress: 1830/2077 symbols completed. TNET took 1.2s. Estimated remaining: 1m 36s. Rate: 153.8 symbols/min [2025-09-23T22:27:20.102319] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:20.102126] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:20.102613] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:20.164491] [DEBUG] [LOCAL ] TNK: Loaded 35266 existing records from primary storage. [2025-09-23T22:27:20.164690] [INFO ] [MAIN ] TNK: Loaded 35266 primary data records. [2025-09-23T22:27:20.294075] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-23T22:27:20.306963] [DEBUG] [LOCAL ] TNL: Loaded 41949 existing records from primary storage. [2025-09-23T22:27:20.307074] [INFO ] [MAIN ] TOST: Loaded 53681 primary data records. [2025-09-23T22:27:20.307226] [INFO ] [MAIN ] TNL: Loaded 41949 primary data records. [2025-09-23T22:27:21.163234] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:21.164459] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35266 primary records. [2025-09-23T22:27:21.164590] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-23T22:27:21.184432] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-09-23T22:27:21.192424] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-23T22:27:21.200262] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:27:21.199817] [INFO ] [MAIN ] Derivative Progress: 1831/2077 symbols completed. TNK took 1.1s. Estimated remaining: 1m 36s. Rate: 153.7 symbols/min [2025-09-23T22:27:21.201199] [INFO ] [MAIN ] TNL: Generated 1793 derivative records from 41949 primary records. [2025-09-23T22:27:21.201844] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:21.201796] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-23T22:27:21.234262] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:21.236055] [DEBUG] [LOCAL ] TNL: Derivative data saved (1793 records). [2025-09-23T22:27:21.236895] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53681 primary records. [2025-09-23T22:27:21.237060] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-23T22:27:21.237409] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-23T22:27:21.240168] [INFO ] [MAIN ] Derivative Progress: 1832/2077 symbols completed. TNL took 1.1s. Estimated remaining: 1m 36s. Rate: 153.7 symbols/min [2025-09-23T22:27:21.247888] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:21.261567] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-09-23T22:27:21.261843] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-23T22:27:21.264562] [INFO ] [MAIN ] Derivative Progress: 1833/2077 symbols completed. TOST took 1.2s. Estimated remaining: 1m 35s. Rate: 153.8 symbols/min [2025-09-23T22:27:21.265059] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:21.276278] [DEBUG] [LOCAL ] TPB: Loaded 24884 existing records from primary storage. [2025-09-23T22:27:21.276475] [INFO ] [MAIN ] TPB: Loaded 24884 primary data records. [2025-09-23T22:27:21.651037] [DEBUG] [LOCAL ] TPC: Loaded 38834 existing records from primary storage. [2025-09-23T22:27:21.660508] [DEBUG] [LOCAL ] TPH: Loaded 45210 existing records from primary storage. [2025-09-23T22:27:21.660735] [INFO ] [MAIN ] TPH: Loaded 45210 primary data records. [2025-09-23T22:27:21.659883] [INFO ] [MAIN ] TPC: Loaded 38834 primary data records. [2025-09-23T22:27:22.312606] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:22.314236] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 24884 primary records. [2025-09-23T22:27:22.314769] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-23T22:27:22.337838] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-09-23T22:27:22.338052] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-23T22:27:22.341855] [INFO ] [MAIN ] Derivative Progress: 1834/2077 symbols completed. TPB took 1.1s. Estimated remaining: 1m 35s. Rate: 153.7 symbols/min [2025-09-23T22:27:22.343138] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:22.371173] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:22.371521] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:22.373585] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38834 primary records. [2025-09-23T22:27:22.373971] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 45210 primary records. [2025-09-23T22:27:22.373855] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-23T22:27:22.374130] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-23T22:27:22.408530] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-09-23T22:27:22.410366] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-23T22:27:22.417564] [INFO ] [MAIN ] Derivative Progress: 1835/2077 symbols completed. TPC took 1.2s. Estimated remaining: 1m 34s. Rate: 153.7 symbols/min [2025-09-23T22:27:22.418087] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-09-23T22:27:22.418432] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-23T22:27:22.418993] [DEBUG] [LOCAL ] TPL: Loaded 12414 existing records from primary storage. [2025-09-23T22:27:22.421981] [INFO ] [MAIN ] Derivative Progress: 1836/2077 symbols completed. TPH took 1.2s. Estimated remaining: 1m 34s. Rate: 153.8 symbols/min [2025-09-23T22:27:22.422195] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:22.422491] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:22.422954] [INFO ] [MAIN ] TPL: Loaded 12414 primary data records. [2025-09-23T22:27:22.625464] [DEBUG] [LOCAL ] TPVG: Loaded 26984 existing records from primary storage. [2025-09-23T22:27:22.634709] [INFO ] [MAIN ] TPVG: Loaded 26984 primary data records. [2025-09-23T22:27:22.900497] [DEBUG] [LOCAL ] TPR: Loaded 53483 existing records from primary storage. [2025-09-23T22:27:22.911067] [INFO ] [MAIN ] TPR: Loaded 53483 primary data records. [2025-09-23T22:27:23.464922] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:23.466708] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12414 primary records. [2025-09-23T22:27:23.467162] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-23T22:27:23.485558] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-09-23T22:27:23.486818] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-23T22:27:23.489003] [INFO ] [MAIN ] Derivative Progress: 1837/2077 symbols completed. TPL took 1.1s. Estimated remaining: 1m 34s. Rate: 153.7 symbols/min [2025-09-23T22:27:23.489337] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:23.507266] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:23.510106] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 26984 primary records. [2025-09-23T22:27:23.510457] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-23T22:27:23.514565] [DEBUG] [LOCAL ] TPYP: Loaded 7880 existing records from primary storage. [2025-09-23T22:27:23.514706] [INFO ] [MAIN ] TPYP: Loaded 7880 primary data records. [2025-09-23T22:27:23.709764] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-09-23T22:27:23.734531] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-23T22:27:23.728783] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:23.736998] [INFO ] [MAIN ] Derivative Progress: 1838/2077 symbols completed. TPVG took 1.3s. Estimated remaining: 1m 33s. Rate: 153.7 symbols/min [2025-09-23T22:27:23.853554] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:23.854584] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53483 primary records. [2025-09-23T22:27:23.855049] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-23T22:27:23.873940] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-09-23T22:27:23.874485] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-23T22:27:23.877184] [INFO ] [MAIN ] Derivative Progress: 1839/2077 symbols completed. TPR took 1.5s. Estimated remaining: 1m 33s. Rate: 153.8 symbols/min [2025-09-23T22:27:23.877825] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:23.881423] [DEBUG] [LOCAL ] TPZ: Loaded 5169 existing records from primary storage. [2025-09-23T22:27:23.881512] [INFO ] [MAIN ] TPZ: Loaded 5169 primary data records. [2025-09-23T22:27:24.058125] [DEBUG] [LOCAL ] TR: Loaded 18319 existing records from primary storage. [2025-09-23T22:27:24.080212] [INFO ] [MAIN ] TR: Loaded 18319 primary data records. [2025-09-23T22:27:24.358964] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:24.398172] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7880 primary records. [2025-09-23T22:27:24.532011] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-23T22:27:24.559077] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-09-23T22:27:24.559434] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-23T22:27:24.562017] [INFO ] [MAIN ] Derivative Progress: 1840/2077 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 33s. Rate: 153.7 symbols/min [2025-09-23T22:27:24.562615] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:24.583767] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:27:24.584934] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 5169 primary records. [2025-09-23T22:27:24.585093] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-23T22:27:24.590190] [DEBUG] [LOCAL ] TRAK: Loaded 9317 existing records from primary storage. [2025-09-23T22:27:24.590500] [INFO ] [MAIN ] TRAK: Loaded 9317 primary data records. [2025-09-23T22:27:24.674367] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-09-23T22:27:24.686282] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-23T22:27:24.694143] [INFO ] [MAIN ] Derivative Progress: 1841/2077 symbols completed. TPZ took 0.8s. Estimated remaining: 1m 32s. Rate: 153.7 symbols/min [2025-09-23T22:27:24.713324] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:24.770365] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:24.782770] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18319 primary records. [2025-09-23T22:27:24.788589] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-23T22:27:24.955777] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-09-23T22:27:24.956912] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-23T22:27:24.959729] [INFO ] [MAIN ] Derivative Progress: 1842/2077 symbols completed. TR took 1.1s. Estimated remaining: 1m 32s. Rate: 153.8 symbols/min [2025-09-23T22:27:24.956819] [DEBUG] [LOCAL ] TRC: Loaded 16061 existing records from primary storage. [2025-09-23T22:27:24.960808] [INFO ] [MAIN ] TRC: Loaded 16061 primary data records. [2025-09-23T22:27:24.960595] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:25.297917] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:25.298895] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9317 primary records. [2025-09-23T22:27:25.299062] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-23T22:27:25.316277] [DEBUG] [LOCAL ] TREX: Loaded 50009 existing records from primary storage. [2025-09-23T22:27:25.323809] [INFO ] [MAIN ] TREX: Loaded 50009 primary data records. [2025-09-23T22:27:25.332300] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-09-23T22:27:25.353773] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-23T22:27:25.373807] [INFO ] [MAIN ] Derivative Progress: 1843/2077 symbols completed. TRAK took 0.8s. Estimated remaining: 1m 31s. Rate: 153.8 symbols/min [2025-09-23T22:27:25.522856] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:25.544997] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 16061 primary records. [2025-09-23T22:27:25.618538] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-23T22:27:25.719091] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-09-23T22:27:25.719787] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-23T22:27:25.722588] [INFO ] [MAIN ] Derivative Progress: 1844/2077 symbols completed. TRC took 1.0s. Estimated remaining: 1m 31s. Rate: 153.8 symbols/min [2025-09-23T22:27:25.743370] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:25.744111] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 50009 primary records. [2025-09-23T22:27:25.744198] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-23T22:27:25.759292] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-09-23T22:27:25.759356] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-23T22:27:25.761429] [INFO ] [MAIN ] Derivative Progress: 1845/2077 symbols completed. TREX took 0.8s. Estimated remaining: 1m 30s. Rate: 153.8 symbols/min [2025-09-23T22:27:25.762352] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:25.762551] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:25.762182] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:25.837943] [DEBUG] [LOCAL ] TRNO: Loaded 44131 existing records from primary storage. [2025-09-23T22:27:25.838109] [INFO ] [MAIN ] TRNO: Loaded 44131 primary data records. [2025-09-23T22:27:25.850395] [DEBUG] [LOCAL ] TRN: Loaded 37402 existing records from primary storage. [2025-09-23T22:27:25.860441] [INFO ] [MAIN ] TRN: Loaded 37402 primary data records. [2025-09-23T22:27:26.080725] [DEBUG] [LOCAL ] TRGP: Loaded 50845 existing records from primary storage. [2025-09-23T22:27:26.135079] [INFO ] [MAIN ] TRGP: Loaded 50845 primary data records. [2025-09-23T22:27:26.841397] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:26.843452] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 37402 primary records. [2025-09-23T22:27:26.845298] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-23T22:27:26.875235] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:26.876824] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 44131 primary records. [2025-09-23T22:27:26.877307] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-23T22:27:26.898143] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-09-23T22:27:26.900846] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-09-23T22:27:26.901271] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-23T22:27:26.901005] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-23T22:27:26.915986] [INFO ] [MAIN ] Derivative Progress: 1846/2077 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 30s. Rate: 153.7 symbols/min [2025-09-23T22:27:26.919342] [INFO ] [MAIN ] Derivative Progress: 1847/2077 symbols completed. TRN took 1.2s. Estimated remaining: 1m 30s. Rate: 153.8 symbols/min [2025-09-23T22:27:26.919089] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:26.919294] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:26.920562] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50845 primary records. [2025-09-23T22:27:26.919784] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:26.920856] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-23T22:27:26.938790] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-09-23T22:27:26.939007] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-23T22:27:26.941693] [INFO ] [MAIN ] Derivative Progress: 1848/2077 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 29s. Rate: 153.8 symbols/min [2025-09-23T22:27:26.942093] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:27.017042] [DEBUG] [LOCAL ] TRP: Loaded 52132 existing records from primary storage. [2025-09-23T22:27:27.018484] [INFO ] [MAIN ] TRP: Loaded 52132 primary data records. [2025-09-23T22:27:27.018303] [DEBUG] [LOCAL ] TRTX: Loaded 37337 existing records from primary storage. [2025-09-23T22:27:27.018991] [INFO ] [MAIN ] TRTX: Loaded 37337 primary data records. [2025-09-23T22:27:27.076683] [DEBUG] [LOCAL ] TROX: Loaded 51774 existing records from primary storage. [2025-09-23T22:27:27.159130] [INFO ] [MAIN ] TROX: Loaded 51774 primary data records. [2025-09-23T22:27:28.058047] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:28.059933] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52132 primary records. [2025-09-23T22:27:28.060675] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-23T22:27:28.103743] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-09-23T22:27:28.103849] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-23T22:27:28.104290] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:28.105240] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37337 primary records. [2025-09-23T22:27:28.107100] [INFO ] [MAIN ] Derivative Progress: 1849/2077 symbols completed. TRP took 1.2s. Estimated remaining: 1m 29s. Rate: 153.7 symbols/min [2025-09-23T22:27:28.107695] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:28.107397] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-23T22:27:28.116614] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:28.109698] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51774 primary records. [2025-09-23T22:27:28.121780] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-23T22:27:28.141898] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-09-23T22:27:28.141996] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-23T22:27:28.141152] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-09-23T22:27:28.144714] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-23T22:27:28.144532] [INFO ] [MAIN ] Derivative Progress: 1850/2077 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 29s. Rate: 153.8 symbols/min [2025-09-23T22:27:28.144943] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:28.148268] [INFO ] [MAIN ] Derivative Progress: 1851/2077 symbols completed. TROX took 1.2s. Estimated remaining: 1m 28s. Rate: 153.8 symbols/min [2025-09-23T22:27:28.148825] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:28.216718] [DEBUG] [LOCAL ] TRU: Loaded 51195 existing records from primary storage. [2025-09-23T22:27:28.216859] [INFO ] [MAIN ] TRU: Loaded 51195 primary data records. [2025-09-23T22:27:28.354249] [DEBUG] [LOCAL ] TRV: Loaded 48229 existing records from primary storage. [2025-09-23T22:27:28.364709] [INFO ] [MAIN ] TRV: Loaded 48229 primary data records. [2025-09-23T22:27:28.400670] [DEBUG] [LOCAL ] TS: Loaded 51665 existing records from primary storage. [2025-09-23T22:27:28.409232] [INFO ] [MAIN ] TS: Loaded 51665 primary data records. [2025-09-23T22:27:29.205214] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:29.206004] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51195 primary records. [2025-09-23T22:27:29.206295] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-23T22:27:29.223211] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-09-23T22:27:29.223324] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-23T22:27:29.228404] [INFO ] [MAIN ] Derivative Progress: 1852/2077 symbols completed. TRU took 1.1s. Estimated remaining: 1m 28s. Rate: 153.7 symbols/min [2025-09-23T22:27:29.231095] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:29.245708] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:29.247281] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 48229 primary records. [2025-09-23T22:27:29.260768] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:29.260449] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-23T22:27:29.261913] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51665 primary records. [2025-09-23T22:27:29.262426] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-23T22:27:29.289284] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-09-23T22:27:29.290340] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-23T22:27:29.292708] [INFO ] [MAIN ] Derivative Progress: 1853/2077 symbols completed. TRV took 1.1s. Estimated remaining: 1m 27s. Rate: 153.8 symbols/min [2025-09-23T22:27:29.293320] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:29.308117] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-09-23T22:27:29.308317] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-23T22:27:29.311519] [INFO ] [MAIN ] Derivative Progress: 1854/2077 symbols completed. TS took 1.2s. Estimated remaining: 1m 27s. Rate: 153.8 symbols/min [2025-09-23T22:27:29.311961] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:29.316149] [DEBUG] [LOCAL ] TSI: Loaded 8206 existing records from primary storage. [2025-09-23T22:27:29.316399] [INFO ] [MAIN ] TSI: Loaded 8206 primary data records. [2025-09-23T22:27:29.415828] [DEBUG] [LOCAL ] TSE: Loaded 28764 existing records from primary storage. [2025-09-23T22:27:29.429918] [INFO ] [MAIN ] TSE: Loaded 28764 primary data records. [2025-09-23T22:27:29.877708] [DEBUG] [LOCAL ] TSLX: Loaded 35229 existing records from primary storage. [2025-09-23T22:27:29.902809] [INFO ] [MAIN ] TSLX: Loaded 35229 primary data records. [2025-09-23T22:27:30.329796] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:30.331506] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 8206 primary records. [2025-09-23T22:27:30.339293] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-23T22:27:30.346483] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:30.357207] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 28764 primary records. [2025-09-23T22:27:30.361153] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-23T22:27:30.361258] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-09-23T22:27:30.362217] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-23T22:27:30.364434] [INFO ] [MAIN ] Derivative Progress: 1855/2077 symbols completed. TSI took 1.1s. Estimated remaining: 1m 27s. Rate: 153.7 symbols/min [2025-09-23T22:27:30.372802] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:30.380149] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-09-23T22:27:30.380518] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-23T22:27:30.382676] [INFO ] [MAIN ] Derivative Progress: 1856/2077 symbols completed. TSE took 1.2s. Estimated remaining: 1m 26s. Rate: 153.8 symbols/min [2025-09-23T22:27:30.383158] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:30.401157] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:30.401918] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35229 primary records. [2025-09-23T22:27:30.402033] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-23T22:27:30.421269] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-09-23T22:27:30.421498] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-23T22:27:30.424220] [INFO ] [MAIN ] Derivative Progress: 1857/2077 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 26s. Rate: 153.9 symbols/min [2025-09-23T22:27:30.424572] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:30.437924] [DEBUG] [LOCAL ] TSQ: Loaded 12114 existing records from primary storage. [2025-09-23T22:27:30.438052] [INFO ] [MAIN ] TSQ: Loaded 12114 primary data records. [2025-09-23T22:27:30.606501] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-23T22:27:30.620554] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-09-23T22:27:30.672082] [DEBUG] [LOCAL ] TSN: Loaded 52872 existing records from primary storage. [2025-09-23T22:27:30.683402] [INFO ] [MAIN ] TSN: Loaded 52872 primary data records. [2025-09-23T22:27:31.466811] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:31.468225] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 12114 primary records. [2025-09-23T22:27:31.468475] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-23T22:27:31.486193] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-09-23T22:27:31.486799] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-23T22:27:31.488633] [INFO ] [MAIN ] Derivative Progress: 1858/2077 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 25s. Rate: 153.7 symbols/min [2025-09-23T22:27:31.508164] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:31.510717] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52872 primary records. [2025-09-23T22:27:31.510800] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-23T22:27:31.539666] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:31.541530] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-09-23T22:27:31.540777] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-09-23T22:27:31.541695] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-23T22:27:31.541767] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-23T22:27:31.544180] [INFO ] [MAIN ] Derivative Progress: 1859/2077 symbols completed. TSN took 1.2s. Estimated remaining: 1m 25s. Rate: 153.8 symbols/min [2025-09-23T22:27:31.560703] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-09-23T22:27:31.560780] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-23T22:27:31.563427] [INFO ] [MAIN ] Derivative Progress: 1860/2077 symbols completed. TSM took 1.2s. Estimated remaining: 1m 25s. Rate: 153.9 symbols/min [2025-09-23T22:27:31.564202] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:31.564298] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:31.564122] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:31.626890] [DEBUG] [LOCAL ] TTC: Loaded 42609 existing records from primary storage. [2025-09-23T22:27:31.642056] [INFO ] [MAIN ] TTC: Loaded 42609 primary data records. [2025-09-23T22:27:31.676707] [DEBUG] [LOCAL ] TTE: Loaded 51652 existing records from primary storage. [2025-09-23T22:27:31.687360] [INFO ] [MAIN ] TTE: Loaded 51652 primary data records. [2025-09-23T22:27:31.693494] [DEBUG] [LOCAL ] TT: Loaded 47893 existing records from primary storage. [2025-09-23T22:27:31.772764] [INFO ] [MAIN ] TT: Loaded 47893 primary data records. [2025-09-23T22:27:32.660462] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:32.661698] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42609 primary records. [2025-09-23T22:27:32.673958] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-23T22:27:32.675759] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:32.676900] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47893 primary records. [2025-09-23T22:27:32.677849] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-23T22:27:32.709392] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-09-23T22:27:32.710294] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-23T22:27:32.724605] [INFO ] [MAIN ] Derivative Progress: 1861/2077 symbols completed. TTC took 1.2s. Estimated remaining: 1m 24s. Rate: 153.7 symbols/min [2025-09-23T22:27:32.732482] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:32.732020] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:32.732940] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-09-23T22:27:32.733910] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51652 primary records. [2025-09-23T22:27:32.734120] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-23T22:27:32.734489] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-23T22:27:32.737506] [INFO ] [MAIN ] Derivative Progress: 1862/2077 symbols completed. TT took 1.2s. Estimated remaining: 1m 24s. Rate: 153.8 symbols/min [2025-09-23T22:27:32.738848] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:32.754719] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-09-23T22:27:32.754916] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-23T22:27:32.757490] [INFO ] [MAIN ] Derivative Progress: 1863/2077 symbols completed. TTE took 1.2s. Estimated remaining: 1m 23s. Rate: 153.9 symbols/min [2025-09-23T22:27:32.757878] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:32.804026] [DEBUG] [LOCAL ] TTI: Loaded 45312 existing records from primary storage. [2025-09-23T22:27:32.804290] [INFO ] [MAIN ] TTI: Loaded 45312 primary data records. [2025-09-23T22:27:32.913953] [DEBUG] [LOCAL ] TUYA: Loaded 46578 existing records from primary storage. [2025-09-23T22:27:32.950797] [INFO ] [MAIN ] TUYA: Loaded 46578 primary data records. [2025-09-23T22:27:32.962844] [DEBUG] [LOCAL ] TU: Loaded 49920 existing records from primary storage. [2025-09-23T22:27:33.012259] [INFO ] [MAIN ] TU: Loaded 49920 primary data records. [2025-09-23T22:27:33.841494] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:33.842861] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45312 primary records. [2025-09-23T22:27:33.843231] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-23T22:27:33.860467] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-09-23T22:27:33.860835] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-23T22:27:33.862966] [INFO ] [MAIN ] Derivative Progress: 1864/2077 symbols completed. TTI took 1.1s. Estimated remaining: 1m 23s. Rate: 153.7 symbols/min [2025-09-23T22:27:33.863440] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:33.895670] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:33.896078] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:33.896999] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49920 primary records. [2025-09-23T22:27:33.897207] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-23T22:27:33.898094] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46578 primary records. [2025-09-23T22:27:33.898948] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-23T22:27:33.921974] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-09-23T22:27:33.922159] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-23T22:27:33.929163] [INFO ] [MAIN ] Derivative Progress: 1865/2077 symbols completed. TU took 1.2s. Estimated remaining: 1m 23s. Rate: 153.8 symbols/min [2025-09-23T22:27:33.930167] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:33.945156] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-09-23T22:27:33.945462] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-23T22:27:33.948140] [DEBUG] [LOCAL ] TVC: Loaded 3471 existing records from primary storage. [2025-09-23T22:27:33.950682] [INFO ] [MAIN ] Derivative Progress: 1866/2077 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 22s. Rate: 153.8 symbols/min [2025-09-23T22:27:33.951052] [INFO ] [MAIN ] TVC: Loaded 3471 primary data records. [2025-09-23T22:27:33.956835] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:34.058557] [DEBUG] [LOCAL ] TV: Loaded 43003 existing records from primary storage. [2025-09-23T22:27:34.069846] [INFO ] [MAIN ] TV: Loaded 43003 primary data records. [2025-09-23T22:27:34.093568] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-23T22:27:34.114749] [INFO ] [MAIN ] TVE: Loaded 2795 primary data records. [2025-09-23T22:27:34.940534] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:34.941930] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3471 primary records. [2025-09-23T22:27:34.943169] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-23T22:27:34.973500] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-09-23T22:27:34.974099] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-23T22:27:34.974018] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:34.976374] [INFO ] [MAIN ] Derivative Progress: 1867/2077 symbols completed. TVC took 1.0s. Estimated remaining: 1m 22s. Rate: 153.7 symbols/min [2025-09-23T22:27:34.977617] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 43003 primary records. [2025-09-23T22:27:34.978189] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-23T22:27:34.978128] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:35.009514] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:35.010996] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2795 primary records. [2025-09-23T22:27:35.011857] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-23T22:27:35.033895] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-09-23T22:27:35.034831] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-23T22:27:35.037425] [INFO ] [MAIN ] Derivative Progress: 1868/2077 symbols completed. TV took 1.2s. Estimated remaining: 1m 22s. Rate: 153.8 symbols/min [2025-09-23T22:27:35.038345] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:35.040950] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-09-23T22:27:35.041256] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-23T22:27:35.043845] [INFO ] [MAIN ] Derivative Progress: 1869/2077 symbols completed. TVE took 1.1s. Estimated remaining: 1m 21s. Rate: 153.9 symbols/min [2025-09-23T22:27:35.044832] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:35.056248] [DEBUG] [LOCAL ] TWI: Loaded 34560 existing records from primary storage. [2025-09-23T22:27:35.056476] [INFO ] [MAIN ] TWI: Loaded 34560 primary data records. [2025-09-23T22:27:35.102999] [DEBUG] [LOCAL ] TWN: Loaded 3226 existing records from primary storage. [2025-09-23T22:27:35.121701] [INFO ] [MAIN ] TWN: Loaded 3226 primary data records. [2025-09-23T22:27:35.742821] [DEBUG] [LOCAL ] TWLO: Loaded 52725 existing records from primary storage. [2025-09-23T22:27:35.743874] [INFO ] [MAIN ] TWLO: Loaded 52725 primary data records. [2025-09-23T22:27:36.077400] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:36.078631] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34560 primary records. [2025-09-23T22:27:36.079084] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-23T22:27:36.092210] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:36.094956] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3226 primary records. [2025-09-23T22:27:36.101952] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-23T22:27:36.116564] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-09-23T22:27:36.121122] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-23T22:27:36.123848] [INFO ] [MAIN ] Derivative Progress: 1870/2077 symbols completed. TWI took 1.1s. Estimated remaining: 1m 21s. Rate: 153.7 symbols/min [2025-09-23T22:27:36.124569] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:36.129515] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-09-23T22:27:36.129738] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-23T22:27:36.132142] [INFO ] [MAIN ] Derivative Progress: 1871/2077 symbols completed. TWN took 1.1s. Estimated remaining: 1m 20s. Rate: 153.8 symbols/min [2025-09-23T22:27:36.132397] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:36.149498] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:36.150218] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52725 primary records. [2025-09-23T22:27:36.150376] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-23T22:27:36.172928] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-09-23T22:27:36.173074] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-23T22:27:36.175422] [INFO ] [MAIN ] Derivative Progress: 1872/2077 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 20s. Rate: 153.9 symbols/min [2025-09-23T22:27:36.182749] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:36.194601] [DEBUG] [LOCAL ] TX: Loaded 23690 existing records from primary storage. [2025-09-23T22:27:36.194700] [INFO ] [MAIN ] TX: Loaded 23690 primary data records. [2025-09-23T22:27:36.321920] [DEBUG] [LOCAL ] TWO: Loaded 48326 existing records from primary storage. [2025-09-23T22:27:36.344017] [INFO ] [MAIN ] TWO: Loaded 48326 primary data records. [2025-09-23T22:27:36.656891] [DEBUG] [LOCAL ] TXNM: Loaded 43982 existing records from primary storage. [2025-09-23T22:27:36.657226] [INFO ] [MAIN ] TXNM: Loaded 43982 primary data records. [2025-09-23T22:27:37.194533] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:37.195722] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23690 primary records. [2025-09-23T22:27:37.196066] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-23T22:27:37.215440] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-09-23T22:27:37.216627] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-23T22:27:37.219549] [INFO ] [MAIN ] Derivative Progress: 1873/2077 symbols completed. TX took 1.1s. Estimated remaining: 1m 20s. Rate: 153.7 symbols/min [2025-09-23T22:27:37.233772] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:37.234409] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48326 primary records. [2025-09-23T22:27:37.234637] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-23T22:27:37.264892] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-09-23T22:27:37.264982] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-23T22:27:37.264198] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:37.267238] [INFO ] [MAIN ] Derivative Progress: 1874/2077 symbols completed. TWO took 1.1s. Estimated remaining: 1m 19s. Rate: 153.8 symbols/min [2025-09-23T22:27:37.268031] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43982 primary records. [2025-09-23T22:27:37.268094] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-23T22:27:37.283468] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-09-23T22:27:37.283527] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-23T22:27:37.286260] [INFO ] [MAIN ] Derivative Progress: 1875/2077 symbols completed. TXNM took 1.1s. Estimated remaining: 1m 19s. Rate: 153.9 symbols/min [2025-09-23T22:27:37.286782] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:37.286993] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:37.286871] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:37.297104] [DEBUG] [LOCAL ] TY: Loaded 7679 existing records from primary storage. [2025-09-23T22:27:37.297232] [INFO ] [MAIN ] TY: Loaded 7679 primary data records. [2025-09-23T22:27:37.411820] [DEBUG] [LOCAL ] TXO: Loaded 18744 existing records from primary storage. [2025-09-23T22:27:37.412329] [INFO ] [MAIN ] TXO: Loaded 18744 primary data records. [2025-09-23T22:27:37.756069] [DEBUG] [LOCAL ] TXT: Loaded 49764 existing records from primary storage. [2025-09-23T22:27:37.780701] [INFO ] [MAIN ] TXT: Loaded 49764 primary data records. [2025-09-23T22:27:38.298910] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:38.300895] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7679 primary records. [2025-09-23T22:27:38.300993] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-23T22:27:38.329889] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:38.331783] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 18744 primary records. [2025-09-23T22:27:38.332117] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-23T22:27:38.342527] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-09-23T22:27:38.346417] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-23T22:27:38.352229] [INFO ] [MAIN ] Derivative Progress: 1876/2077 symbols completed. TY took 1.1s. Estimated remaining: 1m 18s. Rate: 153.7 symbols/min [2025-09-23T22:27:38.353294] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:38.353353] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-09-23T22:27:38.353590] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-23T22:27:38.358465] [INFO ] [MAIN ] Derivative Progress: 1877/2077 symbols completed. TXO took 1.1s. Estimated remaining: 1m 18s. Rate: 153.8 symbols/min [2025-09-23T22:27:38.359836] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:38.374119] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:38.374889] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49764 primary records. [2025-09-23T22:27:38.375017] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-23T22:27:38.400798] [DEBUG] [LOCAL ] TYG: Loaded 14240 existing records from primary storage. [2025-09-23T22:27:38.400438] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-09-23T22:27:38.401067] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-23T22:27:38.403709] [INFO ] [MAIN ] Derivative Progress: 1878/2077 symbols completed. TXT took 1.1s. Estimated remaining: 1m 18s. Rate: 153.9 symbols/min [2025-09-23T22:27:38.403884] [INFO ] [MAIN ] TYG: Loaded 14240 primary data records. [2025-09-23T22:27:38.409471] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:38.529119] [DEBUG] [LOCAL ] TYL: Loaded 22381 existing records from primary storage. [2025-09-23T22:27:38.540685] [INFO ] [MAIN ] TYL: Loaded 22381 primary data records. [2025-09-23T22:27:38.930981] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-23T22:27:38.956305] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-09-23T22:27:39.409800] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:39.419043] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 14240 primary records. [2025-09-23T22:27:39.423701] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-23T22:27:39.425013] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:39.434902] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22381 primary records. [2025-09-23T22:27:39.438039] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-23T22:27:39.457724] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-09-23T22:27:39.458045] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-23T22:27:39.460256] [INFO ] [MAIN ] Derivative Progress: 1879/2077 symbols completed. TYG took 1.1s. Estimated remaining: 1m 17s. Rate: 153.8 symbols/min [2025-09-23T22:27:39.461055] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:39.463429] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-09-23T22:27:39.463995] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-23T22:27:39.467823] [INFO ] [MAIN ] Derivative Progress: 1880/2077 symbols completed. TYL took 1.1s. Estimated remaining: 1m 17s. Rate: 153.8 symbols/min [2025-09-23T22:27:39.468848] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:39.482539] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:39.483269] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-09-23T22:27:39.483415] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-23T22:27:39.501009] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-09-23T22:27:39.501085] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-23T22:27:39.503869] [INFO ] [MAIN ] Derivative Progress: 1881/2077 symbols completed. U took 1.1s. Estimated remaining: 1m 16s. Rate: 153.9 symbols/min [2025-09-23T22:27:39.504165] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:39.522472] [DEBUG] [LOCAL ] UAN: Loaded 5454 existing records from primary storage. [2025-09-23T22:27:39.522758] [INFO ] [MAIN ] UAN: Loaded 5454 primary data records. [2025-09-23T22:27:39.659901] [DEBUG] [LOCAL ] UA: Loaded 50417 existing records from primary storage. [2025-09-23T22:27:39.694250] [INFO ] [MAIN ] UA: Loaded 50417 primary data records. [2025-09-23T22:27:39.913859] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-09-23T22:27:39.968512] [INFO ] [MAIN ] UAA: Loaded 53509 primary data records. [2025-09-23T22:27:40.537050] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:40.538079] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5454 primary records. [2025-09-23T22:27:40.539400] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-23T22:27:40.559570] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-09-23T22:27:40.559736] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-23T22:27:40.562137] [INFO ] [MAIN ] Derivative Progress: 1882/2077 symbols completed. UAN took 1.1s. Estimated remaining: 1m 16s. Rate: 153.8 symbols/min [2025-09-23T22:27:40.562500] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:40.577216] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:40.579520] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50417 primary records. [2025-09-23T22:27:40.579727] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-23T22:27:40.601424] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:40.605427] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53509 primary records. [2025-09-23T22:27:40.606032] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-23T22:27:40.623766] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-09-23T22:27:40.624322] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-23T22:27:40.627340] [INFO ] [MAIN ] Derivative Progress: 1883/2077 symbols completed. UA took 1.2s. Estimated remaining: 1m 16s. Rate: 153.8 symbols/min [2025-09-23T22:27:40.628097] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:40.630807] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-09-23T22:27:40.630893] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-23T22:27:40.633710] [INFO ] [MAIN ] Derivative Progress: 1884/2077 symbols completed. UAA took 1.2s. Estimated remaining: 1m 15s. Rate: 153.9 symbols/min [2025-09-23T22:27:40.633985] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:40.671912] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-23T22:27:40.672178] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-09-23T22:27:40.886759] [DEBUG] [LOCAL ] UCB: Loaded 38105 existing records from primary storage. [2025-09-23T22:27:40.900398] [INFO ] [MAIN ] UCB: Loaded 38105 primary data records. [2025-09-23T22:27:41.014764] [DEBUG] [LOCAL ] UBS: Loaded 52443 existing records from primary storage. [2025-09-23T22:27:41.044681] [INFO ] [MAIN ] UBS: Loaded 52443 primary data records. [2025-09-23T22:27:41.691227] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:41.692239] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-09-23T22:27:41.692400] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-23T22:27:41.725096] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-09-23T22:27:41.725978] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-23T22:27:41.725915] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:41.728326] [INFO ] [MAIN ] Derivative Progress: 1885/2077 symbols completed. UBER took 1.2s. Estimated remaining: 1m 15s. Rate: 153.8 symbols/min [2025-09-23T22:27:41.729249] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 38105 primary records. [2025-09-23T22:27:41.729468] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-23T22:27:41.729898] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:41.759445] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:41.760959] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52443 primary records. [2025-09-23T22:27:41.761342] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-23T22:27:41.771636] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-09-23T22:27:41.774257] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-23T22:27:41.776913] [INFO ] [MAIN ] Derivative Progress: 1886/2077 symbols completed. UCB took 1.1s. Estimated remaining: 1m 14s. Rate: 153.8 symbols/min [2025-09-23T22:27:41.780858] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:41.782405] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-09-23T22:27:41.782632] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-23T22:27:41.785426] [INFO ] [MAIN ] Derivative Progress: 1887/2077 symbols completed. UBS took 1.2s. Estimated remaining: 1m 14s. Rate: 153.9 symbols/min [2025-09-23T22:27:41.785762] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:41.797988] [DEBUG] [LOCAL ] UFI: Loaded 8156 existing records from primary storage. [2025-09-23T22:27:41.798189] [INFO ] [MAIN ] UFI: Loaded 8156 primary data records. [2025-09-23T22:27:41.941024] [DEBUG] [LOCAL ] UDR: Loaded 51781 existing records from primary storage. [2025-09-23T22:27:41.978362] [INFO ] [MAIN ] UDR: Loaded 51781 primary data records. [2025-09-23T22:27:42.253543] [DEBUG] [LOCAL ] UE: Loaded 42935 existing records from primary storage. [2025-09-23T22:27:42.269698] [INFO ] [MAIN ] UE: Loaded 42935 primary data records. [2025-09-23T22:27:42.793940] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:42.795400] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8156 primary records. [2025-09-23T22:27:42.795620] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-23T22:27:42.826194] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:42.827889] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51781 primary records. [2025-09-23T22:27:42.828880] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-23T22:27:42.828834] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-09-23T22:27:42.828981] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-23T22:27:42.831996] [INFO ] [MAIN ] Derivative Progress: 1888/2077 symbols completed. UFI took 1.0s. Estimated remaining: 1m 14s. Rate: 153.8 symbols/min [2025-09-23T22:27:42.847677] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-09-23T22:27:42.847929] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-23T22:27:42.850491] [INFO ] [MAIN ] Derivative Progress: 1889/2077 symbols completed. UDR took 1.1s. Estimated remaining: 1m 13s. Rate: 153.9 symbols/min [2025-09-23T22:27:42.865385] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:42.866067] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42935 primary records. [2025-09-23T22:27:42.866128] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-23T22:27:42.881623] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-09-23T22:27:42.881710] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-23T22:27:42.884360] [INFO ] [MAIN ] Derivative Progress: 1890/2077 symbols completed. UE took 1.1s. Estimated remaining: 1m 13s. Rate: 153.9 symbols/min [2025-09-23T22:27:42.884971] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:42.885130] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:42.885079] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:42.903073] [DEBUG] [LOCAL ] UHAL: Loaded 16490 existing records from primary storage. [2025-09-23T22:27:42.903307] [INFO ] [MAIN ] UHAL: Loaded 16490 primary data records. [2025-09-23T22:27:43.248429] [DEBUG] [LOCAL ] UGI: Loaded 50552 existing records from primary storage. [2025-09-23T22:27:43.249342] [DEBUG] [LOCAL ] UGP: Loaded 42568 existing records from primary storage. [2025-09-23T22:27:43.249631] [INFO ] [MAIN ] UGP: Loaded 42568 primary data records. [2025-09-23T22:27:43.249834] [INFO ] [MAIN ] UGI: Loaded 50552 primary data records. [2025-09-23T22:27:43.915431] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:43.917765] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16490 primary records. [2025-09-23T22:27:43.917956] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-23T22:27:43.940543] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-09-23T22:27:43.941510] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-23T22:27:43.945034] [INFO ] [MAIN ] Derivative Progress: 1891/2077 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 13s. Rate: 153.8 symbols/min [2025-09-23T22:27:43.945367] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:43.960377] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:43.973335] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50552 primary records. [2025-09-23T22:27:43.973815] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:43.973547] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-23T22:27:43.974858] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42568 primary records. [2025-09-23T22:27:43.975235] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-23T22:27:44.006416] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-09-23T22:27:44.006785] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-23T22:27:44.011458] [INFO ] [MAIN ] Derivative Progress: 1892/2077 symbols completed. UGP took 1.1s. Estimated remaining: 1m 12s. Rate: 153.9 symbols/min [2025-09-23T22:27:44.012202] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:44.012143] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-09-23T22:27:44.012307] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-23T22:27:44.014684] [INFO ] [MAIN ] Derivative Progress: 1893/2077 symbols completed. UGI took 1.1s. Estimated remaining: 1m 12s. Rate: 153.9 symbols/min [2025-09-23T22:27:44.023914] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:44.039010] [DEBUG] [LOCAL ] UHT: Loaded 10042 existing records from primary storage. [2025-09-23T22:27:44.039247] [INFO ] [MAIN ] UHT: Loaded 10042 primary data records. [2025-09-23T22:27:44.135297] [DEBUG] [LOCAL ] UI: Loaded 12673 existing records from primary storage. [2025-09-23T22:27:44.121699] [DEBUG] [LOCAL ] UHS: Loaded 41216 existing records from primary storage. [2025-09-23T22:27:44.140742] [INFO ] [MAIN ] UI: Loaded 12673 primary data records. [2025-09-23T22:27:44.208342] [INFO ] [MAIN ] UHS: Loaded 41216 primary data records. [2025-09-23T22:27:45.026073] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:45.027573] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10042 primary records. [2025-09-23T22:27:45.028541] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-23T22:27:45.057846] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:45.060675] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 12673 primary records. [2025-09-23T22:27:45.061251] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-23T22:27:45.079435] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:45.087177] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 41216 primary records. [2025-09-23T22:27:45.078541] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-09-23T22:27:45.088563] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-23T22:27:45.091316] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-23T22:27:45.095507] [INFO ] [MAIN ] Derivative Progress: 1894/2077 symbols completed. UHT took 1.1s. Estimated remaining: 1m 11s. Rate: 153.8 symbols/min [2025-09-23T22:27:45.106448] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-09-23T22:27:45.111118] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-23T22:27:45.113973] [INFO ] [MAIN ] Derivative Progress: 1895/2077 symbols completed. UI took 1.1s. Estimated remaining: 1m 11s. Rate: 153.9 symbols/min [2025-09-23T22:27:45.114900] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:45.106555] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:45.122219] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-09-23T22:27:45.122314] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-23T22:27:45.125250] [INFO ] [MAIN ] Derivative Progress: 1896/2077 symbols completed. UHS took 1.2s. Estimated remaining: 1m 11s. Rate: 154.0 symbols/min [2025-09-23T22:27:45.125590] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:45.184532] [DEBUG] [LOCAL ] UIS: Loaded 37092 existing records from primary storage. [2025-09-23T22:27:45.200327] [INFO ] [MAIN ] UIS: Loaded 37092 primary data records. [2025-09-23T22:27:45.212337] [DEBUG] [LOCAL ] ULS: Loaded 39325 existing records from primary storage. [2025-09-23T22:27:45.232134] [INFO ] [MAIN ] ULS: Loaded 39325 primary data records. [2025-09-23T22:27:45.429340] [DEBUG] [LOCAL ] UL: Loaded 53069 existing records from primary storage. [2025-09-23T22:27:45.430353] [INFO ] [MAIN ] UL: Loaded 53069 primary data records. [2025-09-23T22:27:46.210538] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:46.217014] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39325 primary records. [2025-09-23T22:27:46.217144] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-23T22:27:46.216245] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:46.218969] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 37092 primary records. [2025-09-23T22:27:46.219251] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-23T22:27:46.253006] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-09-23T22:27:46.253300] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-23T22:27:46.252352] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-09-23T22:27:46.255535] [INFO ] [MAIN ] Derivative Progress: 1897/2077 symbols completed. ULS took 1.1s. Estimated remaining: 1m 10s. Rate: 153.8 symbols/min [2025-09-23T22:27:46.256094] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-23T22:27:46.256026] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:46.267960] [INFO ] [MAIN ] Derivative Progress: 1898/2077 symbols completed. UIS took 1.2s. Estimated remaining: 1m 10s. Rate: 153.9 symbols/min [2025-09-23T22:27:46.273798] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:46.273707] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:46.274791] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53069 primary records. [2025-09-23T22:27:46.275359] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-23T22:27:46.292373] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-09-23T22:27:46.292528] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-23T22:27:46.295291] [INFO ] [MAIN ] Derivative Progress: 1899/2077 symbols completed. UL took 1.2s. Estimated remaining: 1m 9s. Rate: 154.0 symbols/min [2025-09-23T22:27:46.295660] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:46.317018] [DEBUG] [LOCAL ] UNF: Loaded 11855 existing records from primary storage. [2025-09-23T22:27:46.317217] [INFO ] [MAIN ] UNF: Loaded 11855 primary data records. [2025-09-23T22:27:46.412029] [DEBUG] [LOCAL ] UMH: Loaded 33444 existing records from primary storage. [2025-09-23T22:27:46.424918] [INFO ] [MAIN ] UMH: Loaded 33444 primary data records. [2025-09-23T22:27:46.520853] [DEBUG] [LOCAL ] UMC: Loaded 52732 existing records from primary storage. [2025-09-23T22:27:46.567705] [INFO ] [MAIN ] UMC: Loaded 52732 primary data records. [2025-09-23T22:27:47.304836] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:47.305999] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11855 primary records. [2025-09-23T22:27:47.306198] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-23T22:27:47.323968] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-09-23T22:27:47.324265] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-23T22:27:47.326258] [INFO ] [MAIN ] Derivative Progress: 1900/2077 symbols completed. UNF took 1.0s. Estimated remaining: 1m 9s. Rate: 153.8 symbols/min [2025-09-23T22:27:47.328289] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:47.352600] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:47.357960] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:47.358794] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52732 primary records. [2025-09-23T22:27:47.359715] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33444 primary records. [2025-09-23T22:27:47.359829] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-23T22:27:47.359969] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-23T22:27:47.388296] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-09-23T22:27:47.389206] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-23T22:27:47.392371] [INFO ] [MAIN ] Derivative Progress: 1901/2077 symbols completed. UMH took 1.1s. Estimated remaining: 1m 9s. Rate: 153.9 symbols/min [2025-09-23T22:27:47.393133] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:47.407058] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-09-23T22:27:47.407201] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-23T22:27:47.409978] [INFO ] [MAIN ] Derivative Progress: 1902/2077 symbols completed. UMC took 1.2s. Estimated remaining: 1m 8s. Rate: 154.0 symbols/min [2025-09-23T22:27:47.410383] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:47.426541] [DEBUG] [LOCAL ] UNFI: Loaded 41876 existing records from primary storage. [2025-09-23T22:27:47.426789] [INFO ] [MAIN ] UNFI: Loaded 41876 primary data records. [2025-09-23T22:27:47.817061] [DEBUG] [LOCAL ] UNH: Loaded 53794 existing records from primary storage. [2025-09-23T22:27:47.817977] [DEBUG] [LOCAL ] UNM: Loaded 48702 existing records from primary storage. [2025-09-23T22:27:47.818867] [INFO ] [MAIN ] UNH: Loaded 53794 primary data records. [2025-09-23T22:27:47.818178] [INFO ] [MAIN ] UNM: Loaded 48702 primary data records. [2025-09-23T22:27:48.466748] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:48.469465] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 41876 primary records. [2025-09-23T22:27:48.469791] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-23T22:27:48.489569] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-09-23T22:27:48.489945] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-23T22:27:48.492791] [INFO ] [MAIN ] Derivative Progress: 1903/2077 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 8s. Rate: 153.8 symbols/min [2025-09-23T22:27:48.510340] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:48.511048] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53794 primary records. [2025-09-23T22:27:48.511203] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-23T22:27:48.529551] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-09-23T22:27:48.529855] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-23T22:27:48.532467] [INFO ] [MAIN ] Derivative Progress: 1904/2077 symbols completed. UNH took 1.1s. Estimated remaining: 1m 7s. Rate: 153.9 symbols/min [2025-09-23T22:27:48.547176] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:48.548034] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48702 primary records. [2025-09-23T22:27:48.548116] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-23T22:27:48.565753] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-09-23T22:27:48.565853] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-23T22:27:48.569111] [INFO ] [MAIN ] Derivative Progress: 1905/2077 symbols completed. UNM took 1.2s. Estimated remaining: 1m 7s. Rate: 154.0 symbols/min [2025-09-23T22:27:48.569696] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:48.569847] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:48.570362] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:48.577825] [DEBUG] [LOCAL ] UNMA: Loaded 3622 existing records from primary storage. [2025-09-23T22:27:48.577937] [INFO ] [MAIN ] UNMA: Loaded 3622 primary data records. [2025-09-23T22:27:48.912425] [DEBUG] [LOCAL ] UP: Loaded 43073 existing records from primary storage. [2025-09-23T22:27:48.912697] [INFO ] [MAIN ] UP: Loaded 43073 primary data records. [2025-09-23T22:27:49.030923] [DEBUG] [LOCAL ] UNP: Loaded 53245 existing records from primary storage. [2025-09-23T22:27:49.034372] [INFO ] [MAIN ] UNP: Loaded 53245 primary data records. [2025-09-23T22:27:49.622265] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:49.624848] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3622 primary records. [2025-09-23T22:27:49.625245] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-23T22:27:49.642899] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-09-23T22:27:49.643561] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-23T22:27:49.646481] [INFO ] [MAIN ] Derivative Progress: 1906/2077 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 7s. Rate: 153.8 symbols/min [2025-09-23T22:27:49.647050] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:49.667443] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:49.668250] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43073 primary records. [2025-09-23T22:27:49.668555] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-23T22:27:49.685934] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-09-23T22:27:49.686209] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-23T22:27:49.690503] [INFO ] [MAIN ] Derivative Progress: 1907/2077 symbols completed. UP took 1.1s. Estimated remaining: 1m 6s. Rate: 153.9 symbols/min [2025-09-23T22:27:49.691949] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:49.706357] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:49.707132] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53245 primary records. [2025-09-23T22:27:49.707256] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-23T22:27:49.724190] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-09-23T22:27:49.724364] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-23T22:27:49.727285] [INFO ] [MAIN ] Derivative Progress: 1908/2077 symbols completed. UNP took 1.2s. Estimated remaining: 1m 6s. Rate: 154.0 symbols/min [2025-09-23T22:27:49.727632] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:49.783249] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-23T22:27:49.783453] [INFO ] [MAIN ] UPS: Loaded 53710 primary data records. [2025-09-23T22:27:49.881547] [DEBUG] [LOCAL ] URI: Loaded 36431 existing records from primary storage. [2025-09-23T22:27:49.903935] [INFO ] [MAIN ] URI: Loaded 36431 primary data records. [2025-09-23T22:27:50.066299] [DEBUG] [LOCAL ] USA: Loaded 36108 existing records from primary storage. [2025-09-23T22:27:50.078949] [INFO ] [MAIN ] USA: Loaded 36108 primary data records. [2025-09-23T22:27:50.774818] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:50.774542] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:50.775926] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 36431 primary records. [2025-09-23T22:27:50.776172] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-23T22:27:50.777498] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53710 primary records. [2025-09-23T22:27:50.777620] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-23T22:27:50.806386] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-09-23T22:27:50.806820] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-23T22:27:50.809027] [INFO ] [MAIN ] Derivative Progress: 1909/2077 symbols completed. UPS took 1.2s. Estimated remaining: 1m 6s. Rate: 153.8 symbols/min [2025-09-23T22:27:50.812602] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:50.831605] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-09-23T22:27:50.832085] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-23T22:27:50.832005] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:50.832995] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36108 primary records. [2025-09-23T22:27:50.841256] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-23T22:27:50.841378] [INFO ] [MAIN ] Derivative Progress: 1910/2077 symbols completed. URI took 1.1s. Estimated remaining: 1m 5s. Rate: 153.9 symbols/min [2025-09-23T22:27:50.842190] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:50.864453] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-09-23T22:27:50.864604] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-23T22:27:50.870517] [INFO ] [MAIN ] Derivative Progress: 1911/2077 symbols completed. USA took 1.1s. Estimated remaining: 1m 5s. Rate: 154.0 symbols/min [2025-09-23T22:27:50.870804] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:50.880721] [DEBUG] [LOCAL ] USAC: Loaded 22901 existing records from primary storage. [2025-09-23T22:27:50.880982] [INFO ] [MAIN ] USAC: Loaded 22901 primary data records. [2025-09-23T22:27:51.224557] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-23T22:27:51.225693] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-09-23T22:27:51.343845] [DEBUG] [LOCAL ] USFD: Loaded 51227 existing records from primary storage. [2025-09-23T22:27:51.349618] [INFO ] [MAIN ] USFD: Loaded 51227 primary data records. [2025-09-23T22:27:51.900494] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:51.901385] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 22901 primary records. [2025-09-23T22:27:51.901588] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-23T22:27:51.920337] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-09-23T22:27:51.920621] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-23T22:27:51.922924] [INFO ] [MAIN ] Derivative Progress: 1912/2077 symbols completed. USAC took 1.1s. Estimated remaining: 1m 4s. Rate: 153.8 symbols/min [2025-09-23T22:27:51.923358] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:51.944811] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:51.950340] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-09-23T22:27:51.950509] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-23T22:27:51.973020] [DEBUG] [LOCAL ] USNA: Loaded 18221 existing records from primary storage. [2025-09-23T22:27:51.973142] [INFO ] [MAIN ] USNA: Loaded 18221 primary data records. [2025-09-23T22:27:52.051284] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:52.064581] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51227 primary records. [2025-09-23T22:27:52.077904] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-09-23T22:27:52.076117] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-23T22:27:52.095000] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-23T22:27:52.097130] [INFO ] [MAIN ] Derivative Progress: 1913/2077 symbols completed. USB took 1.3s. Estimated remaining: 1m 4s. Rate: 153.9 symbols/min [2025-09-23T22:27:52.124617] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:52.133834] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-09-23T22:27:52.161789] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-23T22:27:52.193442] [INFO ] [MAIN ] Derivative Progress: 1914/2077 symbols completed. USFD took 1.3s. Estimated remaining: 1m 4s. Rate: 153.9 symbols/min [2025-09-23T22:27:52.307008] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:52.323003] [DEBUG] [LOCAL ] USPH: Loaded 16579 existing records from primary storage. [2025-09-23T22:27:52.323522] [INFO ] [MAIN ] USPH: Loaded 16579 primary data records. [2025-09-23T22:27:52.541124] [DEBUG] [LOCAL ] UTF: Loaded 28596 existing records from primary storage. [2025-09-23T22:27:52.541346] [INFO ] [MAIN ] UTF: Loaded 28596 primary data records. [2025-09-23T22:27:52.763015] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:52.781831] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 18221 primary records. [2025-09-23T22:27:52.781970] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-23T22:27:52.843069] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-09-23T22:27:52.880364] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-23T22:27:52.999012] [INFO ] [MAIN ] Derivative Progress: 1915/2077 symbols completed. USNA took 1.1s. Estimated remaining: 1m 3s. Rate: 153.9 symbols/min [2025-09-23T22:27:53.001092] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:53.027446] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:53.028538] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16579 primary records. [2025-09-23T22:27:53.028910] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-23T22:27:53.055894] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-09-23T22:27:53.056135] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-23T22:27:53.058909] [INFO ] [MAIN ] Derivative Progress: 1916/2077 symbols completed. USPH took 0.9s. Estimated remaining: 1m 3s. Rate: 153.9 symbols/min [2025-09-23T22:27:53.059497] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:53.092697] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:53.093753] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 28596 primary records. [2025-09-23T22:27:53.094872] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-23T22:27:53.094673] [DEBUG] [LOCAL ] UTI: Loaded 40514 existing records from primary storage. [2025-09-23T22:27:53.095393] [INFO ] [MAIN ] UTI: Loaded 40514 primary data records. [2025-09-23T22:27:53.113914] [DEBUG] [LOCAL ] UTL: Loaded 11057 existing records from primary storage. [2025-09-23T22:27:53.144902] [INFO ] [MAIN ] UTL: Loaded 11057 primary data records. [2025-09-23T22:27:53.341678] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-09-23T22:27:53.347074] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-23T22:27:53.354768] [INFO ] [MAIN ] Derivative Progress: 1917/2077 symbols completed. UTF took 1.1s. Estimated remaining: 1m 2s. Rate: 153.9 symbols/min [2025-09-23T22:27:53.373723] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:53.841013] [DEBUG] [LOCAL ] UTZ: Loaded 44740 existing records from primary storage. [2025-09-23T22:27:53.841692] [INFO ] [MAIN ] UTZ: Loaded 44740 primary data records. [2025-09-23T22:27:54.047068] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:54.153990] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11057 primary records. [2025-09-23T22:27:54.172006] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-23T22:27:54.181895] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:54.183099] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40514 primary records. [2025-09-23T22:27:54.190230] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-23T22:27:54.214331] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-09-23T22:27:54.215491] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-23T22:27:54.219796] [INFO ] [MAIN ] Derivative Progress: 1918/2077 symbols completed. UTL took 1.2s. Estimated remaining: 1m 2s. Rate: 153.9 symbols/min [2025-09-23T22:27:54.220019] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-09-23T22:27:54.220765] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-23T22:27:54.230470] [INFO ] [MAIN ] Derivative Progress: 1919/2077 symbols completed. UTI took 1.2s. Estimated remaining: 1m 2s. Rate: 153.9 symbols/min [2025-09-23T22:27:54.249728] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:54.250277] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44740 primary records. [2025-09-23T22:27:54.250336] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-23T22:27:54.265357] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-09-23T22:27:54.265414] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-23T22:27:54.267925] [INFO ] [MAIN ] Derivative Progress: 1920/2077 symbols completed. UTZ took 0.9s. Estimated remaining: 1m 1s. Rate: 154.0 symbols/min [2025-09-23T22:27:54.268435] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:54.268670] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:54.269092] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:54.296259] [DEBUG] [LOCAL ] UVE: Loaded 21861 existing records from primary storage. [2025-09-23T22:27:54.304155] [DEBUG] [LOCAL ] UVV: Loaded 22410 existing records from primary storage. [2025-09-23T22:27:54.304242] [INFO ] [MAIN ] UVV: Loaded 22410 primary data records. [2025-09-23T22:27:54.303799] [INFO ] [MAIN ] UVE: Loaded 21861 primary data records. [2025-09-23T22:27:54.812571] [DEBUG] [LOCAL ] UWMC: Loaded 52739 existing records from primary storage. [2025-09-23T22:27:54.943237] [INFO ] [MAIN ] UWMC: Loaded 52739 primary data records. [2025-09-23T22:27:55.294692] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:55.295621] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22410 primary records. [2025-09-23T22:27:55.307993] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-23T22:27:55.309455] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:55.310157] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21861 primary records. [2025-09-23T22:27:55.310878] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-23T22:27:55.338430] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-09-23T22:27:55.338780] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-23T22:27:55.342971] [INFO ] [MAIN ] Derivative Progress: 1921/2077 symbols completed. UVV took 1.1s. Estimated remaining: 1m 1s. Rate: 153.9 symbols/min [2025-09-23T22:27:55.343606] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:55.346040] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-09-23T22:27:55.346258] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-23T22:27:55.348862] [INFO ] [MAIN ] Derivative Progress: 1922/2077 symbols completed. UVE took 1.1s. Estimated remaining: 1m 0s. Rate: 153.9 symbols/min [2025-09-23T22:27:55.349452] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:55.372538] [DEBUG] [LOCAL ] UZD: Loaded 6309 existing records from primary storage. [2025-09-23T22:27:55.372777] [INFO ] [MAIN ] UZD: Loaded 6309 primary data records. [2025-09-23T22:27:55.373188] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:55.385211] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52739 primary records. [2025-09-23T22:27:55.434598] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-23T22:27:55.444098] [DEBUG] [LOCAL ] UZE: Loaded 7458 existing records from primary storage. [2025-09-23T22:27:55.450142] [INFO ] [MAIN ] UZE: Loaded 7458 primary data records. [2025-09-23T22:27:55.634387] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-09-23T22:27:55.658271] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-23T22:27:55.672136] [INFO ] [MAIN ] Derivative Progress: 1923/2077 symbols completed. UWMC took 1.4s. Estimated remaining: 1m 0s. Rate: 154.0 symbols/min [2025-09-23T22:27:55.692983] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:56.067613] [DEBUG] [LOCAL ] UZF: Loaded 6444 existing records from primary storage. [2025-09-23T22:27:56.068886] [INFO ] [MAIN ] UZF: Loaded 6444 primary data records. [2025-09-23T22:27:56.418911] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-09-23T22:27:56.432018] [INFO ] [MAIN ] UZE: Generated 1789 derivative records from 7458 primary records. [2025-09-23T22:27:56.432413] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-23T22:27:56.434046] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:56.435756] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6309 primary records. [2025-09-23T22:27:56.437036] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-23T22:27:56.464581] [DEBUG] [LOCAL ] UZE: Derivative data saved (1789 records). [2025-09-23T22:27:56.464996] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-23T22:27:56.467739] [INFO ] [MAIN ] Derivative Progress: 1924/2077 symbols completed. UZE took 1.1s. Estimated remaining: 59.7s. Rate: 153.9 symbols/min [2025-09-23T22:27:56.468851] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:56.475870] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-09-23T22:27:56.488444] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-23T22:27:56.488885] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:56.489700] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6444 primary records. [2025-09-23T22:27:56.491938] [INFO ] [MAIN ] Derivative Progress: 1925/2077 symbols completed. UZD took 1.1s. Estimated remaining: 59.2s. Rate: 153.9 symbols/min [2025-09-23T22:27:56.492383] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-23T22:27:56.492304] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:56.508144] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-09-23T22:27:56.508340] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-23T22:27:56.511136] [INFO ] [MAIN ] Derivative Progress: 1926/2077 symbols completed. UZF took 0.8s. Estimated remaining: 58.8s. Rate: 154.0 symbols/min [2025-09-23T22:27:56.511552] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:56.592512] [DEBUG] [LOCAL ] V: Loaded 53763 existing records from primary storage. [2025-09-23T22:27:56.593873] [INFO ] [MAIN ] V: Loaded 53763 primary data records. [2025-09-23T22:27:56.628978] [DEBUG] [LOCAL ] VAC: Loaded 34611 existing records from primary storage. [2025-09-23T22:27:56.645127] [INFO ] [MAIN ] VAC: Loaded 34611 primary data records. [2025-09-23T22:27:56.653220] [DEBUG] [LOCAL ] VAL: Loaded 50437 existing records from primary storage. [2025-09-23T22:27:56.730531] [INFO ] [MAIN ] VAL: Loaded 50437 primary data records. [2025-09-23T22:27:57.548979] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:57.550350] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34611 primary records. [2025-09-23T22:27:57.550856] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-23T22:27:57.583619] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:57.599336] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53763 primary records. [2025-09-23T22:27:57.599933] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:57.599596] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-23T22:27:57.598457] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-09-23T22:27:57.601137] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50437 primary records. [2025-09-23T22:27:57.601784] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-23T22:27:57.601210] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-23T22:27:57.604880] [INFO ] [MAIN ] Derivative Progress: 1927/2077 symbols completed. VAC took 1.1s. Estimated remaining: 58.5s. Rate: 153.9 symbols/min [2025-09-23T22:27:57.625194] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:57.636007] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-09-23T22:27:57.636777] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-23T22:27:57.640505] [INFO ] [MAIN ] Derivative Progress: 1928/2077 symbols completed. V took 1.2s. Estimated remaining: 58.1s. Rate: 154.0 symbols/min [2025-09-23T22:27:57.641336] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:57.644902] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-09-23T22:27:57.644975] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-23T22:27:57.647884] [INFO ] [MAIN ] Derivative Progress: 1929/2077 symbols completed. VAL took 1.1s. Estimated remaining: 57.7s. Rate: 154.0 symbols/min [2025-09-23T22:27:57.648270] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:57.656051] [DEBUG] [LOCAL ] VATE: Loaded 5673 existing records from primary storage. [2025-09-23T22:27:57.656262] [INFO ] [MAIN ] VATE: Loaded 5673 primary data records. [2025-09-23T22:27:57.754278] [DEBUG] [LOCAL ] VBF: Loaded 7089 existing records from primary storage. [2025-09-23T22:27:57.767457] [INFO ] [MAIN ] VBF: Loaded 7089 primary data records. [2025-09-23T22:27:57.981968] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-23T22:27:58.044593] [INFO ] [MAIN ] VALE: Loaded 53694 primary data records. [2025-09-23T22:27:58.682745] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:58.683742] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7089 primary records. [2025-09-23T22:27:58.683882] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-23T22:27:58.704756] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:58.709422] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5673 primary records. [2025-09-23T22:27:58.709748] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-23T22:27:58.720530] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-09-23T22:27:58.720746] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-23T22:27:58.723954] [INFO ] [MAIN ] Derivative Progress: 1930/2077 symbols completed. VBF took 1.1s. Estimated remaining: 57.3s. Rate: 153.9 symbols/min [2025-09-23T22:27:58.727315] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:58.733087] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-09-23T22:27:58.734769] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-23T22:27:58.740220] [INFO ] [MAIN ] Derivative Progress: 1931/2077 symbols completed. VATE took 1.1s. Estimated remaining: 56.9s. Rate: 154.0 symbols/min [2025-09-23T22:27:58.740682] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:58.760121] [DEBUG] [LOCAL ] VCV: Loaded 13406 existing records from primary storage. [2025-09-23T22:27:58.759844] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:58.761096] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53694 primary records. [2025-09-23T22:27:58.761219] [INFO ] [MAIN ] VCV: Loaded 13406 primary data records. [2025-09-23T22:27:58.766474] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-23T22:27:59.094080] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-09-23T22:27:59.095346] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-23T22:27:59.098248] [INFO ] [MAIN ] Derivative Progress: 1932/2077 symbols completed. VALE took 1.5s. Estimated remaining: 56.5s. Rate: 154.0 symbols/min [2025-09-23T22:27:59.110670] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:59.114092] [DEBUG] [LOCAL ] VEEV: Loaded 47275 existing records from primary storage. [2025-09-23T22:27:59.115082] [INFO ] [MAIN ] VEEV: Loaded 47275 primary data records. [2025-09-23T22:27:59.243967] [DEBUG] [LOCAL ] VEL: Loaded 13126 existing records from primary storage. [2025-09-23T22:27:59.250366] [INFO ] [MAIN ] VEL: Loaded 13126 primary data records. [2025-09-23T22:27:59.641990] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:59.668101] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13406 primary records. [2025-09-23T22:27:59.668343] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-23T22:27:59.867401] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-09-23T22:27:59.867991] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-23T22:27:59.870268] [INFO ] [MAIN ] Derivative Progress: 1933/2077 symbols completed. VCV took 1.1s. Estimated remaining: 56.1s. Rate: 153.9 symbols/min [2025-09-23T22:27:59.892705] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:27:59.893553] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47275 primary records. [2025-09-23T22:27:59.893785] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-23T22:27:59.915298] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-09-23T22:27:59.927906] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-23T22:27:59.930474] [INFO ] [MAIN ] Derivative Progress: 1934/2077 symbols completed. VEEV took 1.2s. Estimated remaining: 55.7s. Rate: 154.0 symbols/min [2025-09-23T22:27:59.928173] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:27:59.931452] [INFO ] [MAIN ] VEL: Generated 1793 derivative records from 13126 primary records. [2025-09-23T22:27:59.931616] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-23T22:27:59.946993] [DEBUG] [LOCAL ] VEL: Derivative data saved (1793 records). [2025-09-23T22:27:59.947054] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-23T22:27:59.949681] [INFO ] [MAIN ] Derivative Progress: 1935/2077 symbols completed. VEL took 0.9s. Estimated remaining: 55.3s. Rate: 154.0 symbols/min [2025-09-23T22:27:59.950480] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:59.950411] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:59.950947] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:27:59.970662] [DEBUG] [LOCAL ] VGI: Loaded 5174 existing records from primary storage. [2025-09-23T22:27:59.970991] [INFO ] [MAIN ] VGI: Loaded 5174 primary data records. [2025-09-23T22:28:00.337510] [DEBUG] [LOCAL ] VET: Loaded 44097 existing records from primary storage. [2025-09-23T22:28:00.338175] [INFO ] [MAIN ] VET: Loaded 44097 primary data records. [2025-09-23T22:28:00.435727] [DEBUG] [LOCAL ] VFC: Loaded 53611 existing records from primary storage. [2025-09-23T22:28:00.441246] [INFO ] [MAIN ] VFC: Loaded 53611 primary data records. [2025-09-23T22:28:00.988918] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:00.990066] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5174 primary records. [2025-09-23T22:28:00.990850] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-23T22:28:01.008529] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-09-23T22:28:01.008726] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-23T22:28:01.012160] [INFO ] [MAIN ] Derivative Progress: 1936/2077 symbols completed. VGI took 1.1s. Estimated remaining: 55.0s. Rate: 153.9 symbols/min [2025-09-23T22:28:01.012739] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:01.028739] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:01.030319] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44097 primary records. [2025-09-23T22:28:01.030490] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-23T22:28:01.063350] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:01.071195] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53611 primary records. [2025-09-23T22:28:01.072128] [DEBUG] [LOCAL ] VGM: Loaded 18238 existing records from primary storage. [2025-09-23T22:28:01.072231] [INFO ] [MAIN ] VGM: Loaded 18238 primary data records. [2025-09-23T22:28:01.072303] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-09-23T22:28:01.071839] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-23T22:28:01.072423] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-23T22:28:01.074449] [INFO ] [MAIN ] Derivative Progress: 1937/2077 symbols completed. VET took 1.1s. Estimated remaining: 54.6s. Rate: 154.0 symbols/min [2025-09-23T22:28:01.080894] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:01.190229] [DEBUG] [LOCAL ] VHI: Loaded 2886 existing records from primary storage. [2025-09-23T22:28:01.202166] [INFO ] [MAIN ] VHI: Loaded 2886 primary data records. [2025-09-23T22:28:01.255904] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-09-23T22:28:01.328214] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-23T22:28:01.501693] [INFO ] [MAIN ] Derivative Progress: 1938/2077 symbols completed. VFC took 1.4s. Estimated remaining: 54.2s. Rate: 154.0 symbols/min [2025-09-23T22:28:01.511630] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:01.814919] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:01.815701] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18238 primary records. [2025-09-23T22:28:01.816083] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-23T22:28:01.847731] [DEBUG] [LOCAL ] VICI: Loaded 53649 existing records from primary storage. [2025-09-23T22:28:01.848409] [INFO ] [MAIN ] VICI: Loaded 53649 primary data records. [2025-09-23T22:28:01.862999] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-09-23T22:28:01.874256] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-23T22:28:01.876400] [INFO ] [MAIN ] Derivative Progress: 1939/2077 symbols completed. VGM took 0.9s. Estimated remaining: 53.8s. Rate: 154.0 symbols/min [2025-09-23T22:28:01.888056] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:01.950571] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:28:01.977092] [INFO ] [MAIN ] VHI: Generated 1793 derivative records from 2886 primary records. [2025-09-23T22:28:01.981130] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-23T22:28:02.214496] [DEBUG] [LOCAL ] VHI: Derivative data saved (1793 records). [2025-09-23T22:28:02.214671] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-23T22:28:02.217073] [INFO ] [MAIN ] Derivative Progress: 1940/2077 symbols completed. VHI took 1.1s. Estimated remaining: 53.4s. Rate: 154.0 symbols/min [2025-09-23T22:28:02.217411] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:02.240507] [DEBUG] [LOCAL ] VIK: Loaded 52512 existing records from primary storage. [2025-09-23T22:28:02.240772] [INFO ] [MAIN ] VIK: Loaded 52512 primary data records. [2025-09-23T22:28:02.447292] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:02.446907] [DEBUG] [LOCAL ] VIPS: Loaded 51359 existing records from primary storage. [2025-09-23T22:28:02.464264] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53649 primary records. [2025-09-23T22:28:02.469329] [INFO ] [MAIN ] VIPS: Loaded 51359 primary data records. [2025-09-23T22:28:02.547117] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-23T22:28:02.903283] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-09-23T22:28:02.904021] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-23T22:28:02.907242] [INFO ] [MAIN ] Derivative Progress: 1941/2077 symbols completed. VICI took 1.4s. Estimated remaining: 53.0s. Rate: 153.9 symbols/min [2025-09-23T22:28:02.908833] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:02.929079] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:02.930121] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52512 primary records. [2025-09-23T22:28:02.930311] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-23T22:28:02.950567] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-09-23T22:28:02.962968] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-23T22:28:02.965051] [INFO ] [MAIN ] Derivative Progress: 1942/2077 symbols completed. VIK took 1.1s. Estimated remaining: 52.6s. Rate: 154.0 symbols/min [2025-09-23T22:28:02.965444] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:02.965779] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:02.966631] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51359 primary records. [2025-09-23T22:28:02.967179] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-23T22:28:02.996772] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-09-23T22:28:02.996947] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-23T22:28:02.999419] [INFO ] [MAIN ] Derivative Progress: 1943/2077 symbols completed. VIPS took 0.8s. Estimated remaining: 52.2s. Rate: 154.0 symbols/min [2025-09-23T22:28:03.000781] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:03.017259] [DEBUG] [LOCAL ] VIRT: Loaded 46883 existing records from primary storage. [2025-09-23T22:28:03.017563] [INFO ] [MAIN ] VIRT: Loaded 46883 primary data records. [2025-09-23T22:28:03.247923] [DEBUG] [LOCAL ] VIST: Loaded 46006 existing records from primary storage. [2025-09-23T22:28:03.252401] [INFO ] [MAIN ] VIST: Loaded 46006 primary data records. [2025-09-23T22:28:03.498870] [DEBUG] [LOCAL ] VIV: Loaded 45188 existing records from primary storage. [2025-09-23T22:28:03.511452] [INFO ] [MAIN ] VIV: Loaded 45188 primary data records. [2025-09-23T22:28:04.082799] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:04.084925] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46883 primary records. [2025-09-23T22:28:04.085485] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-23T22:28:04.120797] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:04.122076] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46006 primary records. [2025-09-23T22:28:04.122630] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-23T22:28:04.140209] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-09-23T22:28:04.142212] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-23T22:28:04.146824] [INFO ] [MAIN ] Derivative Progress: 1944/2077 symbols completed. VIRT took 1.2s. Estimated remaining: 51.9s. Rate: 153.9 symbols/min [2025-09-23T22:28:04.148963] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:04.163887] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:04.165132] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 45188 primary records. [2025-09-23T22:28:04.165483] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-09-23T22:28:04.165536] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-23T22:28:04.166205] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-23T22:28:04.168493] [INFO ] [MAIN ] Derivative Progress: 1945/2077 symbols completed. VIST took 1.2s. Estimated remaining: 51.4s. Rate: 154.0 symbols/min [2025-09-23T22:28:04.169097] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:04.201687] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-09-23T22:28:04.201223] [DEBUG] [LOCAL ] VKQ: Loaded 17404 existing records from primary storage. [2025-09-23T22:28:04.202008] [INFO ] [MAIN ] VKQ: Loaded 17404 primary data records. [2025-09-23T22:28:04.202119] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-23T22:28:04.210001] [INFO ] [MAIN ] Derivative Progress: 1946/2077 symbols completed. VIV took 1.2s. Estimated remaining: 51.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:04.219288] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:04.375587] [DEBUG] [LOCAL ] VLN: Loaded 28471 existing records from primary storage. [2025-09-23T22:28:04.379822] [INFO ] [MAIN ] VLN: Loaded 28471 primary data records. [2025-09-23T22:28:04.922937] [DEBUG] [LOCAL ] VLO: Loaded 53088 existing records from primary storage. [2025-09-23T22:28:04.924505] [INFO ] [MAIN ] VLO: Loaded 53088 primary data records. [2025-09-23T22:28:05.265465] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:05.266890] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17404 primary records. [2025-09-23T22:28:05.267603] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-23T22:28:05.300084] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:05.301536] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 28471 primary records. [2025-09-23T22:28:05.301991] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-23T22:28:05.303125] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-09-23T22:28:05.303560] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-23T22:28:05.305831] [INFO ] [MAIN ] Derivative Progress: 1947/2077 symbols completed. VKQ took 1.2s. Estimated remaining: 50.7s. Rate: 153.9 symbols/min [2025-09-23T22:28:05.306514] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:05.325709] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-09-23T22:28:05.325965] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-23T22:28:05.328165] [INFO ] [MAIN ] Derivative Progress: 1948/2077 symbols completed. VLN took 1.2s. Estimated remaining: 50.3s. Rate: 154.0 symbols/min [2025-09-23T22:28:05.341269] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:05.341989] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53088 primary records. [2025-09-23T22:28:05.342140] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-23T22:28:05.368561] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-09-23T22:28:05.368727] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-23T22:28:05.371026] [INFO ] [MAIN ] Derivative Progress: 1949/2077 symbols completed. VLO took 1.2s. Estimated remaining: 49.9s. Rate: 154.0 symbols/min [2025-09-23T22:28:05.386431] [DEBUG] [LOCAL ] VLRS: Loaded 40846 existing records from primary storage. [2025-09-23T22:28:05.386590] [INFO ] [MAIN ] VLRS: Loaded 40846 primary data records. [2025-09-23T22:28:05.711806] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:05.712476] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40846 primary records. [2025-09-23T22:28:05.712542] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-23T22:28:05.728065] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-09-23T22:28:05.728134] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-23T22:28:05.730051] [INFO ] [MAIN ] Derivative Progress: 1950/2077 symbols completed. VLRS took 0.4s. Estimated remaining: 49.5s. Rate: 154.0 symbols/min [2025-09-23T22:28:05.730948] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:05.731030] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:05.730863] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:05.738561] [DEBUG] [LOCAL ] VLT: Loaded 4588 existing records from primary storage. [2025-09-23T22:28:05.738717] [INFO ] [MAIN ] VLT: Loaded 4588 primary data records. [2025-09-23T22:28:06.114204] [DEBUG] [LOCAL ] VMC: Loaded 43793 existing records from primary storage. [2025-09-23T22:28:06.115134] [INFO ] [MAIN ] VMC: Loaded 43793 primary data records. [2025-09-23T22:28:06.127728] [DEBUG] [LOCAL ] VLTO: Loaded 45994 existing records from primary storage. [2025-09-23T22:28:06.148672] [INFO ] [MAIN ] VLTO: Loaded 45994 primary data records. [2025-09-23T22:28:06.779211] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:06.781453] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4588 primary records. [2025-09-23T22:28:06.781609] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-23T22:28:06.803673] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-09-23T22:28:06.803852] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-23T22:28:06.806351] [INFO ] [MAIN ] Derivative Progress: 1951/2077 symbols completed. VLT took 1.1s. Estimated remaining: 49.1s. Rate: 153.9 symbols/min [2025-09-23T22:28:06.806930] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:06.827107] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:06.844885] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:06.840359] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 43793 primary records. [2025-09-23T22:28:06.845869] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-23T22:28:06.845769] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 45994 primary records. [2025-09-23T22:28:06.846871] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-23T22:28:06.874137] [DEBUG] [LOCAL ] VMI: Loaded 15478 existing records from primary storage. [2025-09-23T22:28:06.879825] [INFO ] [MAIN ] VMI: Loaded 15478 primary data records. [2025-09-23T22:28:06.968424] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-09-23T22:28:06.983017] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-23T22:28:07.005902] [INFO ] [MAIN ] Derivative Progress: 1952/2077 symbols completed. VMC took 1.3s. Estimated remaining: 48.7s. Rate: 153.9 symbols/min [2025-09-23T22:28:07.029336] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:07.035688] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-09-23T22:28:07.036353] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-23T22:28:07.040004] [INFO ] [MAIN ] Derivative Progress: 1953/2077 symbols completed. VLTO took 1.3s. Estimated remaining: 48.3s. Rate: 154.0 symbols/min [2025-09-23T22:28:07.052305] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:07.362582] [DEBUG] [LOCAL ] VMO: Loaded 21025 existing records from primary storage. [2025-09-23T22:28:07.363123] [INFO ] [MAIN ] VMO: Loaded 21025 primary data records. [2025-09-23T22:28:07.361461] [DEBUG] [LOCAL ] VNCE: Loaded 7130 existing records from primary storage. [2025-09-23T22:28:07.385159] [INFO ] [MAIN ] VNCE: Loaded 7130 primary data records. [2025-09-23T22:28:08.351063] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:08.352404] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15478 primary records. [2025-09-23T22:28:08.352877] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-23T22:28:08.373934] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-09-23T22:28:08.374410] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-23T22:28:08.376558] [INFO ] [MAIN ] Derivative Progress: 1954/2077 symbols completed. VMI took 1.6s. Estimated remaining: 48.0s. Rate: 153.8 symbols/min [2025-09-23T22:28:08.376976] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:08.415714] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:08.417702] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 21025 primary records. [2025-09-23T22:28:08.417858] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-23T22:28:08.418543] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:08.419607] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 7130 primary records. [2025-09-23T22:28:08.419934] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-23T22:28:08.465999] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-09-23T22:28:08.466772] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-23T22:28:08.469245] [INFO ] [MAIN ] Derivative Progress: 1955/2077 symbols completed. VMO took 1.4s. Estimated remaining: 47.6s. Rate: 153.9 symbols/min [2025-09-23T22:28:08.470365] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:08.471444] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-09-23T22:28:08.471771] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-23T22:28:08.475027] [INFO ] [MAIN ] Derivative Progress: 1956/2077 symbols completed. VNCE took 1.4s. Estimated remaining: 47.2s. Rate: 154.0 symbols/min [2025-09-23T22:28:08.475490] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:08.492937] [DEBUG] [LOCAL ] VNO: Loaded 48999 existing records from primary storage. [2025-09-23T22:28:08.493101] [INFO ] [MAIN ] VNO: Loaded 48999 primary data records. [2025-09-23T22:28:08.577242] [DEBUG] [LOCAL ] VOC: Loaded 8936 existing records from primary storage. [2025-09-23T22:28:08.602087] [INFO ] [MAIN ] VOC: Loaded 8936 primary data records. [2025-09-23T22:28:08.863544] [DEBUG] [LOCAL ] VNT: Loaded 43968 existing records from primary storage. [2025-09-23T22:28:08.892943] [INFO ] [MAIN ] VNT: Loaded 43968 primary data records. [2025-09-23T22:28:09.494478] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:09.507908] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48999 primary records. [2025-09-23T22:28:09.508352] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-23T22:28:09.508139] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:09.510172] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8936 primary records. [2025-09-23T22:28:09.510393] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-23T22:28:09.555013] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:09.557112] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43968 primary records. [2025-09-23T22:28:09.557762] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-23T22:28:09.557408] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-09-23T22:28:09.558050] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-09-23T22:28:09.558945] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-23T22:28:09.558836] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-23T22:28:09.561304] [INFO ] [MAIN ] Derivative Progress: 1957/2077 symbols completed. VOC took 1.1s. Estimated remaining: 46.8s. Rate: 153.8 symbols/min [2025-09-23T22:28:09.569899] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:09.574707] [INFO ] [MAIN ] Derivative Progress: 1958/2077 symbols completed. VNO took 1.2s. Estimated remaining: 46.4s. Rate: 153.9 symbols/min [2025-09-23T22:28:09.575485] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:09.581689] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-09-23T22:28:09.581826] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-23T22:28:09.584243] [INFO ] [MAIN ] Derivative Progress: 1959/2077 symbols completed. VNT took 1.1s. Estimated remaining: 46.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:09.584630] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:09.596805] [DEBUG] [LOCAL ] VPV: Loaded 5371 existing records from primary storage. [2025-09-23T22:28:09.602793] [DEBUG] [LOCAL ] VPG: Loaded 17231 existing records from primary storage. [2025-09-23T22:28:09.602856] [INFO ] [MAIN ] VPV: Loaded 5371 primary data records. [2025-09-23T22:28:09.602966] [INFO ] [MAIN ] VPG: Loaded 17231 primary data records. [2025-09-23T22:28:09.934971] [DEBUG] [LOCAL ] VOYA: Loaded 42835 existing records from primary storage. [2025-09-23T22:28:10.090278] [INFO ] [MAIN ] VOYA: Loaded 42835 primary data records. [2025-09-23T22:28:10.615430] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:10.618082] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5371 primary records. [2025-09-23T22:28:10.619025] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-23T22:28:10.647862] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:10.649498] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17231 primary records. [2025-09-23T22:28:10.650146] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-23T22:28:10.664743] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-09-23T22:28:10.665514] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-23T22:28:10.668824] [INFO ] [MAIN ] Derivative Progress: 1960/2077 symbols completed. VPV took 1.1s. Estimated remaining: 45.6s. Rate: 153.8 symbols/min [2025-09-23T22:28:10.670215] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:10.676288] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-09-23T22:28:10.676473] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-23T22:28:10.686682] [INFO ] [MAIN ] Derivative Progress: 1961/2077 symbols completed. VPG took 1.1s. Estimated remaining: 45.2s. Rate: 153.9 symbols/min [2025-09-23T22:28:10.692149] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:10.693136] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:10.693065] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42835 primary records. [2025-09-23T22:28:10.693401] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-23T22:28:10.711034] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-09-23T22:28:10.711231] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-23T22:28:10.713599] [INFO ] [MAIN ] Derivative Progress: 1962/2077 symbols completed. VOYA took 1.1s. Estimated remaining: 44.8s. Rate: 154.0 symbols/min [2025-09-23T22:28:10.722963] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:10.741980] [DEBUG] [LOCAL ] VRE: Loaded 34915 existing records from primary storage. [2025-09-23T22:28:10.742198] [INFO ] [MAIN ] VRE: Loaded 34915 primary data records. [2025-09-23T22:28:10.789754] [DEBUG] [LOCAL ] VRTS: Loaded 9107 existing records from primary storage. [2025-09-23T22:28:10.810949] [INFO ] [MAIN ] VRTS: Loaded 9107 primary data records. [2025-09-23T22:28:11.175238] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-23T22:28:11.179918] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-09-23T22:28:11.802023] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:11.803409] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:11.804422] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 34915 primary records. [2025-09-23T22:28:11.805370] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9107 primary records. [2025-09-23T22:28:11.805719] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-23T22:28:11.805978] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-23T22:28:11.846314] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-09-23T22:28:11.848704] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-23T22:28:11.852606] [INFO ] [MAIN ] Derivative Progress: 1963/2077 symbols completed. VRTS took 1.1s. Estimated remaining: 44.5s. Rate: 153.8 symbols/min [2025-09-23T22:28:11.855492] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-09-23T22:28:11.868052] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-23T22:28:11.868386] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:11.870742] [INFO ] [MAIN ] Derivative Progress: 1964/2077 symbols completed. VRE took 1.2s. Estimated remaining: 44.1s. Rate: 153.9 symbols/min [2025-09-23T22:28:11.871637] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-09-23T22:28:11.871740] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-23T22:28:11.887030] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-09-23T22:28:11.887123] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-23T22:28:11.889578] [INFO ] [MAIN ] Derivative Progress: 1965/2077 symbols completed. VRT took 1.2s. Estimated remaining: 43.6s. Rate: 154.0 symbols/min [2025-09-23T22:28:11.890933] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:11.890819] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:11.890427] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:11.985128] [DEBUG] [LOCAL ] VSCO: Loaded 52871 existing records from primary storage. [2025-09-23T22:28:11.986094] [INFO ] [MAIN ] VSCO: Loaded 52871 primary data records. [2025-09-23T22:28:11.985923] [DEBUG] [LOCAL ] VSH: Loaded 48617 existing records from primary storage. [2025-09-23T22:28:11.998007] [INFO ] [MAIN ] VSH: Loaded 48617 primary data records. [2025-09-23T22:28:12.166773] [DEBUG] [LOCAL ] VST: Loaded 53720 existing records from primary storage. [2025-09-23T22:28:12.204561] [INFO ] [MAIN ] VST: Loaded 53720 primary data records. [2025-09-23T22:28:13.038153] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:13.039554] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52871 primary records. [2025-09-23T22:28:13.039693] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-23T22:28:13.070786] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:13.078905] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-09-23T22:28:13.079992] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48617 primary records. [2025-09-23T22:28:13.080105] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-23T22:28:13.080286] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-23T22:28:13.082829] [INFO ] [MAIN ] Derivative Progress: 1966/2077 symbols completed. VSCO took 1.2s. Estimated remaining: 43.3s. Rate: 153.8 symbols/min [2025-09-23T22:28:13.083284] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:13.099154] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:13.108741] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53720 primary records. [2025-09-23T22:28:13.111996] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-23T22:28:13.133477] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-09-23T22:28:13.134423] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-23T22:28:13.136717] [INFO ] [MAIN ] Derivative Progress: 1967/2077 symbols completed. VSH took 1.2s. Estimated remaining: 42.9s. Rate: 153.9 symbols/min [2025-09-23T22:28:13.137277] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:13.140761] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-09-23T22:28:13.140953] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-23T22:28:13.143555] [INFO ] [MAIN ] Derivative Progress: 1968/2077 symbols completed. VST took 1.3s. Estimated remaining: 42.5s. Rate: 154.0 symbols/min [2025-09-23T22:28:13.144101] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:13.180608] [DEBUG] [LOCAL ] VSTS: Loaded 49047 existing records from primary storage. [2025-09-23T22:28:13.180803] [INFO ] [MAIN ] VSTS: Loaded 49047 primary data records. [2025-09-23T22:28:13.422878] [DEBUG] [LOCAL ] VTEX: Loaded 43413 existing records from primary storage. [2025-09-23T22:28:13.544478] [INFO ] [MAIN ] VTEX: Loaded 43413 primary data records. [2025-09-23T22:28:13.550856] [DEBUG] [LOCAL ] VTLE: Loaded 48624 existing records from primary storage. [2025-09-23T22:28:13.578839] [INFO ] [MAIN ] VTLE: Loaded 48624 primary data records. [2025-09-23T22:28:14.202455] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:14.203386] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49047 primary records. [2025-09-23T22:28:14.203898] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-23T22:28:14.221685] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-09-23T22:28:14.223168] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-23T22:28:14.225362] [INFO ] [MAIN ] Derivative Progress: 1969/2077 symbols completed. VSTS took 1.1s. Estimated remaining: 42.1s. Rate: 153.8 symbols/min [2025-09-23T22:28:14.226584] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:14.254046] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:14.255174] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43413 primary records. [2025-09-23T22:28:14.255310] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-23T22:28:14.287000] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:14.290424] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48624 primary records. [2025-09-23T22:28:14.290532] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-23T22:28:14.286593] [DEBUG] [LOCAL ] VTMX: Loaded 17446 existing records from primary storage. [2025-09-23T22:28:14.292894] [INFO ] [MAIN ] VTMX: Loaded 17446 primary data records. [2025-09-23T22:28:14.292251] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-09-23T22:28:14.293258] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-23T22:28:14.317616] [INFO ] [MAIN ] Derivative Progress: 1970/2077 symbols completed. VTEX took 1.2s. Estimated remaining: 41.7s. Rate: 153.9 symbols/min [2025-09-23T22:28:14.343542] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:14.393517] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-09-23T22:28:14.398857] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-23T22:28:14.407834] [INFO ] [MAIN ] Derivative Progress: 1971/2077 symbols completed. VTLE took 1.3s. Estimated remaining: 41.3s. Rate: 153.9 symbols/min [2025-09-23T22:28:14.419675] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:14.505534] [DEBUG] [LOCAL ] VTN: Loaded 7265 existing records from primary storage. [2025-09-23T22:28:14.510348] [INFO ] [MAIN ] VTN: Loaded 7265 primary data records. [2025-09-23T22:28:14.739428] [DEBUG] [LOCAL ] VTOL: Loaded 19767 existing records from primary storage. [2025-09-23T22:28:14.757332] [INFO ] [MAIN ] VTOL: Loaded 19767 primary data records. [2025-09-23T22:28:15.313040] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:15.314025] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17446 primary records. [2025-09-23T22:28:15.314326] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-23T22:28:15.332889] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-09-23T22:28:15.333937] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-23T22:28:15.336739] [INFO ] [MAIN ] Derivative Progress: 1972/2077 symbols completed. VTMX took 1.1s. Estimated remaining: 41.0s. Rate: 153.8 symbols/min [2025-09-23T22:28:15.337355] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:15.351563] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:15.352757] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7265 primary records. [2025-09-23T22:28:15.352852] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-23T22:28:15.371180] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-09-23T22:28:15.371378] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-23T22:28:15.373732] [INFO ] [MAIN ] Derivative Progress: 1973/2077 symbols completed. VTN took 1.0s. Estimated remaining: 40.5s. Rate: 153.9 symbols/min [2025-09-23T22:28:15.374273] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:15.387505] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:15.388413] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19767 primary records. [2025-09-23T22:28:15.388590] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-23T22:28:15.404611] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-09-23T22:28:15.404841] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-23T22:28:15.407464] [INFO ] [MAIN ] Derivative Progress: 1974/2077 symbols completed. VTOL took 1.0s. Estimated remaining: 40.1s. Rate: 154.0 symbols/min [2025-09-23T22:28:15.407935] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:15.460903] [DEBUG] [LOCAL ] VTR: Loaded 52845 existing records from primary storage. [2025-09-23T22:28:15.468341] [DEBUG] [LOCAL ] VTS: Loaded 30554 existing records from primary storage. [2025-09-23T22:28:15.468568] [INFO ] [MAIN ] VTR: Loaded 52845 primary data records. [2025-09-23T22:28:15.468779] [INFO ] [MAIN ] VTS: Loaded 30554 primary data records. [2025-09-23T22:28:15.672944] [DEBUG] [LOCAL ] VVR: Loaded 30480 existing records from primary storage. [2025-09-23T22:28:15.714507] [INFO ] [MAIN ] VVR: Loaded 30480 primary data records. [2025-09-23T22:28:16.481843] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:16.498692] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52845 primary records. [2025-09-23T22:28:16.497900] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:16.499477] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30554 primary records. [2025-09-23T22:28:16.499566] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-23T22:28:16.498841] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-23T22:28:16.531266] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-09-23T22:28:16.539740] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-23T22:28:16.547270] [INFO ] [MAIN ] Derivative Progress: 1975/2077 symbols completed. VTS took 1.2s. Estimated remaining: 39.8s. Rate: 153.8 symbols/min [2025-09-23T22:28:16.548007] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:16.549374] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:16.550486] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 30480 primary records. [2025-09-23T22:28:16.551172] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-23T22:28:16.552878] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-09-23T22:28:16.553154] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-23T22:28:16.554991] [INFO ] [MAIN ] Derivative Progress: 1976/2077 symbols completed. VTR took 1.2s. Estimated remaining: 39.4s. Rate: 153.9 symbols/min [2025-09-23T22:28:16.563365] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:16.571510] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-09-23T22:28:16.571633] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-23T22:28:16.574347] [INFO ] [MAIN ] Derivative Progress: 1977/2077 symbols completed. VVR took 1.2s. Estimated remaining: 39.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:16.574637] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:16.593608] [DEBUG] [LOCAL ] VVX: Loaded 23369 existing records from primary storage. [2025-09-23T22:28:16.593842] [INFO ] [MAIN ] VVX: Loaded 23369 primary data records. [2025-09-23T22:28:16.762145] [DEBUG] [LOCAL ] VVV: Loaded 50212 existing records from primary storage. [2025-09-23T22:28:16.813747] [INFO ] [MAIN ] VVV: Loaded 50212 primary data records. [2025-09-23T22:28:17.023040] [DEBUG] [LOCAL ] VYX: Loaded 49075 existing records from primary storage. [2025-09-23T22:28:17.041180] [INFO ] [MAIN ] VYX: Loaded 49075 primary data records. [2025-09-23T22:28:17.600465] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:17.602096] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23369 primary records. [2025-09-23T22:28:17.602334] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-23T22:28:17.626017] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-09-23T22:28:17.626368] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-23T22:28:17.628710] [INFO ] [MAIN ] Derivative Progress: 1978/2077 symbols completed. VVX took 1.1s. Estimated remaining: 38.6s. Rate: 153.9 symbols/min [2025-09-23T22:28:17.641936] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:17.642542] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50212 primary records. [2025-09-23T22:28:17.642619] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-23T22:28:17.672327] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-09-23T22:28:17.671381] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:17.673007] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 49075 primary records. [2025-09-23T22:28:17.673084] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-23T22:28:17.675204] [INFO ] [MAIN ] Derivative Progress: 1979/2077 symbols completed. VVV took 1.1s. Estimated remaining: 38.2s. Rate: 153.9 symbols/min [2025-09-23T22:28:17.675293] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-23T22:28:17.691063] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-09-23T22:28:17.691122] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-23T22:28:17.693508] [INFO ] [MAIN ] Derivative Progress: 1980/2077 symbols completed. VYX took 1.1s. Estimated remaining: 37.8s. Rate: 154.0 symbols/min [2025-09-23T22:28:17.694123] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:17.694305] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:17.694203] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:17.774908] [DEBUG] [LOCAL ] W: Loaded 53503 existing records from primary storage. [2025-09-23T22:28:17.775204] [INFO ] [MAIN ] W: Loaded 53503 primary data records. [2025-09-23T22:28:17.911774] [DEBUG] [LOCAL ] WAB: Loaded 44280 existing records from primary storage. [2025-09-23T22:28:17.912966] [INFO ] [MAIN ] WAB: Loaded 44280 primary data records. [2025-09-23T22:28:17.940717] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-23T22:28:17.960828] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-09-23T22:28:18.801931] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:18.803251] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53503 primary records. [2025-09-23T22:28:18.803667] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-23T22:28:18.821275] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-09-23T22:28:18.821553] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-23T22:28:18.823346] [INFO ] [MAIN ] Derivative Progress: 1981/2077 symbols completed. W took 1.1s. Estimated remaining: 37.4s. Rate: 153.8 symbols/min [2025-09-23T22:28:18.823973] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:18.857705] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:18.858217] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:18.859161] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44280 primary records. [2025-09-23T22:28:18.860016] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-09-23T22:28:18.860186] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-23T22:28:18.860302] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-23T22:28:18.901192] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-09-23T22:28:18.902054] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-23T22:28:18.904950] [INFO ] [MAIN ] Derivative Progress: 1982/2077 symbols completed. VZ took 1.2s. Estimated remaining: 37.0s. Rate: 153.9 symbols/min [2025-09-23T22:28:18.905534] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:18.906535] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-09-23T22:28:18.906800] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-23T22:28:18.909290] [INFO ] [MAIN ] Derivative Progress: 1983/2077 symbols completed. WAB took 1.2s. Estimated remaining: 36.6s. Rate: 154.0 symbols/min [2025-09-23T22:28:18.909515] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:18.927767] [DEBUG] [LOCAL ] WAL: Loaded 45418 existing records from primary storage. [2025-09-23T22:28:18.927987] [INFO ] [MAIN ] WAL: Loaded 45418 primary data records. [2025-09-23T22:28:19.258763] [DEBUG] [LOCAL ] WAT: Loaded 35074 existing records from primary storage. [2025-09-23T22:28:19.259460] [INFO ] [MAIN ] WAT: Loaded 35074 primary data records. [2025-09-23T22:28:19.329376] [DEBUG] [LOCAL ] WBS: Loaded 48780 existing records from primary storage. [2025-09-23T22:28:19.329953] [INFO ] [MAIN ] WBS: Loaded 48780 primary data records. [2025-09-23T22:28:19.902482] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:19.903603] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45418 primary records. [2025-09-23T22:28:19.903821] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-23T22:28:19.923548] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-09-23T22:28:19.924223] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-23T22:28:19.926500] [INFO ] [MAIN ] Derivative Progress: 1984/2077 symbols completed. WAL took 1.1s. Estimated remaining: 36.3s. Rate: 153.9 symbols/min [2025-09-23T22:28:19.927448] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:19.947628] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:19.951969] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35074 primary records. [2025-09-23T22:28:19.959612] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-23T22:28:19.965071] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:19.966283] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48780 primary records. [2025-09-23T22:28:19.971443] [DEBUG] [LOCAL ] WBX: Loaded 12641 existing records from primary storage. [2025-09-23T22:28:19.971752] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-23T22:28:19.978982] [INFO ] [MAIN ] WBX: Loaded 12641 primary data records. [2025-09-23T22:28:20.106256] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-09-23T22:28:20.117840] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-23T22:28:20.131204] [INFO ] [MAIN ] Derivative Progress: 1985/2077 symbols completed. WBS took 1.2s. Estimated remaining: 35.9s. Rate: 153.9 symbols/min [2025-09-23T22:28:20.128734] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-09-23T22:28:20.136588] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:20.150449] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-23T22:28:20.169862] [INFO ] [MAIN ] Derivative Progress: 1986/2077 symbols completed. WAT took 1.3s. Estimated remaining: 35.5s. Rate: 154.0 symbols/min [2025-09-23T22:28:20.312917] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:20.355960] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:20.356898] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 12641 primary records. [2025-09-23T22:28:20.357163] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-23T22:28:20.384026] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-09-23T22:28:20.395819] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-23T22:28:20.397446] [DEBUG] [LOCAL ] WCC: Loaded 40057 existing records from primary storage. [2025-09-23T22:28:20.412445] [INFO ] [MAIN ] Derivative Progress: 1987/2077 symbols completed. WBX took 0.5s. Estimated remaining: 35.1s. Rate: 154.0 symbols/min [2025-09-23T22:28:20.412543] [INFO ] [MAIN ] WCC: Loaded 40057 primary data records. [2025-09-23T22:28:20.425208] [DEBUG] [LOCAL ] WCN: Loaded 48064 existing records from primary storage. [2025-09-23T22:28:20.413117] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:20.435007] [INFO ] [MAIN ] WCN: Loaded 48064 primary data records. [2025-09-23T22:28:20.782871] [DEBUG] [LOCAL ] WD: Loaded 23537 existing records from primary storage. [2025-09-23T22:28:20.965115] [INFO ] [MAIN ] WD: Loaded 23537 primary data records. [2025-09-23T22:28:21.389313] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:21.390339] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 40057 primary records. [2025-09-23T22:28:21.391429] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-23T22:28:21.413474] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:21.422797] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 48064 primary records. [2025-09-23T22:28:21.421981] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-09-23T22:28:21.422976] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-23T22:28:21.423047] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-23T22:28:21.425217] [INFO ] [MAIN ] Derivative Progress: 1988/2077 symbols completed. WCC took 1.3s. Estimated remaining: 34.7s. Rate: 153.9 symbols/min [2025-09-23T22:28:21.426725] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:21.446093] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-09-23T22:28:21.446357] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-23T22:28:21.448389] [INFO ] [MAIN ] Derivative Progress: 1989/2077 symbols completed. WCN took 1.1s. Estimated remaining: 34.3s. Rate: 153.9 symbols/min [2025-09-23T22:28:21.460838] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:21.466396] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:21.467142] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23537 primary records. [2025-09-23T22:28:21.467359] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-23T22:28:21.489153] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-09-23T22:28:21.489350] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-23T22:28:21.492269] [DEBUG] [LOCAL ] WDH: Loaded 17064 existing records from primary storage. [2025-09-23T22:28:21.491859] [INFO ] [MAIN ] Derivative Progress: 1990/2077 symbols completed. WD took 1.1s. Estimated remaining: 33.9s. Rate: 154.0 symbols/min [2025-09-23T22:28:21.492871] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:21.492559] [INFO ] [MAIN ] WDH: Loaded 17064 primary data records. [2025-09-23T22:28:21.607808] [DEBUG] [LOCAL ] WDI: Loaded 21050 existing records from primary storage. [2025-09-23T22:28:21.611324] [INFO ] [MAIN ] WDI: Loaded 21050 primary data records. [2025-09-23T22:28:21.964842] [DEBUG] [LOCAL ] WDS: Loaded 43647 existing records from primary storage. [2025-09-23T22:28:21.992297] [INFO ] [MAIN ] WDS: Loaded 43647 primary data records. [2025-09-23T22:28:22.529533] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:22.530790] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 17064 primary records. [2025-09-23T22:28:22.530890] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-23T22:28:22.548683] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-09-23T22:28:22.550459] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-23T22:28:22.553161] [INFO ] [MAIN ] Derivative Progress: 1991/2077 symbols completed. WDH took 1.1s. Estimated remaining: 33.5s. Rate: 153.9 symbols/min [2025-09-23T22:28:22.553922] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:22.567833] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:22.568480] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21050 primary records. [2025-09-23T22:28:22.568821] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-23T22:28:22.587306] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-09-23T22:28:22.587485] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-23T22:28:22.589671] [INFO ] [MAIN ] Derivative Progress: 1992/2077 symbols completed. WDI took 1.1s. Estimated remaining: 33.1s. Rate: 153.9 symbols/min [2025-09-23T22:28:22.595894] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:22.596241] [DEBUG] [LOCAL ] WEA: Loaded 7353 existing records from primary storage. [2025-09-23T22:28:22.596458] [INFO ] [MAIN ] WEA: Loaded 7353 primary data records. [2025-09-23T22:28:22.676200] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:22.689849] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43647 primary records. [2025-09-23T22:28:22.695288] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-23T22:28:22.806582] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-09-23T22:28:22.822909] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-23T22:28:22.827094] [INFO ] [MAIN ] Derivative Progress: 1993/2077 symbols completed. WDS took 1.3s. Estimated remaining: 32.7s. Rate: 154.0 symbols/min [2025-09-23T22:28:22.856833] [DEBUG] [LOCAL ] WEAV: Loaded 42058 existing records from primary storage. [2025-09-23T22:28:22.969712] [INFO ] [MAIN ] WEAV: Loaded 42058 primary data records. [2025-09-23T22:28:23.296116] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:23.296999] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7353 primary records. [2025-09-23T22:28:23.297086] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-23T22:28:23.315185] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-09-23T22:28:23.315519] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-23T22:28:23.317619] [INFO ] [MAIN ] Derivative Progress: 1994/2077 symbols completed. WEA took 0.8s. Estimated remaining: 32.3s. Rate: 154.0 symbols/min [2025-09-23T22:28:23.334702] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:23.335366] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42058 primary records. [2025-09-23T22:28:23.335427] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-23T22:28:23.351084] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-09-23T22:28:23.351200] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-23T22:28:23.353537] [INFO ] [MAIN ] Derivative Progress: 1995/2077 symbols completed. WEAV took 0.8s. Estimated remaining: 31.9s. Rate: 154.0 symbols/min [2025-09-23T22:28:23.354527] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:23.354693] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:23.354227] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:23.444027] [DEBUG] [LOCAL ] WEC: Loaded 52213 existing records from primary storage. [2025-09-23T22:28:23.445906] [INFO ] [MAIN ] WEC: Loaded 52213 primary data records. [2025-09-23T22:28:23.458079] [DEBUG] [LOCAL ] WES: Loaded 48023 existing records from primary storage. [2025-09-23T22:28:23.528814] [INFO ] [MAIN ] WES: Loaded 48023 primary data records. [2025-09-23T22:28:23.541862] [DEBUG] [LOCAL ] WELL: Loaded 52359 existing records from primary storage. [2025-09-23T22:28:23.569018] [INFO ] [MAIN ] WELL: Loaded 52359 primary data records. [2025-09-23T22:28:24.453226] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:24.455506] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52213 primary records. [2025-09-23T22:28:24.470511] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-23T22:28:24.492992] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:24.496895] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48023 primary records. [2025-09-23T22:28:24.497195] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-23T22:28:24.493525] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:24.501831] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-09-23T22:28:24.502122] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-23T22:28:24.503046] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52359 primary records. [2025-09-23T22:28:24.510357] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-23T22:28:24.515697] [INFO ] [MAIN ] Derivative Progress: 1996/2077 symbols completed. WEC took 1.2s. Estimated remaining: 31.6s. Rate: 153.9 symbols/min [2025-09-23T22:28:24.516871] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:24.522475] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-09-23T22:28:24.531488] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-23T22:28:24.536765] [INFO ] [MAIN ] Derivative Progress: 1997/2077 symbols completed. WES took 1.2s. Estimated remaining: 31.2s. Rate: 153.9 symbols/min [2025-09-23T22:28:24.539880] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:24.541527] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-09-23T22:28:24.541699] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-23T22:28:24.544763] [INFO ] [MAIN ] Derivative Progress: 1998/2077 symbols completed. WELL took 1.2s. Estimated remaining: 30.8s. Rate: 154.0 symbols/min [2025-09-23T22:28:24.545480] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:24.557865] [DEBUG] [LOCAL ] WF: Loaded 10870 existing records from primary storage. [2025-09-23T22:28:24.558036] [INFO ] [MAIN ] WF: Loaded 10870 primary data records. [2025-09-23T22:28:24.720945] [DEBUG] [LOCAL ] WEX: Loaded 35399 existing records from primary storage. [2025-09-23T22:28:24.737246] [INFO ] [MAIN ] WEX: Loaded 35399 primary data records. [2025-09-23T22:28:25.063232] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-23T22:28:25.092831] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-09-23T22:28:25.568898] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:25.570178] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10870 primary records. [2025-09-23T22:28:25.570532] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-23T22:28:25.589441] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-09-23T22:28:25.590010] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-23T22:28:25.591903] [INFO ] [MAIN ] Derivative Progress: 1999/2077 symbols completed. WF took 1.1s. Estimated remaining: 30.4s. Rate: 153.9 symbols/min [2025-09-23T22:28:25.592462] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:25.606103] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:25.607119] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 35399 primary records. [2025-09-23T22:28:25.607284] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-23T22:28:25.626481] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-09-23T22:28:25.626735] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-23T22:28:25.628984] [INFO ] [MAIN ] Derivative Progress: 2000/2077 symbols completed. WEX took 1.1s. Estimated remaining: 30.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:25.629286] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:25.642776] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:25.643493] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-09-23T22:28:25.643671] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-23T22:28:25.665312] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-09-23T22:28:25.665419] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-23T22:28:25.667896] [INFO ] [MAIN ] Derivative Progress: 2001/2077 symbols completed. WFC took 1.1s. Estimated remaining: 29.6s. Rate: 154.0 symbols/min [2025-09-23T22:28:25.675283] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:25.677311] [DEBUG] [LOCAL ] WFG: Loaded 24918 existing records from primary storage. [2025-09-23T22:28:25.677587] [INFO ] [MAIN ] WFG: Loaded 24918 primary data records. [2025-09-23T22:28:25.998312] [DEBUG] [LOCAL ] WGO: Loaded 39379 existing records from primary storage. [2025-09-23T22:28:25.998564] [INFO ] [MAIN ] WGO: Loaded 39379 primary data records. [2025-09-23T22:28:26.144031] [DEBUG] [LOCAL ] WH: Loaded 45807 existing records from primary storage. [2025-09-23T22:28:26.184355] [INFO ] [MAIN ] WH: Loaded 45807 primary data records. [2025-09-23T22:28:26.553156] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:26.701594] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24918 primary records. [2025-09-23T22:28:26.709529] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-23T22:28:26.737186] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-09-23T22:28:26.737977] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-23T22:28:26.739904] [INFO ] [MAIN ] Derivative Progress: 2002/2077 symbols completed. WFG took 1.1s. Estimated remaining: 29.2s. Rate: 153.9 symbols/min [2025-09-23T22:28:26.741207] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:26.757955] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:26.758947] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 39379 primary records. [2025-09-23T22:28:26.759137] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-23T22:28:26.779688] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-09-23T22:28:26.780293] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-23T22:28:26.782451] [INFO ] [MAIN ] Derivative Progress: 2003/2077 symbols completed. WGO took 1.2s. Estimated remaining: 28.8s. Rate: 154.0 symbols/min [2025-09-23T22:28:26.782780] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:26.809095] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:26.810035] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45807 primary records. [2025-09-23T22:28:26.810202] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-23T22:28:26.812748] [DEBUG] [LOCAL ] WHG: Loaded 3395 existing records from primary storage. [2025-09-23T22:28:26.813483] [INFO ] [MAIN ] WHG: Loaded 3395 primary data records. [2025-09-23T22:28:26.886950] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-09-23T22:28:26.914986] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-23T22:28:26.925057] [INFO ] [MAIN ] Derivative Progress: 2004/2077 symbols completed. WH took 1.3s. Estimated remaining: 28.4s. Rate: 154.0 symbols/min [2025-09-23T22:28:26.931127] [DEBUG] [LOCAL ] WHD: Loaded 40569 existing records from primary storage. [2025-09-23T22:28:26.955670] [INFO ] [MAIN ] WHD: Loaded 40569 primary data records. [2025-09-23T22:28:26.951825] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:27.502687] [DEBUG] [LOCAL ] WHR: Loaded 48114 existing records from primary storage. [2025-09-23T22:28:27.503305] [INFO ] [MAIN ] WHR: Loaded 48114 primary data records. [2025-09-23T22:28:27.819945] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:27.821148] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3395 primary records. [2025-09-23T22:28:27.821350] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-23T22:28:27.839196] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-09-23T22:28:27.839471] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-23T22:28:27.842482] [INFO ] [MAIN ] Derivative Progress: 2005/2077 symbols completed. WHG took 1.1s. Estimated remaining: 28.1s. Rate: 153.9 symbols/min [2025-09-23T22:28:27.844985] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:27.858278] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:27.859115] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40569 primary records. [2025-09-23T22:28:27.859298] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-23T22:28:27.876788] [DEBUG] [LOCAL ] WIA: Loaded 4863 existing records from primary storage. [2025-09-23T22:28:27.878815] [INFO ] [MAIN ] WIA: Loaded 4863 primary data records. [2025-09-23T22:28:27.902493] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-09-23T22:28:27.913737] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-23T22:28:27.921112] [INFO ] [MAIN ] Derivative Progress: 2006/2077 symbols completed. WHD took 1.2s. Estimated remaining: 27.7s. Rate: 154.0 symbols/min [2025-09-23T22:28:27.921434] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:28.053605] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:28.071521] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48114 primary records. [2025-09-23T22:28:28.095219] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-23T22:28:28.206867] [DEBUG] [LOCAL ] WINN: Loaded 11865 existing records from primary storage. [2025-09-23T22:28:28.220846] [INFO ] [MAIN ] WINN: Loaded 11865 primary data records. [2025-09-23T22:28:28.293562] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-09-23T22:28:28.302900] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-23T22:28:28.305332] [INFO ] [MAIN ] Derivative Progress: 2007/2077 symbols completed. WHR took 1.4s. Estimated remaining: 27.3s. Rate: 154.0 symbols/min [2025-09-23T22:28:28.335385] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:28.638351] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:28.639696] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4863 primary records. [2025-09-23T22:28:28.653468] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-23T22:28:28.670495] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-09-23T22:28:28.670731] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-23T22:28:28.673348] [INFO ] [MAIN ] Derivative Progress: 2008/2077 symbols completed. WIA took 0.8s. Estimated remaining: 26.9s. Rate: 154.0 symbols/min [2025-09-23T22:28:28.689998] [DEBUG] [LOCAL ] WIT: Loaded 52285 existing records from primary storage. [2025-09-23T22:28:28.690351] [INFO ] [MAIN ] WIT: Loaded 52285 primary data records. [2025-09-23T22:28:28.817578] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:28:28.828680] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11865 primary records. [2025-09-23T22:28:28.833891] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-23T22:28:29.018310] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-09-23T22:28:29.018861] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-23T22:28:29.021257] [INFO ] [MAIN ] Derivative Progress: 2009/2077 symbols completed. WINN took 1.1s. Estimated remaining: 26.5s. Rate: 154.0 symbols/min [2025-09-23T22:28:29.042072] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:29.042867] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52285 primary records. [2025-09-23T22:28:29.042935] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-23T22:28:29.058431] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-09-23T22:28:29.058506] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-23T22:28:29.060893] [INFO ] [MAIN ] Derivative Progress: 2010/2077 symbols completed. WIT took 0.8s. Estimated remaining: 26.1s. Rate: 154.1 symbols/min [2025-09-23T22:28:29.061626] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:29.061751] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:29.061974] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:29.084013] [DEBUG] [LOCAL ] WIW: Loaded 20769 existing records from primary storage. [2025-09-23T22:28:29.084313] [INFO ] [MAIN ] WIW: Loaded 20769 primary data records. [2025-09-23T22:28:29.222351] [DEBUG] [LOCAL ] WKC: Loaded 35151 existing records from primary storage. [2025-09-23T22:28:29.234269] [INFO ] [MAIN ] WKC: Loaded 35151 primary data records. [2025-09-23T22:28:29.245719] [DEBUG] [LOCAL ] WK: Loaded 36653 existing records from primary storage. [2025-09-23T22:28:29.291578] [INFO ] [MAIN ] WK: Loaded 36653 primary data records. [2025-09-23T22:28:30.071385] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:30.072530] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20769 primary records. [2025-09-23T22:28:30.072781] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-23T22:28:30.106986] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:30.108450] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 35151 primary records. [2025-09-23T22:28:30.109111] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-09-23T22:28:30.109049] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-23T22:28:30.109572] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-23T22:28:30.111711] [INFO ] [MAIN ] Derivative Progress: 2011/2077 symbols completed. WIW took 1.1s. Estimated remaining: 25.7s. Rate: 153.9 symbols/min [2025-09-23T22:28:30.112381] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:30.136895] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:30.141008] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-09-23T22:28:30.141109] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-23T22:28:30.141850] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 36653 primary records. [2025-09-23T22:28:30.141958] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-23T22:28:30.145004] [INFO ] [MAIN ] Derivative Progress: 2012/2077 symbols completed. WKC took 1.1s. Estimated remaining: 25.3s. Rate: 154.0 symbols/min [2025-09-23T22:28:30.145522] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:30.161015] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-09-23T22:28:30.161110] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-23T22:28:30.163992] [INFO ] [MAIN ] Derivative Progress: 2013/2077 symbols completed. WK took 1.1s. Estimated remaining: 24.9s. Rate: 154.1 symbols/min [2025-09-23T22:28:30.164383] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:30.171595] [DEBUG] [LOCAL ] WLKP: Loaded 6653 existing records from primary storage. [2025-09-23T22:28:30.171769] [INFO ] [MAIN ] WLKP: Loaded 6653 primary data records. [2025-09-23T22:28:30.457714] [DEBUG] [LOCAL ] WLK: Loaded 45411 existing records from primary storage. [2025-09-23T22:28:30.503722] [DEBUG] [LOCAL ] WLY: Loaded 30209 existing records from primary storage. [2025-09-23T22:28:30.497788] [INFO ] [MAIN ] WLK: Loaded 45411 primary data records. [2025-09-23T22:28:30.517495] [INFO ] [MAIN ] WLY: Loaded 30209 primary data records. [2025-09-23T22:28:31.194182] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:31.195046] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6653 primary records. [2025-09-23T22:28:31.195330] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-23T22:28:31.213163] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-09-23T22:28:31.213477] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-23T22:28:31.215592] [INFO ] [MAIN ] Derivative Progress: 2014/2077 symbols completed. WLKP took 1.1s. Estimated remaining: 24.6s. Rate: 153.9 symbols/min [2025-09-23T22:28:31.217963] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:31.235144] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:31.248727] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 30209 primary records. [2025-09-23T22:28:31.249226] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-23T22:28:31.249161] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:31.250368] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45411 primary records. [2025-09-23T22:28:31.250756] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-23T22:28:31.283362] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-09-23T22:28:31.282187] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-09-23T22:28:31.283545] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-23T22:28:31.286508] [INFO ] [MAIN ] Derivative Progress: 2015/2077 symbols completed. WLK took 1.2s. Estimated remaining: 24.2s. Rate: 154.0 symbols/min [2025-09-23T22:28:31.286713] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-23T22:28:31.289493] [INFO ] [MAIN ] Derivative Progress: 2016/2077 symbols completed. WLY took 1.1s. Estimated remaining: 23.8s. Rate: 154.1 symbols/min [2025-09-23T22:28:31.287076] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:31.290200] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:31.318871] [DEBUG] [LOCAL ] WMK: Loaded 14549 existing records from primary storage. [2025-09-23T22:28:31.319010] [INFO ] [MAIN ] WMK: Loaded 14549 primary data records. [2025-09-23T22:28:31.424381] [DEBUG] [LOCAL ] WM: Loaded 50959 existing records from primary storage. [2025-09-23T22:28:31.446479] [INFO ] [MAIN ] WM: Loaded 50959 primary data records. [2025-09-23T22:28:31.787715] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-23T22:28:31.798263] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-09-23T22:28:32.306205] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:32.307783] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14549 primary records. [2025-09-23T22:28:32.308729] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-23T22:28:32.339040] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-09-23T22:28:32.338121] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:32.339253] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-23T22:28:32.340031] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50959 primary records. [2025-09-23T22:28:32.342390] [INFO ] [MAIN ] Derivative Progress: 2017/2077 symbols completed. WMK took 1.1s. Estimated remaining: 23.4s. Rate: 153.9 symbols/min [2025-09-23T22:28:32.342718] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:32.340283] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-23T22:28:32.361990] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-09-23T22:28:32.362262] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-23T22:28:32.364772] [INFO ] [MAIN ] Derivative Progress: 2018/2077 symbols completed. WM took 1.1s. Estimated remaining: 23.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:32.372629] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:32.378198] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:32.378933] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-09-23T22:28:32.379099] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-23T22:28:32.398241] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-09-23T22:28:32.398385] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-23T22:28:32.400796] [INFO ] [MAIN ] Derivative Progress: 2019/2077 symbols completed. WMB took 1.1s. Estimated remaining: 22.6s. Rate: 154.1 symbols/min [2025-09-23T22:28:32.401193] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:32.438356] [DEBUG] [LOCAL ] WMS: Loaded 39642 existing records from primary storage. [2025-09-23T22:28:32.438587] [INFO ] [MAIN ] WMS: Loaded 39642 primary data records. [2025-09-23T22:28:32.582916] [DEBUG] [LOCAL ] WNC: Loaded 40165 existing records from primary storage. [2025-09-23T22:28:32.588280] [INFO ] [MAIN ] WNC: Loaded 40165 primary data records. [2025-09-23T22:28:32.600213] [DEBUG] [LOCAL ] WNS: Loaded 39966 existing records from primary storage. [2025-09-23T22:28:32.648528] [INFO ] [MAIN ] WNS: Loaded 39966 primary data records. [2025-09-23T22:28:33.451487] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:33.452466] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39642 primary records. [2025-09-23T22:28:33.452674] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-23T22:28:33.486847] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-09-23T22:28:33.487382] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:33.488404] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 40165 primary records. [2025-09-23T22:28:33.487598] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-23T22:28:33.488602] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-23T22:28:33.492561] [INFO ] [MAIN ] Derivative Progress: 2020/2077 symbols completed. WMS took 1.1s. Estimated remaining: 22.2s. Rate: 154.0 symbols/min [2025-09-23T22:28:33.492894] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:33.512704] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-09-23T22:28:33.525231] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-23T22:28:33.530483] [INFO ] [MAIN ] Derivative Progress: 2021/2077 symbols completed. WNC took 1.2s. Estimated remaining: 21.8s. Rate: 154.0 symbols/min [2025-09-23T22:28:33.531064] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:33.531804] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 39966 primary records. [2025-09-23T22:28:33.532163] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-23T22:28:33.532252] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:33.550462] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-09-23T22:28:33.550729] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-23T22:28:33.553201] [INFO ] [MAIN ] Derivative Progress: 2022/2077 symbols completed. WNS took 1.2s. Estimated remaining: 21.4s. Rate: 154.1 symbols/min [2025-09-23T22:28:33.553632] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:33.597343] [DEBUG] [LOCAL ] WOR: Loaded 24614 existing records from primary storage. [2025-09-23T22:28:33.597671] [INFO ] [MAIN ] WOR: Loaded 24614 primary data records. [2025-09-23T22:28:33.690684] [DEBUG] [LOCAL ] WOW: Loaded 30117 existing records from primary storage. [2025-09-23T22:28:33.701750] [INFO ] [MAIN ] WOW: Loaded 30117 primary data records. [2025-09-23T22:28:33.780532] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-23T22:28:33.835925] [INFO ] [MAIN ] WOLF: Loaded 53532 primary data records. [2025-09-23T22:28:34.606714] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:34.608415] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24614 primary records. [2025-09-23T22:28:34.610271] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-23T22:28:34.641074] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-09-23T22:28:34.641526] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-23T22:28:34.641463] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:34.643300] [INFO ] [MAIN ] Derivative Progress: 2023/2077 symbols completed. WOR took 1.1s. Estimated remaining: 21.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:34.656326] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30117 primary records. [2025-09-23T22:28:34.657283] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:34.656972] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-23T22:28:34.658899] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53532 primary records. [2025-09-23T22:28:34.658995] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-23T22:28:34.689046] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-09-23T22:28:34.690265] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-09-23T22:28:34.690398] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-23T22:28:34.692891] [INFO ] [MAIN ] Derivative Progress: 2024/2077 symbols completed. WOLF took 1.2s. Estimated remaining: 20.6s. Rate: 154.0 symbols/min [2025-09-23T22:28:34.693015] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-23T22:28:34.695768] [INFO ] [MAIN ] Derivative Progress: 2025/2077 symbols completed. WOW took 1.1s. Estimated remaining: 20.2s. Rate: 154.1 symbols/min [2025-09-23T22:28:34.696361] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:34.696524] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:34.696923] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:34.766559] [DEBUG] [LOCAL ] WPC: Loaded 48608 existing records from primary storage. [2025-09-23T22:28:34.765878] [DEBUG] [LOCAL ] WPP: Loaded 33736 existing records from primary storage. [2025-09-23T22:28:34.766854] [INFO ] [MAIN ] WPC: Loaded 48608 primary data records. [2025-09-23T22:28:34.767021] [INFO ] [MAIN ] WPP: Loaded 33736 primary data records. [2025-09-23T22:28:35.040238] [DEBUG] [LOCAL ] WPM: Loaded 52728 existing records from primary storage. [2025-09-23T22:28:35.123574] [INFO ] [MAIN ] WPM: Loaded 52728 primary data records. [2025-09-23T22:28:35.758424] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:35.758705] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:35.760097] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48608 primary records. [2025-09-23T22:28:35.760206] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-23T22:28:35.759492] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33736 primary records. [2025-09-23T22:28:35.760666] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-23T22:28:35.790670] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-09-23T22:28:35.792492] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-09-23T22:28:35.792592] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-23T22:28:35.794739] [INFO ] [MAIN ] Derivative Progress: 2026/2077 symbols completed. WPP took 1.1s. Estimated remaining: 19.9s. Rate: 154.0 symbols/min [2025-09-23T22:28:35.792710] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-23T22:28:35.797579] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:35.797787] [INFO ] [MAIN ] Derivative Progress: 2027/2077 symbols completed. WPC took 1.1s. Estimated remaining: 19.5s. Rate: 154.0 symbols/min [2025-09-23T22:28:35.799591] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:35.813854] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:35.814492] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52728 primary records. [2025-09-23T22:28:35.814633] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-23T22:28:35.830519] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-09-23T22:28:35.830610] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-23T22:28:35.833079] [INFO ] [MAIN ] Derivative Progress: 2028/2077 symbols completed. WPM took 1.1s. Estimated remaining: 19.1s. Rate: 154.1 symbols/min [2025-09-23T22:28:35.833476] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:35.882246] [DEBUG] [LOCAL ] WS: Loaded 23862 existing records from primary storage. [2025-09-23T22:28:35.882433] [INFO ] [MAIN ] WS: Loaded 23862 primary data records. [2025-09-23T22:28:36.025056] [DEBUG] [LOCAL ] WRBY: Loaded 50882 existing records from primary storage. [2025-09-23T22:28:36.013754] [DEBUG] [LOCAL ] WRB: Loaded 50581 existing records from primary storage. [2025-09-23T22:28:36.030403] [INFO ] [MAIN ] WRBY: Loaded 50882 primary data records. [2025-09-23T22:28:36.025240] [INFO ] [MAIN ] WRB: Loaded 50581 primary data records. [2025-09-23T22:28:36.898895] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:36.899980] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23862 primary records. [2025-09-23T22:28:36.900151] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-23T22:28:36.920383] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-09-23T22:28:36.922207] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-23T22:28:36.944988] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:36.931774] [INFO ] [MAIN ] Derivative Progress: 2029/2077 symbols completed. WS took 1.1s. Estimated remaining: 18.7s. Rate: 154.0 symbols/min [2025-09-23T22:28:36.950765] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50882 primary records. [2025-09-23T22:28:36.951389] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:36.952277] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50581 primary records. [2025-09-23T22:28:36.952628] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:36.952809] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-23T22:28:36.951561] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-23T22:28:36.986170] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-09-23T22:28:36.986280] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-23T22:28:36.983967] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-09-23T22:28:36.988874] [INFO ] [MAIN ] Derivative Progress: 2030/2077 symbols completed. WRBY took 1.2s. Estimated remaining: 18.3s. Rate: 154.0 symbols/min [2025-09-23T22:28:36.989408] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:36.989116] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-23T22:28:36.992250] [INFO ] [MAIN ] Derivative Progress: 2031/2077 symbols completed. WRB took 1.2s. Estimated remaining: 17.9s. Rate: 154.1 symbols/min [2025-09-23T22:28:36.992973] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:37.044405] [DEBUG] [LOCAL ] WSR: Loaded 23361 existing records from primary storage. [2025-09-23T22:28:37.044896] [DEBUG] [LOCAL ] WSO: Loaded 24720 existing records from primary storage. [2025-09-23T22:28:37.045676] [INFO ] [MAIN ] WSO: Loaded 24720 primary data records. [2025-09-23T22:28:37.045765] [INFO ] [MAIN ] WSR: Loaded 23361 primary data records. [2025-09-23T22:28:37.241262] [DEBUG] [LOCAL ] WSM: Loaded 49906 existing records from primary storage. [2025-09-23T22:28:37.283619] [INFO ] [MAIN ] WSM: Loaded 49906 primary data records. [2025-09-23T22:28:38.009089] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:38.014597] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:38.015288] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 23361 primary records. [2025-09-23T22:28:38.015438] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-23T22:28:38.016451] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24720 primary records. [2025-09-23T22:28:38.016963] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-23T22:28:38.040109] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-09-23T22:28:38.041277] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-23T22:28:38.046210] [INFO ] [MAIN ] Derivative Progress: 2032/2077 symbols completed. WSR took 1.1s. Estimated remaining: 17.5s. Rate: 154.0 symbols/min [2025-09-23T22:28:38.046860] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:38.051268] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-09-23T22:28:38.051368] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-23T22:28:38.053604] [INFO ] [MAIN ] Derivative Progress: 2033/2077 symbols completed. WSO took 1.1s. Estimated remaining: 17.1s. Rate: 154.0 symbols/min [2025-09-23T22:28:38.055140] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:38.070579] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:38.071311] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49906 primary records. [2025-09-23T22:28:38.071494] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-23T22:28:38.091144] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-09-23T22:28:38.091330] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-23T22:28:38.094462] [INFO ] [MAIN ] Derivative Progress: 2034/2077 symbols completed. WSM took 1.1s. Estimated remaining: 16.7s. Rate: 154.1 symbols/min [2025-09-23T22:28:38.094850] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:38.134255] [DEBUG] [LOCAL ] WST: Loaded 37595 existing records from primary storage. [2025-09-23T22:28:38.134556] [INFO ] [MAIN ] WST: Loaded 37595 primary data records. [2025-09-23T22:28:38.262021] [DEBUG] [LOCAL ] WT: Loaded 47621 existing records from primary storage. [2025-09-23T22:28:38.262296] [INFO ] [MAIN ] WT: Loaded 47621 primary data records. [2025-09-23T22:28:38.321559] [DEBUG] [LOCAL ] WTI: Loaded 43736 existing records from primary storage. [2025-09-23T22:28:38.394532] [INFO ] [MAIN ] WTI: Loaded 43736 primary data records. [2025-09-23T22:28:39.136536] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:39.137403] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 37595 primary records. [2025-09-23T22:28:39.137672] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-23T22:28:39.154339] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-09-23T22:28:39.154512] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-23T22:28:39.156546] [INFO ] [MAIN ] Derivative Progress: 2035/2077 symbols completed. WST took 1.1s. Estimated remaining: 16.4s. Rate: 154.0 symbols/min [2025-09-23T22:28:39.157113] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:39.188967] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:39.189999] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43736 primary records. [2025-09-23T22:28:39.190321] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-23T22:28:39.190241] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:39.191885] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47621 primary records. [2025-09-23T22:28:39.191968] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-23T22:28:39.224364] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-09-23T22:28:39.224123] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-09-23T22:28:39.224509] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-23T22:28:39.224573] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-23T22:28:39.227253] [INFO ] [MAIN ] Derivative Progress: 2036/2077 symbols completed. WT took 1.2s. Estimated remaining: 16.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:39.230076] [INFO ] [MAIN ] Derivative Progress: 2037/2077 symbols completed. WTI took 1.1s. Estimated remaining: 15.6s. Rate: 154.1 symbols/min [2025-09-23T22:28:39.230217] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:39.230419] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:39.264617] [DEBUG] [LOCAL ] WTS: Loaded 18514 existing records from primary storage. [2025-09-23T22:28:39.264825] [INFO ] [MAIN ] WTS: Loaded 18514 primary data records. [2025-09-23T22:28:39.383983] [DEBUG] [LOCAL ] WTRG: Loaded 50937 existing records from primary storage. [2025-09-23T22:28:39.384349] [INFO ] [MAIN ] WTRG: Loaded 50937 primary data records. [2025-09-23T22:28:39.703738] [DEBUG] [LOCAL ] WTTR: Loaded 45098 existing records from primary storage. [2025-09-23T22:28:39.708565] [INFO ] [MAIN ] WTTR: Loaded 45098 primary data records. [2025-09-23T22:28:40.239503] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:40.240401] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 18514 primary records. [2025-09-23T22:28:40.240904] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-23T22:28:40.260799] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-09-23T22:28:40.261133] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-23T22:28:40.275714] [INFO ] [MAIN ] Derivative Progress: 2038/2077 symbols completed. WTS took 1.0s. Estimated remaining: 15.2s. Rate: 154.0 symbols/min [2025-09-23T22:28:40.276578] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:40.277499] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50937 primary records. [2025-09-23T22:28:40.277674] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-23T22:28:40.296325] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-09-23T22:28:40.296607] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-23T22:28:40.299338] [INFO ] [MAIN ] Derivative Progress: 2039/2077 symbols completed. WTRG took 1.1s. Estimated remaining: 14.8s. Rate: 154.1 symbols/min [2025-09-23T22:28:40.312013] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:40.312565] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 45098 primary records. [2025-09-23T22:28:40.312624] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-23T22:28:40.327700] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-09-23T22:28:40.327758] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-23T22:28:40.330448] [INFO ] [MAIN ] Derivative Progress: 2040/2077 symbols completed. WTTR took 1.1s. Estimated remaining: 14.4s. Rate: 154.1 symbols/min [2025-09-23T22:28:40.331150] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:40.331258] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:40.332154] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:40.405818] [DEBUG] [LOCAL ] WU: Loaded 53454 existing records from primary storage. [2025-09-23T22:28:40.418970] [INFO ] [MAIN ] WU: Loaded 53454 primary data records. [2025-09-23T22:28:40.476786] [DEBUG] [LOCAL ] WWW: Loaded 49188 existing records from primary storage. [2025-09-23T22:28:40.489496] [DEBUG] [LOCAL ] WY: Loaded 53118 existing records from primary storage. [2025-09-23T22:28:40.511351] [INFO ] [MAIN ] WY: Loaded 53118 primary data records. [2025-09-23T22:28:40.516584] [INFO ] [MAIN ] WWW: Loaded 49188 primary data records. [2025-09-23T22:28:41.384872] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:41.398185] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53118 primary records. [2025-09-23T22:28:41.398771] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:41.399476] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53454 primary records. [2025-09-23T22:28:41.399735] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-23T22:28:41.398892] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-23T22:28:41.434257] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-09-23T22:28:41.435143] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-23T22:28:41.438532] [INFO ] [MAIN ] Derivative Progress: 2041/2077 symbols completed. WY took 1.1s. Estimated remaining: 14.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:41.435071] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-09-23T22:28:41.451518] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-23T22:28:41.453684] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:41.453596] [INFO ] [MAIN ] Derivative Progress: 2042/2077 symbols completed. WU took 1.1s. Estimated remaining: 13.6s. Rate: 154.1 symbols/min [2025-09-23T22:28:41.454105] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:41.454297] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:41.455586] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49188 primary records. [2025-09-23T22:28:41.455816] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-23T22:28:41.473012] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-09-23T22:28:41.473133] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-23T22:28:41.475638] [INFO ] [MAIN ] Derivative Progress: 2043/2077 symbols completed. WWW took 1.1s. Estimated remaining: 13.2s. Rate: 154.1 symbols/min [2025-09-23T22:28:41.476030] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:41.510991] [DEBUG] [LOCAL ] XFLT: Loaded 30138 existing records from primary storage. [2025-09-23T22:28:41.511157] [INFO ] [MAIN ] XFLT: Loaded 30138 primary data records. [2025-09-23T22:28:41.658007] [DEBUG] [LOCAL ] XHR: Loaded 44220 existing records from primary storage. [2025-09-23T22:28:41.722042] [INFO ] [MAIN ] XHR: Loaded 44220 primary data records. [2025-09-23T22:28:41.878591] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-23T22:28:41.926458] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-09-23T22:28:42.536125] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:28:42.538147] [INFO ] [MAIN ] XFLT: Generated 1793 derivative records from 30138 primary records. [2025-09-23T22:28:42.538250] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-23T22:28:42.556377] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1793 records). [2025-09-23T22:28:42.556610] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-23T22:28:42.558827] [INFO ] [MAIN ] Derivative Progress: 2044/2077 symbols completed. XFLT took 1.1s. Estimated remaining: 12.9s. Rate: 154.0 symbols/min [2025-09-23T22:28:42.559152] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:42.573116] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:42.574042] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 44220 primary records. [2025-09-23T22:28:42.574260] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-23T22:28:42.592462] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-09-23T22:28:42.592699] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-23T22:28:42.595295] [INFO ] [MAIN ] Derivative Progress: 2045/2077 symbols completed. XHR took 1.1s. Estimated remaining: 12.5s. Rate: 154.1 symbols/min [2025-09-23T22:28:42.608627] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:42.609051] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:42.617546] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-09-23T22:28:42.617783] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-23T22:28:42.634683] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-09-23T22:28:42.642725] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-23T22:28:42.646491] [INFO ] [MAIN ] Derivative Progress: 2046/2077 symbols completed. XOM took 1.2s. Estimated remaining: 12.1s. Rate: 154.1 symbols/min [2025-09-23T22:28:42.646919] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:42.647926] [DEBUG] [LOCAL ] XPER: Loaded 29640 existing records from primary storage. [2025-09-23T22:28:42.648434] [INFO ] [MAIN ] XPER: Loaded 29640 primary data records. [2025-09-23T22:28:42.984816] [DEBUG] [LOCAL ] XPEV: Loaded 53641 existing records from primary storage. [2025-09-23T22:28:42.985126] [INFO ] [MAIN ] XPEV: Loaded 53641 primary data records. [2025-09-23T22:28:43.140974] [DEBUG] [LOCAL ] XPO: Loaded 48148 existing records from primary storage. [2025-09-23T22:28:43.169090] [INFO ] [MAIN ] XPO: Loaded 48148 primary data records. [2025-09-23T22:28:43.643143] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:43.644228] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 29640 primary records. [2025-09-23T22:28:43.644519] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-23T22:28:43.661465] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-09-23T22:28:43.662141] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-23T22:28:43.664680] [INFO ] [MAIN ] Derivative Progress: 2047/2077 symbols completed. XPER took 1.1s. Estimated remaining: 11.7s. Rate: 154.0 symbols/min [2025-09-23T22:28:43.665926] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:43.683620] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:43.684432] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53641 primary records. [2025-09-23T22:28:43.684615] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-23T22:28:43.714176] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-09-23T22:28:43.714508] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-23T22:28:43.724591] [INFO ] [MAIN ] Derivative Progress: 2048/2077 symbols completed. XPEV took 1.1s. Estimated remaining: 11.3s. Rate: 154.1 symbols/min [2025-09-23T22:28:43.729952] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:43.730633] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:43.731341] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 48148 primary records. [2025-09-23T22:28:43.731489] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-23T22:28:43.759433] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-09-23T22:28:43.755233] [DEBUG] [LOCAL ] XPOF: Loaded 38831 existing records from primary storage. [2025-09-23T22:28:43.759683] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-23T22:28:43.759758] [INFO ] [MAIN ] XPOF: Loaded 38831 primary data records. [2025-09-23T22:28:43.763037] [INFO ] [MAIN ] Derivative Progress: 2049/2077 symbols completed. XPO took 1.1s. Estimated remaining: 10.9s. Rate: 154.2 symbols/min [2025-09-23T22:28:43.768633] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:44.101340] [DEBUG] [LOCAL ] XYF: Loaded 28034 existing records from primary storage. [2025-09-23T22:28:44.107794] [INFO ] [MAIN ] XYF: Loaded 28034 primary data records. [2025-09-23T22:28:44.107700] [DEBUG] [LOCAL ] XPRO: Loaded 46074 existing records from primary storage. [2025-09-23T22:28:44.153571] [INFO ] [MAIN ] XPRO: Loaded 46074 primary data records. [2025-09-23T22:28:44.790491] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:44.791679] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 38831 primary records. [2025-09-23T22:28:44.791901] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-23T22:28:44.815112] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-09-23T22:28:44.827745] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-23T22:28:44.830188] [INFO ] [MAIN ] Derivative Progress: 2050/2077 symbols completed. XPOF took 1.2s. Estimated remaining: 10.5s. Rate: 154.0 symbols/min [2025-09-23T22:28:44.831043] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:44.830814] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:44.832460] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28034 primary records. [2025-09-23T22:28:44.832717] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-23T22:28:44.851364] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-09-23T22:28:44.851566] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-23T22:28:44.853918] [INFO ] [MAIN ] Derivative Progress: 2051/2077 symbols completed. XYF took 1.1s. Estimated remaining: 10.1s. Rate: 154.1 symbols/min [2025-09-23T22:28:44.866769] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:44.867029] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:44.867795] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 46074 primary records. [2025-09-23T22:28:44.868149] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-23T22:28:44.884577] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-09-23T22:28:44.884793] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-23T22:28:44.887584] [INFO ] [MAIN ] Derivative Progress: 2052/2077 symbols completed. XPRO took 1.2s. Estimated remaining: 9.7s. Rate: 154.2 symbols/min [2025-09-23T22:28:44.887926] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:44.926087] [DEBUG] [LOCAL ] YALA: Loaded 37425 existing records from primary storage. [2025-09-23T22:28:44.927069] [INFO ] [MAIN ] YALA: Loaded 37425 primary data records. [2025-09-23T22:28:44.999913] [DEBUG] [LOCAL ] XYL: Loaded 48125 existing records from primary storage. [2025-09-23T22:28:45.021595] [INFO ] [MAIN ] XYL: Loaded 48125 primary data records. [2025-09-23T22:28:45.138586] [DEBUG] [LOCAL ] YELP: Loaded 45370 existing records from primary storage. [2025-09-23T22:28:45.174493] [INFO ] [MAIN ] YELP: Loaded 45370 primary data records. [2025-09-23T22:28:45.926194] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:45.927590] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37425 primary records. [2025-09-23T22:28:45.927947] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-23T22:28:45.959839] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-09-23T22:28:45.960705] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:45.960773] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-23T22:28:45.961504] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 48125 primary records. [2025-09-23T22:28:45.963483] [INFO ] [MAIN ] Derivative Progress: 2053/2077 symbols completed. YALA took 1.1s. Estimated remaining: 9.3s. Rate: 154.0 symbols/min [2025-09-23T22:28:45.964706] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-23T22:28:45.992814] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:45.994542] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-09-23T22:28:45.995210] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45370 primary records. [2025-09-23T22:28:45.995369] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-23T22:28:45.995306] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-23T22:28:45.997984] [INFO ] [MAIN ] Derivative Progress: 2054/2077 symbols completed. XYL took 1.2s. Estimated remaining: 9.0s. Rate: 154.1 symbols/min [2025-09-23T22:28:46.013116] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-09-23T22:28:46.013175] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-23T22:28:46.015861] [INFO ] [MAIN ] Derivative Progress: 2055/2077 symbols completed. YELP took 1.1s. Estimated remaining: 8.6s. Rate: 154.2 symbols/min [2025-09-23T22:28:46.016466] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:46.016404] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:46.017123] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:46.059834] [DEBUG] [LOCAL ] YEXT: Loaded 43298 existing records from primary storage. [2025-09-23T22:28:46.060060] [INFO ] [MAIN ] YEXT: Loaded 43298 primary data records. [2025-09-23T22:28:46.276577] [DEBUG] [LOCAL ] YOU: Loaded 49867 existing records from primary storage. [2025-09-23T22:28:46.277277] [DEBUG] [LOCAL ] YETI: Loaded 52472 existing records from primary storage. [2025-09-23T22:28:46.277782] [INFO ] [MAIN ] YOU: Loaded 49867 primary data records. [2025-09-23T22:28:46.277925] [INFO ] [MAIN ] YETI: Loaded 52472 primary data records. [2025-09-23T22:28:47.080897] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:47.081993] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43298 primary records. [2025-09-23T22:28:47.082300] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-23T22:28:47.110980] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-09-23T22:28:47.117415] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-23T22:28:47.120386] [INFO ] [MAIN ] Derivative Progress: 2056/2077 symbols completed. YEXT took 1.1s. Estimated remaining: 8.2s. Rate: 154.0 symbols/min [2025-09-23T22:28:47.120798] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:47.121201] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:47.122420] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49867 primary records. [2025-09-23T22:28:47.130064] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-23T22:28:47.136348] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:47.137319] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52472 primary records. [2025-09-23T22:28:47.137414] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-23T22:28:47.153246] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-09-23T22:28:47.160842] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-23T22:28:47.163392] [INFO ] [MAIN ] Derivative Progress: 2057/2077 symbols completed. YOU took 1.1s. Estimated remaining: 7.8s. Rate: 154.1 symbols/min [2025-09-23T22:28:47.164998] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:47.174677] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-09-23T22:28:47.174886] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-23T22:28:47.177591] [INFO ] [MAIN ] Derivative Progress: 2058/2077 symbols completed. YETI took 1.2s. Estimated remaining: 7.4s. Rate: 154.2 symbols/min [2025-09-23T22:28:47.177985] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:47.187470] [DEBUG] [LOCAL ] YRD: Loaded 12584 existing records from primary storage. [2025-09-23T22:28:47.187586] [INFO ] [MAIN ] YRD: Loaded 12584 primary data records. [2025-09-23T22:28:47.409845] [DEBUG] [LOCAL ] YSG: Loaded 24977 existing records from primary storage. [2025-09-23T22:28:47.437703] [INFO ] [MAIN ] YSG: Loaded 24977 primary data records. [2025-09-23T22:28:47.438360] [DEBUG] [LOCAL ] YPF: Loaded 50493 existing records from primary storage. [2025-09-23T22:28:47.546452] [INFO ] [MAIN ] YPF: Loaded 50493 primary data records. [2025-09-23T22:28:48.152625] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:48.153788] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12584 primary records. [2025-09-23T22:28:48.154033] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-23T22:28:48.172406] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-09-23T22:28:48.173480] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-23T22:28:48.176730] [INFO ] [MAIN ] Derivative Progress: 2059/2077 symbols completed. YRD took 1.0s. Estimated remaining: 7.0s. Rate: 154.0 symbols/min [2025-09-23T22:28:48.178085] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:48.194162] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:28:48.195079] [INFO ] [MAIN ] YSG: Generated 1793 derivative records from 24977 primary records. [2025-09-23T22:28:48.195250] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-23T22:28:48.215626] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:48.224233] [DEBUG] [LOCAL ] YSG: Derivative data saved (1793 records). [2025-09-23T22:28:48.223555] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50493 primary records. [2025-09-23T22:28:48.224386] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-23T22:28:48.224456] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-23T22:28:48.226695] [INFO ] [MAIN ] Derivative Progress: 2060/2077 symbols completed. YSG took 1.0s. Estimated remaining: 6.6s. Rate: 154.1 symbols/min [2025-09-23T22:28:48.227848] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:48.243976] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-09-23T22:28:48.244083] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-23T22:28:48.246710] [INFO ] [MAIN ] Derivative Progress: 2061/2077 symbols completed. YPF took 1.1s. Estimated remaining: 6.2s. Rate: 154.2 symbols/min [2025-09-23T22:28:48.247064] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:48.286183] [DEBUG] [LOCAL ] YUM: Loaded 51264 existing records from primary storage. [2025-09-23T22:28:48.286448] [INFO ] [MAIN ] YUM: Loaded 51264 primary data records. [2025-09-23T22:28:48.479895] [DEBUG] [LOCAL ] YUMC: Loaded 52708 existing records from primary storage. [2025-09-23T22:28:48.651452] [INFO ] [MAIN ] YUMC: Loaded 52708 primary data records. [2025-09-23T22:28:48.675272] [DEBUG] [LOCAL ] ZBH: Loaded 51247 existing records from primary storage. [2025-09-23T22:28:48.707029] [INFO ] [MAIN ] ZBH: Loaded 51247 primary data records. [2025-09-23T22:28:49.301073] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:49.302358] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51264 primary records. [2025-09-23T22:28:49.302618] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-23T22:28:49.319725] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-09-23T22:28:49.320878] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-23T22:28:49.324113] [INFO ] [MAIN ] Derivative Progress: 2062/2077 symbols completed. YUM took 1.1s. Estimated remaining: 5.8s. Rate: 154.1 symbols/min [2025-09-23T22:28:49.325298] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:49.341293] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:49.342228] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52708 primary records. [2025-09-23T22:28:49.342391] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-23T22:28:49.355593] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:49.364561] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 51247 primary records. [2025-09-23T22:28:49.364681] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-23T22:28:49.395593] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-09-23T22:28:49.396726] [DEBUG] [LOCAL ] ZEPP: Loaded 16807 existing records from primary storage. [2025-09-23T22:28:49.397347] [INFO ] [MAIN ] ZEPP: Loaded 16807 primary data records. [2025-09-23T22:28:49.397455] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-23T22:28:49.412174] [INFO ] [MAIN ] Derivative Progress: 2063/2077 symbols completed. ZBH took 1.2s. Estimated remaining: 5.5s. Rate: 154.1 symbols/min [2025-09-23T22:28:49.422119] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-09-23T22:28:49.442988] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:49.437472] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-23T22:28:49.450767] [INFO ] [MAIN ] Derivative Progress: 2064/2077 symbols completed. YUMC took 1.2s. Estimated remaining: 5.1s. Rate: 154.2 symbols/min [2025-09-23T22:28:49.480801] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:49.751323] [DEBUG] [LOCAL ] ZGN: Loaded 40910 existing records from primary storage. [2025-09-23T22:28:49.768255] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-23T22:28:49.768383] [INFO ] [MAIN ] ZETA: Loaded 53595 primary data records. [2025-09-23T22:28:49.767276] [INFO ] [MAIN ] ZGN: Loaded 40910 primary data records. [2025-09-23T22:28:50.004914] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-23T22:28:50.027346] [INFO ] [MAIN ] ZEPP: Generated 1792 derivative records from 16807 primary records. [2025-09-23T22:28:50.048014] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-23T22:28:50.413622] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1792 records). [2025-09-23T22:28:50.413944] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-23T22:28:50.416127] [INFO ] [MAIN ] Derivative Progress: 2065/2077 symbols completed. ZEPP took 1.1s. Estimated remaining: 4.7s. Rate: 154.1 symbols/min [2025-09-23T22:28:50.417995] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:50.451177] [DEBUG] [LOCAL ] ZH: Loaded 26759 existing records from primary storage. [2025-09-23T22:28:50.451549] [INFO ] [MAIN ] ZH: Loaded 26759 primary data records. [2025-09-23T22:28:50.512052] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:50.519908] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53595 primary records. [2025-09-23T22:28:50.506639] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:50.531817] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-23T22:28:50.546276] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40910 primary records. [2025-09-23T22:28:50.553986] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-23T22:28:50.657940] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-09-23T22:28:50.687589] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-23T22:28:50.690164] [INFO ] [MAIN ] Derivative Progress: 2066/2077 symbols completed. ZETA took 1.3s. Estimated remaining: 4.3s. Rate: 154.1 symbols/min [2025-09-23T22:28:50.753066] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:50.842989] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-09-23T22:28:50.843089] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-23T22:28:50.845764] [INFO ] [MAIN ] Derivative Progress: 2067/2077 symbols completed. ZGN took 1.4s. Estimated remaining: 3.9s. Rate: 154.1 symbols/min [2025-09-23T22:28:50.846162] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:50.873198] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:50.884119] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 26759 primary records. [2025-09-23T22:28:50.884306] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-23T22:28:50.899752] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-09-23T22:28:50.912777] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-23T22:28:50.915046] [INFO ] [MAIN ] Derivative Progress: 2068/2077 symbols completed. ZH took 0.5s. Estimated remaining: 3.5s. Rate: 154.2 symbols/min [2025-09-23T22:28:50.929205] [DEBUG] [LOCAL ] ZIP: Loaded 44413 existing records from primary storage. [2025-09-23T22:28:50.929396] [INFO ] [MAIN ] ZIP: Loaded 44413 primary data records. [2025-09-23T22:28:51.054564] [DEBUG] [LOCAL ] ZIM: Loaded 53542 existing records from primary storage. [2025-09-23T22:28:51.065263] [INFO ] [MAIN ] ZIM: Loaded 53542 primary data records. [2025-09-23T22:28:51.582604] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:51.583737] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 44413 primary records. [2025-09-23T22:28:51.584082] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-23T22:28:51.615769] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:51.617220] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53542 primary records. [2025-09-23T22:28:51.617527] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-23T22:28:51.619049] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-09-23T22:28:51.619357] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-23T22:28:51.628496] [INFO ] [MAIN ] Derivative Progress: 2069/2077 symbols completed. ZIP took 0.8s. Estimated remaining: 3.1s. Rate: 154.1 symbols/min [2025-09-23T22:28:51.636374] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-09-23T22:28:51.636446] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-23T22:28:51.638374] [INFO ] [MAIN ] Derivative Progress: 2070/2077 symbols completed. ZIM took 0.9s. Estimated remaining: 2.7s. Rate: 154.2 symbols/min [2025-09-23T22:28:51.639124] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:51.639310] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:51.639016] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:51.649944] [DEBUG] [LOCAL ] ZKH: Loaded 8058 existing records from primary storage. [2025-09-23T22:28:51.650092] [INFO ] [MAIN ] ZKH: Loaded 8058 primary data records. [2025-09-23T22:28:51.994074] [DEBUG] [LOCAL ] ZK: Loaded 40229 existing records from primary storage. [2025-09-23T22:28:52.009104] [INFO ] [MAIN ] ZK: Loaded 40229 primary data records. [2025-09-23T22:28:52.145392] [DEBUG] [LOCAL ] ZTO: Loaded 49981 existing records from primary storage. [2025-09-23T22:28:52.176074] [INFO ] [MAIN ] ZTO: Loaded 49981 primary data records. [2025-09-23T22:28:52.716916] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:28:52.718023] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 8058 primary records. [2025-09-23T22:28:52.718376] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-23T22:28:52.741525] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-09-23T22:28:52.744505] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-23T22:28:52.747007] [INFO ] [MAIN ] Derivative Progress: 2071/2077 symbols completed. ZKH took 1.1s. Estimated remaining: 2.3s. Rate: 154.1 symbols/min [2025-09-23T22:28:52.755756] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:52.761961] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:52.763040] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 40229 primary records. [2025-09-23T22:28:52.766293] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-23T22:28:52.782605] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-09-23T22:28:52.782767] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-23T22:28:52.785121] [INFO ] [MAIN ] Derivative Progress: 2072/2077 symbols completed. ZK took 1.1s. Estimated remaining: 1.9s. Rate: 154.1 symbols/min [2025-09-23T22:28:52.785579] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:52.813362] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:52.814498] [DEBUG] [LOCAL ] ZTR: Loaded 16720 existing records from primary storage. [2025-09-23T22:28:52.815357] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49981 primary records. [2025-09-23T22:28:52.815604] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-23T22:28:52.815728] [INFO ] [MAIN ] ZTR: Loaded 16720 primary data records. [2025-09-23T22:28:52.917108] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-09-23T22:28:52.927894] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-23T22:28:52.940991] [INFO ] [MAIN ] Derivative Progress: 2073/2077 symbols completed. ZTO took 1.3s. Estimated remaining: 1.6s. Rate: 154.2 symbols/min [2025-09-23T22:28:52.941364] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:53.165557] [DEBUG] [LOCAL ] ZTS: Loaded 53002 existing records from primary storage. [2025-09-23T22:28:53.175225] [INFO ] [MAIN ] ZTS: Loaded 53002 primary data records. [2025-09-23T22:28:53.277666] [DEBUG] [LOCAL ] ZVIA: Loaded 35414 existing records from primary storage. [2025-09-23T22:28:53.291125] [INFO ] [MAIN ] ZVIA: Loaded 35414 primary data records. [2025-09-23T22:28:53.815056] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:53.816302] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16720 primary records. [2025-09-23T22:28:53.816427] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-23T22:28:53.833769] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-09-23T22:28:53.833957] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-23T22:28:53.836333] [INFO ] [MAIN ] Derivative Progress: 2074/2077 symbols completed. ZTR took 1.1s. Estimated remaining: 1.2s. Rate: 154.1 symbols/min [2025-09-23T22:28:53.837679] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-23T22:28:53.860127] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-23T22:28:53.861126] [INFO ] [MAIN ] ZTS: Generated 1793 derivative records from 53002 primary records. [2025-09-23T22:28:53.861513] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-23T22:28:53.901126] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:53.902452] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35414 primary records. [2025-09-23T22:28:53.902593] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-23T22:28:53.917040] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1793 records). [2025-09-23T22:28:53.928593] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-23T22:28:53.931425] [INFO ] [MAIN ] Derivative Progress: 2075/2077 symbols completed. ZTS took 1.1s. Estimated remaining: 0.8s. Rate: 154.1 symbols/min [2025-09-23T22:28:53.934299] [DEBUG] [LOCAL ] ZWS: Loaded 42484 existing records from primary storage. [2025-09-23T22:28:53.934886] [INFO ] [MAIN ] ZWS: Loaded 42484 primary data records. [2025-09-23T22:28:54.004853] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-09-23T22:28:54.015690] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-23T22:28:54.028597] [INFO ] [MAIN ] Derivative Progress: 2076/2077 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.4s. Rate: 154.2 symbols/min [2025-09-23T22:28:54.244704] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-23T22:28:54.245388] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42484 primary records. [2025-09-23T22:28:54.245452] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-23T22:28:54.260432] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-09-23T22:28:54.260490] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-23T22:28:54.262492] [INFO ] [MAIN ] Derivative Progress: 2077/2077 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 154.2 symbols/min [2025-09-23T22:28:54.264669] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 28s [2025-09-23T22:28:54.264810] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2077/2077 symbols) [2025-09-23T22:28:54.939224] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2077/2077 @ 100.00%)' [2025-09-23T22:28:54.940357] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-23T22:28:54.940562] [INFO ] [STATE ] Last completion updated: 2025-09-23T22:28:54.940448